I procrastinate by building tools to stop me from procrastinating: A sad story

15 pointsposted 15 hours ago
by thisislorenzov

Item id: 48489109

7 Comments

Yahyaaa

5 hours ago

How do you prevent the rule system itself from becoming the thing you end up tinkering with instead of actually using it for focus?

thisislorenzov

5 hours ago

You don't. Or at least, I don't, hence the title.

lionelgarnier

14 hours ago

Was going to try this tonight, but, well... tomorrow. Jokes aside, I like the part with the visual layer over mitmproxy addons. Question: since custom nodes run unsandboxed, how are you thinking about the "let an LLM write the policies" angle?

thisislorenzov

14 hours ago

Assuming that we're not dealing with bizantine failures (e.g. the LLM has not been hijacked/compromised), the worst that can happen is that it introduces some nodes with blocking calls and our local machine traffic stops. At that point, we can just disable the proxy and check where the LLM fucked up.

The bizantine failure assumption is fundamental though: If by any chance some LLM injects a rule like "send traffic to xyz", the story changes.

As usual, always doublecheck the LLM work. Triple-check it whenever redirection of traffic is involved.

galsapir

15 hours ago

i feel like i've had exactly the same thought in the past :-0 might even have written about it. feel your pain