ilitirit
5 hours ago
I've all but given up on these types of approaches. Models will often just ignore your process instructions at the most inopportune moments. For work, I've resorted to mostly just using single agents for smallish pieces of work that I orchestrate myself. I treat it as a tool, with me being the craftsman.
Everyone is pushing Agent Fleets and Swarms, and I'm sure that there are many success stories, but from our internal experiments many devs don't see any speed advantage for complex work. Here's what one of them told us recently: "The speed advantage is offset by the manual refactoring work. The code is 'correct', but it's just not what any of us would have written".
Now one could argue that you could just ignore the code if it's working (that is in fact what Ex Co instructed us to do) and just keep running these fleets if the end result "works", but I'm not fully convinced this will end well in the long term.
Then again, I'm stuck with decades of legacy code and systems that noone understands that were introduced by humans...
ngruhn
4 hours ago
First I wasn't sure if technical debt still matters but I think it absolutely does. As long as I'm involved in the planning phase at all, the complexity of the code base still bubbles up to me. Claude will say: ok we can build that but how should we handle legacy code paths A,B,C,D that no one needs and I wasn't even aware existed.
arccy
3 hours ago
even better when "legacy" means something Claude added without explicit instruction, maybe in the same session, for edge cases that can't happen
cyanydeez
3 hours ago
I think the current LLMs benefit from the modular design, but also from things humans would hate: arbitrary uniqueness. If you have three services, your main() function better just be a single call to a unique function else they're going to slowly lose track of which one you're talking about.
I broke apart a 1k length script into functional components because the local AI just couldn't figure out where edits landed. But once that was complete, it had no problem tweaking features in those scopes.
I think the real TAM is local coding models starting around 32GB sometime in 2027. Obviously, Capitalism gets to decide what we're blessed with but knowing that you can get Qwen3.8-Flash-Next running at around 40GB VRAM with SSD offloading means data centers are either going to become way more efficient, or they're going to die on the vine.
onli
5 hours ago
> Then again, I'm stuck with decades of legacy code and systems that noone understands that were introduced by humans...
But that's despite many efforts made to keep that code understandable, maybe even documented. If now that's not even tried the results will be a thousand times worse - and the dependency on the LLM absolute.
chickensong
4 hours ago
> many devs don't see any speed advantage for complex work
Swarms don't necessarily need to be about speed. You can get a lot of value from small swarms doing things like analysis or verification work.
DanielHB
4 hours ago
The only time I ever few like I need agent swarms is when I am doing mechanical whole-codebase migrations/verification.
The LLMs are so much faster than I can check the output anyway. If I have a long-running task I just work on another one in parallel while I wait on the first one.
Chris2048
40 minutes ago
> Models will often just ignore your process instructions
Many are using a sub, which means (AFAIK) you can't override the system prompt:
https://platform.claude.com/docs/en/release-notes/system-pro...
I imagine it's harder to follow relevant instructions once they are buried in a mass of otherwise irrelevant, but undifferentiated instructions.
chrisjj
2 hours ago
> The code is 'correct', but it's just not what any of us would have written".
I'd fine with not what we'd have written ... if it worked.
Trying ChatGPT for a simple one page of HTML JS having draggables, I said clamp touch point to visible viewpoint. Fine. Then I said add 3x drag gain. It put that after the clamp, whereas anyone/thing having an ounce of intelligence would have urecognised the only possible purpose of the clamp and so put the gain before.
This is fundamentally why we cannot trust stochastic parrots to code. They lack the human's understanding of purpose which cannot be abstracted from the code yet is essential for success.