I gave four coding agents $100 budget to build a PDF editor

11 pointsposted 8 hours ago
by nielstron

5 Comments

Boltgolt

3 hours ago

I think the biggest difference is how the feedback loop used to work when hand coding. The pdf colors being inverted in dark mode is a bug i could see myself accidentally create, but i would've seen that immediately when testing if dark mode works at all

nielstron

5 hours ago

I gave 4 coding agents a $100 budget to build a functional PDF editor. The implementations are okay, but not great: within a few clicks I find bugs in almost all of them. I hypothesize that this is partly because agents don’t interact with software like humans: they don’t pursue concrete goals and experience friction on their way, and they also just look at the UI much less. In consequence, unless we change the way LLMs operate, we will be cursed with annoying SlopWare.

MiroslavPokorny

8 hours ago

Why reinvent the wheel ?

What new value add are you attempting to create ?