noelwelsh
2 days ago
This rhetoric (and it is rhetoric, in that it is designed to persuade) too often lacks nuance. Generating a 3 minute stand alone video is impressive, but it is a different task from generating code that must be consistent with an existing mountain of code. Generating code that implements a straightforward feature within an existing system is different to generating code that must make architectural decisions in novel domain or with a novel architecture. The Navier-Stokes result is impressive but 1) they spent a bajillion tokens / currency units to achieve it and 2) AFAIK all the recent mathematics results have been counterexamples, which are a different beast to proofs.
My own experience, pootling around with Claude like a peasant, is that it is simultaneously amazing at some tasks and an absolute moron at others. The more abstract the reasoning required, the worse it is.
fugaziboutit
a day ago
What you're described is 'the jagged frontier,' a term coined by Mollick in 2023 (along with fellow authors Fabrizio Dell'Acqua, Edward McFowland III, Hila Lifshitz-Assaf, Katherine Kellogg, Saran Rajendran, Thierry Laurent, Edouard Cudre-Mauroux, François Candelon, and Karim R. Lakhani).
If you'd read his rhetoric earlier you would have encountered the concept years ago and perhaps it would have raised his estimation in your eyes.
lowbloodsugar
2 days ago
Yeah, I work on secure networking libraries and AI does things that compile but void the security whenever I give it free rein. But it seems that for boring management shit, stuff that I, an autistic recluse, really prefer to avoid, it’s great.