theteapot
8 hours ago
> While I’m certain that this technology is producing some productivity improvements, I’m still genuinely (and frustratingly) unsure just how much of an improvement it is actually creating.
I often wonder how much more productive I'd be if just a fraction the effort and money poured into LLMs was spent on better API documentation and conventional coding tools. A lot of the time, I'm resorting to using an AI because I can't get information on how the current API of some-thing works into my brain fast enough, because the docs are non existent, outdated, or scattered and hard to collate.
nunez
3 hours ago
This is facts. All of this talk about putting agent skills directly into repos (as Markdown!) is maddening. "Where were LITERALLY ALL OF YOU whenever the topic of docs as code came up?"
This is doubly maddening with NotebookLMs. They are becoming single sources of knowledge for large domains, which is great (except you can't just read the sources, which is very "We will read the Bible to you" energy), but, in the past, this knowledge would've been all over SharePoint, Slack, Google Drive, Confluence, etc.
raincole
3 hours ago
> I often wonder how much more productive I'd be if just a fraction the effort and money poured into LLMs was spent on better API documentation and conventional coding tools.
Probably negligible. It's not a problem you can solve by pouring more money in. Evidence: configuration file format. I've never seen programmers who enjoy writing YAML. And pure JSON (without comments) is simply not a format should be written by humans. But as far as I know even in the richest companies these formats are still common. And the bad thing they were supposed to replace, XML config, was popularized by rich companies too...!
heavyset_go
27 minutes ago
I love YAML, so there is at least one weirdo out there on the internet who is bitter that TOML and JSON won
Gud
an hour ago
JSON is not designed as a configuration file format.
Rapzid
3 hours ago
I feel like Google search results have gotten tremendously worse over the past 2 years too. It's almost like you have to use AI search to find anything useful now.
Which of course reduces traffic to sites and thus the incentives to create the content you're looking for in the first place :(
alex43578
2 hours ago
There’s many groups that “win” by making search results worse. It’s an ongoing battle between them, and if someone’s blaming solely Google for it, they’re way oversimplifying.
jmalicki
8 hours ago
My favorite thing is when some projects now have better documentation in their Claude skills or MCPs than they ever did for users.
yks
8 hours ago
But that documentation itself is likely AI-generated
jmalicki
8 hours ago
At least it saves me from having to generate the docs myself!
danappelxx
3 hours ago
There is natural incentive for engineers working on a project to keep Claude skills up to date. I cannot say the same for general documentation.
cousin_it
36 minutes ago
But maybe not for long. When we get long-running AIs, the knowledge locked inside the AI's thinking might supplant docs once again. Like if you had an engineer working at your company for a long time and knowing everything. With all the problems that implies, of course.
MichaelZuo
7 hours ago
Why continue involvement with a project that clearly devalues their “customers” or “users” who care about documentation?
jmalicki
7 hours ago
Projects that spend time on documentation for my robots have shown me they care about my use case!
tomrod
8 hours ago
As someone who does broad activities, it supercharges a lot of things. Having a critical eye is required though. I estimate 40%-60% improvements on basic coding tasks.
I don't bring huge codebases to it.
LAC-Tech
8 hours ago
Yeah I get this impression too. AI feels like it's papering over overwrought and badly designed frameworks, tech stacks with far too many things in them, and also the decline of people creating or advocating for really expressive languages.
Pragmatic sure, but we're building a tower of chairs here rather than building ladders like a real engineering field.
luckydata
6 hours ago
then you should be delighted we have LLMs one of the use cases they are best suited to is writing documentation, much better than humans can.
fyrn_
3 hours ago
Good is debatable. The docs I want point out the weird shit in the system. The AI docs I've read are all basically "the get user endpoint can be called with HTTP to get a user, given a valid auth token". Thanks, it would have been faster to read the code.
nunez
3 hours ago
They write good _looking_ documentation. How good those docs are is entirely on the person/people who prompted them into existence.
heavyset_go
3 hours ago
Please don't inflict LLM docs on people