Aurornis
14 hours ago
The subtitle is:
> I already did.
They repeat multiple times in the article that asking Claude was something they already did. So this isn’t an anti-LLM article.
This seems to be a communication problem. The other party either doesn’t know that they’ve put a lot of effort into researching this already, or their trying to give a gentle let-down instead of saying they don’t have time for this.
For the first case, the solution is to explain what you did to reach this point. People are more interested in helping those who have already tried helping themselves.
The second case is more of a social situation with an infinite number of explanations. Some times you have to read the room and realize that someone may not be interested in having those conversations with you. Some times it’s only in the moment (we all have bad days where we want to be left alone) but other times it’s a signal that they’re not interested in discussing this topic with you or maybe even anyone else.
jeffnash
9 hours ago
I agree 100%. I've been the resident 'tech guy' among my friends and family for as long as I can remember, and I thought that LLMs would be the definite end to all 'blurry picture of computer screen captioned with "what should I do"' texts, yet that didn't seem to be the case. In fact, LLMs made it worse, as it actually made me seem more knowledgeable; I would be the one asking AI on their behalf and responding with beautifully formatted, easy to understand answers, encouraging them to ask me more.
I chuckled because, as a joke to express my frustration about this, I made a website called djfa.ai (Dude, Just Fucking Ask AI), which is essentially LMGTFY for ChatGPT. As one can imagine, the gimmick wore off rather quickly with my loved ones (turns out moms of nerds sometimes ask their children tech questions because they miss their voice). I ended up haphazardly turning it into my personal blog, which I sometimes choose to abbreviate and sometimes not on my resume.
I would never have made it in the first place had most of the people asking me questions been like Yael: seeking my informed opinion on thought-provoking questions they'd already researched. Going back to your larger point about the social aspect of it all, even among my wife and my social group, "just ask Claude" is almost the new "I don't really know" or "that's a tough one" when it comes to any sort of question. Almost colloquial in the sense that it isn't to be taken literally, but more as an indication of uncertainty.
JumpCrisscross
13 hours ago
> the solution is to explain what you did to reach this point
It's also helpful to the problem-solving and learning processes. For the expert, knowing what you've tried and how it didn't work refines the set of potential problems. For you, it's a free opportunity to get feedback on your methods from someone with domain expertise.
Animats
14 hours ago
When I post a technical question in Forums, I usually add something like "Tried Copilot, got useless answer ...". The trouble with asking an LLM is that there are a huge number of people (this predates LLMs) who post answers on forums along the lines of "turn it off and turn it on again" LLMs pick that up as the consensus solution.
II2II
12 hours ago
Something tells me people's milage varies based upon how they prompt the LLM. I spent about half an hour using traditional web searches to tackle a software configuration problem today, then about another half an hour poking around the system to see if I could find a solution, then about half an hour with an LLM. Not once was I told by the LLM to use the consensus solution of reinstalling the operating system even though it was clearly bumbling around much as I was earlier. (Eventually I decided to go with the consensus decision.)
BobbyTables2
13 hours ago
I actually hate reading posts that go “I can’t understand/fix this problem. Tried LLM…”
To me, such screams “I’m too lazy to do anything more than ask a LLM. I’ve tried nothing and I’m all out of ideas”
Show me you put a modicum effort and aren’t just looking to be spoon-fed the content from the first Google result that would have been found.
jagged-chisel
13 hours ago
I get exasperated with the inexperience that I have run across for decades. Yes, I frobnicated the frobnitz, I transmogrified the bit twiddler, I wizzled the wobnosticator, (and this decade, I talked the three LLMs), and the problem still exists. What I really need to know is how the transmogrification affects frobnication, but no one has ever touched that configuration.
“Why would you even want to do that?”
I dunno, man, it’s the job I was given. Do you know or not? No. No one does.
I take a week to figure it out, I come back to the forum to post my response, and it’s automatically closed as off-topic.
*sigh*
voxgen
13 hours ago
There is a third case where the other party doesn't realize that the asker lacks the relevant experience to discern good LLM answers from bad answers for that topic.
Same solution as case one though - don't be afraid to say "Claude said X but that doesn't sound right".
14u2c
13 hours ago
Depending on the question that possibility can be quite rare these days. If you ask “How does x work in this codebase?”, it will read a bunch of files and give you a very likely to be accurate answer. If your using a platform without that context and ask it something more abstract, well, your mileage will vary.
mlinhares
13 hours ago
Here's the problem, countering a lie or hallucination takes much more energy than asking Claude something and saying its true. Its the same as trying to fight misinformation on the internet, the amount of energy you have to spend to prove someone is lying or fabricating data is very high.
And having to do this on the corporate environment saps the energy and time of people that could be doing something productive by wasting their time answering a clueless person that asked an LLM about something they don't understand, got the answer they wanted (but that isn't real), and now are asking multiple people to prove it can't be done.
Here's an example, a PM decided they wanted to build a metrics framework, to track team success, with high level metrics. They asked claude to build such high level metrics (out of nowhere, these metrics don't exist), it happily produced hallucinated code that said it was collecting the metrics and the PR opened a pull request. Now we have to go there, review, find out is all bullshit and explain to the person that what they're trying to build doesn't exist.
So now we have to fight misinformation even on the clock.
ChrisMarshallNY
11 hours ago
Honestly, I think she feels that it’s a new way to say “GOFY.”
She’s a journalist, and, from what I can see, a pretty good one. Someone that is fairly used to being able to talk to very senior people.
I suspect most journalists get told to intercourse themselves, from time to time, but it seems “ask Claude” is a new way of saying it, and, whether it’s meant, or not, a subtle insult. The kind that people like her especially resent. The intimation that she didn’t do her homework. It puts her on her back foot, and I think it’s meant to.
Us nerds can relate. How often are we told that we didn’t do something basic, with the onus on us, to prove we did? For a newb, that’s understandable, but it’s a real slap, for experienced pros.
aprilthird2021
12 hours ago
> So this isn’t an anti-LLM article.
It kind of feels like it though. We can be anti-LLM even though it's smart or helpful or whatever. It's reduced so many interesting conversations to this type of boring redirect to just "Ask AI"