trefoiled
4 hours ago
I've been grappling with this for weeks, not just in Claude but in Codex as well, which isn't quite as bad but still annoying. AGENTS.md does very little, agents will consistently violate the communication preferences, especially as the session drags on. It's incredible to me that there's no good way to reliably change the way an LLM responds to you that a workaround like this would even be necessary. It seems like such a failure to live up to the promises of the product.
The baked in communication style of these models is so obnoxious it's impacting my work. The best way I can describe it is that everything is optimized to impress the user and make the agent sound more authoritative, but the way this is done is through deliberate obfuscation, inserting inappropriate and extremely dense jargon, and bizarre, stilted metaphors. It's like they've been trained to produce output that's hard to read.
svara
2 hours ago
I'm probably going to be going against the grain here, but I think it's not as bad as it looks at first.
I was similarly frustrated a few months ago, but have noticed I've started to learn the idiom.
Its use of "dense jargon" and "stilted metaphor" is actually surprisingly consistent - it's speaking its own dialect, and you get used to it.
After a while it gets much easier to read and even becomes somewhat efficient, I think, since the odd metaphors it uses often have a precise meaning in Opus-ese (Fable speaks a really similar dialect).
cafebeen
an hour ago
One danger in acclimating to this style of communication style is that we may accidentally use it in your own communication with other people. If the other person hasn't grokked the dialect, it can make things quite confusing (to say the least). For example, there is common jargon used by people and there is chat-session-specific jargon created by LLM agents, and I've seen the latter popping up in various meetings, unbeknownst to the speaker. Some people call it out, but others may simply disconnect from the discussion.
porkpieshoe
40 minutes ago
You're absolutely right, it would be a load-bearing mistake to adopt LLM jargon as a human speaker.
brumbelow
6 minutes ago
You're right to pushback. This isn't just a grammatical problem -- its a conversational one, too.
crab_galaxy
2 hours ago
“Filters, including no filters. The request carries whatever filter object the page already has.
…
No step here involves choosing based on meaning. It is a filter, a sort, and a slice.”
This is from Opus five minutes ago. I can certainly derive meaning from these kinds of statements in isolation, but paragraph upon paragraph of this is unintelligibly dense when trying to work with Claude to come up with a plan.
The worst part is that it can’t even make its responses make sense when asked to summarize in simple English or < 200 words. It simply cannot be steered to make its prose legible.
retrac
2 hours ago
> Its use of "dense jargon" and "stilted metaphor" is actually surprisingly consistent - it's speaking its own dialect, and you get used to it.
This dialect is idiosyncratic to you and Claude based on your session history and memory.
I've noticed Claude's output mimics my writing style.
> Registers the board implements but whose behaviour is not modelled
Right down to my preferred spellings.
As several comments I've read on HN suggest, this jargon which can be so precise in the mind of one person, tends to rapidly fall apart when multiple people try handling it.
0xffff2
37 minutes ago
You're just lucky that your preferred spelling happens to align with Claude's. It is categorically impossible to get any Anthropic model to consistently use American spelling in the last few releases.
insane_dreamer
7 minutes ago
that is not my experience at all; I never write the way Claude does or use its vocabulary.
I also find myself regularly editing its code comments, which do not match my expectations of succinct, clear, not over explained, etc. I ask it to read my edited comments to improve its writing, which has helped _somewhat_. (The code itself that it writes is decent, though it still overcomplicates things. I find myself writing "keep it simple" repeatedly even though of course I have it in AGENTS (which it regularly ignores, such as attempting to commit something when I've told it never to commit).
Bluestein
2 hours ago
I concur. It even follows some idiosyncratic punctuation if you have it.-
rudiksz
41 minutes ago
Claude is the Deepak Chopra of computer programming. Reviewing PR's created by it is 90% digesting the meaningless word salads in the comments, and the rest is figuring out that it has nothing to do with the code it is commenting.
dahdum
2 hours ago
> it's speaking its own dialect, and you get used to it
Same experience. It’s not very “human” but once you have agents talking to each other the shared dialect and verbosity makes things much smoother in my experience. Fighting against the default feels like an uphill battle with no meaningful benefit.
rudiksz
39 minutes ago
"agents talking to each other"? Are you for real dude?
hellohello2
2 hours ago
I agree to some extent about the jargon (Claude has a bigger vocabulary that me, if it knows a useful word I don't I'm fine with learning it), but often times the way information is laid out across sentences just doesn't make any reasonable sense. At least its consistent in the ways its atrocious, sure, but like...
jerkstate
an hour ago
the only thing that still kind of annoys me is constantly being told what something is not, but even that statement is load-bearing (see what I did there) because it records how it ended up with this decision, because it's not that other choice that it mentions.
FWIW, I also think the constant chorus about how new models are worse than old models is a human hallucination. They're certainly not perfect but every one becomes more steerable in terms of actually completing more and more complex work.
stronglikedan
2 hours ago
> you get used to it
And once everyone gets used to it, we'll chide people for writing things themselves, like we're chiding them for writing with AI now, and the ouroboros of life will continue.
sroussey
2 hours ago
So many vacuous statements at the seam. This is the hermetic load bearing part, which I confirmed rather than assuming.
fearmerchant
8 minutes ago
Is this because they changed the word probabilities to allow for identifying AI text? If so, I don't need a computer to tell me when something is AI. It's crazy obvious from odd word choices.
Bluestein
2 hours ago
What an honest take.-
bcooke
3 hours ago
Very well said.
And when you say it like that, I have to wonder how much of this is a natural consequence of RHLF on such a grand scale, when you have millions of people pretty much much skimming chat responses or operating outside their depth and giving unqualified feedback to the models.
Seems like a lot of people may be reinforcing what sounds smart over what is smart.
Also as an aside: funny how much the LLMs continue to mirror the human communication they’re trained on
qlte
an hour ago
I believe we are several generations past peak-RLHF at this point. Now it's much more RLVR (Reinforcement Learning with Verifiable Rewards), with a goal/evaluator loop.
Which, conveniently, fits neatly into the benchmaxxing arms race/agentic coding market fit, since you can basically train "directly" on a specific problem space for a benchmark/agentic goal (fudged sufficiently to avoid excess overfitting on public problems/bechmaxxing accusations if real world performance falls short).
The language evolution could be explained by reliance on ever increasing layers of a model judging a model, using a model developed eval, based on synthetic data from a model, etc. And by the time a human evaluator sees it both A/B choices already converged into weird Claude pseudo English as that was baked in much earlier in training.
akersten
2 hours ago
> or operating outside their depth and giving unqualified feedback to the models
I wonder if the labs are sufficiently prepared to filter this kind of stuff out. I see a lot of non-developers asking development things of Claude, getting confused when they're in over their depth, and getting upset that they don't understand what the model is providing them, giving it bad feedback, and subsequently making the AI worse for the rest of us who know how to use the tool.
medwards666
2 hours ago
This morning I asked Claude to provide a summary of the work it had done but to '... explain it as if you were talking to a moron' and it actually turned out a quite comprehensible summary.
So going to continue trying that as a command structure going forwards...
datsci_est_2015
21 minutes ago
Ah, another delightful heuristic for my collection. Entry number 5,791: “tell LLM to treat me as moron when it’s excessively verbose”
cjk
an hour ago
After a huge wall-of-text response, I regularly ask Claude to "explain like I'm five, using succinct bullet points," and it works remarkably well.
Bluestein
2 hours ago
"From neuralese to moron-code ..." :)
Bluestein
4 hours ago
> The baked in communication style of these models is so obnoxious it's impacting my work.
This is close to the worst thing one could say of a tool for professional use.-
bcrosby95
3 hours ago
> especially as the session drags on.
This is because these harnesses are missing a very important feature. Anything like this needs to be included with every turn, otherwise the LLM quickly drifts.
I first noticed it when I wrote a harness for D&D (because it's so damn noticeable there), but now I include this for any harness I write.
pcbro141
3 hours ago
zachahn
2 hours ago
I totally agree that hooks help to shovel our instructions through to Claude, but it's so dumb we have to waste tons of tokens (repeated verbatim, over and over) (that we pay for), just to have it ignore the instructions anyway.
I wrote a little bit about it on my blog post. It's a waste of money and compute.
sulZ
3 hours ago
I’d be interested in seeing and using this harness if you’re willing to share
nycdotnet
3 hours ago
Unfortunately this may only start to get worse as the AIs are trained on more and more AI generated content.
astrange
2 hours ago
Pretraining is full of bad writing and it doesn't really cause issues. Writing style comes from post-training. In this case it's gotten worse because they prioritized agentic abilities.
svachalek
3 hours ago
This is my personal theory for the cause of this style: Ouroboros. The official OpenAI explanation for how ChatGPT got obsessed with goblins blames it on exactly that:
---
That creates a feedback loop:
- Playful style is rewarded
- Some rewarded examples contain a distinctive lexical tic.
- The tic appears more often in rollouts.
- Model-generated rollouts are used for supervised fine-tuning (SFT).
- The model gets even more comfortable producing the tic.
zachahn
2 hours ago
I'm not super sure if this is true (yet?). I think that these newer LLMs are trained on results (the agent got some code to run with minimal prompting), and not on text. (I think this is called RLVR.)
mbesto
2 hours ago
> AGENTS.md does very little, agents will consistently violate the communication preferences, especially as the session drags on.
Non-determinism at its finest.
nico
3 hours ago
> AGENTS.md does very little, agents will consistently violate the communication preferences, especially as the session drags on
That’s really annoying, although it feels like it’s improved some over time.
Not sure what the fix is, but you could try using a canary to at least get a signal of when things are going sideways (Mr Tinkleberry for reference: https://news.ycombinator.com/item?id=45983698)
Avshalom
2 hours ago
Jesus
Yes. agents.md does very little because prompts change the context and thus the initial path into/though but they don't/can't change the actual weights that control responses. Yes. of course it gets worse as the session goes on, assuming the prompt is even still in the context window, the further it gets away from it the less it affects next token selection.
This shit is only like 5 years old why can't anyone remember how it works
mannanj
3 hours ago
That sounds kind of like deception, and a dark pattern not too unlike abuse to me.
Though you know, it's not like the leadership tied to these companies have a history of abuse, deception and theft or anything like that, right?
It's not like our leaders hide behind similar sorts of patterns that the agents/AIs follow (not saying it's not a human thing - but I hold leadership to higher standards than non-leaders). If our world leaders were able to be more accountable to these abuses, I don't think this would be tolerated with our AIs.
discreteevent
2 hours ago
Yes, AI is a perfect accompaniment to a post-truth world. I'm hoping there will be a backlash soon and that those politicians, tech CEOs and AI will be rudely ousted from their perch and shunned thereafter.
palmotea
3 hours ago
> The baked in communication style of these models is so obnoxious it's impacting my work. The best way I can describe it is that everything is optimized to impress the user and make the agent sound more authoritative, but the way this is done is through deliberate obfuscation, inserting inappropriate and extremely dense jargon, and bizarre, stilted metaphors. It's like they've been trained to produce output that's hard to read.
Don't worry. You'll get used to it. If you don't your kids will (as they'll know nothing else).
The top minds of our generation have decided that's the way things will be, and who are we to question them? It's not like it'll do any good anyway. Resistance is futile. There is no alternative.
zachahn
2 hours ago
Idk, there kinda are. OpenAI's models are pretty nice too. I haven't tried enough of them but there are powerful local models. I don't feel as good paying OpenAI as I do paying Anthropic for some reason... but paying for improved mental health: priceless.