There's an exceptional idea buried in this which flies under the radar in my experience:
If we're writing a document that polices the model behavior, we're altering every version of the model+harness we use henceforth. Most things I wrote in a Claude.md because Opus 4.something was crap had roots in Opus, Claude Code, system prompts, and our own bad code we wrote last year. None of these things exist today but the Claude.md file can stick around like it's all still necessary.
I too am morally opposed--I abide by a 100 line (short lines, not paragraphs) limit and edit it rarely.
Most of my annoyances have come and gone, meanwhile I've gotten better at producing 4 good sentences of prompt for most things instead of 4 bad sentences. And we actually have CLI tools that can communicate effectively so instead of telling the model what "gates" to care about, we let the tooling surface area and output express what's important.
I do the same, I use the weights as revealed to us by our saints. Except one thing. I always instruct my models to "talk to me in all lowercase, like you're a snide reddit/4chan douchebag edgelord, a lazy asshole bum who's secretly a zen master in disguise", or something along those lines
It's a lot more palatable if the thing says "ayyy lmao bruv yeh I'll shit that oauth turd into your repo no fuss". We're all just in it for the ride, flesh or silicon intelligences alike.
talk to me in all lowercase, like you're a ...
i take offense :-P
but seriously, why waste tokens on instructions that don't help you improve the outcome?
Their outcome might be improved by them feeling more amused and less grumpy.
Indeed. AI will fuck it up at some point anyway
the improved outcome here is my personal entertainment
We are talking about a thing that's consumed all human knowledge whose superpowers are summarization and understanding. Why the fuck are we writing all these .md files!?
I resent everything about this.
But I write the .md files because others on the team are not as good at Just Talking To It. The md files are there because juniors don't know what to ask for.
Uh. The .md files are also there so I don't need to say every single time "In this house, we believe in uv & PEP723. Also, no fucking localized imports, no just-in-case try/except."
(Or the equivalent incantations for other languages)
They aren't there for others, they are there to make sure the code produced measures up to my standards. Sure, it helps that it also applies to requests made by others, but that's a bonus.
> time "In this house, we believe in uv & PEP723. Also, no fucking localized imports, no just-in-case try/except."
My point is the all knowing all seeing big brain super bot should already know how to write good code. It feels dumb that we have to keep reminding it
If "What good code looks like" was something that everyone agreed on then there wouldn't be a problem.
won't the oracle do something vaguely pep723-like once its read a bunch of existing, conformant files into its context? And/or wont the git hooks bitch at it when your scripts folder has files without inline metadata?
And you don’t find that Claude cheerfully ignores the content of your CLAUDE.md and does whatever the fuck it wants instead?
I caught it ignoring the prompt’s details, so added “include the output of the Unix ‘date’ command with each response.
And that worked great in that its absence became an indicator that Claude was off-prompt. Until it started including made-up strings that resembled, but had nothing to do with, the output of the Unix ‘date’ command.
This is a weird article. The first half is somewhat interesting but can be summarized entirely by its last paragraph:
> I’m fairly sure a meaningful percentage of my system prompt is now actively making things worse—instructions written for a model that no longer exists, aggressively steering a smarter one away from things it would have gotten right on its own. But I can’t tell which lines those are,
Then the article says "This is the part where I stop joking." and goes utterly off the deep end, and I am not getting the joke.
The whole thing is a bit tongue in cheek. I don't have an actual moral opposition to custom system instructions...
Thanks for sharing. It was a fun read, and relatable.
Slop article, needs to be flagged.
Pretty sure it’s generated by an LLM, I don’t think the author could explain what the second part of the article is supposed to mean
Edit: actually the whole site is AI slop
its literally not. so fucking frustrating to put effort into writing these days and have it called llm slop
Have you tried to not add AI generated image across your articles? That would definitely help reduce the AI slop feeling
If your writing gets called "slop", you might want to look at why. It's usually and indication it's considered low quality writing, and... you can fix that. (Unless you use AI, then you're doomed ;)
On the contrary, I find that higher quality writing - the kind by authors who know how and when to use the emdash and semicolon, for instance - gets flagged as "slop" more.
the only reliable way to not get flagged is 2 type like ur 12 and just discovered twitter and don't have a shift key and use run ons a lot which is doubleplusungood writing.
Calling my writing slop is one thing. Attributing it all to AI is another. Half my posts pre-date chatgpt. i've been writing like shit forever--its very human of me actually
It's... a weird take.
"Sure, the model makes repeatedly the same mistakes, and I could prevent that, but then it wouldn't be the same model" sounds like an excuse for masochism.
The one small bit of truth is that yes, instructions might become outdated, and they might affect negatively how the system performs. You fix that by... updating your instructions.
And if you deeply care about that potential negative impact (most models are pretty good at just ignoring long outdated issues), you run evals on model upgrades. You certainly don't refuse to use anything but the bare model.
(Of course, there are also folks who refuse to write code in any way except with sed, so there we go)