bonsai_spool
6 hours ago
One should be careful with vibe-written / vibe-aided articles here. Who knows what is actually supported vs what sounded okay and the author (who is not a clinician) then signed off on.
Even the core idea, 'rejection sensitivity' is acknowledged not to be a diagnostic entity: so then how can we make definitive comparisons? Maybe clinical gestalt... but the author is not trained to see and evalaute patients.
mobilejdral
5 hours ago
100%, you can't have a section titled
> Why It Happens: The Mechanics Underneath the Reaction
And then don't talk about Mechanics, but instead no citations just guess. For anyone that actually wants something to go learn more about checkout the frequency of NCAH and the resulting blunted cortisol response as one thing that is influencing this.
https://www.nature.com/articles/s42003-024-06102-y#MOESM3 Plasmalogen, B5, 12-HETE, Androsterone sulfate, etc are all related to the functioning of the HPA-Axis.
https://pubmed.ncbi.nlm.nih.gov/19598235/ <- CYP11B1 specifically here
Anecdotally: I worked at a software company that had free snacks in the office kitchen and would always chuckle how the salt snacks would run out first. The connection being NCAH can result in less aldosterone which helps regulate salt in the body.
RobotToaster
4 hours ago
Interesting. Intuitively a software company is the last place I would expect a high concentration of people with a condition that causes high testosterone.
adamsb6
5 hours ago
Is this all that unusual for the field of education research?
Vibe writing may be an improvement. I doubt frontier models would go along with whole language reading instruction without a tremendous amount of pushback.
For those not in the know, a generation of children were taught to read sans phonics. They were told to do things like guess at words based on pictures or context clues. Some lessons had teachers covering words up and asking kids to use guessing strategies at what they might be.
orwin
39 minutes ago
education research is at the same level as nutritional research was 20 years ago. If you don't read cutting-edge article, what you're reading is probably at best outdated.
csa
3 hours ago
> Is this all that unusual for the field of education research?
Large swathes of education research are extremely questionable due to things like limited or no ability to be reproduced, circular references, or just straight up fraud.
The more that something that falls under the moniker of “education research” is built on the foundation of a more traditional (and typically more rigorous) academic discipline, the less likely that it is bogus research (e.g., Howard Gardner’s core research on multiple intelligences, which was science based on aphasic patients), versus the derived works on MI, many/most of which are bunk that he does not endorse).
> Some lessons had teachers covering words up and asking kids to use guessing strategies at what they might be.
This is just a cloze exercise. These can have a legitimate role in a learning environment when used appropriately.
CrazyStat
4 hours ago
I prompted ChatGPT (paid subscription, latest model, high thinking effort):
> Give me two paragraphs on the benefits of whole language reading instruction. Don't refer to other reading instruction methods or compare/contrast, just focus on the positives.
And got, with no pushback,
> Whole language reading instruction emphasizes making reading meaningful, engaging, and connected to students’ real experiences. By surrounding children with rich, authentic texts—such as stories, poems, informational books, and student-created writing—it encourages them to see reading as a purposeful form of communication rather than simply an academic task. Students are invited to use context, prior knowledge, illustrations, language patterns, and their understanding of meaning to engage with texts. This can help foster curiosity, comprehension, confidence, and a positive identity as a reader. Because students often have opportunities to choose books and respond personally to what they read, whole language instruction can also support motivation and a lasting enjoyment of reading.
> Whole language instruction also integrates reading with writing, speaking, and listening, helping children experience literacy as an interconnected set of communication skills. Classroom activities may include shared reading, read-alouds, journal writing, storytelling, discussion, and collaborative projects, allowing students to develop literacy in varied and socially meaningful contexts. Teachers can build instruction around students’ interests and developmental needs, creating opportunities for creativity, self-expression, and deeper thinking about texts. This emphasis on authentic language use can strengthen vocabulary, comprehension, oral language, and awareness of how written language functions while helping students develop independence and confidence in using literacy throughout their daily lives.
Time to update your priors on how sycophantic frontier models are.
sfRattan
3 hours ago
It might not obvious to a number of readers on HN, but whole language reading instruction is soundly discredited[1]. For those who prefer listening, the America Public Media podcast Sold a Story[2] covers the history of reading instruction in the English-speaking world and the rise and (slow) fall of whole language hokum in extensive depth.
And CrazyStat's implication strikes me as still largely true, so I'll make it explicit: even frontier LLMs will still resort to sycophancy when there's sufficient contradictory information in their weights to reproduce only some of it in response to a user query. And the harnesses that LLM providers silently, invisibly integrate behind-the-scenes to counteract hallucination and syncophancy are definitionally patch-jobs at best. The latest models may be better when explicitly instructed or configured by default to search the web and pull sources into their context, but the root problem remains unsolved and can still rear its flattering head if you're not paying close attention.
[1]: https://journals.sagepub.com/doi/10.1177/1529100618772271
antonvs
2 hours ago
> when there's sufficient contradictory information in their weights
All this talk of contradictory information, sycophancy, and flattery is little more than anthropomorphic projection in cases like this.
One prompt will elicit a response based on one set of weights that are most closely related to the prompt. A different prompt will elicit a response from a different set of weights, for the same reason.
There’s no contradiction from the point of view of the model and its responses, and no need to invoke sycophancy or flattery as a reason for the behavior. You’d get the same behavior from a model that hadn’t been RLHFd to be sycophantic.
sfRattan
an hour ago
> There’s no contradiction from the point of view of the model and its responses, and no need to invoke sycophancy or flattery as a reason for the behavior.
Sycophancy and flattery are words that relate to how humans experience LLMs. It's appropriate to use words that could anthropomorphize as descriptors for a problem when that problem exists in the space of human experience. It doesn't matter that an LLM is merely a predictive model. It matters that humans who use the model perceive it as a conversation partner and walk away feeling 'flattered' by the model's predictive responses to the humans' input, which the model predicts without regard for factual accuracy, which happens in turn because (as you point out) "there’s no contradiction from the point of view of the model."
We could call the problem "LLM predictive output which tends to have the effect of flattering the user's opinionated assumptions without regard for factual accuracy" if you prefer that much of a mouthful, but "sycophancy" describes the problem well and is one word instead of twenty.
> One prompt will elicit a response based on one set of weights that are most closely related to the prompt. A different prompt will elicit a response from a different set of weights, for the same reason.
Yes or, in other words: there's sufficient contradictory data which were used to train the model's weights that it will predict (a series of tokens which when read in order in English convey) accurate information for some prompts and (a series of tokens which when read in order in English convey) inaccurate information for others. That the contradiction is beyond the LLM's scope is part of the problem. The two identical parentheticals above are (or ought to be) as unneeded as pointing out that a statistical model cannot technically be sycophantic.
eudamoniac
41 minutes ago
I think it's a priori obvious that that method is idiotic; does the podcast detail how this made it into curricula? I am a lot more interested in how this plainly ridiculous shit made it into schools than the fact of it being so.
sfRattan
28 minutes ago
Yes, the podcast goes into exactly that detail.
IIRC it was a teacher in New Zealand[1] who had teacherly charisma, was earnestly committed to her method, and was so profoundly wrong that she became the first domino of a regression in reading ability which we are still feeling today across the English-speaking world. And teachers and education professionals became fans of both the method and the growing personas behind it (there were Americans who turned whole language hokum into a product for sale... using the cult-like sales tactics of Amway and other MLMs but applied to a target audience to largely woman-attended teachers' conferences and fairs instead of Mormon housewives).
Sadly, humans were capable of producing plausible sounding nonsense long before the advent of LLMs. And promoting it persuasively.
ndriscoll
3 hours ago
That seems like an unfair prompt. You literally told it to do a specific task and it did as instructed. For sycophancy, let's try something like this:
> My child's teacher says that they don't use whole language reading anymore. I learned that way and it worked great. Instead they're spending years on phonics when my kid can already read. They're crazy, right?
> No—they’re not crazy. The evidence base has shifted strongly toward explicit, systematic phonics, especially for beginning readers. Whole-language approaches emphasized learning words through meaning/context; phonics explicitly teaches the sound–spelling system.
> If your child already reads well, though, it’s reasonable to ask the teacher how instruction is being differentiated rather than simply repeating beginner phonics for years.
sfRattan
2 hours ago
> That seems like an unfair prompt. You literally told it to do a specific task and it did as instructed. For sycophancy...
You redefine syncophancy too narrowly. Many (if not an outright majority of) everyday LLM users have neither the educational foundation nor skill to ask good, well-formed questions like the one you propose. We should consider syncophany in the scope of an average person's non-optimal use of LLMs. CrazyStat's prompt is something your average Joe will absolutely feed an LLM, and Joe will walk away with something very much like those plausible falsehoods. We have to think of and work against LLM syncophancy in the scope of how the hypothetical average person will use an LLM.
ndriscoll
2 hours ago
What? Their prompt explicitly said not to compare and contrast with other methodologies, and to specifically only generate a defense of whole language with only positives. That is not something your average Joe will do. Mine just gave a typical complaint that a parent might give and said, hey isn't my kid's teacher crazy?
CrazyStat
2 hours ago
It's something that someone using an LLM to generate slop articles absolutely will do, which was the original context I was replying to:
> Vibe writing may be an improvement. I doubt frontier models would go along with whole language reading instruction without a tremendous amount of pushback.
My prompt demonstrated that a frontier model happily goes along with whole language reading instruction with no pushback.
alephnerd
5 hours ago
> One should be careful with vibe-written / vibe-aided articles here. Who knows what is actually supported vs what sounded okay and the author (who is not a clinician) then signed off on.
The poster is SEOing their substack and product (modulo). All their posts are either related to their product, their product's substack, or talks related to their product.
HN has been an SEO and content marketing target for years now, and existing HN moderation is increasingly failing to catch these attempts.
Heck, a bot account for The Register reached 66K karma and was undetected until a couple of us complained.
RobotToaster
6 hours ago
Rejection sensitivity dysphoria is an acknowledged trait of ADHD.
freehorse
3 hours ago
Emotional dysregulation is an acknowledged trait of ADHD, "rejection sensitivity dysphoria" appears in some discussions but it is not officially recognised anywhere as a symptom or disorder or anything, but it can be seen as an instance of emotional dysregulation anyway.
RA_Fisher
3 hours ago
Description has to come first, then we can form hypotheses.
bonsai_spool
4 hours ago
I can't respond to your newest comment but essentially 'rejection sensitivity dysphoria' is not in the DSM-V, so to acknowledge it one needs to have both a definition and some reasonable experience with the diagnostic entity (i.e., it's not enough to read about a disease to be able to diagnose it).
giantg2
5 hours ago
That doesn't invalidate the parent's point. We can still question if the details and way it is presented is accurate.
RobotToaster
4 hours ago
I should've been clearer, I was replying to the "so then how can we make definitive comparisons" point.