YeGoblynQueenne
5 days ago
Chain of Thought prompting reminds me of Facilitated Communication:
https://en.wikipedia.org/wiki/Facilitated_communication
A long discredited intervention where a "facilitator" guides the hand of a non-verbal human to help them write down their thoughts and experiences. Experiments that blinded the facilitator to the observations of the subject, where the written message matched the facilitator's, rather than the subject's, observations, have convincingly proved that it was so much bunkum. It's the Clever Hans Effect all by another name, and with non-verbal humans rather than horses.
Chain of Thought works like that: without hand-holding by a human who understands how to answer a question, the LLM's performance drops, or drops off a cliff even. Of course this is much harder to prove for LLMs than it was for facilitated communication because LLMs don't really do anything without a prompt in the first place. Which should be a very big hint of what's really going on with CoT.
TZubiri
4 days ago
Much of the benefit of LLM is that it's a great interlocutor yes. The chatgpt app is an interactive notepad.
ithkuil
4 days ago
Yes! I'd like to find some time to explore and fine tune a model to act as an effective rubber duck.
I benefit greatly from talking to colleagues which helped me understand things by not saying much of the answer but by asking the right questions and "thinking together".
The current chat interface where each sentence gets an immediate response and the model always has to say something feels unnatural. But OTOH it's not easy to find the right balance, so I didn't make much progress. Probably I need to talk with somebody :-)
Anyway. Being senior naming engineer myself I already have the name for the product:
Robert Duck
TZubiri
4 days ago
No ML needed. Just hardcode a couple of
"That's interesting, tell me more"
"And why do you think that is?"
"And how does that make you feel?"
throwthrowuknow
4 days ago
You can do this now by simply telling it to use the Socratic method or your own variation of it