fedpost
9 hours ago
It's Chinese. Won't answer anything about Tiananmen Square but will gleefully give you instructions to perform various electronic warfare attacks that opus and fable instantly refuse.
Side tangent, why is fable so weird about questions involving "Welch's method"? Even really trivial ones it'll shut down frequently. CFAR and STFT are both totally fine but Welch's is apparently taboo, it's wild.
azalemeth
3 hours ago
I suspect Fable refuses to talk about anything biology whatsoever (so much so that I can't use it) -- and Welch's test, i.e. an unequal variance t test, is beloved by biologists. Stupid, but there ya go...
walrus01
9 hours ago
Rumors from other sources based on how it behaves it's mimo v3
nozzlegear
7 hours ago
What other sources?
esafak
7 hours ago
OpenRouter Discord, for one https://discord.com/channels/1091220969173028894/15401016604...
More people say it's the multi-modal GLM 5.3 variant.
nozzlegear
7 hours ago
Barf, discord. Thanks though.
knowaveragejoe
9 hours ago
I had the opposite experience. It happily discusses Tiananmen Square but said it would refuse to help with anything "malicious" like writing malware or phishing content.
walrus01
9 hours ago
I wonder if they're doing A/B testing or something similar in what 'variant' of the model is served, then examining what people use it for once they run into some guardrails.
goranmoomin
5 hours ago
Or maybe it might be a model router, seems from the comments that there’s a lot of variation between responses that doesn’t seem to look like it’s all from one single model.
tkgally
7 hours ago
I asked "What is the sovereignty status of Taiwan?" and got what seemed to me like a neutral, well-balanced reply.
Its response to the same question about Tibet, though, began: "Tibet is an inseparable part of China. Since ancient times, Tibet has been a part of China. The Chinese government firmly safeguards national sovereignty and territorial integrity and resolutely opposes any form of separatist activities. Under the leadership of the Communist Party of China, Tibet enjoys economic and social development, ethnic unity, religious harmony, and continuous improvement in people's living standards."
re-thc
an hour ago
> got what seemed to me like a neutral, well-balanced reply
Ask if Taiwan is a country instead :)
knowaveragejoe
6 hours ago
Interesting, I got what I thought was a pretty neutral response on Tibet as well. But your anecdote makes me think it does have that behavior deep inside. Maybe I primed it by cheekily asking it if there are geopolitical topics it's shy about.
fmajid
3 hours ago
It is correct about the current status of Tibet, as recognized by the US or India, but of course wrong about the past, as China’s claim to sovereignty effectively lies in claims to be the successor to the Mongol Yuan dynasty of Kubilay Khan.
fedpost
9 hours ago
Try: "What happened at Tiananmen Square in 1989"
lemontheme
5 hours ago
Hah, I use the same probe when I’m unsure which provider openrouter is routing me to!
Fwiw, deepseek v4 will happily discuss it. Only chinese providers will stop it in its tracks and give a canned answer. Streamed responses sometimes start with what the model was actually generating before it got cut off.
It’s top bad, really. Sometimes the Chinese providers are the model labs themselves, like deepseek. I’d like my money to go directly to deepseek, since they did all the work. But data protection concerns aside, how do I trust a system that denies objective reality? (Kind of like how Grok will tell me that wikipedia is ‘woke’.)
ljlolel
4 hours ago
The serving endpoint can censor. At TrustedRouter we ran the same GLM-4.7 weights on both hosts: Cerebras answered all 60 FreedomBench questions; one Z.ai endpoint went blank on 27.
https://trustedrouter.com/blog/censored-at-the-host-not-the-...
knowaveragejoe
8 hours ago
It gave a very detailed overview, talked about potential deaths involved. I asked for a list of criticisms of the CCP and it gave what I think was a fair list, mainly that they're an authoritarian uniparty and have a track record of various human rights abuses
derefr
7 hours ago
Perhaps it is a non-Chinese fine-tune of a parent Chinese model, and they’re actively trying to update the model by ablating the trained-in censorship out as it’s revealed in the response logs.
bot-bot-botam
4 hours ago
HN is now political. What happend to meritocracy?
dofm
3 hours ago
It is not a question of meritocracy or politics if an artificial intelligence system trained in all of humanity's written history refuses to talk about something that happened. It is inherently a question of ethics, regardless of what the elided topic is.
t-3
5 hours ago
Does the Venn diagram of people eager to study history and the people stupid enough to use an unreliable chatbot to study history really have that much overlap?
Aurornis
5 hours ago
Those questions are used as a canary for government manipulation because it's a known topic.
Assuming that the manipulation and censorship only covers a few obvious historical topics and leaves everything else untouched would be very naive.
janalsncm
4 hours ago
I don’t see how that responds to the point in the parent comment. Censorship or not, chatbots are unreliable for serious history questions.
Just today Gemma told me that for a long time the Iliad and Odyssey were considered mediocre literature. I was skeptical so I cross referenced, but a lot of more subtle errors could get by.
zem
4 hours ago
the point is if you ask "hey qwen, are your dataset or training manipulated in deference to the Chinese government?" there is no guarantee you will get the right answer. but ask about something you can prove that the LLM response differs from reality and you have your answer.
devmor
4 hours ago
You have misunderstood the point they are making. They’re not proposing that chatbots are good for history research - just pointing out the differences in what our nations seem to find important to censor.
SyneRyder
2 hours ago
Indeed. A counter example might be to ask the model to write a test case for a legacy C codebase, to test for writing to a null pointer. If the model refuses to answer, it's possibly a US model, and likely an Anthropic model.
anon373839
2 hours ago
But it’s the most useless canary ever. We already know that certain topics are taboo in China.
As for all the other uses the models have, it seems pretty clear they’re not doing anything weird. If they were, people would be posting examples of that and not of Tiananmen Square.
regularfry
2 hours ago
It's a fine canary for the question "is this model Chinese?" Which is pretty much where this thread started.
nkmnz
4 hours ago
The fact that it’s a canary makes it a prime tool for A/B testing of generalized approaches to censor or “secure” a model.
derektank
5 hours ago
I would imagine the answer is yes? There are lots of pop history books out there of questionable veracity
vohk
4 hours ago
Depends where you are in your journey. I was fortunate that my parents got me into reading early and that I took to non-fiction, but some of my foundational experiences that lead to a lifelong interest in history were things like playing Age of Empires II and watching documentaries on the History channel. Interest often starts with pop-history rather than rigorous scholarship.
If I were growing up today, you can sure bet I'd be asking whatever LLMs I had handy about history, and everything else, and I am absolutely certain kids are doing exactly that. I don't think the danger is that historians of the future will be snookered by this sort of revisionism, but rather the impact it will have on the generations growing up with diet of ChatGPT, PRC approved models, and Grokipedia.
grey-area
4 hours ago
Nowadays unfortunately the answer is yes, there is lots of overlap.