himata4113
3 hours ago
I think this is as good as time as any to bring up that fable/mythos weights are one mistake (malicious or not) away from being leaked to adverseries or available in a random torrent.
Imagine this, fable weights are likely distributed to hundreds of datacenters with likely thousands of people directly or indirectly having partial or full access. I just don't quite buy that a 'world ending' fable/mythos model would be treated like this, mythos I could maybe believe that it runs inside government compliant datacenters which have a proven track record, but something as valuable as a 'world ending' model invites state sponsored actors to put in significantly more effort into exfiltrating it.
Whatever the real story is I doubt this is as ground-breaking as anthropic claims it to be.
noosphr
an hour ago
We've been told models are too dangerous since gpt2.
There comes a point where you not only want the boy to stop crying wolf, but hopefully be eaten by one.
matheusmoreira
an hour ago
Mythos somehow leaking and becoming usable by all humanity in a self-hosted manner would probably be the optimal long term outcome.
mrcwinn
an hour ago
We can’t buy affordable memory for Fortnite but everyone is running Mythos locally? Is this the year of Linux on the desktop too?
palata
an hour ago
I think they meant more "every country can host it", as opposed to "every human hosts it at home".
matheusmoreira
30 minutes ago
I'll take what I can get.
matheusmoreira
31 minutes ago
If models leak and the AI bubble implodes, memory could become cheap again.
teravor
3 hours ago
i believe it's more complicated than that. i know that nvidia offers TEE for their overpriced offerings. i would assume they make use of that so the weights are encrypted.
this doesn't mean it cannot leak but it would be a major undertaking.
this is why anthropic isn't that worried about having Elon service their models. the workflow would be something like handshaking with the nvidia TEE, provisioning it with your keys and then uploading encrypted weights. there is probably also a timer in there so you can't continue operating the nvidia box with the stolen weights without a heartbeat signal.
himata4113
3 hours ago
There's so many points of failure before it ever reaches gpus.
Davidzheng
3 hours ago
I don't think Anthropic is claiming it's world ending? Just that it has offensive cybersecurity abilities which can be dangerous
himata4113
3 hours ago
Cyber-warfare is pretty world-ending these days. Our relatively peaceful world is built on top of mutual destruction.
dakolli
an hour ago
Why would you believe anything an intelligence agency says? Half their job is spreading fear and obfuscating the truth.
hansvm
an hour ago
And that mistruth appears in delightfully insidious ways, like seemingly well-meaning comments opening up about "half" the job being lying when the point is to shift the Overton window away from the actual numbers, whatever they might be.
(obviously not serious, but it's fun to probe what we can actually reason about when every message might be adversarial)
cheesemayo
2 hours ago
What they claim is immaterial.
vlovich123
3 hours ago
Is the model structure going to be easy to reverse engineer just from the weights? Also, I'm going to guess it's an MoE and thus it's possible there's no single machine that hosts all of Fabel / Mythos.
himata4113
3 hours ago
kvcache residency requirements and general latency for good throughput wants good locality, but you're right it could be split across multiple different parts of a single datacenter, but as I mentioned before the weakest link is before the model is ever loaded onto the gpus.
as for reverse engineering I doubt it's something that state sponsored actors would struggle with for too long.
prokopton
an hour ago
Most likely it'll try to rewrite the whole world's CSS and get the custom properties wrong.
fny
3 hours ago
Security has always been and always will be a game of cat and mouse.
We all need cyborg cats to hunt cyborg mice. There's no other compromise unless you want a rat infestation.
brokencode
2 hours ago
Yup, but apparently our cyborg cats can only be kittens and the cyborg mice are probably going to be like 4 feet tall. At least according to the US government.
tclancy
an hour ago
We could also encourage people to bring us cyborg cobras.
NamlchakKhandro
3 hours ago
Fido the Rat Thing
jaggederest
2 hours ago
It's probably a huge file though, I would guess it's at least a multi terabyte file.
jasonfarnon
an hour ago
The spotify leak on the front page a while back mentioned a 300TB torrent
jaggederest
an hour ago
I suspect that might have been more than one file - I wonder how many files make up the shipping bundle for Fable 5?
DyslexicAtheist
2 hours ago
most of it is overstated because of marketing. in fact the ban looked like an inside job by the current administration to play with the stock value. if the ban did anything it was to make every n00b agree that Anthropic was so far ahead of its times it needed to be banned.
human305893
2 hours ago
I feel like I'm loosing my mind with the way people are falling for the marketing with every iteration. Is it better, sure but it's still just a LLM.
latentsea
11 minutes ago
These days an LLM + a harness can one-shot playable Minecraft clones. This tech has come a long way since it was first released.
nickv
2 hours ago
Stock value?
llm_nerd
an hour ago
Not publicly traded as they haven't IPOd yet (the part where those closely held shares become publicly traded), but Anthropic does absolutely have shares, and there is a valuation on those shares. I don't quite understand how the administration is playing this, beyond the normal corrupt protection racket stuff they're doing all the time now, but Dario is absolutely gearing every public apocalyptic prediction on juicing the "stock".
I mean, if the matryoshka doll rent-a-gpu farce that is SpaceX somehow is worth $2T with their garbage child porn xAI, Anthropic must be worth quadzillions.