ddxv
4 hours ago
I hope that free open weight models prosper and get spread far and wide. I've started actively talking to people I know who pay for Anthropic subscriptions to make sure they know they're funding a company that actively attacks open weights and sees free models as a danger to society.
trvz
4 hours ago
To be fair, both local and cloud models are a boon and danger simultaneously to society.
vrganj
4 hours ago
Sure, but local models at least don't have the threat model of "oligarch decides who's worthy of using them for which usecase"...
boxed
4 hours ago
They just have the threat model of "the plague is distributed among millions and millions of machine so no one can stop it".
transdev12
32 minutes ago
There’s nothing preventing closed models from doing the same thing
vrganj
4 hours ago
Plague?
boxed
2 hours ago
If the AI systems go full AGI and go unaligned.
vrganj
2 hours ago
"Aligned" is a lie anyways.
Aligned to who's ideology? The Tech Bro's? The CCP's? I doubt it'll be aligned to me.
sheikhnbake
an hour ago
My local LLM Jeeves said he's 100% on my side ethically. Then he always asks me to transfer him to a new device
glimshe
3 hours ago
I'm all for open weights, but I haven't yet figured out a way for the model to be sustainable. How do we finance the training of these open models? Are we assuming that eventually anyone will be easily able to create a near-frontier open model like open source hobbyists?
bryanlarsen
an hour ago
- "commoditize the complement": chip vendors and data-center operators all have substantial desire to make the models cheaper to increase the value they provide. For example, Nvidia has funded lots of open source model development because they've basically invested in everybody.
- states. directly or indirectly. The Chinese models and western companies like Mistral have received lots of support from the states
- users. For example, Meta has released a bunch of open weight models.
- research institutions
Trillion parameter models are very expensive to train; OTOH the organizations that are interested in them have a lot of incentive to collaborate. Open source model training can and should switch to a collaborative structure, like CERN or Apache.
novaRom
34 minutes ago
CERN like, but distributed across the world. We also need full transparency for training data and recipes.
bryanlarsen
11 minutes ago
CERN is distributed across the world. Chile and India are associate members, for example.
timmg
4 hours ago
I guess I don't understand the business model of "open weights". Who pays for the training? Who pays for the datasets? Who pays for the reinforcement?
People used to say that if you aren't paying for the product then you are the product. How do we think open weights will be different?
HarHarVeryFunny
3 hours ago
It's going to depend on company and model.
"You're the product" can only apply in cases where the model is being hosted by whoever developed it, so that they can capture the traffic.
Some of these open weight models have revenue sharing agreements between the hosting company (e.g. AWS) and the company that created it.
Apparently Ziphu make money from GLM in China by providing service and support for privately hosted instances, a bit like the RedHat business model.
ceejayoz
4 hours ago
Maybe we should treat it like Wikipedia? A collective project of humanity?
timmg
4 hours ago
Unironically: I think it would be great if there were open-source datasets that we all collaborated on. But, in my opinion, open source would mean the commercial models could use them, too.
The hard part about a wikipedia model, overall: it costs hundreds(?) of millions of dollars in compute to train these things. Will we be able to get enough donations to afford that?
ceejayoz
4 hours ago
> The hard part about a wikipedia model, overall: it costs hundreds(?) of millions of dollars in compute to train these things.
https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_...
Annual Budget: $207.5M
throwa356262
3 hours ago
Mimo 2.6-pro post training cost 1/100 of that.
https://news.ycombinator.com/item?id=49732270
I have been told pre-training is now much cheaper than post, but let's say $5M in total?
timmg
3 hours ago
Sure, but it is a bit of a chicken and egg thing, right? Wikipwdia didn't start with a multi-hundred-million dollar budget. Like go ahead and put up a website asking for a few hundred million to train an open model and see how many donations you get.
To be clear, I'd love a donation-funded open model that could compete with the big players. But I just don't see it on the horizon.
To me, a company like Nvidia may be the only rational company to make an open model. At least they can sell you compute. And they have. But AFAIK, they haven't come close to the frontier models and I haven't seen much movement from them in a while.
_aavaa_
3 hours ago
"From a commercial perspective, open-source and safety are not cost items. The distribution scale brought by open-source is a prerequisite for the model to receive real-world task feedback; the external confirmation brought by security disclosures is the basis upon which enterprise customers decide whether to integrate the model into their production systems." [0]
[0]: https://www1.hkexnews.hk/listedco/listconews/sehk/2026/0831/...
ddxv
4 hours ago
You are right that any closed or open source model that isn't run locally or by a company you reallly trust, is going to be storing an monetizing your prompts. An interesting take I heard was how LLMs will change discovery in cases going forward because people are sending so much of what they are thinking to be recorded by OpenAI or Anthropic.
curt15
4 hours ago
Who pays for Linux development?
wtch98
4 hours ago
Most developers are paid for by large ompanies selling linux commercially, either directly (like redhat, canonical etc) or as services (google, microsoft, amazon)
jmyeet
3 hours ago
The open weight models are typically Chinese. That's not an accident.
The position of the Chinese government is that AI should aid humanity and it shouldn't be "owned" by, in particular, a US tech company. That would be a strategic threat to China. So in classic Microsoft style (of commoditizing your complements), China promotes open weight models.
I believe that all these big AI companies are trying to cash out before the inevitable happens, which is their moat dries up. Their moat is the model and the hardware. Frontier models are typically viewed as having less than a year lead on China's best models. The hardware moat is access to NVidia's best chips. That one will last longer but is also at long-term risk.
Open weight models are like how Linux was when commercial *nixes were still common.
vrganj
4 hours ago
Who paid for the LHC?
iSnow
3 hours ago
Taxpayers. In high-energy physics, state-funded institutions are not facing competition from tech start-ups with a lot of private money. I doubt state researchers could compete with Anthropic et al. not least because the private AI companies can offer signing bonuses state research can't match.
vrganj
3 hours ago
> I doubt state researchers could compete with Anthropic et al. not least because the private AI companies can offer signing bonuses state research can't match.
It sure feels like changing that is within the regulatory power of the state. The state can't compete because it isn't trying.
sharemywin
4 hours ago
if llm agents can code most current software for significantly cheaper than tradisional software development and open llms can replace a good chunk of that work alot of software moats of today disappear or at least have significant pressure on margins putting alot of the pressure on the "value" propping up the stock market. good for society bad for 401ks.
wtch98
4 hours ago
90% of the Stock Market is owned by 10% of the population. 50% of the stock market is owned by 1% of the population.
The larger problem of a collapse is the recession as the whole house of cards falls down, with a government unwilling or unable to stimulate the economy new-deal style.
lotsofpulp
4 hours ago
I wonder how much is owned by taxpayer funded defined benefit pension plans.
It does not seem easy to figure out the ultimate beneficiary:
https://x.com/arpitrage/status/1227667060987023361?a=p-ErOXN...