rao-v
8 hours ago
I know we have strong views on what a truly open model is (open weights, open training data, open training code etc.) but I really like how transparent they’ve been about the training of this model.
The realtime dashboard they shared during training (https://mimo.xiaomi.com/rl/) was an incredible learning and teaching tool for me, and they’ve been unusually comprehensive in sharing details about their methodology (check out that tech report - it's got lots of clever behind the scene tricks like Google or Deepseek writeups) and benchmark scores (even the stuff they didn’t do well on).
If you’re releasing an open model going forward, please consider offering the community more of this transparency!
bicepjai
2 hours ago
I was absolutely mind blown when I saw how they were publishing that training dashboard while US models publish 100s of pages of reports (just provide a "copy as MD" button, folks, in the future). I was thinking about doing something similar but did not know how to show it, and this is a perfect example for someone who wants to show whatever they are training, for me it was local training on a consumer GPU.
My dream is to see this like a dashboard for a model trained across distributed machines, like Bitcoin mining, where minted coins are given to people whose machines were used for training. I don't know if they are worth it, but bragging rights alone, like a tag they can put on a website or social media, will be good enough for me.
earthnail
7 hours ago
Thanks so much for sharing this. As someone who mostly watches from the sideline, can you share what you can see in this dashboard that someone like me can't see? Is it the metrics themselves that they measure (the metrics tab is absurdly detailed), something in the notices, or something else I missed?
rao-v
7 hours ago
I might turn this into a blogpost if folks are interested, but my god there is so much clever info in that dashboard.
Here is one really neat bit:
A cutting edge training idea (for agents, it's been used elsewhere for ages) is on-policy RL, basically, it's not enough to say "here is an end to end agentic sequence (including tool calls etc.) that is perfect" you want to say "here is a sequence you might actually have generated that turns out to be correct".
Basically, it's more training efficient to improve models with small tweaks to do more of the right thing they are already doing sometimes than from some perfect oracular "this is the way" answer.
(if you've ever tried to teach humans new skills, you’ve probably noticed this too!)
When you do that, you care about how far the model you are updating (improving) has deviated from the one being used to generate rollouts (agentic rollouts for hard problems can take hours with lots of tool calls, so you can't keep redeploying every slight improvement).
Lo and behold, the dashboard literally has:
partial/avg_staleness (likely the measure of how many micro iterations the "generate answers" model is behind the "improving based on the occasional right answer" model)
train_infer_diff/new_infer/kl (a more direct KL divergence based way of measuring how differently the two models generate tokens)
How cool is that?!
And don't get me started on the clever ideas hiding behind dynsam/avg@n ...
armas
2 hours ago
yes I'm interested. please consider writing this
jeffmcjunkin
6 hours ago
I'd read the heck out of that blogpost. You have my interest.
pimeys
5 hours ago
I would really enjoy that blog post.
dgellow
6 hours ago
Please do
oceansweep
5 hours ago
Please do!
tancop
7 hours ago
The best thing they did is being open about all the setbacks they had to deal with. They logged every restart with a reason, talked about dropping a cyber dataset after it degraded coding benchmarks. Also published real time training loss, benchmark scores after every checkpoint and running cost estimates.
Really the only thing missing was dataset descriptions, the dashboard only had random IDs like "dataset-zrso". I guess it's their lawyers fault.
verdverm
7 hours ago
the existence, who else has a live dashboard for the RL late-training?
dang
42 minutes ago
> The realtime dashboard
'twas discussed a few days ago:
Xiaomi Mimo 2.6 live post-training dashboard - https://news.ycombinator.com/item?id=49732270 - Sept 2026 (155 comments)
anvuong
37 minutes ago
> the pro run restarted at step 17 due to a GPU OOM issue caused by expert load imbalance. we have adjusted the training parallelism strategy.
no idea why I laughed so hard at this, feel so familiar
aarondong
3 hours ago
The RL dashboard is quite cool.
I wonder if this waters down the “distillation attack” claims by Anthropic. They have their own RL environments! I guess the caveat is that the RL datasets are still opaque, nothing is really proved.
ignoramous
7 hours ago
> got lots of clever behind the scene tricks like Google or Deepseek writeups) and benchmark scores
Xiaomi MiMo is led by Luo Fuli, a former Alibaba & DeepSeek employee. Perhaps it is due to Luo just how similar Xiaomi's tech & GTM approach is to DeepSeek's.
- How Luo Fuli Keeps an Earthy Touch as she Soars Through the AI World, https://newsen.pku.edu.cn/news_events/news/people/15385.html (https://archive.vn/I8Pmu).
- Luo Fuli, the 30-year-old ‘AI genius girl’ behind DeepSeek’s success?, https://e.vnexpress.net/news/tech/personalities/who-is-luo-f... (https://archive.vn/sb3B6).
pimeys
5 hours ago
Open tech is cool. Speeds up all progress...
MangoCoffee
7 hours ago
maybe this is why Dario want to slow down AI development and all the big AI labs in the USA is singing the same song.
whey they all singing the same tune. it make me question what is their real motives.
they are afraid of Chinese good enough LLM model killing their margin. we already have story about US companies switch some task to use cheaper Chinese model hosted on Neoclouds.
aeyes
6 hours ago
The reason is money. They want regulation to make it harder for new competitors and competitors from other countries.
They invested billions into training the models but there is no competitive advantage, we see that within a couple of months everyone catches up. There is no way to profitability unless they get some policies to shields them against competitors that can't comply with the regulatory requirements.
That is also why there are things like Claude, Codex and Cursor. They are trying hard to build a customer relationship with a higher switching cost that hopefully sticks.
But the problem is that the AI buildout has become a large percentage of GDP. So obviously the government wants to keep it going because these companies are pumping enormous amounts of money into the economy.
lelanthran
5 hours ago
> But the problem is that the AI buildout has become a large percentage of GDP. So obviously the government wants to keep it going because these companies are pumping enormous amounts of money into the economy.
They are pumping enormous amounts of money into each other. Hardly any of that is making its way to people, it's all going to highly automated construction and to energy use.
Seriously, how many jobs did the $1t in venture capital fund?
gunalx
5 hours ago
If I pay you 100$ for mowing my lawn, and you me for yours. Technically the GDP increased with 200$.
cosmojg
4 hours ago
And, in this case, the dollar-amount increase in GDP serves as a virtual quantitative proxy for the increase in mowed lawns (and the value thereof). In other words, the participants in this economy are collectively ~$200 richer with their mowed lawns than they were without them.
AlotOfReading
4 hours ago
This is a thinly disguised broken window parable.
If everyone goes around mowing lawns for each other, the economy is richer in lawn mowing at the expense of all the other things that would have been funded had everyone mowed their own lawns and purchased different services instead.
aytigra
3 hours ago
I am confused with this, if "everyone mowed their own lawns" then the net result will be exactly the same, everyone will be busy the same and not poorer, just without money movement.
saidnooneever
3 hours ago
look at the broken window parable as he mentioned it might help understand the rest of his comment
socialcommenter
4 hours ago
If the pricing is fair and at arms' length. What's happening in reality is as if they are mowing each others' lawns at wink wink nudge nudge $1000. Not a good proxy for actual value created.
eru
2 hours ago
In the real world, you have to pay taxes. So people are incentivized to claim less value for the lawns mowed, or even just do it themselves, instead of benefiting from the division of labour.
Naracion
3 hours ago
But also importantly the government of the residents' country is about 39% ($78) richer, if say the participants are honest in reporting this and the country is the UK and the participants are people like you and me in the tech industry who frequent HN and would think to do something like this.
genxy
4 hours ago
How about I draw you a picture instead. Mowing a lawn is a priceable service.
Wowfunhappy
3 hours ago
Well, yes, because both of your lawns got mowed!
Value was created!
eru
2 hours ago
> Hardly any of that is making its way to people, it's all going to highly automated construction and to energy use.
How do we know that? How automated is the construction really?
In any case, the Fed and other central banks can print as much money as they want in order to hit any aggregate spending or inflation target they have for the economy.
eru
2 hours ago
Well, if you are right, I just hope their protectionism will only affect the American market, and they leave us unAmericans free to get our models from wherever.
vlovich123
3 hours ago
Unless something has shifted, “everyone catches up” is because these bleeding edge models are distilled. You don’t see this happening with other European and US labs and the problem isn’t something being ignored. I’m not convinced this pattern will continue indefinitely.
awad
3 hours ago
Why is it OK to train on the collective IP of humanity and call it fair use but then call the next batch distilled with negative connotations?
userbinator
3 hours ago
This is why Imaginary Property is an illusion, as everything is a derivative work, and AI is going to make that fact even clearer.
eru
2 hours ago
That's not true for literally everything.
When eg I snap a picture of my dog, that's not derived from anything. But I still get intellectual property rights for the photograph.
vlovich123
an hour ago
I did no such moral claim. I just noted that the foundation labs are working on technical hurdles to thwart distillation efforts and the cost and quality of Chinese models isn’t likely to keep up with the 6 month lag time everyone has assumed.
floam
3 hours ago
I don’t follow. Fair use is a copyright defense, and nobody is suggesting distillation attacks are just a copyright violation are they?
Aren’t they alleging these other companies directly entered into a contract and violated the terms, and in cases where question, answer pairs were obtained without such agreement, it was accomplished by outright wire fraud or theft?
kkotak
2 hours ago
Are you suggesting that worldwide copyright violation is more acceptable than contract breach between companies?
jamienk
5 hours ago
I’m still not at all sure about the “billions” invested claim. How much of that is cloud running the models? How much is pre and post training (which may or may not be part of what we’d want to include in accounting). Etc. Does anyone have links to good reporting about this: not blind recitations of numbers, but analysis and thought mixes with investigation?
Shekelphile
3 hours ago
No chinese lab has caught up yet. They've tried to fake it by distilling and overfitting on benchmarks to make their models look better than they are, the 'best' models available from chinese labs right now (GLM 5.3 and Kimi K3) fall apart completely when you try to do real work with them. K3 is especially embarrassing because it is larger than Mythos yet performs worse than opus 5 and 5.6 sol in benchmarks they haven't been able to fake yet.
kkotak
2 hours ago
In that case, Open AI and Anthropic have nothing to worry about.
jwolfe
6 hours ago
Please explain how putting an upper bound on how good the strongest models can be prevents cheaper less strong models from catching up, rather than enabling it. I do not understand this argument at all.
rbjorklin
6 hours ago
The general idea is that Anthropic/OpenAI is pushing this narrative as an attempt at "Regulatory Capture"[1] which would allow them to make it prohibitively expensive for anyone but them to enter the market thus stifling competition.
chanakya
6 hours ago
How would that slow down the Chinese models, given that the US has no regulatory reach in China?
girvo
6 hours ago
You target the US companies: if they can't use these Chinese models, then they're less of a danger for a now captive audience in the US (and the West generally).
This is already kind of the case: the big enterprises don't really want to touch the latest Chinese models. It's a real pain, personally, I want to use them at work!
pimeys
6 hours ago
Show them you can burn tokens in seven sessions day and night with comparable results to Opus with less energy and less than 10 dollars a day, per dev.
girvo
5 hours ago
We have. Unfortunately there are political realities that get in the way, and Bedrock for example doesn't have GLM 5.3 (Flash or otherwise) or anything new/useful
I do imagine it'll change, but it hasn't yet.
unethical_ban
3 hours ago
If it's hosted, all they know is "data goes to China".
Until profitable, reputable third parties host open models in the US with ZDR or they become plug-and-play for self-hosting at a modest cost, paying the US models is as much about data protection and liability as performance.
verdverm
6 hours ago
1. China is a bigger market than the US for Ai, they are on pace to process 100Q tokens this year, roughly the same or more than the US big companies
2. Enterprise trends are towards open weights, several routers and vendors now have more than half the volume going towards open weights
girvo
5 hours ago
Yes, but thats not something a company engaged in regulatory capture for themselves care about: especially if they're worried they'll be outpaced and overtaken by the Chinese labs. Which they will be, IMO.
verdverm
5 hours ago
they care because they know it unlikely open weights will be banned, and thus available to American companies, with regulatory capture (onerous requirements) being a "good enough" "ban" that their big models don't face real competition, regardless of the open weight origin. American companies make open weights too, they are equally threatening to Big Ai financials.
wolpoli
an hour ago
That will then create incentives for companies that consume AI tokens to counter lobby against those regulations.
RussianCow
6 hours ago
Because the end goal is to ban non-US AI companies from being able to do business in the US.
CookieCrisp
4 hours ago
The US is meeting with China to discuss the threat of AI… May be fine but, i’m wary
stickfigure
an hour ago
Trump and Xi are meeting. Not the countries, just two corrupt and malevolent individuals.
verdverm
6 hours ago
it wouldn't slow down China as much as make it impossible for American companies to use non-American options, they care about their margins and don't want to be commoditized
verdverm
6 hours ago
I heard someone analogize token vendors to car manufacturers, where American companies only want to produce expensive options, the people want cheaper/better alternatives, and we ban BYD because those with enough money are more "persuasive"
juiceland
6 hours ago
The analogy is a good one, but your explanation is missing one aspect: the country (USA) does have a reasonable interest in having the capacity to build their own models. The “we need to slow down because it’s getting too dangerous” part is probably more related to “we need to slow our public facing development down so the US government can get the best and the American corporations can trickle out what we decide is safe”
It’s similar with cars. It’s not that American cars are better than Chinese cars on any tangible measurement. But America already shipped most of its manufacturing overseas. Everyone who built those factories is retired. The US should probably hold on to some capacity to make cars, seeing as their entire infrastructure depends on them.
verdverm
6 hours ago
American Ai/Car manufacturers could build cheaper/open models, some do, the big ones do not. It's not an either or, but a spectrum where they have chosen to build only in a subrange
juiceland
5 hours ago
It is the natural result of a country run by lawyers. China is a country run by engineers.
nxm
4 hours ago
That doesn’t explain the decline of German automotive industry which is now taken over by Chinese cars thanks to massive subsidies by the Chinese government
eru
2 hours ago
Why? Germany is also run by lawyers.
See eg https://en.wikipedia.org/wiki/Friedrich_Merz#Private_sector_... for the current chancellor. Many past chancellors were also lawyers, and many members of the Bundestag were and are lawyers.
I don't know whether having lawyers in power leads to industrial decline. My point is only that you can't use Germany as a counterexample.
verdverm
2 hours ago
Do we consider the US Chips Act to be a subsidy? What about when GM became Government Motors because it was Too Big To Fail?
In other words, when do economic and industrial policies transition to subsidies? Is it a matter of perspective? Is the devil in the details?
verdverm
5 hours ago
I think it less about lawyer vs engineers and more about money in politics (now unlimited)
lelanthran
5 hours ago
> Please explain how putting an upper bound on how good the strongest models can be prevents cheaper less strong models from catching up, rather than enabling it. I do not understand this argument at all.
They are not proposing to regulate only the strongest models. They are proposing to regulate all models. If they are already on top, regulation may stop them from proceeding further, but it also stops the cheaper alternatives from catching up.
If they feel they have reached the asymptote of the curve, then regulation doesn't affect them, it affects those who have yet to reach the asymptote.
cogman10
5 hours ago
Particularly, the route they seem to want to go is "safety".
My guess is that Anthropic and OpenAI will push for "safety" regulations which require byzantine testing that, shocker, Anthropic and OpenAI can pass but the chinese models cannot. The route they'll take is import bans and potentially even general bans on products producing or using "unsafe" models.
They'll further likely try and push AI "safety" treaties from the US to other nations to further lock in their lead.
That's why, IMO, we've been seeing so many "OMG, AI will destroy the world and these AI researchers are so scared" articles.
lytedev
6 hours ago
I don't think "putting an upper bound" was OPs phrasing?
jwolfe
6 hours ago
That's what pacing the frontier is, and is what the labs are pushing for.
bellowsgulch
6 hours ago
That’s not the argument.
jwolfe
6 hours ago
Please elaborate on what the AI labs are specifically requesting and how that results in slowing down Chinese model progress below the frontier.
qlte
38 minutes ago
Cracking down on proliferation of open models which can't be locked down using the kind of guardrails that Anthropic/OpenAI/etc insist are keeping the public safe from all manner of nefarious bioweapons, hacker swarms, propaganda bots, etc. They've discovered they can't meaningfully slow Chinese model progress, so the next best option is to knock them out of competition in the enterprise market for any American company.
Both Anthropic and OpenAI leaders have repeatedly made this exact argument that it's impossible for open models to rigorously enforce the same kind of safety framework as proprietary cloud-served models. It's implicitly part of any regulatory framework they advocate or else it wouldn't be "fair" to American companies since Chinese models would "cheat" (provide weights).
kindkang2024
42 minutes ago
Competition on the provider side—when no single dragon monopolizes the sky—brings fortune for all.
As normal consumers with common sense, we should never naively assume others care for the world out of the goodness of their hearts. Maybe they do, but we should never rely on that.
We can only get good, affordable deals when there is enough competition on the other side.
hgoel
4 hours ago
This is definitely part of it. I think the reports/PR over the past month ended up being a serious unforced error.
Chinese models are increasingly closer to the frontier, while being able to run on much cheaper hardware than what US frontier models run on.
On top of that, both Anthropic and OpenAI showed that they can't really be trusted on data security.
Even if US companies can be forced to not use Chinese models, the rest of the world is going to see the risks and the availability of good enough open weight models for their purposes and be more likely to lean in favor of self-hosted Chinese models or local inference clouds.
awongh
4 hours ago
In a recent Dwarkesh podcast Dylan Patel breaks down how little compute the chinese labs actually have- not even the fact that they don't have access to new Nvidia chips and they're stealing them through shell companies- just that, even if they have cheap electricity, the compute just doesn't compare. Maybe even two orders of magnitude less. They couldn't get it even if they had the money. And if you look at how much more efficient newer chips are, that cuts the effective compute in half again. The conclusion was that they are at least 2-3 years behind.
For frontier labs the current compute seems to be driving model progress (in training) at least to some degree, even without true RSI, and this seems like it'll continue to keep any chinese model from drawing even with the frontier labs, at least for the foreseeable future.
Inevitably the chinese government will drive more funding in chip fab technology and the money will come around to build chinese data centers, but who knows how far off that is. A few different things in the tech tree need to fall into place. It doesn't seem like it'll be next year.
SwellJoe
3 hours ago
The counterpoint to that, though, is that the Chinese companies have to figure out how to be competitive, regardless of their significant compute deficit. And, as far as I can tell, they're actually doing that. They're trailing the frontiers in model effectiveness, but not by years. It's single digit months.
If there is no upper bound how how these things scale with compute, and if China does really begin to catch up to Nvidia (and they're probably not going to feel encumbered by US patents for domestic AI hardware, given how important AI seems to be to the Chinese government), there will come a day when China leapfrogs the US on AI.
awongh
2 hours ago
I think on the timescale of 10 years, that's a super likely scenario. But will it be any sooner?
For instance a Chinese EUV machine seems like it's very far away. Even if they have (steal/borrow) the necessary IP.
ed_balls
5 hours ago
Does anyone know what are the proposed regulations? Controlling software is impossible, so the only option is banning hardware ownership. No more mac studio.
cogman10
5 hours ago
If you pay attention to how these US CEOs talk, it'll be "safety". If I were to guess, they'll try and require a lot of testing, validation, certification before a model is legally allowed to be used in the US or on US products.
It won't be a great moat, they'll probably try and get trade treaties setup to try and expand the moat. But ultimately it won't slow down chinese model development, just limit who can legally use them.
hgoel
4 hours ago
From the frontier labs, the only publicly stated one seemed to be to give them an exception from anti-trust laws to form a cartel and place - incidentally friendly - regulators in charge of monitoring everyone's work.
From politicians like Bernie Sanders, we've had proposals like 20 year imprisonment for anyone researching "ASI".
theplumber
5 hours ago
OAI and Anthropic are forced to release a better model every x months otherwise the Chinese ones will not only be cheaper but also better.
So how could Dario show the investors very nice profit charts representing profit = revenue excluding training costs if it needs to pay a lot of training every x months?
They want to sell the same model for longer(a kind of software subscription where the cost of running /inference is cheap) but the Chinese don’t let them do it. That’s the gist of it. You can see already how they nerf the models just a week or so after release and try all kind of tricks to deliver you shitty performance for the same money. I think it’s part of the same issue of costs and enshitification plan.
In the meantime let’s hope they don’t get to ban the Chinese models(I think they won’t), local AI hardware will get cheaper and the whole AI doom saga will slowly fade to the point that Anthropic becomes a kind of IBM stuff with proprietary data, enterprise certified alignment and enterprise contacts. Think of Accenture junk.
rpcope1
an hour ago
I mean DSv4.1 Flash and GLM 5.3 kept in check by a supervising frontier like Astra or Fable already in my experience clowns massively on ever using Opus or Sonnet. Opus 5 in particular has been such a stinker that they have to know that they're going to get smoked outside the halo models.
tarkin2
4 hours ago
Or it’s PR to push up the price of AI shares
Pxtl
6 hours ago
Dario has always wanted the AI development to slow down and be more careful. Safer AI development was a core reason that Anthropic split off from OpenAI.
What's different today is that now all the big LLM firms want to slow down AI development. When men like Musk and Altman (both known for habitually shooting their mouths off and saying whatever they need to whoever needs to hear it regardless of truth) suddenly agree with Amodei, that's when things start to smell off.
verdverm
6 hours ago
> What's different today is that now all the big LLM firms
not all, just a few American ones (~PayPal Mafia + Google), there are other big American LLM developers (notables include Nvidia, Meta, and Palantir) that do not agree