tcumulus
5 hours ago
Everything in AI seems to be focused on LLMs lately. But in my opinion, powerful problem-specific models like this are even more interesting. The SOTA AI models used in weather forecasting are already outperforming the classic NWP models while being orders of magnitude more efficient (inference). Most are based on multi scale (hierarchical) Graph Neural Networks, an architecture which is not often talked about. The original Graphcast paper is worth a read if you think this is interesting: https://arxiv.org/abs/2212.12794
polairscience
5 hours ago
You say this as if you don't need he MWP models to train the AI models? The accuracy of the AI Prediction depends entirely on the quality of the training dataset...
WarmWash
4 hours ago
Rumor is that part of the disruption at GDM these past few months also involved people not wanting to be bound to strictly LLM research.
hammock
2 hours ago
Is there any website publishing these forecasts? I imagine NWS/NOAA isn’t doing anything different yet on their public websites.
timeisapear
2 hours ago
Yes. AIFS directly by ECMWF and AIGEFS by NOAA. Every vibecoded weather app these days has them. Google those terms you’ll find them.
numbers_guy
3 hours ago
I can assure you that anyone who touches numerical simulations of any kind (physicists, engineers, chemists, biophysicts...etc) has tried their hand at ML based surrogate models in the last 5 years, so it's not like they aren't being tested. From my experience, they aren't very robust. Weather modeling is actually one of the very few areas where it seems to work half decently.
testfoobar
2 hours ago
Why does it work for weather at all? Is there something that the mathematical models are over-simulating? Is weather easier to predict than we thought? Just curious what the intuition is to regarding the success of ML weather modelling...
segmondy
2 hours ago
everything in AI is not focused on LLM, if you think so then that's because you are in LLM bubble. The big idea with LLM is that it's generative AI, the generative could be anything! Not just large languages, we have seen break through in image generation, video, audio, but guess what. Anything that you have enough data and given data you can predict what comes next can have gen AI applied, so we are seeing it with physical actions so robots get trained to generate the next move, and I think the same thing applies to weather forecast. It's predictable too given enough data
fragmede
an hour ago
Please don't generate cyclones!
amarcheschi
2 hours ago
One of my professors is referenced in the Wikipedia page of graph neural networks. It's funny that he explained them in the worse way possible and I eventually understood them better with another professor
pbronez
4 hours ago
Insightful paper, thanks for sharing. Two things stand out to me.
First, it reinforces that you want methods that get better with more data. It emphasizes that the current approach cannot improve based on historic data - that’s the opportunity that ML based approaches exploit.
Second, it highlights that mature legacy solutions are tough competitors. They benefit from extensive tuning and real world feedback. Even when you have a genuinely better approach, it will take meaningful time & effort to achieve the current standard.
Patience and solid long term strategy are needed to make progress in these situations. You need confidence that your approach will win long term, backed by enough money & time to prove yourself correct.
KennyBlanken
2 hours ago
Everything in the western world isn't focused on LLM. The top western players are heavily focused on AGI.
Meanwhile the Chinese are using LLMs and other non-AGI AI tech at the edge wherever they think to put it for task-specific productivity or optimization. They don't really care about AGI, or more accurately: they're working on getting their society more efficient and decarbonized, and then they'll be free to work on AGI with far fewer resources.
OpenAI, Anthropic, et al are working toward someday having AGI, and if they ever do, when they do, the Chinese will be hopelessly far ahead of us on energy, manufacturing, logistics (especially low/zero carbon transport of goods and people) and so on.
Once the Chinese figure out how to train an AI for ULEV lithography, especially once they figure out how to train it for semiconductor design or validation - it's game over for the semiconductor industry, and the big AI players will follow, because they won't possibly be able to compete against a Chinese version of NVIDIA with TSMC-like capabilities, or Chinese AI companies running on those much cheaper chips, with cheap, zero carbon power.