modeless
8 hours ago
Kingma is most notable for writing one of the most cited papers in AI. Actually one of the most cited scientific papers ever published, right up there with the transformers paper if not higher. "Adam: A Method for Stochastic Optimization" https://arxiv.org/abs/1412.6980
I remain astonished that Adam continues to be the most widely used optimizer in AI 10 years later. So many contenders have failed to replace it.
LarsDu88
8 hours ago
The number of papers that use it exceed the number of papers that cite it probably by 100x!
p1esk
7 hours ago
In my opinion, he is more notable for inventing a variational autoencoder.
supafastcoder
8 hours ago
I mean, there’s only so many ways to optimize a black box
OutOfHere
7 hours ago
(delete)
esafak
7 hours ago
That's an architecture, not an optimizer. You can probably use ADAM with KANs. I think you latched on to the transformers in the sentence, but Kingma did not invent those.