From Muon to Gradient Clipping: Some Thoughts on QK Stability

3 pointsposted 13 hours ago
by Eridanus2
(mastergodzilla.github.io)

No comments yet