Stepped MoE: reducing memory movement in large mixture-of-experts models

2 pointsposted 5 hours ago
by arnav1993k
(arxiv.org)

2 Comments

Iolaum

5 hours ago

This may be a very good paper but when I saw Apple regarding the authors org I stopped.