QuantumLeap: 2.3× faster MoE inference with intelligent expert caching

1 pointsposted 7 hours ago
by ikharoz
(github.com)

No comments yet