A new Speculative decoding drafter for vLLM and SGLang called EAGLE-4

2 pointsposted 6 hours ago
by sgiannopoulos
(github.com)

No comments yet