Benchmarking Speculative Decoding on DGX Spark: 11.5 → 29.5 tok/s

2 pointsposted 7 hours ago
by Alephinitesimal
(alephinitesimal.com)

No comments yet