Q4_0 KV cache collapses 92.5% at 64K on DGX Spark GB10 (unified memory paradox)

2 pointsposted 8 hours ago
by memoriant
(github.com)

No comments yet