Fathom: Per-query read depth for sparse decoding over offloaded KV caches

1 pointsposted 4 hours ago
by vivekkalyanaran
(arxiv.org)

1 Comments