When the KV Cache Is Slower Than the GPU: Scaling Remote KV Tiers

2 pointsposted 8 hours ago
by wondersky
(arxiv.org)

No comments yet