When Fancy Eviction Fails: Rethinking Cache Replacement for LLM Prefix Reuse

1 pointsposted 11 hours ago
by matt_d
(arxiv.org)

No comments yet