Hackernews
new
show
ask
jobs
vLLM TorchTPU: Zero-copy KV cache offloading and disaggregated serving
1 points
posted 5 hours ago
by mikemo88
(vllm.ai)
No comments yet