Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving

8 pointsposted 2 days ago
by sarkory
(github.com)

1 Comments