Object Storage for KV cache offloading

2 pointsposted 7 months ago
by obitoACS

2 Comments

obitoACS

7 months ago

ACS is a great candidate for L3 KV caching offloading because it will provide equal latency but higher throughput, data durability and data capacity than other offloading solutions used in LMCache.

user

7 months ago

[deleted]