EdgeSync-LLM – KV cache fragment engine for on-device LLM inference (Go/Android)

2 pointsposted 4 hours ago
by bossandboss
(github.com)

1 Comments