INT2 KV-cache quantization is getting surprisingly good

1 pointsposted 8 hours ago
by yunuyean
(arxiv.org)

1 Comments