A Self-Pruning Transformer: Extreme KV-Cache Compression w/Universal Attention

6 pointsposted 11 hours ago
by matt_d

No comments yet