DiabloD3
2 hours ago
Neat, can't wait to see a llama.cpp PR for this.
Show HN: Fast NF4 dequantization Triton kernel (1.41x faster than bitsandbytes)
3 pointsposted 9 hours ago
by Griffith-72 hours ago
Neat, can't wait to see a llama.cpp PR for this.