My "4-bit" quant was 6.2 bits per weight

3 pointsposted 5 hours ago
by murphman
(koleslaw.ai)

1 Comments