Cold starting a 32B model in 1.1s with GPU checkpoint/restore

4 pointsposted 7 hours ago
by agcatalan
(numerata.com)

No comments yet