Serving a 1T open model at 511 tok.s single-stream, lossless, on four B200s

7 pointsposted a day ago
by alsufiman
(brainsless.com)

1 Comments