2x Tesla p100s, q6_k quant, Qwen 3.8 27B ~60tps

3 pointsposted 12 hours ago
by Kmic68
(github.com)

2 Comments

enslavedrobot

31 minutes ago

Interesting. What system were running the cards on?