Running Qwen3.8-Flash-Next NVFP4 at 184 tok/s on a single RTX 6000 Pro

19 pointsposted 10 hours ago
by matteohorvath

3 Comments

IronWolve

5 hours ago

Been running versions of this on my pc, if you have 64 gigs ram, you can run it on a 12+ gig cards easily.

lowbloodsugar

7 hours ago

Been running Qwen3.8-Flash-Next NVFP4 for weeks now. What's new about this?

catchnear4321

7 hours ago

hn title is completely different from the article title, which takes clicking the hn title to discover.

> Our first model-kernel combos