Single-User Inference Card

6 pointsposted 2 days ago
by mhaberl

2 Comments

deadcatfound

2 days ago

This is the form factor I want: one quiet box for a single operator, not a mini data center. Sustained speed and power draw matter most.

mhaberl

a day ago

You could run Qwen 3.8 locally at almost 200 tok/s