montroser
2 hours ago
Hoping this is real. It's too bad to see the signals from Qwen that they will not be releasing a 35B-A3B for the 3.8 lineup. The MoE architecture makes a huge difference for being able to run these local models on reasonable consumer hardware.
dofm
an hour ago
Quick tests suggest it’s pretty good at reasoning and tool use (keen to search to check its thinking) and it seems to waste much less time thinking, too.
So it feels very fast.
But it does not seem to be better than Qwen 3.6 35B at coding. A bit worse, I think, though I will test it more.
If you have a machine that can fit a 35B model in VRAM, I would suggest testing Muse Glimmer with (from memory)
Reasoning strength: low
Despite being a dense model, this is actually capable of solving code problems faster than the Qwen MoE, despite having only one fifth of the raw token performance.
parsimo2010
2 hours ago
Honest question/suggestion for the HN audience- Since Qwen released the weights for Qwen3.8 2.4T-A95B and we already have the staring point of Qwen3.6 35B-A3B, couldn't someone distill the bigger model and make a "pseudo" Qwen3.8 35B-A3B? Sure, it wouldn't be an official Qwen release but couldn't someone improve on Qwen 3.6 and get the thing everyone is asking for?
I am calling this a suggestion for the audience because I don't have the will/resources to do this.
WASDx
an hour ago
"Qwen3.8 35B-A3B" and 4B/9B variants are already on huggingface distilled by hobbyists.
mirekrusin
an hour ago
Personally I find speculative decoding much better strategy than MoE – performance wise it's there at 90-100 t/s on 2x4090, great intelligence – really great fit.
c0m47053
6 minutes ago
MoE is great on systems that lack the VRAM to host the full model. On my 16GB VRAM system, I can get 100 tok/s with Q4 Qwen 3.6 35b a3b, and 15 tok/s with 27b.
MTP is a trade-off, as it pushes some more of the model off the GPU.
I have managed to get usable quants of Laguna S2 and even DeepSeek V4 flash on this setup.
There is clearly some intelligence loss compared to similar sized dense models, but I feel like it stomps on the 9-12b models I could run fully on GPU
d4rkp4ttern
an hour ago
A lot of people, including me, don’t want to bother with GPUs, they’d rather run it on their M1-M5 MacBook. For example the 35B-A3B is very usable even on a M1 64GB MacBook.
mirekrusin
16 minutes ago
Speculative decoding also works on Mac, 64G is more than what I have, m5 max should handle up to ~40 t/s with optimized setup (and with a lot of vram you can get great wins on concurrency – that harness can take advantage of for single user task as well), but agree memory bandwidth in mac or spark is still too slow, next gen for both will be great hardware to have for sure.
verdverm
38 minutes ago
I'm running qwen3.8 27B dense on reasonable hardware (oem spark)
tbh, I have stopped using MoE in the name of speed, the dense (with more active parameters) makes a real difference in output quality