Your AI Max+ 495 would be hobbled by ~300gb/s bus no? So muuuuch slow inference

Your AI Max+ 495 would be bottlenecked by ~300gb/s no?

What is the 40GiB link ?

That's the 96GB ram price.

what the f is that sketchy site doing?

They haven't shipped yet (people who purchased the moment it became available have delivery dates near the end of the month). That said you can estimate it's speed by looking at the 256GB version for models with similar numbers of active parameters (GLM 5.3 has 40B active parameters). So for 4-bit you could compare to what people are getting Qwen3.8 27B at 8-bit (which is around 2000 tok/s prefill and 70-80tok/s token generation [1]). It might be a little higher or a little lower due to the different architecture and kernel optimizations.

[1]: https://omlx.ai/benchmarks/performance?model=qwen3.8+27b&chi...

Crescent island will be cheaper and might ship earlier. It could also be faster.

GLM-5.3 would be bottlenecked by the M5's GPU, here. I don't have any hard numbers, but Apple Silicon is known for weak prefill performance on larger models (yes, even MoEs).

75% by default, ~90% with manual overrides.

What are you comparing this to, and for how much, and what sort of benchmark numbers is it getting? I'd love to run better cheaper hardware. I'll gladly pay you a reasonable finders fee.

By comparison, the Macintosh IIfx with 4 MB of memory and a 160 MB hard disk was about $28k in today's dollars.

https://en.wikipedia.org/wiki/Macintosh_IIfx#Models

5/3/27 if you are in the UK.

To be safe, just buy four and you'd be able to run the current biggest open weight models.

Get a personal computer with 48-64 GB RAM (or maybe even 32 GB). Whenever your model usages go beyond that – there's those APIs/subscriptions just for that. You are golden for most (really most) of the work.

But if your use-cases need extremely heavy-duty local models then just open your bank vaults and get the one you need.

Can't really answer that without knowing your use case. What is the largest model you need to run? What are you going to do with it? What tps do you need?

For just trying out local models and running occasional queries a 16GB mac will run an 8B-20B dense quantized model just fine.

If you are running at the scale of OpenAI then a data center full of blackwells will have the best ROI.

Buy one of the 128gb m4 max when people sell them to buy m5 ultras. It runs fine on the 27b models and qwen3.8 can actually run tools and perform tasks well. I use it for private agents, voice processing (no elevenlabs criminal pricing) and some photo manipulation though it's not very efficient at this task.

Probably 64GB MacBook Pro and run a 27B model on it comfortably.

Running inference on LLMs that can fit in 512GB. For example, you would be able to run either GLM-5.3-Flash or DeepSeek V4.1 Flash 1017 on this, both of which are very respectable models. It's up to you, of course, if ultimate privacy is worth $25k.

... Or even 640K