IBM CEO says open weight models are now irresistibly good and cheap on-prem

16 pointsposted 15 hours ago
by beardyw
(theregister.com)

7 Comments

beardyw

15 hours ago

Not surprising he says that, but it makes sense.

user

12 hours ago

[deleted]

rvz

15 hours ago

This is the future Anthropic does not want you to see, because that companies believes they are there for your safety, which is complete BS.

Open weight models are the future.

theplumber

12 hours ago

They are the future as long as someone is releasing them. From what I read lately it could be that OpenAI and Anthropic will get the regulation they caved for and unexpectedly China will stop releasing good open models.

akagusu

11 hours ago

Open weight models are the present.

cyanydeez

10 hours ago

they're presentish, if you prepped pre Fall 2025. The current prices for local model GPUs is insane.

I picked up the AMD Strix Halo with 128GB a year ago, and had my company pick up a framework one prior to that.

Qwen3.8-Flash-Next is the equalizer. I'm building autonmously with it for personal and work. There's a halogen-flash-server that runs rings around llamacpp.

With the right engineering harness, I'm keeping the same agent busy through 6 million tokens by recycling the context with dynamic context pruning and eviction so it's able to just keep chugging with a little direction & decisions.

eqvinox

11 hours ago

Yet another warning sign that Anthropic and OpenAI IPOs are doomed.