Apple Intelligence uses up to 30GB+ on macOS 27

2 pointsposted 5 hours ago
by tosh

1 Comments

JSR_FDED

5 hours ago

If it’s a decent model and I can access it through an API (even just a MacOS native API) and it benefits from a high performance implementation that Apple can likely provide, I wouldn’t mind this at all. I’m currently using up much more space on various local GGUFs in a never ending search for the most capable local model.