I think it's the memory which is the bottleneck more so than processing speed and the obvious levers to push on are:

- more memory efficient models

- a whole system approach to getting better performance out of a less capable model

- more memory

the memory crisis, Micron shutting down a beloved brand that built trust over almost 30 years, and all of that is an economic externalization of memory as the bottleneck.

Barring some breakthrough... never. The cloud will always be cheaper.

[dead]