There also seems to have been a major shift in strategy from AMD / Intel / Apple / NVidia due to this, as I was used to CPU / GPU / chipset upgrades coming out more regularly with double-digit percentage improvements each year, but that seems to be basically over for the consumer space now that everyone is just trying to build as much AI hardware as fast as possible for enterprise markets.

I also used to rebuild my desktop every 1-2 years and upgrade laptops every 2-3 years, but I'm currently a bit past that and have no plans to refresh anything in the near future. I'll probably wait another CPU and GPU generation or two to even consider it, especially with prices being this ridiculous.

I'm fully anticipating AI hardware demand to dry up once Anthropic and OpenAI start tanking financially in a few years after missing earnings and investors and banks wanting their loans paid back combined with more folks realizing that LLMs cannot achieve AGI. After that, I would hope that the demand that's driving this pricing spike will fall along with it, but I also fully expect hardware companies to be as greedy as possible, so maybe a 32TB HDD will just cost $1000 going forward and the era of "a decent gaming PC made up of the tier of components one step below TOTL costs ~$2000" we've been in since the 1990s is fully over, and it's just going to be more like $5k going forward.

I'm running a 12 year old i5 3.2ghz CPU with 16 GB of memory, an SSD and an AMD RX 480 (8 GB) GPU. Currently using a 100% scaled 4k monitor and a 2nd 1440p monitor. I keep the machine on 24 / 7. It's great for software development along with video + image editing and casual gaming. Everything feels fast and snappy.

I will use this until the hardware stops. There's a 0% chance I'd buy hardware at the current prices.

I have a 2021 M1 pro and see no reason to upgrade it... ever?

I do web & general java work on it and it's plenty fast even using a memory hog like IntelliJ (which is typically disk bound anyway). Claude tells me that a new macbook would feel about 1.8x faster in my CPU-bound cases, which is not common.

If memory prices returned to normal and if local inference gets over the hump, I could see upgrading for local AI agents, but I'm fine waiting for a good long while on that.

I say all this as someone who, five years ago, was a perpetual upgrader: immediately bought new product and got excited for next product. Wonder if the future will see the end of that culture in tech and, looking back, it was a little silly and wasteful anyway.

I'm also using an iPhone mini 12 and it's fine.

There isn't much to upgrade to if all you want is a desktop for gaming, a non-workstation work box or just a decent laptop. Much like smartphones, there just hasn't been much innovation of late. A midrange gaming desktop from mid 2023, something like rtx 4070 and ryzen 7800x3d, can still play pretty much any video game on max settings and high framerate at 1440p, and has sufficient performance for most workstation-esque tasks as long as you have enough ram. Similarly, the only thing my spare macbook m2 lacks compared to m5 is hardware av1 decoding - the performance is worse, but I don't really notice it in normal usage, and macOS 27 runs perfectly well on it.

Local AI will crush any machine, of course, and if you need a 512gb ram box you'll probably need to sell both kidneys, but you're well past the average consumer territory with those.

So, fingers crossed nothing breaks down and that some of the funny money goes into R&D which will eventually trickle down to consumer devices in a few years (16TB gum stick SSDs at sane prices pretty please) instead of endless datacenter GPUs and SSDs that will be tossed into a shredder in x years.

Most devices never test their memory and don’t have ecc, so you generally never know. Random instability can be fixed by restarting and your program not being in an area with bad bits anymore.

Anecdotally, RAM failures are more common than they used to be in previous decades, I assume due to increased capacities and smaller process nodes. Looser manufacturing standards may also play a part.

The component category I've never seen fail is CPU.

Well, you’re lucky. I had to change laptop memory sticks a few times. Though not since they are soldered directly to the motherboard

I recently had part of a 32 gig DIMM go bad on a 128 gig system. One of the larger VMs was spontaneously rebooting for no apparent reason. I was able to find the addresses with MemTest86 and map out 512 megs of the affected DIMM with the Linux kernel memmap option.

Same, it's either bad to begin with or it's basically immortal.

I've seen some fail. Might have had to do with the fact that the computers were literally flooded (river came up faster than the sandbaggers could keep up) while running.

This isn’t true anymore beginning with DDR4 speeds.

I've had a few RAM sticks fail, but the ECC usually caught it first. Also had one case that somehow the stick slightly unseated itself; dunno how but it was out of service for months until someone opened it up and reseated the stick.

...granted though I've also seen a backpane on a server fail. I didn't think that was even possible until that point.

DRAM fabs are multi-billion dollar investments which take years to come online. That's the whole reason we're in this situation, there is no quick fix available.

My understanding is that it's fundamentally a fab capacity limit. At a given node size/technology (think 7nm, etc) they can only output so many wafers. If AI data centers are generating enormous demand for memory, then that's what those wafers are going to be used to for, unless they can be outcompeted, hence higher prices.

I'm not actually sure if enterprise designated memory is equivalent or not to consumer designated. Could be they are the same just packaged differently and/or with better binning. Either way, it's the same supply/demand dynamic at work.

Datacentre NVMe disk is still usable in a standard desktop. Sever memory less so, but essentially if there were no 'new' server market whatsoever then you could redirect 100% of memory production to consumer chips without enormous upheaval.

By the way I personally think this scenario is very unlikely to happen.

And watch … $5 says they have nothing to do with the ram because even if there was enough power there’s no use case for this much spend

If I had to guess they’re just buying up ram to keep others from having it same way meta, Google, etc hired up engineers to keep others from having them

next they will become successful business by reselling RAM

Some people really so need the /s huh

I'm quite sure he's being sarcastic.

"The best good ever is to maximise shareholder profits" is a tired and cliched caricature that some people unfortunately take seriously. But this is too on the nose.