Ask HN: What is the black swan event that could bring down GPU costs?

3 pointsposted 5 hours ago
by whatdowecallu

Item id: 50107973

4 Comments

kbesplv

2 hours ago

Training is 10-100x more compute than inference. The current rush is all training. When it tips over to mostly inference, a lot of that hardware is just going to sit there.

vibe_that_works

2 hours ago

It's already happening. Cost of capital is increasing, Nvidia and SK Hynix going down. This will follow the patterns of a "real demand but overbuilt" bubble like railway back in the day.

I personally plant to buy GPUs in about 18 months.

FrankWilhoit

5 hours ago

A collapse of demand. That swan looks pretty white to me.