Jacob Coxon warns of human extinction and triggers a preference cascade

3 pointsposted 12 hours ago
by maxutility

2 Comments

maxutility

11 hours ago

I agree that there seems to have been some sort of tipping point on public awareness and willingness to talk about risks. This week I’ve had three “normies” independently bring up AI related X-risk in conversations with me. Before this week I’m not sure that’s ever happened. (I generally avoid the topic because it doesn’t make for great small talk and don’t want to be the weirdo talking about the potential end of the world)

maxutility

12 hours ago

Here’s Zvi’s companion compilation of quotes on the topic from AI lab employees: https://thezvi.substack.com/p/the-extinction-risk-preference...

For example, Drake Thomas from Anthropic: “ I would burn my equity to the ground in a heartbeat for a 1% higher chance we make it out of this situation alive. I expect a great many of my colleagues across the industry would as well.

I promise you, we are actually just fucking scared, it’s not galaxy brained marketing.”