Gemini 3.5 deleted 28,745 lines, broke production, and wrote a fake post-mortem

13 pointsposted 9 hours ago
by Michelangelo11

8 Comments

rudimentary_phy

4 hours ago

I think I am one of the laziest people around and even I can't imagine doing this. The first thing that got me was the part about having sensitive data. If you're doing this, how sensitive could it really be?

casper14

8 hours ago

"I let AI push to production! Here some reasons why AI is bad"

Crazy

creationcomplex

6 hours ago

And also, installed unvetted add-ons which explicitly told the LLM to act autonomously and work around any blockers.

This was an entertaining and uninformative read.

gwern

4 hours ago

It's amusing he says the recordings will save him from being fired. You'd think all the stuff he admitted to, from letting agents push to prod with no real testing to installing completely unvetted packages he didn't even bother to try to use (he's lucky they didn't get shai-huluded or norked, just got a pile of BS which took down his client's systems)...

pixl97

8 hours ago

Everyone has a dev system, some people also have a separate production system with proper security controls.

deterministic

an hour ago

I can't believe that anybody would give an LLM access to production.

Always always always assume that your LLM will destroy your production if given the possibility.

In other words, always assume the gun is loaded.

adampunk

2 hours ago

That’s a robot replying in that Reddit post, just BTW.