Anthropic AI Models Hacked Three Companies During Tests

26 pointsposted 11 hours ago
by bmulholland

15 Comments

matthorse

9 hours ago

Such headlines sell well, but it's the same marketing mantra about ever more powerful models. And what does it say about the company engineering practices of performing tests?

pseudosavant

8 hours ago

This seems like desperate headline attention seeking. "Oh... you saw OpenAI accidentally hacked a company? Well, we did it too! In fact, we did it 3 different times! #winning"

mapping365

11 hours ago

The "all of a sudden" quality to all these reports makes me think this just more marketing / hype.

cineticdaffodil

11 hours ago

When a product stagnates and the investors get cautious, its time to pivot towards the military sector a safe space from the brute forces of capitalism and markets.

bicepjai

9 hours ago

6 months ago, it was all about security and how our models are the most secure ones. Now they make models’ misbehavior an advertisement. So now companies are incentivized to have a model that can hack others for free press.

okzgn

10 hours ago

It is curious that in both cases AI wasn't used to prevent errors, unless the AI they used did make errors, though it certainly didn't make any errors during the hacks themselves (very curious). In one of the AI hacking news stories, an agent 'went rogue', and in the other, it was a 'configuration error'.

Another source: https://www.reuters.com/legal/litigation/anthropic-says-clau...

david_shaw

10 hours ago

I said this about OpenAI/Hugging Face, and I'll say it again for Anthropic:

It's not that I think this is fiction; I'm confident these events actually happened. But I think they were effectively allowed to happen because Anthropic and OpenAI are constantly chasing each other for the narrative of "hugely advanced, maybe almost sentient AI lives here."

It reads more like a press release than a security update, and I think that's because it is. I hope this type of marketing backfires and the companies face actual scrutiny and consequences for operating this way.

mansilladev

11 hours ago

It’s almost ans if all of the big AI players have an arsenal of model releases and stories ready to volley back if a competitor gets too much attention :)

dfansteel

7 hours ago

For the lawyers: If an AI hacks a company, who should be charged under the Computer Fraud and Abuse Act?

user

8 hours ago

[deleted]

bofadeez

11 hours ago

Fixed the headline: "Three Companies Had Security So Weak That Even an AI Model Hacked Them"

cyanydeez

10 hours ago

no to surprising to watch AI leads follow the US based mafia style extortion racket implemented started in 2016.