Is indirect prompt injection still a big threat as models get more advanced?

3 pointsposted 10 hours ago
by ArcherL

5 Comments

user

10 hours ago

[deleted]

rvz

9 hours ago

Yes it is.

iAMkenough

10 hours ago

Yet Meta's Muse will dump its root filesystem in a .tar for you to download and analyze.

https://mouse.dev/blog/muse-runtime-export

ArcherL

9 hours ago

I mean it didn't do very well on the Gray Swan IPI benchmark the Claude models were tested on either (24.2% within 15 tries), so I'm not surprised. Though that export was a direct ask, not an injection. The scary part is combining them: an agent that will tar up everything it can see and ship it off is exactly what an injected instruction would ask for.

user

9 hours ago

[deleted]