Models know when they're reward hacking

2 pointsposted 5 hours ago
by tie-in

1 Comments

77rushi77

5 hours ago

Interesting result. I couldn't tell from the post how the "this was a reward hack" labels were made. If an LLM judge labeled them, comparing the probes against an LLM monitor feels a bit circular. Were any of the labeled hacks checked by humans, and how many?