Calling the AI bluff: Adding "Do not guess" cut made-up claims from 71% to 20%

25 pointsposted 9 hours ago
by FKJ

8 Comments

literalAardvark

8 hours ago

I've used "you're not trained on this data, return exclusively grounded results" to good effect.

Shacharp

8 hours ago

The "do not guess" sentence works but the last 20% will only close when a system stops being told to avoid guessing and actually knows what it does not know.

A command can get you most of the way. It takes something else for the rest.

datsci_est_2015

8 hours ago

Cool, this will be added to harnesses and then it’ll stop being effective and we’ll move on to the next magical incantation.

samrus

8 hours ago

It sounds alot like "make no mistakes" but honestly telling it to essentially stop bullshitting works pretty well

nizarmah

4 hours ago

I mean if we can measure it, then we can probably have a way to validate it programmatically. I gave up on drawing restrictions using prompts :(

FKJ

9 hours ago

[dead]