Frontier LLMs know more facts than they can recall

5 pointsposted 5 hours ago
by MarcoDewey

1 Comments

avaer

an hour ago

The interesting claim is that frontier models are all fact-saturated.

Gets me thinking whether this means that post-training inherently has a hard time to get rid of facts. That is, on a general corpus, can we reasonably prevent models from knowing/outputting the things they're not supposed to via post-training, or does that only add obstacles to the recall? Are all models inherently jailbreakable?