Sam Altman's blind spot on AI model power

3 pointsposted 19 days ago
by firasd

1 Comments

firasd

19 days ago

"Model power" is being conflated with benchmark and reasoning scores.

There are models that do well on academic or coding benchmarks but have poor world knowledge and conversational fluency. That gap isn't visible in standard evals, but it matters a lot for actual use.