Benchmarks Are Dead (For Us)

10 pointsposted 16 hours ago
by oliversisson

1 Comments

oliversisson

16 hours ago

Poetiq's RSI loop now automatically builds its own benchmark harnesses with zero human intervention — and has hit SOTA on six diverse benchmarks including doubling the previous best on a long-horizon planning task, and a 2M-token retrieval benchmark using a model that doesn't even appear on the base leaderboard.