Sonnet 5 is 2.5x cheaper than Opus 4.8 and 6 points behind on SWE-bench Pro

2 pointsposted 5 hours ago
by bentemrel

1 Comments

bentemrel

5 hours ago

I wrote this after realising I'd never once reconsidered my default model. The scoring system is deliberately crude (four axes, 1-3 each). Curious whether people who route per task find the overhead worth it, or whether one default model is still the right call for most.