Show HN: Taskrouter – One API Learning to Choose Models per AI Task

1 pointsposted 6 hours ago
by robmay

2 Comments

robmay

6 hours ago

We've been building SLMs for enterprise customers for over a year, and in almost every case it's pretty easy to beat a frontier model on price and performance, so we decided to put our tech behind a broader router. Plug it in, we start with a frontier model but then constantly test on other inference configurations and start routing certain workloads to those. You can see on the "Task Explorer" page a few hundred comparisons of various models on common enterprise workloads.

It's new so, we need people to test it out and tell us what doesn't work. Appreciate any feedback you can send.

user

5 hours ago

[deleted]