RoRF (Routing on Random Forests)

6 pointsposted 7 hours ago
by t5-notdiamond

1 Comments

t5-notdiamond

7 hours ago

Hey hn, this is Tomás, founder of Not Diamond. Today we're open-sourcing RoRF (Routing on Random Forests), a pairwise AI model router that beats all closed and open-source approaches, along with 12 pre-trained model routers:

Hugging Face: https://lnkd.in/gE4FKZWR Github: https://lnkd.in/gn2uKWaY Blog: https://lnkd.in/gutaamm4

When routing between two strong models, RoRF achieves higher accuracy than either individual model at significant cost reductions. When routing between a strong and a weak model pair, we outperform other routing approaches at a lower cost.

The architecture for RoRF is based on a Random Forest Classifier and supports both open-source embedding models like Jina which you can run locally, or closed-source embedding models like Voyage or OpenAI for lower compute requirements.

We developed RoRF earlier this year as a previous iteration of the more powerful router we released through our API. Excited to share this :)