We swapped our LLMs for Jev. It's 39% cheaper

7 pointsposted 5 hours ago
by gczh

4 Comments

michaelastreiko

5 hours ago

Curious how the switch felt day-to-day for a small team — was the win mostly lower spend, or did the outputs stay predictable enough that you stopped second-guessing every call?

vitran_orca

4 hours ago

We have Jev running as shadow calls alongside with the control calls (LLM models). Agreement rate differ across use cases. We then use this data to tune the confidence and probabilities threshold for each case to achieve around high enough agreement rate with the current model.

vitran_orca

5 hours ago

I’m the author, tysm for sharing the article! Happy to share more if anyone has questions.

matanyall

5 hours ago

so much jev hype, honestly deserved