nathanqueme
4 hours ago
When you say it costs 57% less to use Halv do you mean this is due to routing to a cheaper model or thanks to compression?
villaspedro
4 hours ago
the benchmark ran with the whole suite enabled, so routing, compression, better code indexing, and command filtering.
user
4 hours ago
[deleted]