Show HN: I stopped using an LLM gateway and put rate-limits/fallback in-process

4 pointsposted 7 hours ago
by Buddo
(github.com)

1 Comments

Buddo

7 hours ago

If any of you have feedback or any feature requests for VernLLM, feel free to ask them.