santiago-pl
7 hours ago
GoModel author is here.
This is my attempt to honestly compare GoModel vs LiteLLM vs Portkey vs Bifrost AI gateways.
sjeno
6 hours ago
Very interesting, I really wish that Python would stop being used for core things like gateways, just way way too inefficient and too much overhead. Great to see other options and the strengths of non-python stacks being highlighted, looking forward to trying out GoModel.
santiago-pl
6 hours ago
Thank you! Feel free to reach out to me over Discord in the case of any feedback or feature request.
verdverm
4 hours ago
There seems to be movement within the Python/TypeScript ecosystem to replace implementations with Rust and continue distribution within said ecosystem.
I'm also looking to try out GoModel this weekend, met the creator in the OpenCode discord this last week. Looking to pair that with https://github.com/kubeopencode/kubeopencode
verdverm
4 hours ago
Appreciate the reproduction, perhaps we can expand it to cover more providers / local and build out a larger perspective.
Thoughts on breaking out the benchmarking code into a separate repo?
santiago-pl
3 hours ago
Currently, I want to keep them close to the documentation, where I link to them directly. The fewer repositories I have, the easier it is to maintain them.
verdverm
2 hours ago
lol, are we headed towards monAIrepos?
santiago-pl
an hour ago
I mentally treat it as part of the documentation right now.
verdverm
an hour ago
Yeah, I hear you on that, I've been using what I call "mega-repos" where all the things for a single project live in the same repo. I retract my prior request upon reflection :]