khimaros
2 hours ago
created something similar but specific to llama-server. it takes advantage of logprob output and completes decisions in a single forward pass https://github.com/khimaros/verdict
2 hours ago
created something similar but specific to llama-server. it takes advantage of logprob output and completes decisions in a single forward pass https://github.com/khimaros/verdict
2 hours ago
we also have several jev type models available in seconds built on top of models on our router
mev (based on mercury) gemmev (based on gemma)
also these take images input
zev, lev etc
2 hours ago
But… why???