wheresmyshadow
a year ago
I'm sorry for being ignorant but how does this work? Is there an LLM underneath? Does it use ChatGPT? If so, how do you maintain the privacy and how are you able to cover expenses? I'm just curious, it looks pretty great though.
pedrok
a year ago
Hey! Yeah, it runs on an open-source llama3 image, and since the requests aren’t too wild, it costs me about $2 a month to keep it up. Thanks!
wheresmyshadow
a year ago
I see, thanks for the info! I played with it for a bit and I really enjoy the results. A dark mode would be amazing to have but still great job!
pedrok
a year ago
Thank you so much for your feedback!
android521
a year ago
Could you share a bit on where you host it ? it is 8 B ,right?
pedrok
a year ago
Hi there, I utilize the Groq/Llama-3-Groq-70B-Tool-Use model. I initially hosted it on Hugging Face for some time, but eventually, I transitioned to using the Groq API directly.