wheresmyshadow
2 years ago
I'm sorry for being ignorant but how does this work? Is there an LLM underneath? Does it use ChatGPT? If so, how do you maintain the privacy and how are you able to cover expenses? I'm just curious, it looks pretty great though.
pedrok
2 years ago
Hey! Yeah, it runs on an open-source llama3 image, and since the requests aren’t too wild, it costs me about $2 a month to keep it up. Thanks!
wheresmyshadow
2 years ago
I see, thanks for the info! I played with it for a bit and I really enjoy the results. A dark mode would be amazing to have but still great job!
pedrok
2 years ago
Thank you so much for your feedback!
android521
2 years ago
Could you share a bit on where you host it ? it is 8 B ,right?
pedrok
2 years ago
Hi there, I utilize the Groq/Llama-3-Groq-70B-Tool-Use model. I initially hosted it on Hugging Face for some time, but eventually, I transitioned to using the Groq API directly.