wheresmyshadow
10 months ago
I'm sorry for being ignorant but how does this work? Is there an LLM underneath? Does it use ChatGPT? If so, how do you maintain the privacy and how are you able to cover expenses? I'm just curious, it looks pretty great though.
pedrok
10 months ago
Hey! Yeah, it runs on an open-source llama3 image, and since the requests aren’t too wild, it costs me about $2 a month to keep it up. Thanks!
wheresmyshadow
10 months ago
I see, thanks for the info! I played with it for a bit and I really enjoy the results. A dark mode would be amazing to have but still great job!
pedrok
10 months ago
Thank you so much for your feedback!
android521
10 months ago
Could you share a bit on where you host it ? it is 8 B ,right?
pedrok
9 months ago
Hi there, I utilize the Groq/Llama-3-Groq-70B-Tool-Use model. I initially hosted it on Hugging Face for some time, but eventually, I transitioned to using the Groq API directly.