tyleo
6 hours ago
We’re at a small startup and we mix models. But mainly just between the major providers. I wouldn’t say it’s as much to avoid spending money as it is to get the maximum benefit out of different capability spectrums.
6stringmerc
5 hours ago
Well, you can say that all day long but realistically would your “small startup” even exist if your firm was charged Enterprise rates or the actual compute costs and denied access to capital to subsidize your users? It’s a fair question.
The other, more complex one would be “what benefit” are you talking about? Clearly there are some differences in performance regarding speed and token cost, but industry news indicates not a single one has solved the inherent hallucination problem which makes the reliability akin to an untreated schizophrenic research or coding assistant.
tyleo
4 hours ago
The old, “it doesn’t matter because AI doesn’t work,” argument.
I thought we were past this.
notfromhere
5 hours ago
Hallucinations are not really a big problem in day to day work
VCFundedGenYer
3 hours ago
As a sysadmin I disagree mightily. LLMs are very bad at IT troubleshooting, server stuff, etc. Especially microsoft and powershell.
literalAardvark
2 hours ago
Yours might be. Sol is terrifying.
user
5 hours ago
lazide
5 hours ago
Depends on the work and the customer.
user
4 hours ago
officialchicken
5 hours ago
Are you the person paying for the hallucinations, or do you just like the free high?
notfromhere
4 hours ago
I’m the person implementing and monitoring output.
What high am I supposed to be getting? Please let me know so I can stop buying drugs