Should I reconsider my decision of self-hosting LLM Gateway?

1 pointsposted 7 hours ago
by leanroute_ai

Item id: 49586552

2 Comments

FatalLogic

7 hours ago

Isn't this a general class of problem that has a similar risk profile for any type of gateway that accepts inputs that are not very tightly bounded?

Not only LLM services.

verdverm

4 hours ago

I'm running a gateway for my local LLMs, are you opening it to the internet? Who's going to craft a malicious payload?