Show HN: Gavio: open-source interceptor pipeline for production LLM applications

3 pointsposted 14 hours ago
by cees007

1 Comments

cees007

14 hours ago

One design decision I'm still thinking about is interceptors.

Right now almost everything is implemented as an interceptor:

- PII - Retry - Audit - Cost - Logging - Mock providers

I'm curious whether people think this is the right abstraction, or whether some