One design question we went back and forth on was where to draw the line between deterministic rules (regex, allowlists) and LLM-based semantic checks.

Regex is fast and predictable but misses context; LLMs add context but introduce latency and cost. We ended up using a hybrid approach, but I’m curious how others are handling this trade-off in production.