Why you can need Cloud Run Instances

2 pointsposted 7 hours ago
by minherz

1 Comments

taintech

6 hours ago

Easy pattern in Cloud Run, if anyone is interested for AI agents.

Use invocation based Cloud Run with Cloud Tasks.

User calls service in Cloud Run, Cloud Run start Cloud Task that holds connection for 30 minutes. Cheap and easy patterns, and you avoid no cpu throttling too.

I use it with ADK agents, works well.