Tell HN: Google increased existing finetuned model latency by 5x

13 pointsposted 2 days ago
by deaux

Item id: 46042273

1 Comments

jpau

14 hours ago

Hey we're also a Vertex tuning customer in a similar spot. We're seeing other capacity issues, although not a leap in latency. Can you DM me? I'd love to trade notes. https://x.com/hellofromjames