Seen this at a lot of companies. It's a legitimately hard problem - you want to let the best users feel unleashed and be free, but you have to worry about token budgets!

Just a bunch of links to previous stories.

Some discussions:

Companies rein in AI usage as costs strain budgets

https://news.ycombinator.com/item?id=48602571

AI's Affordability Crisis

https://news.ycombinator.com/item?id=48646276

Corporate America Is Starting to Ration AI as Cost Skyrockets

https://news.ycombinator.com/item?id=48335388

Uber’s COO says it’s getting harder to justify money spent on tokenmaxxing

https://news.ycombinator.com/item?id=48268871