Ask HN: If you're burning tokens at scale, what are you using them for?

3 pointsposted 5 hours ago
by simonw

Item id: 49333379

3 Comments

dxbhack

5 hours ago

We process a lot of business documents at scale, invoices, sales orders, insurance documents and so on. Our token usage easily go beyond 50 to 100 million tokens per day.

We use a routing approach where simpler tasks go to smaller, cheaper models and more complex tasks go to frontier models. We are also working on having our own model for some of these workloads.

Document processing is probably one of our biggest agent use cases for tokens at this scale.

akudha

an hour ago

Interested in this kind of work. How did you get into this niche?

toomuchtodo

4 hours ago

Software vulnerability assessments, constructing and testing attack chains via a vulnerability testing factory.