Unlimited AI tokens aren't unlimited after all as US Army burns through supply

22 pointsposted 4 hours ago
by Bender

6 Comments

colingauvin

3 hours ago

>In order to use Ask Sage, the Army had access to 100,000,000 tokens as part of an annual subscription to an “enterprise pack.” Tokens represent a unit of output, either in text or image, from an LLM. For the Ask Sage tool, a single token equates to about 3.7 characters, according to documents viewed by WIRED. The Defense Department burned through some 20 billion tokens per day during the 38-day Operation Epic Fury in Iran, according to Breaking Defense.

I'm confused. Access to 100M tokens? That's trivial, I could burn that in a month or two and I'm not even doing anything very serious. But then how did they burn through 200x per day? These numbers don't make sense.

>The Army employee says that the Army has been pushing its workers to lean into using generative AI. Employees were given an allotment of at least 200,000 tokens per month, according to emails viewed by WIRED, and were automatically allocated more if they burned through their initial allotment. Employees who had signed up for Ask Sage but were not regularly using it would receive emails encouraging them to use more of their allocated tokens.

My confusion amplifies. 200k is like, read a PDF.

Sounds like the Army got scammed.

nikita2206

3 hours ago

They are mixing up single units of tokens and units of million of tokens.

mring33621

2 hours ago

Claude, please create a plan to invade Cuba and Iran simultaneously. A related stretch goal is 0 US troop deployments. Thx!

tibbydudeza

32 minutes ago

How do I launch a Tomahawk strike against an IRGC base even though there are satellite imagery of kids playing during Iranian school break.

jqpabc123

4 hours ago

FYI, we live in a finite world and nothing on the planet is truly "unlimited".