Token Arbitrage: Use Sol for coding, Luna for compaction, save 84%

3 pointsposted 5 hours ago
by GodelNumbering

2 Comments

Leynos

5 hours ago

Is this using the server side compaction of the responses API?

GodelNumbering

5 hours ago

No, server-side compaction is inherently tied to the model's current context. This uses a full side prompt to get the compaction result, then swap the context with new compaction result. I did a bunch of tests and the results from Luna were indistinguishable from Sol