Context Language Models

4 pointsposted 5 hours ago
by tomatomatomato

1 Comments

tomatomatomato

5 hours ago

The Bitter Lesson for context management: Giving LMs unrestricted control over their context beats human-designed SOTA!

Introducing Context Language Models (CLMs) - Natively manage their own context - Treat context as a file - Learn policies in CLM weights, no harness

Check out our paper, code, and play with CLM! Paper: arxiv.org/abs/2609.37725 Code: github.com/facebookresearch/context-language-models HF paper: huggingface.co/papers/2609.37725