LLM is a compiler, not a runtime

3 pointsposted 5 hours ago
by ehtbanton

1 Comments

vanjazdr

5 hours ago

Working with Anton on the implementation side. The biggest unlock wasn't cost, imo it was swapping mysterious non-reproducible inference bugs for boring, reproducible compiler bugs. The emotional shift of "I can actually debug this" came before the cost savings did.