The World is Something We Make ...and we can make a truly open language model