That's a great q and point. I built it to get at a broad approach to tying multimodal capability together in one place as I'm personally building products on top of it that stitch chat, image, video together and wanted to enable others to do the same. For just coding/chat/specialized models I'd say ollama or lm studio is still the better bet generally, but for some of the models I care about I'm trying to optimize pretty deeply and make fine-tuning really simple. Plus I'm often supporting and bouncing between Mac and Cuda boxes so wanted something where the same codebase ran on both.

totally fair! i spent a while trying to get clever and compress what i wanted to say and finally just hit submit but prob lost too much - local inference runtime, one cli that runs image/video/music/speech/3d/etc on your own machine without package hell. would def edit if I still could after your feedback, but window is closed. Thank you!