Show HN: Local LLM Inference in Godot and Unity

2 pointsposted 7 months ago
by nobodywho

1 Comments

iFire

7 months ago

Hi, our strategy for embedding llms is because our eupl share-alike doesn't fit godot engine is to use iree-gd (but upstream broke support), so we also tried llama.cpp and investigating directly pytorch and microsoft's onnx.