Fastest Inference Meta Muse Glimmer 30B on Apple

2 pointsposted 10 hours ago
by lukasonedge

2 Comments

user

10 hours ago

[deleted]

lukasonedge

9 hours ago

hey guys, we've optimised our inference engine to run Meta Muse Glimmer 30B faster than any other engine (llama.cpp etc) on Mac. Best performance on M5 Pro.