Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio

4 pointsposted 5 hours ago
by ingve
(machinelearning.apple.com)

1 Comments

buddyholey

5 hours ago

MLX has been an absolute gamechanger for local AI.