Show HN: Hardware-software co-design for MoE models to bypass NCCL bottlenecks

2 pointsposted 8 hours ago
by PJHkorea

1 Comments

PJHkorea

8 hours ago

Imagine virtual memory, but instead of using your local storage, you’re pooling a whole bunch of network servers into a single address space