Prefill a 284B model on Nvidia. Decode it on Apple Silicon. Over plain 10GbE

2 pointsposted 8 hours ago
by jnaina
(github.com)

1 Comments

jnaina

8 hours ago

pd-bridge — heterogeneous prefill/decode for DeepSeek-V4-Flash