Serving LLMs on Tenstorrent Hardware: Inside the vLLM TT Plugin

1 pointsposted 6 hours ago
by ankitg12
(vllm.ai)

No comments yet