VLLM: The High-Throughput and Memory-Efficient Serving Engine for LLMs

1 pointsposted a month ago
by sorrow17
(vllm.ai)

No comments yet