Hitting 1B tokens/minute on 1 GPU combining a query planner and inference engine

1 pointsposted 6 hours ago
by gmays
(modal.com)

No comments yet