floathub
5 hours ago
The thesis being that if you can pack multiple models onto a single GPU, you can actually increase processing capacity with a fixed amount of hardware.
Fighting the chip shortage with old school cooperative multitasking on GPUs
2 pointsposted 6 hours ago
by floathub