NVIDIA B200 low power usage for inference AI workload

3 pointsposted 5 months ago
by viyops

1 Comments

viyops

5 months ago

Full Cluster Power: Our entire 8xB200 node (GPUs only) drew approximately 4.8 kW under heavy training load. Including CPUs, RAM, storage, etc., the total system power draw was roughly 6.5–7 kW at the wall.