NVIDIA B200 low power usage for inference AI workload

3 pointsposted 11 hours ago
by viyops

1 Comments

viyops

10 hours ago

Full Cluster Power: Our entire 8xB200 node (GPUs only) drew approximately 4.8 kW under heavy training load. Including CPUs, RAM, storage, etc., the total system power draw was roughly 6.5–7 kW at the wall.