GPU Cluster Power & OpEx Calculator

Understand the full operational cost breakdown for your GPU cluster, by component, by operating state

Cluster configuration

Number of H100 GPUs

Electricity cost ($/KWH)

Electricity Cost ($/KWH)

Number of GPUs8

GPU Utilization20%

Always-On Infrastructure Power (kW)

Total Power at Selected Utilization (kW)

Annual Electricity Cost (USD)

$53,294.44

Cost per GPU-Hour (USD)

$3.80

Total Always-On Infrastructure

53.20 kW$5.96$52,195.58

GPU Power States

State	Power/GPU (W)	Total GPUs	Total Power (kW)	Hourly Cost ($)	Annual Cost ($)
Powered Off	0 W	8	74.48 kW	$5.96	$52,195.58
Idle	75 W	8	75.32 kW	$6.03	$52,784.26
Light Training (25% TDP)	300 W	8	77.84 kW	$6.23	$54,550.27
Production (70% TDP)	500 W	8	80.08 kW	$6.41	$56,120.06
Peak Training (100% TDP)	700 W	8	82.32 kW	$6.59	$57,689.86

CPU Variable Load

Component	Servers	Per-Server Load (W)	Total Power (kW)	Hourly Cost ($)	Annual Cost ($)
CPU Variable (Based on Utilization)	2	35 W	76.15 kW	$6.09	$53,363.12

Variable Cooling & PSU Efficiency Losses

Component	Power (kW)	Hourly Cost ($)	Annual Cost ($)
Variable Cooling (Scales with GPU + CPU load)	10.86 kW	$0.87	$7,613.49
PSU Efficiency Losses	10.86 kW	$0.87	$7,613.49

Operating States Summary

State	GPU Util. (%)	GPU Power (kW)	Base Power (kW)	Total Power (kW)	$/hr	$/year
Idle/Low	0%	0.0 kW	53.2 kW	74.48 kW	$5.96	$52,195.58
Light Training	25%	1.4 kW	53.2 kW	76.44 kW	$6.12	$53,569.15
Medium Training	50%	2.8 kW	53.2 kW	78.4 kW	$6.27	$54,942.72
Heavy Training	75%	4.2 kW	53.2 kW	80.36 kW	$6.43	$56,316.29
Peak Training	100%	5.6 kW	53.2 kW	82.32 kW	$6.59	$57,689.86

Facility power split (GPU + always-on IT + PUE overhead vs total)

GPU IT (1.5%)

Always-on IT (70.0%)

PUE overhead (cooling) (28.6%)

Total System Power: 76.05 kW