H100 NVL vs H100 SXM

Open Advisor →

Side-by-side GPU comparison: specs, memory, compute performance, and live cloud pricing.

Verdict

H100 NVL has 14 GB more VRAM, making it better suited for large models and long context windows. For compute-bound workloads like training, H100 SXM delivers 1.2× higher FP16 throughput. H100 NVL supports a broader range of models (637 vs 636 from this catalog), giving more flexibility.

Specifications

H100 NVLH100 SXM
VRAM94 GB80 GB
VRAM TypeHBM3HBM3
Memory Bandwidth3.9 TB/s3.4 TB/s
FP16 Performance835 TFLOPS990 TFLOPS
ManufacturerNVIDIANVIDIA
FP8 SupportYesYes
FP4 SupportNoNo

Price / Performance

Based on cheapest single-GPU on-demand pricing. Lower $/TFLOP = better compute value; lower $/GB = better memory value.

H100 NVLH100 SXM
$/hr (cheapest)$1.80$1.80
$/TFLOP (compute value)$0.0022$0.0018✓ best
$/GB VRAM (memory value)$0.0191✓ best$0.0225

Cloud Pricing

Cheapest on-demand price per provider (single GPU).

H100 NVL

ProviderOn-demandSpotRent
Vast.ai$1.80/hrRent
RunPod$2.39/hr$1.25/hrRent
Nebius$2.95/hr$1.25/hr
Lambda$3.29/hr
Google Cloud$4.20/hr$1.14/hr
Amazon Web Services$6.88/hr$2.81/hr
Microsoft Azure$6.98/hr$6.98/hr

H100 SXM

ProviderOn-demandSpotRent
Vast.ai$1.80/hrRent
RunPod$2.39/hr$1.25/hrRent
Nebius$2.95/hr$1.25/hr
Lambda$3.29/hr
Google Cloud$4.20/hr$1.14/hr
Amazon Web Services$6.88/hr$2.81/hr
Microsoft Azure$6.98/hr$6.98/hr

Model Compatibility

Models from the catalog that fit on each GPU, grouped by required precision.

H100 NVL (637 models)

H100 SXM (636 models)

You might also compare…

Pricing data refreshed hourly · Last updated April 11, 2026 · Browse all comparisons