Side-by-side GPU comparison: specs, memory, compute performance, and live cloud pricing.
Verdict
Gaudi 3 has 32 GB more VRAM, making it better suited for large models and long context windows. For compute-bound workloads like training, Gaudi 3 delivers 1.9× higher FP16 throughput. Gaudi 3 supports a broader range of models (649 vs 637 from this catalog), giving more flexibility.
Specifications
| Gaudi 3 | GH200 | |
|---|---|---|
| VRAM | 128 GB | 96 GB |
| VRAM Type | HBM2e | HBM3 |
| Memory Bandwidth | 3.7 TB/s | 4.0 TB/s |
| FP16 Performance | 1835 TFLOPS | 990 TFLOPS |
| Manufacturer | Intel | NVIDIA |
| FP8 Support | Yes | Yes |
| FP4 Support | No | No |
Price / Performance
Based on cheapest single-GPU on-demand pricing. Lower $/TFLOP = better compute value; lower $/GB = better memory value.
| Gaudi 3 | GH200 | |
|---|---|---|
| $/hr (cheapest) | — | $2.29 |
| $/TFLOP (compute value) | — | $0.0023 |
| $/GB VRAM (memory value) | — | $0.0239 |
Cloud Pricing
Cheapest on-demand price per provider (single GPU).
Gaudi 3
No cloud pricing available.
GH200
| Provider | On-demand | Spot | Rent |
|---|---|---|---|
| Lambda | $2.29/hr | — |
Model Compatibility
Models from the catalog that fit on each GPU, grouped by required precision.
Gaudi 3 (649 models)
GH200 (637 models)
You might also compare…
Pricing data refreshed hourly · Last updated April 11, 2026 · Browse all comparisons