Side-by-side GPU comparison: specs, memory, compute performance, and live cloud pricing.
Verdict
A100 40GB has 8 GB more VRAM, making it better suited for large models and long context windows. For compute-bound workloads like training, A100 40GB delivers 1.5× higher FP16 throughput. At $0.44/hr vs $0.93/hr, RTX 5090 is the more cost-efficient choice for inference. A100 40GB supports a broader range of models (612 vs 577 from this catalog), giving more flexibility.
Specifications
| A100 40GB | RTX 5090 | |
|---|---|---|
| VRAM | 40 GB | 32 GB |
| VRAM Type | HBM2 | GDDR7 |
| Memory Bandwidth | 1.6 TB/s | 1.8 TB/s |
| FP16 Performance | 312 TFLOPS | 210 TFLOPS |
| Manufacturer | NVIDIA | NVIDIA |
| FP8 Support | No | Yes |
| FP4 Support | No | Yes |
Price / Performance
Based on cheapest single-GPU on-demand pricing. Lower $/TFLOP = better compute value; lower $/GB = better memory value.
| A100 40GB | RTX 5090 | |
|---|---|---|
| $/hr (cheapest) | $0.93 | $0.44✓ best |
| $/TFLOP (compute value) | $0.0030 | $0.0021✓ best |
| $/GB VRAM (memory value) | $0.0232 | $0.0138✓ best |
Cloud Pricing
Cheapest on-demand price per provider (single GPU).
Model Compatibility
Models from the catalog that fit on each GPU, grouped by required precision.
A100 40GB (612 models)
RTX 5090 (577 models)
You might also compare…
Pricing data refreshed hourly · Last updated April 11, 2026 · Browse all comparisons