Side-by-side GPU comparison: specs, memory, compute performance, and live cloud pricing.
Verdict
For compute-bound workloads like training, L40 delivers 2.3× higher FP16 throughput. At $0.82/hr vs $1.09/hr, L40 is the more cost-efficient choice for inference.
Specifications
| L40 | RTX A6000 | |
|---|---|---|
| VRAM | 48 GB | 48 GB |
| VRAM Type | GDDR6 | GDDR6 |
| Memory Bandwidth | 0.9 TB/s | 0.8 TB/s |
| FP16 Performance | 181 TFLOPS | 77 TFLOPS |
| Manufacturer | NVIDIA | NVIDIA |
| FP8 Support | Yes | No |
| FP4 Support | No | No |
Price / Performance
Based on cheapest single-GPU on-demand pricing. Lower $/TFLOP = better compute value; lower $/GB = better memory value.
| L40 | RTX A6000 | |
|---|---|---|
| $/hr (cheapest) | $0.82✓ best | $1.09 |
| $/TFLOP (compute value) | $0.0045✓ best | $0.0141 |
| $/GB VRAM (memory value) | $0.0171✓ best | $0.0227 |
Cloud Pricing
Cheapest on-demand price per provider (single GPU).
Model Compatibility
Models from the catalog that fit on each GPU, grouped by required precision.
L40 (1000 models)
RTX A6000 (1000 models)
You might also compare…
Pricing data refreshed hourly · Last updated June 1, 2026 · Browse all comparisons