Side-by-side GPU comparison: specs, memory, compute performance, and live cloud pricing.
Verdict
RTX 4090 has 12 GB more VRAM, making it better suited for large models and long context windows. For compute-bound workloads like training, RTX 4090 delivers 18.9× higher FP16 throughput. At $0.18/hr vs $0.40/hr, K80 is the more cost-efficient choice for inference. RTX 4090 supports a broader range of models (566 vs 486 from this catalog), giving more flexibility.
Specifications
| K80 | RTX 4090 | |
|---|---|---|
| VRAM | 12 GB | 24 GB |
| VRAM Type | GDDR5 | GDDR6X |
| Memory Bandwidth | 0.2 TB/s | 1.0 TB/s |
| FP16 Performance | 9 TFLOPS | 165 TFLOPS |
| Manufacturer | NVIDIA | NVIDIA |
| FP8 Support | No | Yes |
| FP4 Support | No | No |
Price / Performance
Based on cheapest single-GPU on-demand pricing. Lower $/TFLOP = better compute value; lower $/GB = better memory value.
| K80 | RTX 4090 | |
|---|---|---|
| $/hr (cheapest) | $0.18✓ best | $0.40 |
| $/TFLOP (compute value) | $0.0206 | $0.0024✓ best |
| $/GB VRAM (memory value) | $0.0150✓ best | $0.0167 |
Cloud Pricing
Cheapest on-demand price per provider (single GPU).
Model Compatibility
Models from the catalog that fit on each GPU, grouped by required precision.
K80 (486 models)
RTX 4090 (566 models)
You might also compare…
Pricing data refreshed hourly · Last updated April 11, 2026 · Browse all comparisons