sage-ft-mixtral-8x7b

Open Advisor →
46.7BMixtralForCausalLMMoE 2/8mixtral

86 downloads

VRAM Requirements

VRAM requirements for sage-ft-mixtral-8x7b at different quantization levels
QuantizationVRAM Required
FP16104.4 GB
Q852.2 GB
Q639.1 GB
Q426.1 GB

Compatible GPUs

Top 10 compatible GPUs for sage-ft-mixtral-8x7b, sorted by cheapest price
GPUVRAMBest QuantFromRent
MI300X192 GBFP16$1.99/hrRent
H200 SXM141 GBFP16$2.35/hrRent
B200192 GBFP16$5.49/hrRent
B100192 GBFP16
MI325X256 GBFP16
MI350X288 GBFP16
Gaudi 3128 GBFP16
DGX Spark (GB10)128 GBFP16
M3 Ultra (192 GB)144 GBFP16

Showing top 10. Open Advisor for full results.

sage-ft-mixtral-8x7b FAQ