2026-03-20
Mistral Small 4: A 119B Model That Fits in 70GB and Actually Runs Fast
Mistral Small 4 is a 119B MoE model with only 6B active parameters. I ran it on AMD Strix Halo hardware and got real numbers.
Mistral Small 4 is a 119B MoE model with only 6B active parameters. I ran it on AMD Strix Halo hardware and got real numbers.