2026-04-04
Gemma 4 26B: Google Drops a MoE Monster With 4B Active Params
Google DeepMind released Gemma 4 today. The 26B A4B MoE scores 1441 on LMArena while burning just 4B active parameters. Here's what that means for local inference.
Google DeepMind released Gemma 4 today. The 26B A4B MoE scores 1441 on LMArena while burning just 4B active parameters. Here's what that means for local inference.
I benchmarked 17 local LLMs across 13 dimensions with 39 tests. The results destroyed my assumptions about model size.