Last tested Jul 3, 2026
The standout single-GPU self-host pick. Only 3B active params → 70–80 tok/s, faster than most 70B dense models. Apache 2.0, 262K context.