Last tested Jun 18, 2026
VRAM is computed from parameter count (~20% added for KV cache + runtime) — an estimate; tune for your context length and serving stack.