← r/LocalLLaMA
▲
65
 
28👁
r/LocalLLaMA · u/AvidCyclist250 · 15d ago

Qwen 3.8 Flash Next q4_k_m, 130k context, q8 cache on 16GB VRAM ann 64GB RAM, 15-20 t/s on 4080

Thought it's about time to share after testing for a week. You need four things most people miss: the right quant, the right model, the right branch, and the right cache flags.

https://github.com/dtm-beep/qwen38-flash-next-mtp-16gb

TLDR: AtomicChat AD-4.27bpw Q4_K_M target + the shared Unsloth MTP head, build from my pr-mtp-fix branch (plain master can't load this MTP head yet, it's PR #28243 + one fix commit), and --spec-draft-cpu-moe is the trick that makes 16 GB work. Draft experts live in RAM so the target's hot experts get the GPU. IQ4_XS ~10 t/s → 16.5 tg / 350 pp at 131k, q8 KV.

Hope it helps someone.

69 0 65 10/3 04:49 10/8 23:24 UTC
scorecomments28 sightings
first seen 2026-10-03 04:49 UTClast seen 2026-10-08 23:24 UTCscore then 65score now 65gained 0sightings 28
open on reddit ↗ 💬 66