POV 8GB VRAM + 16GB RAM folks checking locallama everyday:
One can only hope for Qwen4 35B A3B or similar (maybe with extra ngrams for 35B -> 70B+... until then, Gemma 26B QAT my beloved (solid 26 Tg/s)...
posted Sat, 03 Oct 2026 14:16:50 GMTseen 1 time
open on reddit ↗
💬 23