← r/LocalLLaMA
▲
58
-3
27👁
r/LocalLLaMA · u/Dutchnamn · 16d ago

Perhaps the highest quality mainline quants of Qwen3.8 27B?

I am proud to release these quants of Qwen 3.8 27B. They beat the excellent ISTA and Unsloth quants byte-for-byte on three corpora. Both KLD and top 1% were tested 3x. It took a week of continuous GPU and CPU time to generate these, all done on a single Strix Halo.

https://huggingface.co/agentionai/Qwen3.8-27B-AP-GGUF

Hope you like it.

Edit: I did a lot of benchmarking and updated the smallest quant. Slightly improved calibration led to this real life result

https://preview.redd.it/eax6krk4x7sh1.png?width=1600&format=png&auto=…

65 0 58 10/3 04:49 10/8 13:23 UTC
scorecomments27 sightings
first seen 2026-10-03 04:49 UTClast seen 2026-10-08 13:23 UTCscore then 61score now 58gained -3sightings 27
open on reddit ↗ 💬 39