← r/LocalLLaMA
▲
134
 
21👁
r/LocalLLaMA · u/noneabove1182 · 29d ago

New tensor type layouts for my GGUF uploads

Hey all, long time no post.

Figured I'd pop my head in to point you towards a blog post I just published about research I had performed and changes I'm making to the shape of models I post, you can read it here:

https://huggingface.co/blog/bartowski/per-tensor-layout-maps-for-gguf-quantiz…

I won't try to claim "Pareto frontier" or "best models in the world", but I will say from tests the new shapes look to be better across the board than what I was posting before, so I'm really happy with where it came out, and I hope to not be done yet either :)

https://cdn-uploads.huggingface.co/production/uploads/6435718aaaef013d1aec3b8…

If anyone has any questions let me know!

137 0 134 10/3 04:44 10/7 16:58 UTC
scorecomments21 sightings
first seen 2026-10-03 04:44 UTClast seen 2026-10-07 16:58 UTCscore then 134score now 134gained 0sightings 21
open on reddit ↗ 💬 26