New tensor type layouts for my GGUF uploads
Hey all, long time no post.
Figured I'd pop my head in to point you towards a blog post I just published about research I had performed and changes I'm making to the shape of models I post, you can read it here:
https://huggingface.co/blog/bartowski/per-tensor-layout-maps-for-gguf-quantiz…
I won't try to claim "Pareto frontier" or "best models in the world", but I will say from tests the new shapes look to be better across the board than what I was posting before, so I'm really happy with where it came out, and I hope to not be done yet either :)
https://cdn-uploads.huggingface.co/production/uploads/6435718aaaef013d1aec3b8…
If anyone has any questions let me know!
scorecomments21 sightings
first seen 2026-10-03 04:44 UTClast seen 2026-10-07 16:58 UTCscore then 134score now 134gained 0sightings 21
open on reddit ↗
💬 26