← r/LocalLLaMA
▲
1
 
2👁
r/LocalLLaMA · u/OvertaxedOne · 10d ago

Good setup for QFN on 48GB Ampere GPU (A40)

Anyone have a good config they've found for QFN on a A40 (or similar Ampere GPU(s) with 48GB VRAM)? The system the card is in has 128GB of RAM (DDR3); right now it's running 27B but I'm curious if there's a way to move to QFN to maybe get better speed/a little more smarts. TY in advance!

1 0 1 10/3 06:29 10/3 13:34 UTC
scorecomments2 sightings
first seen 2026-10-03 06:29 UTClast seen 2026-10-03 13:34 UTCscore then 1score now 1gained 0sightings 2
open on reddit ↗ 💬 7 (+1)