← r/LocalLLaMA
▲
0
 
14👁
r/LocalLLaMA · u/rawdikrik · 11d ago

Argue with each other for my edu-tainment - 5070 + 5060ti OR RX 7900XTX

I run an Unraid server and use local models for STT, memory, a small llm (I like the new swift bonsai), and SystemOne Models. I currently have a 5070 plugged into my x570 board (with a 5600x), and then the 5060ti on a riser. The 5060 runs at x4, there is a limitation on the board setup.

Running a model big enough for both cards runs SLOW, since the connection to the 5060ti is capped.

Ive tried optimizing with ninfer and vllm, but my speed is capped at the hardware level.

I am considering scrapping the 2 card setup for a single card, and right now the best budget option is the RX7900XTX.

Can you guys argue about what would be the better setup? I dont need the newest models, and I dont need the most speed. I pay for online models. I just like to have a bit of local stuff to help with server stuff. I feel like I spend too much time managing the 2 card setup for not enough to get out of it, and I think dropping to the one card would make things easier without a loss in speed. The idea is to sell both NVIDIA cards, and just get a single card with big enough memory that isnt a pig.

Any advice would help.

1 0 0 10/3 06:30 10/7 08:02 UTC
scorecomments14 sightings
first seen 2026-10-03 06:30 UTClast seen 2026-10-07 08:02 UTCscore then 0score now 0gained 0sightings 14
open on reddit ↗ 💬 44