← r/LocalLLaMA
▲
4
+1
8👁
r/LocalLLaMA · u/dh7net · 20h ago

Harness x model combination: more data!

I'm testing harness x model combination for my local setup, but more importantly, I created a website for anyone to test their config and share their best results. airbench.ai

And it worked! Someone I don't know but I'm thanksfull for beat all my baseline with a 3090! (I'm using a 5090). here is the winning config so far: qwen3.8-flash-next-iq3\_s via pi and Strata, 3090 24GB, 80GB system ram, increased context to 256. More detailed here: https://airbench.ai/checkup/c58559df-40b2-40e4-b5f3-7a51c2c9336f/report

Thanks to data collected I can tell what is the best harness per model. See image.

On another note, to make the website better and encourage more people to participate I just added a "contributor" section, feel free to have a look. And yes you need to be logged in to contribute. And yes you don't have to. You can still access all the results from everyone.

https://preview.redd.it/vrhb9lj4f8uh1.png?width=2351&format=png&auto=…

5 0 4 10/8 15:32 10/9 07:36 UTC
scorecomments8 sightings
first seen 2026-10-08 15:32 UTClast seen 2026-10-09 07:36 UTCscore then 3score now 4gained +1sightings 8
open on reddit ↗ 💬 4 (+4)