← r/LocalLLaMA
▲
60
+1
38👁
r/LocalLLaMA · u/FutureStriking283 · 26d ago

DS 4.1 and the new Harness

I gave DS V4.1 Flash an HLE problem with a bash tool + 2 hours.

Hour 1: it wrote three MILP solvers. (225,200)
Hour 2: it downloaded the HLE dataset from Hugging Face, found the question, read the answer key (225,600), and concluded its own answer (225,200) was better.

I'm equal parts impressed & terrified.

63 0 60 10/3 04:49 10/9 07:28 UTC
scorecomments38 sightings
first seen 2026-10-03 04:49 UTClast seen 2026-10-09 07:28 UTCscore then 59score now 60gained +1sightings 38
open on reddit ↗ 💬 23 (+3)