DS 4.1 and the new Harness
I gave DS V4.1 Flash an HLE problem with a bash tool + 2 hours.
Hour 1: it wrote three MILP solvers. (225,200)
Hour 2: it downloaded the HLE dataset from Hugging Face, found the question, read the answer key (225,600), and concluded its own answer (225,200) was better.
I'm equal parts impressed & terrified.
scorecomments38 sightings
first seen 2026-10-03 04:49 UTClast seen 2026-10-09 07:28 UTCscore then 59score now 60gained +1sightings 38
open on reddit ↗
💬 23 (+3)