normalize benchmarks from different time period
LiveBench has benchmark snapshots from different points in time. Could someone run an agent to normalize the values across these snapshots so we can compare model strength consistently from 2024 through 2026? Right now, it’s difficult to make meaningful comparisons across the full three-year period because the benchmarks can only be compared within each individual snapshot, not across snapshots.
scorecomments7 sightings
first seen 2026-10-03 06:32 UTClast seen 2026-10-04 01:40 UTCscore then 4score now 5gained +1sightings 7
open on reddit ↗
💬 4