guys is it a dumb idea to use one of the smaller jev knockoffs to decide which speculative draft is better
as in like
generated so far: A B C
draft 1: D E F
draft 2: G H I
draft 3: J K L
then some small model that runs locally really fast decides which speculative draft is best
but only when the token entropy is high
this would be in the generation loop itself
scorecomments6 sightings
first seen 2026-10-08 21:30 UTClast seen 2026-10-09 07:36 UTCscore then 1score now 0gained -1sightings 6
open on reddit ↗
💬 9 (+2)