← r/LocalLLaMA
▲
0
-1
6👁
r/LocalLLaMA · u/Aggravating-Push-207 · 12h ago

guys is it a dumb idea to use one of the smaller jev knockoffs to decide which speculative draft is better

as in like

generated so far: A B C
draft 1: D E F
draft 2: G H I
draft 3: J K L

then some small model that runs locally really fast decides which speculative draft is best

but only when the token entropy is high

this would be in the generation loop itself

1 0 0 10/8 21:30 10/9 07:36 UTC
scorecomments6 sightings
first seen 2026-10-08 21:30 UTClast seen 2026-10-09 07:36 UTCscore then 1score now 0gained -1sightings 6
open on reddit ↗ 💬 9 (+2)