← r/LocalLLaMA
▲
0
 
7👁
r/LocalLLaMA · u/tom_tsai28 · 3d ago

Wrote a 3MB standalone C runner for Gemma-2B. Caught a Layer 15 hallucination drop.

Weekend experiment running Gemma-2B on bare-metal x86-64 (pure C + AVX2, zero Python/CUDA, \~3.3MB single binary). Added a simple orthogonal probe on the residual stream to see what each layer is doing.

Tested it on Taiwan's statutory VAT rate (legally 5%). Layers 0-14 stay factual, but Layer 15 suddenly collapses into the negative, and RAX spits out "15%":

Layer 14 | Truth: +0.0163 | \[0xDF28010E\]

Layer 15 | Truth: -0.0481 | \[0x72DE18A0\] <- drops below 0

Layer 17 | Truth: -0.0817 | -> Register RAX outputs tokens: '1', '5', '%。'

Raw trace, 6-page paper, and release binary here for anyone into low-level ML:

\* Web trace: https://pulsar-tracer.web.app

\* PDF: https://pulsar-tracer.web.app/PULSAR\_Technical\_Whitepaper.pdf

\* Repo: https://github.com/tomtsai28/PULSAR-ASM

1 0 0 10/6 07:45 10/7 11:27 UTC
scorecomments7 sightings
first seen 2026-10-06 07:45 UTClast seen 2026-10-07 11:27 UTCscore then 0score now 0gained 0sightings 7
open on reddit ↗ 💬 3