Pi + llama-server randomly hung
I can't seem to find what's wrong. I'm using Pi for my llama-server and sometimes it just stops processing for some reason and stuck after tool call. Logs seems to think that it's finished its job while Pi thinks it's waiting for a response, so sometimes I have to stop it and tell it to "Continue". This only happens occasionally, 99% of the time it works with no problem. Anyone experienced something like this?
Edit: Just realized I was vagueposting. Running Qwen3.6 35B A3B IQ4_NL_XL from Unsloth, but I think it happened with other models as well.
scorecomments9 sightings
first seen 2026-10-03 06:29 UTClast seen 2026-10-07 06:39 UTCscore then 3score now 4gained +1sightings 9
open on reddit ↗
💬 15