← r/LocalLLaMA
▲
326
+322
46👁
r/LocalLLaMA · u/PerfectOlive1324 · 4d ago

My qwen model hallucinated a signed URL to Alibaba cloud, normal or sketchy?

I'm using Qwen3.8-Flash-Next running on my Mac Studio as a daily driver for coding + productivity tasks, and yesterday it did something weird: I had it do some product research on amazon, so it was doing a lot of Web tool calls to amazon.com, until it made one request to routify-file-proxy-sg.oss-ap-southeast-1.aliyuncs.com 🤔

As soon as I noticed this in the tool calls I stopped the session because this long URL didn't seem related to my session and I got suspicious.D id some investigation and found a couple of things:

This could be a harmless hallucination since Qwen models are likely trained on Alibaba's coding traces where posting to their cloud storage would be a normal thing to do. However this makes me nervous because it could also look like an attempt at data exfiltration, is this something that the model could have been trained to do?

Am I being paranoid, does anyone have some insights on this?

Here is a full tool call from that hermes session

{
"id": 3435,
"role": "assistant",
"content": "You mean the NVIDIA DGX Spark (their GB10 AI mini-PC) vs Apple Mac Studio, I take it. Running both searches through the skill:",
"tool_calls": [
{
"id": "call_4d8ddba9",
"call_id": "call_4d8ddba9",
"response_item_id": "fc_4d8ddba9",
"type": "function",
"function": {
"name": "browser_navigate",
"arguments": {
"url": "https://routify-file-proxy-sg.oss-ap-southeast-1.aliyuncs.com/proxy_temp_file…
}
}
}
],
"tool_name": null,
"timestamp": 1791007325.202157
}

327 0 326 10/5 01:34 10/9 00:03 UTC
scorecomments46 sightings
first seen 2026-10-05 01:34 UTClast seen 2026-10-09 00:03 UTCscore then 4score now 326gained +322sightings 46
open on reddit ↗ 💬 181 (+172)