Cybersecurity is local AI model's killer use case

This weekend I posted about the gap closing between frontier models and open source models. Well, now I'm coming with receipts.

I've been running local + cloud models against real public github codebases. This is all provable and verifiable: https://github.com/CYPHES-ATP/Node (audit.db)

Over two weeks:

1,665 model runs
1,067 security findings
27 repos

Results:

|Model|Paths checked|Real|
|:-|:-|:-|
|claude-opus-5|8|0/8|
|minimax-m3|12|10/12|
|deepseek-v4-flash|6|6/6|
|glm-5.1|5|5/5|
|gpt-oss-20b|5|5/5|

My takeaway:

When it comes to cybersecurity, nothing will beat open source models.

Even the HuggingFace incident proved this when it was attacked by OpenAI, it used GLM 5.2 to defend itself.

Happy to share the queries / methodology if anyone wants to reproduce it.