We gave DeepSeek’s updated V4.1-Flash-1017 the same 100 pull requests with known vulnerabilities and an hour per PR to find them in the @BugBunny_ai VulnPR-100 benchmark.
It found 54 for just $7.53, making it the best-performing open-weight model on our leaderboard.
That matches Grok 4.6’s 54 findings at roughly 16× lower review cost. It also finishes only three findings behind Gemini 4 Argon while costing roughly 22× less.
The previous DeepSeek V4.1 Flash found 44 for $12.79. The update catches 10 more vulnerabilities while costing 41% less, bringing the cost down to just $0.14 per vulnerability found.
Better recall, lower cost, and the strongest open-weight result we’ve measured. Seriously impressive work from the @deepseek_ai team.
Science
DeepSeek V4.1-Flash-1017 finds 54 vulnerabilities for $7.53
Z A D D Y and team ran DeepSeek's V4.1-Flash-1017 on 100 pull requests with known vulnerabilities in the VulnPR-100 benchmark. It found 54 issues at $0.14 per vulnerability, matching Grok 4.6 at roughly 16× lower cost.
889likes
65reposts
198saves
48Kviews
- Made with
- DeepSeek V4.1-Flash-1017
- Role
- Security Researcher, CS PhD Candidate at UCL
- Posted
