conv.

← The whole story
AI
DeepSeek v4.1 Flash Achieves Perfect Score on AI Hacking Benchmark

Researchers contest the benchmark claim with contrary test results

2 Sep 16 11:15 AM · 11d ago · 1 post · 1 comment · 2 sources · development 2 of 5

Hacker News commenter TuxSH reports benchmarking DeepSeek v4.1 Flash against GLM 5.3 on a Nintendo 3DS kernel decomposition task. GLM 5.3 found almost all vulnerabilities in 30 minutes for $22, while DeepSeek found only one vulnerability in 40 minutes for $2, suggesting the model may perform better on low-hanging fruit targets.

Researchers contest the benchmark claim with contrary test results
enclave.ai

“GLM 5.3 founds almost all the vulns in 30min for $22, while DS only found one vuln for $2 in 40min. Perhaps DS works better where targets have low-hanging fruits than can be found fast?”

TuxSH

Enclave.ai Security research firmDeepSeek AI model provider

The whole story articlespostscomments the bright band is this development · numbered dots are the others · click one to jump

Peak 5 pieces in 3h at Sep 16, 10 AM; 11 pieces over 12 days (1 article · 2 posts · 8 comments) Sep 16, 7 AM — 2 pieces · 1 article · 1 post — Hacker News 1, Newswires 1Sep 16, 10 AM — 5 pieces · 1 post · 4 comments — Hacker News 4, Mastodon 1Sep 16, 1 PM — 3 pieces · 3 comments — Hacker News 3Sep 16, 4 PM — quietSep 16, 7 PM — 1 piece · 1 comment — Hacker News 1Sep 16, 10 PM — quietSep 17, 1 AM — quietSep 17, 4 AM — quietSep 17, 7 AM — quietSep 17, 10 AM — quietSep 17, 1 PM — quietSep 17, 4 PM — quietSep 17, 7 PM — quietSep 17, 10 PM — quietSep 18, 1 AM — quietSep 18, 4 AM — quietSep 18, 7 AM — quietSep 18, 10 AM — quietSep 18, 1 PM — quietSep 18, 4 PM — quietSep 18, 7 PM — quietSep 18, 10 PM — quietSep 19, 1 AM — quietSep 19, 4 AM — quietSep 19, 7 AM — quietSep 19, 10 AM — quietSep 19, 1 PM — quietSep 19, 4 PM — quietSep 19, 7 PM — quietSep 19, 10 PM — quietSep 20, 1 AM — quietSep 20, 4 AM — quietSep 20, 7 AM — quietSep 20, 10 AM — quietSep 20, 1 PM — quietSep 20, 4 PM — quietSep 20, 7 PM — quietSep 20, 10 PM — quietSep 21, 1 AM — quietSep 21, 4 AM — quietSep 21, 7 AM — quietSep 21, 10 AM — quietSep 21, 1 PM — quietSep 21, 4 PM — quietSep 21, 7 PM — quietSep 21, 10 PM — quietSep 22, 1 AM — quietSep 22, 4 AM — quietSep 22, 7 AM — quietSep 22, 10 AM — quietSep 22, 1 PM — quietSep 22, 4 PM — quietSep 22, 7 PM — quietSep 22, 10 PM — quietSep 23, 1 AM — quietSep 23, 4 AM — quietSep 23, 7 AM — quietSep 23, 10 AM — quietSep 23, 1 PM — quietSep 23, 4 PM — quietSep 23, 7 PM — quietSep 23, 10 PM — quietSep 24, 1 AM — quietSep 24, 4 AM — quietSep 24, 7 AM — quietSep 24, 10 AM — quietSep 24, 1 PM — quietSep 24, 4 PM — quietSep 24, 7 PM — quietSep 24, 10 PM — quietSep 25, 1 AM — quietSep 25, 4 AM — quietSep 25, 7 AM — quietSep 25, 10 AM — quietSep 25, 1 PM — quietSep 25, 4 PM — quietSep 25, 7 PM — quietSep 25, 10 PM — quietYesterday, 1 AM — quietYesterday, 4 AM — quietYesterday, 7 AM — quietYesterday, 10 AM — quietYesterday, 1 PM — quietYesterday, 4 PM — quietYesterday, 7 PM — quietYesterday, 10 PM — quietToday, 1 AM — quietToday, 4 AM — quietToday, 7 AM — quietToday, 10 AM — quietToday, 1 PM — quietToday, 4 PM — quietToday, 7 PM — quiet 1–5
1–5Researchers contest the benchmark claim…
Sep 17Sep 18Sep 19Sep 20Sep 21Sep 22Sep 23Sep 24Sep 25yesterdaynow · 10:23 PM ET

What people said 1 voice · verbatim

All 5 developments of DeepSeek v4.1 Flash Achieves Perfect Score on AI Hacking… →

Hacker NewsMastodonNewswires