SemiAnalysis argues GDPval is outdated for agentic models
2 Nov 1 11:04 PM · 9d ago · 1 post · 1 source · development 2 of 2
The newsletter argued that OpenAI's GDPval, released September 2025 and still widely cited on model release cards, predates the agentic era and is poorly suited to evaluating current frontier models, motivating GDPx's design.
“GDPval may have been marketed as a “knowledge work” benchmark, but agents weren’t really even a thing yet.”
SemiAnalysisSemiAnalysis Benchmark creator and publisherOpenAI Developer of GPT-6 AstraAnthropic Developer of Opus 5.5Google Developer of Gemini 4 Carbon
The whole story posts the bright band is this development · numbered dots are the others · click one to jump
Reported in the same hours no headline names this development itself — these 1 claim were published in its stretch
-
first by SemiAnalysis, 9d ago
What people said 3 voices · verbatim
-
Super interesting Benchmark. GDPx measures how well AI agents handle 206 challenging tasks across 11 economically valuable fields, including chip design, software engineering, finance, and biology. But here's the interesting part: Opus 5.5 wins with 12%, closely followed by Gemini 4 Carbon with 10...
-
SemiAnalysis just released GDPx, a new benchmark for measuring agentic capabilities across some of the most economically valuable domains. Crazy to see Opus 5.5 at the top with just 12.0%, followed by Google's upcoming Gemini Carbon at 10.9%.
-
Today we're releasing GDPx, a benchmark for measuring agentic capabilities across the most valuable domains. GDPx is a true frontier-level benchmark: even the best model scores just 12% (1/7)🧵
All 2 developments of SemiAnalysis launches GDPx, a tougher agentic AI benchmark →
XHacker NewsNewswiresMastodonGoogle News