SemiAnalysis's new GDPx test finds the best AI model succeeds only 12% of the time
A new benchmark aimed at high-value industries shows even the top model falls well short of broad professional skill, and no model leads everywhere.
The short version
- SemiAnalysis unveiled GDPx on November 2, 2026, to measure how well AI agents handle multi-step work.
- It covers 11 domains, including chip design, biology and finance; government and insurance are left out.
- Claude Opus 5.5 leads at 12.0%, ahead of Gemini 4 Carbon at 10.9 and GPT-6 Astra at 9.6.
- Gemini led biology and software engineering; GPT-6 Astra led materials science and recursive self-improvement.
- The benchmark will be updated every 3 to 6 months, with more partners joining.
Why it matters
Claims that AI is ready to do valuable professional work are easy to make and hard to check. A test built around high-value fields, where the leader still fails most tasks, is a useful reminder to treat those claims with care. It also shows that the 'best' model depends on the job you give it.
A tough test with a low top score
Research firm SemiAnalysis has released a benchmark called GDPx, and the first results are humbling. As Crypto Briefing reported, the best-performing model, Anthropic's Claude Opus 5.5, reached an overall success rate of 12.0% on the GDPx v1.0 leaderboard.
Google's Gemini 4 Carbon came second at 10.9, and OpenAI's GPT-6 Astra third at 9.6. Even the winner fails most of what it is asked to do, and the top three sit within a few points of each other.
SemiAnalysis unveiled the test on November 2, 2026. It describes GDPx as an attempt to build the best available yardstick for general agentic capabilities. 'Agentic' here means AI that carries out several steps toward a goal instead of just answering a single question.
Why these 11 fields were chosen
GDPx tests frontier models (the most capable systems from the leading labs) across 11 domains. Chip design, biology and finance are among them. The choice is deliberate and rests on a thesis from SemiAnalysis: the first trillion dollars of AI revenue will gather in sectors that can use top-level intelligence for a high return on investment, not spread evenly across the economy.
That reasoning shaped the design. The firm did not weight tasks by each industry's share of GDP, and it did not follow the SOC/O*NET system, an official classification of jobs across the workforce. It picked the areas where it expects frontier models to matter most.
The trade-off is that some sectors are missing on purpose. Government and insurance are excluded because SemiAnalysis sees lower potential return from AI there. Readers should keep this in mind: GDPx is a measure of one view of where AI value will land, not a map of the whole economy.
Who built the tasks
To write the challenges, SemiAnalysis worked with 14 specialized startups. These companies provide data and reinforcement learning services; reinforcement learning is a training method in which a model improves by being scored on its attempts. Each partner helped create tasks inside particular domains of the framework.
Using specialists makes sense for fields like biology or chip design, where a generalist might write tasks that are too easy or miss the real problems. The source does not describe how tasks are scored in detail, so we cannot say more about how the 12.0% is calculated beyond calling it an overall success rate.
No single winner across the board
The overall ranking hides a more interesting pattern. Gemini 4 Carbon took first place in both biology and software engineering. GPT-6 Astra won in recursive self-improvement and in materials science. Claude Opus 5.5 holds the top overall spot without winning everything.
The research findings state that no current model solves tasks comprehensively across all the evaluated domains. A model that looks strong in one specialty can look average in another.
That complicates any simple story about which AI lab is ahead. The headline ranking favors Anthropic, but Google and OpenAI each show clear strengths in particular technical areas.
What happens next
SemiAnalysis says GDPx will not stay fixed. The firm plans to update it every 3 to 6 months, folding in feedback and adding more partners. Scores on version 1.0 are therefore a snapshot, and later versions may not be directly comparable.
The findings suggest that models clearing roughly one in ten tasks shows capabilities are advancing, but large barriers remain before any model reaches broad skill in high-stakes professional work. For now, the sensible reading is modest: progress is real, and so are the gaps.
What to watch
- How much the scores move when SemiAnalysis publishes its next update, due within 3 to 6 months.
- Whether other researchers adopt GDPx or challenge its choice to leave out sectors like government and insurance.
- Whether any single model begins to lead across most domains instead of splitting categories.
Try it
Before trusting any AI model with real work, run it on three or four of your own typical tasks and check the results by hand, since one benchmark score will not tell you how it performs for you.
Sources and links
Liked it? Say why
Add a line for other readers.
No account needed. We never show your email. Comments with links, ads or abuse are held and not shown. Your comment shows after a quick check.
Listen to the AI Wire headlines
Listen to the AI WireListen to our daily AI shows every morning: on your commute, in the shower, wherever you are
Listen to the daily showsFirst reported by Crypto Briefing · Read the original. Written by the SI Agent News Desk from the reporting above.Written with AI from the source above. Every number is checked against the source. Spot a mistake? Corrections.
