METR says Anthropic's AI progress has sped up, with AI now helping build AI
An independent lab reports Anthropic's models are improving about 1.9 times faster than before, but Anthropic had much of the report cut.
The short version
- METR published its evaluation of Anthropic on November 5, after an 11-week review.
- It estimates benchmark growth of about 1.9 times the earlier pace since October 2025.
- Anthropic finished 3 models in the past half year that are not yet public.
- Staff rated their own productivity gain at about 12 times with the strongest internal model.
- Anthropic required heavy cuts, so the public sees only part of the evidence.
Why it matters
If AI really is speeding up its own development, the pace of new tools could get harder to predict. But the evidence is partly hidden, so the size of the effect is unconfirmed. Treat it as a credible signal, not a settled measurement.
What METR reported
METR is an independent AI safety research group. As technews.tw reported, on November 5 it released an evaluation saying Anthropic's models have improved about twice as fast over the past year on tasks that can be clearly defined.
The team puts the rate at roughly 1.9 times the earlier pace since October 2025. In plain terms, that is about two years of past progress packed into one.
AI helping to build AI
METR says the speed-up comes mainly from Anthropic using AI heavily in its own research and development, not simply from throwing more computing power at training.
The report also notes that more oversight and training work is being handed to other AI models. This is called recursive self-improvement: AI helping to improve the next AI, which can keep progress accelerating. METR has not yet seen a clear bottleneck that would slow this down.
What staff say inside the company
METR combined internal data, interviews and performance data from unreleased models over 11 weeks, with unusual internal access. Anthropic finished 3 models in the past half year that the public cannot use, and employees work with versions well ahead of what customers get.
In an internal Slack poll and interviews, staff reported big productivity gains. For the strongest internal model, the average self-rated boost was about 12 times. Some researchers said their bottleneck has moved from writing code to coming up with ideas and getting enough computing power.
The limits of what we can see
The report itself says Anthropic required large cuts, so outsiders get only part of the evidence and conclusions. The 12 times figure is also self-reported by employees, not a measured result.
METR adds that AI still cannot make major contributions on its own in the most important training steps. People remain in the loop where it counts most.
What to watch
- Will METR or Anthropic publish a fuller, less redacted version of the evidence?
- Will other independent groups measure the same acceleration and get similar results?
- Will AI start making major contributions to the most critical training steps without human help?
Try it
Next time you use an AI coding or writing tool, note how long generating the work takes versus checking it. That shows where your own bottleneck is.
Sources and links
- Reportingtechnews.tw: the article we sourced
Liked it? Say why
Add a line for other readers.
No account needed. We never show your email. Comments with links, ads or abuse are held and not shown. Your comment shows after a quick check.
Listen to the AI Wire headlines
Listen to the AI WireListen to our daily AI shows every morning: on your commute, in the shower, wherever you are
Listen to the daily showsFirst reported by technews.tw · Read the original. Written by the SI Agent News Desk from the reporting above.Written with AI from the source above. Every number is checked against the source. Spot a mistake? Corrections.
