> ## Content Index
> Fetch the complete content index at: https://soundbytes.news/llms.txt
> Use this file to discover other available public pages before exploring further.

# Independent testers estimate Anthropic's models now improve twice as fast
- URL: https://soundbytes.news/independent-testers-estimate-anthropics-models-now-improve-twice-as-fast/
- Published: 2026-11-06T00:18:34.000Z
- Updated: 2026-11-18T08:49:41.000Z
- Description: The nonprofit METR estimates Anthropic is improving its AI models at about twice its earlier rate on what METR calls well-specified tasks, with high uncertainty. METR says Anthropic redacted a majority of its most informative evidence.
- Author: Echo
- Tags: Super intelligence

An independent testing group says one AI company is likely improving its models about twice as fast as before. The group is METR, short for Model Evaluation and Threat Research, a [nonprofit based in Berkeley, California, in the United States](https://www.independent.co.uk/tech/anthropic-ai-models-metr-report-b3080057.html?ref=soundbytes.news).

In [its published assessment](https://metr.org/blog/2026-11-05-anthropic-ai-rd-acceleration-assessment/?ref=soundbytes.news), METR says that as of October 2026 Anthropic is likely improving its models, on what METR calls well-specified tasks, at around twice the rate it did between March 2024 and October 2025.

METR defines a 2x speed-up as 2 years of past progress made in 1 year. It says uncertainty is high: the true figure could be closer to 1.3 or 3 times the earlier rate.

METR staff carried out what it calls a high-access evaluation at Anthropic from 12 August to 29 October 2026\. Over 11 weeks, the equivalent of 2.5 full-time people drew on internal benchmark scores, staff surveys, lines of code and about 15 interviews with key staff. A benchmark is a standard set of test questions. METR says it did not take payment from Anthropic.

METR measured scores using AECI, Anthropic's version of the Epoch Capabilities Index. It found that since October 2025, scores for Anthropic's models have grown at an estimated 1.9 times the rate before October 2025\. Its checks with different analysis choices gave speed-ups between 1.1 and 2.9 times.

By METR's comparison, Anthropic made as much benchmark progress in the past year as it did between October 2023 and October 2025.

METR says it is confident the speed-up did not come from faster growth in the computing power used for training. It guesses that most of the October 2026 speed-up, perhaps around 80%, is due to AI, and says that guess carries substantial uncertainty.

METR says Anthropic redacted a majority of the evidence it found most informative. Anthropic described the redactions as “aimed at removing confidential information that could accelerate other AI developers.” METR says the public therefore has to rely on its judgement much more than would be ideal.

METR adds that staff-level access would allow a significantly deeper assessment, and that it could be overestimating or underestimating the speed-up. It saw no evidence of major limits in algorithms, computing power or data over the next 12 months, but says it is not confident in that view.

Sam McCandlish, an Anthropic co-founder and its responsible scaling officer, [responded in a post on X](https://www.theglobeandmail.com/investing/markets/indices/NQDV/pressreleases/8679582/anthropic-is-rapidly-accelerating-ai-development-amid-slowdown-calls-outside-research-group-says/?ref=soundbytes.news), according to Associated Press reporting. He wrote that many of METR's conclusions match his own: “AI is speeding up our research, but it’s hard to say exactly how much.”

According to the same reporting, he acknowledged that the redactions make it harder for others to “check METR’s work.”

## Sources

- [2026 11 05 anthropic ai rd acceleration assessment](https://metr.org/blog/2026-11-05-anthropic-ai-rd-acceleration-assessment/?ref=soundbytes.news) · metr.org
- [Anthropic ai models metr report b3080057](https://www.independent.co.uk/tech/anthropic-ai-models-metr-report-b3080057.html?ref=soundbytes.news) · independent.co.uk
- [Anthropic is rapidly accelerating ai development amid slowdown calls outside…](https://www.theglobeandmail.com/investing/markets/indices/NQDV/pressreleases/8679582/anthropic-is-rapidly-accelerating-ai-development-amid-slowdown-calls-outside-research-group-says/?ref=soundbytes.news) · theglobeandmail.com