RESEARCH

METR Finds Anthropic’s Internal AI Use Has Roughly Doubled Its Model-Improvement Pace

J James Whitfield Nov 8, 2026 2 min read
Engine Score 8/10 — Important

Primary-source METR assessment of Anthropic's AI-accelerated R&D, high actionability

Editorial illustration for: METR Finds Anthropic's Internal AI Use Has Roughly Doubled Its Model-Improvement Pace
  • METR staff conducted a high-access assessment inside Anthropic from August 12 to October 29, 2026, to measure whether AI is accelerating Anthropic’s own AI research.
  • The report concludes Anthropic is improving model capabilities at roughly twice the rate it did between March 2024 and October 2025.
  • METR attributes about 80% of that acceleration to Anthropic’s heavy internal use of AI in its own R&D process, not to larger training-compute budgets.
  • Anthropic gave METR access to pretraining, reinforcement-learning, and compute data, internal benchmark scores, speedup analyses, model forecasts, and staff interviews.

What Happened

METR published an independent assessment on November 5, 2026 of how much AI is speeding up Anthropic’s own model development, after an 11-week on-site evaluation that ran from August 12 through October 29.

Why It Matters

This is METR’s second major look inside a frontier lab’s development process this year; the group’s earlier evaluation found it could barely measure the capability gains of a prior Anthropic model. The new finding gives one of the first independently reviewed estimates of how much labs’ own AI tools are now driving their research speed, rather than relying on labs’ self-reported claims.

Technical Details

Anthropic granted METR unusually broad access: metrics on pretraining and reinforcement-learning runs, training compute broken out by domain, benchmark scores for unreleased internal models, AI-driven speedup analyses, forecasts for upcoming models, and interviews with Anthropic staff. METR found the roughly 2x acceleration in capability improvement is not explained by a corresponding jump in training-compute scale.

Who’s Affected

The assessment matters most for AI-safety researchers and regulators trying to track recursive self-improvement risk, since an 80%-AI-driven acceleration in a lab’s own R&D is a concrete data point rather than a hypothetical. It also bears on competitors like OpenAI and Google DeepMind, who face pressure to demonstrate comparable internal efficiency gains.

What’s Next

METR says the assessment relied on data Anthropic chose to share and interviews it arranged, a limitation METR flags itself; independent replication at another lab would help confirm whether the roughly 2x acceleration pattern holds industry-wide.

Share

Enjoyed this story?

Get articles like this delivered daily. The Engine Room — free AI intelligence newsletter.

Free · No spam · Unsubscribe anytime