Case TS-4E7EB4067 Nov 2026researchCompound claim

AI

“AI-evaluation nonprofit METR published a new report based on 11 weeks of inside access to Anthropic's internal data and staff interviews, concluding that Anthropic's AI progress is likely running about 2x as fast as before, mostly due to its own AI.”

Plain restatementMETR published a report, based on roughly 11 weeks of access to Anthropic internal data and employee interviews, estimating that Anthropic's rate of model capability improvement is about twice its earlier rate, with AI assistance judged the main driver.

Mostly accurateConfidence High
What this verdict means →

This one largely checks out. METR, an independent AI evaluation nonprofit, did publish a report on November 5, 2026, after about eleven weeks of access to Anthropic's internal data and roughly fifteen staff interviews, and it does estimate that Anthropic's model capabilities are improving at about twice their earlier rate. The specific numbers in the post are accurate: a plausible range of 1.3 to 3 times, and a guess that roughly 80 percent of the speedup comes from Anthropic using AI in its own research. Two things are worth knowing that the post compresses. First, METR's finding is about scores on a benchmark index built by Anthropic, not about progress in general, and METR says it is unclear how those scores translate to real-world capability. Second, the 80 percent figure is explicitly labelled by METR as a guess with substantial uncertainty, and Anthropic redacted most of the evidence behind it, which METR itself says leaves outsiders relying on its judgment more than it would like. METR's own sensitivity checks produce results ranging from about 1.1 to 2.9 times, and the figure drops to around 1.4 times when models from other companies are included. So the post reports the report faithfully, but the report is a careful, heavily caveated estimate rather than a measurement.

The drift / as claimed vs as evidenced

[drifted from the evidence:] AI-evaluation nonprofit METR published a [drifted from the evidence:] new report based on 11 weeks of [drifted from the evidence:] inside access to [drifted from the evidence:] Anthropic's internal data and [drifted from the evidence:] staff interviews, [drifted from the evidence:] concluding that Anthropic's [drifted from the evidence:] AI progress is [drifted from the evidence:] likely running about [drifted from the evidence:] 2x as fast as before, mostly due to its [drifted from the evidence:] own AI.


METR published a report, based on [added by the neutral restatement:] roughly 11 weeks of access to [added by the neutral restatement:] Anthropic internal data and [added by the neutral restatement:] employee interviews, [added by the neutral restatement:] estimating that Anthropic's [added by the neutral restatement:] rate of model capability improvement is about [added by the neutral restatement:] twice its [added by the neutral restatement:] earlier rate, with AI [added by the neutral restatement:] assistance judged the main driver.

Red-tinted words in the claim drifted from the evidence. Green-tinted words are what a neutral restatement needs.

The trace / claim to source

Where it appeared
⌿ Omitted qualifier
A load-bearing condition from the source quietly disappears from the claim.
capability extrapolation
unreleased as released
Secondary sourcenamed-outlet journalism
ABC News / AP wire report on the METR assessment
Secondary sourcetech press
The Decoder, coverage including the Risk Report comparison
Secondary sourcecommunity aggregation of primary quotes
LessWrong linkpost collecting the report and practitioner reactions, 2026-11-05
Secondary sourcetech and finance press
Reporting on Anthropic's amended Form S-1/A filed 2026-11-02
Secondary sourcetrade press and newsletter
TechRepublic, The Rundown AI newsletter (the post's own stated source), and various syndicated coverage
Primary sourceindependent evaluator, self-published, not refereed
METR, "Independent Assessment of AI R&D Acceleration at Anthropic in October 2026," published 2026-11-05
Primary sourceindependent evaluator
METR, "Review of the 'Risks from automated R&D' section in Anthropic's Risk Report (August 2026)," 2026-11-05
Primary sourcenamed individual, METR technical staff
Ryan Greenblatt, post on X, 2026-11-05
Primary sourcenamed individual
Ryan Greenblatt, post on X announcing his move to METR, ~41 days before 2026-11-07
● Primary source found
What is true
  • METR did publish a report on 2026-11-05 assessing AI R&D acceleration at Anthropic. The report exists and is on METR's own site.
  • The access window, August 12 to October 29, 2026, is about 11 weeks, matching the post.
  • The work was based on Anthropic internal data plus staff interviews, roughly 15 of them, as the post describes.
  • METR's central framing is that Anthropic is improving model capabilities at around twice its March 2024 to October 2025 rate, with a measured AECI acceleration of 1.9x and a 95% confidence interval of 1.5x to 2.8x.
  • The post's "1.3 to 3x" range matches METR's own stated uncertainty language almost exactly.
  • The post's "around 80%" matches METR's own guess that perhaps about 80% of the current, October 2026, acceleration is due to AI.
  • The redaction description is accurate. METR said Anthropic redacted a majority of the evidence METR found most informative.
  • The McCandlish quote about a roadmap is real and is quoted accurately in substance.
  • "Model 4" is real as an internal designation in METR's report, and METR does say it exceeds 50% on all the AECI benchmarks it was tested on.
  • The S-1 element is accurate in substance. Anthropic's amended filing of 2026-11-02 does add language that it may imminently meet its Responsible Scaling Policy definition of "dramatically accelerated progress attributable to AI."
  • Ryan Greenblatt's "seriously wrong" quote is real, and describing him as METR's own is correct as of his 2026 move to METR.
  • METR does say it did not find convincing near-term bottlenecks, which supports the caption's "no clear bottlenecks."
What is misleading
  • The claim says "Anthropic's AI progress is likely running about 2x as fast." METR's sentence is narrower: capabilities of their models "on well-specified tasks," measured by a benchmark index. METR separately cautions that recent progress may be overfitting to the kinds of tasks included in the index, and that it remains unclear how benchmark scores map to real-world capabilities. Dropping "on well-specified tasks" converts a benchmark-trend finding into a general statement about company progress.
  • The claim presents the 80% AI attribution as a conclusion. METR presents it as a guess given with substantial uncertainty, and explicitly says the late-2025 portion of the acceleration was likely influenced by non-AI factors. The post's word "crediting" reads as a finding rather than a judgment call. The post does carry the 1.3x to 3x range, which partly offsets this.
  • The claim does not mention that AECI is Anthropic's own index, that the underlying data was supplied by Anthropic, or that METR's headline Anthropic-only figure falls to about 1.4x when all frontier developers' models are included in the same analysis. METR's own robustness table spans 1.1x to 2.9x depending on one modelling choice. The single "2x" number is the middle of a wide and assumption-sensitive range.
  • Capability extrapolation (in the caption, not the headline claim): the caption's closing line that the loop "already seems to be running inside Anthropic" and "may only get faster" states as an observation what METR frames as an uncertain attribution resting on evidence the public cannot see. Anthropic's own filing, per reporting, states it has not designated any current model as exceeding the threshold.
  • Imprecise count: the post says the report "revealed two internal models ahead of" Opus 5.5. The report covers three unreleased internal models, designated Model 2, Model 3 and Model 4. Whether exactly two of them sit ahead of Opus 5.5 is plausible from the chart but is not something I could confirm from METR's own text.
What is uncertain
  • Whether Model 4 was tested on exactly 15 benchmarks. METR's own quoted wording is "all the AECI benchmarks on which it was tested," without a number in the passages I retrieved. The figure of 15 appears in secondary coverage, which also uses 15 for the number of staff interviews, so the two could have been conflated somewhere in the chain.
  • Whether exactly two internal models outrank Opus 5.5, as the post states. Three internal models appear in the analysis.
  • Whether METR's 80% attribution to AI is correct. This is the weakest-supported element of the report itself, not of the post. The evidence behind it was largely redacted, and METR says the public cannot check it to the degree it would want.
  • Whether the measured benchmark acceleration corresponds to a real-world doubling of research output. METR raises this question itself and does not resolve it.
  • The exact wording of the Anthropic S-1/A passages, which I have only through named-outlet reporting rather than from the filing itself.
Evidence summary

METR's report exists, is dated 2026-11-05, and says substantially what the post says it says. The report's own summary states that benchmark scores of Anthropic's models, as measured by AECI (Anthropic's version of the Epoch Capabilities Index), have accelerated 1.9x [95% confidence interval: 1.5–2.8x] since October 2025, implying that Anthropic has made roughly two years of historical progress over the last year. On the headline framing, METR's wording is narrower than "AI progress." METR says Anthropic "is likely improving the capabilities of their models on well-specified tasks at around twice the rate" it managed from March 2024 to October 2025. On the uncertainty around that figure, METR writes that the estimate is given with high uncertainty and it would not be surprised if the true acceleration was closer to 1.3x or 3x the historical rate. On attribution, METR writes: "We guess that a majority (perhaps ≈80%) of the current (October 2026) acceleration is due to AI." This judgment is given with substantial uncertainty, but is based on a variety of lines of evidence on contributions from AI and other causes. METR also states that the acceleration in late 2025 was likely influenced by non-AI factors, and that details of many of these factors have been redacted. Separately, METR says it is confident the acceleration is not driven by an acceleration in the scale of training compute. On the access period and method, the assessment ran from August 12 to October 29, 2026, which is about 11 weeks, and was performed by METR staff at 2.5 full-time equivalents piloting a high-access evaluation at Anthropic. Press accounts describe the inputs as Anthropic's internal benchmark data, compute metrics, uplift surveys, code and inference-spend data, and about 15 staff interviews. On redactions, METR has said "We submitted a ~100-page full report on our assessment to Anthropic. For the public version, Anthropic redacted a majority of the evidence we found most informative", and that most of the redacted information was very high-level, while adding that it was not in a position to say whether the redactions were commercially justified. On the McCandlish quote, Anthropic's co-founder acknowledged the extent of the redactions in a post on X responding to METR's findings, saying "we determined that sharing exactly what is driving the speedup isn't the right thing to do, both because it's commercially sensitive and because it risks handing out a roadmap for others to go faster". On the internal models, METR states that Anthropic's internal benchmarks are increasingly saturated: Model 4 achieves greater than 50% on all the AECI benchmarks on which it was tested, and its main chart plots AECI scores of Anthropic model snapshots by the date each was available to most Anthropic employees, from Claude 3 Opus in early 2024 to internal Model 4 in October 2026. On the S-1, reporting describes new risk-factor language in the amended Form S-1/A filed 2026-11-02: "our internal estimates and our expectations regarding future models, rather than our current models, indicate that we may imminently meet our Responsible Scaling Policy's definition" of "dramatically accelerated progress attributable to AI", and that this sentence is not in the first S-1, filed October 26. The filing also states, per reporting, "We have not designated any of our current models as exceeding this threshold." On the Greenblatt quote, he wrote: "This report on AI R&D automation (RSI) is a big update towards ASI within 1-2 years. It says AI progress is sped up by RSI right now by around 2x. In AI 2027, this happens around March 2027." He added "I was seriously wrong about RSI speed up; I previously expected much less in 2026 (around 1.15x-1.3x)". The post describes him as "METR's own," which checks out: he announced "I'm joining METR to work on more investigations like our Hugging Face report" and is now listed as a Member of Technical Staff at METR, previously Chief Scientist at Redwood Research.

Complete reasoning
The primary METR report was located and read, and every load-bearing element of the claim matches it: the 11-week window, the internal data and interview basis, the roughly 2x figure, the 1.3x to 3x range, the roughly 80% AI attribution, and the redaction caveat. The gap is one of scope and certainty rather than fact: METR's claim is about model capabilities on well-specified tasks as measured by Anthropic's own benchmark index, and its 80% attribution is explicitly labelled a guess, while the post states both more flatly. I considered and rejected "Accurate" because the dropped scope qualifier and the hardening of a stated guess into a conclusion are real simplifications, and I rejected "Partially accurate but misleading" because no source I retrieved contradicts or bounds away the claim's operative proposition, and the post itself carries the uncertainty range and the redaction caveat that a distorting version would have cut. As of 2026-11-07 the report is two days old and no contrary assessment has appeared, though METR's own robustness analysis shows the headline number is sensitive to modelling choices.
Use this case

The reply is formatted for pasting into the thread where the claim is circulating.

Similar cases on record

Mostly accurate: METR published a report, based on roughly 11 weeks of access to Anthropic internal data an… | TrueSeeker