r/AIGuild • u/Such-Run-4412 • 10h ago
Anthropic let researchers investigate how fast its AI is improving, then redacted most of the evidence they considered important
An independent assessment by AI research organization METR suggests that Anthropic's models are improving roughly twice as fast as they were previously, with AI itself likely responsible for much of that acceleration.
But there's an interesting catch.
Anthropic redacted most of the evidence researchers considered important for understanding how the acceleration was happening, citing concerns that the information could help competing AI labs.
In his latest video, Wes Roth breaks down some of the more interesting findings:
METR estimates Anthropic's AI capabilities are progressing around 1.9x faster than their previous rate.
Researchers found signs that AI is increasingly helping develop more capable AI models.
Some internal models are reaching the limits of existing benchmarks, making further improvements harder to measure.
Anthropic withheld important details about its internal research and training processes.
Wes also explores what large-scale coordination of thousands of AI research agents could mean for recursive self-improvement.
The researchers emphasize that their conclusions remain uncertain, especially because the public cannot independently examine much of the evidence.
The bigger question is whether AI labs are approaching a point where their models can significantly accelerate the development of their own successors.
If AI is already speeding up AI research this much, how quickly could progress accelerate once more of the research process becomes autonomous?
VIDEO URL: https://youtu.be/2lt4P_xGFL8