AI 2027 Tracker Update Puts Some Anthropic Internal Models Ahead of the Forecast, Commentators Say
The AI 2027 tracker was updated today. And according to the tracker’s estimates, based on AECI scores from METR’s report on Anthropic’s internal models, some of those models are even ahead of the AI 2027 curve.
Context
It is a widely shared reading that AI progress is running ahead of one well known forecast, but it is an interpretation of benchmark estimates, not a new capability.
The AI 2027 tracker compares real progress with the AI 2027 forecast. kimmonismus says its latest update, based on scores from METR's report on Anthropic's internal models, puts some of those models ahead of the forecast's curve. Andrew Curran says progress went from five weeks behind the curve to six weeks ahead. These are commentators' readings of the tracker, not confirmed findings.