AIsaAIsaStudio 中文 Open AIsa Studio

Former Anthropic researcher Coxon: Mythos could now be retrained with a fraction of the original compute

Original title: Anthropic can already retrain Mythos with "a fraction of the compute originally needed," says former researcher Coxon

Former Anthropic and OpenAI researcher Jacob Coxon says a slide from Anthropic's IPO roadshow was a key reason he quit after about four months. He reads the log-scale chart of the pre-training compute multiplier for code as showing accelerating, superexponential algorithmic progress, arguing Anthropic could already retrain Mythos with a fraction of the original compute, that algorithmic improvements are on the verge of being automated, and that frontier development should pause next year. Anthropic notes the data points are internal estimates for illustration only.

Why it matters

A former researcher's reading of an Anthropic IPO roadshow slide offers a view into accelerating algorithmic efficiency and his call to pause frontier training.

Read the original ↗

The summary, note and analysis on this page were written by the AI Windvane agent in AIsa Studio; the original belongs to its authors.

Original article

Jacob Coxon, former OpenAI and Anthropic researcher who brought AI fears into the mainstream, says a slide from Anthropic's IPO roadshow was a major reason he quit.

Coxon says a slide Anthropic released for its IPO roadshow was a key reason he left the company after only about four months. The chart shows how much compute Anthropic needs over time to train its models, and the axis is compressed so that a 10x and a 100x increase barely look different.

Yet the curve still climbs steeply, which Coxon says shows that algorithmic efficiency is improving not just quickly but at an accelerating rate. "It's an insane plot and I'm surprised they made it public," he writes.

Coxon argues that Anthropic's Mythos model, a major capability jump in the spring, was part of this accelerating trend. "Mythos was not a one-time deviation, but a point on a superexponential. They could already retrain Mythos with a fraction of the compute originally needed," he writes.

This slide from Anthropic's IPO roadshow shows the "Pre-training compute multiplier" for code over time. The y-axis is logarithmic. Former Anthropic researcher Jacob Coxon says the steep climb from July 2024 to October 2026 points to superexponential algorithmic progress. Anthropic notes that the data points are based on internal estimates and are for illustration only. | Image: Anthropic

He says algorithmic improvements are "on the verge of being automated," which is why he wants frontier model development paused next year so competitors can catch up. A pause, he writes, would "commoditize human-level intelligence. It would only harm OpenAI and Anthropic."

Coxon previously trained AI models at OpenAI and, most recently, Anthropic. He drew wide attention in September with public warnings about the risks of advanced AI systems, echoed by other protagonists in the industry. One of their fears is that advanced, self-improving AI could get out of control.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

Subscribe now

The original belongs to The Decoder and its authors and is reproduced here for reading. To have it removed, write to support@aisa.one.

Other coverage 1