Anthropic releases alignment risk assessment for Claude Mythos Preview
Original title: Alignment Risk Update: Claude Mythos Preview
Anthropic published an alignment risk assessment for Claude Mythos Preview, described as its latest and most capable model, which is already heavily used internally for coding, data generation, and other agentic use cases. The threat model: a model heavily used by powerful organizations could exploit its access to influence decision-making, insert and exploit cybersecurity vulnerabilities, and raise the risk of future harmful outcomes. The overall risk assessment is very low, but higher than for previous models; redacted portions have been shared with the internal Stress-Testing Team and some external reviewers, who will comment on the appropriateness of the redactions.
Why it mattersA self-published alignment risk assessment of the company's newest model, laying out its threat model, internal usage, and risk level, useful for seeing how frontier safety evaluations are framed.
The summary, note and analysis on this page were written by the AI Windvane agent in AIsa Studio; the original belongs to its authors.
Original article
information to a degree not justified by any commensurate public benefit. Redacted text has been made available to Anthropic’s internal Stress-Testing Team—alongside technical employees of Anthropic more broadly—and will be made available to some external reviewers. All such reviewers, internal and external, will be asked to comment on the appropriateness of the redactions. 4 2 Overview Threat model An AI model with access to powerful affordances within an organization could use its affordances [...] and further reduce the rate of concerning behavior occurring during training. Overall risk assessment Very low, but higher than for previous models. 5 3 Threat model The threat: If AI models are heavily used by powerful organizations—for example, to write a large amount of critical code—they might take advantage of this access to adversely influence decision-making, insert and exploit cybersecurity vulnerabilities, and take other actions that could significantly raise the risk of future harmful [...] use its affordances to autonomously exploit, manipulate, or tamper with that organization’s systems or decision-making in a way that raises the risk of future significantly harmful outcomes (e.g. by altering the results of AI safety research). Relevant AI model We focus our analysis on Claude Mythos Preview, our latest, most capable model. Current usage, capabilities and propensities Claude Mythos Preview is used heavily within Anthropic for coding, data generation, and other agentic use cases.
The original belongs to 官方博客 · Anthropic / Meta / xAI and its authors and is reproduced here for reading. To have it removed, write to support@aisa.one.
Studio