Results reported on Claude Mythos 5 throughout this section describe the model’s core
behavior without deployment-time safeguards. To reflect the different ways users
encounter Claude, we also report results for Claude Fable 5 with its classifiers and model
switching mechanism active, and with a near-final version of the claude.ai system prompt
that will be in place at launch. We focus our qualitative discussion on Mythos 5 as the more [...] runs. Surge evaluated the model on the full 100 prompts.
On GDP.pdf, Claude Fable 5 achieved a strict pass rate of 29.8%, improving over Claude
Opus 4.8, which achieved a strict pass rate of 22.5%. Claude Fable 5 is state-of-the-art over
GPT-5.5 and Gemini 3.1 Pro, which scored 24.9% and 16.7% respectively.
52 Surge AI. (2026). GDP.pdf: Can $100B AI models master the documents that run the world? [...] 287
-- 287 of 319 --
developed by FutureHouse, which evaluates AI capabilities for practical scientific research
tasks.
We evaluate the model on 181 questions from the public set and average scores over five
runs. The model is configured with adaptive thinking and max effort enabled in all runs,
both with and without Python tools. When evaluated with Python tools, the model is
provided with a container—with the image file and standard Python libraries installed—and
an image cropping tool.
原文版权归 官方博客 · Anthropic / Meta / xAI 及原作者所有,本站转载仅供阅读。如需删除,请联系 support@aisa.one。