AIsaAIsaStudio English 打开 AIsa Studio

OpenAI 发布 GPT-6.2 Astra 和 Sol,API 降价但第三方评测有涨有跌

原标题:OpenAI launches GPT-6.2 Astra and Sol with lower API prices and some benchmark gains

OpenAI 发布两款新模型 GPT-6.2 Astra 和 GPT-6.2 Sol,分别面向高要求专业工作与日常使用,已在 ChatGPT Work 和 Codex 向 Plus、Pro、Enterprise、Edu 用户开放,并可通过 API 调用。Astra 的 API 定价比前代便宜 20%,为每百万输入 token 8 美元、缓存输入 0.40 美元、输出 40 美元;Sol 沿用 GPT-6.1 Sol 定价。OpenAI 称 Astra 在 Agents' Last Exam、Terminal-Bench-Science 等基准领先,在 FrontierMath Erdős 上解出 68 题中的 7 题(此前纪录为 3 题),并成为首个达到 OpenAI「AI 自我改进」High 阈值的对外发布模型。第三方评测呈现另一面:Artificial Analysis 智能指数中 …

为什么值得看

文章汇总 OpenAI 官方数据与 Artificial Analysis、Epoch AI、Vals AI 三方评测,价格下降之外也呈现编码停滞、幻觉率和法律短板等反差面。

阅读原文 ↗11月18日 AI 日报

本页的摘要、推荐理由与解读出自 AIsa Studio 的 AI 风向智能体,原文版权归原作者所有。

深度解读

发生了什么

OpenAI 发布两款新语言模型:GPT-6.2 Astra 面向法律、金融、会计等领域的专业工作,GPT-6.2 Sol 则面向日常任务。两款模型已在 ChatGPT Work 和 Codex 中向 Plus、Pro、Enterprise 和 Edu 用户开放,并可通过 OpenAI API 调用。Pro-500 订阅者可对两款模型使用 Ultrafast 模式,Pro-200 订阅者首次获得 Ultrafast 权限(先从 Sol 开始)。

Astra 的 API 定价比前代低 20%,为每百万输入 token 8 美元、缓存输入 0.40 美元、输出 40 美元;Sol 维持前代价格,输入 2 美元、缓存 0.10 美元、输出 10 美元。

关键细节

  • OpenAI 称 Astra 在 Agents' Last Exam 上比 GPT-6 Astra 高 5.2 分、成本不到前代三分之一;在法律基准 Harvey LAB-AA 上以约六分之一成本取得超过 Claude Fable 5.2 两倍的通过率;AA-3D 设计基准以 1,318 Elo 居首。
  • 第三方评测结果好坏参半:Artificial Analysis 综合指数中 Astra 以 62 分排第二,仅次于 Claude Fable 5.2(65 分);Epoch AI 给出 174 分的 ECI,与 Fable 5.2 持平。Vals AI 榜单上 Astra 第 7、Sol 第 9,Sol 每任务 3.18 美元,是前十中最便宜的。
  • 但编码「持平不前」:Sol 在 FrontierCode 2.0 上落后 Astra 仅 0.5 分、成本为其五分之一,但 Artificial Analysis 指出 Sol 在编码智能体指数中比前代「下降三分」,主要因 SWE-Atlas-QnA-AA 上「遗漏关键事实」的频率上升。
  • 幻觉率高:最大推理档位下 Astra 幻觉率 59%、Sol 55%(AA-Omniscience 指标,题目极难,不代表日常水平)。
  • 法律是短板:HLAB 上 Astra、Sol 分别仅列第 11 和第 21;Legal Research 上更是第 30 和第 52。两者工具调用次数几乎翻倍,但答案更短。9 月发布的专用产品「Astra for Law」在 Legal Research Bench 上可达第 6 名。
  • 安全方面:两款模型在 OpenAI 准备框架中达到网络安全「Critical」阈值;关闭防护的内部 ExploitBench 测试中 Astra 成功将已知浏览器漏洞转化为可用漏洞的比例超过 50%。OpenAI 正为高风险网络安全请求加严防护,并计划通过 OpenAI Daybreak 向经审核的安全研究者提供访问。
  • 更值得注意的是,GPT-6.2 Astra 是首个达到 OpenAI「High」级别 AI 自我改进阈值的对外发布模型。OpenAI 称其能「相当于给每位 OpenAI 研究员增加一名高水平研究工程师」地加速 AI 研究,并明确将其列为风险,对策包括收紧研究环境管控和监控系统 Control Room。
  • Epoch AI 还观察到 Astra 能在单个输出 token 内完成复杂推理,串行步数达 12.3 步(前代为 10.5)。Epoch AI 指出这类不展示思考过程的模型更难监控。在 FrontierMath Erdős 上 Astra 解出 68 题中的 7 题,远超此前 GPT-6.1 Sol 的 3 题纪录,其中一题此前无已知解法。

为什么重要

这次发布的核心叙事是性价比而非全面领先。Artificial Analysis 认为 OpenAI 在成本-性能帕累托前沿上占主导,但编码能力停滞、幻觉率偏高说明新模型并非全方位进步。真实任务表现也存疑:Epoch AI 用自家研究任务实测发现,Astra 在较简单的项目上会偏离核心问题、在数据中心研究任务上过于保守跳过关键估算,「换作任何承包商都不可能蒙混过关」。

自改进阈值首次在对外模型上被触发,是安全层面最重的信号。OpenAI 自己承认,能加速构建未来 AI 系统的模型,可能让领域进展快于安全措施和人类监督所能跟上的速度。无可见思维链的高步数推理也延续了前代就存在的可监控性担忧。

对谁有影响

  • 依赖模型做专业工作(科学、3D/设计、机器人)的团队:Astra 在这些领域表现最强且成本大幅下降。
  • 编码与法律场景的用户:编码无实质提升、Sol 编码评分下滑,法律任务排名靠后,可能需要考虑专用产品或竞品。
  • 安全研究者与 AI 安全从业者:Critical 级网络安全能力、Daybreak 计划、自改进 High 阈值和隐藏推理链都是需要关注的新变量。
全文翻译

以下翻译只覆盖原文的前一部分,其余内容请看下方原文。

OpenAI 发布两款新语言模型。GPT-6.2 Astra 面向高要求的专业工作,而 GPT-6.2 Sol 则专为日常使用打造。OpenAI 表示,这两款模型在基准测试中均优于前代产品,且运行成本更低。

GPT-6.2 Astra 和 Sol 现已在 ChatGPT Work 和 Codex 中向 Plus、Pro、Enterprise 和 Edu 用户开放。Pro-500 订阅者可以使用这两款模型的 Ultrafast(超快)模式。Pro-200 订阅者首次获得 Ultrafast 访问权限,从 GPT-6.2 Sol 开始。

开发者可以通过 OpenAI API 访问这两款模型。OpenAI 表示,GPT-6.2 Astra 的 API 定价比其前代产品便宜 20%,输入令牌为每百万 8 美元,缓存输入为 0.40 美元,输出令牌为每百万 40 美元。GPT-6.2 Sol 保持 GPT-6.1 Sol 的定价不变,即输入每百万令牌 2 美元,缓存输入 0.10 美元,输出 10 美元。

OpenAI 称 Astra 是“科学家的世界最佳模型”,并展示精美的幻灯片

OpenAI 训练 GPT-6.2 Astra 以更可靠地处理法律、金融和会计等领域的专业惯例。该公司表示,演示文稿会从模板中提取布局、颜色和排版,并匹配确切的字体大小。幻灯片标题旨在捕捉幻灯片的主要观点,而正文则专注于关键细节。

OpenAI 的公告重点强调其模型的性能价格比。在 Agents' Last Exam(一项测试多步专业工作流程的基准测试)上,根据 OpenAI 的说法,GPT-6.2 Astra 得分比其前代产品 GPT-6 Astra 高出 5.2 分,而成本不到三分之一。它以仅 5% 的成本领先 Anthropic 的 Claude Fable 5.2 达 5.5 分。只有 Google 的 Gemini 4 Carbon 在这项基准测试中与 Astra 持平。

GPT-6.2 Astra 以较低的单任务成本在 Agents' Last Exam v1.1 中获得最高分。Claude Fable 5.2 达到类似的分数,但单任务成本高数倍。| 图片来源:OpenAI

在涵盖合同条款分析等任务的法律基准 Harvey LAB-AA 上,根据 OpenAI 的说法,GPT-6.2 Astra 的通过率几乎是 Claude Fable 5.2 的两倍,而成本约为其六分之一。在包含咨询、金融和设计任务的内部 GDPval-v2 基准测试中,OpenAI 表示 Astra 比其前代产品提高了 6.2 个百分点,同时输出令牌减少了 22%。

OpenAI 表示,计算机使用能力——此前已是前代产品的强项——再次得到提升。据报告,在测试中,该模型构建了一个 3D 汽车模型,用 Python 编写了物理求解器,并在 Blender 中对结果进行了动画处理。在另一个演示中,它逐步构建了遥控汽车的部件,并生成了动画组装指南。

OpenAI 还声称在网络设计方面取得了进展。在 3D 基准 AA-3D 上,人类评委比较两个盲测的交互体验。GPT-6.2 Astra 以 1,318 Elo 点排名第一,领先于 Claude Fable 5.2 的 1,271 分和 GPT-6.2 Sol 的 1,259 分。

在 Terminal-Bench-Science(一项在终端中测试科学工作流的基准测试)上,根据 OpenAI 的说法,该模型得分比 GPT-6 Astra 高出 9 个百分点,成本同样不到三分之一。OpenAI 表示,Astra 还在 Vals Science Index 上创下新高,该指数衡量模型解释生物数据和运行实验的能力。

Sol 以极低成本几乎追平原版 Astra

OpenAI 表示,GPT-6.2 Sol 是为希望拥有快速、多功能模型用于日常任务的用户设计的。在 FrontierCode 2.0 编码基准测试中(该测试检查代码更改是否达到真实项目的质量门槛),Sol 的成本仅为 Astra 的五分之一,得分仅落后 0.5 分。OpenAI 表示,该模型也能很好地处理非工作类任务。

在编码基准 FrontierCode 2.0 上,GPT-6.2 Sol 的得分几乎与 GPT-6.2 Astra 相当,但成本仅为其中的一小部分。Claude Fable 5.2 达到最高峰值分数,但单任务成本高数倍。| 图片来源:OpenAI

根据 OpenAI 的说法,GPT-6.2 Astra 和 Sol 在网络安全方面也表现得更好。它们能更有效地发现并利用漏洞,编写更安全的代码,并提供更好的错误修复,在多项测试中具有显著更高的令牌效率。这两款模型都在 OpenAI 的 Preparedness Framework(准备框架) 中达到了网络安全的“Critical”阈值,正如之前的 GPT-6 Astra 所做的那样。

作为回应,OpenAI 正在对潜在风险的网络安全评分请求增加更严格的保障措施。OpenAI 表示,这些保障措施应使滥用变得更加困难,但也限制了合法的漏洞研究和安全测试。

在内部 ExploitBench 测试中,模型必须将已知的浏览器漏洞转化为可行的利用工具。GPT-6.2 Astra 实现了 50% 的成功率,远远超过其前代产品 GPT-6 Astra。结果来自关闭安全措施的测试结果。| 图片来源:OpenAI

OpenAI 计划通过 OpenAI Daybreak 提供新模型,该平台已经允许经过审核的安全研究人员访问其他限制较少的模型。发布的网络安全基准数据来自关闭安全措施和分类器的内部测试。OpenAI 在其配套安全报告中详细说明了其方法论。

Astra 在 Artificial Analysis Intelligence Index 中排名第二

在 Artificial Analysis Intelligence Index(汇总了知识工作、编码、科学和一般知识方面的九项评估)中,GPT-6.2 Astra 排名第二,仅次于 Anthropic 的 Claude Fable 5.2。根据 Artificial Analysis 的数据,Astra 比 GPT-6 Astra 高出 5 分,超过了 Google 的 Gemini 4 Carbon(60 分)和 Anthropic 的 Claude Opus 5.5(59 分)。GPT-6.2 Sol 增加了 2 分,达到 57 分,相当于 GPT-6 Astra 的水平,但单任务成本仅为约 15%。

根据 Artificial Analysis 的说法,OpenAI 在成本与性能的帕累托前沿(Pareto frontier,即没有其他模型既更便宜又更好的界线)上占据主导地位。只有 Anthropic 和 Meta 的模型也位于这条前沿线上。OpenAI 也在效率方面占据了大部分顶级位置,这是通过每个任务的输出令牌来衡量的。Claude Fable 5.2 是唯一出现在那里的外部模型。

GPT-6.2 Astra 以 62 分的成绩在 Intelligence Index 中排名第二,仅次于 Claude Fable 5.2 (65)。OpenAI 模型在成本效益的帕累托边界上占据主导地位。 | 图片:Artificial Analysis

GPT-6.2 Astra 获得 62 分,在 Intelligence Index 中排名第二,仅次于 Claude Fable 5.2 (65)。OpenAI 模型在成本绩效的帕累托前沿上占据主导地位。| 图片来源:Artificial Analysis

Artificial Analysis 证实了 OpenAI 在科学和事实知识方面的说法。GPT-6.2 Astra 在 Terminal-Bench-Science 0.1 上领先,并在物理推理测试 CritPt v2、事实知识基准 AA-Omniscience 和知识基准 HLE-Diamond 上排名第二,仅次于 Claude Fable 5.2。Astra 还在 3D 设计 (AA-3D) 和机器人技术 (AA-Robotics v0.1) 方面领先,在机器人技术上得分为 79 分,高于 Sol 的 78 分和 Claude Fable 5.2 的 75 分。

然而,编码方面情况不同。根据 Artificial Analysis 的说法,这两款模型在此方面停滞不前。在 Codex harness 最大计算量下测量的 Coding Agent Index 中,GPT-6.2 Astra 保持在 GPT-6 Astra 的位置。GPT-6.2 Sol 实际上比 GPT-6.1 Sol 下降了 3 分。这一下降源于 SWE-Atlas-QnA-AA 上的 14 分下滑,在该测试中,模型比其前代产品更频繁地在答案中遗漏关键事实。

Artificial Analysis 还指出高幻觉率。在最大努力下,GPT-6.2 Astra 有 59% 的时间会产生幻觉,Sol 为 55%。该指标是 AA-Omniscience Hallucination Rate,衡量模型在事实问题上猜测而非承认不知道的频率。这些问题非常困难,因此这些数字并不反映日常幻觉率。

Epoch AI 发现 Astra 与 Fable 5.2 持平,但在现实任务中较弱

研究机构 Epoch AI 在发布前对其基准测试了 GPT-6.2 Astra。该模型在 Epoch Capabilities Index (ECI) 中得分为 174 分,与 Anthropic 的 Fable 5.2 持平。根据 Epoch AI 的说法,这两款模型都优于 Astra 出现之前推理模型的先前趋势所预测的结果。

在来自 Epoch AI 自身研究的现实任务中,Astra 落后于 Fable 5.2,仅比 GPT-6 Astra 略有改善。根据 Epoch AI 的说法,该模型在较简单的研究项目中错过了核心问题,并试图修复事物却徒劳无功。在一个关于研究 AI 数据中心的任务中,Astra 过于保守,跳过了关键估算,Epoch AI 表示没有任何承包商可以逃脱这种指责。Epoch AI 认为 Astra 的写作能力相对于其他测试模型来说相对较强,但仍低于其自身的标准。

GPT-6.2 Astra 在 Epoch Capabilities Index 中得分为 174 分,与 Anthropic 的 Fable 5.2 持平。两者均位于推理模型先前趋势线的上方。Astra 的成本显著降低。| 图片来源:Epoch AI

值得注意的是,Astra 能够在单个输出令牌内运行复杂的推理,而没有可见的思维链。Epoch AI 记录 Astra 有 12.3 个串行步骤,高于 GPT-6 Astra 的 10.5 步和当时最强的非 OpenAI 模型 Claude Fable 5.1 的 4.2 步。能够以这种方式推理而不展示其工作的模型更难监控,这是一个安全问题,已在第一代 Astra 模型中出现。

在 FrontierMath Erdős(一项未解决的数学问题基准测试)上,GPT-6.2 Astra 解决了 68 个任务中的 7 个,每个任务都在证明助手 Lean 中正式验证。旧纪录是 GPT-6.1 Sol 创造的 3/68。这七个任务中有一个在此之前没有已知的解决方案。

Vals AI 将 Astra 和 Sol 排在前十,但发现法律方面的弱点

GPT-6.2 Astra 排名第 7,GPT-6.2 Sol 排名第 9,两者在 Vals Index 中仅相差 1.6 分。不过价格差距很大。Sol 每任务成本为 3.18 美元,不到 Astra 10.68 美元的三分之一,使其成为前十名中最便宜的模型,根据 Vals AI 的说法。Astra 也比其前代产品更便宜,得分比 GPT-6 Astra 高出 2.6 分,成本约为其每任务 21.28 美元的一半。Vals AI 表示,Astra 在前十名中使用最少的输出令牌,平均每任务 91,000 个。

GPT-6.2 Astra 和 Sol 在 Vals Index 中分别排名第 7 和第 9。Sol 每任务成本为 3.18 美元,不到 Astra 10.68 美元的三分之一,是前十名中最便宜的模型。Claude Fable 5.2 位居榜首。| 图片来源:Vals AI

Vals AI 支持 OpenAI 在 Vals Science Index 上排名第一的说法。Astra 在该排名中领先,并以大约一半的成本和一半的运行时间在 Terminal-Bench Science 和 VCB 1–100 上获得第一名。Sol 在 Terminal-Bench Science 上排名第三,成本约为 Astra 的四分之一。在更广泛的 agentic 编码基准 Terminal-Bench 4 中,Astra 排名第 5,Sol 排名第 7。

根据 Vals AI 的说法,法律测试是这些模型的短板。在 HLAB 基准测试中,Astra 和 Sol 将其前代产品的分数翻倍,但仅排名第 11 和第 21。在法律

查看原文

OpenAI releases two new language models. GPT-6.2 Astra is aimed at demanding professional work, while GPT-6.2 Sol is built for everyday use. OpenAI says both outperform their predecessors on benchmarks and cost less to run.

GPT-6.2 Astra and Sol are available now for Plus, Pro, Enterprise, and Edu users in ChatGPT Work and Codex. Pro-500 subscribers can use Ultrafast mode with both models. For the first time, Pro-200 subscribers also get Ultrafast access, starting with GPT-6.2 Sol.

Developers can access both models through the OpenAI API. OpenAI says API pricing for GPT-6.2 Astra is 20 percent cheaper than its predecessor's, at $8 per million input tokens, $0.40 for cached inputs, and $40 per million output tokens. GPT-6.2 Sol keeps GPT-6.1 Sol's pricing at $2 for input, $0.10 for cached inputs, and $10 for output per million tokens.

OpenAI calls Astra "the world's best model for scientists" and touts polished slides

OpenAI trained GPT-6.2 Astra to handle professional conventions in fields like law, finance, and accounting more reliably. The company says presentations pull layouts, colors, and typography from templates, matching exact font sizes. Slide titles are meant to capture a slide's main point, while body text stays focused on key details.

OpenAI's announcement leans hard on the price-to-performance ratio of its models. On Agents' Last Exam, a benchmark that tests multi-step professional workflows, GPT-6.2 Astra scores 5.2 points above its predecessor GPT-6 Astra at less than a third of the cost, according to OpenAI. It leads Anthropic's Claude Fable 5.2 by 5.5 points at just 5 percent of the cost. Only Google's Gemini 4 Carbon keeps up with Astra on this benchmark.

GPT-6.2 Astra achieves the highest scores on Agents' Last Exam v1.1 at low cost per task. Claude Fable 5.2 reaches a similar score but costs several times more per task. | Image: OpenAI

On the legal benchmark Harvey LAB-AA, which covers tasks like contract clause analysis, GPT-6.2 Astra more than doubles Claude Fable 5.2's pass rate at about one-sixth of the cost, according to OpenAI. On the internal GDPval-v2 benchmark, which includes consulting, finance, and design tasks, OpenAI says Astra gains 6.2 percentage points over its predecessor while using 22 percent fewer output tokens.

OpenAI says computer use, already a strong suit of the predecessor, got better again. In testing, the model reportedly built a 3D car model, wrote a physics solver in Python, and animated the results in Blender. In another demo, it modeled a remote-controlled car part by part and produced an animated assembly guide.

OpenAI also claims progress in web design. On the 3D benchmark AA-3D, human judges compare two blinded interactive experiences. GPT-6.2 Astra takes first with 1,318 Elo points, ahead of Claude Fable 5.2 at 1,271 and GPT-6.2 Sol at 1,259.

On Terminal-Bench-Science, a benchmark that tests scientific workflows in a terminal, the model scores 9 percentage points above GPT-6 Astra, again at less than a third of the cost, according to OpenAI. Astra also sets a new high on the Vals Science Index, which measures how well models interpret biological data and run experiments, OpenAI says.

Sol nearly matches the original Astra at a fraction of the cost

GPT-6.2 Sol is for users who want a fast, versatile model for everyday tasks, OpenAI says. On the coding benchmark FrontierCode 2.0, which checks whether code changes meet the quality bar of real projects, Sol trails Astra by just 0.5 points at one-fifth the cost. OpenAI says the model also handles non-work tasks well.

On the coding benchmark FrontierCode 2.0, GPT-6.2 Sol scores nearly as high as GPT-6.2 Astra but at a fraction of the cost. Claude Fable 5.2 hits the highest peak score but costs several times more per task. | Image: OpenAI

GPT-6.2 Astra and Sol have also gotten better at cybersecurity, according to OpenAI. They find and exploit vulnerabilities more effectively, write more secure code, and deliver better bug fixes, with notably higher token efficiency in several tests. Both models hit the "Critical" threshold for cybersecurity in OpenAI's Preparedness Framework, just as GPT-6 Astra did before them.

OpenAI is adding stricter safeguards for potentially risky cybersecurity requests in response. These safeguards should make abuse harder but will also limit legitimate vulnerability research and security testing, OpenAI says.

On the internal ExploitBench test, models must turn known browser vulnerabilities into working exploits. GPT-6.2 Astra clears a 50 percent success rate, far outpacing its predecessor GPT-6 Astra. Results come from tests with safeguards turned off. | Image: OpenAI

OpenAI plans to offer the new models through OpenAI Daybreak, which already gives vetted security researchers access to other models with fewer guardrails. The published cybersecurity benchmark numbers come from internal tests with safeguards and classifiers turned off. OpenAI lays out its methodology in the accompanying safety report.

Astra takes second in the Artificial Analysis Intelligence Index

In the Artificial Analysis Intelligence Index, which rolls up nine evaluations across knowledge work, coding, science, and general knowledge, GPT-6.2 Astra finishes second, just behind Anthropic's Claude Fable 5.2. Astra jumps five points over GPT-6 Astra, according to Artificial Analysis, passing Google's Gemini 4 Carbon (60 points) and Anthropic's Claude Opus 5.5 (59 points). GPT-6.2 Sol picks up two points to reach 57, matching GPT-6 Astra's level at only about 15 percent of the cost per task.

OpenAI owns the Pareto frontier on cost versus performance, the line where no other model is both cheaper and better, according to Artificial Analysis. Only Anthropic and Meta models also land on that frontier. OpenAI holds most of the top spots on efficiency too, measured by output tokens per task. Claude Fable 5.2 is the only outside model that shows up there.

GPT-6.2 Astra erreicht mit 62 Punkten Platz 2 im Intelligence Index, knapp hinter Claude Fable 5.2 (65). OpenAI-Modelle dominieren die Pareto-Grenze beim Kosten-Leistungs-Verhältnis. | Bild: Artificial Analysis

GPT-6.2 Astra reaches 62 points, taking second place in the Intelligence Index just behind Claude Fable 5.2 (65). OpenAI models dominate the Pareto frontier on cost-performance. | Image: Artificial Analysis

Artificial Analysis backs up OpenAI's claims in science and factual knowledge. GPT-6.2 Astra leads on Terminal-Bench-Science 0.1 and places second behind Claude Fable 5.2 on the physics reasoning test CritPt v2, the factual knowledge benchmark AA-Omniscience, and the knowledge benchmark HLE-Diamond. Astra also leads in 3D design (AA-3D) and robotics (AA-Robotics v0.1), scoring 79 on robotics against Sol's 78 and Claude Fable 5.2's 75.

Coding is a different story, though. According to Artificial Analysis, both models have flatlined there. In the Coding Agent Index, measured with the Codex harness at max compute, GPT-6.2 Astra stays right where GPT-6 Astra was. GPT-6.2 Sol actually drops three points from GPT-6.1 Sol. That decline comes from a 14-point slide on SWE-Atlas-QnA-AA, where the model omits key facts from its answers more often than its predecessor did.

Artificial Analysis also flags a high hallucination rate. At maximum effort, GPT-6.2 Astra hallucinates 59 percent of the time, Sol 55 percent. The metric is AA-Omniscience Hallucination Rate, which measures how frequently a model guesses on factual questions instead of saying it doesn't know. These are unusually hard questions, so the numbers don't reflect everyday hallucination rates.

Epoch AI finds Astra on par with Fable 5.2 but weaker on real-world tasks

Research organization Epoch AI tested GPT-6.2 Astra on its own benchmarks before launch. The model scores 174 points in the Epoch Capabilities Index (ECI), tying Anthropic's Fable 5.2. Both models beat what the previous trend for reasoning models would have predicted before Astra, according to Epoch AI.

On real-world tasks pulled from Epoch AI's own research, Astra fell behind Fable 5.2 and barely improved over GPT-6 Astra. According to Epoch AI, the model missed the central question on simpler research projects and spun its wheels trying to fix things. On a task about researching AI data centers, Astra played it too safe and skipped key estimates, something Epoch AI says no contractor could get away with. Epoch AI rated Astra's writing as relatively strong compared to other tested models but still below its own bar.

GPT-6.2 Astra scores 174 points in the Epoch Capabilities Index, tying Anthropic's Fable 5.2. Both sit above the previous trend line for reasoning models. Astra is significantly cheaper. | Image: Epoch AI

One thing that stands out is Astra's ability to run complex reasoning within a single output token, with no visible chain of thought. Epoch AI clocks 12.3 serial steps for Astra, up from 10.5 for GPT-6 Astra and 4.2 for Claude Fable 5.1, the strongest non-OpenAI model at the time. Models that can reason this way without showing their work are harder to monitor, a safety concern that already came up with the first Astra model.

On FrontierMath Erdős, a benchmark of unsolved math problems, GPT-6.2 Astra cracked 7 of 68 tasks, each formally verified in the proof assistant Lean. The old record was 3 of 68, set by GPT-6.1 Sol. One of the seven had no known solution before.

Vals AI puts Astra and Sol in the top 10 but finds legal weak spots

GPT-6.2 Astra ranks 7th and GPT-6.2 Sol 9th in the Vals Index, separated by just 1.6 points. The price gap is wide, though. Sol runs $3.18 per task, less than a third of Astra's $10.68, making it the cheapest model in the top 10, according to Vals AI. Astra also got cheaper than its predecessor, scoring 2.6 points above GPT-6 Astra at roughly half of its $21.28 per-task cost. Vals AI says Astra uses the fewest output tokens in the top 10, averaging 91,000 per task.

GPT-6.2 Astra and Sol rank 7th and 9th in the Vals Index. Sol runs $3.18 per task, less than a third of Astra's $10.68, and is the cheapest model in the top 10. Claude Fable 5.2 tops the ranking. | Image: Vals AI

Vals AI backs OpenAI's claim to the top spot on the Vals Science Index. Astra leads that ranking and takes first on Terminal-Bench Science and VCB 1–100 at about half the cost and half the runtime of GPT-6 Astra. Sol comes in third on Terminal-Bench Science at roughly a quarter of Astra's cost. On the broader Terminal-Bench 4 for agentic coding, Astra places 5th and Sol 7th.

Legal tests are where the models fall short, according to Vals AI. On the HLAB benchmark, Astra and Sol double their predecessors' scores but rank only 11th and 21st. On the Legal Research benchmark, the drop is even steeper, with Astra at 30th and Sol at 52nd. Vals AI says the models make nearly twice as many tool calls as their predecessors but write shorter answers.

In September, OpenAI announced a specialized product called "Astra for Law." It does significantly better than the base model on the Legal Research Bench, reaching 6th place. Vals AI tested both models with a one-million-token context window and 128,000 max output tokens at full reasoning effort.

GPT-6.2 Astra is the first released model to hit OpenAI's "High" threshold for AI self-improvement

According to OpenAI, GPT-6.2 Astra is the first externally released model to reach the "High" threshold for AI self-improvement. OpenAI says the model can meaningfully speed up AI research, on par with giving every OpenAI researcher an extra, highly skilled research engineer.

OpenAI calls this out explicitly as a risk. Models that can help build future AI systems could push the field forward faster than safety measures and human oversight can keep up. The industry is currently wrestling with this under the label "RSI".

As countermeasures, OpenAI points to tighter controls in research environments and its monitoring system Control Room, which can track research tasks and shut them down if needed. The company also says it has expanded monitoring that examines how models reason and act and automatically flags unauthorized behavior.

On alignment, meaning how well the model follows user instructions and communicates openly, the new models match their predecessors, according to OpenAI. In two tests, however, they more often failed to flag obstacles blocking their work, like a missing file or an unavailable search tool.

原文版权归 The Decoder 及原作者所有,本站转载仅供阅读。如需删除,请联系 support@aisa.one。

事件综述

OpenAI 发布 GPT-6.2 Astra 与 Sol 两款模型

2026 年 11 月 17 日,OpenAI 官方宣布发布 GPT-6.2 Astra 和 GPT-6.2 Sol 两款新模型,主打更专业的输出、编码、计算机使用能力及更低成本。两款模型面向 Plus、Pro、Enterprise 和 Edu 用户,在 ChatGPT Work、Codex 和 API(gpt-6.2-astra、gpt-6.2-sol)中可用。定价方面:Astra API 定价比前代便宜 20%,为每百万输入 token 8 美元、缓存输入 0.40 美元、输出 40 美元;Sol 沿用 GPT-6.1 Sol 定价($2/$10)。OpenAI 称 Astra 在 Agents' Last Exam、Terminal-Bench-Science 等基准领先,在 FrontierMath Erdős 上解出 68 题中的 7 题(此前纪录为 3 题),并称其为首个达到「AI 自我改进」High 阈值的对外发布模型;OpenAI 按 Preparedness Framework 将两款模型评为 C 级。第三方评测则好坏不一:Artificial Analysis 独立指数上 Sol 得 57 分,低于 Claude Opus 5.5 的 59 分但运行成本约为其十分之一;Simon Willison 的测试显示两模型在变形任务上均不及 Claude Fable 5.2 和 Gemini 4 Carbon;有用户自建的 LLM sophistry 基准上,两款模型表现差于同等智能水平模型甚至 GPT-6.1 Sol。11 月 18 日有 Reddit 用户转述 ARC Prize 官方账号消息,称 Astra 是首个在 ARC-AGI-3 满分的模型,Sol 约 98%。同日根据 OpenAI 帮助页的报道,本次推送仅限 Work 和 Codex,普通 Chat 不加入该模型,仍停留在 GPT-6;Plus 上 Astra 用量估算为每 5 小时窗口 5 到 45 条消息,12 月起 ChatGPT 与 Codex 将共享按 token 计量的用量。11 月 19 日,OpenAI 宣布 GPT-6.2 在 Responses API 中可基于早期推理继续构建以减少 token 消耗,但编辑早期消息会导致 API 丢弃之后的推理内容。用户反响两极,包括对订阅用量未重置的不满和 Matt Shumer 称模型 "essentially unusable" 等争议。

其他来源的报道 10