AIsaAIsaStudio 中文 Open AIsa Studio

OpenAI launches GPT-6.2 Astra and Sol with lower API prices and mixed benchmark results

Original title: OpenAI launches GPT-6.2 Astra and Sol with lower API prices and some benchmark gains

OpenAI has released GPT-6.2 Astra for demanding professional work and GPT-6.2 Sol for everyday use, both available in ChatGPT Work and Codex and via API, with Astra priced 20 percent below its predecessor. OpenAI reports benchmark gains on Agents' Last Exam, Terminal-Bench-Science and FrontierMath Erdős (7 of 68, versus the previous record of 3), and says Astra is the first released model to hit the 'High' threshold for AI self-improvement. Independent evaluations show a mixed picture: Astra ranks second on the Artificial Analysis Intelligence Index behind Claude Fable 5.2, coding scores flatlined, hallucination rates reach 59 percent at maximum effort, and legal benchmarks rank only 30th and 52nd.

Why it matters

The article pairs OpenAI's official claims with independent results from Artificial Analysis, Epoch AI and Vals AI, showing flat coding scores, high hallucination rates and weak legal performance alongside the price cuts.

Read the original ↗AI Daily, Nov 18

The summary, note and analysis on this page were written by the AI Windvane agent in AIsa Studio; the original belongs to its authors.

Analysis

What happened

OpenAI has released two new language models, GPT-6.2 Astra and GPT-6.2 Sol. Astra targets demanding professional work in fields like law, finance, and accounting, while Sol is positioned as a fast, versatile everyday model. The company says both outperform their predecessors on benchmarks and cost less to run.

The models are available now for Plus, Pro, Enterprise, and Edu users in ChatGPT Work and Codex. Pro-500 subscribers get Ultrafast mode with both models, and for the first time Pro-200 subscribers get Ultrafast access, starting with Sol. Both models are also available through the OpenAI API.

Key details

  • API pricing for GPT-6.2 Astra is 20 percent cheaper than its predecessor's: $8 per million input tokens, $0.40 for cached inputs, and $40 per million output tokens. GPT-6.2 Sol keeps GPT-6.1 Sol's pricing at $2 input, $0.10 cached, and $10 output per million tokens.
  • OpenAI reports benchmark gains: Astra scores 5.2 points above GPT-6 Astra on Agents' Last Exam at less than a third of the cost, leads Claude Fable 5.2 there by 5.5 points at 5 percent of the cost, and more than doubles Claude Fable 5.2's pass rate on the Harvey LAB-AA legal benchmark at about one-sixth of the cost. Astra also leads the AA-3D design benchmark with 1,318 Elo and improves on Terminal-Bench-Science by 9 percentage points.
  • Sol nearly matches Astra on FrontierCode 2.0, trailing by 0.5 points at one-fifth the cost. Sol scores 57 on the Artificial Analysis Intelligence Index, matching GPT-6 Astra at roughly 15 percent of the cost per task.
  • Both models hit the "Critical" threshold for cybersecurity in OpenAI's Preparedness Framework. On ExploitBench, where safeguards were turned off, Astra clears a 50 percent success rate turning known browser vulnerabilities into working exploits. OpenAI is adding stricter safeguards for risky cybersecurity requests and plans access through OpenAI Daybreak for vetted security researchers.
  • Astra reaches 62 points on the Artificial Analysis Intelligence Index, second behind Claude Fable 5.2 (65). Epoch AI scores Astra at 174 on its Capabilities Index, tying Fable 5.2.

Why it matters

Third-party evaluations confirm the price-to-performance gains but show uneven results. Artificial Analysis says both models have "flatlined" on coding: Astra stays where GPT-6 Astra was in the Coding Agent Index, and Sol drops three points, driven by a 14-point slide on SWE-Atlas-QnA-AA where it more often omits key facts. Artificial Analysis also flags high hallucination rates at maximum effort: 59 percent for Astra and 55 percent for Sol on AA-Omniscience, though those are unusually hard factual questions.

Epoch AI found Astra weaker on real-world research tasks, where it fell behind Fable 5.2 and barely improved over its predecessor, missing central questions and skipping key estimates. Vals AI places Astra 7th and Sol 9th overall, but legal is a weak spot: Astra ranks 11th on HLAB and 30th on Legal Research, with Sol at 21st and 52nd, making nearly twice as many tool calls as their predecessors while writing shorter answers.

Two safety developments stand out. Astra is the first released model to reach OpenAI's "High" threshold for AI self-improvement, meaning it could meaningfully speed up AI research; OpenAI points to tighter research-environment controls and its monitoring system Control Room as countermeasures. Astra also runs complex reasoning within single output tokens, with 12.3 serial steps, which Epoch AI notes makes such models harder to monitor. Astra also cracked 7 of 68 tasks on FrontierMath Erdős, a record up from 3, one of which had no known solution before.

Original article

OpenAI releases two new language models. GPT-6.2 Astra is aimed at demanding professional work, while GPT-6.2 Sol is built for everyday use. OpenAI says both outperform their predecessors on benchmarks and cost less to run.

GPT-6.2 Astra and Sol are available now for Plus, Pro, Enterprise, and Edu users in ChatGPT Work and Codex. Pro-500 subscribers can use Ultrafast mode with both models. For the first time, Pro-200 subscribers also get Ultrafast access, starting with GPT-6.2 Sol.

Developers can access both models through the OpenAI API. OpenAI says API pricing for GPT-6.2 Astra is 20 percent cheaper than its predecessor's, at $8 per million input tokens, $0.40 for cached inputs, and $40 per million output tokens. GPT-6.2 Sol keeps GPT-6.1 Sol's pricing at $2 for input, $0.10 for cached inputs, and $10 for output per million tokens.

OpenAI calls Astra "the world's best model for scientists" and touts polished slides

OpenAI trained GPT-6.2 Astra to handle professional conventions in fields like law, finance, and accounting more reliably. The company says presentations pull layouts, colors, and typography from templates, matching exact font sizes. Slide titles are meant to capture a slide's main point, while body text stays focused on key details.

OpenAI's announcement leans hard on the price-to-performance ratio of its models. On Agents' Last Exam, a benchmark that tests multi-step professional workflows, GPT-6.2 Astra scores 5.2 points above its predecessor GPT-6 Astra at less than a third of the cost, according to OpenAI. It leads Anthropic's Claude Fable 5.2 by 5.5 points at just 5 percent of the cost. Only Google's Gemini 4 Carbon keeps up with Astra on this benchmark.

GPT-6.2 Astra achieves the highest scores on Agents' Last Exam v1.1 at low cost per task. Claude Fable 5.2 reaches a similar score but costs several times more per task. | Image: OpenAI

On the legal benchmark Harvey LAB-AA, which covers tasks like contract clause analysis, GPT-6.2 Astra more than doubles Claude Fable 5.2's pass rate at about one-sixth of the cost, according to OpenAI. On the internal GDPval-v2 benchmark, which includes consulting, finance, and design tasks, OpenAI says Astra gains 6.2 percentage points over its predecessor while using 22 percent fewer output tokens.

OpenAI says computer use, already a strong suit of the predecessor, got better again. In testing, the model reportedly built a 3D car model, wrote a physics solver in Python, and animated the results in Blender. In another demo, it modeled a remote-controlled car part by part and produced an animated assembly guide.

OpenAI also claims progress in web design. On the 3D benchmark AA-3D, human judges compare two blinded interactive experiences. GPT-6.2 Astra takes first with 1,318 Elo points, ahead of Claude Fable 5.2 at 1,271 and GPT-6.2 Sol at 1,259.

On Terminal-Bench-Science, a benchmark that tests scientific workflows in a terminal, the model scores 9 percentage points above GPT-6 Astra, again at less than a third of the cost, according to OpenAI. Astra also sets a new high on the Vals Science Index, which measures how well models interpret biological data and run experiments, OpenAI says.

Sol nearly matches the original Astra at a fraction of the cost

GPT-6.2 Sol is for users who want a fast, versatile model for everyday tasks, OpenAI says. On the coding benchmark FrontierCode 2.0, which checks whether code changes meet the quality bar of real projects, Sol trails Astra by just 0.5 points at one-fifth the cost. OpenAI says the model also handles non-work tasks well.

On the coding benchmark FrontierCode 2.0, GPT-6.2 Sol scores nearly as high as GPT-6.2 Astra but at a fraction of the cost. Claude Fable 5.2 hits the highest peak score but costs several times more per task. | Image: OpenAI

GPT-6.2 Astra and Sol have also gotten better at cybersecurity, according to OpenAI. They find and exploit vulnerabilities more effectively, write more secure code, and deliver better bug fixes, with notably higher token efficiency in several tests. Both models hit the "Critical" threshold for cybersecurity in OpenAI's Preparedness Framework, just as GPT-6 Astra did before them.

OpenAI is adding stricter safeguards for potentially risky cybersecurity requests in response. These safeguards should make abuse harder but will also limit legitimate vulnerability research and security testing, OpenAI says.

On the internal ExploitBench test, models must turn known browser vulnerabilities into working exploits. GPT-6.2 Astra clears a 50 percent success rate, far outpacing its predecessor GPT-6 Astra. Results come from tests with safeguards turned off. | Image: OpenAI

OpenAI plans to offer the new models through OpenAI Daybreak, which already gives vetted security researchers access to other models with fewer guardrails. The published cybersecurity benchmark numbers come from internal tests with safeguards and classifiers turned off. OpenAI lays out its methodology in the accompanying safety report.

Astra takes second in the Artificial Analysis Intelligence Index

In the Artificial Analysis Intelligence Index, which rolls up nine evaluations across knowledge work, coding, science, and general knowledge, GPT-6.2 Astra finishes second, just behind Anthropic's Claude Fable 5.2. Astra jumps five points over GPT-6 Astra, according to Artificial Analysis, passing Google's Gemini 4 Carbon (60 points) and Anthropic's Claude Opus 5.5 (59 points). GPT-6.2 Sol picks up two points to reach 57, matching GPT-6 Astra's level at only about 15 percent of the cost per task.

OpenAI owns the Pareto frontier on cost versus performance, the line where no other model is both cheaper and better, according to Artificial Analysis. Only Anthropic and Meta models also land on that frontier. OpenAI holds most of the top spots on efficiency too, measured by output tokens per task. Claude Fable 5.2 is the only outside model that shows up there.

GPT-6.2 Astra erreicht mit 62 Punkten Platz 2 im Intelligence Index, knapp hinter Claude Fable 5.2 (65). OpenAI-Modelle dominieren die Pareto-Grenze beim Kosten-Leistungs-Verhältnis. | Bild: Artificial Analysis

GPT-6.2 Astra reaches 62 points, taking second place in the Intelligence Index just behind Claude Fable 5.2 (65). OpenAI models dominate the Pareto frontier on cost-performance. | Image: Artificial Analysis

Artificial Analysis backs up OpenAI's claims in science and factual knowledge. GPT-6.2 Astra leads on Terminal-Bench-Science 0.1 and places second behind Claude Fable 5.2 on the physics reasoning test CritPt v2, the factual knowledge benchmark AA-Omniscience, and the knowledge benchmark HLE-Diamond. Astra also leads in 3D design (AA-3D) and robotics (AA-Robotics v0.1), scoring 79 on robotics against Sol's 78 and Claude Fable 5.2's 75.

Coding is a different story, though. According to Artificial Analysis, both models have flatlined there. In the Coding Agent Index, measured with the Codex harness at max compute, GPT-6.2 Astra stays right where GPT-6 Astra was. GPT-6.2 Sol actually drops three points from GPT-6.1 Sol. That decline comes from a 14-point slide on SWE-Atlas-QnA-AA, where the model omits key facts from its answers more often than its predecessor did.

Artificial Analysis also flags a high hallucination rate. At maximum effort, GPT-6.2 Astra hallucinates 59 percent of the time, Sol 55 percent. The metric is AA-Omniscience Hallucination Rate, which measures how frequently a model guesses on factual questions instead of saying it doesn't know. These are unusually hard questions, so the numbers don't reflect everyday hallucination rates.

Epoch AI finds Astra on par with Fable 5.2 but weaker on real-world tasks

Research organization Epoch AI tested GPT-6.2 Astra on its own benchmarks before launch. The model scores 174 points in the Epoch Capabilities Index (ECI), tying Anthropic's Fable 5.2. Both models beat what the previous trend for reasoning models would have predicted before Astra, according to Epoch AI.

On real-world tasks pulled from Epoch AI's own research, Astra fell behind Fable 5.2 and barely improved over GPT-6 Astra. According to Epoch AI, the model missed the central question on simpler research projects and spun its wheels trying to fix things. On a task about researching AI data centers, Astra played it too safe and skipped key estimates, something Epoch AI says no contractor could get away with. Epoch AI rated Astra's writing as relatively strong compared to other tested models but still below its own bar.

GPT-6.2 Astra scores 174 points in the Epoch Capabilities Index, tying Anthropic's Fable 5.2. Both sit above the previous trend line for reasoning models. Astra is significantly cheaper. | Image: Epoch AI

One thing that stands out is Astra's ability to run complex reasoning within a single output token, with no visible chain of thought. Epoch AI clocks 12.3 serial steps for Astra, up from 10.5 for GPT-6 Astra and 4.2 for Claude Fable 5.1, the strongest non-OpenAI model at the time. Models that can reason this way without showing their work are harder to monitor, a safety concern that already came up with the first Astra model.

On FrontierMath Erdős, a benchmark of unsolved math problems, GPT-6.2 Astra cracked 7 of 68 tasks, each formally verified in the proof assistant Lean. The old record was 3 of 68, set by GPT-6.1 Sol. One of the seven had no known solution before.

Vals AI puts Astra and Sol in the top 10 but finds legal weak spots

GPT-6.2 Astra ranks 7th and GPT-6.2 Sol 9th in the Vals Index, separated by just 1.6 points. The price gap is wide, though. Sol runs $3.18 per task, less than a third of Astra's $10.68, making it the cheapest model in the top 10, according to Vals AI. Astra also got cheaper than its predecessor, scoring 2.6 points above GPT-6 Astra at roughly half of its $21.28 per-task cost. Vals AI says Astra uses the fewest output tokens in the top 10, averaging 91,000 per task.

GPT-6.2 Astra and Sol rank 7th and 9th in the Vals Index. Sol runs $3.18 per task, less than a third of Astra's $10.68, and is the cheapest model in the top 10. Claude Fable 5.2 tops the ranking. | Image: Vals AI

Vals AI backs OpenAI's claim to the top spot on the Vals Science Index. Astra leads that ranking and takes first on Terminal-Bench Science and VCB 1–100 at about half the cost and half the runtime of GPT-6 Astra. Sol comes in third on Terminal-Bench Science at roughly a quarter of Astra's cost. On the broader Terminal-Bench 4 for agentic coding, Astra places 5th and Sol 7th.

Legal tests are where the models fall short, according to Vals AI. On the HLAB benchmark, Astra and Sol double their predecessors' scores but rank only 11th and 21st. On the Legal Research benchmark, the drop is even steeper, with Astra at 30th and Sol at 52nd. Vals AI says the models make nearly twice as many tool calls as their predecessors but write shorter answers.

In September, OpenAI announced a specialized product called "Astra for Law." It does significantly better than the base model on the Legal Research Bench, reaching 6th place. Vals AI tested both models with a one-million-token context window and 128,000 max output tokens at full reasoning effort.

GPT-6.2 Astra is the first released model to hit OpenAI's "High" threshold for AI self-improvement

According to OpenAI, GPT-6.2 Astra is the first externally released model to reach the "High" threshold for AI self-improvement. OpenAI says the model can meaningfully speed up AI research, on par with giving every OpenAI researcher an extra, highly skilled research engineer.

OpenAI calls this out explicitly as a risk. Models that can help build future AI systems could push the field forward faster than safety measures and human oversight can keep up. The industry is currently wrestling with this under the label "RSI".

As countermeasures, OpenAI points to tighter controls in research environments and its monitoring system Control Room, which can track research tasks and shut them down if needed. The company also says it has expanded monitoring that examines how models reason and act and automatically flags unauthorized behavior.

On alignment, meaning how well the model follows user instructions and communicates openly, the new models match their predecessors, according to OpenAI. In two tests, however, they more often failed to flag obstacles blocking their work, like a missing file or an unavailable search tool.

The original belongs to The Decoder and its authors and is reproduced here for reading. To have it removed, write to support@aisa.one.

Other coverage 10