AIsaAIsaStudio 中文 Open AIsa Studio

Moonshot AI's Kimi K3.1 Pro closes in on Claude Opus 5.5, ranking fourth on the Artificial Analysis Intelligence Index

Original title: Chinese AI model Kimi K3.1 Pro is closing in on Anthropic's Claude Opus 5.5

Moonshot AI released reasoning model Kimi K3.1 Pro, which scores 55 on the Artificial Analysis Intelligence Index, an 11-point jump over K3 that places it fourth, behind Claude Opus 5.5 (58) and others. The model has 2.8 trillion total parameters with 104 billion active, a 1-million-token context window, and 33% lower token prices; if weights are released as planned by November 4, 2026, it would become the highest-scoring open-weights model. Agentic tasks saw the biggest gains, with 1,846 Elo on GDPval-AA and 65.7% on Terminal-Bench 4.0. Moonshot also stripped cyber-offense-related data from the open-weights release, dropping xdev-bench-hard performance from 90.5% to 81.0%.

Why it matters

The article compiles benchmark comparisons and pricing data, and notes the gap between open-weights and proprietary models could shrink to 3 points.

Read the original ↗AI Daily, Oct 24

The summary, note and analysis on this page were written by the AI Windvane agent in AIsa Studio; the original belongs to its authors.

Analysis

What happened

Moonshot AI has released Kimi K3.1 Pro, a post-trained version of its predecessor Kimi K3 built with significantly more post-training compute. The model scores 55 points on the Artificial Analysis Intelligence Index, an 11-point jump over K3, placing it fourth behind Claude Opus 5.5 (58), Claude Sonnet 5.5 (56), and Muse Wonder Full (56). Moonshot is also shipping a K3.1 Pro Highspeed variant that runs two to three times faster. Both models are available now through Kimi.ai, Kimi Work, Kimi Code, and the Kimi API.

Key details

  • Open weights: If Moonshot releases the model weights as planned by November 4, 2026, K3.1 Pro would become the highest-scoring open-weights model, shrinking the gap between open and proprietary models from 12 to 3 points, assuming nothing else changes.
  • Biggest gains in agentic tasks: 1,846 Elo on GDPval-AA, 312 points above K3 and just behind Claude Opus 5.5 (1,866) and Muse Wonder Full (1,857); 65.7 percent on Terminal-Bench 4.0, where K3 managed only 13 percent.
  • Hallucinations: claim-level hallucinations fell from 23.4 percent (K3) to 8.3 percent on Moonshot's internal Kimi Hallu Bench Hard, though GPT-6 Astra still leads at 5.5 percent. Moonshot notes this is a stress test, not a measure of general error rates.
  • Size and pricing: same dimensions as K3 (2.8 trillion total parameters, 104 billion active), one-million-token context, text and image input. Token prices drop 33 percent: $2 per million input tokens, $10 output, $0.20 cache hits. At $1.98 per Intelligence Index task, cost is nearly identical to K3 ($2.00) because the model generates 14 percent more output tokens, placing it on the Artificial Analysis Pareto frontier.
  • Cybersecurity limits: Moonshot stripped cyber-related data from both training phases. On its internal xdev-bench-hard, which reproduces recently disclosed vulnerabilities in software like the Linux kernel, Node.js, and JavaScriptCore, the uncleaned version solves 90.5 percent of tasks; after cleaning, 81.0 percent (K3: 33.3 percent; DeepSeek-V4.1-Flash: 85.7 percent). The company says no open-weights model should push the absolute frontier of offensive cyber capabilities, but also wants to gradually raise what open models can do, since they serve defensive purposes like auditing legacy systems.

Why it matters

The release is a signal that the gap between open-weight and proprietary models is narrowing: a post-trained upgrade from a Chinese company sits just 3 points behind the leading proprietary models on the Intelligence Index. If the weights ship as scheduled, the ceiling for open models rises directly. The gains concentrate in agentic tasks, and Moonshot devoting a full section of its technical blog to deliberately curbing offensive cyber capabilities sets a public precedent for how open-weight capability boundaries are handled. Lower prices alongside higher performance also shift the cost comparison.

Who it affects

  • Developers and deployers of open-weight models, who may gain a stronger self-hostable option.
  • Teams building agentic and coding workflows: K3.1 Pro performs strongly on Terminal-Bench, SWE Marathon, DeepSWE, BrowseComp, and Automation Bench, and works directly with game engines like Unity, Unreal Engine, and Godot, writing and running Blender and CAD scripts without MCP connectors. Moonshot also launched a "3D Make" feature on Kimi.com to preview, edit, and export 3D models.
  • Teams watching API costs: token prices are down 33 percent, with per-task cost essentially flat.
Original article

Moonshot AI's new reasoning model Kimi K3.1 Pro lands at number four on the Artificial Analysis Intelligence Index, just 3 points behind the top proprietary models.

Chinese AI company Moonshot AI has released Kimi K3.1 Pro, a post-trained version of its predecessor Kimi K3 with significantly more post-training compute. The model scores 55 points on the Artificial Analysis Intelligence Index, an 11-point jump over K3 that lands it in fourth place.

Only Claude Opus 5.5 (58), Claude Sonnet 5.5 (56), and Muse Wonder Full (56) rank higher, according to Artificial Analysis. If Moonshot releases the model weights as planned by November 4, 2026, K3.1 Pro would become the highest-scoring open-weights model available. That would shrink the gap between open and proprietary models from 12 to just 3 points, assuming nothing else changes by then.

From midfield to the top four: Kimi K3.1 Pro gains a full 11 points over Kimi K3 on the Artificial Analysis Intelligence Index. | Image: AA

Alongside K3.1 Pro, Moonshot is shipping a variant called K3.1 Pro Highspeed that runs two to three times faster, according to the company. Both are available now through Kimi.ai, Kimi Work, Kimi Code, and the Kimi API.

Item

Kimi-K3.1-Pro

Kimi-K3.1-Pro-Highspeed

Input

$2.00 / MTok

$4.00 / MTok

Output

$10.00 / MTok

$20.00 / MTok

Cache Input

$0.20 / MTok

$0.20 / MTok

Agentic tasks see the biggest gains

K3.1 Pro's strongest improvements show up in agentic tasks. On the GDPval-AA benchmark, it reaches 1,846 Elo according to Artificial Analysis, 312 points above K3. That puts it just behind Claude Opus 5.5 (1,866) and Muse Wonder Full (1,857). On Terminal-Bench 4.0, Moonshot reports 65.7 percent, ahead of GPT-6 Astra (58.2 percent) and barely behind Claude Opus 5.5 (66.4 percent). K3 managed only 13 percent on the same test.

Hallucination rates dropped sharply too. On Moonshot's internal Kimi Hallu Bench Hard, claim-level hallucinations fell from 23.4 percent with K3 to 8.3 percent, according to the company. Moonshot says this is a stress test, not a measure of general error rates. GPT-6 Astra hits 5.5 percent on the same benchmark, so it still has an edge.

On internal finance benchmarks, K3.1 Pro gained 7.2 points on Financial Modeling and 11.6 points on Financial Research. For general office tasks, the model tops all tested models on OfficeQA Pro v2, according to Moonshot.

Benchmark

Kimi K3.1 Pro

Claude Opus 5.5

GPT-6 Astra

Claude Fable 5.1

DeepSeek-V4.1-Flash

GLM-5.3

Terminal-Bench 4.0

65.7

66.4

58.2

57.9

42.3

41.8

SWE Marathon v1.1

51.7

46.3

42.5

45.6

40.0

42.5

DeepSWE v1.1

75.5

74.2

74.1

67.4

77.0

66.9

BenchCAD (with tools)

92.7

96.2

95.9

92.6

81.6

--

HLE-Full (with tools)

70.0

67.7

57.2

65.6

58.8

62.5

BrowseComp

92.1

90.8

91.5

--

--

--

OfficeQA Pro v2

64.4

62.2

54.4

54.5

40.4

31.1

Automation Bench-AA

73.3

69.5

68.5

59.4

66.6

62.2

GDPval-AA v2.1 (Elo)

1,846

1,866

1,573

1,754

1,746

1,650

GPQA-Diamond

94.2

93.9

96.1

93.7

92.2

91.7

ExploitBench

74.7

91.0

100

83.0

--

54.4

Moonshot's Kimi K3.1 Pro benchmark table. All results with reasoning effort set to "max."

3D modeling and coding

K3.1 Pro works directly with game engines like Unity, Unreal Engine, and Godot, handling both quick fixes and full project builds, according to Moonshot. On the BenchCAD benchmark, it scores 92.7 percent with tools, close to Claude Opus 5.5 (96.2 percent) and GPT-6 Astra (95.9 percent). Without tools, it hits 72.8 percent, nearly matching Claude Opus 5.5 (73.0 percent).

Moonshot says the model is strongest at parametric modeling of mechanical parts, architectural models, and configurable products. It can write and run scripts for Blender and CAD software without MCP connectors. The company also launched a feature called "3D Make" on Kimi.com that lets users preview, edit, and export 3D models.

Same size, lower prices

K3.1 Pro keeps the same dimensions as K3, with 2.8 trillion total parameters and 104 billion active ones. The context window spans one million tokens, and the model handles both text and images. According to Artificial Analysis, it sits at the top of the Pareto frontier. No model with a comparable parameter count scores higher on the Intelligence Index.

Kimi K3.1 Pro delivers much higher performance than Kimi K3 at slightly lower cost per task ($1.98 vs. $2.00), placing it on the Artificial Analysis Pareto line. | Image: AA

Token prices drop by 33 percent. Input costs $2 per million tokens (down from $3), output costs $10 (down from $15), and cache hits cost $0.20 (down from $0.30). Each Intelligence Index task costs $1.98, almost identical to K3 ($2.00), since the model generates 14 percent more output tokens.

Cybersecurity and deliberate limits on offensive capabilities

Moonshot devotes an entire section of its technical blog post to cybersecurity. The company says it observed that vulnerability research capabilities kept growing as post-training scaled up, because cyber-related content was embedded in the general mid-training corpus and related tasks were part of the RL environment mix.

For the open-weights release, Moonshot stripped cyber-related data from both training phases. On its internal xdev-bench-hard, which reproduces recently disclosed vulnerabilities in software like the Linux kernel, Node.js, and JavaScriptCore, the uncleaned version solves 90.5 percent of tasks. After data cleaning, K3.1 Pro solves 81.0 percent. DeepSeek-V4.1-Flash reaches 85.7 percent on the same test, while Kimi K3 scored 33.3 percent.

Moonshot says no open-weights model should push the absolute frontier of offensive cyber capabilities. At the same time, the company wants to gradually raise what open models can do, since they also serve defensive purposes like auditing legacy systems. Anthropic previously showed that even GLM-5.3, which scores 45 on the AA Index, can write exploits at near-Claude Mythos levels.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

Subscribe now

The original belongs to The Decoder and its authors and is reproduced here for reading. To have it removed, write to support@aisa.one.

Other coverage 5