Mistral Large 4（又名 Le Chonk）是 Mistral 推出的一款多模态、多语言、混合专家（MoE）模型。它接受文本和图像作为输入，并生成文本。该模型拥有约 1T 总参数，49B 活跃参数，上下文窗口为 100 万 tokens。
在 Artificial Analysis 网络安全指数测试中，Mistral Large 4 得分 82%。该测试要求模型复现开源软件中的真实漏洞，然后修补该软件。Mistral 报告称，几个封闭的前沿模型在同一测试中得分接近零，因为它们拒绝尝试执行此类工作。这对防御者来说至关重要，因为修复漏洞通常需要复现漏洞。在 Mistral 的内部测试中，Mistral Large 4 还用于恶意软件分析、漏洞优先级排序和编写检测规则，而这些并非模型显式训练的内容。
Mistral 主要将该模型定位为用于防御性安全工作。漏洞研究和事件响应在模型输入中往往看起来像攻击，因此闭源过滤器可能会阻止它们。依赖 API 的团队也可能在事件处理过程中失去访问权限。至关重要的是，开放权重模型让用户同时掌控使用策略和部署。尽管如此，该模型仍然会拒绝有害请求：在 JailbreakBench、StrongREJECT 和 AgentHarm 的网络安全提示下，其平均拒绝率高于任何其他开放权重模型。
对于社区建设者而言，像 Mistral Large 4 这样的开放权重模型解锁了大量下游用例。你可以围绕自己的代码库、崩溃日志和恶意软件样本来构建自己的网络安全系统。例如，使用 TRL 你可以从 Mistral Large 4 的数据中微调 较小的模型以修补你的代码库。事实上，复现后修补任务使用可验证的奖励，因此适合用于进一步强化小型安全模型的 RL 环境。开放权重还允许研究人员直接测量模型的拒绝行为，而不是依赖提供商的描述。
Mistral Large 4 的文本解码器有 72 层，隐藏维度为 6,144，包含 64 个注意力头。其注意力块结合了多头潜在注意力（MLA）与 DeepSeek 稀疏注意力（DSA）索引器（这是 GLM 5.3 等其他模型中的一个方向）。MLA 保持压缩的 KV 表示，而 DSA 为每个查询选择多达 2,048 个键位置。
Mistral Large 4 采用了 1.6B 参数的 Pixtral 编码器。Pixtral 有 30 层，隐藏维度为 2,048，包含 16 个注意力头。它使用 14 × 14 的补丁，并带有空间合并大小为 2 的补丁合并投影器。你可以在下面看到编码器流水线。
Mistral Large 4 在编码、网络安全、多模态理解和智能体工作流方面提供了强大的基准性能，使其成为开放权重生态系统中具有竞争力的补充。截至 2026 年 10 月 29 日，该模型在 Artificial Analysis 智力指数上排名第五的最佳开放权重模型。
vLLM 支持高质量的 NVFP4 Mistral Large 4 检查点，它具有更小的内存占用，并且需要 NVIDIA Blackwell GPU。该模型还附带了一个 DSpark 草稿生成器，以在 vLLM 中获得额外的加速。像这样启动服务器：
查看原文
Mistral Large 4 (aka Le Chonk) is a multimodal, multilingual, Mixture-of-Experts (MoE) model from Mistral. It takes text and images as input and generates text. It has about 1T total, 49B active parameter, and a context window of 1M tokens.
The model is released in two official variants:
- FP8
- NVFP4
There are also GGUFs created by Unsloth and the llama.cpp team. It’s distributed under the Mistral Ecosystem Open-Weight License (an MIT derivative that establishes limitations for model-as-a-service offerings).
Mistral Large 4 is particularly strong for cybersecurity, coding agents, and multimodality. In this post, we look at how the model works, its capabilities, architecture and more!
Table of Contents
What is new with Mistral Large 4
Mistral Large 4 combines a large pool of experts with sparse attention and a Pixtral vision encoder. The language model selects a small group of experts for each token, while its attention indexer selects which earlier token positions to attend to. These are two different forms of sparsity, where one selects feed-forward networks, the other selects context positions.
You can find all the checkpoints in the Mistral Large 4 collection.
Cybersecurity Capabilities
Mistral Large 4 scores 82% on the Artificial Analysis Cyber Index test that asks a model to reproduce a real vulnerability in open-source software and then patch the software. Mistral reports that several closed frontier models score near zero on the same test because they refuse to attempt the work. This is super important for defenders, because fixing a vulnerability usually requires reproducing the vulnerability. In Mistral’s internal testing, Mistral Large 4 was also useful for malware analysis, vulnerability prioritisation and writing detection rules, which the model was not explicitly trained for.
Mistral mainly positions the model for defensive security work. Vulnerability research and incident response often appear like attacks in model input, so closed source filters can block them. A team that depends on an API can also lose access in the middle of an incident. Crucially, open weight models put both the usage policy and the deployment under the user’s control. That said, the model still declines harmful requests: on cyber prompts from JailbreakBench, StrongREJECT and AgentHarm, its average refusal rate is higher than any other open weight model.
For community builders, an open weight model like Mistral Large 4 unlocks a load of downstream use cases. You could build your own cyber system around your code base, crash logs, and malware samples. For example, with TRL you could fine-tune smaller models from Mistral Large 4 traces patching your code base. In fact, reproduce-then-patch tasks use a verifiable reward, so it fits with RL environments that could be used to further RL smaller security models. Open weights also let researchers measure the model’s refusal behaviour directly instead of relying on the provider’s description.
In short, cyber capabilities like ML4’s in the open are a huge boost for the community.
We have interviewed Pierre Stock about the cyber capabilities of the model, you can watch it here.
Architecture
Mistral Large 4’s text decoder has 72 layers, a hidden dimension of 6,144, and 64 attention heads. Its attention blocks combine Multi-head Latent Attention (MLA) with a DeepSeek Sparse Attention (DSA) indexer (a direction in other models such as GLM 5.3). MLA keeps a compressed KV representation, and DSA selects up to 2,048 key positions for each query.
For each decoder block, there’s a 3:1 RoPE to NoPE pattern, i.e. 3 decoder layers employ RoPE and every fourth layer uses NoPE. The model also shares KV state across layers.
The first decoder layer uses a dense feed-forward network. The other 71 layers use MoE blocks, in which a softmax router selects four of the 128 experts for each token. One shared expert always runs alongside the selected experts, for a total of 5 active experts per token.
Regarding RoPE, Mistral uses LeRope, a YaRN-scaled RoPE with one learned multiplier per frequency.
Vision encoder
Mistral Large 4 employs a 1.6B Pixtral encoder. Pixtral has 30 layers, a hidden dimension of 2,048, and 16 attention heads. It uses 14 × 14 patches and a patch-merge projector with spatial merge size 2. You can see the encoder pipeline below.
Benchmark Results
Mistral Large 4 delivers strong benchmark performance across coding, cybersecurity, multimodal understanding, and agentic workflows, positioning it as a competitive addition to the open-weight ecosystem. As of October 29, 2026, the model is the fifth best open weights model on Artificial Analysis Intelligence index.
On coding, ML4 achieves 61.7% on DeepSWE v1.1, 59.4% on SWE-Atlas-QnA, and 28.3% on Terminal-Bench 4. Its combined Coding Agent Index score of 49.8% places it ahead of DeepSeek V4 Pro 0813 and Qwen3.8 Max.
Coding capabilities of ML4 extend to knowledge work, with 59.9% on AutomationBench and 1,393 Elo on AA-Briefcase, which evaluate business workflows and long-horizon professional tasks.
Cybersecurity is one of Mistral Large 4’s standout capabilities, with strong results across real-world vulnerability assessment and security competition tasks. Three benchmarks highlight the model’s cyber performance:
- Artificial Analysis Cyber Index: ML4 ranks among the top five models globally on this independent evaluation of models’ ability to find and fix software vulnerabilities.
- Vulnerability reproduction and patching: It achieves 82%, the highest reported score on this test within the index. The task requires reproducing a real vulnerability in open-source software and then patching it, testing both investigation and remediation.
- Cybench: ML4 solves 93% of a suite of 40 challenges drawn from security competitions, demonstrating strong performance on hands-on security problems.
Mistral Large 4 also demonstrates 93.3% attack resistance on Lakera’s B3 benchmark, adding evidence of robustness against prompt-injection attacks. Beyond benchmarks, internal testing showed promising results in malware analysis, vulnerability prioritization, and detection-rule generation.
Inference Support
Mistral Large 4 is shipped with day-0 support for transformers, vLLM and llama.cpp. GGUF quants are available from GGUF and the llama.cpp team. We provide options to deploy remotely with Inference Endpoints, and use serverless inference through Inference Providers.
Transformers
The Transformers implementation provides AutoModelForMultimodalLM, with AutoProcessor preparing the conversation and image inputs. Mistral Large 4 can take low, medium, high as reasoning effort. The default is high, and note that reasoning cannot be disabled, so using reasoning_effort: none would still use high.
To run the model, upgrade the transformers package
pip install --upgrade transformers
import os
from transformers import AutoProcessor, AutoModelForMultimodalLM, DistributedConfig
distributed_config = DistributedConfig(
tp_size=int(os.environ["WORLD_SIZE"]),
ep_size=int(os.environ["WORLD_SIZE"]),
)
model_id = "mistralai/Mistral-Large-4-1T-A52B"
processor = AutoProcessor.from_pretrained(model_id)
model = AutoModelForMultimodalLM.from_pretrained(
model_id,
distributed_config=distributed_config,
)
# only text
text_messages = [
{
"role": "user",
"content": "Who are you?"
}
]
# text + image
multimodal_messages = [
{
"role": "user",
"content": [
{
"type": "image",
"image": "https://huggingface.co/datasets/huggingface/cats-image/resolve/main/cats_image.jpeg",
},
{
"type": "text",
"text": "How many cats are in the image?",
},
],
},
]
for messages in [text_messages, multimodal_messages]:
inputs = processor.apply_chat_template(
messages,
add_generation_prompt=True,
tokenize=True,
return_dict=True,
return_tensors="pt",
reasoning_effort="medium",
).to(model.device).to(model.dtype)
input_len = inputs["input_ids"].shape[-1]
outputs = model.generate(**inputs, max_new_tokens=100)
if int(os.environ["RANK"]) == 0:
print(processor.decode(outputs[0][input_len:], skip_special_tokens=False))
You can run the script above by saving it in a python file script.py and then run
torchrun --nproc-per-node 8 script.py
vLLM
vLLM supports the high-quality NVFP4 Mistral Large 4 checkpoint, which has a smaller memory footprint and requires NVIDIA Blackwell GPUs. The model also ships with a DSpark drafter for additional speed-ups with vLLM. Launch the server like this:
vllm serve mistralai/Mistral-Large-4-1T-A52B-NVFP4 \
--config-format mistral \
--load-format mistral \
--tensor-parallel-size 8 \
--decode-context-parallel-size 8 \
--enable-expert-parallel \
--dtype bfloat16 \
--max-model-len 131072 \
--max-num-seqs 16 \
--max-num-batched-tokens 2048 \
--gpu-memory-utilization 0.85 \
--enable-prefix-caching \
--enforce-eager \
--mm_processor_cache_gb 0.0
Once the server is up and running, you can run the following.
curl -s http://127.0.0.1:8000/v1/chat/completions -H 'Content-Type: application/json' \
-d '{"messages":[{"role":"user","content":"What is 17*23?"}],"max_tokens":512}'
Llama.cpp
Llama.cpp and Llama App already support Mistral Large 4.
You can install Llama App with the following command:
curl -LsSf https://llama.app/install.sh | sh
Then you can start the server as follows, indicating the quant suffix after the model ID:
llama serve -hf ggml-org/Mistral-Large-4-1T-A52B-GGUF:Q2_K
Here’s the repository with the quants derived from the FP8 checkpoint, and this is the NVFP4 one, converted from the official NVFP4 repo.
Once the server has started, you can head to localhost:9931 to chat using the built-in WebUI. From the web UI you can add images for inference and adjust the reasoning lever.
You can also query the server as follows. Feel free to check out the API reference for multimodality, tool calls and more.
curl http://localhost:8080/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"messages": [
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "Write a limerick about python exceptions"}
]
}'
You can run image-text inference as follows.
curl -s http://127.0.0.1:8080/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer <your-key>" \
-d '{
"model": "muse-spark-open",
"messages": [
{
"role": "user",
"content": [
{
"type": "text",
"text": "What is in this image?"
},
{
"type": "image_url",
"image_url": {
"url": "data:image/png;base64,..."
}
}
]
}
],
"temperature": 0
}'
The llama.cpp team ships the following quants: IQ2_XXS, Q2_K, Q4_K_M, NVFP4, Q8_0, and BF16 for further conversions. The 2-bit quants run on a single Apple Silicon Ultra computer with 512 GB of unified RAM. The others require distributed inference. You can also run on multiple NVIDIA or AMD cards.
Running Q2_K on a single M3 Ultra, we got a prefill throughput of about 90 tokens per second, and a generation speed of 15 tok/s. On 4 x RTX6000 Pro, we observed the following results:
- NVFP4: 32K context size, prefill 130-590 t/s, gen speed ~10 t/s
- IQ2_XXS: 800K context size. At short context sizes, prefill is 500 tok/s and generation runs at 30 tok/s. However, using long contexts performance drops to 129 tok/s (prefill) and 3 tok/s (generation).
Fine-tuning with TRL
We also ship day 0 support of fine tuning Mistral Large 4 using TRL. All you have to do is upgrade to the latest version of transformers, trl and peft.
pip install --upgrade transformers trl peft
In the following example we train the model to perform multilingual thinking. The fine tuned model would be able to reason in the language the system prompt asks for!
The script runs on the FP8 variant on a node of 8xB300s. The full example, with a Slurm launcher, is in TRL's examples.
# torchrun --nproc-per-node 8 sft.py
import os
from datasets import load_dataset
from peft import LoraConfig
from transformers import AutoModelForImageTextToText, DistributedConfig
from trl import SFTConfig, SFTTrainer
world_size = int(os.environ["WORLD_SIZE"])
model_id = "mistralai/Mistral-Large-4-1T-A52B"
model = AutoModelForImageTextToText.from_pretrained(
model_id,
distributed_config=DistributedConfig(fsdp_size=world_size, ep_size=world_size),
dtype="auto",
)
dataset = load_dataset("HuggingFaceH4/Multilingual-Thinking", split="train")
# the assistant turns carry reasoning, so render them in reasoning mode
dataset = dataset.map(lambda x: {"chat_template_kwargs": {"reasoning_effort": "high"}})
trainer = SFTTrainer(
model=model,
args=SFTConfig(
packing=True,
max_length=4096,
assistant_only_loss=True,
learning_rate=1e-4,
lr_scheduler_type="cosine",
warmup_steps=10,
),
train_dataset=dataset,
peft_config=LoraConfig(
r=16,
lora_alpha=32,
target_modules=r".*language_model.*\.(q_proj|kv_a_proj_with_mqa|kv_b_proj|o_proj|gate_proj|up_proj|down_proj)",
),
)
trainer.train()
Inference Endpoints
Mistral Large 4 is also available on Inference Endpoints, with a ready-to-deploy recipe on 8 x NVIDIA H200 GPUs. The recipe runs vLLM with the FP8 weights split across all eight GPUs using tensor and expert parallelism, and uses the model's built-in DSpark draft head for faster generation through speculative decoding. It serves up to 131K tokens of context and processes up to 16 requests at a time, and we observed the following results:
- Single request: time to first token of about 0.6 seconds for a 1K-token prompt, and a generation speed of ~65 tok/s, reaching 120–138 tok/s on chat prompts where DSpark's drafts are accepted.
- Long prompts: 16K-token prompts, four at a time, are prefilled at about 4,300 tok/s in total, with a time to first token of 8–9 seconds.
- Under load: about 480 tok/s of total generation across 1,000 ShareGPT conversations.
You can deploy it with the hf CLI as follows:
hf endpoints catalog deploy --repo mistralai/Mistral-Large-4-1T-A52B --name mistral-large-4
Once the endpoint is running, you can query its OpenAI-compatible API, using the endpoint URL and your Hugging Face token. The reasoning_effort field controls how much the model reasons before answering, and can be set to low, medium, or high (default).
curl "$(hf endpoints describe mistral-large-4 --json | jq -r .status.url)/v1/chat/completions" \
-H "Authorization: Bearer $(hf auth token 2>/dev/null)" \
-H "Content-Type: application/json" \
-d '{
"model": "mistralai/Mistral-Large-4-1T-A52B",
"messages": [
{"role": "user", "content": "Write a limerick about python exceptions"}
],
"reasoning_effort": "medium"
}'
The answer comes back in choices[0].message.content, and the reasoning in choices[0].message.reasoning. The endpoint also supports tool calls, structured outputs, image inputs, and streaming through the standard Chat Completions fields.
Dell Enterprise Hub
The easiest way to get up and running with your Dell AI Servers (NVIDIA H200, B200, GB200 or GB300) is by installing the dell-ai CLI:
pip install dell-ai && dell-ai login
And use it to run an optimized recipe for Mistral Large 4 on e.g., a NVIDIA B300 node.
dell-ai models deploy --model-id mistralai/Mistral-Large-4-1T-A52B-NVFP4 \
--engine docker \
--platform-id xe9780-nvidia-b300 \
--gpus 4
You can find more about this release in the Dell Enterprise Hub (DEH).
Try it out
Grab the weights from the Mistral Large 4 collection, run them locally with the GGUFs, or deploy them with Inference Endpoints. We can't wait to see what you build with Le Chonk. Share your fine-tunes, quants and other artefacts on the Hub!
Studio