Claude Haiku 4.5 Pro vs Mistral Large 3 Instruct: which model should you choose?
We compared Claude Haiku 4.5 Pro and Mistral Large 3 Instruct on price, context window and 12 benchmarks. Mistral Large 3 Instruct has the stronger average benchmark score; Mistral Large 3 Instruct is cheaper on a blended 3:1 basis.
Claude Haiku 4.5 Pro
Claude Haiku 4.5 Pro is a multimodal model from Anthropic. It offers a 1,000,000-token context window, costs $15.07 per million input tokens and $73.96 per million output tokens, and averages 80.8 across the index's benchmark suite.
- Input
- $15.07 / 1M
- Output
- $73.96 / 1M
- Context
- 1,000,000
- Avg score
- 80.8
- Open weights
- No
Mistral Large 3 Instruct
Mistral Large 3 Instruct is a multimodal model from Mistral AI. It offers a 400,000-token context window, costs $5.31 per million input tokens and $22.47 per million output tokens, and averages 81.1 across the index's benchmark suite.
- Input
- $5.31 / 1M
- Output
- $22.47 / 1M
- Context
- 400,000
- Avg score
- 81.1
- Open weights
- Yes
Specification comparison
| Spec | Claude Haiku 4.5 Pro | Mistral Large 3 Instruct | Edge |
|---|---|---|---|
| Input price / 1M | $15.07 | $5.31 | B |
| Output price / 1M | $73.96 | $22.47 | B |
| Context window | 1,000,000 | 400,000 | A |
| Max output | 8,192 | 65,536 | B |
| Average score | 80.8 | 81.1 | B |
| Arena Elo | 1436.2 | 1446.2 | B |
| Open weights | No | Yes | B |
Benchmark comparison
Claude Haiku 4.5 Pro wins 5, Mistral Large 3 Instruct wins 7, and 0 benchmarks are tied. The table shows the modelled score for each model and the gap.
| Benchmark | Claude Haiku 4.5 Pro | Mistral Large 3 Instruct | Gap | Winner |
|---|---|---|---|---|
| MMLU-Pro | 81.5 | 82.3 | 0.8 | Mistral Large 3 Instruct |
| GPQA Diamond | 75.7 | 79.8 | 4.1 | Mistral Large 3 Instruct |
| SWE-bench Verified | 70.4 | 71.9 | 1.5 | Mistral Large 3 Instruct |
| HumanEval | 86.0 | 84.2 | 1.8 | Claude Haiku 4.5 Pro |
| MATH-500 | 83.7 | 83.4 | 0.3 | Claude Haiku 4.5 Pro |
| AIME 2025 | 80.1 | 76.2 | 3.9 | Claude Haiku 4.5 Pro |
| LiveCodeBench | 72.4 | 75.1 | 2.7 | Mistral Large 3 Instruct |
| IFEval | 90.1 | 87.6 | 2.5 | Claude Haiku 4.5 Pro |
| TruthfulQA | 84.1 | 85.5 | 1.4 | Mistral Large 3 Instruct |
| HellaSwag | 89.3 | 89.1 | 0.2 | Claude Haiku 4.5 Pro |
| MMMU | 75.3 | 76.5 | 1.2 | Mistral Large 3 Instruct |
| Arena Elo | 1436.2 | 1446.2 | 10.0 | Mistral Large 3 Instruct |
Price analysis
On a blended 3:1 input-to-output basis, Claude Haiku 4.5 Pro costs about $29.79 per million tokens and Mistral Large 3 Instruct costs about $9.60. Mistral Large 3 Instruct is roughly 68% cheaper than Claude Haiku 4.5 Pro. At high volume, that gap compounds quickly, so price should carry real weight unless the quality difference is decisive.
Claude Haiku 4.5 Pro has the larger context window at 1,000,000 tokens, compared with 400,000 for Mistral Large 3 Instruct. That matters for long documents, large codebases and multi-step agent traces.
Verdict
Across 12 shared benchmarks, Claude Haiku 4.5 Pro wins 5, Mistral Large 3 Instruct wins 7, and 0 are tied. On the index average, Mistral Large 3 Instruct leads Claude Haiku 4.5 Pro by 0.3 points (81.1 versus 80.8).
The price picture favours Mistral Large 3 Instruct. The context picture favours Claude Haiku 4.5 Pro. Those two dimensions often matter more than a few benchmark points once a model is good enough for the task.
If you need a single default, start with Mistral Large 3 Instruct for quality-sensitive work, and check whether its price holds at your expected volume before committing.
Choose Claude Haiku 4.5 Pro if
- You need the larger 1,000,000-token context window.
Choose Mistral Large 3 Instruct if
- You want the higher average benchmark score in this index.
- Unit cost matters and you want the cheaper blended price.
- You need the larger 65,536-token output limit.
- You need open weights for self-hosting or fine-tuning.
FAQ
Is Claude Haiku 4.5 Pro better than Mistral Large 3 Instruct?
On the index average, Mistral Large 3 Instruct leads Claude Haiku 4.5 Pro by 0.3 points (81.1 versus 80.8). The better choice depends on price, context and your task. Claude Haiku 4.5 Pro wins 5 benchmarks, Mistral Large 3 Instruct wins 7.
Which is cheaper, Claude Haiku 4.5 Pro or Mistral Large 3 Instruct?
Mistral Large 3 Instruct is cheaper on a blended 3:1 basis at about $9.60 per million tokens, versus $29.79 for Claude Haiku 4.5 Pro.
Which has the larger context window?
Claude Haiku 4.5 Pro has the larger context window at 1,000,000 tokens. Mistral Large 3 Instruct has 400,000 tokens.
Are these models open weights?
Claude Haiku 4.5 Pro is proprietary; Mistral Large 3 Instruct is open weights.
Which should I choose for production?
If you need a single default, start with Mistral Large 3 Instruct for quality-sensitive work, and check whether its price holds at your expected volume before committing.