Head-to-head · multimodal vs multimodal

Claude Haiku 4.5 Pro vs Mistral Large 3: which model should you choose?

We compared Claude Haiku 4.5 Pro and Mistral Large 3 on price, context window and 12 benchmarks. Mistral Large 3 has the stronger average benchmark score; Mistral Large 3 is cheaper on a blended 3:1 basis.

Anthropic

Claude Haiku 4.5 Pro

Claude Haiku 4.5 Pro is a multimodal model from Anthropic. It offers a 1,000,000-token context window, costs $15.07 per million input tokens and $73.96 per million output tokens, and averages 80.8 across the index's benchmark suite.

Input
$15.07 / 1M
Output
$73.96 / 1M
Context
1,000,000
Avg score
80.8
Open weights
No
Full Claude Haiku 4.5 Pro page
Mistral AI

Mistral Large 3

Mistral Large 3 is a multimodal model from Mistral AI. It offers a 128,000-token context window, costs $5.41 per million input tokens and $23.83 per million output tokens, and averages 81.7 across the index's benchmark suite.

Input
$5.41 / 1M
Output
$23.83 / 1M
Context
128,000
Avg score
81.7
Open weights
Yes
Full Mistral Large 3 page

Specification comparison

SpecClaude Haiku 4.5 ProMistral Large 3Edge
Input price / 1M$15.07$5.41B
Output price / 1M$73.96$23.83B
Context window1,000,000128,000A
Max output8,1924,096A
Average score80.881.7B
Arena Elo1436.21448.6B
Open weightsNoYesB

Benchmark comparison

Claude Haiku 4.5 Pro wins 4, Mistral Large 3 wins 8, and 0 benchmarks are tied. The table shows the modelled score for each model and the gap.

BenchmarkClaude Haiku 4.5 ProMistral Large 3GapWinner
MMLU-Pro81.584.63.1Mistral Large 3
GPQA Diamond75.779.63.9Mistral Large 3
SWE-bench Verified70.471.30.9Mistral Large 3
HumanEval86.088.62.6Mistral Large 3
MATH-50083.784.10.4Mistral Large 3
AIME 202580.178.31.8Claude Haiku 4.5 Pro
LiveCodeBench72.474.42.0Mistral Large 3
IFEval90.189.80.3Claude Haiku 4.5 Pro
TruthfulQA84.183.70.4Claude Haiku 4.5 Pro
HellaSwag89.388.21.1Claude Haiku 4.5 Pro
MMMU75.376.20.9Mistral Large 3
Arena Elo1436.21448.612.4Mistral Large 3

Price analysis

On a blended 3:1 input-to-output basis, Claude Haiku 4.5 Pro costs about $29.79 per million tokens and Mistral Large 3 costs about $10.02. Mistral Large 3 is roughly 66% cheaper than Claude Haiku 4.5 Pro. At high volume, that gap compounds quickly, so price should carry real weight unless the quality difference is decisive.

Claude Haiku 4.5 Pro has the larger context window at 1,000,000 tokens, compared with 128,000 for Mistral Large 3. That matters for long documents, large codebases and multi-step agent traces.

Verdict

Across 12 shared benchmarks, Claude Haiku 4.5 Pro wins 4, Mistral Large 3 wins 8, and 0 are tied. On the index average, Mistral Large 3 leads Claude Haiku 4.5 Pro by 0.9 points (81.7 versus 80.8).

The price picture favours Mistral Large 3. The context picture favours Claude Haiku 4.5 Pro. Those two dimensions often matter more than a few benchmark points once a model is good enough for the task.

If you need a single default, start with Mistral Large 3 for quality-sensitive work, and check whether its price holds at your expected volume before committing.

Choose Claude Haiku 4.5 Pro if

  • You need the larger 1,000,000-token context window.
  • You need the larger 8,192-token output limit.

Choose Mistral Large 3 if

  • You want the higher average benchmark score in this index.
  • Unit cost matters and you want the cheaper blended price.
  • You need open weights for self-hosting or fine-tuning.

FAQ

Is Claude Haiku 4.5 Pro better than Mistral Large 3?

On the index average, Mistral Large 3 leads Claude Haiku 4.5 Pro by 0.9 points (81.7 versus 80.8). The better choice depends on price, context and your task. Claude Haiku 4.5 Pro wins 4 benchmarks, Mistral Large 3 wins 8.

Which is cheaper, Claude Haiku 4.5 Pro or Mistral Large 3?

Mistral Large 3 is cheaper on a blended 3:1 basis at about $10.02 per million tokens, versus $29.79 for Claude Haiku 4.5 Pro.

Which has the larger context window?

Claude Haiku 4.5 Pro has the larger context window at 1,000,000 tokens. Mistral Large 3 has 128,000 tokens.

Are these models open weights?

Claude Haiku 4.5 Pro is proprietary; Mistral Large 3 is open weights.

Which should I choose for production?

If you need a single default, start with Mistral Large 3 for quality-sensitive work, and check whether its price holds at your expected volume before committing.

Related comparisons