ERNIE 4.5 Pro vs Mistral Large 3 Chat: which model should you choose?
We compared ERNIE 4.5 Pro and Mistral Large 3 Chat on price, context window and 12 benchmarks. ERNIE 4.5 Pro has the stronger average benchmark score; Mistral Large 3 Chat is cheaper on a blended 3:1 basis.
ERNIE 4.5 Pro
ERNIE 4.5 Pro is a multimodal model from Baidu. It offers a 1,000,000-token context window, costs $13.89 per million input tokens and $65.19 per million output tokens, and averages 80.5 across the index's benchmark suite.
- Input
- $13.89 / 1M
- Output
- $65.19 / 1M
- Context
- 1,000,000
- Avg score
- 80.5
- Open weights
- No
Mistral Large 3 Chat
Mistral Large 3 Chat is a multimodal model from Mistral AI. It offers a 1,000,000-token context window, costs $4.90 per million input tokens and $20.04 per million output tokens, and averages 79.1 across the index's benchmark suite.
- Input
- $4.90 / 1M
- Output
- $20.04 / 1M
- Context
- 1,000,000
- Avg score
- 79.1
- Open weights
- Yes
Specification comparison
| Spec | ERNIE 4.5 Pro | Mistral Large 3 Chat | Edge |
|---|---|---|---|
| Input price / 1M | $13.89 | $4.90 | B |
| Output price / 1M | $65.19 | $20.04 | B |
| Context window | 1,000,000 | 1,000,000 | Tie |
| Max output | 32,768 | 32,768 | Tie |
| Average score | 80.5 | 79.1 | A |
| Arena Elo | 1414.3 | 1414.2 | A |
| Open weights | No | Yes | B |
Benchmark comparison
ERNIE 4.5 Pro wins 8, Mistral Large 3 Chat wins 4, and 0 benchmarks are tied. The table shows the modelled score for each model and the gap.
| Benchmark | ERNIE 4.5 Pro | Mistral Large 3 Chat | Gap | Winner |
|---|---|---|---|---|
| MMLU-Pro | 80.3 | 83.3 | 3.0 | Mistral Large 3 Chat |
| GPQA Diamond | 74.7 | 75.9 | 1.2 | Mistral Large 3 Chat |
| SWE-bench Verified | 66.5 | 67.1 | 0.6 | Mistral Large 3 Chat |
| HumanEval | 86.9 | 85.0 | 1.9 | ERNIE 4.5 Pro |
| MATH-500 | 87.2 | 81.6 | 5.6 | ERNIE 4.5 Pro |
| AIME 2025 | 76.3 | 74.1 | 2.2 | ERNIE 4.5 Pro |
| LiveCodeBench | 76.4 | 73.0 | 3.4 | ERNIE 4.5 Pro |
| IFEval | 86.0 | 86.6 | 0.6 | Mistral Large 3 Chat |
| TruthfulQA | 83.1 | 80.2 | 2.9 | ERNIE 4.5 Pro |
| HellaSwag | 90.2 | 87.1 | 3.1 | ERNIE 4.5 Pro |
| MMMU | 78.4 | 76.6 | 1.8 | ERNIE 4.5 Pro |
| Arena Elo | 1414.3 | 1414.2 | 0.1 | ERNIE 4.5 Pro |
Price analysis
On a blended 3:1 input-to-output basis, ERNIE 4.5 Pro costs about $26.71 per million tokens and Mistral Large 3 Chat costs about $8.69. Mistral Large 3 Chat is roughly 67% cheaper than ERNIE 4.5 Pro. At high volume, that gap compounds quickly, so price should carry real weight unless the quality difference is decisive.
Both models list a 1,000,000-token context window. That is enough for long documents, large codebases and multi-step agent traces.
Verdict
Across 12 shared benchmarks, ERNIE 4.5 Pro wins 8, Mistral Large 3 Chat wins 4, and 0 are tied. On the index average, ERNIE 4.5 Pro leads Mistral Large 3 Chat by 1.4 points (80.5 versus 79.1).
The price picture favours Mistral Large 3 Chat. The context picture is effectively a tie. Those two dimensions often matter more than a few benchmark points once a model is good enough for the task.
If you need a single default, start with ERNIE 4.5 Pro for quality-sensitive work and Mistral Large 3 Chat for high-volume, well-scoped tasks. Run both on a sample of your own traffic before locking in a choice.
Choose ERNIE 4.5 Pro if
- You want the higher average benchmark score in this index.
Choose Mistral Large 3 Chat if
- Unit cost matters and you want the cheaper blended price.
- You need open weights for self-hosting or fine-tuning.
FAQ
Is ERNIE 4.5 Pro better than Mistral Large 3 Chat?
On the index average, ERNIE 4.5 Pro leads Mistral Large 3 Chat by 1.4 points (80.5 versus 79.1). The better choice depends on price, context and your task. ERNIE 4.5 Pro wins 8 benchmarks, Mistral Large 3 Chat wins 4.
Which is cheaper, ERNIE 4.5 Pro or Mistral Large 3 Chat?
Mistral Large 3 Chat is cheaper on a blended 3:1 basis at about $8.69 per million tokens, versus $26.71 for ERNIE 4.5 Pro.
Which has the larger context window?
Both models list a 1,000,000-token context window.
Are these models open weights?
ERNIE 4.5 Pro is proprietary; Mistral Large 3 Chat is open weights.
Which should I choose for production?
If you need a single default, start with ERNIE 4.5 Pro for quality-sensitive work and Mistral Large 3 Chat for high-volume, well-scoped tasks. Run both on a sample of your own traffic before locking in a choice.