Kimi K1.5 Chat vs Llama 4 Maverick Chat: which model should you choose?
We compared Kimi K1.5 Chat and Llama 4 Maverick Chat on price, context window and 12 benchmarks. Kimi K1.5 Chat has the stronger average benchmark score; Llama 4 Maverick Chat is cheaper on a blended 3:1 basis.
Kimi K1.5 Chat
Kimi K1.5 Chat is a multimodal model from Moonshot AI. It offers a 128,000-token context window, costs $5.11 per million input tokens and $26.59 per million output tokens, and averages 80.2 across the index's benchmark suite.
- Input
- $5.11 / 1M
- Output
- $26.59 / 1M
- Context
- 128,000
- Avg score
- 80.2
- Open weights
- Yes
Llama 4 Maverick Chat
Llama 4 Maverick Chat is a multimodal model from Meta AI. It offers a 128,000-token context window, costs $5.09 per million input tokens and $23.20 per million output tokens, and averages 79.7 across the index's benchmark suite.
- Input
- $5.09 / 1M
- Output
- $23.20 / 1M
- Context
- 128,000
- Avg score
- 79.7
- Open weights
- Yes
Specification comparison
| Spec | Kimi K1.5 Chat | Llama 4 Maverick Chat | Edge |
|---|---|---|---|
| Input price / 1M | $5.11 | $5.09 | B |
| Output price / 1M | $26.59 | $23.20 | B |
| Context window | 128,000 | 128,000 | Tie |
| Max output | 32,768 | 32,768 | Tie |
| Average score | 80.2 | 79.7 | A |
| Arena Elo | 1422.6 | 1419.9 | A |
| Open weights | Yes | Yes | Tie |
Benchmark comparison
Kimi K1.5 Chat wins 7, Llama 4 Maverick Chat wins 5, and 0 benchmarks are tied. The table shows the modelled score for each model and the gap.
| Benchmark | Kimi K1.5 Chat | Llama 4 Maverick Chat | Gap | Winner |
|---|---|---|---|---|
| MMLU-Pro | 81.3 | 80.5 | 0.8 | Kimi K1.5 Chat |
| GPQA Diamond | 78.1 | 73.0 | 5.1 | Kimi K1.5 Chat |
| SWE-bench Verified | 69.9 | 66.6 | 3.3 | Kimi K1.5 Chat |
| HumanEval | 84.3 | 83.2 | 1.1 | Kimi K1.5 Chat |
| MATH-500 | 81.7 | 84.8 | 3.1 | Llama 4 Maverick Chat |
| AIME 2025 | 81.4 | 78.9 | 2.5 | Kimi K1.5 Chat |
| LiveCodeBench | 75.7 | 76.3 | 0.6 | Llama 4 Maverick Chat |
| IFEval | 88.2 | 87.4 | 0.8 | Kimi K1.5 Chat |
| TruthfulQA | 80.3 | 81.5 | 1.2 | Llama 4 Maverick Chat |
| HellaSwag | 87.2 | 88.8 | 1.6 | Llama 4 Maverick Chat |
| MMMU | 73.6 | 75.4 | 1.8 | Llama 4 Maverick Chat |
| Arena Elo | 1422.6 | 1419.9 | 2.7 | Kimi K1.5 Chat |
Price analysis
On a blended 3:1 input-to-output basis, Kimi K1.5 Chat costs about $10.48 per million tokens and Llama 4 Maverick Chat costs about $9.62. Llama 4 Maverick Chat is roughly 8% cheaper than Kimi K1.5 Chat. At high volume, that gap compounds quickly, so price should carry real weight unless the quality difference is decisive.
Both models list a 128,000-token context window. That is enough for long documents, large codebases and multi-step agent traces.
Verdict
Across 12 shared benchmarks, Kimi K1.5 Chat wins 7, Llama 4 Maverick Chat wins 5, and 0 are tied. On the index average, Kimi K1.5 Chat leads Llama 4 Maverick Chat by 0.5 points (80.2 versus 79.7).
The price picture favours Llama 4 Maverick Chat. The context picture is effectively a tie. Those two dimensions often matter more than a few benchmark points once a model is good enough for the task.
If you need a single default, start with Kimi K1.5 Chat for quality-sensitive work and Llama 4 Maverick Chat for high-volume, well-scoped tasks. Run both on a sample of your own traffic before locking in a choice.
Choose Kimi K1.5 Chat if
- You want the higher average benchmark score in this index.
Choose Llama 4 Maverick Chat if
- Unit cost matters and you want the cheaper blended price.
FAQ
Is Kimi K1.5 Chat better than Llama 4 Maverick Chat?
On the index average, Kimi K1.5 Chat leads Llama 4 Maverick Chat by 0.5 points (80.2 versus 79.7). The better choice depends on price, context and your task. Kimi K1.5 Chat wins 7 benchmarks, Llama 4 Maverick Chat wins 5.
Which is cheaper, Kimi K1.5 Chat or Llama 4 Maverick Chat?
Llama 4 Maverick Chat is cheaper on a blended 3:1 basis at about $9.62 per million tokens, versus $10.48 for Kimi K1.5 Chat.
Which has the larger context window?
Both models list a 128,000-token context window.
Are these models open weights?
Kimi K1.5 Chat is open weights; Llama 4 Maverick Chat is open weights.
Which should I choose for production?
If you need a single default, start with Kimi K1.5 Chat for quality-sensitive work and Llama 4 Maverick Chat for high-volume, well-scoped tasks. Run both on a sample of your own traffic before locking in a choice.