o4: pricing, context window and benchmarks
o4 is a frontier model from OpenAI. It offers a 2,000,000-token context window, costs $17.74 per million input tokens and $66.00 per million output tokens, and averages 85.4 across the index's benchmark suite.
Pricing
o4 costs $17.74 per million input tokens and $66.00 per million output tokens. A blended 3:1 input-to-output mix works out to about $29.80 per million tokens. Cached input is listed at $1.66 per million tokens.
| Item | Price | Notes |
|---|---|---|
| Input | $17.74 | per 1M tokens |
| Output | $66.00 | per 1M tokens |
| Cached input | $1.66 | per 1M tokens |
| Blended 3:1 | $29.80 | estimate per 1M tokens |
| 1M in + 1M out | $83.74 | estimate |
Benchmarks
Scores below are modelled estimates on a 0–100 scale. Use them to compare relative position, not as official vendor results.
| Benchmark | Score | Rank | Percentile | Relative |
|---|---|---|---|---|
| MMLU-Pro | 85.3 | 59 | 90th | |
| GPQA Diamond | 82.3 | 27 | 96th | |
| SWE-bench Verified | 74.8 | 43 | 93th | |
| HumanEval | 89.6 | 56 | 91th | |
| MATH-500 | 90.5 | 44 | 93th | |
| AIME 2025 | 85.3 | 36 | 94th | |
| LiveCodeBench | 81.4 | 29 | 95th | |
| IFEval | 92.8 | 23 | 96th | |
| TruthfulQA | 85.0 | 65 | 89th | |
| HellaSwag | 91.0 | 63 | 90th | |
| MMMU | 80.9 | 45 | 93th | |
| Arena Elo | 1469.4 | 33 | 95th |
What o4 is good for
o4 sits in the frontier tier of the index. It is aimed at work where answer quality matters more than unit cost: hard reasoning, multi-step coding, document analysis and multimodal inputs. At $17.74 per million input tokens and a 2,000,000-token context window, it is a premium option, so reserve it for tasks where a cheaper model measurably fails.
Strengths
- Top-tier average benchmark score (85.4), placing it #43 of 600.
- Large 2,000,000-token context window for long documents and agent traces.
- Accepts more than text, including image input where the provider supports it.
- Reasoning-oriented profile, useful for multi-step problems and structured analysis.
- Coding benchmarks are a relative strength within its tier.
Trade-offs
- Proprietary licence: you cannot download the weights or self-host the model.
- Premium input pricing at $17.74 per million tokens.
- Cost can climb quickly on long outputs and high-volume traffic.
How it compares
| Model | Provider | Context | Input / 1M | Avg score |
|---|---|---|---|---|
| Claude Opus 4.5 Turbo | Anthropic | 2000000 | $19.57 | 85.7 |
| Gemini 3 Pro Vision | Google DeepMind | 200000 | $17.59 | 85.5 |
| Grok 4 Pro | xAI | 1000000 | $19.00 | 85.4 |
| o4 | OpenAI | 2000000 | $17.74 | 85.4 |
| o3 Reasoning | OpenAI | 200000 | $18.07 | 85.3 |
| GPT-4.1 Pro | OpenAI | 400000 | $17.56 | 85.2 |
FAQ
How much does o4 cost?
o4 is listed at $17.74 per million input tokens and $66.00 per million output tokens. Cached input is $1.66 per million tokens. A blended 3:1 input-to-output mix is about $29.80 per million tokens.
What is the context window of o4?
o4 has a context window of 2,000,000 tokens and can emit up to 8,192 output tokens per request in this index.
Is o4 open weights?
No. o4 is a proprietary model with a proprietary licence, so you cannot download the weights.
How does o4 score on benchmarks?
o4 averages 85.4 across the scored benchmarks in this index, ranking #43 of 600 models. Its strongest relative result is Arena Elo at 1469.4.
What is o4 best for?
o4 sits in the frontier tier of the index. It is aimed at work where answer quality matters more than unit cost: hard reasoning, multi-step coding, document analysis and multimodal inputs. At $17.74 per million input tokens and a 2,000,000-token context window, it is a premium option, so reserve it for tasks where a cheaper model measurably fails.