Coding benchmark

LiveCodeBench: leaderboard, scores and methodology

Contamination-free coding problems collected from recent contests.

Top score
85.1
Claude Sonnet 4.5 Reasoning
Average
61.0
all models
Models tested
600
in this index
Score range
0–100
observed
Category
Coding
Source type
https://example.org/benchmarks/livecodebench
modelled

Top 10

Bars are scaled to the highest observed score. The leader sets the pace; the spread below it shows how much separation exists in this benchmark.

Claude Sonnet 4.5 Reasoning 85.1
Grok 4 Reasoning 85.1
Claude Opus 4.5 85.0
GPT-5.2 Max 84.8
Grok 4 Turbo 84.7
GPT-5.1 Turbo 84.6
GPT-5.2 Pro 84.6
GPT-5.2 Reasoning 84.6
Claude Opus 4.5 Pro 84.1
Gemini 3 Pro Max 83.6

Leaderboard

#ModelProviderContextInput / 1MAvg score
1 Claude Sonnet 4.5 Reasoning Anthropic 400000 $19.48 87.7
2 Grok 4 Reasoning xAI 2000000 $19.67 87.8
3 Claude Opus 4.5 Anthropic 400000 $19.42 87.7
4 GPT-5.2 Max OpenAI 1000000 $21.39 89.2
5 Grok 4 Turbo xAI 1000000 $19.21 86.7
6 GPT-5.1 Turbo OpenAI 2000000 $19.19 86.1
7 GPT-5.2 Pro OpenAI 2000000 $21.32 89.6
8 GPT-5.2 Reasoning OpenAI 1000000 $20.98 87.5
9 Claude Opus 4.5 Pro Anthropic 200000 $20.98 89.1
10 Gemini 3 Pro Max Google DeepMind 2000000 $20.57 87.9
11 GPT-5.2 Vision OpenAI 1000000 $19.03 87.4
12 o4 Reasoning OpenAI 1000000 $19.69 87.5
13 Gemini 3 Pro Google DeepMind 2000000 $18.24 86.1
14 Gemini 3 Pro Pro Google DeepMind 200000 $19.80 87.3
15 Claude Sonnet 4.5 Max Anthropic 1000000 $19.90 87.2
16 Qwen3-Max Max Alibaba Cloud 400000 $18.53 85.9
17 Gemini 3 Pro Turbo Google DeepMind 400000 $19.62 86.4
18 o3 Reasoning OpenAI 200000 $18.07 85.3
19 Claude Sonnet 4.5 Anthropic 400000 $17.84 86.0
20 GPT-5.2 Turbo OpenAI 1000000 $20.73 87.4
21 o3 Pro OpenAI 400000 $17.89 85.8
22 GPT-5.1 Pro OpenAI 200000 $19.77 87.8
23 Grok 4 xAI 200000 $17.90 86.5
24 Qwen3-Max Alibaba Cloud 400000 $17.37 84.4
25 Gemini 3 Pro Reasoning Google DeepMind 200000 $19.69 87.5
26 Claude Sonnet 4.5 Pro Anthropic 1000000 $18.73 86.7
27 Claude Opus 4.5 Reasoning Anthropic 2000000 $20.91 88.2
28 o4 Pro OpenAI 1000000 $19.37 87.3
29 o4 OpenAI 2000000 $17.74 85.4
30 Grok 4 Max xAI 2000000 $19.70 86.6
31 o4 Vision OpenAI 200000 $17.01 84.5
32 Qwen3-Max Pro Alibaba Cloud 400000 $18.87 86.2
33 GPT-5.1 Reasoning OpenAI 400000 $20.27 88.3
34 Grok 3 Pro xAI 400000 $16.61 83.8
35 o3 OpenAI 400000 $16.80 84.5
36 o3 Turbo OpenAI 200000 $16.63 83.4
37 Claude Opus 4.5 Max Anthropic 1000000 $20.90 87.8
38 o4 Max OpenAI 2000000 $19.51 86.2
39 GPT-4.1 Reasoning OpenAI 1000000 $16.97 83.8
40 DeepSeek-V3.2 DeepSeek 1000000 $5.88 84.0
41 GPT-5.1 Max OpenAI 2000000 $20.50 87.9
42 Gemini 3 Flash Pro Google DeepMind 400000 $17.71 84.8
43 Claude Opus 4.5 Vision Anthropic 200000 $17.70 85.9
44 o4 Turbo OpenAI 2000000 $19.34 86.6
45 Gemini 2.5 Pro Max Google DeepMind 200000 $16.94 84.8
46 GPT-5.2 OpenAI 2000000 $19.71 88.0
47 Grok 3 Max xAI 2000000 $17.66 85.9
48 Claude 3.7 Sonnet Reasoning Anthropic 128000 $16.30 83.7
49 DeepSeek-R1 Instruct DeepSeek 1000000 $5.90 83.1
50 DeepSeek-R1 Chat DeepSeek 400000 $5.62 82.4

Methodology

LiveCodeBench is included as a coding benchmark with a typical score range of 0 to 100. The values in this index are deterministic modelled estimates generated for comparison at scale. They are not official leaderboard results and should not be quoted as vendor benchmarks.

Each model receives a score derived from its capability tier, release generation and benchmark difficulty. Scores are normalised to a 0–100 scale so that models from different providers can be placed side by side. The average shown is the arithmetic mean across all 600 scored models.

Read the leaderboard as a relative map. A five-point gap is meaningful at the top and less meaningful in the middle of the distribution. Pair the score with price and context data before choosing a model.

How to use this leaderboard

  • Use the top 10 to shortlist candidates, not to declare a winner.
  • Check whether the leader is open weights or proprietary before assuming you can deploy it.
  • Compare the score against input and output price on each model page.
  • Look at the model's scores on related benchmarks before trusting a single number.

FAQ

What is LiveCodeBench?

Contamination-free coding problems collected from recent contests.

Who leads LiveCodeBench?

Claude Sonnet 4.5 Reasoning from Anthropic leads this index with a score of 85.1, followed by Grok 4 Reasoning at 85.1.

What is a good LiveCodeBench score?

The top quartile starts around 71.8. The index average is 61.0, so a score above 71.8 is a strong result relative to this dataset.

How are LiveCodeBench scores calculated?

The values are modelled estimates on a 0–100 scale, generated from capability tier, release generation and benchmark difficulty. They are not official leaderboard results.

Which models are included?

All 600 models in the index are scored on LiveCodeBench, across 40 providers and every model category.

Related benchmarks