Allen Institute for AI · small open-weight · Released 2025-06-27

OLMo 2 1.5B: pricing, context window and benchmarks

OLMo 2 1.5B is a small open-weight model from Allen Institute for AI. It offers a 16,384-token context window, costs $0.28 per million input tokens and $1.41 per million output tokens, and averages 44.0 across the index's benchmark suite.

budgetopen weightssmall
Input price
$0.28
per 1M tokens
Output price
$1.41
per 1M tokens
Context
16,384
tokens
Avg score
44.0
rank #585 of 600
Arena Elo
1142.8
modelled
Max output
16,384
tokens

Pricing

OLMo 2 1.5B costs $0.28 per million input tokens and $1.41 per million output tokens. A blended 3:1 input-to-output mix works out to about $0.56 per million tokens. Cached input is listed at $0.04 per million tokens.

ItemPriceNotes
Input$0.28per 1M tokens
Output$1.41per 1M tokens
Cached input$0.04per 1M tokens
Blended 3:1$0.56estimate per 1M tokens
1M in + 1M out$1.69estimate

Benchmarks

Scores below are modelled estimates on a 0–100 scale. Use them to compare relative position, not as official vendor results.

BenchmarkScoreRankPercentileRelative
MMLU-Pro 51.2 588 2th
GPQA Diamond 40.7 582 3th
SWE-bench Verified 26.3 592 1th
HumanEval 48.3 584 3th
MATH-500 41.9 591 2th
AIME 2025 29.2 585 3th
LiveCodeBench 29.4 584 3th
IFEval 55.4 591 2th
TruthfulQA 50.5 590 2th
HellaSwag 64.3 588 2th
MMMU 46.4 577 4th
Arena Elo 1142.8 586 2th

What OLMo 2 1.5B is good for

OLMo 2 1.5B is a small model. That makes it a good fit for classification, extraction, routing, summarization and other high-volume jobs where latency and cost dominate. It is not the right pick for open-ended frontier reasoning, but at $0.28 per million input tokens it can handle a large share of production traffic.

Strengths

  • Input price of $0.28 per million tokens is at or below the index median.
  • Open weights make self-hosting, fine-tuning and data-residency review possible.

Trade-offs

  • Context window of 16,384 tokens is small for long-document work.
  • Average benchmark score is below the index median; test it on your own task.
  • Less reliable on open-ended reasoning and complex multi-step instructions.

How it compares

ModelProviderContextInput / 1MAvg score
Phi-3.5 1.5B Microsoft 32768 $0.25 44.5
SmolLM3 7B Hugging Face 16384 $0.19 44.3
StableLM 2 7B Stability AI 8192 $0.28 44.3
OLMo 2 1.5B Allen Institute for AI 16384 $0.28 44.0
SmolLM3 8B Hugging Face 32768 $0.21 44.0
GPT-NeoX 8B EleutherAI 16384 $0.25 43.7

Browse all comparisons →

FAQ

How much does OLMo 2 1.5B cost?

OLMo 2 1.5B is listed at $0.28 per million input tokens and $1.41 per million output tokens. Cached input is $0.042 per million tokens. A blended 3:1 input-to-output mix is about $0.56 per million tokens.

What is the context window of OLMo 2 1.5B?

OLMo 2 1.5B has a context window of 16,384 tokens and can emit up to 16,384 output tokens per request in this index.

Is OLMo 2 1.5B open weights?

Yes. OLMo 2 1.5B is listed as an open-weight model under a open weights licence.

How does OLMo 2 1.5B score on benchmarks?

OLMo 2 1.5B averages 44.0 across the scored benchmarks in this index, ranking #585 of 600 models. Its strongest relative result is Arena Elo at 1142.8.

What is OLMo 2 1.5B best for?

OLMo 2 1.5B is a small model. That makes it a good fit for classification, extraction, routing, summarization and other high-volume jobs where latency and cost dominate. It is not the right pick for open-ended frontier reasoning, but at $0.28 per million input tokens it can handle a large share of production traffic.

Related