NVIDIA · small open-weight · Released 2023-03-05

Nemotron Nano 8B: pricing, context window and benchmarks

Nemotron Nano 8B is a small open-weight model from NVIDIA. It offers a 8,192-token context window, costs $0.46 per million input tokens and $1.64 per million output tokens, and averages 48.1 across the index's benchmark suite.

budgetopen weightssmall
Input price
$0.46
per 1M tokens
Output price
$1.64
per 1M tokens
Context
8,192
tokens
Avg score
48.1
rank #573 of 600
Arena Elo
1192.6
modelled
Max output
8,192
tokens

Pricing

Nemotron Nano 8B costs $0.46 per million input tokens and $1.64 per million output tokens. A blended 3:1 input-to-output mix works out to about $0.76 per million tokens. Cached input is listed at $0.04 per million tokens.

ItemPriceNotes
Input$0.46per 1M tokens
Output$1.64per 1M tokens
Cached input$0.04per 1M tokens
Blended 3:1$0.76estimate per 1M tokens
1M in + 1M out$2.10estimate

Benchmarks

Scores below are modelled estimates on a 0–100 scale. Use them to compare relative position, not as official vendor results.

BenchmarkScoreRankPercentileRelative
MMLU-Pro 53.5 580 3th
GPQA Diamond 41.5 581 3th
SWE-bench Verified 31.1 575 4th
HumanEval 51.2 565 6th
MATH-500 50.2 554 8th
AIME 2025 35.2 567 6th
LiveCodeBench 37.0 556 7th
IFEval 58.7 580 3th
TruthfulQA 55.7 569 5th
HellaSwag 68.7 551 8th
MMMU 46.2 579 4th
Arena Elo 1192.6 563 6th

What Nemotron Nano 8B is good for

Nemotron Nano 8B is a small model. That makes it a good fit for classification, extraction, routing, summarization and other high-volume jobs where latency and cost dominate. It is not the right pick for open-ended frontier reasoning, but at $0.46 per million input tokens it can handle a large share of production traffic.

Strengths

  • Input price of $0.46 per million tokens is at or below the index median.
  • Open weights make self-hosting, fine-tuning and data-residency review possible.

Trade-offs

  • Context window of 8,192 tokens is small for long-document work.
  • Average benchmark score is below the index median; test it on your own task.
  • Less reliable on open-ended reasoning and complex multi-step instructions.

How it compares

ModelProviderContextInput / 1MAvg score
Llama 3 Hyperbolic 1.5B Hyperbolic 32768 $0.45 48.4
Llama 3 Lambda 1.5B Lambda 16384 $0.46 48.4
Llama 3 Baseten 1.5B Baseten 4096 $0.42 48.2
Nemotron Nano 8B NVIDIA 8192 $0.46 48.1
Phi-4 1.5B Microsoft 8192 $0.42 48.1
Mixtral 1.5B Mistral AI 16384 $0.36 47.7

Browse all comparisons →

FAQ

How much does Nemotron Nano 8B cost?

Nemotron Nano 8B is listed at $0.46 per million input tokens and $1.64 per million output tokens. Cached input is $0.042 per million tokens. A blended 3:1 input-to-output mix is about $0.76 per million tokens.

What is the context window of Nemotron Nano 8B?

Nemotron Nano 8B has a context window of 8,192 tokens and can emit up to 8,192 output tokens per request in this index.

Is Nemotron Nano 8B open weights?

Yes. Nemotron Nano 8B is listed as an open-weight model under a open weights licence.

How does Nemotron Nano 8B score on benchmarks?

Nemotron Nano 8B averages 48.1 across the scored benchmarks in this index, ranking #573 of 600 models. Its strongest relative result is Arena Elo at 1192.6.

What is Nemotron Nano 8B best for?

Nemotron Nano 8B is a small model. That makes it a good fit for classification, extraction, routing, summarization and other high-volume jobs where latency and cost dominate. It is not the right pick for open-ended frontier reasoning, but at $0.46 per million input tokens it can handle a large share of production traffic.

Related