Llama 3.1 Turbo 8B: pricing, context window and benchmarks
Llama 3.1 Turbo 8B is a small open-weight model from Together AI. It offers a 32,768-token context window, costs $1.16 per million input tokens and $5.48 per million output tokens, and averages 58.8 across the index's benchmark suite.
Pricing
Llama 3.1 Turbo 8B costs $1.16 per million input tokens and $5.48 per million output tokens. A blended 3:1 input-to-output mix works out to about $2.24 per million tokens. Cached input is listed at $0.17 per million tokens.
| Item | Price | Notes |
|---|---|---|
| Input | $1.16 | per 1M tokens |
| Output | $5.48 | per 1M tokens |
| Cached input | $0.17 | per 1M tokens |
| Blended 3:1 | $2.24 | estimate per 1M tokens |
| 1M in + 1M out | $6.64 | estimate |
Benchmarks
Scores below are modelled estimates on a 0–100 scale. Use them to compare relative position, not as official vendor results.
| Benchmark | Score | Rank | Percentile | Relative |
|---|---|---|---|---|
| MMLU-Pro | 63.7 | 479 | 20th | |
| GPQA Diamond | 56.8 | 443 | 26th | |
| SWE-bench Verified | 45.1 | 465 | 23th | |
| HumanEval | 61.4 | 476 | 21th | |
| MATH-500 | 58.7 | 482 | 20th | |
| AIME 2025 | 44.6 | 502 | 16th | |
| LiveCodeBench | 50.5 | 442 | 26th | |
| IFEval | 68.0 | 488 | 19th | |
| TruthfulQA | 65.3 | 456 | 24th | |
| HellaSwag | 74.0 | 456 | 24th | |
| MMMU | 58.3 | 452 | 25th | |
| Arena Elo | 1272.1 | 454 | 24th |
What Llama 3.1 Turbo 8B is good for
Llama 3.1 Turbo 8B is a small model. That makes it a good fit for classification, extraction, routing, summarization and other high-volume jobs where latency and cost dominate. It is not the right pick for open-ended frontier reasoning, but at $1.16 per million input tokens it can handle a large share of production traffic.
Strengths
- Input price of $1.16 per million tokens is at or below the index median.
- Open weights make self-hosting, fine-tuning and data-residency review possible.
Trade-offs
- Average benchmark score is below the index median; test it on your own task.
- Less reliable on open-ended reasoning and complex multi-step instructions.
How it compares
| Model | Provider | Context | Input / 1M | Avg score |
|---|---|---|---|---|
| Codestral 8B | Mistral AI | 4096 | $1.18 | 59.0 |
| Magistral 7B | Mistral AI | 32768 | $1.22 | 58.9 |
| Llama 3.1 Turbo 8B | Together AI | 32768 | $1.16 | 58.8 |
| DeepSeek-Coder 8B | DeepSeek | 32768 | $1.26 | 58.7 |
| Hunyuan-Large 8B | Tencent | 4096 | $1.29 | 58.7 |
| Llama 3.1 8B | Meta AI | 8192 | $1.15 | 58.7 |
FAQ
How much does Llama 3.1 Turbo 8B cost?
Llama 3.1 Turbo 8B is listed at $1.16 per million input tokens and $5.48 per million output tokens. Cached input is $0.17 per million tokens. A blended 3:1 input-to-output mix is about $2.24 per million tokens.
What is the context window of Llama 3.1 Turbo 8B?
Llama 3.1 Turbo 8B has a context window of 32,768 tokens and can emit up to 32,768 output tokens per request in this index.
Is Llama 3.1 Turbo 8B open weights?
Yes. Llama 3.1 Turbo 8B is listed as an open-weight model under a open weights licence.
How does Llama 3.1 Turbo 8B score on benchmarks?
Llama 3.1 Turbo 8B averages 58.8 across the scored benchmarks in this index, ranking #467 of 600 models. Its strongest relative result is Arena Elo at 1272.1.
What is Llama 3.1 Turbo 8B best for?
Llama 3.1 Turbo 8B is a small model. That makes it a good fit for classification, extraction, routing, summarization and other high-volume jobs where latency and cost dominate. It is not the right pick for open-ended frontier reasoning, but at $1.16 per million input tokens it can handle a large share of production traffic.