Together AI · multimodal · Released 2024-06-12

Llama 3.1 Turbo Chat: pricing, context window and benchmarks

Llama 3.1 Turbo Chat is a multimodal model from Together AI. It offers a 200,000-token context window, costs $3.95 per million input tokens and $20.39 per million output tokens, and averages 76.1 across the index's benchmark suite.

visionlong contextopen weightsmultimodal
Input price
$3.95
per 1M tokens
Output price
$20.39
per 1M tokens
Context
200,000
tokens
Avg score
76.1
rank #219 of 600
Arena Elo
1404.5
modelled
Max output
32,768
tokens

Pricing

Llama 3.1 Turbo Chat costs $3.95 per million input tokens and $20.39 per million output tokens. A blended 3:1 input-to-output mix works out to about $8.06 per million tokens. Cached input is listed at $0.55 per million tokens.

ItemPriceNotes
Input$3.95per 1M tokens
Output$20.39per 1M tokens
Cached input$0.55per 1M tokens
Blended 3:1$8.06estimate per 1M tokens
1M in + 1M out$24.34estimate

Benchmarks

Scores below are modelled estimates on a 0–100 scale. Use them to compare relative position, not as official vendor results.

BenchmarkScoreRankPercentileRelative
MMLU-Pro 80.8 155 74th
GPQA Diamond 73.6 182 70th
SWE-bench Verified 64.2 230 62th
HumanEval 80.9 216 64th
MATH-500 81.5 176 71th
AIME 2025 73.0 202 66th
LiveCodeBench 69.9 194 68th
IFEval 83.0 243 60th
TruthfulQA 76.0 307 49th
HellaSwag 83.7 294 51th
MMMU 70.9 275 54th
Arena Elo 1404.5 195 68th

What Llama 3.1 Turbo Chat is good for

Llama 3.1 Turbo Chat is an open-weight model, so it can be self-hosted or run through a third-party inference provider. That matters for data residency, fine-tuning and long-run cost control. At $3.95 per million input tokens (hosted list price) and a 200,000-token context window, it is a practical option for teams that want more control than a closed API allows.

Strengths

  • Large 200,000-token context window for long documents and agent traces.
  • Input price of $3.95 per million tokens is at or below the index median.
  • Open weights make self-hosting, fine-tuning and data-residency review possible.
  • Accepts more than text, including image input where the provider supports it.

Trade-offs

  • No standout weakness in the indexed specifications, but real-world behaviour still needs testing.

How it compares

ModelProviderContextInput / 1MAvg score
Llama 3.1 Cerebras Instruct Cerebras 65536 $4.11 76.1
Llama 3.1 Turbo Chat Together AI 200000 $3.95 76.1
Gemini 3 Flash Mini Google DeepMind 200000 $10.71 76.0
Llama 3.1 Cerebras Cerebras 128000 $4.01 76.0
Seed-OSS Instruct ByteDance 128000 $3.79 76.0
Sonar Perplexity 200000 $10.57 76.0

Browse all comparisons →

FAQ

How much does Llama 3.1 Turbo Chat cost?

Llama 3.1 Turbo Chat is listed at $3.95 per million input tokens and $20.39 per million output tokens. Cached input is $0.55 per million tokens. A blended 3:1 input-to-output mix is about $8.06 per million tokens.

What is the context window of Llama 3.1 Turbo Chat?

Llama 3.1 Turbo Chat has a context window of 200,000 tokens and can emit up to 32,768 output tokens per request in this index.

Is Llama 3.1 Turbo Chat open weights?

Yes. Llama 3.1 Turbo Chat is listed as an open-weight model under a open weights licence.

How does Llama 3.1 Turbo Chat score on benchmarks?

Llama 3.1 Turbo Chat averages 76.1 across the scored benchmarks in this index, ranking #219 of 600 models. Its strongest relative result is Arena Elo at 1404.5.

What is Llama 3.1 Turbo Chat best for?

Llama 3.1 Turbo Chat is an open-weight model, so it can be self-hosted or run through a third-party inference provider. That matters for data residency, fine-tuning and long-run cost control. At $3.95 per million input tokens (hosted list price) and a 200,000-token context window, it is a practical option for teams that want more control than a closed API allows.

Related