Provider · Founded 2019 · San Francisco, USA

Baseten: models, pricing and benchmarks

Model inference and deployment platform.

Models

in this index

Avg input

$2.36

per 1M tokens

Avg output

$10.92

per 1M tokens

Open weights

models

Best model

llama-3-baseten-instruct

by average score

Website

Visit

https://baseten.co

All Baseten models

Sorted by average benchmark score. Prices are per million tokens and context is measured in tokens.

#	Model	Provider	Context	Input / 1M	Avg score
1	Llama 3 Baseten Instruct	Baseten	200000	$3.91	76.2
2	Llama 3 Baseten	Baseten	128000	$3.62	74.9
3	Llama 3 Baseten Chat	Baseten	200000	$3.55	73.2
4	Llama 3 Baseten Base	Baseten	16384	$3.16	72.4
5	Llama 3 Baseten 8B	Baseten	4096	$1.02	57.0
6	Llama 3 Baseten 7B	Baseten	32768	$0.87	55.3
7	Llama 3 Baseten 1.5B	Baseten	4096	$0.42	48.2

Best Baseten models

multimodal

Llama 3 Baseten Instruct

Llama 3 Baseten Instruct is a multimodal model from Baseten. It offers a 200,000-token context window, costs $3.91 per million input tokens and $20.18 per million output tokens, and averages 76.2 across the index's benchmark suite.

$3.91 in · 200,000 context · 76.2 avg multimodal

Llama 3 Baseten

Llama 3 Baseten is a multimodal model from Baseten. It offers a 128,000-token context window, costs $3.62 per million input tokens and $14.04 per million output tokens, and averages 74.9 across the index's benchmark suite.

$3.62 in · 128,000 context · 74.9 avg multimodal

Llama 3 Baseten Chat

Llama 3 Baseten Chat is a multimodal model from Baseten. It offers a 200,000-token context window, costs $3.55 per million input tokens and $16.64 per million output tokens, and averages 73.2 across the index's benchmark suite.

$3.55 in · 200,000 context · 73.2 avg open-weight

Llama 3 Baseten Base

Llama 3 Baseten Base is a open-weight model from Baseten. It offers a 16,384-token context window, costs $3.16 per million input tokens and $13.67 per million output tokens, and averages 72.4 across the index's benchmark suite.

$3.16 in · 16,384 context · 72.4 avg small open-weight

Llama 3 Baseten 8B

Llama 3 Baseten 8B is a small open-weight model from Baseten. It offers a 4,096-token context window, costs $1.02 per million input tokens and $5.38 per million output tokens, and averages 57.0 across the index's benchmark suite.

$1.02 in · 4,096 context · 57.0 avg

How Baseten fits

Baseten has 7 models in the index, of which 7 are open weights. The average input price across the lineup is $2.36 per million tokens, and the average output price is $10.92 per million tokens. The strongest model by average benchmark score is llama-3-baseten-instruct.

Use the table above to compare individual models, or open a model page for its full benchmark breakdown. If you are choosing between providers, start with the comparison pages and then check context limits and licence terms.

FAQ

How many Baseten models are in the index?

Baseten has 7 models in this index, of which 7 are open weights.

What is the cheapest Baseten model?

Llama 3 Baseten 1.5B is the cheapest Baseten model by input price at $0.42 per million tokens.

What is the best Baseten model?

Llama 3 Baseten Instruct has the highest average benchmark score in the Baseten lineup at 76.2.

Are Baseten models open weights?

7 of the 7 Baseten models in this index are open weights. The rest are proprietary.

Where is Baseten based?

Baseten was founded in 2019 and is headquartered in San Francisco, USA.