Groq API: models, pricing and limits
A practical guide to groq, using data from the AI & LLM Index. The goal is a shortlist and a decision, not a tour of every option.
The Groq lineup
Groq has 14 models in the index. Inference company building LPU accelerators. The lineup spans 3 categories, from multimodal to small open-weight.
The strongest model by average score is llama-3-3-groq. The cheapest by input price is Mixtral Groq 1.5B.
Pricing
Across the lineup, the average input price is $2.30 per million tokens and the average output price is $10.23. That average hides a wide range: individual models run from $0.34 to $4.08 on input.
Use the average as a starting point, then check the specific model you plan to deploy. Output price and cached input pricing can change the ranking for long or repetitive workloads.
Strengths and limits
14 of the 14 models are open weights. That gives you a self-hosting path for part of the lineup, while the proprietary models remain API-only.
The best benchmark result in the lineup is 76.8 on the index average. Compare that with the best model from other providers before treating Groq as the default.
How to choose
- Start with the task, not the brand.
- Pick the cheapest model that clears your evaluation set.
- Keep a second provider as a fallback for outages and price changes.
- Check licence and data-handling terms for every model you shortlist.
Groq models at a glance
| Model | Input / 1M | Context | Avg score |
|---|---|---|---|
| Llama 3.3 Groq | $3.98 | 32,768 | 76.8 |
| Llama 3.3 Groq Chat | $4.06 | 32,768 | 76.8 |
| Llama 3.3 Groq Instruct | $4.08 | 65,536 | 76.7 |
| Llama 3.3 Groq Base | $3.24 | 16,384 | 73.5 |
| Mixtral Groq | $3.37 | 16,384 | 73.1 |
| Mixtral Groq Instruct | $3.25 | 16,384 | 72.5 |
| Mixtral Groq Chat | $3.09 | 8,192 | 72.0 |
| Mixtral Groq Base | $2.66 | 32,768 | 68.4 |
| Llama 3.3 Groq 8B | $1.17 | 16,384 | 59.5 |
| Llama 3.3 Groq 7B | $1.01 | 16,384 | 56.7 |
Related
FAQ
Which Groq model should I start with?
Start with llama-3-3-groq for quality-sensitive work and Mixtral Groq 1.5B for high-volume tasks.
What is the most important factor in groq?
Fit to the task beats raw benchmark rank. Define the failure modes, pick the benchmarks that resemble them, then test a small shortlist on your own examples.
How many models should I evaluate?
Three is usually enough: a quality candidate, a value candidate and a fallback. More candidates add work without changing the decision.
How do I control cost?
Compare blended 3:1 price, watch output tokens, use caching where available and route simple requests to a cheaper model.