Groq On-Demand API

LLM 5.6/10

Llama 3.1 8B $0.05/$0.08; GPT-OSS $0.075/$0.30; Llama 3.3 70B $0.59/$0.79 per 1M. LPU ultra-fast inference

Groq On-Demand API scores 5.6/10 for free value in LLM. The main constraint: Paid — Pay-as-you-go, from $0.05/M input. Llama 3.1 8B $0.05/$0.08; GPT-OSS $0.075/$0.30; Llama 3.3 70B $0.59/$0.79 per 1M. LPU ultra-fast inference.

Category LLM Kind Paid plan

Free value score

5.6 / 10

Show the math

Model Quality 4.3/10

value = 24 artificial_analysis_score

weighted score = 0.2 * 4.3/10

Access 10/10

value = 10/10

weighted score = 0.1 * 10/10

Price Efficiency 5.4/10

value = 1562500 tok/$

weighted score = 0.7 * 5.4/10

Key metrics

GPT-OSS 120B 24 Best model

$0.64/M Price

What you get

Paid — Pay-as-you-go, from $0.05/M input. Llama 3.1 8B $0.05/$0.08; GPT-OSS $0.075/$0.30; Llama 3.3 70B $0.59/$0.79 per 1M. LPU ultra-fast inference

13.3M input tokens per $1 on GPT-OSS; up to 20M input tokens/$1 on 8B — fastest cheap inference

Gotchas

No gotchas documented yet. Contribute one if you know a constraint we missed.

Sources

"Input Token Price(Per Million Tokens). $0.075(13.3M / $1)* Output Token Price(Per Million Tokens). $0.30(3.33M / $1)*"
https://groq.com/pricing
"the flagship Llama 3.3 70B Versatile is $0.59 input / ... per 1M"
https://www.aipricing.guru/groq-pricing/
"GPT-OSS 120B is present in the refreshed BenchLM Artificial Analysis table with score 23.8."
https://benchlm.ai/benchmarks/artificialAnalysis

paid value llm-providers

Open service ← All LLM

Alternatives

Same category · similar quota

DeepInfra APIDeepInfra API · paid · Paid plan

5.7

Open models per-token: Llama 3.2 3B $0.02/M, Llama 8B $0.06/M, Qwen 2.5 72B $0.23/M, DeepSeek V3.1 $0.30/$1.00 per M tokens, gpt-oss-120b $0.09/$0.45 per M tokens, Qwen3-Coder $0.30/$1.20 per M tokens

2.1M/$21.1 AA2.1M/$

May be outdatedChecked 26d ago

Paid onlyMetered

Command Code Provider APICommand Code Provider API · paid · Paid plan

5.4

Raw OpenAI- + Anthropic-compatible API ('no lock-in — any client or agent') with GLM-5.2 + GLM-5.2 Fast (1M ctx), Kimi K2.7 Code + HighSpeed, DeepSeek V4 Pro (75% off), MiMo V2.5 (98% off), plus Claude/GPT/Gemini at list; $15 usage included, then pay-as-you-go with permanent discounts

207.8K/$51.1 AA207.8K/$

May be outdatedChecked 23d ago

Paid onlyMetered

OpenCode ZenOpenCode Zen · paid · Paid plan

5.2

Curated coding-optimized models at transparent per-token pricing; add $20 balance, auto-top-up, use any tested model (GPT-5 $1.07/$8.50 per 1M)

341.6K/$36.1 AA341.6K/$

May be outdatedChecked 26d ago

Paid only