GroqCloud logo

GroqCloud

LLM 5.3/10 Jun 15, 2026

Very fast hosted inference for open models, with free account-level limits.

Requests / day
14.4K
Requests / min
30
Tokens / min
6K

GroqCloud scores 5.3/10 for free value in LLM. The main constraint: Free plan limits are shown per organization/model in Groq Console; measured as RPM/RPD/TPM/TPD.

Category LLM Kind Fast inference Caveats Exact current limits are account/model-specific; read response headers and console limits. Renewal daily Card required No Eligibility anyone

Free value score

5.3 / 10
Show the math
Model Quality 4.3/10
value = 24 artificial_analysis_score
weighted score = 0.33 * 4.3/10
Throughput 2.6/10
value = 6000 tok/min
weighted score = 0.17 * 2.6/10
Request Rate 4/10
value = 30 req/min
weighted score = 0.17 * 4/10
Requests 6.3/10
value = 432000 req/mo
weighted score = 0.17 * 6.3/10
Access 10/10
value = 10/10
weighted score = 0.17 * 10/10

Key metrics

openai/gpt-oss-120b 24 Best model
6.0K T/min Tokens/min
14K R/day Requests/day
30 R/min Requests/min
Yes Commercial use

Models

16 free · 19 total

Limits may be stale — last re-verified outside this section's freshness window.

Model Family Context Limits AA Access
openai/gpt-oss-120b GPT 131.1K 30 rpm · 8K tpm · 1K rpd · 200K tpd 23.8 free
openai/gpt-oss-20b GPT 131.1K 30 rpm · 8K tpm · 1K rpd · 200K tpd 14.9 free
meta-llama/llama-4-scout-17b-16e-instruct Llama 131.1K 30 rpm · 30K tpm · 1K rpd · 500K tpd 10 free
allam-2-7b ALLaM free
canopylabs/orpheus-arabic-saudi Orpheus (Canopy Labs) 4.1K free
canopylabs/orpheus-v1-english Orpheus (Canopy Labs) 4.1K free
groq/compound Groq (system) 131.1K free
groq/compound-mini Groq (system) 131.1K free
llama-3.1-8b-instant Llama 131.1K 30 rpm · 6K tpm · 14.4K rpd · 500K tpd free
llama-3.3-70b-versatile Llama 131.1K 30 rpm · 12K tpm · 1K rpd · 100K tpd free
meta-llama/llama-prompt-guard-2-22m Llama 512 free
meta-llama/llama-prompt-guard-2-86m Llama 512 free
openai/gpt-oss-safeguard-20b GPT 131.1K 30 rpm · 8K tpm · 1K rpd · 200K tpd free
qwen/qwen3-32b Qwen 131.1K 60 rpm · 6K tpm · 1K rpd · 500K tpd free
whisper-large-v3 Whisper free
whisper-large-v3-turbo Whisper free
Minimax M2.5 MiniMax paid
Qwen3-VL 32B Qwen paid

Compare all free models across providers →

What you get

Free plan exists

Units: RPM / RPD / TPM / TPD

Limits per organization/model

Very low latency inference

Gotchas

No gotchas documented yet. Contribute one if you know a constraint we missed.

Sources

fast free-tier open-models

Alternatives

Same category · similar quota
ScalewayScaleway · finite_credit · Serverless EU LLM inference API
5.2

Scaleway's EU-sovereign serverless Generative APIs give every new customer 1,000,000 free tokens (plus 60 free audio-transcription minutes) across open models like Qwen, Llama, Mistral and gpt-oss.

$0.90 one-time*33.7 AA1M tok
May be outdatedChecked 28d ago
One-time
DeepInfraDeepInfra · finite_credit · Hosted open-model LLM API
5.4

DeepInfra runs ~77 open-weight models on a pay-what-you-use basis and lets new accounts try the API on a small free allowance with no payment details.

$0.50 one-time*51.1 AA259.7K tok
May be outdatedChecked 28d ago
One-time
Qwen APIQwen API · paid · Paid plan
5.1

Qwen-Turbo $0.05/$0.20; qwen3-coder-plus tiered; Qwen3 Max $0.78/$3.90 per 1M. 1M free tokens at signup

641.0K/$24 AA641.0K/$
May be outdatedChecked 26d ago
Paid onlyMetered