Together AI Batch API

LLM 6.5/10

Batch inference at half serverless price; DeepSeek V4 Pro listed at $0.20 batch vs $1.74 serverless

Together AI Batch API scores 6.5/10 for free value in LLM. The main constraint: Paid — 50% of serverless (e.g. DeepSeek V4 Pro $0.20). Batch inference at half serverless price; DeepSeek V4 Pro listed at $0.20 batch vs $1.74 serverless.

Category LLM Kind Paid plan

Free value score

6.5 / 10

Show the math

Model Quality 8/10

value = 44 artificial_analysis_score

weighted score = 0.2 * 8/10

Access 10/10

value = 10/10

weighted score = 0.1 * 10/10

Price Efficiency 5.6/10

value = 2 value/$

weighted score = 0.7 * 5.6/10

Key metrics

DeepSeek V4 Pro (Max) 44 Best model

2x Value ratio

What you get

Paid — 50% of serverless (e.g. DeepSeek V4 Pro $0.20). Batch inference at half serverless price; DeepSeek V4 Pro listed at $0.20 batch vs $1.74 serverless

~5M DeepSeek V4 Pro tokens/$1 in batch mode — half the per-call cost for async workloads

Gotchas

No gotchas documented yet. Contribute one if you know a constraint we missed.

Sources

"Price per 1M tokens Batch API price DeepSeek V4 Pro $1.74 $0.20."
https://www.together.ai/pricing
"In reasoning mode, DeepSeek V3.2 scores 66 on the Artificial Analysis Intelligence Index"
https://www.linkedin.com/pulse/deepseek-v32-2-most-intelligent-open-weights-model-qnwoc

paid value llm-providers

Open service ← All LLM

Alternatives

Same category · similar quota

Fireworks AI BatchFireworks AI Batch · paid · Paid plan

6.5

Batch inference billed at 50% of serverless on both input and output across the open catalog

2×44.3 AA2.0×

May be outdatedChecked 26d ago

Paid onlyEmbeddings

CrofAI (nahcrof) Pay-As-You-GoCrofAI (nahcrof) Pay-As-You-Go · paid · Paid plan

6.4

Dirt-cheap open-model PAYG with disclosed quants: GLM-5.2 (Q8_0) $0.50/$2.20 per 1M, Kimi-K2.7-code (int4) $0.55/$2.25, GLM-5.1 $0.45/$2.15, Qwen3.5-397B (Q4_0) $0.35/$1.75, DeepSeek-V4-Pro $0.35/$0.80; OpenAI-compatible endpoint

1.1M/$51.1 AA1.1M/$

May be outdatedChecked 23d ago

Paid onlySolo operator

ZenMux Pay-As-You-Go APIZenMux Pay-As-You-Go API · paid · Paid plan

6.6

Cheapest GLM 5.2 API verified (Jul 2026): $0.43/M input, $1.35/M output, $0.08/M cache read, 1M context; Kimi K2.7 Code $0.43/$1.79 (+HighSpeed tier); OpenAI- AND Anthropic-compatible gateway, no rate/concurrency limits, production allowed

1.5M/$51.1 AA1.5M/$

May be outdatedChecked 23d ago

Best valuePaid onlyMetered