Together AI

Functions 4.6/10

On-demand dedicated endpoints billed per minute: A100 40GB $2.40/hr, A100 80GB $2.59/hr, H100 80GB $3.36/hr (up to ~43% off legacy). Also serverless token APIs and clusters (H100 f

Together AI scores 4.6/10 for free value in Functions. The main constraint: Paid — H100 80GB $3.36/hr; A100 80GB $2.59/hr; A100 40GB $2.40/hr. On-demand dedicated endpoints billed per minute: A100 40GB $2.40/hr, A100 80GB $2.59/hr, H100 80GB $3.36/hr (up to ~43% off legacy). Also serverless token APIs and clusters (H100 from $5.49/hr).

Category Functions Kind Paid plan

Free value score

4.6 / 10

Show the math

Overall 4.6/10

value = 4.6/100

weighted_components_v1

Invocation value 1/10

value = 0.01 ×

fixed_log_v1

Runtime fit 8.2/10

value = 8.2/100

policy_score_v1

Deploy friction 8/10

value = 8/100

policy_score_v1

Key metrics

H100 $3.36/h

A100 $2.59

40GB $2.40

What you get

Paid — H100 80GB $3.36/hr; A100 80GB $2.59/hr; A100 40GB $2.40/hr. On-demand dedicated endpoints billed per minute: A100 40GB $2.40/hr, A100 80GB $2.59/hr, H100 80GB $3.36/hr (up to ~43% off legacy). Also serverless token APIs and clusters (H100 from $5.49/hr).

A100 80GB at $2.59/hr and H100 at $3.36/hr for dedicated endpoints is competitive for guaranteed-capacity inference with no queue.

Gotchas

No gotchas documented yet. Contribute one if you know a constraint we missed.

Sources

"A100 SXM 40GB, $2.40/hour, -20% ; A100 SXM 80GB, $2.59/hour, -20% ; H100 80GB, $3.36/hour, -43%"
https://www.together.ai/blog/on-demand-dedicated-endpoints
"NVIDIA HGX H100 $5.49 ... NVIDIA HGX H200 $6.79"
https://www.together.ai/pricing

paid value serverless-functions

Open service ← All Functions

Alternatives

Same category · similar quota

BasetenBaseten · paid · Paid plan

4.6

Per-minute, idle-excluded billing on dedicated replicas; A100 80GB ~$4/hr, H100 MIG ~$0.0625/min, H100 80GB ~$6.50/hr (also $9.984/hr SXM tier). Autoscaling model deployments.

A100 ~$4/hr

Checked 26d ago

Paid only

CerebriumCerebrium · paid · Paid plan

4.6

Pay-per-second GPU/CPU: T4 $0.000164/s, L4 $0.000222/s, A10 $0.000306/s, A100 80GB $0.000583/s (~$2.10/hr), H100 $0.000944/s (~$3.40/hr), B200 $0.00167/s; CPU $0.00000655/vCPU/s.

A100 $.58k/sT4 $164u/s

Checked 26d ago

Paid only

Cloudflare Containers GPU note / R2Cloudflare Containers GPU note / R2 · paid · Paid plan

4.6

$5/mo unlocks Workers + Containers + Durable Objects + R2 ($0.015/GB-month standard, Class A $4.50/M, Class B $0.36/M) with no egress fees.

$0 egress$5/moR2 $.015/GB

Checked 26d ago

Low/no egressEmbeddingsPaid only