Replicate Multi-GPU logo

Replicate Multi-GPU

Functions 4.6/10

Per-second multi-GPU hardware: 2x A100 80GB $10.08/hr, 4x A100 $20.16/hr, 8x A100 $40.32/hr, 2x H100 $10.98/hr, 8x H100 $43.92/hr, L40S multi up to 8x $28.08/hr.

Replicate Multi-GPU scores 4.6/10 for free value in Functions. The main constraint: Paid — 8x H100 $0.012200/s ($43.92/hr); 2x A100 $0.0028/s. Per-second multi-GPU hardware: 2x A100 80GB $10.08/hr, 4x A100 $20.16/hr, 8x A100 $40.32/hr, 2x H100 $10.98/hr, 8x H100 $43.92/hr, L40S multi up to 8x $28.08/hr.

Category Functions Kind Paid plan

Free value score

4.6 / 10
Show the math
Overall 4.6/10
value = 4.6/100
weighted_components_v1
Invocation value 1/10
value = 0.01 ×
fixed_log_v1
Runtime fit 8.2/10
value = 8.2/100
policy_score_v1
Deploy friction 8/10
value = 8/100
policy_score_v1

Key metrics

8xH100 $44h
8xA100 $40h
$12.2m/s

What you get

Paid — 8x H100 $0.012200/s ($43.92/hr); 2x A100 $0.0028/s. Per-second multi-GPU hardware: 2x A100 80GB $10.08/hr, 4x A100 $20.16/hr, 8x A100 $40.32/hr, 2x H100 $10.98/hr, 8x H100 $43.92/hr, L40S multi up to 8x $28.08/hr.

Linear per-GPU scaling (e.g. $5.49/hr per H100) with per-second billing; good for running big models on-demand without negotiating clusters.

Gotchas

No gotchas documented yet. Contribute one if you know a constraint we missed.

Sources

paid value serverless-functions
Open service ← All Functions

Alternatives

Same category · similar quota
BasetenBaseten · paid · Paid plan
4.6

Per-minute, idle-excluded billing on dedicated replicas; A100 80GB ~$4/hr, H100 MIG ~$0.0625/min, H100 80GB ~$6.50/hr (also $9.984/hr SXM tier). Autoscaling model deployments.

A100 ~$4/hr
Checked 26d ago
Paid only
CerebriumCerebrium · paid · Paid plan
4.6

Pay-per-second GPU/CPU: T4 $0.000164/s, L4 $0.000222/s, A10 $0.000306/s, A100 80GB $0.000583/s (~$2.10/hr), H100 $0.000944/s (~$3.40/hr), B200 $0.00167/s; CPU $0.00000655/vCPU/s.

A100 $.58k/sT4 $164u/s
Checked 26d ago
Paid only
Cloudflare Containers GPU note / R2Cloudflare Containers GPU note / R2 · paid · Paid plan
4.6

$5/mo unlocks Workers + Containers + Durable Objects + R2 ($0.015/GB-month standard, Class A $4.50/M, Class B $0.36/M) with no egress fees.

$0 egress$5/moR2 $.015/GB
Checked 26d ago
Low/no egressEmbeddingsPaid only