Hugging Face Inference Endpoints
Dedicated autoscaling inference billed per minute of uptime. CPU from $0.032/core/hr; GPUs T4 $0.50/hr, L4 $0.80/hr, A100 and up to ~$45/hr; can scale to zero.
Hugging Face Inference Endpoints scores 4.8/10 for free value in Functions. The main constraint: Paid — From $0.032/CPU-core-hr; GPUs from $0.50/hr (T4). Dedicated autoscaling inference billed per minute of uptime. CPU from $0.032/core/hr; GPUs T4 $0.50/hr, L4 $0.80/hr, A100 and up to ~$45/hr; can scale to zero.
Free value score
4.8 / 10Show the math
Key metrics
What you get
Paid — From $0.032/CPU-core-hr; GPUs from $0.50/hr (T4). Dedicated autoscaling inference billed per minute of uptime. CPU from $0.032/core/hr; GPUs T4 $0.50/hr, L4 $0.80/hr, A100 and up to ~$45/hr; can scale to zero.
~2 T4 GPU-hours per $1 ($0.50/hr); per-minute billing and scale-to-zero make it efficient for spiky inference. CPU endpoints extremely cheap for light
Gotchas
No gotchas documented yet. Contribute one if you know a constraint we missed.
Sources
-
"Inference Endpoints Dedicated inference, starting at $0.033/hour ... GPU Instances NVIDIA T4 ... $0.50 ... NVIDIA L4 ... $0.80"
https://huggingface.co/pricing -
"As low as $0.06 per CPU core/hr and $0.6 per GPU/hr."
https://discuss.huggingface.co/t/misunderstanding-about-inference-endpoint-billing/57428