GMI Cloud
GMI Cloud is an NVIDIA-partner inference cloud offering serverless open-model inference and H100/H200 GPUs, with free starter credits for new accounts.
- Free credit
- $5
- Card required
- No
GMI Cloud scores 5.4/10 for free value in LLM. The main constraint: Reported $5 in free credits for new users to try the Inference Engine; some free inference endpoints advertised without a card. Finite starter credit.
Free value score
5.4 / 10Show the math
Key metrics
Models
3 free · 230+ totalLimits may be stale — last re-verified outside this section's freshness window.
| Model | Family | AA | Access |
|---|---|---|---|
| DeepSeek V3 | DeepSeek | 10.4 | free |
| DeepSeek R1 Distill Qwen 1.5B | DeepSeek | — | free |
| Llama-3.1-8B-Instruct | Llama | — | free |
| Claude Opus 4.8 | Claude | 55.7 | paid |
| GPT-5.5 | GPT | 54.8 | paid |
| GPT-5.4 | GPT | 51.4 | paid |
| Gemini 3.5 Flash | Gemini | 50.2 | paid |
| Gemini-3.1-Pro | Gemini | 46.5 | paid |
| DeepSeek-V4-Pro | DeepSeek | 44.3 | paid |
| GPT-5.2 | GPT | 42.2 | paid |
| DeepSeek-V4-Flash | DeepSeek | 40.3 | paid |
| ZAI: GLM-5.1 | GLM | 40.2 | paid |
| ZAI: GLM-5 | GLM | 39.5 | paid |
| GPT-5.1 | GPT | 38.9 | paid |
| MiniMaxAI/MiniMax-M2.7 | MiniMax | 38.1 | paid |
| moonshotai/Kimi-K2.5 | Kimi | 38.1 | paid |
| Claude Sonnet 4.6 | Claude | 35.9 | paid |
| Claude Opus 4.5 | Claude | 34.7 | paid |
| deepseek-ai/DeepSeek-V3.2 | DeepSeek | 24.7 | paid |
| DeepSeek-V3.2-Exp | DeepSeek | 24.7 | paid |
| OpenAI: GPT OSS 120b | GPT | 23.8 | paid |
| GLM-4.6 | GLM | 23 | paid |
| DeepSeek-V3.1-Terminus | DeepSeek | 21.1 | paid |
| DeepSeek R1 | DeepSeek | 20.1 | paid |
| Kimi-K2-Thinking | Kimi | 19.4 | paid |
| GPT OSS 20b | GPT | 14.9 | paid |
| Llama-4 Maverick 17B 128E Instruct FP8 | Llama | 14.3 | paid |
| DeepSeek V3 0324 | DeepSeek | 10.4 | paid |
| Claude Haiku 4.5 | Claude | — | paid |
| DeepSeek R1 Distill Llama 70B | DeepSeek | — | paid |
| deepseek-ai/DeepSeek-R1-0528 | DeepSeek | — | paid |
| Llama 3.3 70B Instruct | Llama | — | paid |
| MiniMax-M2 | MiniMax | — | paid |
| MiniMaxAI/MiniMax-M2.5 | MiniMax | — | paid |
| moonshotai/Kimi-K2-Instruct-0905 | Kimi | — | paid |
| Qwen: Qwen3-VL-235B-A22B-Instruct-FP8 | Qwen | — | paid |
| Qwen3 235B A22B Instruct 2507 FP8 | Qwen | — | paid |
| Qwen3 235B A22B Thinking 2507 FP8 | Qwen | — | paid |
| Qwen3 Coder 480B A35B Instruct FP8 | Qwen | — | paid |
| Qwen3 Next 80B A3B Thinking | Qwen | — | paid |
Showing first 3 of a larger catalog.
What you get
Reported $5 free credits for new accounts
NVIDIA H100/H200-backed serverless inference
Open-model catalog with OpenAI-compatible API
Also offers dedicated GPU clusters and bare metal
Gotchas
- $5 starter credit (one-time)
New accounts receive a reported $5 in free credits for the Inference Engine; once exhausted the account switches to pay-as-you-go with no free allotment.
- Card required after credit exhaustion
Continuing to use the platform after the $5 credit is depleted requires adding a payment method; a card may also be needed at signup to unlock full quota.
Sources
-
"By default, organizations are assigned to Tier 1. ... | Tier 1 | $0 | Immediately | ... | zai-org/GLM-5-FP8 | 100,000 | 2,000,000 | 4,000,000 | 10,000,000 | 150,000,000 |"
https://docs.gmicloud.ai/inference-engine/api-reference/rate-limit -
"New users get $5 in free credits to try Inference Engine 2.0."
https://www.threads.com/@githubprojects/post/DQ4yj5ZkyOG/new-users-get-in-free-credits-to-try-inference-engine-join-the-gmi-community -
"GLM-5 scores 50 on the Intelligence Index and is the new open weights leader, up from GLM-4.7's score of 42 - an 8 point jump"
https://x.com/ArtificialAnlys/status/2021678229418066004 -
"GMI Cloud, a San Jose-based startup that provides GPU cloud infrastructure, has raised an $82 million Series A led by Headline Asia."
https://techcrunch.com/2024/10/29/gmi-cloud-secures-82m-in-series-a-for-its-gpu-cloud-infrastructure/
Alternatives
Same category · similar quotaNebius AI Studio offers serverless inference on a wide range of open models with a small free starter credit for new users, usable from playground or API after adding a bank card at signup.