LocalAI logo

LocalAI

Inference & Serving 8.0/10 Strong

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

LocalAI scores 8/10 (Strong) in Inference & Serving.

Language Go License MIT Stars 47.3k★ Type service Self-host Yes Repo mudler/LocalAI Homepage https://localai.io

Quality

Strong 8.0
Adoption 67
Activity 89
Maturity 97
Community 66
Capability 50
Show the math
Overall 8/10
value = 8/10
score = value
Adoption 7/10
value = 66.9/100
score = 1 + 9 * value / 100
Activity 9/10
value = 88.6/100
score = 1 + 9 * value / 100
Maturity 9.8/10
value = 97.3/100
score = 1 + 9 * value / 100
Community 7/10
value = 66.3/100
score = 1 + 9 * value / 100
Capability 5.5/10
value = 50/100
score = 1 + 9 * value / 100

Key metrics

47.3k★ GitHub stars
1k/90d Recent commits
10 devs/90d Recent contributors
3.3y Project age
active Last commit

Gotchas

No gotchas documented yet. Contribute one if you know a constraint we missed.

Labels

  • Self-hosted

    Self-hosted

    You deploy and operate it yourself; there is no hosted option here.

  • Managed option

    Managed option

    Available as a hosted/managed service in addition to self-hosting.

openai-compatible self-hosted multimodal embeddings local