llamafile logo

llamafile

Inference & Serving 6.9/10 Solid

Distribute and run LLMs with a single file.

llamafile scores 6.9/10 (Solid) in Inference & Serving.

Language C++ License Custom (see repo) Stars 25.2k★ Type lightweight Self-host Yes Repo mozilla-ai/llamafile Homepage https://github.com/mozilla-ai/llamafile

Quality

Solid 6.9
Adoption 60
Activity 64
Maturity 95
Community 55
Capability 50
Show the math
Overall 6.9/10
value = 6.9/10
score = value
Adoption 6.4/10
value = 60/100
score = 1 + 9 * value / 100
Activity 6.8/10
value = 63.9/100
score = 1 + 9 * value / 100
Maturity 9.6/10
value = 95.2/100
score = 1 + 9 * value / 100
Community 6/10
value = 55.3/100
score = 1 + 9 * value / 100
Capability 5.5/10
value = 50/100
score = 1 + 9 * value / 100

Key metrics

25.2k★ GitHub stars
40/90d Recent commits
8 devs/90d Recent contributors
2.8y Project age
active Last commit

Gotchas

No gotchas documented yet. Contribute one if you know a constraint we missed.

Labels

  • No license

    No OSS license

    No recognized open-source license is declared; using it commercially is legally ambiguous.

  • Self-hosted

    Self-hosted

    You deploy and operate it yourself; there is no hosted option here.

single-binary portable local cpu server