EleutherAI GPT-NeoX
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
EleutherAI GPT-NeoX scores 5.8/10 (Solid) in Fine-Tuning.
Language Python License Apache-2.0 Stars 7.4k★ Type heavyweight Self-host Yes Repo EleutherAI/gpt-neox Homepage https://github.com/EleutherAI/gpt-neox
Quality
Solid 5.8
Adoption 47
Activity 42
Maturity 100
Community 52
Capability 50
Show the math
Overall 5.8/10
value = 5.8/10
score = value
Adoption 5.2/10
value = 46.8/100
score = 1 + 9 * value / 100
Activity 4.8/10
value = 41.7/100
score = 1 + 9 * value / 100
Maturity 10/10
value = 100/100
score = 1 + 9 * value / 100
Community 5.7/10
value = 52.4/100
score = 1 + 9 * value / 100
Capability 5.5/10
value = 50/100
score = 1 + 9 * value / 100
Key metrics
7.4k★ GitHub stars
7/90d Recent commits
3 devs/90d Recent contributors
5.5y Project age
active Last commit
Gotchas
No gotchas documented yet. Contribute one if you know a constraint we missed.
Labels
- Self-hosted
Self-hosted
You deploy and operate it yourself; there is no hosted option here.
- Heavyweight
Heavyweight
Resource-heavy to run (GPU, large memory, or multi-service stack).
training large-scale deepspeed megatron gpu