Article Complete
AIM
EleutherAI announces 20 billion-parameter language model, GPT-NeoX-20B
EleutherAI announces 20 billion-parameter language model, GPT-NeoX-20B

EleutherAI announces 20 billion-parameter language model, GPT-NeoX-20B

The company claimed it is the largest publicly accessible pretrained general-purpose autoregressive language model.

Published Updated

Key takeaways

  • EleutherAI has launched GPT-NeoX-20B, the largest publicly accessible pretrained language model with 20 billion parameters.
  • The model aims to advance research on the safe use of AI systems.
  • Full model weights will be available for free under an Apache 2.0 license from February 9.
  • The model is intended as a research tool and not recommended for production use without careful evaluation.
5 min

EleutherAI has announced GPT-NeoX-20B, a 20 billion parameter model trained using the GPT-NeoX framework on GPUs from CoreWeave. The company claimed it is the largest publicly accessible pretrained general-purpose autoregressive language model.

Image: EleutherAI

The model will help in accelerating research towards the safe use of AI systems.

Image:  EleutherAI

The full model weights will be downloadable for free from February 9, under a permissive Apache 2.0 license from The Eye. Till then, you can try the model using CoreWeave and Anlatan’s inference service, GooseAI.

“GPT-NeoX and GPT-NeoX-20B are very much research artifacts and we do not recommend deploying either in a production setting without careful consideration,” EleutherAI said.

Membership

Stay ahead with AI insights.

Unlimited access to premium articles, exclusive analysis, and the stories shaping India's AI economy.

Subscribe now

AIM Americas

1190 Miraloma Way Suite P, Sunnyvale, CA 94085

AIM India

1st Floor, Sakti Statesman, Bellandur, Bengaluru – 560103

Β© 2026 AIM. All rights reserved.