EleutherAI
EleutherAI develops language models that researchers can download and study. Its work includes the GPT-Neo lineage, Pythia training checkpoints and specialist models for Korean text and mathematics.
Models & tools
- Pythia 14M
EleutherAI · Pythia
A tiny six-layer model for studying the effect of training data.
Launch date Research releaseDownloadable - Pythia 31M
EleutherAI · Pythia
A six-layer Pythia model that doubles the width of the 14M network.
Launch date Research releaseDownloadable - Deep Ignorance research models
EleutherAI · Deep Ignorance
A controlled suite of 6.9B models studying training-data filtering and safety.
Launch date August 2025Research releaseDownloadable - Comma v0.1 1T
EleutherAI · Comma
A seven-billion-parameter Common Pile model trained for one trillion tokens.
Launch date Research releaseDownloadable - Comma v0.1 2T
EleutherAI · Comma
A seven-billion-parameter Common Pile model trained for two trillion tokens.
Launch date Research releaseDownloadable - Pile-T5 Base
EleutherAI · Pile-T5
A compact encoder-decoder model trained on two trillion Pile tokens.
Launch date Research releaseDownloadable - Pile-T5 Large
EleutherAI · Pile-T5
A 783-million-parameter encoder-decoder model trained from scratch for text-to-text research.
Launch date Research releaseDownloadable - Pile-T5 XL
EleutherAI · Pile-T5
A 2.85-billion-parameter text-to-text model with an open training history.
Launch date Research releaseDownloadable - Pile-T5 XXL
EleutherAI · Pile-T5
An eleven-billion-parameter encoder-decoder model trained from scratch.
Launch date Research releaseDownloadable - Hermes RWKV v5 7B
EleutherAI · Hermes RWKV
A seven-billion-parameter RWKV chat model with recurrent inference.
Launch date February 2024Research releaseDownloadable - Llemma 34B
EleutherAI · Llemma
A 34B mathematical language model adapted from Meta Code Llama.
Launch date Research releaseDownloadable - Llemma 7B
EleutherAI · Llemma
A 7B mathematical language model adapted from Meta Code Llama.
Launch date Research releaseDownloadable - Pythia 14M Deduped
EleutherAI · Pythia
A 14M Pythia checkpoint trained on deduplicated Pile text.
Launch date July 2023Research releaseDownloadable - Pythia 31M Deduped
EleutherAI · Pythia
A 31M Pythia checkpoint trained on deduplicated Pile text.
Launch date July 2023Research releaseDownloadable - Pythia 1.4B
EleutherAI · Pythia
A 24-layer Pythia network with a two-thousand-wide hidden state.
Launch date Research releaseDownloadable - Pythia 1.4B Deduped
EleutherAI · Pythia
A 1.4B Pythia checkpoint trained on deduplicated Pile text.
Launch date Research releaseDownloadable - Pythia 12B
EleutherAI · Pythia
The largest Pythia size, with 36 layers and open training checkpoints.
Launch date Research releaseDownloadable - Pythia 12B Deduped
EleutherAI · Pythia
A 12B Pythia checkpoint trained on deduplicated Pile text.
Launch date Research releaseDownloadable - Pythia 160M
EleutherAI · Pythia
A twelve-layer open model with checkpoints across its training run.
Launch date Research releaseDownloadable - Pythia 160M Deduped
EleutherAI · Pythia
A 160M Pythia checkpoint trained on deduplicated Pile text.
Launch date Research releaseDownloadable - Pythia 1B
EleutherAI · Pythia
A wide, sixteen-layer Pythia model trained with bfloat16 precision.
Launch date Research releaseDownloadable - Pythia 1B Deduped
EleutherAI · Pythia
A 1B Pythia checkpoint trained on deduplicated Pile text.
Launch date Research releaseDownloadable - Pythia 2.8B
EleutherAI · Pythia
A 32-layer Pythia model with about 2.52 billion non-embedding parameters.
Launch date Research releaseDownloadable - Pythia 2.8B Deduped
EleutherAI · Pythia
A 2.8B Pythia checkpoint trained on deduplicated Pile text.
Launch date Research releaseDownloadable - Pythia 410M
EleutherAI · Pythia
A 24-layer research model with a 1,024-wide hidden state.
Launch date Research releaseDownloadable - Pythia 410M Deduped
EleutherAI · Pythia
A 410M Pythia checkpoint trained on deduplicated Pile text.
Launch date Research releaseDownloadable - Pythia 6.9B
EleutherAI · Pythia
A 32-layer open model for research at a six-billion-parameter scale.
Launch date Research releaseDownloadable - Pythia 6.9B Deduped
EleutherAI · Pythia
A 6.9B Pythia checkpoint trained on deduplicated Pile text.
Launch date Research releaseDownloadable - Pythia 70M
EleutherAI · Pythia
The smallest size in the original eight-size Pythia research suite.
Launch date Research releaseDownloadable - Pythia 70M Deduped
EleutherAI · Pythia
A 70M Pythia checkpoint trained on deduplicated Pile text.
Launch date Research releaseDownloadable - GPT-NeoX-20B
EleutherAI · GPT-NeoX
A 20-billion-parameter Pile model from EleutherAI distributed training research.
Launch date Research releaseDownloadable - GPT-J 6B
EleutherAI · GPT-J
A six-billion-parameter text model built with Mesh Transformer JAX.
Launch date Research releaseDownloadable - GPT-Neo 1.3B
EleutherAI · GPT-Neo
An early open GPT-style model trained on 380 billion tokens.
Launch date Research releaseDownloadable - GPT-Neo 2.7B
EleutherAI · GPT-Neo
The largest original GPT-Neo checkpoint, with 32 Transformer layers.
Launch date Research releaseDownloadable - GPT-Neo 125M
EleutherAI · GPT-Neo
A compact English text model with local and global attention.
Launch date not confirmedResearch releaseDownloadable - Hermes Mamba 2.8B
EleutherAI · Hermes Mamba
A chat adaptation of the Pile-trained Mamba 2.8B base.
Launch date not confirmedResearch releaseDownloadable - Hermes Mamba 2.8B SlimPajama
EleutherAI · Hermes Mamba
A Mamba chat model whose base was trained on SlimPajama.
Launch date not confirmedResearch releaseDownloadable - Hermes Mamba 2.8B SlimPajama cDPO
EleutherAI · Hermes Mamba
A preference-trained variant of the SlimPajama Hermes Mamba model.
Launch date not confirmedResearch releaseDownloadable - Hermes RWKV v5 3B
EleutherAI · Hermes RWKV
A three-billion-parameter recurrent chat adaptation of RWKV v5.
Launch date not confirmedResearch releaseDownloadable An instruction-tuned Llemma adaptation with a nonstandard end token.
Launch date not confirmedResearch releaseDownloadable- Polyglot-Ko 1.3B
EleutherAI · Polyglot-Ko
A compact Korean base model from the Polyglot project.
Launch date not confirmedResearch releaseDownloadable - Polyglot-Ko 12.8B
EleutherAI · Polyglot-Ko
The largest documented Polyglot-Ko base model, trained on Korean text.
Launch date not confirmedResearch releaseDownloadable - Polyglot-Ko 3.8B
EleutherAI · Polyglot-Ko
A Korean text-completion model with 32 Transformer layers.
Launch date not confirmedResearch releaseDownloadable - Polyglot-Ko 5.8B
EleutherAI · Polyglot-Ko
A wider Korean base model with 28 layers and downloadable weights.
Launch date not confirmedResearch releaseDownloadable - Quirky Models research suite
EleutherAI · Quirky Models
Language-model adaptations designed to separate stated answers from internal knowledge.
Launch date not confirmedResearch releaseDownloadable