Jurassic-1 Jumbo
Jurassic-1 Jumbo is AI21's 178-billion-parameter first-generation model. Its design used 76 layers and a hidden width of 13,824.
Access not confirmed
A deliberate depth and width tradeoff
The paper explains that a wider, shallower network increased parallel work during inference. It also describes training on 300 billion tokens with distributed training infrastructure.Jurassic-1 technical details and evaluation
The largest original Jurassic tier
AI21 later positioned Grande between Large and Jumbo, with Jumbo remaining the largest tier.Introducing J1-Grande
Practical guidance. Jumbo belongs to the historical completion-model range. Current access is not confirmed, and its published architecture should not be assigned to Jurassic-2 Ultra without separate evidence.
Specifications & access
| Detail | Value and conditions |
|---|---|
| Status | Access not confirmed |
| Launch date | August 2021 |
| Model identifiers | J1-Jumbo |
| Parameters | 178 billionJurassic-1 technical details and evaluation |
| Layers | 76Jurassic-1 technical details and evaluation |
Related models
- Jurassic-2 Jumbo Base
AI21 Labs · Jurassic-2
Historical largest Jurassic-2 base model from the March 2023 release.
Launch date Access not confirmed - Jurassic-2 Ultra
AI21 Labs · Jurassic-2
Largest instruction-capable Jurassic-2 tier for complex text comprehension and generation.
Launch date Access not confirmed - Jurassic-1 Grande
AI21 Labs · Jurassic-1
Middle-sized Jurassic-1 text model introduced between Large and Jumbo.
Launch date Access not confirmed