MetaLlama 3.1
Llama 3.1 405B Instruct
The 405B checkpoint is the largest Llama 3.1 text instruction release.
What the release provides
Its context is 128K. The Llama 3.1 Community License permits use of outputs for model improvement, including distillation, subject to its terms.Llama 3.1 official model card
How to use it well
Practical guidance. For synthetic data, retain provenance and filter generated examples before training another model. A larger teacher can still produce incorrect answers. Compare the resulting student on independent material rather than only on its generated training examples.
Specifications & access
| Detail | Value and conditions |
|---|---|
| Access | Downloadable |
| Model identifiers | meta-llama/Llama-3.1-405B-Instruct |