LLM-jp-3 172B beta2 Instruct2
LLM-jp-3 172B beta2 Instruct2 preserves the beta2 stage of LLM-jp's 172B model. The card records 1.4 trillion seen tokens and a 4,096-token context.
Restricted access
An aligned beta-stage model
This is the Instruct2 beta2 release, not the final 2.1-trillion-token checkpoint. Its weights are published behind the model's access conditions.LLM-jp-3 172B beta2 Instruct2 official model card
Keep the training stage in research records
Practical guidance. Use beta2 when the experiment needs that training stage. A later tokenizer, final checkpoint or different aligned version would change the comparison. Review the specific beta terms before distributing derived work.
Specifications & access
| Detail | Value and conditions |
|---|---|
| Status | Restricted access |
| Access | Downloadable |
| Model identifiers | llm-jp-3-172b-beta2-instruct2 |
| Context window | 4,096 tokens Maximum sequence length stated in the model card. LLM-jp-3 172B beta2 Instruct2 official model card |
| Architecture | 96 transformer layers; hidden size 12,288; 96 attention heads.LLM-jp-3 172B beta2 Instruct2 official model card |
| Access | Hugging Face access gate requires acceptance of conditions and sharing profile information.LLM-jp-3 172B beta2 Instruct2 official model card |
| License | Custom LLM-jp-3 172B beta2 terms of use.LLM-jp-3 172B beta2 Instruct2 official model card |
| Approval | The official release index requires approval and restricts redistribution and certain uses.LLM-jp official release index |
Related models
- LLM-jp-3 172B Base
LLM-jp / NII LLMC · LLM-jp-3 172B
The final 2.1-trillion-token 172B base checkpoint uses application-based access and custom terms.
Launch date not confirmedRestricted accessDownloadable - LLM-jp-3 172B beta2
LLM-jp / NII LLMC · LLM-jp-3 172B
LLM-jp-3 172B beta2 is a gated 172B research checkpoint with 1.4 trillion pretraining tokens.
Launch date not confirmedRestricted accessDownloadable