LLM-jp-3 1.8B Instruct

LLM-jp-3 1.8B Instruct is the 1.8B original instruction-tuned release in LLM-jp's generation-3 size series. The underlying model was exposed to 2.1 trillion pretraining tokens.

Research release

The original instruction data mixture

The card lists Japanese ichikara and AnswerCarefully data alongside synthetic conversation, coding and English FLAN material. This original Instruct checkpoint remains distinct from the later Instruct2 and Instruct3 releases.LLM-jp-3 1.8B Instruct official model card

Record the exact Instruct revision

Practical guidance. Keep this original 1.8B revision separate in results. Reusing an Instruct2 prompt or template without checking it can obscure the cause of a response change.

Specifications & access

LLM-jp-3 1.8B Instruct specifications
DetailValue and conditions
StatusResearch release
AccessDownloadable
Model identifiersllm-jp-3-1.8b-instruct
Context window4,096 tokens

Maximum sequence length stated in the model card.

LLM-jp-3 1.8B Instruct official model card
Architecture24 layers; hidden size 2,048; 16 attention heads.LLM-jp-3 1.8B Instruct official model card
Parameters1,867,614,208 total, from the card's embedding and non-embedding counts.LLM-jp-3 1.8B Instruct official model card
LicenseApache 2.0; research weights.LLM-jp-3 1.8B Instruct official model card

Related models

  • LLM-jp-3 1.8B Base is a pretrained text model with 4,096-token context and Apache 2.0 weights.

    Launch date not confirmedResearch releaseDownloadable