LLM-jp 13B v1.1 Instruct Full

LLM-jp 13B v1.1 Instruct Full updates instruction training for the v1.0 base. It combines Dolly, OpenAssistant and ichikara 003-001 data.

Research release

English originals and Japanese instructions share the mixture

The release includes English Dolly and OpenAssistant examples, their Japanese translations, and human-written Japanese ichikara instructions. Its long repository name records those data choices.LLM-jp 13B v1.1 Instruct Full official model card

Use it as the preference-training parent

Practical guidance. This full-tuned release is the parent of the v1.1 DPO model. Comparing it with that descendant helps isolate preference training from the initial instruction mixture.

Specifications & access

LLM-jp 13B v1.1 Instruct Full specifications
DetailValue and conditions
StatusResearch release
AccessDownloadable
Model identifiersllm-jp-13b-instruct-full-dolly_en-dolly_ja-ichikara_003_001-oasst_en-oasst_ja-v1.1
Context window2,048 tokens

Maximum sequence length stated in the model card.

LLM-jp 13B v1.1 Instruct Full official model card
BaseLLM-jp 13B v1.0; 300 billion pretraining tokens.LLM-jp 13B v1.1 Instruct Full official model card
LicenseApache 2.0.LLM-jp 13B v1.1 Instruct Full official model card
Release identityFull tuning variant; Transformers weight distribution.LLM-jp 13B v1.1 Instruct Full official model card

Related models

  • The original 13B LLM-jp text model, trained on 300 billion tokens with a 2,048-token context.

    Launch date not confirmedResearch releaseDownloadable
  • A preference-tuned descendant of the full v1.1 instruction model using Japanese HH-RLHF data.

    Launch date not confirmedResearch releaseDownloadable
  • The v1.1 LoRA instruction release combines Japanese human-written data with English and translated dialogue data.

    Launch date not confirmedResearch releaseDownloadable