LLM-jp 13B v2.0 Instruct AC

LLM-jp 13B v2.0 Instruct AC is a full-model instruction-tuned descendant of LLM-jp 13B v2.0. The underlying model has 256 billion pretraining tokens and a 4,096-token context.

Research release

Safety-data inclusion is the experimental change

The instruction mixture contains Japanese human-written examples, English source datasets and Japanese translations. Full-model tuning was performed with TRL and DeepSpeed.LLM-jp 13B v2.0 Instruct AC official model card

Use the exact safety-data variant

Practical guidance. Compare AC with the instruction-only model while holding the input and decoding fixed. This isolates the added safety examples more clearly than a comparison across model families.

Specifications & access

LLM-jp 13B v2.0 Instruct AC specifications
DetailValue and conditions
StatusResearch release
AccessDownloadable
Model identifiersllm-jp-13b-instruct-full-ac_001-dolly-ichikara_004_001_single-oasst-oasst2-v2.0
Context window4,096 tokens

Maximum sequence length stated in the model card.

LLM-jp 13B v2.0 Instruct AC official model card
BaseLLM-jp 13B v2.0.LLM-jp 13B v2.0 Instruct AC official model card
Instruction sourcesDolly, ichikara 004-001, OpenAssistant 1 and OpenAssistant 2.LLM-jp 13B v2.0 Instruct AC official model card
LicenseApache 2.0.LLM-jp 13B v2.0 Instruct AC official model card
VariantInstruction mixture with AnswerCarefully safety data.LLM-jp v2.0 release and safety-data experiments

Related models

  • The 13B v2.0 base changes the pretraining corpus and vocabulary and extends context to 4,096 tokens.

    Launch date not confirmedResearch releaseDownloadable
  • LLM-jp 13B v2.0 Instruct is one of three published safety-data tuning comparisons.

    Launch date not confirmedResearch releaseDownloadable