LLM-jp-4 33B Thinking
LLM-jp-4 33B Thinking adds supervised fine-tuning and direct preference optimization to the corresponding LLM-jp-4 base model.
Research release
Reasoning trained without reinforcement learning
The card specifies SFT followed by DPO, without reinforcement learning. It links the instruction and size-specific preference datasets. Its Harmony-style chat format requires the model's own tokenizer; the openai-harmony tokenizer is not interchangeable.LLM-jp-4 33B Thinking official model card
Measure reasoning output as part of serving
Practical guidance. Use this dense checkpoint to compare full-model computation with the 32B-A3B expert model. Similar total parameter counts do not imply similar memory traffic or token latency.
GGUF is a distribution of this model
The project publishes an official GGUF repository for this Thinking release. It is a file-format and quantization distribution of the model, not an additional pretrained model.LLM-jp-4 33B Thinking official GGUF release
Specifications & access
| Detail | Value and conditions |
|---|---|
| Status | Research release |
| Access | Downloadable |
| Model identifiers | llm-jp-4-33b-thinkingllm-jp-4-33b-thinking-gguf |
| Context window | 65,536 tokens Maximum sequence length stated in the model card. LLM-jp-4 33B Thinking official model card |
| Architecture | Dense; 64 layers, hidden size 5,120.LLM-jp-4 33B Thinking official model card |
| Parameters | 33,219,548,160 total parameters.LLM-jp-4 33B Thinking official model card |
| License | Apache 2.0; downloadable research weights.LLM-jp-4 33B Thinking official model card |
Related models
- LLM-jp-4.1 33B Thinking
LLM-jp / NII LLMC · LLM-jp-4.1
LLM-jp-4.1 33B Thinking is a Japanese-English reasoning release with new SFT and preference training.
Launch date Research releaseDownloadable - LLM-jp-4 33B Base
LLM-jp / NII LLMC · LLM-jp-4
LLM-jp-4 33B Base provides Japanese and English text pretraining weights with a 65,536-token context.
Launch date not confirmedResearch releaseDownloadable