LLM-jp / NII LLMCLLM-jp Document AI

LayoutLMv3 Japanese Preview

LayoutLMv3 Japanese Preview adapts the LayoutLMv3 architecture to Japanese documents. Its tokenizer comes from Waseda's Japanese RoBERTa, and its visual tokenizer uses BEiT v2 VQ-KD.

Preview

The processor needs Japanese word alignment

The standard LayoutLMv3Processor cannot be used unchanged. The card combines the Japanese tokenizer with LayoutLMv3ImageProcessor and aligns word boxes to subwords. PyMuPDF is an optional PDF-rendering and preprocessing tool, not an included learned OCR model.LayoutLMv3 Japanese Preview official model card

Check OCR and bounding boxes first

Practical guidance. A document workflow needs reliable Japanese text and word positions before this encoder can use them. Evaluate extraction quality through that full input path instead of attributing every error to the model.

Specifications & access

LayoutLMv3 Japanese Preview specifications
DetailValue and conditions
StatusPreview
AccessDownloadable
Model identifierslayoutlmv3-japanese-preview
Training dataMore than 20 million NDL WARP pages, plus PubLayNet and DocLayNet.LayoutLMv3 Japanese Preview official model card
LicenseApache 2.0 for the published model.LayoutLMv3 Japanese Preview official model card
Model rolePretrained document encoder; task heads require downstream fine-tuning.LayoutLMv3 Japanese Preview official model card

Related models

  • A Japanese pretrained text encoder with an 8,192-token sequence limit and ModernBERT architecture.

    Launch date not confirmedResearch releaseDownloadable
  • A Japanese-English vision-language reasoning model that changes both the language backbone and training data from the beta.

    Launch date not confirmedResearch releaseDownloadable