Sakana AIDoc-to-LoRA
Doc-to-LoRA for Qwen3 4B
This trained hypernetwork creates adapters for Qwen/Qwen3-4B-Instruct-2507. It is an auxiliary model, not a replacement copy of the base language model.
Research release
A document becomes a trained-model update
The hypernetwork compresses document information into a LoRA adapter. The target model can then answer without receiving the full document again.Doc-to-LoRA model method and distinction from Text-to-LoRA
Use the matching target checkpoint
Practical guidance. Load the named target model and its tokenizer. An adapter for another model may have incompatible layer shapes or behavior. Keep the adapter generator's terms separate from the target model's terms.
Specifications & access
| Detail | Value and conditions |
|---|---|
| Status | Research release |
| Access | Downloadable |
| Model identifiers | SakanaAI/doc-to-lora/qwen_4b_d2l |
| Target language model | Qwen/Qwen3-4B-Instruct-2507Doc-to-LoRA for Qwen3 4B released training arguments |
| Released directory | qwen_4b_d2lDoc-to-LoRA released hypernetwork files |
| Weight terms | No explicit checkpoint license was identified in the reviewed weight repository.Doc-to-LoRA released hypernetwork files |
| Code license | MITDoc-to-LoRA code license |