Sakana AIText-to-LoRA

Text-to-LoRA for Mistral 7B

This trained hypernetwork creates adapters for mistralai/Mistral-7B-Instruct-v0.2. It is an auxiliary model, not a replacement copy of the base language model.

Research release

A task description becomes a trained-model update

The hypernetwork maps a short task description to LoRA parameters. The generated adapter changes the frozen target model's behavior.Text-to-LoRA research announcement

Use the matching target checkpoint

Practical guidance. Load the named target model and its tokenizer. An adapter for another model may have incompatible layer shapes or behavior. Keep the adapter generator's terms separate from the target model's terms.

The demo is grouped with the Mistral-targeted release

The t2l_demo directory targets Mistral-7B-Instruct-v0.2. It is grouped here as a demo checkpoint rather than a separate model page.Text-to-LoRA demo target-model configuration

Specifications & access

Text-to-LoRA for Mistral 7B specifications
DetailValue and conditions
StatusResearch release
AccessDownloadable
Model identifiersSakanaAI/text-to-lora/trained_t2l/mistral_7b_t2l
Target language modelmistralai/Mistral-7B-Instruct-v0.2Text-to-LoRA for Mistral 7B released training arguments
Released directorytrained_t2l/mistral_7b_t2lText-to-LoRA released hypernetwork files
Weight termsNo explicit checkpoint license was identified in the reviewed weight repository.Text-to-LoRA released hypernetwork files
Code licenseApache 2.0Text-to-LoRA code license