Falcon H1 3B Instruct
Falcon H1 3B Instruct is a multilingual text model in TII's hybrid H1 family. The repository provides an instruction checkpoint under the Falcon-LLM License.
The middle H1 configuration
Its configuration sets 32 layers, a hidden width of 2,560 and 131,072 positions. The release includes a separate base checkpoint for further model training.Falcon-H1-3B-Instruct configurationFalcon H1 architecture and release
Choose the checkpoint for the task
Practical guidance. Use Instruct when the input is a user request. For continued pretraining, evaluate the separate base weights. Keep the exact checkpoint name with the results so a change in instruction training is not mistaken for a hardware difference.
Specifications & access
| Detail | Value and conditions |
|---|---|
| Access | Downloadable |
| Model identifiers | tiiuae/Falcon-H1-3B-InstructFalcon-H1-3B-Base |
| Context window | 131,072 tokens max_position_embeddings in the instruction checkpoint configuration; effective recall depends on the task. Falcon-H1-3B-Instruct configuration |
| License | Falcon-LLM LicenseFalcon-H1-3B-Instruct model card |
| Layers and width | 32 layers; hidden width 2560Falcon-H1-3B-Instruct configuration |
Related models
Falcon H1 7B Instruct is a multilingual hybrid model with a published 262,144-position configuration.
Launch date not confirmedDownloadable