Falcon2 11B
Falcon2 11B is a raw pretrained text model with published weights. It is a foundation for further training, not an instruction-tuned chat checkpoint.
Research release
Training and release background
Its training combined English and European-language web data with technical, code and conversational material. Four stages increased the training length from 2,048 to 8,192 tokens and ended with higher-quality data. The card points to Falcon3-7B-Base as a newer model.Falcon2 11B model card
Plan the adaptation before using it
Practical guidance. For a fine-tuning project, define the target task and output format before selecting this base model. Chat-style prompts do not turn a raw checkpoint into an instruction model. A comparison with newer bases should use the same training data and budget.
Specifications & access
| Detail | Value and conditions |
|---|---|
| Status | Research release |
| Access | Downloadable |
| Model identifiers | tiiuae/falcon-11B |
| License | TII Falcon License 2.0Falcon2 11B model card |
| Release status | Earlier release; published weight access remains availableFalcon2 11B model card |
Related models
A 7B transformer language model for English, French, Spanish and Portuguese with a 32K context.
Launch date December 2024Downloadable