Falcon 40B Instruct

Falcon 40B Instruct is an early 40B chat model adapted from Falcon-40B. The downloadable release uses Apache 2.0 and remains available as a historical Falcon checkpoint.

Training and release background

Its instruction training used about 150 million Baize tokens mixed with 5% RefinedWeb data. The model uses rotary position embeddings and multiquery attention. The card recommends the separate base release when building a new instruction model.Falcon 40B Instruct model card

Separate historical reproduction from model choice

Practical guidance. Use this checkpoint when its exact training lineage matters to the work. If the task is general writing or extraction, compare it with newer models at the required latency. A larger parameter count by itself is not a reason to prefer an older release.

Specifications & access

Falcon 40B Instruct specifications
DetailValue and conditions
AccessDownloadable
Model identifierstiiuae/falcon-40b-instruct
LicenseApache 2.0Falcon 40B Instruct model card
Release statusEarlier release; published weight access remains availableFalcon 40B Instruct model card

Related models