KyutaiARC Encoder
ARC4 Encoder Llama
ARC4 Encoder Llama compresses text into representations that a language-model decoder can use. Its pooling factor is 4. The Llama decoder determines its training compatibility.
Research release
The encoder does not answer by itself
Its output is an encoded representation, not a finished reply. Downstream use needs a compatible decoder and may require further tuning. Even the Mistral-named variant retains Llama ancestry in its encoder; the name describes the target decoder.ARC4_Encoder_Llama: Kyutai model card
Specifications & access
| Detail | Value and conditions |
|---|---|
| Status | Research release |
| Access | Downloadable |
| Model identifiers | kyutai/ARC4_Encoder_Llama |
| Encoder ancestry | Llama 3.2 3B backbone.ARC4_Encoder_Llama: Kyutai model card |
| Terms | CC BY 4.0 plus the applicable Llama terms.ARC4_Encoder_Llama: Kyutai model card |
Related models
A Moshika speech front end that receives retrieved text while an audio conversation continues.
Launch date not confirmedResearch releaseDownloadable