Llama-Mimi 8B

Llama-Mimi 8B uses a single Llama decoder to model interleaved semantic and acoustic audio tokens. Its card identifies Meta Llama 3.1 8B as the base.

Research release

One decoder models semantic and acoustic tokens

The method uses the Mimi tokenizer rather than separate language and acoustic model stages. The released usage example continues an audio prompt. This is distinct from LLM-jp's Japanese conversational Moshi adaptation.Llama-Mimi 8B official model card

Evaluate the continuation task

Practical guidance. Use the larger model for a same-method comparison with Llama-Mimi 1.3B. Keep the audio prompt and generation settings fixed when evaluating speaker continuity.

Specifications & access

Llama-Mimi 8B specifications
DetailValue and conditions
StatusResearch release
AccessDownloadable
Model identifiersLlama-Mimi-8B
TrainingApproximately 240,000 hours of English audio.Llama-Mimi 8B official model card
LicenseLlama 3.1 Community License.Llama-Mimi 8B official model card
Input and outputAudio prompt to generated audio continuation.Llama-Mimi 8B official model card

Related models

  • An English speech-continuation model derived from Meta Llama 3.2 1B and Mimi audio tokenization.

    Launch date not confirmedResearch releaseDownloadable
  • A Japanese full-duplex speech-dialogue derivative of Kyutai's Moshi model.

    Launch date not confirmedResearch releaseDownloadable