Hermes 3 Llama 3.1 70B

Hermes 3 Llama 3.1 70B supports general conversation, reasoning and structured responses. It is a Nous post-training release of a Meta base model.

Training and model behavior

The 70B release applies Hermes 3 post-training to Llama 3.1. It uses ChatML to carry roles and system instructions, including structured-output and function-calling prompts.Hermes 3 Llama 3.1 70B model card

Working with this model

Practical guidance. Use the shipped chat template when migrating a conversation. Compare instruction following and tool syntax on your own prompts. A larger parameter count increases memory requirements but does not guarantee better answers on every task.

Download formats

Nous also publishes GGUF and FP8 packages for this model. These are deployment formats of the same release.Hermes 3 Llama 3.1 70B GGUF packageHermes 3 Llama 3.1 70B FP8 package

Specifications & access

Hermes 3 Llama 3.1 70B specifications
DetailValue and conditions
Launch dateAugust 2024
AccessDownloadable
Model identifiersNousResearch/Hermes-3-Llama-3.1-70B
Context window131,072 tokens

Configured position limit; practical serving limits depend on the runtime.

Hermes 3 Llama 3.1 70B configuration
Base modelmeta-llama/Meta-Llama-3.1-70BHermes 3 Llama 3.1 70B model card
Repository license labelllama3Hermes 3 Llama 3.1 70B model card

Related models