Nous Hermes 2 Mixtral 8x7B DPO
This release adds direct preference optimization after supervised tuning of Mixtral 8x7B. Nous published it alongside the SFT-only version so users can compare the training variants on the same tasks.
Training and model behavior
This release adds direct preference optimization after supervised fine-tuning. Nous publishes it separately from the supervised-only version. Together AI supplied training compute.Nous Hermes 2 Mixtral 8x7B DPO model card
Working with this model
Practical guidance. Preserve the model's ChatML roles and stop tokens. Compare style and factual accuracy separately. Older benchmark positions describe the release period rather than the current model market.
Specifications & access
| Detail | Value and conditions |
|---|---|
| Launch date | |
| Access | Downloadable |
| Model identifiers | NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO |
| Context window | 32,768 tokens Configured position limit; practical serving limits depend on the runtime. Nous Hermes 2 Mixtral 8x7B DPO configuration |
| Base model | mistralai/Mixtral-8x7B-v0.1Nous Hermes 2 Mixtral 8x7B DPO model card |
| Repository license label | apache-2.0Nous Hermes 2 Mixtral 8x7B DPO model card |
Related models
- Nous Hermes 2 SOLAR 10.7B
Nous Research · Hermes 2
An earlier instruction-tuned Hermes model with downloadable weights.
Launch date January 2024Downloadable - Nous Hermes 2 Yi 34B
Nous Research · Hermes 2
An earlier instruction-tuned Hermes model with downloadable weights.
Launch date Downloadable - Nous Hermes 2 Llama 2 70B
Nous Research · Hermes 2
An earlier instruction-tuned Hermes model with downloadable weights.
Launch date not confirmedDownloadable