Nous Hermes 2 Mistral 7B DPO
Nous Hermes 2 Mistral 7B DPO adapts teknium/OpenHermes-2.5-Mistral-7B for instruction following and conversation.
Training and model behavior
Nous applied direct preference optimization to OpenHermes 2.5 Mistral 7B. Its inherited instruction training included about one million conversations and instructions.Nous Hermes 2 Mistral 7B DPO model card
Working with this model
Practical guidance. Preserve the model's ChatML roles and stop tokens. Compare style and factual accuracy separately. Older benchmark positions describe the release period rather than the current model market.
Specifications & access
| Detail | Value and conditions |
|---|---|
| Launch date | |
| Access | Downloadable |
| Model identifiers | NousResearch/Nous-Hermes-2-Mistral-7B-DPO |
| Context window | 32,768 tokens Configured position limit; practical serving limits depend on the runtime. Nous Hermes 2 Mistral 7B DPO configuration |
| Base model | teknium/OpenHermes-2.5-Mistral-7BNous Hermes 2 Mistral 7B DPO model card |
| Repository license label | apache-2.0Nous Hermes 2 Mistral 7B DPO model card |
Related models
- Nous Hermes 2 SOLAR 10.7B
Nous Research · Hermes 2
An earlier instruction-tuned Hermes model with downloadable weights.
Launch date January 2024Downloadable - Nous Hermes 2 Yi 34B
Nous Research · Hermes 2
An earlier instruction-tuned Hermes model with downloadable weights.
Launch date Downloadable - Nous Hermes 2 Llama 2 70B
Nous Research · Hermes 2
An earlier instruction-tuned Hermes model with downloadable weights.
Launch date not confirmedDownloadable