Hercule Hindi
This Hercule release is the Hindi full fine-tuning member of AI4Bharat's CIA evaluation suite. It derives from Llama-3.1-8B-Instruct.
The evaluator needs a reference and a scoring rubric
Its prompt includes the instruction, candidate response, reference answer and score definitions. It uses English references to judge multilingual answers. The publisher supplies separate language releases and training variants.Hercule Hindi official model card
Treat the score as one evaluation signal
Practical guidance. Check Hindi judgments against human examples from the domain you need. An English reference can omit a cultural or linguistic detail that matters in the candidate response.
Specifications & access
| Detail | Value and conditions |
|---|---|
| Access | Downloadable |
| Model identifiers | hercule-hi |
| Training data | INTEL; evaluated by the authors on RECON.Hercule Hindi official model card |
| Output | Written feedback and a score from 1 to 5, using a reference answer and rubric.Hercule Hindi official model card |
| Terms | The card declares MIT; the Llama 3.1 base has additional upstream terms.Hercule Hindi official model card |
Related models
- Hercule Hindi LoRA
AI4Bharat · Hercule
Hindi answer-evaluation model from Hercule's LoRA-designated releases.
Launch date not confirmedDownloadable - Llama-Prometheus
AI4Bharat · CIA Suite
English answer evaluator adapted from Llama-3.1-8B-Instruct using Feedback-Collection and Prometheus 2 training.
Launch date not confirmedDownloadable