Hercule Bengali
This Hercule release is the Bengali full fine-tuning member of AI4Bharat's CIA evaluation suite. It derives from Llama-3.1-8B-Instruct.
The evaluator needs a reference and a scoring rubric
Its prompt includes the instruction, candidate response, reference answer and score definitions. It uses English references to judge multilingual answers. The publisher supplies separate language releases and training variants.Hercule Bengali official model card
Treat the score as one evaluation signal
Practical guidance. Check Bengali judgments against human examples from the domain you need. An English reference can omit a cultural or linguistic detail that matters in the candidate response.
Specifications & access
| Detail | Value and conditions |
|---|---|
| Access | Downloadable |
| Model identifiers | hercule-bn |
| Training data | INTEL; evaluated by the authors on RECON.Hercule Bengali official model card |
| Output | Written feedback and a score from 1 to 5, using a reference answer and rubric.Hercule Bengali official model card |
| Terms | The card declares MIT; the Llama 3.1 base has additional upstream terms.Hercule Bengali official model card |
Related models
- Hercule Bengali LoRA
AI4Bharat · Hercule
LoRA-designated Hercule evaluator for Bengali model answers using English references.
Launch date not confirmedDownloadable - Llama-Prometheus
AI4Bharat · CIA Suite
English answer evaluator adapted from Llama-3.1-8B-Instruct using Feedback-Collection and Prometheus 2 training.
Launch date not confirmedDownloadable