AI4BharatHercule

Hercule Telugu

This Hercule release is the Telugu full fine-tuning member of AI4Bharat's CIA evaluation suite. It derives from Llama-3.1-8B-Instruct.

The evaluator needs a reference and a scoring rubric

Its prompt includes the instruction, candidate response, reference answer and score definitions. It uses English references to judge multilingual answers. The publisher supplies separate language releases and training variants.Hercule Telugu official model card

Treat the score as one evaluation signal

Practical guidance. Check Telugu judgments against human examples from the domain you need. An English reference can omit a cultural or linguistic detail that matters in the candidate response.

Specifications & access

Hercule Telugu specifications
DetailValue and conditions
AccessDownloadable
Model identifiershercule-te
Training dataINTEL; evaluated by the authors on RECON.Hercule Telugu official model card
OutputWritten feedback and a score from 1 to 5, using a reference answer and rubric.Hercule Telugu official model card
TermsThe card declares MIT; the Llama 3.1 base has additional upstream terms.Hercule Telugu official model card

Related models

  • LoRA-designated Hercule evaluator for Telugu model answers using English references.

    Launch date not confirmedDownloadable
  • English answer evaluator adapted from Llama-3.1-8B-Instruct using Feedback-Collection and Prometheus 2 training.

    Launch date not confirmedDownloadable