AI4BharatHercule

Hercule German

This Hercule release is the German full fine-tuning member of AI4Bharat's CIA evaluation suite. It derives from Llama-3.1-8B-Instruct.

The evaluator needs a reference and a scoring rubric

Its prompt includes the instruction, candidate response, reference answer and score definitions. It uses English references to judge multilingual answers. The publisher supplies separate language releases and training variants.Hercule German official model card

Treat the score as one evaluation signal

Practical guidance. Check German judgments against human examples from the domain you need. An English reference can omit a cultural or linguistic detail that matters in the candidate response.

Specifications & access

Hercule German specifications
DetailValue and conditions
AccessDownloadable
Model identifiershercule-de
Training dataINTEL; evaluated by the authors on RECON.Hercule German official model card
OutputWritten feedback and a score from 1 to 5, using a reference answer and rubric.Hercule German official model card
TermsThe card declares MIT; the Llama 3.1 base has additional upstream terms.Hercule German official model card

Related models

  • LoRA-designated Llama-3.1-8B-Instruct adaptation for evaluating German model answers.

    Launch date not confirmedDownloadable
  • English answer evaluator adapted from Llama-3.1-8B-Instruct using Feedback-Collection and Prometheus 2 training.

    Launch date not confirmedDownloadable