AI4BharatHercule

Hercule German LoRA

This Hercule release is the German LoRA-designated member of AI4Bharat's CIA evaluation suite. It derives from Llama-3.1-8B-Instruct.

The evaluator needs a reference and a scoring rubric

Its prompt includes the instruction, candidate response, reference answer and score definitions. It uses English references to judge multilingual answers. The publisher supplies separate language releases and training variants.Hercule German LoRA official model card

Treat the score as one evaluation signal

Practical guidance. Check German judgments against human examples from the domain you need. An English reference can omit a cultural or linguistic detail that matters in the candidate response.

Specifications & access

Hercule German LoRA specifications
DetailValue and conditions
AccessDownloadable
Model identifiershercule-de-lora
Training dataINTEL; evaluated by the authors on RECON.Hercule German LoRA official model card
OutputWritten feedback and a score from 1 to 5, using a reference answer and rubric.Hercule German LoRA official model card
TermsThe card declares MIT; the Llama 3.1 base has additional upstream terms.Hercule German LoRA official model card

Related models

  • Fully fine-tuned Hercule model for evaluating German answers against English references.

    Launch date not confirmedDownloadable
  • English answer evaluator adapted from Llama-3.1-8B-Instruct using Feedback-Collection and Prometheus 2 training.

    Launch date not confirmedDownloadable