Skip to content

NorEval v1.0

Choose a tag to compare

@vmkhlv vmkhlv released this 23 Sep 15:37
· 72 commits to main since this release

First versioned release of NorEval, the Norwegian language understanding and generation evaluation benchmark described in our ACL 2025 Findings paper.

This release includes:

  • 24 datasets for Norwegian Bokmål and Nynorsk, integrated into LM Evaluation Harness (lm_eval/tasks/noreval)
  • Annotation guidelines for human baselines, prompt writing, NorRewrite-Instruct and NorSummarize-Instruct
  • Example task groups and result-processing scripts in tools/