Repository navigation
NorEval v1.0
First versioned release of NorEval, the Norwegian language understanding and generation evaluation benchmark described in our ACL 2025 Findings paper.
This release includes:
- 24 datasets for Norwegian Bokmål and Nynorsk, integrated into LM Evaluation Harness (
lm_eval/tasks/noreval) - Annotation guidelines for human baselines, prompt writing, NorRewrite-Instruct and NorSummarize-Instruct
- Example task groups and result-processing scripts in
tools/