Skip to content

HumanEval+ v0.1.9

Choose a tag to compare

@ganler ganler released this 22 Jan 07:11
· 2 commits to main since this release

HumanEval+ dataset, revision v0.1.9:

  • HumanEvalPlus-OriginFmt.jsonl.gz: The (compressed) HumanEval+ dataset that follows the original HumanEval format and is designed to be compatible with existing evaluation frameworks targetting the original HumanEval.
  • HumanEvalPlus.jsonl.gz: The (compressed) HumanEval+ dataset that follows the EvalPlus format and is designed to be used by the evalplus framework.
  • HumanEvalPlus-Mini.jsonl.gz: HumanEvalPlus.jsonl.gz with fewer test-cases yet achieving similar effectiveness.

See also https://huggingface.co/datasets/evalplus/humanevalplus