Skip to content

v0.5.3

Choose a tag to compare

@github-actions github-actions released this 30 Sep 01:39
· 76 commits to main since this release

Added (M11)

  • Evaluation framework integrations (integrations/): lm_eval,
    lighteval, inspect_ai — each detects usage (imports, CLI invocations),
    extracts task names from framework config files (lm-eval task YAMLs,
    inspect-ai @task decorators) for init pre-filling, and reports
    installed versions. They never import the target library.
  • docs/integrations/ — manifest examples and recorded-run snippets for
    lm-evaluation-harness, lighteval, and inspect-ai.
  • docs/integrations/card-snippets.md — copy-paste reproducibility snippets
    for Hugging Face model cards, dataset cards, and paper artifact READMEs.