Skip to content

0.5.3

Choose a tag to compare

@hynky1999 hynky1999 released this 17 Feb 14:08
· 32 commits to main since this release

[0.5.3]

  • Added support for multiple antlr4 runtimes:
    • antlr4-python3-runtime==4.13.2
    • antlr4-python3-runtime==4.11.0
    • antlr4-python3-runtime==4.9.3

[0.5.3-pre]

  • Improve process of running evaluate_model.py:
    • Update the README command and installation instructions.
    • Update inference dependencies to "lighteval" instead of "lighteval[accelerate]" to reflect the fact that accelerate is now a main rather than optional dependency of lighteval.
    • Fix import path passed to lighteval/tasks/registry.py.
    • Provide --override-bs as a CLI parameter as an alternative to automatic batch size selection, which does not work well on all hardware.
    • Use available accelerators.