Skip to content

v1.11.0: Extended ONNX, ONNX Runtime, BetterTransformer support

Choose a tag to compare

@JingyaHuang JingyaHuang released this 03 Aug 14:38
· 529 commits to main since this release

Extended ONNX and ONNX Runtime support

Add ONNX export and ONNX Runtime inference support for gpt bigcode.

Extended BetterTransformer support

BetterTransformer now supports Llama 2 and bark.

Training and autocast are now supported for most architectures, please refer to the documentation for more details: https://huggingface.co/docs/optimum/main/en/bettertransformer/overview

  • Support Llama 2 in BetterTransformer. by @noamwies in #1235
  • BetterTransformer support training & autocast for all archs by @fxmarty in #1225
  • Add bark into bettertransformer by @ylacombe in #1199
  • Drop mask for training in all cases for BetterTransformer & precise documentation by @fxmarty in #1250

Major bugfixes

  • Update ORT training to be compatible with transformers 4.31 by @JingyaHuang in #1227

Other improvements and bugfix

New Contributors

Full Changelog: v1.10.0...v1.11.0