Skip to content

Version 0.2.0

Choose a tag to compare

@evan-lloyd evan-lloyd released this 04 Jun 00:36
· 53 commits to main since this release

0.2.0 adds fallback in case of compilation failure and adds several additional improvements:

  • Fallback to opaque graph on compilation failure (supports patching input, output, buffers, and parameters)
  • Add ExtractionOptions controlling graph extraction
  • Better accelerate support (now supports CPU and disk offloading)
  • generate() now supported with patching for transformers models implementing GenerationMixin
  • Support for torch 2.2 and 2.3 releases

What's Changed

Full Changelog: v0.1.0...v0.2.0