Repository navigation
Version 0.2.0
0.2.0 adds fallback in case of compilation failure and adds several additional improvements:
- Fallback to opaque graph on compilation failure (supports patching input, output, buffers, and parameters)
- Add ExtractionOptions controlling graph extraction
- Better
acceleratesupport (now supports CPU and disk offloading) generate()now supported with patching fortransformersmodels implementingGenerationMixin- Support for
torch2.2 and 2.3 releases
What's Changed
- Self-review for v.0.2.0 update by @evan-lloyd in #1
Full Changelog: v0.1.0...v0.2.0