Repository navigation
v0.2.27
What's Changed
- Add quantize/compile support for ~1.9x GPU speedup by @maxwbuckley in #342
- Feature/prompt compression by @Ingvarstep in #345
- Feature/serving by @Ingvarstep in #346
- Load from_pretrained at target dtype; restrict
quantize=to int8 by @maxwbuckley in #348 - Implement a proper gliner client, fix bugs by @Ingvarstep in #352
- Fix 35 pre-existing test failures; add CI workflow by @maxwbuckley in #351
- Add variant= to from_pretrained for selective half-precision downloads by @maxwbuckley in #354
- Add low_cpu_mem_usage=True to from_pretrained for ~2x faster cold starts by @maxwbuckley in #355
- Fix/train eval by @Ingvarstep in #356
- Add github workflow for automatic PyPI releases by @Ingvarstep in #357
Full Changelog: v0.2.26...v0.2.27