v1.9
Whats New
- 50% faster int4
- Parakeet models
- LFM2-MOE models
- BugFixes
- Hybrid Inference
PRs
- fix stt test and add cpp ci by @yujonglee in #413
- add IRFFT by @yujonglee in #425
- fixed lfm2 vlm lmhead issue that came in with hf 5.0.0 by @kar-m in #426
- raspberry pi numebrs and linux fixes by @kar-m in #437
- Added parakeet model by @ParkiratS in #443
- Adding parakeet graph by @ParkiratS in #446
- Parakeet kernel by @ParkiratS in #445
- added cloud fallback and documentation+tests by @kar-m in #369
- Parakeet FFI by @ParkiratS in #447
- Parakeet convert and tests by @ParkiratS in #444
- Hybrid transcription blog post by @rshemet in #449
- Fixed missing engine changes by @ParkiratS in #453
- feat(python): add context manager support for safe resource cleanup by @yogyam in #412
- Completed ubuntu CICD pipeline by @ncylich in #455
- Tie-embed-conversion-fix by @ncylich in #454
- tiny graph fix and added benchmark by @kar-m in #456
Full Changelog: v1.8...v1.9
Breaking changes
Weights unfortunately need to be refreshed for this :(