Repository navigation
v0.2.4
⚠️ Breaking Changes
- [Rename]
InferenceConfig->LangModelInferConfig. - [Rename]
KvCacheConfig->KVCacheConfig.
Refactorings & Updates
- refactor(tvm): Migrate TVM internal logic from cpp shim to Rust native crates by @khj809 in #342
- refactor(cache): enable lazy loading for cache entries by @khj809 in #343
- refactor(tvmjs): Migrate model-specific logics from JS shim to Rust by @khj809 in #344
- refactor(scope): public scope of mods and exports by @khj809 in #345
- chore(docs): Update docs by @khj809 in #346
Full Changelog: v0.2.3...v0.2.4