Skip to content

v0.2.4

Choose a tag to compare

@khj809 khj809 released this 06 Jan 12:04
· 153 commits to main since this release
66fdf68

⚠️ Breaking Changes

  • [Rename] InferenceConfig -> LangModelInferConfig.
  • [Rename] KvCacheConfig -> KVCacheConfig.

Refactorings & Updates

  • refactor(tvm): Migrate TVM internal logic from cpp shim to Rust native crates by @khj809 in #342
  • refactor(cache): enable lazy loading for cache entries by @khj809 in #343
  • refactor(tvmjs): Migrate model-specific logics from JS shim to Rust by @khj809 in #344
  • refactor(scope): public scope of mods and exports by @khj809 in #345
  • chore(docs): Update docs by @khj809 in #346

Full Changelog: v0.2.3...v0.2.4