Skip to content

v0.2.0

Pre-release
Pre-release

Choose a tag to compare

@tjia1818 tjia1818 released this 06 Jul 22:04
0.2.0
9962781

Adopting updated Core AI python packages

  • Adopt latest coreai-core, coreai-torch, coreai-opt python packages from pypi (#78)

New and updated models

  • Swift runner for Whisper, with autoregressive decoding and dynamic-shape tracing on export (#54, #34)
  • Dynamic-shape and batch support for object detector (#29)
  • Qwen3-VL export and VLM runtime support — model definition + export + runner infrastructure (#65, #68)

LLM inference engine update

  • Tool calling support (#9)
  • Guided generation via XGrammar (upstream Swift package) (#23, #45)
  • InferenceStream with StopReason for structured generation termination (#16)
  • Top-P and Min-P sampling across all engines (#48)
  • Multi-turn KV cache reuse — conversation cache persists across turns (#64)
  • Implicit prefix caching (#51)
  • cancel() / isBusy on the InferenceEngine protocol (#32)
  • Graceful exit when pointed at a model asset instead of a bundle directory (#60)

Miscellaneous

  • Diffusion bundles aligned with metadata.json v0.2 schema (#33)
  • Bits-Per-Weight (BPW) added to model cards (#17)
  • Swift 6.2; custom AsyncSequences replace unstructured concurrency (#22, #24)
  • CI (lint/build/test) on self-hosted Apple Silicon runners; GitHub issue templates (#18, #30, #26, #15)
  • Optimize expert selection (#69)