v1.8.1
What's Changed
- Fix memory surge/OOM crash during inference on SME-capable ARM64 devices (iPhone A18+/M4+) caused by a KleidiAI convolution memory regression in ONNX Runtime 1.24.x (#66, upstream microsoft/onnxruntime#29538) (#68). Thanks to @runoob-coder for reporting this and helping debug!
- Move ONNX Runtime to 1.23.0 on all platforms: Android upgraded from 1.22.0; iOS/macOS downgraded from 1.24.2 via a masicai fork of the ONNX Runtime Swift package (Microsoft's SPM repo has no 1.23.x tag)
- Add save model extraction from assets to avoid ORT loading corrupted models (#67)
- Add true bool support on iOS/macOS via a C++ bridge (#69)
Full Changelog: v1.8.0...v1.8.1