Repository navigation
Onde Inference SDK v1.3.5
Onde Inference runs LLMs on-device on iOS, macOS, tvOS, Android, Windows and Linux.
One Rust core, with SDKs for Swift, Kotlin, Flutter, React Native and Rust.
Swift (iOS, macOS, tvOS)
.package(url: "https://github.com/ondeinference/onde-swift", from: "1.3.5")
- Write GitHub Release notes per SDK
- Fix the 32-bit Android build and the uniffi-bindgen path
Kotlin Multiplatform (Android, JVM)
implementation("com.ondeinference:onde-inference:1.3.5")
- Write GitHub Release notes per SDK
- Fix the 32-bit Android build and the uniffi-bindgen path
Flutter
flutter pub add onde_inference · Changelog
1.3.5
- Fixes the 32-bit Android (
armv7) build by moving toonde-mistralrs-core0.9.6, and fixes the Swift XCFramework and Kotlin binding scripts that looked foruniffi-bindgenin the wrong directory. - Fixes the in-repo iOS, macOS, Linux and Windows builds of the Rust bridge, which looked for
rust/target/. The build files now askcargo metadatafor the target directory. Removes the unusedrust/Cargo.lock.
1.3.4
- The core now builds on
onde-mistralrs0.9.5. Paged attention is turned off on iOS, tvOS, visionOS and watchOS to stay inside the memory budget there.
1.3.3
- The Rust bridge crate (
sdk/dart/rust) is now a member of theondeCargo workspace and inheritstokio,thiserror,log, andsmbcloud-gresiq-sdkfrom the new[workspace.dependencies]table. Resolved versions are unchanged.
React Native
npm install @ondeinference/react-native · Changelog
1.3.5
- Fixes the 32-bit Android (
armv7) build by moving toonde-mistralrs-core0.9.6, and fixes the Swift XCFramework and Kotlin binding scripts that looked foruniffi-bindgenin the wrong directory. - Fixes
scripts/build-rust.sh, which looked for artifacts inrust/target/, and drops the unusedrust/Cargo.lockfrom the package. The script now askscargo metadatafor the target directory.
1.3.4
- The core now builds on
onde-mistralrs0.9.5. Paged attention is turned off on iOS, tvOS, visionOS and watchOS to stay inside the memory budget there.
1.3.3
- The Rust bridge crate (
sdk/react-native/rust) is now a member of theondeCargo workspace and inheritstokio,serde,serde_json, andlogfrom the new[workspace.dependencies]table. Resolved versions are unchanged.
Rust
cargo add onde · Changelog
1.3.5
Build fixes
- Moves
onde-mistralrs-coreto0.9.6.0.9.5did not compile for 32-bit targets:MAX_UNIFIED_RESERVEinmemory_plan.rsis16 * GIB, which overflows a 32-bitusize, soarmv7-linux-androideabifailed with E0080.0.9.6saturates the constant and parses the memory plan inu64. .github/scripts/build-swift-xcframework.shandsdk/kotlin/scripts/generate-bindings.shlooked foruniffi-bindgeninuniffi-bindgen/target/release/. Since onde became a Cargo workspace the binary lands in the roottarget/release/, so the Swift script failed at the firstgeneratecall. Both now use the workspace path.- CI now also runs
cargo checkforarmv7-linux-androideabi, so 32-bit breakage shows up on pull requests. sdk/react-native/scripts/build-rust.sh, the Dart iOS and macOS podspec script phases, and the Dart Linux and WindowsCMakeLists.txtassumedrust/target/. Since the SDK bridge crates became workspace members their output is in the roottarget/, so the copy and link steps missed it. Each now askscargo metadatafortarget_directory. The two per-SDKCargo.lockfiles were dead (cargo only reads the root lock) and are removed;sync-release-version.pyandmake relocknow touch just the root lock.
Packaging
- No public API changes.
1.3.3and1.3.4never reached Maven Central oronde-swift(the1.3.4Kotlin build failed on armv7 and the Swift script failed on the bindgen path), soonde-swiftis still on1.3.2.1.3.5is the first release since1.3.2to ship to every registry.
1.3.4
Inference engine
- Moves
onde-mistralrsandonde-mistralrs-corefrom0.9.3to0.9.5on every target. The new crates merge upstream mistral.rs0.9.5into the fork and add visionOS and watchOS arms to the Metalembedded_library!macro, so--features metalbuilds for tvOS, visionOS and watchOS again. - Upstream made Metal paged attention the default. Its KV block pool does not fit in memory on iOS, tvOS, visionOS or watchOS, so model loading (and the validation load in
hf_cache) now callswithout_paged_attn()on those targets. Desktop and Android are unchanged. - On tvOS the auto device map override is replaced by
with_max_model_len(512).
Packaging
- No public API changes: the published
ondecrate surface is identical to1.3.3. - All version sources (root, Kotlin, Dart, React Native, and the root and per-SDK lockfiles) are aligned on
1.3.4.
1.3.3
Cargo workspace
ondeis now a hybrid root-package Cargo workspace. Members are the rootondecrate, theuniffi-bindgenhelper,sdk/dart/rust, andsdk/react-native/rust; the React Native example app is excluded. No files moved, and the root package is still the publishable crate.- Shared dependency versions (
log,serde,serde_json,thiserror,tokio,uniffi,smbcloud-gresiq-sdk) are hoisted into[workspace.dependencies]. Each member opts in withworkspace = trueand keeps its own feature list, so only the version requirement is shared. Resolved versions are unchanged.
Packaging
- No public API changes: the published
ondecrate surface is identical to1.3.2. - Completes the
1.3.2version propagation that release commitf45253bmissed and that never reached the tagged commit,sdk/react-native/rust/Cargo.toml, the React Native changelog, and theonde-react-nativeentry in the root lockfile were still on1.3.1at tag1.3.2. All version sources are aligned on1.3.3here.
Pull requests
- Add .claude/skills symlink to .agents/skills by @setoelkahfi in #29
- Add sigit factory, code-review, and code-cloud-agent configs by @setoelkahfi in #30
- Convert onde to a Cargo workspace by @setoelkahfi in #24
- Hoist shared dependencies into [workspace.dependencies] by @setoelkahfi in #25
- Ignore node_modules/ at the workspace root by @setoelkahfi in #26
- Move onde-mistralrs to 0.9.5 and release 1.3.4 by @setoelkahfi in #32
- Release 1.3.5: fix the 32-bit Android build and the Swift script by @setoelkahfi in #33
- Write GitHub Release notes per SDK by @setoelkahfi in #34
- Merge development into main for 1.3.5 by @setoelkahfi in #35
Full changelog: 1.3.2...1.3.5
Install guides and API reference: Onde Inference SDKs for Swift, Kotlin, Flutter, React Native and Rust