Skip to content

Onde Inference SDK v1.3.5

Choose a tag to compare

@github-actions github-actions released this 31 Oct 12:42
· 24 commits to main since this release
0f0c973

Onde Inference runs LLMs on-device on iOS, macOS, tvOS, Android, Windows and Linux.
One Rust core, with SDKs for Swift, Kotlin, Flutter, React Native and Rust.

Swift (iOS, macOS, tvOS)

.package(url: "https://github.com/ondeinference/onde-swift", from: "1.3.5")

  • Write GitHub Release notes per SDK
  • Fix the 32-bit Android build and the uniffi-bindgen path

Kotlin Multiplatform (Android, JVM)

implementation("com.ondeinference:onde-inference:1.3.5")

  • Write GitHub Release notes per SDK
  • Fix the 32-bit Android build and the uniffi-bindgen path

Flutter

flutter pub add onde_inference · Changelog

1.3.5

  • Fixes the 32-bit Android (armv7) build by moving to onde-mistralrs-core 0.9.6, and fixes the Swift XCFramework and Kotlin binding scripts that looked for uniffi-bindgen in the wrong directory.
  • Fixes the in-repo iOS, macOS, Linux and Windows builds of the Rust bridge, which looked for rust/target/. The build files now ask cargo metadata for the target directory. Removes the unused rust/Cargo.lock.

1.3.4

  • The core now builds on onde-mistralrs 0.9.5. Paged attention is turned off on iOS, tvOS, visionOS and watchOS to stay inside the memory budget there.

1.3.3

  • The Rust bridge crate (sdk/dart/rust) is now a member of the onde Cargo workspace and inherits tokio, thiserror, log, and smbcloud-gresiq-sdk from the new [workspace.dependencies] table. Resolved versions are unchanged.

React Native

npm install @ondeinference/react-native · Changelog

1.3.5

  • Fixes the 32-bit Android (armv7) build by moving to onde-mistralrs-core 0.9.6, and fixes the Swift XCFramework and Kotlin binding scripts that looked for uniffi-bindgen in the wrong directory.
  • Fixes scripts/build-rust.sh, which looked for artifacts in rust/target/, and drops the unused rust/Cargo.lock from the package. The script now asks cargo metadata for the target directory.

1.3.4

  • The core now builds on onde-mistralrs 0.9.5. Paged attention is turned off on iOS, tvOS, visionOS and watchOS to stay inside the memory budget there.

1.3.3

  • The Rust bridge crate (sdk/react-native/rust) is now a member of the onde Cargo workspace and inherits tokio, serde, serde_json, and log from the new [workspace.dependencies] table. Resolved versions are unchanged.

Rust

cargo add onde · Changelog

1.3.5

Build fixes
  • Moves onde-mistralrs-core to 0.9.6. 0.9.5 did not compile for 32-bit targets: MAX_UNIFIED_RESERVE in memory_plan.rs is 16 * GIB, which overflows a 32-bit usize, so armv7-linux-androideabi failed with E0080. 0.9.6 saturates the constant and parses the memory plan in u64.
  • .github/scripts/build-swift-xcframework.sh and sdk/kotlin/scripts/generate-bindings.sh looked for uniffi-bindgen in uniffi-bindgen/target/release/. Since onde became a Cargo workspace the binary lands in the root target/release/, so the Swift script failed at the first generate call. Both now use the workspace path.
  • CI now also runs cargo check for armv7-linux-androideabi, so 32-bit breakage shows up on pull requests.
  • sdk/react-native/scripts/build-rust.sh, the Dart iOS and macOS podspec script phases, and the Dart Linux and Windows CMakeLists.txt assumed rust/target/. Since the SDK bridge crates became workspace members their output is in the root target/, so the copy and link steps missed it. Each now asks cargo metadata for target_directory. The two per-SDK Cargo.lock files were dead (cargo only reads the root lock) and are removed; sync-release-version.py and make relock now touch just the root lock.
Packaging
  • No public API changes.
  • 1.3.3 and 1.3.4 never reached Maven Central or onde-swift (the 1.3.4 Kotlin build failed on armv7 and the Swift script failed on the bindgen path), so onde-swift is still on 1.3.2. 1.3.5 is the first release since 1.3.2 to ship to every registry.

1.3.4

Inference engine
  • Moves onde-mistralrs and onde-mistralrs-core from 0.9.3 to 0.9.5 on every target. The new crates merge upstream mistral.rs 0.9.5 into the fork and add visionOS and watchOS arms to the Metal embedded_library! macro, so --features metal builds for tvOS, visionOS and watchOS again.
  • Upstream made Metal paged attention the default. Its KV block pool does not fit in memory on iOS, tvOS, visionOS or watchOS, so model loading (and the validation load in hf_cache) now calls without_paged_attn() on those targets. Desktop and Android are unchanged.
  • On tvOS the auto device map override is replaced by with_max_model_len(512).
Packaging
  • No public API changes: the published onde crate surface is identical to 1.3.3.
  • All version sources (root, Kotlin, Dart, React Native, and the root and per-SDK lockfiles) are aligned on 1.3.4.

1.3.3

Cargo workspace
  • onde is now a hybrid root-package Cargo workspace. Members are the root onde crate, the uniffi-bindgen helper, sdk/dart/rust, and sdk/react-native/rust; the React Native example app is excluded. No files moved, and the root package is still the publishable crate.
  • Shared dependency versions (log, serde, serde_json, thiserror, tokio, uniffi, smbcloud-gresiq-sdk) are hoisted into [workspace.dependencies]. Each member opts in with workspace = true and keeps its own feature list, so only the version requirement is shared. Resolved versions are unchanged.
Packaging
  • No public API changes: the published onde crate surface is identical to 1.3.2.
  • Completes the 1.3.2 version propagation that release commit f45253b missed and that never reached the tagged commit, sdk/react-native/rust/Cargo.toml, the React Native changelog, and the onde-react-native entry in the root lockfile were still on 1.3.1 at tag 1.3.2. All version sources are aligned on 1.3.3 here.

Pull requests

Full changelog: 1.3.2...1.3.5


Install guides and API reference: Onde Inference SDKs for Swift, Kotlin, Flutter, React Native and Rust