Releases: ondeinference/onde
Releases · ondeinference/onde
Release list
1.1.4
Onde Inference Kotlin SDK 1.1.4
On-device LLM inference for Android and JVM (macOS Apple Silicon).
Add to your project
// build.gradle.kts
dependencies {
implementation("com.ondeinference:onde-inference:1.1.4")
}What's included
| Target | Backend | Default model |
|---|---|---|
Android (arm64-v8a, armeabi-v7a, x86_64, x86) |
CPU (Candle) | Qwen 2.5 1.5B (~941 MB) |
| JVM (macOS Apple Silicon) | Metal | Qwen 2.5 3B (~1.93 GB) |
Usage
// Android
val onde = OndeInference(applicationContext)
// JVM (macOS)
val onde = OndeInference()
// Shared API
val elapsed = onde.loadDefaultModel(systemPrompt = "You are helpful.")
val result = onde.chat("Hello!")
onde.stream("Tell me a story.").collect { chunk -> print(chunk.delta) }See the README for full API docs.
Full Changelog: 1.1.3...1.1.4
1.1.3
Onde Inference Kotlin SDK 1.1.3
On-device LLM inference for Android and JVM (macOS Apple Silicon).
Add to your project
// build.gradle.kts
dependencies {
implementation("com.ondeinference:onde-inference:1.1.3")
}What's included
| Target | Backend | Default model |
|---|---|---|
Android (arm64-v8a, armeabi-v7a, x86_64, x86) |
CPU (Candle) | Qwen 2.5 1.5B (~941 MB) |
| JVM (macOS Apple Silicon) | Metal | Qwen 2.5 3B (~1.93 GB) |
Usage
// Android
val onde = OndeInference(applicationContext)
// JVM (macOS)
val onde = OndeInference()
// Shared API
val elapsed = onde.loadDefaultModel(systemPrompt = "You are helpful.")
val result = onde.chat("Hello!")
onde.stream("Tell me a story.").collect { chunk -> print(chunk.delta) }See the README for full API docs.
Full Changelog: 1.1.2...1.1.3
1.1.2
Onde Inference Kotlin SDK 1.1.2
On-device LLM inference for Android and JVM (macOS Apple Silicon).
Add to your project
// build.gradle.kts
dependencies {
implementation("com.ondeinference:onde-inference:1.1.2")
}What's included
| Target | Backend | Default model |
|---|---|---|
Android (arm64-v8a, armeabi-v7a, x86_64, x86) |
CPU (Candle) | Qwen 2.5 1.5B (~941 MB) |
| JVM (macOS Apple Silicon) | Metal | Qwen 2.5 3B (~1.93 GB) |
Usage
// Android
val onde = OndeInference(applicationContext)
// JVM (macOS)
val onde = OndeInference()
// Shared API
val elapsed = onde.loadDefaultModel(systemPrompt = "You are helpful.")
val result = onde.chat("Hello!")
onde.stream("Tell me a story.").collect { chunk -> print(chunk.delta) }See the README for full API docs.
Full Changelog: 1.1.1...1.1.2
1.1.1
Onde Inference Kotlin SDK 1.1.1
On-device LLM inference for Android and JVM (macOS Apple Silicon).
Add to your project
// build.gradle.kts
dependencies {
implementation("com.ondeinference:onde-inference:1.1.1")
}What's included
| Target | Backend | Default model |
|---|---|---|
Android (arm64-v8a, armeabi-v7a, x86_64, x86) |
CPU (Candle) | Qwen 2.5 1.5B (~941 MB) |
| JVM (macOS Apple Silicon) | Metal | Qwen 2.5 3B (~1.93 GB) |
Usage
// Android
val onde = OndeInference(applicationContext)
// JVM (macOS)
val onde = OndeInference()
// Shared API
val elapsed = onde.loadDefaultModel(systemPrompt = "You are helpful.")
val result = onde.chat("Hello!")
onde.stream("Tell me a story.").collect { chunk -> print(chunk.delta) }See the README for full API docs.
Full Changelog: 1.1.0...1.1.1
Full Changelog: 1.1.0...1.1.1
1.1.0
1.0.0
0.1.7
Full Changelog: 0.1.6...0.1.7
Full Changelog: 0.1.6...0.1.7
0.1.6
0.1.5
What's Changed
- feat(sdk): add Dart SDK by @keypair34 in #1
New Contributors
- @keypair34 made their first contribution in #1
Full Changelog: https://github.com/ondeinference/onde/commits/0.1.5