Repository navigation
use ggml in android NDK #1524
Unanswered
psilogroup
asked this question in
Q&A
Replies: 1 comment
|
Since you've already built llama.cpp with the Android NDK, the next step is to expose the required ggml functions through JNI. Package the generated .so libraries for your target ABIs, load them with System.loadLibrary(), and use JNI methods to pass image data from Android to native C++ code. For YOLO, you'll also need the appropriate model and preprocessing/postprocessing pipeline; ggml alone doesn't automatically provide YOLO inference. |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Here's a corrected version:
It's possible to use ggml with the Android NDK. I successfully built llama.cpp, which also built the ggml libraries.
Now I'm trying to figure out how to use the built libraries in a custom Android app. My final goal is to make an Android app that runs YOLO for real-time object detection.
Thanks.
All reactions