Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

NN-API #45

Closed
skyne98 opened this issue Apr 24, 2023 · 2 comments
Closed

NN-API #45

skyne98 opened this issue Apr 24, 2023 · 2 comments
Assignees
@decahedron1
Labels
enhancement New feature or request needs testing relevant feature is implemented but needs further testing/debugging os: android p: med medium priority stale

Comments

@skyne98
Copy link

skyne98 commented Apr 24, 2023

Hi, thanks for a great project!

I am currently developing a runtime for an RNN-based LLM by converting the original model to ONNX and trying to potentially run it (or parts of it) using the ONNX hardware acceleration capabilities.

My main goal is mobile and running models there without NN-API on modern SoCs can mean ~x12 reduction in efficiency and performance.

Would it be hard to get the NNAPI running + get the downloadable build with it too? 👀

Will be certainly willing to help with testing!
@decahedron1 decahedron1 self-assigned this Apr 24, 2023
@decahedron1 decahedron1 added the enhancement New feature or request label Apr 24, 2023
decahedron1 added a commit that referenced this issue Apr 29, 2023
@decahedron1
feat: android bindings + NNAPI execution provider, ref #45
40a7b85
@decahedron1
Copy link
Member

Sorry for the delay. I added Android bindings + NNAPI execution provider support in 40a7b85, though I haven't had time to fix my Android environment to test it yet.

decahedron1 added a commit that referenced this issue May 1, 2023
@decahedron1
feat: android bindings + NNAPI execution provider, ref #45
a37300c
@skyne98
Copy link
Author

skyne98 commented May 9, 2023

Thanks a lot, I will give it a try when I get some free time to work on the project 👍🏻

@decahedron1 decahedron1 mentioned this issue May 27, 2023
Closed
@decahedron1 decahedron1 added p: med medium priority os: android labels Jun 3, 2023
@decahedron1 decahedron1 added stale needs testing relevant feature is implemented but needs further testing/debugging labels Sep 20, 2023
@decahedron1 decahedron1 mentioned this issue Oct 27, 2023
Merged
8 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@decahedron1 decahedron1

Labels
enhancement New feature or request needs testing relevant feature is implemented but needs further testing/debugging os: android p: med medium priority stale
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@skyne98 @decahedron1