Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rknn: add more cpus #1451

Merged
merged 5 commits into from
Apr 28, 2024
Merged

rknn: add more cpus #1451

merged 5 commits into from
Apr 28, 2024

Conversation

bjia56
Copy link
Collaborator

@bjia56 bjia56 commented Apr 28, 2024

The additional CPUs are supported by Rockchip's model converter tool, but unknown if they will actually properly run Scrypted and the rknn plugin. These models have been converted and uploaded here: https://github.com/bjia56/scrypted-rknn/tree/main/models

@bjia56 bjia56 changed the title rknn: add more cpus, refactor runtime selection to use queues rknn: add more cpus Apr 28, 2024
@bjia56
Copy link
Collaborator Author

bjia56 commented Apr 28, 2024

The queue-based runtime selection approach was reverted because it caused a drop of 5-10 detections per second compared to the dict method.

@koush koush merged commit 6d520dc into koush:main Apr 28, 2024
@koush
Copy link
Owner

koush commented Apr 28, 2024

Weird, need to switch tf over to that as well. May be a python lock perf issue.

@bjia56 bjia56 deleted the rknn branch April 28, 2024 14:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants