Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

tflite model giving extremely FPS #448

Closed
AryanSethi opened this issue Apr 10, 2021 · 3 comments
Closed

tflite model giving extremely FPS #448

AryanSethi opened this issue Apr 10, 2021 · 3 comments
Assignees
@lu-wang-g

Comments

@AryanSethi
Copy link

I'm trying to run this tflite model and it's taking about 0.5 seconds for prediction on each frame. While on android and iOS phones, it gives over 20 FPS.

Refer to my issue for more details
@lu-wang-g
Copy link
Member

By "0.5 seconds", do you mean to run it on desktop? If so, it is expected, because TFLite is not specifically optimized for desktop. You can try running tflite with xnnpack (soon, xnnpack will become default), or using the Coral EdgeTpu delegate.

@lu-wang-g lu-wang-g self-assigned this Apr 27, 2021
@AryanSethi
Copy link
Author

@lu-wang-g
Yes, I was running the script on my desktop and as I could see, it wasn't even using my GPU.
So will running it on any edge device solve the problem?

@lu-wang-g
Copy link
Member

I don't think tflite is supported on desktop GPU. Running on Coral edgetpu will give you 20x ~ 60x speed up.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@lu-wang-g lu-wang-g

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@AryanSethi @lu-wang-g