[tflite] add xnnpack delegate to label_image #37890
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
rebase and resubmit #36749 to see if it works.
The XNNPACK Delegate uses XNNPACK, a fairly optimized floating point library, to run some inference operators (see the delegate's README for currently supported ops). With XNNPACK, I was able to get performance numbers similar to what @Maratyszcza described at XNNPACK's readme. I also got good numbers on Pixel 4 and Oppo Reno 3. Numbers on x86 machines are also good.
label_image -m MODEL_NAME -x 1 -c 50 -t 1
label_image -m MODEL_NAME -x 1 -c 50 -t NUMBER_OF_BIG_CORES