Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

unsupported operators from tensorflow model garden models #7196

Closed
aaltonenzhang opened this issue Jan 4, 2021 · 2 comments
Closed

unsupported operators from tensorflow model garden models #7196

aaltonenzhang opened this issue Jan 4, 2021 · 2 comments

Comments

@aaltonenzhang
Copy link

aaltonenzhang commented Jan 4, 2021

I'm checking tensorflow models from tensorflow models garden at https://github.com/tensorflow/models/tree/master/community.
For community models, there are types and operators which tvm doesn't supported. Most of them are quantize related, and some are not. I really hope these operators could be supported officially and I can check if these models work well.
The details are listed below.

model name result
inceptionv3_int8 Op type not registered 'QuantizedConcatV2'
inceptionv4_int8 Op type not registered 'QuantizedConcatV2'
mobilenetv1_int8 The following operators are not implemented: {'QuantizeV2', 'Dequantize', 'QuantizedAvgPool', 'QuantizedDepthwiseConv2DWithBiasAndReluAndRequantize', 'QuantizedConv2DWithBiasAndReluAndRequantize', 'QuantizedConv2DWithBiasAndRequantize'}
resnet101_int8 The following operators are not implemented: {'Dequantize', 'QuantizedConv2DWithBiasAndRequantize', 'QuantizeV2', 'QuantizedConv2DWithBiasAndReluAndRequantize', 'QuantizedMaxPool', 'QuantizedConv2DWithBiasSignedSumAndReluAndRequantize', 'QuantizedConv2DWithBiasSumAndReluAndRequantize'}
resnet50_int8 The following operators are not implemented: {'Dequantize', 'QuantizeV2', 'QuantizedConv2DWithBiasSumAndReluAndRequantize', 'QuantizedConv2DWithBiasAndReluAndRequantize', 'QuantizedConv2DWithBiasSignedSumAndReluAndRequantize', 'QuantizedConv2DWithBiasAndRequantize'}
resnet50_v1_5_bfloat16 data type 'bfloat16' not understood
resnet50v1_5_int8 The following operators are not implemented: {'QuantizedConv2DWithBiasAndReluAndRequantize', 'QuantizedConv2DWithBiasSumAndReluAndRequantize', 'QuantizedMaxPool', 'QuantizedConv2DWithBiasSignedSumAndReluAndRequantize', 'Dequantize', 'QuantizeV2', 'QuantizedConv2DWithBiasAndRequantize'}
ssdmobilenet_fp32 The following operators are not implemented: {'CombinedNonMaxSuppression'}
ssdmobilenet_int8 The following operators are not implemented: {'QuantizedDepthwiseConv2DWithBiasAndReluAndRequantize', 'CombinedNonMaxSuppression', 'Dequantize', 'QuantizedConv2DWithBiasAndRequantize', 'QuantizeV2', 'QuantizedConv2DWithBiasAndReluAndRequantize'}
ssd_resnet34_fp32_1200x1200 The following operators are not implemented: {'CombinedNonMaxSuppression'}
ssd_resnet34_int8_bs1 The following operators are not implemented: {'QuantizedConv2DWithBiasSignedSumAndReluAndRequantize', 'QuantizedConv2DWithBiasAndRequantize', 'QuantizedMaxPool', 'QuantizeV2', 'QuantizedConv2DWithBiasAndReluAndRequantize', 'QuantizedConv2DWithBiasSumAndReluAndRequantize', 'Dequantize'}
ssd_resnet34_int8_1200x1200 The following operators are not implemented: {'QuantizeV2', 'QuantizedConv2DWithBiasSignedSumAndReluAndRequantize', 'QuantizedConv2DWithBiasSumAndReluAndRequantize', 'CombinedNonMaxSuppression', 'QuantizedConv2DWithBiasAndReluAndRequantize', 'QuantizedConv2DWithBiasAndRequantize', 'Dequantize', 'QuantizedMaxPool'}
wide_deep_fp32 RuntimeError: Unsupported dtype: int64
wide_deep_int8 The following operators are not implemented: {'QuantizedMatMulWithBias', 'Requantize', 'QuantizedMatMulWithBiasAndReluAndRequantize', 'Dequantize', 'QuantizeV2'}
@insop
Copy link
Contributor

insop commented Jan 4, 2021

@aaltonenzhang
Nit, it seems the embedded url (https://github.com/tensorflow/models/tree/master/community) in the above post is not the actual url shown, i.e. if you click the link you will go to different site. And I see the similar in #7198

@aaltonenzhang
Copy link
Author

aaltonenzhang commented Jan 5, 2021

@insop reedited the url links for both of the two issues.

@masahi masahi closed this as completed Jan 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants