Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Model inference results on Inf1 inconsistent with expected results #175

Open
hasanp87 opened this issue May 18, 2020 · 2 comments
Open

Model inference results on Inf1 inconsistent with expected results #175

hasanp87 opened this issue May 18, 2020 · 2 comments

Comments

@hasanp87
Copy link

I was able to compile , deploy and run inference on Inf1 for a model created with mxnet 1.6.0 . I am using a pre-trained gluon cv i3d rennet model https://gluon-cv.mxnet.io/api/model_zoo.html#gluoncv.model_zoo.i3d_resnet50_v1_kinetics400.
The inference results does find the right predicted class , however the probability value is only 20.1 %. If i run this model standalone from here https://gluon-cv.mxnet.io/build/examples_action_recognition/demo_i3d_kinetics400.html , it gives the same predicted class but with a probability of 99.9 %.
So, clearly neo compile is not getting it right here ? how can we explain this, thanks

@saranyailla
Copy link

I have a similar issue with resnet50_v1 on x86_64 machines(ubuntu and deeplens). It seems to predict correctly on raspberry pi.

@kkwan-sme
Copy link

@hasanp87 @saranyailla I know your posts are now ancient history and there's no excuse for not tracking the posts and responding in a timely manner. Still, I wanted to see if you managed to resolve your issues. If you experience any issues with the current Neo compiler, you can send us a description of the issue and the compilation ARN to amazon-neo-feedback@amazon.com and we can follow-up with the team.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants