Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

When I ran the tvm_pytorch_resnet18_inference.py, I met the problem #2

Closed
Jie-KUN opened this issue Oct 30, 2021 · 5 comments
Closed

Comments

@Jie-KUN
Copy link

Jie-KUN commented Oct 30, 2021

One or more operators have not been tuned. Please tune your model for better performance. Use DEBUG logging level to see more details.
Relay top-1 id: 281, class name: tabby, tabby cat, class probality: 0.3626886010169983
Torch top-1 id: 281, class name: tabby, tabby cat, class probality: 0.36268892884254456
Relay time(ms): 41.741
Torch time(ms): 16.326
free(): invalid pointer
Aborted

@ToleranceGui
Copy link

I met the same problem, how did you solve it?
thanks

@Jie-KUN
Copy link
Author

Jie-KUN commented Jun 16, 2022

/tvm/build/config.cmake
set(USE_LLVM "/usr/bin/llvm-config --link-static")
set(USE_MICRO OFF)
/tvm/CMakelist.txt
set(HIDE_PRIVATE_SYMBOLS ON)\
cmake -DCMAKE_BUILD_TYPE=Debug ../
make -j16
I modify the above .

@ToleranceGui
Copy link

these modifications worked
I have a new puzzle.
In terms of reasoning time, relay reasoning time is longer, which does not reflect the optimization effect of TVM?

@GeneralJing
Copy link

these modifications worked I have a new puzzle. In terms of reasoning time, relay reasoning time is longer, which does not reflect the optimization effect of TVM?

same question.
Relay time: 0.37134288150118666 seconds
Torch time: 0.0024548148998292164 seconds

@BBuf
Copy link
Owner

BBuf commented Jun 28, 2022

these modifications worked I have a new puzzle. In terms of reasoning time, relay reasoning time is longer, which does not reflect the optimization effect of TVM?

You should use AutoTVM or Ansor to optimize it. Please refer to : https://tvm.apache.org/docs/tutorial/autotvm_relay_x86.html & https://tvm.apache.org/docs/tutorial/auto_scheduler_matmul_x86.html

@BBuf BBuf closed this as completed Aug 22, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants