New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Quant] Use finite hops to check if the quant nodes are connected with producer #108572
Conversation
Summary: Using dfs to check if two nodes are connecgted is making it very slow. Use of BFS makes it much faster. Test Plan: https://gist.github.com/leslie-fang-intel/9cd828623f567a3afbf41564d3546398 Reviewers: Subscribers: Tasks: Tags: [ghstack-poisoned]
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/108572
Note: Links to docs will display an error until the docs builds have been completed. ✅ No FailuresAs of commit 369b403 with merge base 0a8296d (): This comment was automatically generated by Dr. CI and updates every 15 minutes. |
Summary: Using dfs to check if two nodes are connecgted is making it very slow. Use of BFS makes it much faster. Test Plan: https://gist.github.com/leslie-fang-intel/9cd828623f567a3afbf41564d3546398 Reviewers: Subscribers: Tasks: Tags: ghstack-source-id: b21854ed9d950903f7964a053fdbbb95ae16b213 Pull Request resolved: #108572
@kimishpatel has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
thanks, please add a comment/doc block to talk about the cleanup plans as well so that we don't forget |
…ess" Summary: Using dfs to check if two nodes are connecgted is making it very slow. Use of BFS makes it much faster. Test Plan: https://gist.github.com/leslie-fang-intel/9cd828623f567a3afbf41564d3546398 Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D48971710](https://our.internmc.facebook.com/intern/diff/D48971710) [ghstack-poisoned]
Summary: Using dfs to check if two nodes are connecgted is making it very slow. Use of BFS makes it much faster. Test Plan: https://gist.github.com/leslie-fang-intel/9cd828623f567a3afbf41564d3546398 Reviewers: Subscribers: Tasks: Tags: ghstack-source-id: bb020ae06cefba115732ccf9c1f32e29f8d9165c Pull Request resolved: #108572
@kimishpatel has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
…ess" Summary: Using dfs to check if two nodes are connecgted is making it very slow. Use of BFS makes it much faster. Test Plan: https://gist.github.com/leslie-fang-intel/9cd828623f567a3afbf41564d3546398 Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D48971710](https://our.internmc.facebook.com/intern/diff/D48971710) [ghstack-poisoned]
Summary: Using dfs to check if two nodes are connecgted is making it very slow. Use of BFS makes it much faster. Test Plan: https://gist.github.com/leslie-fang-intel/9cd828623f567a3afbf41564d3546398 Reviewers: Subscribers: Tasks: Tags: ghstack-source-id: 4fc054a78327ee7e57b4d681c969a780c65eee18 Pull Request resolved: #108572
@kimishpatel has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
Thanks for the fix. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
oh... seems still has issue when running resnet152: https://gist.github.com/leslie-fang-intel/5783540cd11e9c132630319bde16a422
@kimishpatel maybe we have to go with traversing the hardcoded q/dq path |
…ess" Summary: Using dfs to check if two nodes are connecgted is making it very slow. Use of BFS makes it much faster. Test Plan: https://gist.github.com/leslie-fang-intel/9cd828623f567a3afbf41564d3546398 Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D48971710](https://our.internmc.facebook.com/intern/diff/D48971710) [ghstack-poisoned]
Summary: Using dfs to check if two nodes are connecgted is making it very slow. Use of BFS makes it much faster. Test Plan: https://gist.github.com/leslie-fang-intel/9cd828623f567a3afbf41564d3546398 Reviewers: Subscribers: Tasks: Tags: ghstack-source-id: 2f08ec0b4e45e421976038b0f5a2e33a4b8c9820 Pull Request resolved: #108572
@kimishpatel has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
ok this is a step closer to hardcoding but not quite hardcoding. @jerryzh168 how do you try this on inception v4? can you copy paste command here? |
I have a diff, could you import to phabricator? I can rebase and try this out |
it is imported to phabricator at D48971710 |
…ess" Summary: Using dfs to check if two nodes are connecgted is making it very slow. Use of BFS makes it much faster. Test Plan: https://gist.github.com/leslie-fang-intel/9cd828623f567a3afbf41564d3546398 Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D48971710](https://our.internmc.facebook.com/intern/diff/D48971710) [ghstack-poisoned]
Summary: Using dfs to check if two nodes are connecgted is making it very slow. Use of BFS makes it much faster. Test Plan: https://gist.github.com/leslie-fang-intel/9cd828623f567a3afbf41564d3546398 Reviewers: Subscribers: Tasks: Tags: ghstack-source-id: 7995027d4aad7a803a6a5308e6f4ecd80bbfb0e3 Pull Request resolved: #108572
@kimishpatel has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
@pytorchbot merge (Initiating merge automatically since Phabricator Diff has merged) |
Merge startedYour change will be merged once all checks pass (ETA 0-4 Hours). Learn more about merging in the wiki. Questions? Feedback? Please reach out to the PyTorch DevX Team |
Stack from ghstack (oldest at bottom):
Summary:
Using dfs to check if two nodes are connecgted is making it very slow. Even BFS was the same. So resorted to finite hop checks starting from dq node to find a node that is not inserted by quant workflow.
Test Plan:
https://gist.github.com/leslie-fang-intel/9cd828623f567a3afbf41564d3546398
Reviewers:
Subscribers:
Tasks:
Tags:
Differential Revision: D48971710