Skip to content

Conversation

hx89
Copy link

@hx89 hx89 commented Apr 15, 2020

Stack from ghstack:

Add module level comparison API.

Differential Revision: D21045393

Add module level comparison API.

Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)

[ghstack-poisoned]
hx89 pushed a commit that referenced this pull request Apr 15, 2020
Add module level comparison API.

Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)

ghstack-source-id: 102210159
Pull Request resolved: #36669
@hx89 hx89 requested a review from raghuramank100 April 15, 2020 18:25
@dr-ci
Copy link

dr-ci bot commented Apr 15, 2020

💊 Build failures summary and remediations

As of commit 82f1975 (more details on the Dr. CI page):


💚 💚 Looks good so far! There are no failures yet. 💚 💚


This comment was automatically generated by Dr. CI (expand for details).Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions on the GitHub issue tracker.

See how this bot performed.

This comment has been revised 22 times.

Add module level comparison API.

Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)

[ghstack-poisoned]
hx89 pushed a commit that referenced this pull request Apr 17, 2020
Pull Request resolved: #36669

Add module level comparison API.
ghstack-source-id: 102385175

Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)
q_module._modules[key] = value


def compare_model_stub(float_model, q_model, module_swap_list, data, Logger=Logger):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wondering if we need this as a top level function or keep this as an internal/test only function and move it to the test code.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe we can keep it as top level function since it's easy for user to use as a one-liner to quickly check the model accuracy?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, as long as we have the building blocks as user facing functions, we are ok.

Copy link
Contributor

@raghuramank100 raghuramank100 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great start!. Few suggestions for further improvement

Add module level comparison API.

Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)

[ghstack-poisoned]
@hx89
Copy link
Author

hx89 commented Apr 21, 2020

Address comments.

@hx89 hx89 requested a review from raghuramank100 April 21, 2020 17:13
Add module level comparison API.

Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)

[ghstack-poisoned]
hx89 pushed a commit that referenced this pull request Apr 21, 2020
Pull Request resolved: #36669

Add module level comparison API.
ghstack-source-id: 102589374

Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)
Copy link
Contributor

@raghuramank100 raghuramank100 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, have a few comments

Add module level comparison API.

Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)

[ghstack-poisoned]
hx89 pushed a commit that referenced this pull request Apr 22, 2020
Pull Request resolved: #36669

Add module level comparison API.
ghstack-source-id: 102672767

Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)
Add module level comparison API.

Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)

[ghstack-poisoned]
hx89 pushed a commit that referenced this pull request Apr 22, 2020
Pull Request resolved: #36669

Add module level comparison API.
ghstack-source-id: 102713666

Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)
Add module level comparison API.

Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)

[ghstack-poisoned]
hx89 pushed a commit that referenced this pull request Apr 23, 2020
Pull Request resolved: #36669

Add module level comparison API.
ghstack-source-id: 102761562

Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)
Add module level comparison API.

Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)

[ghstack-poisoned]
hx89 pushed a commit that referenced this pull request Apr 23, 2020
Pull Request resolved: #36669

Add module level comparison API.
ghstack-source-id: 102802362

Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)
@facebook-github-bot
Copy link
Contributor

This pull request has been merged in fba9b9a.

hx89 pushed a commit that referenced this pull request Apr 24, 2020
Pull Request resolved: #36669

Add module level comparison API.
ghstack-source-id: 102851307

Differential Revision: [D21231719](https://our.internmc.facebook.com/intern/diff/D21231719/)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants