[Operator Versioning][Test] Automate model generating process #70629
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) [ghstack-poisoned]
CI Flow Status⚛️ CI FlowRuleset - Version:
You can add a comment to the PR and tag @pytorchbot with the following commands: # ciflow rerun, "ciflow/default" will always be added automatically
@pytorchbot ciflow rerun
# ciflow rerun with additional labels "-l <ciflow/label_name>", which is equivalent to adding these labels manually and trigger the rerun
@pytorchbot ciflow rerun -l ciflow/scheduled -l ciflow/slowFor more information, please take a look at the CI Flow Wiki. |
🔗 Helpful links
💊 CI failures summary and remediationsAs of commit 3a8e7f4 (more details on the Dr. CI page): 💚 💚 Looks good so far! There are no failures yet. 💚 💚 This comment was automatically generated by Dr. CI (expand for details).Please report bugs/suggestions to the (internal) Dr. CI Users group. |
cccclai
pushed a commit
that referenced
this pull request
Jan 4, 2022
Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) ghstack-source-id: 146479364 Pull Request resolved: #70629
facebook-github-bot
added
the
oncall: jit
…ess" Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) [ghstack-poisoned]
cccclai
pushed a commit
that referenced
this pull request
Jan 5, 2022
Pull Request resolved: #70629 ghstack-source-id: 146509416 Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/)
cccclai
requested review from
iseeyuan,
tugsbayasgalan,
gmagogsfm and
zhxchen17
…ess" This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841) [ghstack-poisoned]
cccclai
pushed a commit
that referenced
this pull request
Jan 5, 2022
This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Pull Request resolved: #70629 ghstack-source-id: 146524467 Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/)
iseeyuan
reviewed
Jan 5, 2022
iseeyuan
reviewed
Jan 5, 2022
| ``` | ||
|
|
||
| 4. Generate the test to cover upgrader. | ||
| 4.1 Switch the commit before the operator change, and add a module in |
There was a problem hiding this comment.
Could the test be added in the operator change commit?
There was a problem hiding this comment.
Yeah the test need to be added with the operator change commit. This script needs to run before the commit to do the operator change though. Let me update this part so it's clearer.
iseeyuan
approved these changes
Jan 5, 2022
…ess" This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841) [ghstack-poisoned]
cccclai
pushed a commit
that referenced
this pull request
Jan 21, 2022
This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Pull Request resolved: #70629 ghstack-source-id: 147386896 Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) **NOTE FOR REVIEWERS**: This PR has internal Facebook specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D33410841/)!
…ess" This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841) [ghstack-poisoned]
cccclai
pushed a commit
that referenced
this pull request
Jan 21, 2022
This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Pull Request resolved: #70629 ghstack-source-id: 147439871 Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) **NOTE FOR REVIEWERS**: This PR has internal Facebook specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D33410841/)!
…ess" This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841) [ghstack-poisoned]
tugsbayasgalan
approved these changes
Jan 21, 2022
| from typing import Set | ||
|
|
||
| import torch | ||
| from test.jit.fixtures_srcs.fixtures_src import TestVersionedDivTensorExampleV4 |
There was a problem hiding this comment.
should we just import everything from there? So that developers have one less thing to worry about
…ess" This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841) [ghstack-poisoned]
…ess" This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841) [ghstack-poisoned]
…ess" This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841) [ghstack-poisoned]
cccclai
pushed a commit
that referenced
this pull request
Jan 21, 2022
This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Pull Request resolved: #70629 ghstack-source-id: 147453220 Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) **NOTE FOR REVIEWERS**: This PR has internal Facebook specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D33410841/)!
…ess" This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841) [ghstack-poisoned]
cccclai
pushed a commit
that referenced
this pull request
Jan 24, 2022
This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Pull Request resolved: #70629 ghstack-source-id: 147494053 Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) **NOTE FOR REVIEWERS**: This PR has internal Facebook specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D33410841/)!
…ess" This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841) [ghstack-poisoned]
cccclai
pushed a commit
that referenced
this pull request
Jan 24, 2022
This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Pull Request resolved: #70629 ghstack-source-id: 147524909 Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) **NOTE FOR REVIEWERS**: This PR has internal Facebook specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D33410841/)!
…ess" This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841) [ghstack-poisoned]
cccclai
pushed a commit
that referenced
this pull request
Jan 24, 2022
This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Pull Request resolved: #70629 ghstack-source-id: 147543221 Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) **NOTE FOR REVIEWERS**: This PR has internal Facebook specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D33410841/)!
…ess" This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841) [ghstack-poisoned]
cccclai
pushed a commit
that referenced
this pull request
Jan 25, 2022
This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Pull Request resolved: #70629 ghstack-source-id: 147575358 Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) **NOTE FOR REVIEWERS**: This PR has internal Facebook specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D33410841/)!
…ess" This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlaichenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841) [ghstack-poisoned]
cccclai
pushed a commit
that referenced
this pull request
Jan 25, 2022
This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Pull Request resolved: #70629 ghstack-source-id: 147585826 Differential Revision: [D33410841](https://our.internmc.facebook.com/intern/diff/D33410841/) **NOTE FOR REVIEWERS**: This PR has internal Facebook specific changes or comments, please review them on [Phabricator](https://our.internmc.facebook.com/intern/diff/D33410841/)!
facebook-github-bot
pushed a commit
that referenced
this pull request
Jan 25, 2022
Summary: This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Pull Request resolved: #70629 ghstack-source-id: 147585826 Test Plan: OSS ``` python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py ``` Internal: ``` buck run mode/opt //caffe2/torch/fb/mobile/upgrader_codegen:upgrader_test_models_gen ``` Reviewed By: iseeyuan, tugsbayasgalan Differential Revision: D33410841 fbshipit-source-id: 28e2b851a30f12a74e4ac8a539d76e83bbc4fb3a
pytorchmergebot
pushed a commit
that referenced
this pull request
Jan 25, 2022
Summary: This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Pull Request resolved: #70629 ghstack-source-id: 147585826 Test Plan: OSS ``` python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py ``` Internal: ``` buck run mode/opt //caffe2/torch/fb/mobile/upgrader_codegen:upgrader_test_models_gen ``` Reviewed By: iseeyuan, tugsbayasgalan Differential Revision: D33410841 fbshipit-source-id: 28e2b851a30f12a74e4ac8a539d76e83bbc4fb3a (cherry picked from commit 6614f1b)
cyyever
pushed a commit
to cyyever/pytorch_private
that referenced
this pull request
Feb 3, 2022
Summary: This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Pull Request resolved: pytorch/pytorch#70629 ghstack-source-id: 147585826 Test Plan: OSS ``` python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py ``` Internal: ``` buck run mode/opt //caffe2/torch/fb/mobile/upgrader_codegen:upgrader_test_models_gen ``` Reviewed By: iseeyuan, tugsbayasgalan Differential Revision: D33410841 fbshipit-source-id: 28e2b851a30f12a74e4ac8a539d76e83bbc4fb3a (cherry picked from commit 6614f1b)
cyyever
pushed a commit
to cyyever/pytorch_private
that referenced
this pull request
Feb 3, 2022
Summary: This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Pull Request resolved: pytorch/pytorch#70629 ghstack-source-id: 147585826 Test Plan: OSS ``` python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py ``` Internal: ``` buck run mode/opt //caffe2/torch/fb/mobile/upgrader_codegen:upgrader_test_models_gen ``` Reviewed By: iseeyuan, tugsbayasgalan Differential Revision: D33410841 fbshipit-source-id: 28e2b851a30f12a74e4ac8a539d76e83bbc4fb3a (cherry picked from commit 6614f1b)
cyyever
pushed a commit
to cyyever/pytorch_private
that referenced
this pull request
Feb 9, 2022
Summary: This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Pull Request resolved: pytorch/pytorch#70629 ghstack-source-id: 147585826 Test Plan: OSS ``` python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py ``` Internal: ``` buck run mode/opt //caffe2/torch/fb/mobile/upgrader_codegen:upgrader_test_models_gen ``` Reviewed By: iseeyuan, tugsbayasgalan Differential Revision: D33410841 fbshipit-source-id: 28e2b851a30f12a74e4ac8a539d76e83bbc4fb3a (cherry picked from commit 6614f1b)
cyyever
pushed a commit
to cyyever/pytorch_private
that referenced
this pull request
Feb 9, 2022
Summary: This change is to automate the process to generate the old models for testing upgraders. Developer will 1. Add a module in `caffe2/test/jit/fixtures_srcs/fixtures_src.py` 2. Register the module in `caffe2/test/jit/fixtures_srcs/generate_models.py` 3. Run `python test/jit/fixtures_src/generate_models.py` The model will be dumped to `test/jit/fixtures`. This script also ensure: 1. The output model operator version is as expected 2. The output model will include the changed operator Example log: ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Generating model test_versioned_div_tensor_example_v4 and it's save to /Users/chenlai/pytorch/test/jit/fixtures/test_versioned_div_tensor_example_v4.ptl ``` The second time to run ``` (base) chenlai@chenlai-mp pytorch % python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py TestVersionedDivTensorExampleV4() aten::div.Tensor INFO:__main__:Processing TestVersionedDivTensorExampleV4 INFO:__main__:Model test_versioned_div_tensor_example_v4 already exists, skipping ``` Pull Request resolved: pytorch/pytorch#70629 ghstack-source-id: 147585826 Test Plan: OSS ``` python3 /Users/chenlai/pytorch/test/jit/fixtures_src/generate_models.py ``` Internal: ``` buck run mode/opt //caffe2/torch/fb/mobile/upgrader_codegen:upgrader_test_models_gen ``` Reviewed By: iseeyuan, tugsbayasgalan Differential Revision: D33410841 fbshipit-source-id: 28e2b851a30f12a74e4ac8a539d76e83bbc4fb3a (cherry picked from commit 6614f1b)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Stack from ghstack:
This change is to automate the process to generate the old models for testing upgraders. Developer will
caffe2/test/jit/fixtures_srcs/fixtures_src.pycaffe2/test/jit/fixtures_srcs/generate_models.pypython test/jit/fixtures_src/generate_models.pyThe model will be dumped to
test/jit/fixtures.This script also ensure:
Example log:
The second time to run
Differential Revision: D33410841
Differential Revision: D33410841