Skip to content

Conversation

@eellison
Copy link
Contributor

tested locally with nll_loss declaration from #76889 (comment)

@facebook-github-bot
Copy link
Contributor

facebook-github-bot commented May 10, 2022

🔗 Helpful links

❌ 17 New Failures, 1 Flaky Failures, 1 Base Failures

As of commit f7ea799 (more details on the Dr. CI page):

Expand to see more

🕵️ 17 new failures recognized by patterns

The following CI failures do not appear to be due to upstream breakages

See GitHub Actions build pull / linux-bionic-rocm5.1-py3.7 / test (default, 1, 2, linux.rocm.gpu) (1/17)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-10T04:57:36.3864776Z RuntimeError: test_jit failed!
2022-05-10T04:57:33.0261927Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_backends.TestBackendsWithCompiler-20220510045532.xml
2022-05-10T04:57:33.0268270Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_cuda.TestCUDA-20220510045532.xml
2022-05-10T04:57:33.0274643Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_data_parallel.TestDataParallel-20220510045532.xml
2022-05-10T04:57:33.0289369Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_legacy_upgraders.TestLegacyUpgraders-20220510045532.xml
2022-05-10T04:57:33.0294657Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_save_load.TestSaveLoadFlatbuffer-20220510045532.xml
2022-05-10T04:57:36.3849215Z Traceback (most recent call last):
2022-05-10T04:57:36.3850055Z   File "test/run_test.py", line 1072, in <module>
2022-05-10T04:57:36.3857579Z     main()
2022-05-10T04:57:36.3858211Z   File "test/run_test.py", line 1050, in main
2022-05-10T04:57:36.3863358Z     raise RuntimeError(err_message)
2022-05-10T04:57:36.3864776Z RuntimeError: test_jit failed!
2022-05-10T04:57:37.5461593Z 
2022-05-10T04:57:37.5462428Z real	2m10.724s
2022-05-10T04:57:37.5463569Z user	19m30.795s
2022-05-10T04:57:37.5464604Z sys	0m32.452s
2022-05-10T04:57:37.5465193Z + cleanup
2022-05-10T04:57:37.5465706Z + retcode=1
2022-05-10T04:57:37.5466218Z + set +x
2022-05-10T04:57:37.5590722Z ##[error]Process completed with exit code 1.
2022-05-10T04:57:37.5654811Z ##[group]Run # copy test results back to the mounted workspace, needed sudo, resulting permissions were correct
2022-05-10T04:57:37.5655344Z �[36;1m# copy test results back to the mounted workspace, needed sudo, resulting permissions were correct�[0m

See GitHub Actions build pull / linux-bionic-rocm5.1-py3.7 / test (default, 2, 2, linux.rocm.gpu) (2/17)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-10T05:23:48.3699405Z RuntimeError: test_ops_jit failed!
2022-05-10T05:23:42.6440898Z 
2022-05-10T05:23:42.6441303Z FAILED (errors=1, skipped=97, expected failures=146)
2022-05-10T05:23:42.6441819Z 
2022-05-10T05:23:42.6442083Z Generating XML reports...
2022-05-10T05:23:42.8295342Z Generated XML report: test-reports/python-unittest/test_ops_jit/TEST-TestJitCUDA-20220510050508.xml
2022-05-10T05:23:48.3686384Z Traceback (most recent call last):
2022-05-10T05:23:48.3687566Z   File "test/run_test.py", line 1072, in <module>
2022-05-10T05:23:48.3692250Z     main()
2022-05-10T05:23:48.3692989Z   File "test/run_test.py", line 1050, in main
2022-05-10T05:23:48.3698661Z     raise RuntimeError(err_message)
2022-05-10T05:23:48.3699405Z RuntimeError: test_ops_jit failed!
2022-05-10T05:23:50.2378760Z 
2022-05-10T05:23:50.2379977Z real	29m54.117s
2022-05-10T05:23:50.2380674Z user	52m2.375s
2022-05-10T05:23:50.2381248Z sys	5m37.782s
2022-05-10T05:23:50.2381848Z + cleanup
2022-05-10T05:23:50.2382400Z + retcode=1
2022-05-10T05:23:50.2382977Z + set +x
2022-05-10T05:23:50.2492808Z ##[error]Process completed with exit code 1.
2022-05-10T05:23:50.2570838Z ##[group]Run # copy test results back to the mounted workspace, needed sudo, resulting permissions were correct
2022-05-10T05:23:50.2571836Z �[36;1m# copy test results back to the mounted workspace, needed sudo, resulting permissions were correct�[0m

See GitHub Actions build pull / linux-bionic-py3.7-clang9 / test (crossref, 1, 2, linux.2xlarge) (3/17)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-10T01:49:03.2444060Z RuntimeError: test_ops_jit failed!
2022-05-10T01:48:59.7162688Z 
2022-05-10T01:48:59.7162800Z FAILED (errors=1, skipped=79, expected failures=147)
2022-05-10T01:48:59.7162950Z 
2022-05-10T01:48:59.7163037Z Generating XML reports...
2022-05-10T01:48:59.7924978Z Generated XML report: test-reports/python-unittest/test_ops_jit/TEST-TestJitCPU-20220510013241.xml
2022-05-10T01:49:03.2438558Z Traceback (most recent call last):
2022-05-10T01:49:03.2438853Z   File "test/run_test.py", line 1072, in <module>
2022-05-10T01:49:03.2441148Z     main()
2022-05-10T01:49:03.2441430Z   File "test/run_test.py", line 1050, in main
2022-05-10T01:49:03.2443806Z     raise RuntimeError(err_message)
2022-05-10T01:49:03.2444060Z RuntimeError: test_ops_jit failed!
2022-05-10T01:49:03.5321940Z 
2022-05-10T01:49:03.5322373Z real	56m21.672s
2022-05-10T01:49:03.5322591Z user	140m22.286s
2022-05-10T01:49:03.5322770Z sys	5m15.550s
2022-05-10T01:49:03.5322946Z + cleanup
2022-05-10T01:49:03.5323160Z + retcode=1
2022-05-10T01:49:03.5323383Z + set +x
2022-05-10T01:49:03.5356273Z ##[error]Process completed with exit code 1.
2022-05-10T01:49:03.5496052Z ##[group]Run pytorch/pytorch/.github/actions/get-workflow-job-id@master
2022-05-10T01:49:03.5496302Z with:

See GitHub Actions build pull / linux-bionic-py3.7-clang9 / test (crossref, 2, 2, linux.2xlarge) (4/17)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-10T00:54:32.8515035Z RuntimeError: test_jit failed!
2022-05-10T00:54:32.4588822Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_warn.TestWarn-20220510005241.xml
2022-05-10T00:54:32.4594964Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_with.TestWith-20220510005241.xml
2022-05-10T00:54:32.4602034Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_data_parallel.TestDataParallel-20220510005241.xml
2022-05-10T00:54:32.4612327Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_legacy_upgraders.TestLegacyUpgraders-20220510005241.xml
2022-05-10T00:54:32.4621874Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_save_load.TestSaveLoadFlatbuffer-20220510005241.xml
2022-05-10T00:54:32.8508806Z Traceback (most recent call last):
2022-05-10T00:54:32.8509277Z   File "test/run_test.py", line 1072, in <module>
2022-05-10T00:54:32.8511850Z     main()
2022-05-10T00:54:32.8512222Z   File "test/run_test.py", line 1050, in main
2022-05-10T00:54:32.8514669Z     raise RuntimeError(err_message)
2022-05-10T00:54:32.8515035Z RuntimeError: test_jit failed!
2022-05-10T00:54:33.0934138Z 
2022-05-10T00:54:33.0934533Z real	1m56.435s
2022-05-10T00:54:33.0934895Z user	4m38.274s
2022-05-10T00:54:33.0935213Z sys	0m19.892s
2022-05-10T00:54:33.0935505Z + cleanup
2022-05-10T00:54:33.0935734Z + retcode=1
2022-05-10T00:54:33.0935893Z + set +x
2022-05-10T00:54:33.0970937Z ##[error]Process completed with exit code 1.
2022-05-10T00:54:33.1059645Z ##[group]Run pytorch/pytorch/.github/actions/get-workflow-job-id@master
2022-05-10T00:54:33.1059902Z with:

See GitHub Actions build pull / linux-xenial-py3.7-clang7-asan / test (default, 4, 4, linux.2xlarge) (5/17)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-10T01:01:34.9375976Z RuntimeError: test_jit failed!
2022-05-10T01:01:34.2439215Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_legacy_upgraders.TestLegacyUpgraders-20220510005421.xml
2022-05-10T01:01:34.2445424Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_freezing.TestMKLDNNReinplacing-20220510005421.xml
2022-05-10T01:01:34.2478299Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_backend_nnapi.TestNnapiBackend-20220510005421.xml
2022-05-10T01:01:34.2487742Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_optimize_for_mobile_preserve_debug_info.TestOptimizeForMobilePreserveDebugInfo-20220510005421.xml
2022-05-10T01:01:34.2509617Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_save_load.TestSaveLoadFlatbuffer-20220510005421.xml
2022-05-10T01:01:34.9366684Z Traceback (most recent call last):
2022-05-10T01:01:34.9367162Z   File "test/run_test.py", line 1072, in <module>
2022-05-10T01:01:34.9371104Z     main()
2022-05-10T01:01:34.9371463Z   File "test/run_test.py", line 1050, in main
2022-05-10T01:01:34.9375607Z     raise RuntimeError(err_message)
2022-05-10T01:01:34.9375976Z RuntimeError: test_jit failed!
2022-05-10T01:01:35.3906504Z + cleanup
2022-05-10T01:01:35.3907142Z + retcode=1
2022-05-10T01:01:35.3907303Z + set +x
2022-05-10T01:01:35.3942392Z ##[error]Process completed with exit code 1.
2022-05-10T01:01:35.4066955Z ##[group]Run pytorch/pytorch/.github/actions/get-workflow-job-id@master
2022-05-10T01:01:35.4067195Z with:
2022-05-10T01:01:35.4067626Z   github-token: ***
2022-05-10T01:01:35.4067800Z env:
2022-05-10T01:01:35.4067940Z   IN_CI: 1
2022-05-10T01:01:35.4068100Z   IS_GHA: 1

See GitHub Actions build Lint / lintrunner (6/17)

Step: "Install lintrunner" (full log | diagnosis details | 🔁 rerun)

2022-05-10T00:38:46.9365305Z /home/runner/work/...8c48ac3f.sh: line 4: lintrunner: command not found
2022-05-10T00:38:46.9230171Z �[36;1m# in JSON mode and use jq to massage the output into GitHub Actions�[0m
2022-05-10T00:38:46.9230513Z �[36;1m# workflow commands.�[0m
2022-05-10T00:38:46.9230893Z �[36;1mlintrunner --merge-base-with "${PR_BASE_SHA}" --output=json | \�[0m
2022-05-10T00:38:46.9231541Z �[36;1m  jq --raw-output '"::\(if .severity == "advice" or .severity == "disabled" then "warning" else .severity end) file=\(.path),line=\(.line),col=\(.char),title=\(.code) \(.name)::" + (.description | gsub("\\n"; "%0A"))'�[0m
2022-05-10T00:38:46.9279527Z shell: /bin/bash -e {0}
2022-05-10T00:38:46.9279766Z env:
2022-05-10T00:38:46.9280077Z   pythonLocation: /opt/hostedtoolcache/Python/3.8.12/x64
2022-05-10T00:38:46.9280461Z   LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.8.12/x64/lib
2022-05-10T00:38:46.9280855Z   PR_BASE_SHA: 24372eb5acc0ab2ea34b3010e38cad7a90ed7f32
2022-05-10T00:38:46.9281156Z ##[endgroup]
2022-05-10T00:38:46.9365305Z /home/runner/work/_temp/e2bc4060-b482-471b-ba57-39f78c48ac3f.sh: line 4: lintrunner: command not found
2022-05-10T00:38:46.9518713Z Post job cleanup.
2022-05-10T00:38:46.9557296Z Post job cleanup.
2022-05-10T00:38:47.0729503Z [command]/usr/bin/git version
2022-05-10T00:38:47.0794962Z git version 2.36.0
2022-05-10T00:38:47.0836802Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2022-05-10T00:38:47.0887395Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2022-05-10T00:38:47.1209138Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2022-05-10T00:38:47.1260575Z http.https://github.com/.extraheader
2022-05-10T00:38:47.1292950Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader
2022-05-10T00:38:47.1345913Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :

See GitHub Actions build pull / linux-xenial-cuda11.3-py3.7-gcc7 / test (default, 2, 4, linux.4xlarge.nvidia.gpu) (7/17)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-10T01:12:40.6875494Z RuntimeError: test_jit failed!
2022-05-10T01:12:39.9327461Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_with.TestWith-20220510010955.xml
2022-05-10T01:12:39.9337681Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_data_parallel.TestDataParallel-20220510010955.xml
2022-05-10T01:12:39.9354217Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_legacy_upgraders.TestLegacyUpgraders-20220510010955.xml
2022-05-10T01:12:39.9366882Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_optimize_for_mobile_preserve_debug_info.TestOptimizeForMobilePreserveDebugInfo-20220510010955.xml
2022-05-10T01:12:39.9380770Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_save_load.TestSaveLoadFlatbuffer-20220510010955.xml
2022-05-10T01:12:40.6868085Z Traceback (most recent call last):
2022-05-10T01:12:40.6868905Z   File "test/run_test.py", line 1072, in <module>
2022-05-10T01:12:40.6871405Z     main()
2022-05-10T01:12:40.6871924Z   File "test/run_test.py", line 1050, in main
2022-05-10T01:12:40.6874417Z     raise RuntimeError(err_message)
2022-05-10T01:12:40.6875494Z RuntimeError: test_jit failed!
2022-05-10T01:12:41.1911992Z + cleanup
2022-05-10T01:12:41.1912279Z + retcode=1
2022-05-10T01:12:41.1912495Z + set +x
2022-05-10T01:12:41.1960573Z ##[error]Process completed with exit code 1.
2022-05-10T01:12:41.2011455Z ##[group]Run pytorch/pytorch/.github/actions/get-workflow-job-id@master
2022-05-10T01:12:41.2011812Z with:
2022-05-10T01:12:41.2012363Z   github-token: ***
2022-05-10T01:12:41.2012613Z env:
2022-05-10T01:12:41.2012826Z   IN_CI: 1
2022-05-10T01:12:41.2013031Z   IS_GHA: 1

See GitHub Actions build pull / linux-bionic-py3.7-clang9 / test (default, 1, 2, linux.2xlarge) (8/17)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-10T01:21:22.1330403Z RuntimeError: test_ops_jit failed!
2022-05-10T01:21:18.7072163Z 
2022-05-10T01:21:18.7072278Z FAILED (errors=1, skipped=79, expected failures=147)
2022-05-10T01:21:18.7072432Z 
2022-05-10T01:21:18.7072524Z Generating XML reports...
2022-05-10T01:21:18.7783065Z Generated XML report: test-reports/python-unittest/test_ops_jit/TEST-TestJitCPU-20220510010854.xml
2022-05-10T01:21:22.1325713Z Traceback (most recent call last):
2022-05-10T01:21:22.1326029Z   File "test/run_test.py", line 1072, in <module>
2022-05-10T01:21:22.1328112Z     main()
2022-05-10T01:21:22.1328319Z   File "test/run_test.py", line 1050, in main
2022-05-10T01:21:22.1330092Z     raise RuntimeError(err_message)
2022-05-10T01:21:22.1330403Z RuntimeError: test_ops_jit failed!
2022-05-10T01:21:22.3575075Z 
2022-05-10T01:21:22.3575621Z real	28m38.585s
2022-05-10T01:21:22.3575892Z user	70m37.413s
2022-05-10T01:21:22.3576173Z sys	3m19.929s
2022-05-10T01:21:22.3576436Z + cleanup
2022-05-10T01:21:22.3576664Z + retcode=1
2022-05-10T01:21:22.3576884Z + set +x
2022-05-10T01:21:22.3608000Z ##[error]Process completed with exit code 1.
2022-05-10T01:21:22.3805220Z ##[group]Run pytorch/pytorch/.github/actions/get-workflow-job-id@master
2022-05-10T01:21:22.3805562Z with:

See GitHub Actions build pull / linux-xenial-py3.7-gcc5.4 / test (distributed, 1, 1, linux.2xlarge) (9/17)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-10T01:29:10.4404497Z AssertionError: 1 unit test(s) failed:
2022-05-10T01:29:10.2385282Z 
2022-05-10T01:29:10.2385348Z OK
2022-05-10T01:29:10.2385448Z 
2022-05-10T01:29:10.2385531Z Generating XML reports...
2022-05-10T01:29:10.2417792Z Generated XML report: test-reports/python-unittest/distributed.rpc.test_tensorpipe_agent/TEST-TensorPipeThreeWorkersRemoteModuleTest-20220510012908.xml
2022-05-10T01:29:10.4401173Z Traceback (most recent call last):
2022-05-10T01:29:10.4401743Z   File "distributed/rpc/test_tensorpipe_agent.py", line 38, in <module>
2022-05-10T01:29:10.4402099Z     run_tests()
2022-05-10T01:29:10.4402815Z   File "/opt/conda/lib/python3.7/site-packages/torch/testing/_internal/common_utils.py", line 635, in run_tests
2022-05-10T01:29:10.4404053Z     len(failed_tests), '\n\t'.join(failed_tests))
2022-05-10T01:29:10.4404497Z AssertionError: 1 unit test(s) failed:
2022-05-10T01:29:10.4405040Z 	TensorPipeRpcTest.test_without_world_size_existing_rank_can_communicate_with_new_rank
2022-05-10T01:29:10.5703571Z Traceback (most recent call last):
2022-05-10T01:29:10.5704037Z   File "test/run_test.py", line 1072, in <module>
2022-05-10T01:29:10.5705673Z     main()
2022-05-10T01:29:10.5706047Z   File "test/run_test.py", line 1050, in main
2022-05-10T01:29:10.5708130Z     raise RuntimeError(err_message)
2022-05-10T01:29:10.5708643Z RuntimeError: distributed/rpc/test_tensorpipe_agent failed!
2022-05-10T01:29:10.8080117Z + cleanup
2022-05-10T01:29:10.8080456Z + retcode=1
2022-05-10T01:29:10.8080756Z + set +x

See GitHub Actions build pull / linux-xenial-cuda11.3-py3.7-gcc7 / test (default, 3, 4, linux.4xlarge.nvidia.gpu) (10/17)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-10T01:30:20.5807160Z RuntimeError: test_ops_jit failed!
2022-05-10T01:30:16.4304132Z 
2022-05-10T01:30:16.4304299Z FAILED (errors=1, skipped=82, expected failures=152)
2022-05-10T01:30:16.4304494Z 
2022-05-10T01:30:16.4304619Z Generating XML reports...
2022-05-10T01:30:16.5397599Z Generated XML report: test-reports/python-unittest/test_ops_jit/TEST-TestJitCUDA-20220510010516.xml
2022-05-10T01:30:20.5800840Z Traceback (most recent call last):
2022-05-10T01:30:20.5801236Z   File "test/run_test.py", line 1072, in <module>
2022-05-10T01:30:20.5803905Z     main()
2022-05-10T01:30:20.5804175Z   File "test/run_test.py", line 1050, in main
2022-05-10T01:30:20.5806841Z     raise RuntimeError(err_message)
2022-05-10T01:30:20.5807160Z RuntimeError: test_ops_jit failed!
2022-05-10T01:30:21.0713456Z + cleanup
2022-05-10T01:30:21.0713788Z + retcode=1
2022-05-10T01:30:21.0714040Z + set +x
2022-05-10T01:30:21.0758341Z ##[error]Process completed with exit code 1.
2022-05-10T01:30:21.0806187Z ##[group]Run pytorch/pytorch/.github/actions/get-workflow-job-id@master
2022-05-10T01:30:21.0806562Z with:
2022-05-10T01:30:21.0807113Z   github-token: ***
2022-05-10T01:30:21.0807364Z env:
2022-05-10T01:30:21.0807569Z   IN_CI: 1
2022-05-10T01:30:21.0807799Z   IS_GHA: 1

See GitHub Actions build pull / linux-xenial-py3.7-clang7-asan / test (default, 1, 4, linux.2xlarge) (11/17)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-10T02:08:29.5948653Z RuntimeError: test_ops_jit failed!
2022-05-10T02:08:17.5407363Z 
2022-05-10T02:08:17.5407478Z FAILED (errors=1, skipped=79, expected failures=147)
2022-05-10T02:08:17.5407626Z 
2022-05-10T02:08:17.5407696Z Generating XML reports...
2022-05-10T02:08:17.6364485Z Generated XML report: test-reports/python-unittest/test_ops_jit/TEST-TestJitCPU-20220510005557.xml
2022-05-10T02:08:29.5941122Z Traceback (most recent call last):
2022-05-10T02:08:29.5941479Z   File "test/run_test.py", line 1072, in <module>
2022-05-10T02:08:29.5944674Z     main()
2022-05-10T02:08:29.5944935Z   File "test/run_test.py", line 1050, in main
2022-05-10T02:08:29.5948382Z     raise RuntimeError(err_message)
2022-05-10T02:08:29.5948653Z RuntimeError: test_ops_jit failed!
2022-05-10T02:08:30.0387684Z + cleanup
2022-05-10T02:08:30.0387952Z + retcode=1
2022-05-10T02:08:30.0388182Z + set +x
2022-05-10T02:08:30.0425426Z ##[error]Process completed with exit code 1.
2022-05-10T02:08:30.0514876Z ##[group]Run pytorch/pytorch/.github/actions/get-workflow-job-id@master
2022-05-10T02:08:30.0515111Z with:
2022-05-10T02:08:30.0515525Z   github-token: ***
2022-05-10T02:08:30.0515697Z env:
2022-05-10T02:08:30.0515837Z   IN_CI: 1
2022-05-10T02:08:30.0515997Z   IS_GHA: 1

See GitHub Actions build pull / win-vs2019-cpu-py3 / test (default, 1, 2, windows.4xlarge) (12/17)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-10T01:38:25.1424829Z RuntimeError: test_ops_jit failed!
2022-05-10T01:38:20.4685423Z 
2022-05-10T01:38:20.4685584Z FAILED (errors=1, skipped=79, expected failures=147)
2022-05-10T01:38:20.4685757Z 
2022-05-10T01:38:20.4685891Z Generating XML reports...
2022-05-10T01:38:20.4686274Z Generated XML report: test-reports\python-unittest\test_ops_jit\TEST-TestJitCPU-20220510011740.xml
2022-05-10T01:38:25.1423360Z Traceback (most recent call last):
2022-05-10T01:38:25.1423774Z   File "run_test.py", line 1072, in <module>
2022-05-10T01:38:25.1424043Z     main()
2022-05-10T01:38:25.1424290Z   File "run_test.py", line 1050, in main
2022-05-10T01:38:25.1424550Z     raise RuntimeError(err_message)
2022-05-10T01:38:25.1424829Z RuntimeError: test_ops_jit failed!
2022-05-10T01:38:25.3920665Z 
2022-05-10T01:38:25.3921303Z (base) C:\actions-runner\_work\pytorch\pytorch\test>if ERRORLEVEL 1 goto fail 
2022-05-10T01:38:25.3923000Z 
2022-05-10T01:38:25.3923433Z (base) C:\actions-runner\_work\pytorch\pytorch\test>exit /b 1 
2022-05-10T01:38:25.3948727Z + cleanup
2022-05-10T01:38:25.3948932Z + retcode=1
2022-05-10T01:38:25.3949140Z + set +x
2022-05-10T01:38:25.3979700Z ##[error]Process completed with exit code 1.
2022-05-10T01:38:25.4429934Z ##[group]Run pytorch/pytorch/.github/actions/get-workflow-job-id@master
2022-05-10T01:38:25.4430284Z with:

See GitHub Actions build pull / linux-xenial-py3.7-gcc7 / test (default, 2, 2, linux.2xlarge) (13/17)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-10T00:57:21.9484905Z RuntimeError: test_jit failed!
2022-05-10T00:57:21.5613642Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_with.TestWith-20220510005536.xml
2022-05-10T00:57:21.5619989Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_data_parallel.TestDataParallel-20220510005536.xml
2022-05-10T00:57:21.5631543Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_legacy_upgraders.TestLegacyUpgraders-20220510005536.xml
2022-05-10T00:57:21.5639920Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_optimize_for_mobile_preserve_debug_info.TestOptimizeForMobilePreserveDebugInfo-20220510005536.xml
2022-05-10T00:57:21.5649977Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_save_load.TestSaveLoadFlatbuffer-20220510005536.xml
2022-05-10T00:57:21.9480016Z Traceback (most recent call last):
2022-05-10T00:57:21.9480512Z   File "test/run_test.py", line 1072, in <module>
2022-05-10T00:57:21.9482354Z     main()
2022-05-10T00:57:21.9482701Z   File "test/run_test.py", line 1050, in main
2022-05-10T00:57:21.9484646Z     raise RuntimeError(err_message)
2022-05-10T00:57:21.9484905Z RuntimeError: test_jit failed!
2022-05-10T00:57:22.1870321Z + cleanup
2022-05-10T00:57:22.1870560Z + retcode=1
2022-05-10T00:57:22.1870727Z + set +x
2022-05-10T00:57:22.1905784Z ##[error]Process completed with exit code 1.
2022-05-10T00:57:22.2046311Z ##[group]Run pytorch/pytorch/.github/actions/get-workflow-job-id@master
2022-05-10T00:57:22.2046730Z with:
2022-05-10T00:57:22.2047352Z   github-token: ***
2022-05-10T00:57:22.2047650Z env:
2022-05-10T00:57:22.2047906Z   IN_CI: 1
2022-05-10T00:57:22.2048187Z   IS_GHA: 1

See GitHub Actions build pull / linux-bionic-py3.7-clang9 / test (default, 2, 2, linux.2xlarge) (14/17)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-10T00:54:24.5381290Z RuntimeError: test_jit failed!
2022-05-10T00:54:24.0992578Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_warn.TestWarn-20220510005238.xml
2022-05-10T00:54:24.0998920Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_with.TestWith-20220510005238.xml
2022-05-10T00:54:24.1005273Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_data_parallel.TestDataParallel-20220510005238.xml
2022-05-10T00:54:24.1016423Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_legacy_upgraders.TestLegacyUpgraders-20220510005238.xml
2022-05-10T00:54:24.1025627Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_save_load.TestSaveLoadFlatbuffer-20220510005238.xml
2022-05-10T00:54:24.5376874Z Traceback (most recent call last):
2022-05-10T00:54:24.5377194Z   File "test/run_test.py", line 1072, in <module>
2022-05-10T00:54:24.5378918Z     main()
2022-05-10T00:54:24.5379152Z   File "test/run_test.py", line 1050, in main
2022-05-10T00:54:24.5381034Z     raise RuntimeError(err_message)
2022-05-10T00:54:24.5381290Z RuntimeError: test_jit failed!
2022-05-10T00:54:24.8028560Z 
2022-05-10T00:54:24.8029157Z real	1m51.202s
2022-05-10T00:54:24.8029461Z user	4m28.727s
2022-05-10T00:54:24.8029745Z sys	0m19.630s
2022-05-10T00:54:24.8030033Z + cleanup
2022-05-10T00:54:24.8030335Z + retcode=1
2022-05-10T00:54:24.8030509Z + set +x
2022-05-10T00:54:24.8062574Z ##[error]Process completed with exit code 1.
2022-05-10T00:54:24.8105549Z ##[group]Run pytorch/pytorch/.github/actions/get-workflow-job-id@master
2022-05-10T00:54:24.8105790Z with:

See GitHub Actions build pull / linux-xenial-cuda11.3-py3.7-gcc7 / test (default, 1, 4, linux.4xlarge.nvidia.gpu) (15/17)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-10T01:50:38.4978527Z RuntimeError: test_ops failed! Received signal: SIGIOT
2022-05-10T01:50:36.5939580Z   test_variant_consistency_eager_dsplit_cuda_complex64 (__main__.TestCommonCUDA) ... ok (0.012s)
2022-05-10T01:50:36.6021792Z   test_variant_consistency_eager_dsplit_cuda_float32 (__main__.TestCommonCUDA) ... ok (0.008s)
2022-05-10T01:50:36.6098202Z   test_variant_consistency_eager_dstack_cuda_complex64 (__main__.TestCommonCUDA) ... ok (0.008s)
2022-05-10T01:50:36.6158913Z   test_variant_consistency_eager_dstack_cuda_float32 (__main__.TestCommonCUDA) ... ok (0.006s)
2022-05-10T01:50:36.6331364Z   test_variant_consistency_eager_eig_cuda_complex64 (__main__.TestCommonCUDA) ... python: /opt/conda/conda-bld/magma-cuda113_1619629459349/work/interface_cuda/interface.cpp:806: void magma_queue_create_internal(magma_device_t, magma_queue**, const char*, const char*, int): Assertion `queue->dAarray__ != __null' failed.
2022-05-10T01:50:38.4972620Z Traceback (most recent call last):
2022-05-10T01:50:38.4973051Z   File "test/run_test.py", line 1072, in <module>
2022-05-10T01:50:38.4975175Z     main()
2022-05-10T01:50:38.4975566Z   File "test/run_test.py", line 1050, in main
2022-05-10T01:50:38.4978118Z     raise RuntimeError(err_message)
2022-05-10T01:50:38.4978527Z RuntimeError: test_ops failed! Received signal: SIGIOT
2022-05-10T01:50:39.7116353Z + cleanup
2022-05-10T01:50:39.7116662Z + retcode=1
2022-05-10T01:50:39.7116878Z + set +x
2022-05-10T01:50:39.7167723Z ##[error]Process completed with exit code 1.
2022-05-10T01:50:39.7217888Z ##[group]Run pytorch/pytorch/.github/actions/get-workflow-job-id@master
2022-05-10T01:50:39.7218252Z with:
2022-05-10T01:50:39.7218797Z   github-token: ***
2022-05-10T01:50:39.7219018Z env:
2022-05-10T01:50:39.7219235Z   IN_CI: 1
2022-05-10T01:50:39.7219456Z   IS_GHA: 1

See GitHub Actions build pull / linux-xenial-py3.7-gcc5.4 / test (jit_legacy, 1, 1, linux.2xlarge) (16/17)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-10T00:51:08.9355406Z RuntimeError: test_jit_legacy failed!
2022-05-10T00:51:08.5564370Z Generated XML report: test-reports/python-unittest/test_jit_legacy/TEST-jit.test_warn.TestWarn-20220510004936.xml
2022-05-10T00:51:08.5582520Z Generated XML report: test-reports/python-unittest/test_jit_legacy/TEST-jit.test_with.TestWith-20220510004936.xml
2022-05-10T00:51:08.5588666Z Generated XML report: test-reports/python-unittest/test_jit_legacy/TEST-jit.test_data_parallel.TestDataParallel-20220510004936.xml
2022-05-10T00:51:08.5599417Z Generated XML report: test-reports/python-unittest/test_jit_legacy/TEST-jit.test_legacy_upgraders.TestLegacyUpgraders-20220510004936.xml
2022-05-10T00:51:08.5609668Z Generated XML report: test-reports/python-unittest/test_jit_legacy/TEST-jit.test_save_load.TestSaveLoadFlatbuffer-20220510004936.xml
2022-05-10T00:51:08.9349490Z Traceback (most recent call last):
2022-05-10T00:51:08.9349751Z   File "test/run_test.py", line 1072, in <module>
2022-05-10T00:51:08.9351879Z     main()
2022-05-10T00:51:08.9352112Z   File "test/run_test.py", line 1050, in main
2022-05-10T00:51:08.9355152Z     raise RuntimeError(err_message)
2022-05-10T00:51:08.9355406Z RuntimeError: test_jit_legacy failed!
2022-05-10T00:51:09.2055643Z + cleanup
2022-05-10T00:51:09.2055898Z + retcode=1
2022-05-10T00:51:09.2056256Z + set +x
2022-05-10T00:51:09.2095506Z ##[error]Process completed with exit code 1.
2022-05-10T00:51:09.2132873Z ##[group]Run pytorch/pytorch/.github/actions/get-workflow-job-id@master
2022-05-10T00:51:09.2133121Z with:
2022-05-10T00:51:09.2133520Z   github-token: ***
2022-05-10T00:51:09.2133691Z env:
2022-05-10T00:51:09.2133829Z   IN_CI: 1
2022-05-10T00:51:09.2133988Z   IS_GHA: 1

See GitHub Actions build pull / linux-xenial-py3.7-gcc5.4 / test (default, 2, 2, linux.2xlarge) (17/17)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-10T00:55:44.1692842Z RuntimeError: test_jit failed!
2022-05-10T00:55:43.6951555Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_warn.TestWarn-20220510005353.xml
2022-05-10T00:55:43.6958023Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_with.TestWith-20220510005353.xml
2022-05-10T00:55:43.6964277Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_data_parallel.TestDataParallel-20220510005353.xml
2022-05-10T00:55:43.6975573Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_legacy_upgraders.TestLegacyUpgraders-20220510005353.xml
2022-05-10T00:55:43.6985135Z Generated XML report: test-reports/python-unittest/test_jit/TEST-jit.test_save_load.TestSaveLoadFlatbuffer-20220510005353.xml
2022-05-10T00:55:44.1687184Z Traceback (most recent call last):
2022-05-10T00:55:44.1687467Z   File "test/run_test.py", line 1072, in <module>
2022-05-10T00:55:44.1690133Z     main()
2022-05-10T00:55:44.1690353Z   File "test/run_test.py", line 1050, in main
2022-05-10T00:55:44.1692638Z     raise RuntimeError(err_message)
2022-05-10T00:55:44.1692842Z RuntimeError: test_jit failed!
2022-05-10T00:55:44.4434079Z + cleanup
2022-05-10T00:55:44.4434282Z + retcode=1
2022-05-10T00:55:44.4434444Z + set +x
2022-05-10T00:55:44.4468402Z ##[error]Process completed with exit code 1.
2022-05-10T00:55:44.4605365Z ##[group]Run pytorch/pytorch/.github/actions/get-workflow-job-id@master
2022-05-10T00:55:44.4605609Z with:
2022-05-10T00:55:44.4606024Z   github-token: ***
2022-05-10T00:55:44.4606197Z env:
2022-05-10T00:55:44.4606338Z   IN_CI: 1
2022-05-10T00:55:44.4606500Z   IS_GHA: 1

❄️ 1 failure tentatively classified as flaky

but reruns have not yet been triggered to confirm:

See GitHub Actions build pull / linux-xenial-py3.7-clang7-asan / test (default, 2, 4, linux.2xlarge) (1/1)

Step: "Test" (full log | diagnosis details | 🔁 rerun) ❄️

2022-05-10T02:13:47.2874547Z unknown file: Failure
2022-05-10T02:13:47.1929932Z �[0;32m[       OK ] �[mShapeAnalysisTest.DynamicShapesFusion (50 ms)
2022-05-10T02:13:47.1930834Z �[0;32m[ RUN      ] �[mShapeAnalysisTest.MovingConstantOutOfFusionGroups
2022-05-10T02:13:47.2050387Z �[0;32m[       OK ] �[mShapeAnalysisTest.MovingConstantOutOfFusionGroups (12 ms)
2022-05-10T02:13:47.2051528Z �[0;32m[ RUN      ] �[mShapeAnalysisTest.SymbolicShapeAPI
2022-05-10T02:13:47.2527206Z �[0;32m[       OK ] �[mShapeAnalysisTest.SymbolicShapeAPI (47 ms)
2022-05-10T02:13:47.2527999Z �[0;32m[ RUN      ] �[mShapeAnalysisTest.SymbolicShapeCaching
2022-05-10T02:13:47.2583916Z �[0;32m[       OK ] �[mShapeAnalysisTest.SymbolicShapeCaching (5 ms)
2022-05-10T02:13:47.2584809Z �[0;32m[ RUN      ] �[mShapeAnalysisTest.ShapeCacheMultipleFns
2022-05-10T02:13:47.2788391Z �[0;32m[       OK ] �[mShapeAnalysisTest.ShapeCacheMultipleFns (20 ms)
2022-05-10T02:13:47.2789115Z �[0;32m[ RUN      ] �[mShapeAnalysisTest.TestShapeMultipleReturns
2022-05-10T02:13:47.2874547Z unknown file: Failure
2022-05-10T02:13:47.2876358Z C++ exception with description "shape_compute_graph_->outputs().size() == schema_->returns().size() INTERNAL ASSERT FAILED at "/var/lib/jenkins/workspace/torch/csrc/jit/passes/symbolic_shape_analysis.cpp":541, please report a bug to PyTorch. 
2022-05-10T02:13:47.2880260Z Exception raised from extractOutputShape at /var/lib/jenkins/workspace/torch/csrc/jit/passes/symbolic_shape_analysis.cpp:541 (most recent call first):
2022-05-10T02:13:47.2881386Z frame #0: <unknown function> + 0x13d77c (0x7fdb86b8c77c in /opt/conda/lib/python3.7/site-packages/torch/bin/libc10.so)
2022-05-10T02:13:47.2886699Z frame #1: std::function<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > ()>::operator()() const + 0x6d (0x7fdb9aa10ccd in /opt/conda/lib/python3.7/site-packages/torch/bin/libtorch_cpu.so)
2022-05-10T02:13:47.2888219Z frame #2: c10::Error::Error(c10::SourceLocation, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >) + 0x160 (0x7fdb86b8a780 in /opt/conda/lib/python3.7/site-packages/torch/bin/libc10.so)
2022-05-10T02:13:47.2889610Z frame #3: c10::detail::torchCheckFail(char const*, char const*, unsigned int, char const*) + 0x19f (0x7fdb86b85abf in /opt/conda/lib/python3.7/site-packages/torch/bin/libc10.so)
2022-05-10T02:13:47.2891114Z frame #4: c10::detail::torchInternalAssertFail(char const*, char const*, unsigned int, char const*, c10::detail::CompileTimeEmptyString) + 0xe (0x55a201aacf2e in /opt/conda/lib/python3.7/site-packages/torch/bin/test_jit)
2022-05-10T02:13:47.2892603Z frame #5: <unknown function> + 0x141a4354 (0x7fdb9b09f354 in /opt/conda/lib/python3.7/site-packages/torch/bin/libtorch_cpu.so)
2022-05-10T02:13:47.2894280Z frame #6: torch::jit::calculateSymbolicShapesOnOp(c10::FunctionSchema const*, std::vector<c10::variant<c10::IValue, c10::SymbolicShape>, std::allocator<c10::variant<c10::IValue, c10::SymbolicShape> > > const&) + 0x49e (0x7fdb9b09c58e in /opt/conda/lib/python3.7/site-packages/torch/bin/libtorch_cpu.so)
2022-05-10T02:13:47.2895858Z frame #7: torch::jit::ShapeAnalysisTest_TestShapeMultipleReturns_Test::TestBody() + 0x60f (0x55a201fda93f in /opt/conda/lib/python3.7/site-packages/torch/bin/test_jit)

🚧 1 fixed upstream failure:

These were probably caused by upstream breakages that were already fixed.

Please rebase on the viable/strict branch (expand for instructions)

If your commit is older than viable/strict, run these commands:

git fetch https://github.com/pytorch/pytorch viable/strict
git rebase FETCH_HEAD

This comment was automatically generated by Dr. CI (expand for details).

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

@facebook-github-bot facebook-github-bot added the oncall: jit Add this issue/PR to JIT oncall triage queue label May 10, 2022
@Gamrix
Copy link
Contributor

Gamrix commented May 10, 2022

Looks good. I assume that the optimization passes will handle the tuple unpacking properly.

@Gamrix
Copy link
Contributor

Gamrix commented Jun 17, 2022

@eellison, are you still planning on landing this, or should we close it. It is currently blocking the comment change on #77115

Gamrix added a commit that referenced this pull request Aug 11, 2022
Commandeering this diff #77120
and figuring out what issues lie with it.

[ghstack-poisoned]
Gamrix added a commit that referenced this pull request Aug 11, 2022
Commandeering this diff #77120
and figuring out what issues lie with it.

[ghstack-poisoned]
Gamrix added a commit that referenced this pull request Aug 11, 2022
Commandeering this diff #77120
and figuring out what issues lie with it.

ghstack-source-id: 2b0d7e5
Pull Request resolved: #83222
pytorchmergebot pushed a commit that referenced this pull request Aug 12, 2022
Commandeering this diff #77120
and fixed the issues with it.
Pull Request resolved: #83222
Approved by: https://github.com/davidberard98
facebook-github-bot pushed a commit that referenced this pull request Aug 12, 2022
Summary:
Commandeering this diff #77120
and fixed the issues with it.

Pull Request resolved: #83222
Approved by: https://github.com/davidberard98

Test Plan: contbuild & OSS CI, see https://hud.pytorch.org/commit/pytorch/pytorch/aac317535c045cc1d52953d6e5b6dc94dec2d94d

Reviewed By: atalman

Differential Revision: D38658444

Pulled By: Gamrix

fbshipit-source-id: ef0aabd0b6ac95d8201eea8fd19ecd8941e5e2f9
@Gamrix
Copy link
Contributor

Gamrix commented Aug 12, 2022

Closing this commit, as I have commandeered, fixed and pushed the fix here: #83222

@Gamrix Gamrix closed this Aug 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla signed oncall: jit Add this issue/PR to JIT oncall triage queue

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants