Skip to content

Conversation

Amyh11325
Copy link
Contributor

@Amyh11325 Amyh11325 commented Jul 20, 2021

Stack from ghstack:

Summary:

CMakeLists.txt
Android NNAPI delegate library was moved from test/cpp/jit/CMakeLists.txt to torch/CMakeLists.txt. This resolves the issue the original PR had, where the NNAPI delegate library was added to builds without Python (when it depends on Python).
Original PR: #61594

There's an error where the library cannot be built on MacOS. This problem existed in the original PR as well, but now an issue has been created: #61930

test_backend_nnapi.py
Also changed the skip unit test headers so that it's a little cleaner. Now the unit tests are skipped if the Nnapi delegate library file is not found. Previously, the skip was based on the platform (only allowing Linux).

Test Plan:

Ran NNAPI delegate unit tests with python test/test_jit.py TestNnapiBackend

Reviewers:

Subscribers:
myuan

Tasks:

Tags:

Differential Revision: D29799895

…process: Basic OSS Test"

Summary:
Using this PR to test CI tests in
#61787, since I'm also trying to
learn how to debug by rerunning jobs with SSH.

Test Plan:

Reviewers:

Subscribers:
myuan

Tasks:

Tags:

[ghstack-poisoned]
@facebook-github-bot facebook-github-bot added cla signed oncall: jit Add this issue/PR to JIT oncall triage queue labels Jul 20, 2021
@facebook-github-bot
Copy link
Contributor

facebook-github-bot commented Jul 20, 2021

💊 CI failures summary and remediations

As of commit 96351c4 (more details on the Dr. CI page and at hud.pytorch.org/pr/61878):


  • 4/4 failures introduced in this PR

🕵️ 4 new failures recognized by patterns

The following CI failures do not appear to be due to upstream breakages:

See GitHub Actions build Windows CI (pytorch-win-vs2019-cuda10-cudnn7-py3) / test (default, 2, 2, windows.8xlarge.nvidia.gpu) (1/4)

Step: "Store PyTorch Test Reports" (full log | diagnosis details | 🔁 rerun)

2021-07-21T07:54:11.2101123Z ls: cannot access ...d/win_tmp/ci_scripts/*': No such file or directory
2021-07-21T07:54:11.1317600Z + PYTORCH_FINAL_PACKAGE_DIR=/c/1051421105/build-results/
2021-07-21T07:54:11.1403377Z ++ cygpath -w /c/1051421105/build-results/
2021-07-21T07:54:11.1543180Z + PYTORCH_FINAL_PACKAGE_DIR_WIN='C:\1051421105\build-results\'
2021-07-21T07:54:11.1544080Z + export PYTORCH_FINAL_PACKAGE_DIR_WIN
2021-07-21T07:54:11.1544655Z + export PYTORCH_TEST_SKIP_NOARCH=1
2021-07-21T07:54:11.1545124Z + PYTORCH_TEST_SKIP_NOARCH=1
2021-07-21T07:54:11.1545871Z + mkdir -p /c/actions-runner/_work/pytorch/pytorch/pytorch-1051421105/build/win_tmp/build/torch
2021-07-21T07:54:11.1752150Z + CI_SCRIPTS_DIR=/c/actions-runner/_work/pytorch/pytorch/pytorch-1051421105/build/win_tmp/ci_scripts
2021-07-21T07:54:11.1753250Z + mkdir -p /c/actions-runner/_work/pytorch/pytorch/pytorch-1051421105/build/win_tmp/ci_scripts
2021-07-21T07:54:11.2008611Z ++ ls '/c/actions-runner/_work/pytorch/pytorch/pytorch-1051421105/build/win_tmp/ci_scripts/*'
2021-07-21T07:54:11.2101123Z ls: cannot access '/c/actions-runner/_work/pytorch/pytorch/pytorch-1051421105/build/win_tmp/ci_scripts/*': No such file or directory
2021-07-21T07:54:11.2103727Z + '[' -n '' ']'
2021-07-21T07:54:11.2105258Z + export SCRIPT_HELPERS_DIR=/c/actions-runner/_work/pytorch/pytorch/pytorch-1051421105/.jenkins/pytorch/win-test-helpers
2021-07-21T07:54:11.2107209Z + SCRIPT_HELPERS_DIR=/c/actions-runner/_work/pytorch/pytorch/pytorch-1051421105/.jenkins/pytorch/win-test-helpers
2021-07-21T07:54:11.2108019Z + IN_PULL_REQUEST=
2021-07-21T07:54:11.2108358Z + '[' -n '' ']'
2021-07-21T07:54:11.2109242Z + [[ pytorch-win-vs2019-cuda10-cudnn7-py3 == *cuda11* ]]
2021-07-21T07:54:11.2109913Z + run_tests
2021-07-21T07:54:11.2110759Z + for path in '/c/Program Files/NVIDIA Corporation/NVSMI/nvidia-smi.exe' /c/Windows/System32/nvidia-smi.exe
2021-07-21T07:54:11.2111730Z + [[ -x /c/Program Files/NVIDIA Corporation/NVSMI/nvidia-smi.exe ]]
2021-07-21T07:54:11.2112510Z + '/c/Program Files/NVIDIA Corporation/NVSMI/nvidia-smi.exe'

See GitHub Actions build Windows CI (pytorch-win-vs2019-cpu-py3) / test (default, 1, 2, windows.4xlarge) (2/4)

Step: "Store PyTorch Test Reports" (full log | diagnosis details | 🔁 rerun)

2021-07-21T07:03:38.2983961Z ls: cannot access ...d/win_tmp/ci_scripts/*': No such file or directory
2021-07-21T07:03:38.1852771Z + PYTORCH_FINAL_PACKAGE_DIR=/c/1051421103/build-results/
2021-07-21T07:03:38.1920702Z ++ cygpath -w /c/1051421103/build-results/
2021-07-21T07:03:38.2028051Z + PYTORCH_FINAL_PACKAGE_DIR_WIN='C:\1051421103\build-results\'
2021-07-21T07:03:38.2028633Z + export PYTORCH_FINAL_PACKAGE_DIR_WIN
2021-07-21T07:03:38.2029081Z + export PYTORCH_TEST_SKIP_NOARCH=1
2021-07-21T07:03:38.2029470Z + PYTORCH_TEST_SKIP_NOARCH=1
2021-07-21T07:03:38.2030084Z + mkdir -p /c/actions-runner/_work/pytorch/pytorch/pytorch-1051421103/build/win_tmp/build/torch
2021-07-21T07:03:38.2413562Z + CI_SCRIPTS_DIR=/c/actions-runner/_work/pytorch/pytorch/pytorch-1051421103/build/win_tmp/ci_scripts
2021-07-21T07:03:38.2414468Z + mkdir -p /c/actions-runner/_work/pytorch/pytorch/pytorch-1051421103/build/win_tmp/ci_scripts
2021-07-21T07:03:38.2621849Z ++ ls '/c/actions-runner/_work/pytorch/pytorch/pytorch-1051421103/build/win_tmp/ci_scripts/*'
2021-07-21T07:03:38.2983961Z ls: cannot access '/c/actions-runner/_work/pytorch/pytorch/pytorch-1051421103/build/win_tmp/ci_scripts/*': No such file or directory
2021-07-21T07:03:38.2987226Z + '[' -n '' ']'
2021-07-21T07:03:38.2988582Z + export SCRIPT_HELPERS_DIR=/c/actions-runner/_work/pytorch/pytorch/pytorch-1051421103/.jenkins/pytorch/win-test-helpers
2021-07-21T07:03:38.2989640Z + SCRIPT_HELPERS_DIR=/c/actions-runner/_work/pytorch/pytorch/pytorch-1051421103/.jenkins/pytorch/win-test-helpers
2021-07-21T07:03:38.2990281Z + IN_PULL_REQUEST=
2021-07-21T07:03:38.2990588Z + '[' -n '' ']'
2021-07-21T07:03:38.2991010Z + [[ pytorch-win-vs2019-cpu-py3 == *cuda11* ]]
2021-07-21T07:03:38.2991462Z + run_tests
2021-07-21T07:03:38.2992051Z + for path in '/c/Program Files/NVIDIA Corporation/NVSMI/nvidia-smi.exe' /c/Windows/System32/nvidia-smi.exe
2021-07-21T07:03:38.2992831Z + [[ -x /c/Program Files/NVIDIA Corporation/NVSMI/nvidia-smi.exe ]]
2021-07-21T07:03:38.2993469Z + '/c/Program Files/NVIDIA Corporation/NVSMI/nvidia-smi.exe'

See GitHub Actions build Windows CI (pytorch-win-vs2019-cpu-py3) / test (default, 2, 2, windows.4xlarge) (3/4)

Step: "Store PyTorch Test Reports" (full log | diagnosis details | 🔁 rerun)

2021-07-21T07:37:11.9949120Z test_add_done_ca...arg() takes 0 positional arguments but 1 was given
2021-07-21T07:37:11.9902651Z   c:\jenkins\miniconda3\lib\site-packages\coverage\execfile.py(247): run
2021-07-21T07:37:11.9903294Z   c:\jenkins\miniconda3\lib\site-packages\coverage\cmdline.py(746): do_run
2021-07-21T07:37:11.9903942Z   c:\jenkins\miniconda3\lib\site-packages\coverage\cmdline.py(588): command_line
2021-07-21T07:37:11.9904607Z   c:\jenkins\miniconda3\lib\site-packages\coverage\cmdline.py(871): main
2021-07-21T07:37:11.9905210Z   C:\Jenkins\Miniconda3\Scripts\coverage.exe\__main__.py(7): <module>
2021-07-21T07:37:11.9905732Z   c:\jenkins\miniconda3\lib\runpy.py(87): _run_code
2021-07-21T07:37:11.9906214Z   c:\jenkins\miniconda3\lib\runpy.py(194): _run_module_as_main
2021-07-21T07:37:11.9906497Z 
2021-07-21T07:37:11.9906734Z ok (0.010s)
2021-07-21T07:37:11.9933702Z   test_add_done_callback_maintains_callback_order (__main__.TestFuture) ... ok (0.000s)
2021-07-21T07:37:11.9949120Z   test_add_done_callback_no_arg_error_is_ignored (__main__.TestFuture) ... [E pybind_utils.h:200] Got the following error when running the callback: TypeError: no_arg() takes 0 positional arguments but 1 was given
2021-07-21T07:37:11.9950196Z ok (0.000s)
2021-07-21T07:37:11.9978276Z   test_add_done_callback_simple (__main__.TestFuture) ... ok (0.000s)
2021-07-21T07:37:12.0033855Z   test_chained_then (__main__.TestFuture) ... ok (0.000s)
2021-07-21T07:37:12.1085125Z   test_collect_all (__main__.TestFuture) ... ok (0.119s)
2021-07-21T07:37:12.1107120Z   test_done (__main__.TestFuture) ... ok (0.000s)
2021-07-21T07:37:12.1141475Z   test_done_exception (__main__.TestFuture) ... ok (0.000s)
2021-07-21T07:37:12.1183810Z   test_interleaving_then_and_add_done_callback_maintains_callback_order (__main__.TestFuture) ... ok (0.000s)
2021-07-21T07:37:12.1210664Z   test_interleaving_then_and_add_done_callback_propagates_error (__main__.TestFuture) ... [E pybind_utils.h:200] Got the following error when running the callback: ValueError: Expected error
2021-07-21T07:37:12.1211319Z 
2021-07-21T07:37:12.1211541Z At:

See CircleCI build pytorch_xla_linux_bionic_py3_6_clang9_test (4/4)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

Jul 21 21:01:33 AssertionError: False is not tr...ot sizes torch.Size([5, 5, 5]) and torch.Size([]).
Jul 21 21:01:33   File "/opt/conda/lib/python3.6/site-packages/torch/testing/_internal/common_device_type.py", line 780, in test_wrapper
Jul 21 21:01:33     return test(*args, **kwargs)
Jul 21 21:01:33   File "/var/lib/jenkins/workspace/xla/test/test_ops.py", line 411, in test_reference_eager
Jul 21 21:01:33     self.compare_with_eager_reference(op, sample_input)
Jul 21 21:01:33   File "/var/lib/jenkins/workspace/xla/test/test_ops.py", line 402, in compare_with_eager_reference
Jul 21 21:01:33     self.assertEqual(actual, expected, exact_dtype=True, exact_device=False)
Jul 21 21:01:33   File "/var/lib/jenkins/workspace/xla/test/pytorch_test_base.py", line 608, in assertEqual
Jul 21 21:01:33     return DeviceTypeTestBase.assertEqual(self, x, y, *args, **kwargs)
Jul 21 21:01:33   File "/opt/conda/lib/python3.6/site-packages/torch/testing/_internal/common_utils.py", line 1524, in assertEqual
Jul 21 21:01:33     super().assertTrue(result, msg=self._get_assert_msg(msg, debug_msg=debug_msg))
Jul 21 21:01:33 AssertionError: False is not true : Tensors failed to compare as equal!Attempted to compare equality of tensors with different sizes. Got sizes torch.Size([5, 5, 5]) and torch.Size([]).
Jul 21 21:01:33 
Jul 21 21:01:33 ----------------------------------------------------------------------
Jul 21 21:01:33 Ran 347 tests in 333.415s
Jul 21 21:01:33 
Jul 21 21:01:33 FAILED (failures=4)
Jul 21 21:01:33 
Jul 21 21:01:33 Generating XML reports...
Jul 21 21:01:33 + cleanup
Jul 21 21:01:33 + retcode=1
Jul 21 21:01:33 + set +x

Preview docs built from this PR

This comment was automatically generated by Dr. CI (expand for details).Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

Amyh11325 pushed a commit that referenced this pull request Jul 20, 2021
…process: Basic OSS Test"

Summary:
Using this PR to test CI tests in
#61787, since I'm also trying to
learn how to debug by rerunning jobs with SSH.

Test Plan:

Reviewers:

Subscribers:
myuan

Tasks:

Tags:

ghstack-source-id: 6d1661e
Pull Request resolved: #61878
@iseeyuan
Copy link
Contributor

Looks like it has the undefined python symbol issue with Mac build?

@Amyh11325
Copy link
Contributor Author

@Amyh11325 has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

…elegate Preprocess: Basic OSS Test""


Summary:
Using this PR to test CI tests in
#61787, since I'm also trying to
learn how to debug by rerunning jobs with SSH.

Test Plan:
To run NNAPI delegate unit tests: `python test/test_jit.py TestNnapiBackend`

Reviewers:

Subscribers:
myuan

Tasks:

Tags:

Differential Revision: [D29799895](https://our.internmc.facebook.com/intern/diff/D29799895)

[ghstack-poisoned]
@Amyh11325 Amyh11325 changed the title Test PR: Back out "Revert D29687143: [3/N] Nnapi Backend Delegate Preprocess: Basic OSS Test" Back out "Revert D29687143: [3/N] Nnapi Backend Delegate Preprocess: Basic OSS Test" Jul 20, 2021
Copy link
Contributor

@iseeyuan iseeyuan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks!

import torch._C
from pathlib import Path

from torch.testing._internal.common_utils import (
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please fix the lint error before landing it.

)
add_dependencies(torch_python gen_torch_version)

if(NOT ${CMAKE_SYSTEM_NAME} MATCHES "Darwin")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please submit a github issue and put the issue number in the comment.

…reprocess: Basic OSS Test""


Summary:
Android NNAPI delegate library was moved from test/cpp/jit/CMakeLists.txt to torch/CMakeLists.txt. This resolves the issue the original PR had, where the NNAPI delegate library was added to builds without Python (when it depends on Python).
Original PR #61594

Test Plan:
Ran NNAPI delegate unit tests with `python test/test_jit.py TestNnapiBackend`

Reviewers:

Subscribers:
myuan

Tasks:

Tags:

Differential Revision: [D29799895](https://our.internmc.facebook.com/intern/diff/D29799895)

[ghstack-poisoned]
Amyh11325 pushed a commit that referenced this pull request Jul 20, 2021
…process: Basic OSS Test"

Summary:
Using this PR to test CI tests in
#61787, since I'm also trying to
learn how to debug by rerunning jobs with SSH.

Test Plan:

Reviewers:

Subscribers:
myuan

Tasks:

Tags:

ghstack-source-id: 86ef35a
Pull Request resolved: #61878
@Amyh11325 Amyh11325 requested review from dreiss, iseeyuan and malfet July 20, 2021 20:23
@Amyh11325
Copy link
Contributor Author

@Amyh11325 has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

…reprocess: Basic OSS Test""


### Summary:
**CMakeLists.txt**
Android NNAPI delegate library was moved from test/cpp/jit/CMakeLists.txt to torch/CMakeLists.txt. This resolves the issue the original PR had, where the NNAPI delegate library was added to builds without Python (when it depends on Python).
**Original PR**: #61594

There's an error where the library cannot be built on MacOS. This problem existed in the original PR as well, but now an issue has been created: #61930

**test_backend_nnapi.py**
Also changed the skip unit test headers so that it's a little cleaner. Now the unit tests are skipped if the Nnapi delegate library file is not found. Previously, the skip was based on the platform (only allowing Linux).

### Test Plan:
Ran NNAPI delegate unit tests with `python test/test_jit.py TestNnapiBackend`

Reviewers:

Subscribers:
myuan

Tasks:

Tags:

Differential Revision: [D29799895](https://our.internmc.facebook.com/intern/diff/D29799895)

[ghstack-poisoned]
Amyh11325 pushed a commit that referenced this pull request Jul 21, 2021
…process: Basic OSS Test"

Summary:
Using this PR to test CI tests in
#61787, since I'm also trying to
learn how to debug by rerunning jobs with SSH.

Test Plan:

Reviewers:

Subscribers:
myuan

Tasks:

Tags:

ghstack-source-id: 92bebce
Pull Request resolved: #61878
@Amyh11325
Copy link
Contributor Author

@Amyh11325 has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

@facebook-github-bot
Copy link
Contributor

This pull request has been merged in a03466c.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla signed Merged oncall: jit Add this issue/PR to JIT oncall triage queue

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants