[QNNPACK, Sparsity] Add wrapper for the kernels #51150

kimishpatel · 2021-01-26T23:12:46Z

Stack from ghstack:

[QNNPACK, Sparsity] Add wrapper for the kernels #51150 [QNNPACK, Sparsity] Add wrapper for the kernels
[QNNPACK Sparsity] Add aarch64 kernel of 8x1 sparsity #51120 [QNNPACK Sparsity] Add aarch64 kernel of 8x1 sparsity
[QNNPACK, Sparsity] Add 8x1 block sparse kernels for aarch32. #51119 [QNNPACK, Sparsity] Add 8x1 block sparse kernels for aarch32.
[QNNPACK, Sparsity] Code refactoring to allow for more generic block #51118 [QNNPACK, Sparsity] Code refactoring to allow for more generic block
[QNNPACK, Sparsity] Add dyanmic linear sparse kernel for arm64 #50591 [QNNPACK, Sparsity] Add dyanmic linear sparse kernel for arm64
[QNNPACK, Sparsity] Sparse kernel with 4x8 blocking #50590 [QNNPACK, Sparsity] Sparse kernel with 4x8 blocking
[QNNPACK, Sparsity] Added prepacking base aarch32 kernels #50589 [QNNPACK, Sparsity] Added prepacking base aarch32 kernels
[QNNPACK, Sparsity] ARMV7, aarch32, kernels for dynamic linear #50588 [QNNPACK, Sparsity] ARMV7, aarch32, kernels for dynamic linear
[QNNPACK:Sparsity] Add A matrix pretransformed based sparse kernels for FC #50587 [QNNPACK:Sparsity] Add A matrix pretransformed based sparse kernels for FC
[QNNPACK Sparse] Create fc sparse operator #50586 [QNNPACK Sparse] Create fc sparse operator
[QNNPACK] Block Sparse kernel. First commit. #50585 [QNNPACK] Block Sparse kernel. First commit.

Summary:
Following QNNPACK methodology, add wrappers for the sparse kernels

Test Plan:
q8gemm-sparse-test

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: D26089285

Summary: Following QNNPACK methodology, add wrappers for the sparse kernels Test Plan: q8gemm-sparse-test Reviewers: Subscribers: Tasks: Tags: [ghstack-poisoned]

facebook-github-bot · 2021-01-26T23:12:59Z

💊 CI failures summary and remediations

As of commit 7cf449b (more details on the Dr. CI page):

6/10 failures possibly* introduced in this PR
- 2/6 non-CircleCI failure(s)
4/10 broken upstream at merge base 001938d on Jan 26 from 12:49pm to 6:17pm

🕵️ 4 new failures recognized by patterns

The following CI failures do not appear to be due to upstream breakages:

pytorch_windows_vs2019_py36_cuda10.1_test2 (1/4)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

RuntimeError: distributed/test_distributed_spawn failed!

  File "C:\Users\circleci\project\build\win_tmp\build\torch\distributed\algorithms\ddp_comm_hooks\__init__.py", line 7, in <module>
    from . import (
  File "C:\Users\circleci\project\build\win_tmp\build\torch\distributed\algorithms\ddp_comm_hooks\powerSGD_hook.py", line 7, in <module>
    import torch.distributed.algorithms.ddp_comm_hooks.default_hooks as default
AttributeError: module 'torch.distributed.algorithms' has no attribute 'ddp_comm_hooks'
Traceback (most recent call last):
  File "run_test.py", line 925, in <module>
    main()
  File "run_test.py", line 904, in main
    raise RuntimeError(err_message)
RuntimeError: distributed/test_distributed_spawn failed!

(base) C:\Users\circleci\project\test>if ERRORLEVEL 1 exit /b 1 
+ cleanup
+ retcode=1
+ set +x


Exited with code exit status 1

pytorch_linux_xenial_cuda10_2_cudnn7_py3_gcc7_test2 (2/4)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

Jan 29 17:51:16 sccache: error: couldn't connect to server

Jan 29 17:51:16 +++ eval 'extract_trap_cmd '
Jan 29 17:51:16 ++++ extract_trap_cmd
Jan 29 17:51:16 ++++ printf '%s\n' ''
Jan 29 17:51:16 +++ printf '%s\n' cleanup
Jan 29 17:51:16 ++ trap -- '
Jan 29 17:51:16 cleanup' EXIT
Jan 29 17:51:16 ++ [[ pytorch-linux-xenial-cuda10.2-cudnn7-py3-gcc7-test2 != *pytorch-win-* ]]
Jan 29 17:51:16 ++ which sccache
Jan 29 17:51:16 ++ sccache --stop-server
Jan 29 17:51:16 Stopping sccache server...
Jan 29 17:51:16 sccache: error: couldn't connect to server
Jan 29 17:51:16 sccache: caused by: Connection refused (os error 111)
Jan 29 17:51:16 ++ true
Jan 29 17:51:16 ++ rm /var/lib/jenkins/sccache_error.log
Jan 29 17:51:16 ++ [[ pytorch-linux-xenial-cuda10.2-cudnn7-py3-gcc7-test2 == *rocm* ]]
Jan 29 17:51:16 ++ SCCACHE_ERROR_LOG=/var/lib/jenkins/sccache_error.log
Jan 29 17:51:16 ++ SCCACHE_IDLE_TIMEOUT=1200
Jan 29 17:51:16 ++ RUST_LOG=sccache::server=error
Jan 29 17:51:16 ++ sccache --start-server
Jan 29 17:51:16 sccache: Starting the server...
Jan 29 17:51:16 ++ sccache --zero-stats

pytorch_linux_xenial_py3_clang5_asan_test2 (3/4)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

Jan 29 17:30:05 SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior /var/lib/jenkins/workspace/aten/src/ATen/Utils.cpp:15:3 in

Jan 29 17:30:05     #7 0x55bec00b970b in PyEval_EvalCode /tmp/build/80754af9/python_1599604603603/work/Python/ceval.c:731
Jan 29 17:30:05     #8 0x55bec0139573 in run_mod /tmp/build/80754af9/python_1599604603603/work/Python/pythonrun.c:1025
Jan 29 17:30:05     #9 0x55bec013960c in PyRun_StringFlags /tmp/build/80754af9/python_1599604603603/work/Python/pythonrun.c:949
Jan 29 17:30:05     #10 0x55bec013966e in PyRun_SimpleStringFlags /tmp/build/80754af9/python_1599604603603/work/Python/pythonrun.c:445
Jan 29 17:30:05     #11 0x55bec013d472 in run_command /tmp/build/80754af9/python_1599604603603/work/Modules/main.c:301
Jan 29 17:30:05     #12 0x55bec013d472 in Py_Main /tmp/build/80754af9/python_1599604603603/work/Modules/main.c:749
Jan 29 17:30:05     #13 0x55bec000743d in main /tmp/build/80754af9/python_1599604603603/work/Programs/python.c:69
Jan 29 17:30:05     #14 0x7f2fafabb83f in __libc_start_main /build/glibc-e6zv40/glibc-2.23/csu/../csu/libc-start.c:291
Jan 29 17:30:05     #15 0x55bec00e6d0a in _start /home/rdonnelly/mc/conda-bld/compilers_linux-64_1534865402226/work/.build/src/glibc-2.12.2/csu/../sysdeps/x86_64/elf/start.S:103
Jan 29 17:30:05 
Jan 29 17:30:05 SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior /var/lib/jenkins/workspace/aten/src/ATen/Utils.cpp:15:3 in 
Jan 29 17:30:05 + retcode=1
Jan 29 17:30:05 + set -e
Jan 29 17:30:05 + return 1
Jan 29 17:30:05 + [[ pytorch-linux-xenial-py3-clang5-asan-test2 == *-NO_AVX-* ]]
Jan 29 17:30:05 + [[ pytorch-linux-xenial-py3-clang5-asan-test2 == *-NO_AVX2-* ]]
Jan 29 17:30:05 + '[' -n https://github.com/pytorch/pytorch/pull/51150 ']'
Jan 29 17:30:05 + [[ pytorch-linux-xenial-py3-clang5-asan-test2 != *coverage* ]]
Jan 29 17:30:05 ++ mktemp
Jan 29 17:30:05 + DETERMINE_FROM=/tmp/tmp.O3dxXyA0jZ
Jan 29 17:30:05 + file_diff_from_base /tmp/tmp.O3dxXyA0jZ

pytorch_windows_vs2019_py36_cuda10.1_test1 (4/4)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

RuntimeError: distributed/test_c10d failed!

  File "C:\Users\circleci\project\build\win_tmp\build\torch\distributed\algorithms\ddp_comm_hooks\__init__.py", line 7, in <module>
    from . import (
  File "C:\Users\circleci\project\build\win_tmp\build\torch\distributed\algorithms\ddp_comm_hooks\powerSGD_hook.py", line 7, in <module>
    import torch.distributed.algorithms.ddp_comm_hooks.default_hooks as default
AttributeError: module 'torch.distributed.algorithms' has no attribute 'ddp_comm_hooks'
Traceback (most recent call last):
  File "run_test.py", line 925, in <module>
    main()
  File "run_test.py", line 904, in main
    raise RuntimeError(err_message)
RuntimeError: distributed/test_c10d failed!

(base) C:\Users\circleci\project\test>if ERRORLEVEL 1 exit /b 1 
+ cleanup
+ retcode=1
+ set +x


Exited with code exit status 1

🚧 4 fixed upstream failures:

These were probably caused by upstream breakages that were already fixed.

Please rebase on the viable/strict branch (expand for instructions)

If your commit is older than viable/strict, run these commands:

git fetch https://github.com/pytorch/pytorch viable/strict
git rebase FETCH_HEAD

Check out the recency history of this "viable master" tracking branch.

pytorch_linux_xenial_py3_clang5_asan_test1 on Jan 26 from 12:49pm to 5:48pm (a949d7b - 5748410)
- 🔁 rerun
pytorch_linux_xenial_cuda10_2_cudnn7_py3_gcc7_test1 on Jan 26 from 1:29pm to 6:17pm (6f3aa58 - 5748410)
- 🔁 rerun
pytorch_linux_xenial_py3_6_gcc5_4_test on Jan 26 from 1:51pm to 5:48pm (f08464f - 5748410)
- 🔁 rerun
pytorch_linux_bionic_py3_6_clang9_test on Jan 26 from 1:29pm to 5:39pm (6f3aa58 - 5748410)
- 🔁 rerun

ci.pytorch.org: 1 failed

Failed: pr/pytorch-linux-bionic-rocm3.10-py3.6

This comment was automatically generated by Dr. CI (expand for details).

Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Summary: Following QNNPACK methodology, add wrappers for the sparse kernels Test Plan: q8gemm-sparse-test Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D26089285](https://our.internmc.facebook.com/intern/diff/D26089285) [ghstack-poisoned]

Summary: Following QNNPACK methodology, add wrappers for the sparse kernels Test Plan: q8gemm-sparse-test Reviewers: Subscribers: Tasks: Tags: ghstack-source-id: 1afa826332bf57f69e7262b091b82d147179a955 Pull Request resolved: #51150

Summary: Following QNNPACK methodology, add wrappers for the sparse kernels Test Plan: q8gemm-sparse-test Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D26089285](https://our.internmc.facebook.com/intern/diff/D26089285) [ghstack-poisoned]

Summary: Following QNNPACK methodology, add wrappers for the sparse kernels Test Plan: q8gemm-sparse-test Reviewers: Subscribers: Tasks: Tags: ghstack-source-id: 409ea6a0ce6ddef6b10d04243e1d1bdba63c561d Pull Request resolved: #51150

[QNNPACK, Sparsity] Add wrapper for the kernels

23a97d6

Summary: Following QNNPACK methodology, add wrappers for the sparse kernels Test Plan: q8gemm-sparse-test Reviewers: Subscribers: Tasks: Tags: [ghstack-poisoned]

facebook-github-bot added the cla signed label Jan 26, 2021

This was referenced Jan 26, 2021

[QNNPACK, Sparsity] Add dyanmic linear sparse kernel for arm64 #50591

Closed

[QNNPACK, Sparsity] Code refactoring to allow for more generic block #51118

Closed

This was referenced Jan 26, 2021

[QNNPACK, Sparsity] Add 8x1 block sparse kernels for aarch32. #51119

Closed

[QNNPACK Sparsity] Add aarch64 kernel of 8x1 sparsity #51120

Closed

[QNNPACK, Sparsity] Remove unused kernels and codepaths #51149

Closed

kimishpatel requested a review from AshkanAliabadi January 29, 2021 15:55

AshkanAliabadi closed this Jan 29, 2021

AshkanAliabadi reopened this Jan 29, 2021

kimishpatel closed this Jan 29, 2021

facebook-github-bot deleted the gh/kimishpatel/45/head branch March 1, 2021 15:16

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[QNNPACK, Sparsity] Add wrapper for the kernels #51150

[QNNPACK, Sparsity] Add wrapper for the kernels #51150

kimishpatel commented Jan 26, 2021 •

edited

facebook-github-bot commented Jan 26, 2021 •

edited

[QNNPACK, Sparsity] Add wrapper for the kernels #51150

[QNNPACK, Sparsity] Add wrapper for the kernels #51150

Conversation

kimishpatel commented Jan 26, 2021 • edited

facebook-github-bot commented Jan 26, 2021 • edited

💊 CI failures summary and remediations

🕵️ 4 new failures recognized by patterns

pytorch_windows_vs2019_py36_cuda10.1_test2 (1/4)

pytorch_linux_xenial_cuda10_2_cudnn7_py3_gcc7_test2 (2/4)

pytorch_linux_xenial_py3_clang5_asan_test2 (3/4)

pytorch_windows_vs2019_py36_cuda10.1_test1 (4/4)

🚧 4 fixed upstream failures:

ci.pytorch.org: 1 failed

kimishpatel commented Jan 26, 2021 •

edited

facebook-github-bot commented Jan 26, 2021 •

edited