Skip to content

Conversation

VitalyFedyunin
Copy link
Contributor

@VitalyFedyunin VitalyFedyunin commented May 12, 2021

Stack from ghstack:

@facebook-github-bot
Copy link
Contributor

facebook-github-bot commented May 12, 2021

💊 CI failures summary and remediations

As of commit d641d6a (more details on the Dr. CI page and at hud.pytorch.org/pr/58148):


  • 17/17 failures possibly* introduced in this PR
    • 1/17 non-scanned failure(s)

🕵️ 9 new failures recognized by patterns

The following CI failures do not appear to be due to upstream breakages:

See GitHub Actions build Lint / mypy (1/9)

Step: "Run mypy" (full log | diagnosis details | 🔁 rerun)

2021-06-24T18:40:36.8127340Z torch/utils/data/d...error: Too many arguments for "_apply" [call-arg]
2021-06-24T18:39:46.5789982Z   pythonLocation: /opt/hostedtoolcache/Python/3.8.10/x64
2021-06-24T18:39:46.5790850Z   LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.8.10/x64/lib
2021-06-24T18:39:46.5791506Z ##[endgroup]
2021-06-24T18:39:46.5879501Z + STATUS=
2021-06-24T18:39:46.5880427Z + for CONFIG in mypy*.ini
2021-06-24T18:39:46.5881580Z + mypy --config=mypy-strict.ini
2021-06-24T18:40:03.5102465Z Success: no issues found in 144 source files
2021-06-24T18:40:04.4730139Z + for CONFIG in mypy*.ini
2021-06-24T18:40:04.4731283Z + mypy --config=mypy.ini
2021-06-24T18:40:36.8119470Z torch/utils/data/datapipes/iter/grouping.py:91:1: error: Name 'UnBatchIterDataPipe' already defined on line 26  [no-redef]
2021-06-24T18:40:36.8127340Z torch/utils/data/datapipes/iter/selecting.py:61:24: error: Too many arguments for "_apply"  [call-arg]
2021-06-24T18:41:19.3864608Z Found 2 errors in 2 files (checked 1385 source files)
2021-06-24T18:41:21.3193804Z + STATUS=fail
2021-06-24T18:41:21.3194413Z Please fix the above mypy warnings.
2021-06-24T18:41:21.3205348Z + '[' -n fail ']'
2021-06-24T18:41:21.3206462Z + echo 'Please fix the above mypy warnings.'
2021-06-24T18:41:21.3207200Z + false
2021-06-24T18:41:21.3213602Z ##[error]Process completed with exit code 1.
2021-06-24T18:41:21.3319270Z Post job cleanup.
2021-06-24T18:41:21.4456063Z [command]/usr/bin/git version
2021-06-24T18:41:21.4525392Z git version 2.32.0

See CircleCI build pytorch_linux_bionic_py3_8_gcc9_coverage_build (2/9)

Step: "Build" (full log | diagnosis details | 🔁 rerun)

Jun 24 19:00:43 rm: cannot remove '/var/lib/jenkins/sccache_error.log': No such file or directory
Jun 24 19:00:43 ++++ extract_trap_cmd
Jun 24 19:00:43 ++++ printf '%s\n' ''
Jun 24 19:00:43 +++ printf '%s\n' cleanup
Jun 24 19:00:43 ++ trap -- '
Jun 24 19:00:43 cleanup' EXIT
Jun 24 19:00:43 ++ [[ pytorch-linux-bionic-py3.8-gcc9-coverage-build != *pytorch-win-* ]]
Jun 24 19:00:43 ++ which sccache
Jun 24 19:00:43 ++ sccache --stop-server
Jun 24 19:00:43 ++ true
Jun 24 19:00:43 ++ rm /var/lib/jenkins/sccache_error.log
Jun 24 19:00:43 rm: cannot remove '/var/lib/jenkins/sccache_error.log': No such file or directory
Jun 24 19:00:43 ++ true
Jun 24 19:00:43 ++ [[ -n '' ]]
Jun 24 19:00:43 ++ [[ pytorch-linux-bionic-py3.8-gcc9-coverage-build == *rocm* ]]
Jun 24 19:00:43 ++ SCCACHE_ERROR_LOG=/var/lib/jenkins/sccache_error.log
Jun 24 19:00:43 ++ SCCACHE_IDLE_TIMEOUT=1200
Jun 24 19:00:43 ++ RUST_LOG=sccache::server=error
Jun 24 19:00:43 ++ sccache --start-server
Jun 24 19:00:43 sccache: Starting the server...
Jun 24 19:00:43 ++ sccache --zero-stats
Jun 24 19:00:43 Compile requests                      0

See CircleCI build pytorch_linux_xenial_py3_clang7_onnx_build (3/9)

Step: "Build" (full log | diagnosis details | 🔁 rerun)

Jun 24 18:49:23 rm: cannot remove '/var/lib/jenkins/sccache_error.log': No such file or directory
Jun 24 18:49:23 ++++ extract_trap_cmd
Jun 24 18:49:23 ++++ printf '%s\n' ''
Jun 24 18:49:23 +++ printf '%s\n' cleanup
Jun 24 18:49:23 ++ trap -- '
Jun 24 18:49:23 cleanup' EXIT
Jun 24 18:49:23 ++ [[ pytorch-linux-xenial-py3-clang7-onnx-build != *pytorch-win-* ]]
Jun 24 18:49:23 ++ which sccache
Jun 24 18:49:23 ++ sccache --stop-server
Jun 24 18:49:23 ++ true
Jun 24 18:49:23 ++ rm /var/lib/jenkins/sccache_error.log
Jun 24 18:49:23 rm: cannot remove '/var/lib/jenkins/sccache_error.log': No such file or directory
Jun 24 18:49:23 ++ true
Jun 24 18:49:23 ++ [[ -n '' ]]
Jun 24 18:49:23 ++ [[ pytorch-linux-xenial-py3-clang7-onnx-build == *rocm* ]]
Jun 24 18:49:23 ++ SCCACHE_ERROR_LOG=/var/lib/jenkins/sccache_error.log
Jun 24 18:49:23 ++ SCCACHE_IDLE_TIMEOUT=1200
Jun 24 18:49:23 ++ RUST_LOG=sccache::server=error
Jun 24 18:49:23 ++ sccache --start-server
Jun 24 18:49:23 sccache: Starting the server...
Jun 24 18:49:23 ++ sccache --zero-stats
Jun 24 18:49:23 Compile requests                      0

See CircleCI build pytorch_linux_xenial_cuda11_1_cudnn8_py3_gcc7_build (4/9)

Step: "Build" (full log | diagnosis details | 🔁 rerun)

Jun 24 19:18:24 ERROR 2021-06-24T18:55:57Z: scc...eof ((socklen_t)))\n ^\n" }
Jun 24 19:18:24 ERROR 2021-06-24T18:55:50Z: sccache::server: Compilation failed: Output { status: ExitStatus(ExitStatus(256)), stdout: "", stderr: "conftest.c: In function \'main\':\nconftest.c:332:2: error: \'struct sockaddr\' has no member named \'sa_len\'\n x.sa_len = 0;\n  ^\n" }
Jun 24 19:18:24 
Jun 24 19:18:24 ERROR 2021-06-24T18:55:53Z: sccache::server: Compilation failed: Output { status: ExitStatus(ExitStatus(256)), stdout: "", stderr: "conftest.c: In function \'main\':\nconftest.c:366:10: error: \'RTLD_MEMBER\' undeclared (first use in this function); did you mean \'RTLD_NEXT\'?\n   (void) RTLD_MEMBER;\n          ^~~~~~~~~~~\n          RTLD_NEXT\nconftest.c:366:10: note: each undeclared identifier is reported only once for each function it appears in\n" }
Jun 24 19:18:24 
Jun 24 19:18:24 ERROR 2021-06-24T18:55:54Z: sccache::server: Compilation failed: Output { status: ExitStatus(ExitStatus(256)), stdout: "", stderr: "conftest.c:361:9: error: unknown type name \'not\'\n         not a universal capable compiler\n         ^~~\nconftest.c:361:15: error: expected \'=\', \',\', \';\', \'asm\' or \'__attribute__\' before \'universal\'\n         not a universal capable compiler\n               ^~~~~~~~~\nconftest.c:361:15: error: unknown type name \'universal\'\n" }
Jun 24 19:18:24 
Jun 24 19:18:24 ERROR 2021-06-24T18:55:54Z: sccache::server: Compilation failed: Output { status: ExitStatus(ExitStatus(256)), stdout: "", stderr: "conftest.c: In function \'main\':\nconftest.c:367:4: error: unknown type name \'not\'; did you mean \'ino_t\'?\n    not big endian\n    ^~~\n    ino_t\nconftest.c:367:12: error: expected \'=\', \',\', \';\', \'asm\' or \'__attribute__\' before \'endian\'\n    not big endian\n            ^~~~~~\n" }
Jun 24 19:18:24 
Jun 24 19:18:24 ERROR 2021-06-24T18:55:55Z: sccache::server: Compilation failed: Output { status: ExitStatus(ExitStatus(256)), stdout: "", stderr: "conftest.c: In function \'main\':\nconftest.c:378:4: error: \'struct stat\' has no member named \'st_mtimespec\'; did you mean \'st_mtim\'?\n st.st_mtimespec.tv_nsec = 1;\n    ^~~~~~~~~~~~\n    st_mtim\n" }
Jun 24 19:18:24 
Jun 24 19:18:24 ERROR 2021-06-24T18:55:57Z: sccache::server: Compilation failed: Output { status: ExitStatus(ExitStatus(256)), stdout: "", stderr: "conftest.c: In function \'main\':\nconftest.c:402:24: error: expected expression before \')\' token\n if (sizeof ((socklen_t)))\n                        ^\n" }
Jun 24 19:18:24 
Jun 24 19:18:24 =========== If your build fails, please take a look at the log above for possible reasons ===========
Jun 24 19:18:24 Compile requests                  10249
Jun 24 19:18:24 Compile requests executed          6144
Jun 24 19:18:24 Cache hits                         6069
Jun 24 19:18:24 Cache hits (C/C++)                 5504
Jun 24 19:18:24 Cache hits (CUDA)                   565
Jun 24 19:18:24 Cache misses                          7
Jun 24 19:18:24 Cache misses (C/C++)                  7
Jun 24 19:18:24 Cache timeouts                        0

See CircleCI build pytorch_xla_linux_bionic_py3_6_clang9_build (5/9)

Step: "Build" (full log | diagnosis details | 🔁 rerun)

Jun 24 18:49:00 rm: cannot remove '/var/lib/jenkins/sccache_error.log': No such file or directory
Jun 24 18:49:00 ++++ extract_trap_cmd
Jun 24 18:49:00 ++++ printf '%s\n' ''
Jun 24 18:49:00 +++ printf '%s\n' cleanup
Jun 24 18:49:00 ++ trap -- '
Jun 24 18:49:00 cleanup' EXIT
Jun 24 18:49:00 ++ [[ pytorch-xla-linux-bionic-py3.6-clang9-build != *pytorch-win-* ]]
Jun 24 18:49:00 ++ which sccache
Jun 24 18:49:00 ++ sccache --stop-server
Jun 24 18:49:00 ++ true
Jun 24 18:49:00 ++ rm /var/lib/jenkins/sccache_error.log
Jun 24 18:49:00 rm: cannot remove '/var/lib/jenkins/sccache_error.log': No such file or directory
Jun 24 18:49:00 ++ true
Jun 24 18:49:00 ++ [[ -n '' ]]
Jun 24 18:49:00 ++ [[ pytorch-xla-linux-bionic-py3.6-clang9-build == *rocm* ]]
Jun 24 18:49:00 ++ SCCACHE_ERROR_LOG=/var/lib/jenkins/sccache_error.log
Jun 24 18:49:00 ++ SCCACHE_IDLE_TIMEOUT=1200
Jun 24 18:49:00 ++ RUST_LOG=sccache::server=error
Jun 24 18:49:00 ++ sccache --start-server
Jun 24 18:49:00 sccache: Starting the server...
Jun 24 18:49:00 ++ sccache --zero-stats
Jun 24 18:49:00 Compile requests                      0

See CircleCI build pytorch_linux_bionic_py3_6_clang9_noarch_build (6/9)

Step: "Build" (full log | diagnosis details | 🔁 rerun)

Jun 24 18:48:26 rm: cannot remove '/var/lib/jenkins/sccache_error.log': No such file or directory
Jun 24 18:48:25 ++++ extract_trap_cmd
Jun 24 18:48:25 ++++ printf '%s\n' ''
Jun 24 18:48:25 +++ printf '%s\n' cleanup
Jun 24 18:48:25 ++ trap -- '
Jun 24 18:48:25 cleanup' EXIT
Jun 24 18:48:25 ++ [[ pytorch-linux-bionic-py3.6-clang9-noarch-build != *pytorch-win-* ]]
Jun 24 18:48:25 ++ which sccache
Jun 24 18:48:25 ++ sccache --stop-server
Jun 24 18:48:26 ++ true
Jun 24 18:48:26 ++ rm /var/lib/jenkins/sccache_error.log
Jun 24 18:48:26 rm: cannot remove '/var/lib/jenkins/sccache_error.log': No such file or directory
Jun 24 18:48:26 ++ true
Jun 24 18:48:26 ++ [[ -n '' ]]
Jun 24 18:48:26 ++ [[ pytorch-linux-bionic-py3.6-clang9-noarch-build == *rocm* ]]
Jun 24 18:48:26 ++ SCCACHE_ERROR_LOG=/var/lib/jenkins/sccache_error.log
Jun 24 18:48:26 ++ SCCACHE_IDLE_TIMEOUT=1200
Jun 24 18:48:26 ++ RUST_LOG=sccache::server=error
Jun 24 18:48:26 ++ sccache --start-server
Jun 24 18:48:26 sccache: Starting the server...
Jun 24 18:48:26 ++ sccache --zero-stats
Jun 24 18:48:26 Compile requests                      0

See CircleCI build pytorch_vulkan_linux_bionic_py3_6_clang9_build (7/9)

Step: "Build" (full log | diagnosis details | 🔁 rerun)

Jun 24 18:48:42 rm: cannot remove '/var/lib/jenkins/sccache_error.log': No such file or directory
Jun 24 18:48:42 ++++ extract_trap_cmd
Jun 24 18:48:42 ++++ printf '%s\n' ''
Jun 24 18:48:42 +++ printf '%s\n' cleanup
Jun 24 18:48:42 ++ trap -- '
Jun 24 18:48:42 cleanup' EXIT
Jun 24 18:48:42 ++ [[ pytorch-vulkan-linux-bionic-py3.6-clang9-build != *pytorch-win-* ]]
Jun 24 18:48:42 ++ which sccache
Jun 24 18:48:42 ++ sccache --stop-server
Jun 24 18:48:42 ++ true
Jun 24 18:48:42 ++ rm /var/lib/jenkins/sccache_error.log
Jun 24 18:48:42 rm: cannot remove '/var/lib/jenkins/sccache_error.log': No such file or directory
Jun 24 18:48:42 ++ true
Jun 24 18:48:42 ++ [[ -n '' ]]
Jun 24 18:48:42 ++ [[ pytorch-vulkan-linux-bionic-py3.6-clang9-build == *rocm* ]]
Jun 24 18:48:42 ++ SCCACHE_ERROR_LOG=/var/lib/jenkins/sccache_error.log
Jun 24 18:48:42 ++ SCCACHE_IDLE_TIMEOUT=1200
Jun 24 18:48:42 ++ RUST_LOG=sccache::server=error
Jun 24 18:48:42 ++ sccache --start-server
Jun 24 18:48:42 sccache: Starting the server...
Jun 24 18:48:42 ++ sccache --zero-stats
Jun 24 18:48:42 Compile requests                      0

See CircleCI build pytorch_linux_bionic_cuda10_2_cudnn7_py3_9_gcc7_build (8/9)

Step: "Build" (full log | diagnosis details | 🔁 rerun)

Jun 24 18:52:01 rm: cannot remove '/var/lib/jenkins/sccache_error.log': No such file or directory
Jun 24 18:52:00 ++++ extract_trap_cmd
Jun 24 18:52:00 ++++ printf '%s\n' ''
Jun 24 18:52:00 +++ printf '%s\n' cleanup
Jun 24 18:52:00 ++ trap -- '
Jun 24 18:52:00 cleanup' EXIT
Jun 24 18:52:00 ++ [[ pytorch-linux-bionic-cuda10.2-cudnn7-py3.9-gcc7-build != *pytorch-win-* ]]
Jun 24 18:52:00 ++ which sccache
Jun 24 18:52:00 ++ sccache --stop-server
Jun 24 18:52:01 ++ true
Jun 24 18:52:01 ++ rm /var/lib/jenkins/sccache_error.log
Jun 24 18:52:01 rm: cannot remove '/var/lib/jenkins/sccache_error.log': No such file or directory
Jun 24 18:52:01 ++ true
Jun 24 18:52:01 ++ [[ -n '' ]]
Jun 24 18:52:01 ++ [[ pytorch-linux-bionic-cuda10.2-cudnn7-py3.9-gcc7-build == *rocm* ]]
Jun 24 18:52:01 ++ SCCACHE_ERROR_LOG=/var/lib/jenkins/sccache_error.log
Jun 24 18:52:01 ++ SCCACHE_IDLE_TIMEOUT=1200
Jun 24 18:52:01 ++ RUST_LOG=sccache::server=error
Jun 24 18:52:01 ++ sccache --start-server
Jun 24 18:52:01 sccache: Starting the server...
Jun 24 18:52:01 ++ sccache --zero-stats
Jun 24 18:52:01 Compile requests                      0

See CircleCI build pytorch_linux_xenial_py3_6_gcc5_4_build (9/9)

Step: "Build" (full log | diagnosis details | 🔁 rerun)

Jun 24 18:49:04 rm: cannot remove '/var/lib/jenkins/sccache_error.log': No such file or directory
Jun 24 18:49:04 ++++ extract_trap_cmd
Jun 24 18:49:04 ++++ printf '%s\n' ''
Jun 24 18:49:04 +++ printf '%s\n' cleanup
Jun 24 18:49:04 ++ trap -- '
Jun 24 18:49:04 cleanup' EXIT
Jun 24 18:49:04 ++ [[ pytorch-linux-xenial-py3.6-gcc5.4-build != *pytorch-win-* ]]
Jun 24 18:49:04 ++ which sccache
Jun 24 18:49:04 ++ sccache --stop-server
Jun 24 18:49:04 ++ true
Jun 24 18:49:04 ++ rm /var/lib/jenkins/sccache_error.log
Jun 24 18:49:04 rm: cannot remove '/var/lib/jenkins/sccache_error.log': No such file or directory
Jun 24 18:49:04 ++ true
Jun 24 18:49:04 ++ [[ -n '' ]]
Jun 24 18:49:04 ++ [[ pytorch-linux-xenial-py3.6-gcc5.4-build == *rocm* ]]
Jun 24 18:49:04 ++ SCCACHE_ERROR_LOG=/var/lib/jenkins/sccache_error.log
Jun 24 18:49:04 ++ SCCACHE_IDLE_TIMEOUT=1200
Jun 24 18:49:04 ++ RUST_LOG=sccache::server=error
Jun 24 18:49:04 ++ sccache --start-server
Jun 24 18:49:04 sccache: Starting the server...
Jun 24 18:49:04 ++ sccache --zero-stats
Jun 24 18:49:04 Compile requests                      0

7 failures not recognized by patterns:

Job Step Action
GitHub Actions Lint / quick-checks Ensure no trailing spaces 🔁 rerun
GitHub Actions Windows CI (pytorch-win-vs2019-cpu-py3) / build Checkout PyTorch 🔁 rerun
GitHub Actions Lint / flake8-py3 Fail if there were any warnings 🔁 rerun
GitHub Actions Windows CI (pytorch-win-vs2019-cuda10-cudnn7-py3) / render_test_results Download PyTorch Test Reports 🔁 rerun
CircleCI pytorch_linux_xenial_py3_clang5_asan_test2 Run tests 🔁 rerun
CircleCI pytorch_linux_xenial_py3_clang5_asan_test1 Run tests 🔁 rerun
CircleCI pytorch_macos_10_13_py3_test Test 🔁 rerun

ci.pytorch.org: 1 failed


This comment was automatically generated by Dr. CI (expand for details).Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

dgl-intel pushed a commit to dgl-intel/pytorch that referenced this pull request May 19, 2021
ghstack-source-id: 3e44a18
Pull Request resolved: pytorch#58148

update unbatch

fix unbatch2
NivekT added a commit that referenced this pull request Jun 8, 2021
NivekT added a commit that referenced this pull request Jun 8, 2021
NivekT added a commit that referenced this pull request Jun 8, 2021
NivekT added a commit that referenced this pull request Jun 8, 2021
NivekT added a commit that referenced this pull request Jun 8, 2021
NivekT added a commit that referenced this pull request Jun 8, 2021
NivekT added a commit that referenced this pull request Jun 9, 2021
facebook-github-bot pushed a commit that referenced this pull request Jun 9, 2021
Summary:
Implements the simple unbatch feature for DataPipe #58148

Pull Request resolved: #59610

Reviewed By: VitalyFedyunin

Differential Revision: D28994180

Pulled By: NivekT

fbshipit-source-id: 4bafe6e26c4f95a808c489b147369413a196fa1c
@facebook-github-bot facebook-github-bot deleted the gh/VitalyFedyunin/153/head branch July 31, 2021 14:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants