Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Sparse Representation Capability to Dataloaders #793

Merged
merged 45 commits into from
Jun 1, 2021

Conversation

jperez999
Copy link
Contributor

This solves for #500.

@jperez999
Copy link
Contributor Author

rerun tests

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit 6b5c75d65885b5a26b7f0091ca1458f2981aeae2, no merge conflicts.
Running as SYSTEM
Setting status of 6b5c75d65885b5a26b7f0091ca1458f2981aeae2 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2368/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse 6b5c75d65885b5a26b7f0091ca1458f2981aeae2^{commit} # timeout=10
Checking out Revision 6b5c75d65885b5a26b7f0091ca1458f2981aeae2 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 6b5c75d65885b5a26b7f0091ca1458f2981aeae2 # timeout=10
Commit message: "working sparse representation in tf and torch"
 > git rev-list --no-walk 02435f68a697740deca48003b0112526ee22b757 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins1432626867791721144.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.1 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/torch.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/tensorflow.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/backend.py
Oh no! 💥 💔 💥
3 files would be reformatted, 102 files would be left unchanged.
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" 
[nvtabular_tests] $ /bin/bash /tmp/jenkins7118186889350980731.sh

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit 659821dbc782615e111e94c7ecd7b46297a18d0c, no merge conflicts.
Running as SYSTEM
Setting status of 659821dbc782615e111e94c7ecd7b46297a18d0c to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2391/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse 659821dbc782615e111e94c7ecd7b46297a18d0c^{commit} # timeout=10
Checking out Revision 659821dbc782615e111e94c7ecd7b46297a18d0c (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 659821dbc782615e111e94c7ecd7b46297a18d0c # timeout=10
Commit message: "moving in the right direction"
 > git rev-list --no-walk f2cf52326fbb7042e17c09c85f8ab9bb3e4a4483 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins7543768527155475104.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.1 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/framework_utils/torch/models.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/framework_utils/torch/utils.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/torch.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/tensorflow.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/backend.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/tests/unit/test_torch_dataloader.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/ops/categorify.py
Oh no! 💥 💔 💥
7 files would be reformatted, 98 files would be left unchanged.
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" 
[nvtabular_tests] $ /bin/bash /tmp/jenkins6816975069542923734.sh

@albert17
Copy link
Contributor

build

@albert17
Copy link
Contributor

/blossom-ci

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit fddc7a55ce60f846130f49fcb8c2d74ff62640b7, has merge conflicts.
Running as SYSTEM
Setting status of fddc7a55ce60f846130f49fcb8c2d74ff62640b7 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2430/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse fddc7a55ce60f846130f49fcb8c2d74ff62640b7^{commit} # timeout=10
Checking out Revision fddc7a55ce60f846130f49fcb8c2d74ff62640b7 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f fddc7a55ce60f846130f49fcb8c2d74ff62640b7 # timeout=10
Commit message: "âMerge branch 'main' of https://github.com/NVIDIA/NVTabular into spar-dl"
 > git rev-list --no-walk 69fd3f56fc10cf20d02f868578bcd7c736248604 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins3342729121678280390.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.1 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/framework_utils/torch/models.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/framework_utils/torch/utils.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/torch.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/tensorflow.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/backend.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/tests/unit/test_torch_dataloader.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/ops/categorify.py
Oh no! 💥 💔 💥
7 files would be reformatted, 98 files would be left unchanged.
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" 
[nvtabular_tests] $ /bin/bash /tmp/jenkins3748905590950028473.sh

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit c1ee1eb70c13f0e47d990dc54cc70f94aeb177c4, no merge conflicts.
Running as SYSTEM
Setting status of c1ee1eb70c13f0e47d990dc54cc70f94aeb177c4 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2431/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse c1ee1eb70c13f0e47d990dc54cc70f94aeb177c4^{commit} # timeout=10
Checking out Revision c1ee1eb70c13f0e47d990dc54cc70f94aeb177c4 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f c1ee1eb70c13f0e47d990dc54cc70f94aeb177c4 # timeout=10
Commit message: "clean up categorify"
 > git rev-list --no-walk fddc7a55ce60f846130f49fcb8c2d74ff62640b7 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins5015483052671680397.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.1 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/framework_utils/torch/utils.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/framework_utils/torch/models.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/torch.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/tensorflow.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/backend.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/tests/unit/test_torch_dataloader.py
Oh no! 💥 💔 💥
6 files would be reformatted, 100 files would be left unchanged.
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" 
[nvtabular_tests] $ /bin/bash /tmp/jenkins3952170755877946287.sh

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit 44fec2321055d7df02e13a216206fc7b76667ac4, no merge conflicts.
Running as SYSTEM
Setting status of 44fec2321055d7df02e13a216206fc7b76667ac4 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2432/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse 44fec2321055d7df02e13a216206fc7b76667ac4^{commit} # timeout=10
Checking out Revision 44fec2321055d7df02e13a216206fc7b76667ac4 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 44fec2321055d7df02e13a216206fc7b76667ac4 # timeout=10
Commit message: "more tests passing"
 > git rev-list --no-walk c1ee1eb70c13f0e47d990dc54cc70f94aeb177c4 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins2233882198408728476.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.1 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/framework_utils/torch/models.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/framework_utils/torch/utils.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/torch.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/tensorflow.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/backend.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/tests/unit/test_torch_dataloader.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/ops/categorify.py
Oh no! 💥 💔 💥
7 files would be reformatted, 99 files would be left unchanged.
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" 
[nvtabular_tests] $ /bin/bash /tmp/jenkins17083196856660821.sh

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit 912a5a542bac16b42bfe1c4d9728bdf4c3ccdcaf, no merge conflicts.
Running as SYSTEM
Setting status of 912a5a542bac16b42bfe1c4d9728bdf4c3ccdcaf to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2433/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse 912a5a542bac16b42bfe1c4d9728bdf4c3ccdcaf^{commit} # timeout=10
Checking out Revision 912a5a542bac16b42bfe1c4d9728bdf4c3ccdcaf (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 912a5a542bac16b42bfe1c4d9728bdf4c3ccdcaf # timeout=10
Commit message: "working a little better"
 > git rev-list --no-walk 44fec2321055d7df02e13a216206fc7b76667ac4 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins6148435236485722208.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.1 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
106 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
  warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
  warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module nvtabular.loader.tensorflow
nvtabular/loader/tensorflow.py:332:0: R1721: Unnecessary use of a comprehension (unnecessary-comprehension)
nvtabular/loader/tensorflow.py:387:27: C0201: Consider iterating the dictionary directly instead of calling .keys() (consider-iterating-dictionary)
************* Module nvtabular.loader.torch
nvtabular/loader/torch.py:144:27: C0201: Consider iterating the dictionary directly instead of calling .keys() (consider-iterating-dictionary)
nvtabular/loader/torch.py:165:0: R1721: Unnecessary use of a comprehension (unnecessary-comprehension)

Your code has been rated at 10.00/10 (previous run: 10.00/10, -0.00)

Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins5306266991913317294.sh

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit 50399aeb61b4a798026b574d95131e2087373393, has merge conflicts.
Running as SYSTEM
Setting status of 50399aeb61b4a798026b574d95131e2087373393 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2446/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse 50399aeb61b4a798026b574d95131e2087373393^{commit} # timeout=10
Checking out Revision 50399aeb61b4a798026b574d95131e2087373393 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 50399aeb61b4a798026b574d95131e2087373393 # timeout=10
Commit message: "only one test failing now"
 > git rev-list --no-walk 39382c07b87675bd36a7652a743922e45943e84e # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins7290212659290436413.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.1 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/multi-gpu-movielens/torch_trainer.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/framework_utils/torch/utils.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/tests/unit/test_torch_dataloader.py
Oh no! 💥 💔 💥
3 files would be reformatted, 103 files would be left unchanged.
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" 
[nvtabular_tests] $ /bin/bash /tmp/jenkins1027238766218922044.sh

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit 06a27d5fd510ce657433e15f42385f67995e6ba1, has merge conflicts.
Running as SYSTEM
Setting status of 06a27d5fd510ce657433e15f42385f67995e6ba1 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2447/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse 06a27d5fd510ce657433e15f42385f67995e6ba1^{commit} # timeout=10
Checking out Revision 06a27d5fd510ce657433e15f42385f67995e6ba1 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 06a27d5fd510ce657433e15f42385f67995e6ba1 # timeout=10
Commit message: "fixed formatting"
 > git rev-list --no-walk 50399aeb61b4a798026b574d95131e2087373393 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins1722031655059226503.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.1 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
106 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
  warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
  warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module nvtabular.loader.tensorflow
nvtabular/loader/tensorflow.py:332:0: R1721: Unnecessary use of a comprehension (unnecessary-comprehension)
nvtabular/loader/tensorflow.py:387:27: C0201: Consider iterating the dictionary directly instead of calling .keys() (consider-iterating-dictionary)
************* Module nvtabular.loader.torch
nvtabular/loader/torch.py:144:27: C0201: Consider iterating the dictionary directly instead of calling .keys() (consider-iterating-dictionary)
nvtabular/loader/torch.py:165:0: R1721: Unnecessary use of a comprehension (unnecessary-comprehension)

Your code has been rated at 10.00/10 (previous run: 10.00/10, -0.00)

Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins7527082574830608598.sh

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit 9fb369e6853a892b64c44e9c938b0bcf56e7686a, has merge conflicts.
Running as SYSTEM
Setting status of 9fb369e6853a892b64c44e9c938b0bcf56e7686a to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2451/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse 9fb369e6853a892b64c44e9c938b0bcf56e7686a^{commit} # timeout=10
Checking out Revision 9fb369e6853a892b64c44e9c938b0bcf56e7686a (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 9fb369e6853a892b64c44e9c938b0bcf56e7686a # timeout=10
Commit message: "all tests green on dict change"
 > git rev-list --no-walk 5e3115776d5ecabe4aeff8709d3ad5a5b3cf811b # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins2052645554062529147.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.1 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
106 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
  warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
  warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module nvtabular.loader.tensorflow
nvtabular/loader/tensorflow.py:332:0: R1721: Unnecessary use of a comprehension (unnecessary-comprehension)
nvtabular/loader/tensorflow.py:387:27: C0201: Consider iterating the dictionary directly instead of calling .keys() (consider-iterating-dictionary)
************* Module nvtabular.loader.torch
nvtabular/loader/torch.py:144:27: C0201: Consider iterating the dictionary directly instead of calling .keys() (consider-iterating-dictionary)
nvtabular/loader/torch.py:165:0: R1721: Unnecessary use of a comprehension (unnecessary-comprehension)

Your code has been rated at 10.00/10 (previous run: 10.00/10, -0.00)

Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins7276678540262934033.sh

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit e13981e45553e8aad2c3989a5b0f2f8603820630, has merge conflicts.
Running as SYSTEM
Setting status of e13981e45553e8aad2c3989a5b0f2f8603820630 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2453/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse e13981e45553e8aad2c3989a5b0f2f8603820630^{commit} # timeout=10
Checking out Revision e13981e45553e8aad2c3989a5b0f2f8603820630 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f e13981e45553e8aad2c3989a5b0f2f8603820630 # timeout=10
Commit message: "pytorch working sparse with test"
 > git rev-list --no-walk f8db7af3cf78bffb1f364c22f3a189b268d3fe3c # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins6652828718567464703.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.1 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
106 files would be left unchanged.
Running flake8
./nvtabular/loader/tensorflow.py:348:17: F541 f-string is missing placeholders
./nvtabular/loader/tensorflow.py:391:20: E713 test for membership should be 'not in'
./nvtabular/loader/torch.py:149:20: E713 test for membership should be 'not in'
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" 
[nvtabular_tests] $ /bin/bash /tmp/jenkins1044725656805103632.sh

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit 89ebc4ce882244d1452718a879b36e415ed27581, has merge conflicts.
Running as SYSTEM
Setting status of 89ebc4ce882244d1452718a879b36e415ed27581 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2455/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse 89ebc4ce882244d1452718a879b36e415ed27581^{commit} # timeout=10
Checking out Revision 89ebc4ce882244d1452718a879b36e415ed27581 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 89ebc4ce882244d1452718a879b36e415ed27581 # timeout=10
Commit message: "working tests"
 > git rev-list --no-walk 5d312517ad3cc9cf5fa8464b79a949f38b51dd14 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins3551471985562897453.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Attempting uninstall: nvtabular
    Found existing installation: nvtabular 0.5.2+11.g2a51af0
    Can't uninstall 'nvtabular'. No files were found to uninstall.
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.1 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/torch.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/tensorflow.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/tests/unit/test_tf_dataloader.py
Oh no! 💥 💔 💥
3 files would be reformatted, 103 files would be left unchanged.
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" 
[nvtabular_tests] $ /bin/bash /tmp/jenkins2296017292720553945.sh

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit c7eb4658b650e9e52934ac2b04b782beed33e024, no merge conflicts.
Running as SYSTEM
Setting status of c7eb4658b650e9e52934ac2b04b782beed33e024 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2516/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse c7eb4658b650e9e52934ac2b04b782beed33e024^{commit} # timeout=10
Checking out Revision c7eb4658b650e9e52934ac2b04b782beed33e024 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f c7eb4658b650e9e52934ac2b04b782beed33e024 # timeout=10
Commit message: "torch dense testing in"
 > git rev-list --no-walk 5e58d35dd32d6f24e378d27c1fa4d0371243c261 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins5960428204266460400.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.2 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
106 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
  warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
  warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module tests.unit.test_torch_dataloader
tests/unit/test_torch_dataloader.py:40:0: W0611: Unused DictTransform imported from nvtabular.framework_utils.torch.utils (unused-import)

Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)

Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins8134453290952865128.sh

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit 8d806965cd2c5a581d3d0ff5e7c7bbd584ca1d33, no merge conflicts.
Running as SYSTEM
Setting status of 8d806965cd2c5a581d3d0ff5e7c7bbd584ca1d33 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2517/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse 8d806965cd2c5a581d3d0ff5e7c7bbd584ca1d33^{commit} # timeout=10
Checking out Revision 8d806965cd2c5a581d3d0ff5e7c7bbd584ca1d33 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 8d806965cd2c5a581d3d0ff5e7c7bbd584ca1d33 # timeout=10
Commit message: "added tf test for sparse to dense logic"
 > git rev-list --no-walk c7eb4658b650e9e52934ac2b04b782beed33e024 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins7674515692428069966.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.2 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
106 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
  warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
  warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module tests.unit.test_torch_dataloader
tests/unit/test_torch_dataloader.py:40:0: W0611: Unused DictTransform imported from nvtabular.framework_utils.torch.utils (unused-import)

Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)

Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins6724442934354545722.sh

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit 2643e2ee858f07e9ca9eb4dbd6fa7896f8dbd1c7, no merge conflicts.
Running as SYSTEM
Setting status of 2643e2ee858f07e9ca9eb4dbd6fa7896f8dbd1c7 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2518/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse 2643e2ee858f07e9ca9eb4dbd6fa7896f8dbd1c7^{commit} # timeout=10
Checking out Revision 2643e2ee858f07e9ca9eb4dbd6fa7896f8dbd1c7 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 2643e2ee858f07e9ca9eb4dbd6fa7896f8dbd1c7 # timeout=10
Commit message: "flake8 unused dicttransform import"
 > git rev-list --no-walk 8d806965cd2c5a581d3d0ff5e7c7bbd584ca1d33 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins5563362800416668014.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.2 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
106 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
  warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
  warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint

Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)

Running flake8-nb
Building docs
make: Entering directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs'
2021-05-27 21:00:33.069574: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2021-05-27 21:00:34.413529: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2021-05-27 21:00:34.413588: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2021-05-27 21:00:34.414662: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties:
pciBusID: 0000:07:00.0 name: Tesla P100-DGXS-16GB computeCapability: 6.0
coreClock: 1.4805GHz coreCount: 56 deviceMemorySize: 15.90GiB deviceMemoryBandwidth: 681.88GiB/s
2021-05-27 21:00:34.415677: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 1 with properties:
pciBusID: 0000:08:00.0 name: Tesla P100-DGXS-16GB computeCapability: 6.0
coreClock: 1.4805GHz coreCount: 56 deviceMemorySize: 15.90GiB deviceMemoryBandwidth: 681.88GiB/s
2021-05-27 21:00:34.415706: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2021-05-27 21:00:34.415762: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2021-05-27 21:00:34.415800: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2021-05-27 21:00:34.415837: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2021-05-27 21:00:34.415876: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2021-05-27 21:00:34.415986: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2021-05-27 21:00:34.416023: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2021-05-27 21:00:34.416043: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2021-05-27 21:00:34.419967: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0, 1
/usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document
warn("Container node skipped: type={0}".format(mdnode.t))
:219: RuntimeWarning: numpy.ndarray size changed, may indicate binary incompatibility. Expected 88, got 80
:219: RuntimeWarning: numpy.ndarray size changed, may indicate binary incompatibility. Expected 80 from C header, got 88 from PyObject
/usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document
warn("Container node skipped: type={0}".format(mdnode.t))
/usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document
warn("Container node skipped: type={0}".format(mdnode.t))
make: Leaving directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs'
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-6.2.4, py-1.10.0, pluggy-0.13.1
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: pyproject.toml
plugins: xdist-2.2.1, forked-1.3.0, cov-2.12.0
collected 806 items

tests/unit/test_column_group.py .. [ 0%]
tests/unit/test_column_similarity.py ...... [ 0%]
tests/unit/test_dask_nvt.py ............................................ [ 6%]
..................................................................... [ 15%]
tests/unit/test_dataloader_backend.py . [ 15%]
tests/unit/test_io.py .................................................. [ 21%]
..................................................................ssssss [ 30%]
ss.................................................. [ 36%]
tests/unit/test_notebooks.py ...... [ 37%]
tests/unit/test_ops.py ................................................. [ 43%]
........................................................................ [ 52%]
........................................................................ [ 61%]
............................................. [ 66%]
tests/unit/test_s3.py . [ 67%]
tests/unit/test_tf_dataloader.py ..................................s [ 71%]
tests/unit/test_tf_layers.py ........................................... [ 76%]
................................... [ 81%]
tests/unit/test_tools.py ...................... [ 83%]
tests/unit/test_torch_dataloader.py .................................... [ 88%]
[ 88%]
tests/unit/test_triton_inference.py ... [ 88%]
tests/unit/test_workflow.py ............................................ [ 94%]
............................................... [100%]

=============================== warnings summary ===============================
tests/unit/test_ops.py::test_groupby_op[id-False]
tests/unit/test_ops.py::test_groupby_op[id-True]
/usr/local/lib/python3.8/dist-packages/dask/dataframe/core.py:6560: UserWarning: Insufficient elements for head. 1 elements requested, only 0 elements available. Try passing larger npartitions to head.
warnings.warn(msg.format(n, len(r)))

-- Docs: https://docs.pytest.org/en/stable/warnings.html

----------- coverage: platform linux, python 3.8.5-final-0 -----------
Name Stmts Miss Branch BrPart Cover Missing

examples/multi-gpu-movielens/torch_trainer.py 65 0 6 1 99% 32->36
nvtabular/init.py 12 0 0 0 100%
nvtabular/column_group.py 157 18 82 5 87% 54, 87, 128, 152-165, 214, 301
nvtabular/dispatch.py 81 11 38 5 83% 35, 45->47, 69, 94, 110, 117, 134-137, 166-169
nvtabular/framework_utils/init.py 0 0 0 0 100%
nvtabular/framework_utils/tensorflow/init.py 1 0 0 0 100%
nvtabular/framework_utils/tensorflow/feature_column_utils.py 146 137 96 0 4% 28-32, 69-303
nvtabular/framework_utils/tensorflow/layers/init.py 4 0 0 0 100%
nvtabular/framework_utils/tensorflow/layers/embedding.py 151 12 81 6 91% 60, 68->49, 122, 179, 231-239, 333->341, 355->358, 361-362, 365
nvtabular/framework_utils/tensorflow/layers/interaction.py 47 25 20 1 43% 49, 74-103, 106-110, 113
nvtabular/framework_utils/tensorflow/layers/outer_product.py 30 24 10 0 15% 37-38, 41-60, 71-84, 87
nvtabular/framework_utils/torch/init.py 0 0 0 0 100%
nvtabular/framework_utils/torch/layers/init.py 2 0 0 0 100%
nvtabular/framework_utils/torch/layers/embeddings.py 27 1 10 1 95% 47
nvtabular/framework_utils/torch/models.py 41 0 22 1 98% 84->87
nvtabular/framework_utils/torch/utils.py 75 5 30 5 90% 51->53, 64, 71->73, 116, 118-120
nvtabular/inference/init.py 0 0 0 0 100%
nvtabular/inference/triton/init.py 279 144 120 18 48% 95-144, 187-247, 278-279, 284-287, 310-322, 330-335, 353, 372-388, 392-396, 471-493, 497-564, 573->576, 576->572, 605-615, 619-620, 624, 634, 640, 642, 644, 646, 648, 650, 652, 655, 660->663, 663->665
nvtabular/inference/triton/model.py 50 50 18 0 0% 27-133
nvtabular/inference/triton/model_config_pb2.py 299 0 2 0 100%
nvtabular/inference/triton/model_hugectr.py 49 49 14 0 0% 27-125
nvtabular/inference/triton/model_pytorch.py 30 30 8 0 0% 27-89
nvtabular/io/init.py 4 0 0 0 100%
nvtabular/io/avro.py 88 88 30 0 0% 16-189
nvtabular/io/csv.py 54 4 20 5 88% 95, 99->103, 104, 106, 120
nvtabular/io/dask.py 179 7 68 11 93% 110, 113, 149, 224, 384->382, 412->415, 423, 427->429, 429->425, 434, 436
nvtabular/io/dataframe_engine.py 58 3 28 6 90% 47, 66, 85->89, 89->94, 91->94, 94->113, 122
nvtabular/io/dataset.py 263 31 124 21 86% 254, 256, 269, 278, 296-310, 413->482, 418-421, 426->436, 431-432, 443->441, 457->461, 472, 518, 639->641, 641->650, 651, 658-659, 665, 671, 766-767, 879-884, 890, 924
nvtabular/io/dataset_engine.py 23 1 0 0 96% 45
nvtabular/io/hugectr.py 45 2 24 2 91% 34, 74->97, 101
nvtabular/io/parquet.py 486 19 154 12 95% 85-93, 117->119, 206-208, 331-336, 374-379, 495->502, 563->568, 569-570, 690, 694, 698, 736, 753, 757, 764->766, 884->889, 894->904, 931
nvtabular/io/shuffle.py 30 4 12 3 83% 41, 43-44, 48
nvtabular/io/writer.py 168 11 64 5 92% 46, 74, 120, 123, 200, 209, 212, 255, 276-278
nvtabular/io/writer_factory.py 18 2 8 2 85% 35, 60
nvtabular/loader/init.py 0 0 0 0 100%
nvtabular/loader/backend.py 325 13 136 10 95% 131, 138-139, 229->231, 241-245, 291-292, 331->335, 406, 410-411, 441, 547, 555
nvtabular/loader/tensorflow.py 132 21 38 7 82% 57, 65-68, 78, 88, 303, 318-320, 330->334, 349-351, 361-369, 372-375
nvtabular/loader/tf_utils.py 55 10 20 5 80% 29->32, 32->34, 39->41, 43, 50-51, 58-60, 66-70
nvtabular/loader/torch.py 75 13 12 2 76% 26-28, 31-37, 138-139, 162
nvtabular/ops/init.py 21 0 0 0 100%
nvtabular/ops/bucketize.py 24 4 16 2 75% 45, 48-51
nvtabular/ops/categorify.py 514 66 298 44 85% 237, 254, 258, 266, 274, 276, 298, 317-318, 352-353, 415-417, 433, 482->484, 557, 595, 624->627, 628-630, 637-638, 651-653, 654->622, 670, 680, 682, 688, 704-705, 710, 713->716, 726, 750, 755, 771-774, 800, 804, 806, 818-821, 936, 938, 980->1001, 986->1001, 1002-1007, 1044, 1060->1065, 1064, 1074->1071, 1079->1071, 1087, 1095-1105
nvtabular/ops/clip.py 19 2 6 3 80% 45, 53->55, 56
nvtabular/ops/column_similarity.py 88 22 32 5 69% 84, 156-157, 166-168, 176-192, 207->217, 209->212, 213, 223
nvtabular/ops/data_stats.py 57 2 22 3 94% 91->93, 95, 97->87, 102
nvtabular/ops/difference_lag.py 26 0 8 1 97% 67->69
nvtabular/ops/dropna.py 8 0 0 0 100%
nvtabular/ops/fill.py 58 2 20 1 96% 93, 119
nvtabular/ops/filter.py 21 1 6 1 93% 44
nvtabular/ops/groupby.py 93 4 56 6 92% 72, 81, 83, 93->95, 105->110, 181
nvtabular/ops/hash_bucket.py 32 2 18 2 88% 73, 102
nvtabular/ops/hashed_cross.py 29 3 13 4 83% 51, 64, 78->exit, 79
nvtabular/ops/join_external.py 69 4 28 4 92% 96, 98, 116, 168
nvtabular/ops/join_groupby.py 82 5 28 2 94% 106, 109->116, 185-186, 189-190
nvtabular/ops/lambdaop.py 27 3 10 3 84% 61, 65, 78
nvtabular/ops/list_slice.py 64 22 26 1 59% 52-53, 105-119, 127-138
nvtabular/ops/logop.py 9 0 0 0 100%
nvtabular/ops/moments.py 65 0 20 0 100%
nvtabular/ops/normalize.py 65 6 14 2 87% 61->60, 67-68, 101-102, 124-125
nvtabular/ops/operator.py 15 1 2 1 88% 24
nvtabular/ops/rename.py 23 3 14 3 84% 46, 67-69
nvtabular/ops/stat_operator.py 8 0 0 0 100%
nvtabular/ops/target_encoding.py 148 11 64 5 91% 143, 163->167, 170->179, 222-223, 226-227, 236-242, 333->336
nvtabular/tools/init.py 0 0 0 0 100%
nvtabular/tools/data_gen.py 236 1 62 1 99% 323
nvtabular/tools/dataset_inspector.py 49 7 18 1 79% 31-38
nvtabular/tools/inspector_script.py 46 46 0 0 0% 17-168
nvtabular/utils.py 94 45 44 8 46% 30-31, 35-36, 49, 58-61, 63-65, 68, 71, 77, 83, 89-125, 144, 148->152
nvtabular/worker.py 68 1 30 2 97% 74->87, 94
nvtabular/workflow.py 143 9 65 4 93% 40, 126, 140-142, 245, 273-274, 351

TOTAL 5750 1007 2215 243 80%
Coverage XML written to file coverage.xml

Required test coverage of 70% reached. Total coverage: 79.94%
============ 797 passed, 9 skipped, 2 warnings in 627.58s (0:10:27) ============
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins8182308891482867884.sh

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit 45409f5e0241f29f302b6ef8d3e7eef4b41ae3e7, no merge conflicts.
Running as SYSTEM
Setting status of 45409f5e0241f29f302b6ef8d3e7eef4b41ae3e7 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2519/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse 45409f5e0241f29f302b6ef8d3e7eef4b41ae3e7^{commit} # timeout=10
Checking out Revision 45409f5e0241f29f302b6ef8d3e7eef4b41ae3e7 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 45409f5e0241f29f302b6ef8d3e7eef4b41ae3e7 # timeout=10
Commit message: "adding safety check for linear build function"
 > git rev-list --no-walk 2643e2ee858f07e9ca9eb4dbd6fa7896f8dbd1c7 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins3978225860197278013.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.2 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
106 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
  warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
  warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint

Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)

Running flake8-nb
Building docs
make: Entering directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs'
2021-05-27 21:30:41.820665: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2021-05-27 21:30:43.166718: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2021-05-27 21:30:43.166783: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2021-05-27 21:30:43.167998: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties:
pciBusID: 0000:07:00.0 name: Tesla P100-DGXS-16GB computeCapability: 6.0
coreClock: 1.4805GHz coreCount: 56 deviceMemorySize: 15.90GiB deviceMemoryBandwidth: 681.88GiB/s
2021-05-27 21:30:43.169126: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 1 with properties:
pciBusID: 0000:08:00.0 name: Tesla P100-DGXS-16GB computeCapability: 6.0
coreClock: 1.4805GHz coreCount: 56 deviceMemorySize: 15.90GiB deviceMemoryBandwidth: 681.88GiB/s
2021-05-27 21:30:43.169155: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2021-05-27 21:30:43.169212: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2021-05-27 21:30:43.169251: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2021-05-27 21:30:43.169290: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2021-05-27 21:30:43.169328: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2021-05-27 21:30:43.169438: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2021-05-27 21:30:43.169477: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2021-05-27 21:30:43.169495: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2021-05-27 21:30:43.173892: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0, 1
/usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document
warn("Container node skipped: type={0}".format(mdnode.t))
:219: RuntimeWarning: numpy.ndarray size changed, may indicate binary incompatibility. Expected 88, got 80
:219: RuntimeWarning: numpy.ndarray size changed, may indicate binary incompatibility. Expected 80 from C header, got 88 from PyObject
/usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document
warn("Container node skipped: type={0}".format(mdnode.t))
/usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document
warn("Container node skipped: type={0}".format(mdnode.t))
make: Leaving directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs'
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-6.2.4, py-1.10.0, pluggy-0.13.1
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: pyproject.toml
plugins: xdist-2.2.1, forked-1.3.0, cov-2.12.0
collected 806 items

tests/unit/test_column_group.py .. [ 0%]
tests/unit/test_column_similarity.py ...... [ 0%]
tests/unit/test_dask_nvt.py ............................................ [ 6%]
..................................................................... [ 15%]
tests/unit/test_dataloader_backend.py . [ 15%]
tests/unit/test_io.py .................................................. [ 21%]
..................................................................ssssss [ 30%]
ss.................................................. [ 36%]
tests/unit/test_notebooks.py ...... [ 37%]
tests/unit/test_ops.py ................................................. [ 43%]
........................................................................ [ 52%]
........................................................................ [ 61%]
............................................. [ 66%]
tests/unit/test_s3.py . [ 67%]
tests/unit/test_tf_dataloader.py ..................................s [ 71%]
tests/unit/test_tf_layers.py ........................................... [ 76%]
................................... [ 81%]
tests/unit/test_tools.py ...................... [ 83%]
tests/unit/test_torch_dataloader.py .................................... [ 88%]
[ 88%]
tests/unit/test_triton_inference.py ... [ 88%]
tests/unit/test_workflow.py ............................................ [ 94%]
............................................... [100%]

=============================== warnings summary ===============================
tests/unit/test_ops.py::test_groupby_op[id-False]
tests/unit/test_ops.py::test_groupby_op[id-True]
/usr/local/lib/python3.8/dist-packages/dask/dataframe/core.py:6560: UserWarning: Insufficient elements for head. 1 elements requested, only 0 elements available. Try passing larger npartitions to head.
warnings.warn(msg.format(n, len(r)))

-- Docs: https://docs.pytest.org/en/stable/warnings.html

----------- coverage: platform linux, python 3.8.5-final-0 -----------
Name Stmts Miss Branch BrPart Cover Missing

examples/multi-gpu-movielens/torch_trainer.py 65 0 6 1 99% 32->36
nvtabular/init.py 12 0 0 0 100%
nvtabular/column_group.py 157 18 82 5 87% 54, 87, 128, 152-165, 214, 301
nvtabular/dispatch.py 81 11 38 5 83% 35, 45->47, 69, 94, 110, 117, 134-137, 166-169
nvtabular/framework_utils/init.py 0 0 0 0 100%
nvtabular/framework_utils/tensorflow/init.py 1 0 0 0 100%
nvtabular/framework_utils/tensorflow/feature_column_utils.py 146 137 96 0 4% 28-32, 69-303
nvtabular/framework_utils/tensorflow/layers/init.py 4 0 0 0 100%
nvtabular/framework_utils/tensorflow/layers/embedding.py 153 12 85 6 91% 60, 68->49, 122, 179, 231-239, 335->343, 357->360, 363-364, 367
nvtabular/framework_utils/tensorflow/layers/interaction.py 47 25 20 1 43% 49, 74-103, 106-110, 113
nvtabular/framework_utils/tensorflow/layers/outer_product.py 30 24 10 0 15% 37-38, 41-60, 71-84, 87
nvtabular/framework_utils/torch/init.py 0 0 0 0 100%
nvtabular/framework_utils/torch/layers/init.py 2 0 0 0 100%
nvtabular/framework_utils/torch/layers/embeddings.py 27 1 10 1 95% 47
nvtabular/framework_utils/torch/models.py 41 0 22 1 98% 84->87
nvtabular/framework_utils/torch/utils.py 75 5 30 5 90% 51->53, 64, 71->73, 116, 118-120
nvtabular/inference/init.py 0 0 0 0 100%
nvtabular/inference/triton/init.py 279 144 120 18 48% 95-144, 187-247, 278-279, 284-287, 310-322, 330-335, 353, 372-388, 392-396, 471-493, 497-564, 573->576, 576->572, 605-615, 619-620, 624, 634, 640, 642, 644, 646, 648, 650, 652, 655, 660->663, 663->665
nvtabular/inference/triton/model.py 50 50 18 0 0% 27-133
nvtabular/inference/triton/model_config_pb2.py 299 0 2 0 100%
nvtabular/inference/triton/model_hugectr.py 49 49 14 0 0% 27-125
nvtabular/inference/triton/model_pytorch.py 30 30 8 0 0% 27-89
nvtabular/io/init.py 4 0 0 0 100%
nvtabular/io/avro.py 88 88 30 0 0% 16-189
nvtabular/io/csv.py 54 4 20 5 88% 95, 99->103, 104, 106, 120
nvtabular/io/dask.py 179 7 68 11 93% 110, 113, 149, 224, 384->382, 412->415, 423, 427->429, 429->425, 434, 436
nvtabular/io/dataframe_engine.py 58 3 28 6 90% 47, 66, 85->89, 89->94, 91->94, 94->113, 122
nvtabular/io/dataset.py 263 31 124 21 86% 254, 256, 269, 278, 296-310, 413->482, 418-421, 426->436, 431-432, 443->441, 457->461, 472, 518, 639->641, 641->650, 651, 658-659, 665, 671, 766-767, 879-884, 890, 924
nvtabular/io/dataset_engine.py 23 1 0 0 96% 45
nvtabular/io/hugectr.py 45 2 24 2 91% 34, 74->97, 101
nvtabular/io/parquet.py 486 19 154 12 95% 85-93, 117->119, 206-208, 331-336, 374-379, 495->502, 563->568, 569-570, 690, 694, 698, 736, 753, 757, 764->766, 884->889, 894->904, 931
nvtabular/io/shuffle.py 30 4 12 3 83% 41, 43-44, 48
nvtabular/io/writer.py 168 11 64 5 92% 46, 74, 120, 123, 200, 209, 212, 255, 276-278
nvtabular/io/writer_factory.py 18 2 8 2 85% 35, 60
nvtabular/loader/init.py 0 0 0 0 100%
nvtabular/loader/backend.py 325 13 136 10 95% 131, 138-139, 229->231, 241-245, 291-292, 331->335, 406, 410-411, 441, 547, 555
nvtabular/loader/tensorflow.py 132 21 38 7 82% 57, 65-68, 78, 88, 303, 318-320, 330->334, 349-351, 361-369, 372-375
nvtabular/loader/tf_utils.py 55 10 20 5 80% 29->32, 32->34, 39->41, 43, 50-51, 58-60, 66-70
nvtabular/loader/torch.py 75 13 12 2 76% 26-28, 31-37, 138-139, 162
nvtabular/ops/init.py 21 0 0 0 100%
nvtabular/ops/bucketize.py 24 4 16 2 75% 45, 48-51
nvtabular/ops/categorify.py 514 66 298 44 85% 237, 254, 258, 266, 274, 276, 298, 317-318, 352-353, 415-417, 433, 482->484, 557, 595, 624->627, 628-630, 637-638, 651-653, 654->622, 670, 680, 682, 688, 704-705, 710, 713->716, 726, 750, 755, 771-774, 800, 804, 806, 818-821, 936, 938, 980->1001, 986->1001, 1002-1007, 1044, 1060->1065, 1064, 1074->1071, 1079->1071, 1087, 1095-1105
nvtabular/ops/clip.py 19 2 6 3 80% 45, 53->55, 56
nvtabular/ops/column_similarity.py 88 22 32 5 69% 84, 156-157, 166-168, 176-192, 207->217, 209->212, 213, 223
nvtabular/ops/data_stats.py 57 2 22 3 94% 91->93, 95, 97->87, 102
nvtabular/ops/difference_lag.py 26 0 8 1 97% 67->69
nvtabular/ops/dropna.py 8 0 0 0 100%
nvtabular/ops/fill.py 58 2 20 1 96% 93, 119
nvtabular/ops/filter.py 21 1 6 1 93% 44
nvtabular/ops/groupby.py 93 4 56 6 92% 72, 81, 83, 93->95, 105->110, 181
nvtabular/ops/hash_bucket.py 32 2 18 2 88% 73, 102
nvtabular/ops/hashed_cross.py 29 3 13 4 83% 51, 64, 78->exit, 79
nvtabular/ops/join_external.py 69 4 28 4 92% 96, 98, 116, 168
nvtabular/ops/join_groupby.py 82 5 28 2 94% 106, 109->116, 185-186, 189-190
nvtabular/ops/lambdaop.py 27 3 10 3 84% 61, 65, 78
nvtabular/ops/list_slice.py 64 22 26 1 59% 52-53, 105-119, 127-138
nvtabular/ops/logop.py 9 0 0 0 100%
nvtabular/ops/moments.py 65 0 20 0 100%
nvtabular/ops/normalize.py 65 6 14 2 87% 61->60, 67-68, 101-102, 124-125
nvtabular/ops/operator.py 15 1 2 1 88% 24
nvtabular/ops/rename.py 23 3 14 3 84% 46, 67-69
nvtabular/ops/stat_operator.py 8 0 0 0 100%
nvtabular/ops/target_encoding.py 148 11 64 5 91% 143, 163->167, 170->179, 222-223, 226-227, 236-242, 333->336
nvtabular/tools/init.py 0 0 0 0 100%
nvtabular/tools/data_gen.py 236 1 62 1 99% 323
nvtabular/tools/dataset_inspector.py 49 7 18 1 79% 31-38
nvtabular/tools/inspector_script.py 46 46 0 0 0% 17-168
nvtabular/utils.py 94 45 44 8 46% 30-31, 35-36, 49, 58-61, 63-65, 68, 71, 77, 83, 89-125, 144, 148->152
nvtabular/worker.py 68 1 30 2 97% 74->87, 94
nvtabular/workflow.py 143 9 65 4 93% 40, 126, 140-142, 245, 273-274, 351

TOTAL 5752 1007 2219 243 80%
Coverage XML written to file coverage.xml

Required test coverage of 70% reached. Total coverage: 79.95%
============ 797 passed, 9 skipped, 2 warnings in 626.21s (0:10:26) ============
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins273140563976302001.sh

nvtabular/loader/torch.py Outdated Show resolved Hide resolved
nvtabular/loader/tensorflow.py Outdated Show resolved Hide resolved
nvtabular/loader/torch.py Outdated Show resolved Hide resolved
nvtabular/loader/backend.py Show resolved Hide resolved
nvtabular/loader/tensorflow.py Show resolved Hide resolved
@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit 98ccb22d7ce2e1b57c53d506be120c550e861439, no merge conflicts.
Running as SYSTEM
Setting status of 98ccb22d7ce2e1b57c53d506be120c550e861439 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2520/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse 98ccb22d7ce2e1b57c53d506be120c550e861439^{commit} # timeout=10
Checking out Revision 98ccb22d7ce2e1b57c53d506be120c550e861439 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 98ccb22d7ce2e1b57c53d506be120c550e861439 # timeout=10
Commit message: "naming fix"
 > git rev-list --no-walk 45409f5e0241f29f302b6ef8d3e7eef4b41ae3e7 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins2324737037462220339.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.2 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/loader/torch.py
Oh no! 💥 💔 💥
1 file would be reformatted, 105 files would be left unchanged.
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" 
[nvtabular_tests] $ /bin/bash /tmp/jenkins5608412253452254566.sh

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit 76d37186636de8e27dcaa0b68262eabdf7ec2b90, no merge conflicts.
Running as SYSTEM
Setting status of 76d37186636de8e27dcaa0b68262eabdf7ec2b90 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2521/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse 76d37186636de8e27dcaa0b68262eabdf7ec2b90^{commit} # timeout=10
Checking out Revision 76d37186636de8e27dcaa0b68262eabdf7ec2b90 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 76d37186636de8e27dcaa0b68262eabdf7ec2b90 # timeout=10
Commit message: "black reformat"
 > git rev-list --no-walk 98ccb22d7ce2e1b57c53d506be120c550e861439 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins7196285595441732930.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.2 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
106 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
  warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
  warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint

Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)

Running flake8-nb
Building docs
make: Entering directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs'
2021-05-28 00:07:31.388610: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2021-05-28 00:07:32.763183: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2021-05-28 00:07:32.763250: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2021-05-28 00:07:32.764337: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties:
pciBusID: 0000:07:00.0 name: Tesla P100-DGXS-16GB computeCapability: 6.0
coreClock: 1.4805GHz coreCount: 56 deviceMemorySize: 15.90GiB deviceMemoryBandwidth: 681.88GiB/s
2021-05-28 00:07:32.765353: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 1 with properties:
pciBusID: 0000:08:00.0 name: Tesla P100-DGXS-16GB computeCapability: 6.0
coreClock: 1.4805GHz coreCount: 56 deviceMemorySize: 15.90GiB deviceMemoryBandwidth: 681.88GiB/s
2021-05-28 00:07:32.765379: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2021-05-28 00:07:32.765430: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2021-05-28 00:07:32.765464: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2021-05-28 00:07:32.765499: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2021-05-28 00:07:32.765532: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2021-05-28 00:07:32.765645: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2021-05-28 00:07:32.765679: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2021-05-28 00:07:32.765697: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2021-05-28 00:07:32.769707: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0, 1
/usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document
warn("Container node skipped: type={0}".format(mdnode.t))
:219: RuntimeWarning: numpy.ndarray size changed, may indicate binary incompatibility. Expected 88, got 80
:219: RuntimeWarning: numpy.ndarray size changed, may indicate binary incompatibility. Expected 80 from C header, got 88 from PyObject
/usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document
warn("Container node skipped: type={0}".format(mdnode.t))
/usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document
warn("Container node skipped: type={0}".format(mdnode.t))
make: Leaving directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs'
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-6.2.4, py-1.10.0, pluggy-0.13.1
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: pyproject.toml
plugins: xdist-2.2.1, forked-1.3.0, cov-2.12.0
collected 806 items

tests/unit/test_column_group.py .. [ 0%]
tests/unit/test_column_similarity.py ...... [ 0%]
tests/unit/test_dask_nvt.py ............................................ [ 6%]
..................................................................... [ 15%]
tests/unit/test_dataloader_backend.py . [ 15%]
tests/unit/test_io.py .................................................. [ 21%]
..................................................................ssssss [ 30%]
ss.................................................. [ 36%]
tests/unit/test_notebooks.py ...... [ 37%]
tests/unit/test_ops.py ................................................. [ 43%]
........................................................................ [ 52%]
........................................................................ [ 61%]
............................................. [ 66%]
tests/unit/test_s3.py . [ 67%]
tests/unit/test_tf_dataloader.py ..................................s [ 71%]
tests/unit/test_tf_layers.py ........................................... [ 76%]
................................... [ 81%]
tests/unit/test_tools.py ...................... [ 83%]
tests/unit/test_torch_dataloader.py .................................... [ 88%]
[ 88%]
tests/unit/test_triton_inference.py ... [ 88%]
tests/unit/test_workflow.py ............................................ [ 94%]
............................................... [100%]

=============================== warnings summary ===============================
tests/unit/test_ops.py::test_groupby_op[id-False]
tests/unit/test_ops.py::test_groupby_op[id-True]
/usr/local/lib/python3.8/dist-packages/dask/dataframe/core.py:6560: UserWarning: Insufficient elements for head. 1 elements requested, only 0 elements available. Try passing larger npartitions to head.
warnings.warn(msg.format(n, len(r)))

-- Docs: https://docs.pytest.org/en/stable/warnings.html

----------- coverage: platform linux, python 3.8.5-final-0 -----------
Name Stmts Miss Branch BrPart Cover Missing

examples/multi-gpu-movielens/torch_trainer.py 65 0 6 1 99% 32->36
nvtabular/init.py 12 0 0 0 100%
nvtabular/column_group.py 157 18 82 5 87% 54, 87, 128, 152-165, 214, 301
nvtabular/dispatch.py 81 11 38 5 83% 35, 45->47, 69, 94, 110, 117, 134-137, 166-169
nvtabular/framework_utils/init.py 0 0 0 0 100%
nvtabular/framework_utils/tensorflow/init.py 1 0 0 0 100%
nvtabular/framework_utils/tensorflow/feature_column_utils.py 146 137 96 0 4% 28-32, 69-303
nvtabular/framework_utils/tensorflow/layers/init.py 4 0 0 0 100%
nvtabular/framework_utils/tensorflow/layers/embedding.py 153 12 85 6 91% 60, 68->49, 122, 179, 231-239, 335->343, 357->360, 363-364, 367
nvtabular/framework_utils/tensorflow/layers/interaction.py 47 25 20 1 43% 49, 74-103, 106-110, 113
nvtabular/framework_utils/tensorflow/layers/outer_product.py 30 24 10 0 15% 37-38, 41-60, 71-84, 87
nvtabular/framework_utils/torch/init.py 0 0 0 0 100%
nvtabular/framework_utils/torch/layers/init.py 2 0 0 0 100%
nvtabular/framework_utils/torch/layers/embeddings.py 27 1 10 1 95% 47
nvtabular/framework_utils/torch/models.py 41 0 22 1 98% 84->87
nvtabular/framework_utils/torch/utils.py 75 5 30 5 90% 51->53, 64, 71->73, 116, 118-120
nvtabular/inference/init.py 0 0 0 0 100%
nvtabular/inference/triton/init.py 279 144 120 18 48% 95-144, 187-247, 278-279, 284-287, 310-322, 330-335, 353, 372-388, 392-396, 471-493, 497-564, 573->576, 576->572, 605-615, 619-620, 624, 634, 640, 642, 644, 646, 648, 650, 652, 655, 660->663, 663->665
nvtabular/inference/triton/model.py 50 50 18 0 0% 27-133
nvtabular/inference/triton/model_config_pb2.py 299 0 2 0 100%
nvtabular/inference/triton/model_hugectr.py 49 49 14 0 0% 27-125
nvtabular/inference/triton/model_pytorch.py 30 30 8 0 0% 27-89
nvtabular/io/init.py 4 0 0 0 100%
nvtabular/io/avro.py 88 88 30 0 0% 16-189
nvtabular/io/csv.py 54 4 20 5 88% 95, 99->103, 104, 106, 120
nvtabular/io/dask.py 179 7 68 11 93% 110, 113, 149, 224, 384->382, 412->415, 423, 427->429, 429->425, 434, 436
nvtabular/io/dataframe_engine.py 58 3 28 6 90% 47, 66, 85->89, 89->94, 91->94, 94->113, 122
nvtabular/io/dataset.py 263 31 124 21 86% 254, 256, 269, 278, 296-310, 413->482, 418-421, 426->436, 431-432, 443->441, 457->461, 472, 518, 639->641, 641->650, 651, 658-659, 665, 671, 766-767, 879-884, 890, 924
nvtabular/io/dataset_engine.py 23 1 0 0 96% 45
nvtabular/io/hugectr.py 45 2 24 2 91% 34, 74->97, 101
nvtabular/io/parquet.py 486 19 154 12 95% 85-93, 117->119, 206-208, 331-336, 374-379, 495->502, 563->568, 569-570, 690, 694, 698, 736, 753, 757, 764->766, 884->889, 894->904, 931
nvtabular/io/shuffle.py 30 4 12 3 83% 41, 43-44, 48
nvtabular/io/writer.py 168 11 64 5 92% 46, 74, 120, 123, 200, 209, 212, 255, 276-278
nvtabular/io/writer_factory.py 18 2 8 2 85% 35, 60
nvtabular/loader/init.py 0 0 0 0 100%
nvtabular/loader/backend.py 325 13 136 10 95% 131, 138-139, 229->231, 241-245, 291-292, 331->335, 406, 410-411, 441, 547, 555
nvtabular/loader/tensorflow.py 132 21 38 7 82% 57, 65-68, 78, 88, 303, 318-320, 330->334, 349-351, 361-369, 372-375
nvtabular/loader/tf_utils.py 55 10 20 5 80% 29->32, 32->34, 39->41, 43, 50-51, 58-60, 66-70
nvtabular/loader/torch.py 75 13 12 2 76% 26-28, 31-37, 138-139, 162
nvtabular/ops/init.py 21 0 0 0 100%
nvtabular/ops/bucketize.py 24 4 16 2 75% 45, 48-51
nvtabular/ops/categorify.py 514 66 298 44 85% 237, 254, 258, 266, 274, 276, 298, 317-318, 352-353, 415-417, 433, 482->484, 557, 595, 624->627, 628-630, 637-638, 651-653, 654->622, 670, 680, 682, 688, 704-705, 710, 713->716, 726, 750, 755, 771-774, 800, 804, 806, 818-821, 936, 938, 980->1001, 986->1001, 1002-1007, 1044, 1060->1065, 1064, 1074->1071, 1079->1071, 1087, 1095-1105
nvtabular/ops/clip.py 19 2 6 3 80% 45, 53->55, 56
nvtabular/ops/column_similarity.py 88 22 32 5 69% 84, 156-157, 166-168, 176-192, 207->217, 209->212, 213, 223
nvtabular/ops/data_stats.py 57 2 22 3 94% 91->93, 95, 97->87, 102
nvtabular/ops/difference_lag.py 26 0 8 1 97% 67->69
nvtabular/ops/dropna.py 8 0 0 0 100%
nvtabular/ops/fill.py 58 2 20 1 96% 93, 119
nvtabular/ops/filter.py 21 1 6 1 93% 44
nvtabular/ops/groupby.py 93 4 56 6 92% 72, 81, 83, 93->95, 105->110, 181
nvtabular/ops/hash_bucket.py 32 2 18 2 88% 73, 102
nvtabular/ops/hashed_cross.py 29 3 13 4 83% 51, 64, 78->exit, 79
nvtabular/ops/join_external.py 69 4 28 4 92% 96, 98, 116, 168
nvtabular/ops/join_groupby.py 82 5 28 2 94% 106, 109->116, 185-186, 189-190
nvtabular/ops/lambdaop.py 27 3 10 3 84% 61, 65, 78
nvtabular/ops/list_slice.py 64 22 26 1 59% 52-53, 105-119, 127-138
nvtabular/ops/logop.py 9 0 0 0 100%
nvtabular/ops/moments.py 65 0 20 0 100%
nvtabular/ops/normalize.py 65 6 14 2 87% 61->60, 67-68, 101-102, 124-125
nvtabular/ops/operator.py 15 1 2 1 88% 24
nvtabular/ops/rename.py 23 3 14 3 84% 46, 67-69
nvtabular/ops/stat_operator.py 8 0 0 0 100%
nvtabular/ops/target_encoding.py 148 11 64 5 91% 143, 163->167, 170->179, 222-223, 226-227, 236-242, 333->336
nvtabular/tools/init.py 0 0 0 0 100%
nvtabular/tools/data_gen.py 236 1 62 1 99% 323
nvtabular/tools/dataset_inspector.py 49 7 18 1 79% 31-38
nvtabular/tools/inspector_script.py 46 46 0 0 0% 17-168
nvtabular/utils.py 94 45 44 8 46% 30-31, 35-36, 49, 58-61, 63-65, 68, 71, 77, 83, 89-125, 144, 148->152
nvtabular/worker.py 68 1 30 2 97% 74->87, 94
nvtabular/workflow.py 143 9 65 4 93% 40, 126, 140-142, 245, 273-274, 351

TOTAL 5752 1007 2219 243 80%
Coverage XML written to file coverage.xml

Required test coverage of 70% reached. Total coverage: 79.95%
============ 797 passed, 9 skipped, 2 warnings in 628.45s (0:10:28) ============
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins5742547350494335884.sh

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit a48173583a00a0d43ddaa76d1aa4eed4258a1c7a, no merge conflicts.
Running as SYSTEM
Setting status of a48173583a00a0d43ddaa76d1aa4eed4258a1c7a to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2526/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse a48173583a00a0d43ddaa76d1aa4eed4258a1c7a^{commit} # timeout=10
Checking out Revision a48173583a00a0d43ddaa76d1aa4eed4258a1c7a (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f a48173583a00a0d43ddaa76d1aa4eed4258a1c7a # timeout=10
Commit message: "fixed np calls unnecessary"
 > git rev-list --no-walk 6e47a57246bb0e28c0db758d3d96cb8d60dc99f8 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins5766202141533268416.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.2 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
106 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
  warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
  warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint

Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)

Running flake8-nb
Building docs
make: Entering directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs'
2021-05-28 20:59:54.392280: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2021-05-28 20:59:55.731356: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2021-05-28 20:59:55.731416: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcuda.so.1
2021-05-28 20:59:55.732488: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 0 with properties:
pciBusID: 0000:07:00.0 name: Tesla P100-DGXS-16GB computeCapability: 6.0
coreClock: 1.4805GHz coreCount: 56 deviceMemorySize: 15.90GiB deviceMemoryBandwidth: 681.88GiB/s
2021-05-28 20:59:55.733477: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1720] Found device 1 with properties:
pciBusID: 0000:08:00.0 name: Tesla P100-DGXS-16GB computeCapability: 6.0
coreClock: 1.4805GHz coreCount: 56 deviceMemorySize: 15.90GiB deviceMemoryBandwidth: 681.88GiB/s
2021-05-28 20:59:55.733503: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudart.so.11.0
2021-05-28 20:59:55.733552: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublas.so.11
2021-05-28 20:59:55.733587: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcublasLt.so.11
2021-05-28 20:59:55.733622: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcufft.so.10
2021-05-28 20:59:55.733656: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcurand.so.10
2021-05-28 20:59:55.733756: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusolver.so.10
2021-05-28 20:59:55.733790: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcusparse.so.11
2021-05-28 20:59:55.733825: I tensorflow/stream_executor/platform/default/dso_loader.cc:49] Successfully opened dynamic library libcudnn.so.8
2021-05-28 20:59:55.737669: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1862] Adding visible gpu devices: 0, 1
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.5) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
/usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document
warn("Container node skipped: type={0}".format(mdnode.t))
:219: RuntimeWarning: numpy.ndarray size changed, may indicate binary incompatibility. Expected 88, got 80
:219: RuntimeWarning: numpy.ndarray size changed, may indicate binary incompatibility. Expected 80 from C header, got 88 from PyObject
/usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document
warn("Container node skipped: type={0}".format(mdnode.t))
/usr/local/lib/python3.8/dist-packages/recommonmark/parser.py:75: UserWarning: Container node skipped: type=document
warn("Container node skipped: type={0}".format(mdnode.t))
make: Leaving directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs'
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-6.2.4, py-1.10.0, pluggy-0.13.1
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: pyproject.toml
plugins: xdist-2.2.1, forked-1.3.0, cov-2.12.0
collected 806 items

tests/unit/test_column_group.py .. [ 0%]
tests/unit/test_column_similarity.py ...... [ 0%]
tests/unit/test_dask_nvt.py ............................................ [ 6%]
..................................................................... [ 15%]
tests/unit/test_dataloader_backend.py . [ 15%]
tests/unit/test_io.py .................................................. [ 21%]
..................................................................ssssss [ 30%]
ss.................................................. [ 36%]
tests/unit/test_notebooks.py ...... [ 37%]
tests/unit/test_ops.py ................................................. [ 43%]
........................................................................ [ 52%]
........................................................................ [ 61%]
............................................. [ 66%]
tests/unit/test_s3.py . [ 67%]
tests/unit/test_tf_dataloader.py ..................................s [ 71%]
tests/unit/test_tf_layers.py ........................................... [ 76%]
................................... [ 81%]
tests/unit/test_tools.py ...................... [ 83%]
tests/unit/test_torch_dataloader.py ................................FF.. [ 88%]
[ 88%]
tests/unit/test_triton_inference.py ... [ 88%]
tests/unit/test_workflow.py ............................................ [ 94%]
............................................... [100%]

=================================== FAILURES ===================================
__________________________ test_sparse_tensors[False] __________________________

sparse_dense = False

@pytest.mark.parametrize("sparse_dense", [False, True])
def test_sparse_tensors(sparse_dense):
    # create small dataset, add values to sparse_list
    df = cudf.DataFrame(
        {
            "spar1": [[1, 2, 3, 4], [4, 2, 4, 4], [1, 3, 4, 3], [1, 1, 3, 3]],
            "spar2": [[1, 2, 3, 4, 5], [6, 7, 8, 9, 10], [11, 12, 13, 14], [15, 16]],
        }
    )
    spa_lst = ["spar1", "spar2"]
    spa_mx = {"spar1": 5, "spar2": 6}
    batch_size = 2
    data_itr = torch_dataloader.TorchAsyncItr(
        nvt.Dataset(df),
        cats=spa_lst,
        conts=[],
        labels=[],
        batch_size=batch_size,
        sparse_names=spa_lst,
        sparse_max=spa_mx,
        sparse_as_dense=sparse_dense,
    )
  for batch in data_itr:

tests/unit/test_torch_dataloader.py:414:


nvtabular/loader/backend.py:286: in next
return self._get_next_batch()
nvtabular/loader/backend.py:313: in _get_next_batch
self._fetch_chunk()
nvtabular/loader/backend.py:292: in _fetch_chunk
raise chunks
nvtabular/loader/backend.py:126: in load_chunks
chunks = self.dataloader.make_tensors(chunks, self.dataloader._use_nnz)
nvtabular/loader/backend.py:419: in make_tensors
return [self._handle_tensors(*batch) for batch in batches]
nvtabular/loader/backend.py:419: in
return [self._handle_tensors(*batch) for batch in batches]
nvtabular/loader/backend.py:550: in _handle_tensors
X[column_name] = self._to_sparse_tensor(X[column_name], column_name)
nvtabular/loader/backend.py:446: in _to_sparse_tensor
return self._build_sparse_tensor(values, offsets, diff_offsets, num_rows, seq_limit)
nvtabular/loader/torch.py:174: in _build_sparse_tensor
return self._get_sparse_tensor(values, indices, num_rows, seq_limit)


self = <nvtabular.loader.torch.TorchAsyncItr object at 0x7f750c419dc0>
values = tensor([1, 2, 3, 4, 4, 2, 4, 4], device='cuda:0')
indices = tensor([[0, 0],
[0, 1],
[0, 2],
[0, 3],
[1, 0],
[1, 1],
[1, 2],
[1, 3]], device='cuda:0')
num_rows = 2, seq_limit = 5

def _get_sparse_tensor(self, values, indices, num_rows, seq_limit):
    # get_sparse_tensor_class, return sparse_tensor_class
    if torch.is_floating_point(values):
        sparse_tensor_class = torch.sparse.FloatTensor
    else:
        sparse_tensor_class = torch.sparse.LongTensor
  sparse_tensor = sparse_tensor_class(
        indices.T, values, torch.Size([num_rows, seq_limit]), device="cuda"
    )

E RuntimeError: legacy constructor expects device type: cpubut device type: cuda was passed

nvtabular/loader/torch.py:165: RuntimeError
__________________________ test_sparse_tensors[True] ___________________________

sparse_dense = True

@pytest.mark.parametrize("sparse_dense", [False, True])
def test_sparse_tensors(sparse_dense):
    # create small dataset, add values to sparse_list
    df = cudf.DataFrame(
        {
            "spar1": [[1, 2, 3, 4], [4, 2, 4, 4], [1, 3, 4, 3], [1, 1, 3, 3]],
            "spar2": [[1, 2, 3, 4, 5], [6, 7, 8, 9, 10], [11, 12, 13, 14], [15, 16]],
        }
    )
    spa_lst = ["spar1", "spar2"]
    spa_mx = {"spar1": 5, "spar2": 6}
    batch_size = 2
    data_itr = torch_dataloader.TorchAsyncItr(
        nvt.Dataset(df),
        cats=spa_lst,
        conts=[],
        labels=[],
        batch_size=batch_size,
        sparse_names=spa_lst,
        sparse_max=spa_mx,
        sparse_as_dense=sparse_dense,
    )
  for batch in data_itr:

tests/unit/test_torch_dataloader.py:414:


nvtabular/loader/backend.py:286: in next
return self._get_next_batch()
nvtabular/loader/backend.py:313: in _get_next_batch
self._fetch_chunk()
nvtabular/loader/backend.py:292: in _fetch_chunk
raise chunks
nvtabular/loader/backend.py:126: in load_chunks
chunks = self.dataloader.make_tensors(chunks, self.dataloader._use_nnz)
nvtabular/loader/backend.py:419: in make_tensors
return [self._handle_tensors(*batch) for batch in batches]
nvtabular/loader/backend.py:419: in
return [self._handle_tensors(*batch) for batch in batches]
nvtabular/loader/backend.py:550: in _handle_tensors
X[column_name] = self._to_sparse_tensor(X[column_name], column_name)
nvtabular/loader/backend.py:446: in _to_sparse_tensor
return self._build_sparse_tensor(values, offsets, diff_offsets, num_rows, seq_limit)
nvtabular/loader/torch.py:174: in _build_sparse_tensor
return self._get_sparse_tensor(values, indices, num_rows, seq_limit)


self = <nvtabular.loader.torch.TorchAsyncItr object at 0x7f76379572e0>
values = tensor([1, 2, 3, 4, 4, 2, 4, 4], device='cuda:0')
indices = tensor([[0, 0],
[0, 1],
[0, 2],
[0, 3],
[1, 0],
[1, 1],
[1, 2],
[1, 3]], device='cuda:0')
num_rows = 2, seq_limit = 5

def _get_sparse_tensor(self, values, indices, num_rows, seq_limit):
    # get_sparse_tensor_class, return sparse_tensor_class
    if torch.is_floating_point(values):
        sparse_tensor_class = torch.sparse.FloatTensor
    else:
        sparse_tensor_class = torch.sparse.LongTensor
  sparse_tensor = sparse_tensor_class(
        indices.T, values, torch.Size([num_rows, seq_limit]), device="cuda"
    )

E RuntimeError: legacy constructor expects device type: cpubut device type: cuda was passed

nvtabular/loader/torch.py:165: RuntimeError
=============================== warnings summary ===============================
tests/unit/test_ops.py::test_groupby_op[id-False]
tests/unit/test_ops.py::test_groupby_op[id-True]
/usr/local/lib/python3.8/dist-packages/dask/dataframe/core.py:6560: UserWarning: Insufficient elements for head. 1 elements requested, only 0 elements available. Try passing larger npartitions to head.
warnings.warn(msg.format(n, len(r)))

-- Docs: https://docs.pytest.org/en/stable/warnings.html

----------- coverage: platform linux, python 3.8.5-final-0 -----------
Name Stmts Miss Branch BrPart Cover Missing

examples/multi-gpu-movielens/torch_trainer.py 65 0 6 1 99% 32->36
nvtabular/init.py 12 0 0 0 100%
nvtabular/column_group.py 157 18 82 5 87% 54, 87, 128, 152-165, 214, 301
nvtabular/dispatch.py 81 11 38 5 83% 35, 45->47, 69, 94, 110, 117, 134-137, 166-169
nvtabular/framework_utils/init.py 0 0 0 0 100%
nvtabular/framework_utils/tensorflow/init.py 1 0 0 0 100%
nvtabular/framework_utils/tensorflow/feature_column_utils.py 146 137 96 0 4% 28-32, 69-303
nvtabular/framework_utils/tensorflow/layers/init.py 4 0 0 0 100%
nvtabular/framework_utils/tensorflow/layers/embedding.py 153 12 85 6 91% 60, 68->49, 122, 179, 231-239, 335->343, 357->360, 363-364, 367
nvtabular/framework_utils/tensorflow/layers/interaction.py 47 25 20 1 43% 49, 74-103, 106-110, 113
nvtabular/framework_utils/tensorflow/layers/outer_product.py 30 24 10 0 15% 37-38, 41-60, 71-84, 87
nvtabular/framework_utils/torch/init.py 0 0 0 0 100%
nvtabular/framework_utils/torch/layers/init.py 2 0 0 0 100%
nvtabular/framework_utils/torch/layers/embeddings.py 27 1 10 1 95% 47
nvtabular/framework_utils/torch/models.py 41 0 22 1 98% 84->87
nvtabular/framework_utils/torch/utils.py 75 5 30 5 90% 51->53, 64, 71->73, 116, 118-120
nvtabular/inference/init.py 0 0 0 0 100%
nvtabular/inference/triton/init.py 279 144 120 18 48% 95-144, 187-247, 278-279, 284-287, 310-322, 330-335, 353, 372-388, 392-396, 471-493, 497-564, 573->576, 576->572, 605-615, 619-620, 624, 634, 640, 642, 644, 646, 648, 650, 652, 655, 660->663, 663->665
nvtabular/inference/triton/model.py 50 50 18 0 0% 27-133
nvtabular/inference/triton/model_config_pb2.py 299 0 2 0 100%
nvtabular/inference/triton/model_hugectr.py 49 49 14 0 0% 27-125
nvtabular/inference/triton/model_pytorch.py 30 30 8 0 0% 27-89
nvtabular/io/init.py 4 0 0 0 100%
nvtabular/io/avro.py 88 88 30 0 0% 16-189
nvtabular/io/csv.py 54 4 20 5 88% 95, 99->103, 104, 106, 120
nvtabular/io/dask.py 179 7 68 11 93% 110, 113, 149, 224, 384->382, 412->415, 423, 427->429, 429->425, 434, 436
nvtabular/io/dataframe_engine.py 58 3 28 6 90% 47, 66, 85->89, 89->94, 91->94, 94->113, 122
nvtabular/io/dataset.py 263 31 124 21 86% 254, 256, 269, 278, 296-310, 413->482, 418-421, 426->436, 431-432, 443->441, 457->461, 472, 518, 639->641, 641->650, 651, 658-659, 665, 671, 766-767, 879-884, 890, 924
nvtabular/io/dataset_engine.py 23 1 0 0 96% 45
nvtabular/io/hugectr.py 45 2 24 2 91% 34, 74->97, 101
nvtabular/io/parquet.py 486 19 154 12 95% 85-93, 117->119, 206-208, 331-336, 374-379, 495->502, 563->568, 569-570, 690, 694, 698, 736, 753, 757, 764->766, 884->889, 894->904, 931
nvtabular/io/shuffle.py 30 4 12 3 83% 41, 43-44, 48
nvtabular/io/writer.py 168 11 64 5 92% 46, 74, 120, 123, 200, 209, 212, 255, 276-278
nvtabular/io/writer_factory.py 18 2 8 2 85% 35, 60
nvtabular/loader/init.py 0 0 0 0 100%
nvtabular/loader/backend.py 325 9 136 9 96% 131, 229->231, 241-245, 331->335, 406, 410-411, 441, 547, 555
nvtabular/loader/tensorflow.py 131 21 38 7 82% 56, 64-67, 77, 87, 302, 317-319, 329->333, 348-350, 360-368, 371-374
nvtabular/loader/tf_utils.py 55 10 20 5 80% 29->32, 32->34, 39->41, 43, 50-51, 58-60, 66-70
nvtabular/loader/torch.py 74 16 12 2 70% 25-27, 30-36, 137-138, 161, 168-170
nvtabular/ops/init.py 21 0 0 0 100%
nvtabular/ops/bucketize.py 24 4 16 2 75% 45, 48-51
nvtabular/ops/categorify.py 514 66 298 44 85% 237, 254, 258, 266, 274, 276, 298, 317-318, 352-353, 415-417, 433, 482->484, 557, 595, 624->627, 628-630, 637-638, 651-653, 654->622, 670, 680, 682, 688, 704-705, 710, 713->716, 726, 750, 755, 771-774, 800, 804, 806, 818-821, 936, 938, 980->1001, 986->1001, 1002-1007, 1044, 1060->1065, 1064, 1074->1071, 1079->1071, 1087, 1095-1105
nvtabular/ops/clip.py 19 2 6 3 80% 45, 53->55, 56
nvtabular/ops/column_similarity.py 88 22 32 5 69% 84, 156-157, 166-168, 176-192, 207->217, 209->212, 213, 223
nvtabular/ops/data_stats.py 57 2 22 3 94% 91->93, 95, 97->87, 102
nvtabular/ops/difference_lag.py 26 0 8 1 97% 67->69
nvtabular/ops/dropna.py 8 0 0 0 100%
nvtabular/ops/fill.py 58 2 20 1 96% 93, 119
nvtabular/ops/filter.py 21 1 6 1 93% 44
nvtabular/ops/groupby.py 93 4 56 6 92% 72, 81, 83, 93->95, 105->110, 181
nvtabular/ops/hash_bucket.py 32 2 18 2 88% 73, 102
nvtabular/ops/hashed_cross.py 29 3 13 4 83% 51, 64, 78->exit, 79
nvtabular/ops/join_external.py 69 4 28 4 92% 96, 98, 116, 168
nvtabular/ops/join_groupby.py 82 5 28 2 94% 106, 109->116, 185-186, 189-190
nvtabular/ops/lambdaop.py 27 3 10 3 84% 61, 65, 78
nvtabular/ops/list_slice.py 64 22 26 1 59% 52-53, 105-119, 127-138
nvtabular/ops/logop.py 9 0 0 0 100%
nvtabular/ops/moments.py 65 0 20 0 100%
nvtabular/ops/normalize.py 65 6 14 2 87% 61->60, 67-68, 101-102, 124-125
nvtabular/ops/operator.py 15 1 2 1 88% 24
nvtabular/ops/rename.py 23 3 14 3 84% 46, 67-69
nvtabular/ops/stat_operator.py 8 0 0 0 100%
nvtabular/ops/target_encoding.py 148 11 64 5 91% 143, 163->167, 170->179, 222-223, 226-227, 236-242, 333->336
nvtabular/tools/init.py 0 0 0 0 100%
nvtabular/tools/data_gen.py 236 1 62 1 99% 323
nvtabular/tools/dataset_inspector.py 49 7 18 1 79% 31-38
nvtabular/tools/inspector_script.py 46 46 0 0 0% 17-168
nvtabular/utils.py 94 45 44 8 46% 30-31, 35-36, 49, 58-61, 63-65, 68, 71, 77, 83, 89-125, 144, 148->152
nvtabular/worker.py 68 1 30 2 97% 74->87, 94
nvtabular/workflow.py 143 9 65 4 93% 40, 126, 140-142, 245, 273-274, 351

TOTAL 5750 1006 2219 242 80%
Coverage XML written to file coverage.xml

Required test coverage of 70% reached. Total coverage: 79.95%
=========================== short test summary info ============================
FAILED tests/unit/test_torch_dataloader.py::test_sparse_tensors[False] - Runt...
FAILED tests/unit/test_torch_dataloader.py::test_sparse_tensors[True] - Runti...
======= 2 failed, 795 passed, 9 skipped, 2 warnings in 627.20s (0:10:27) =======
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins5841950689534678199.sh

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit 4369e8ad7c48f69f2d5e10964dcbcc94527b1db1, no merge conflicts.
Running as SYSTEM
Setting status of 4369e8ad7c48f69f2d5e10964dcbcc94527b1db1 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2531/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse 4369e8ad7c48f69f2d5e10964dcbcc94527b1db1^{commit} # timeout=10
Checking out Revision 4369e8ad7c48f69f2d5e10964dcbcc94527b1db1 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 4369e8ad7c48f69f2d5e10964dcbcc94527b1db1 # timeout=10
Commit message: "using new sparse api"
 > git rev-list --no-walk 8ec75a3b19a2327bb4c2907b1e5aa6504dc2cf80 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins5527489563700728260.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.2 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
106 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
  warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
  warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
Build timed out (after 20 minutes). Marking the build as failed.
Terminated
Build was aborted
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" 
[nvtabular_tests] $ /bin/bash /tmp/jenkins587785525062540192.sh

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit 8d79bfa5df22540951fad3d189f9275edd2995aa, no merge conflicts.
Running as SYSTEM
Setting status of 8d79bfa5df22540951fad3d189f9275edd2995aa to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2532/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse 8d79bfa5df22540951fad3d189f9275edd2995aa^{commit} # timeout=10
Checking out Revision 8d79bfa5df22540951fad3d189f9275edd2995aa (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 8d79bfa5df22540951fad3d189f9275edd2995aa # timeout=10
Commit message: "Merge branch 'main' into spar-dl"
 > git rev-list --no-walk 4369e8ad7c48f69f2d5e10964dcbcc94527b1db1 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins8638518250240577787.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.2 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
106 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
  warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
  warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
Build timed out (after 20 minutes). Marking the build as failed.
Terminated
Build was aborted
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" 
[nvtabular_tests] $ /bin/bash /tmp/jenkins8794198029917199537.sh

@karlhigley
Copy link
Contributor

As far as I can tell, the comments have now been resolved and it's just a matter of getting pylint to stop timing out on CI, yeah?

@jperez999
Copy link
Contributor Author

rerun tests

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit 8d79bfa5df22540951fad3d189f9275edd2995aa, no merge conflicts.
Running as SYSTEM
Setting status of 8d79bfa5df22540951fad3d189f9275edd2995aa to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2534/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
 > git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse 8d79bfa5df22540951fad3d189f9275edd2995aa^{commit} # timeout=10
Checking out Revision 8d79bfa5df22540951fad3d189f9275edd2995aa (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 8d79bfa5df22540951fad3d189f9275edd2995aa # timeout=10
Commit message: "Merge branch 'main' into spar-dl"
 > git rev-list --no-walk ea950e79bf650bfc3fa9da57e2014258bf483f62 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins4553348100385906567.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Attempting uninstall: nvtabular
    Found existing installation: nvtabular 0.5.3
    Can't uninstall 'nvtabular'. No files were found to uninstall.
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.2 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
106 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
  warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
  warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
Terminated
Build was aborted
Aborted by �[8mha:////4I6AZwo/1Z8Fal8AhZTEatjIwqNwCcqT21311HdysuK+AAAAlx+LCAAAAAAAAP9b85aBtbiIQTGjNKU4P08vOT+vOD8nVc83PyU1x6OyILUoJzMv2y+/JJUBAhiZGBgqihhk0NSjKDWzXb3RdlLBUSYGJk8GtpzUvPSSDB8G5tKinBIGIZ+sxLJE/ZzEvHT94JKizLx0a6BxUmjGOUNodHsLgAzWEgZu/dLi1CL9xJTczDwAj6GcLcAAAAA=�[0madmin
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script  : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log" 
[nvtabular_tests] $ /bin/bash /tmp/jenkins5874487610800103266.sh

@jperez999
Copy link
Contributor Author

rerun tests

1 similar comment
@benfred
Copy link
Member

benfred commented Jun 1, 2021

rerun tests

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #793 of commit 8d79bfa5df22540951fad3d189f9275edd2995aa, no merge conflicts.
Running as SYSTEM
Setting status of 8d79bfa5df22540951fad3d189f9275edd2995aa to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2537/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
 > git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
 > git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/793/*:refs/remotes/origin/pr/793/* # timeout=10
 > git rev-parse 8d79bfa5df22540951fad3d189f9275edd2995aa^{commit} # timeout=10
Checking out Revision 8d79bfa5df22540951fad3d189f9275edd2995aa (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 8d79bfa5df22540951fad3d189f9275edd2995aa # timeout=10
Commit message: "Merge branch 'main' into spar-dl"
 > git rev-list --no-walk 8d79bfa5df22540951fad3d189f9275edd2995aa # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins3136198739925814886.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
    Preparing wheel metadata: started
    Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
  Attempting uninstall: nvtabular
    Found existing installation: nvtabular 0.5.3+47.g8d79bfa
    Can't uninstall 'nvtabular'. No files were found to uninstall.
  Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.2 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
106 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
  warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
  warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 2 files
Running bandit
Running pylint

Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)

Running flake8-nb
Building docs
make: Entering directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs'
/usr/lib/python3/dist-packages/requests/init.py:89: RequestsDependencyWarning: urllib3 (1.26.5) or chardet (3.0.4) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
make: Leaving directory '/var/jenkins_home/workspace/nvtabular_tests/nvtabular/docs'
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-6.2.4, py-1.10.0, pluggy-0.13.1
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: pyproject.toml
plugins: cov-2.12.1, xdist-2.2.1, forked-1.3.0
collected 808 items

tests/unit/test_column_group.py .. [ 0%]
tests/unit/test_column_similarity.py ...... [ 0%]
tests/unit/test_dask_nvt.py ............................................ [ 6%]
..................................................................... [ 14%]
tests/unit/test_dataloader_backend.py . [ 15%]
tests/unit/test_io.py .................................................. [ 21%]
....................................................................ssss [ 30%]
ssss.................................................. [ 36%]
tests/unit/test_notebooks.py ...... [ 37%]
tests/unit/test_ops.py ................................................. [ 43%]
........................................................................ [ 52%]
........................................................................ [ 61%]
............................................. [ 67%]
tests/unit/test_s3.py . [ 67%]
tests/unit/test_tf_dataloader.py ..................................s [ 71%]
tests/unit/test_tf_layers.py ........................................... [ 76%]
................................... [ 81%]
tests/unit/test_tools.py ...................... [ 83%]
tests/unit/test_torch_dataloader.py .................................... [ 88%]
[ 88%]
tests/unit/test_triton_inference.py ... [ 88%]
tests/unit/test_workflow.py ............................................ [ 94%]
............................................... [100%]

=============================== warnings summary ===============================
tests/unit/test_ops.py::test_groupby_op[id-False]
tests/unit/test_ops.py::test_groupby_op[id-True]
/usr/local/lib/python3.8/dist-packages/dask/dataframe/core.py:6560: UserWarning: Insufficient elements for head. 1 elements requested, only 0 elements available. Try passing larger npartitions to head.
warnings.warn(msg.format(n, len(r)))

-- Docs: https://docs.pytest.org/en/stable/warnings.html

----------- coverage: platform linux, python 3.8.5-final-0 -----------
Name Stmts Miss Branch BrPart Cover Missing

examples/multi-gpu-movielens/torch_trainer.py 65 0 6 1 99% 32->36
nvtabular/init.py 12 0 0 0 100%
nvtabular/column_group.py 157 18 82 5 87% 54, 87, 128, 152-165, 214, 301
nvtabular/dispatch.py 81 11 38 5 83% 35, 45->47, 69, 94, 110, 117, 134-137, 166-169
nvtabular/framework_utils/init.py 0 0 0 0 100%
nvtabular/framework_utils/tensorflow/init.py 1 0 0 0 100%
nvtabular/framework_utils/tensorflow/feature_column_utils.py 146 137 96 0 4% 28-32, 69-303
nvtabular/framework_utils/tensorflow/layers/init.py 4 0 0 0 100%
nvtabular/framework_utils/tensorflow/layers/embedding.py 153 12 85 6 91% 60, 68->49, 122, 179, 231-239, 335->343, 357->360, 363-364, 367
nvtabular/framework_utils/tensorflow/layers/interaction.py 47 25 20 1 43% 49, 74-103, 106-110, 113
nvtabular/framework_utils/tensorflow/layers/outer_product.py 30 24 10 0 15% 37-38, 41-60, 71-84, 87
nvtabular/framework_utils/torch/init.py 0 0 0 0 100%
nvtabular/framework_utils/torch/layers/init.py 2 0 0 0 100%
nvtabular/framework_utils/torch/layers/embeddings.py 27 1 10 1 95% 47
nvtabular/framework_utils/torch/models.py 41 0 22 1 98% 84->87
nvtabular/framework_utils/torch/utils.py 75 5 30 5 90% 51->53, 64, 71->73, 116, 118-120
nvtabular/inference/init.py 0 0 0 0 100%
nvtabular/inference/triton/init.py 279 144 120 18 48% 120-170, 215-276, 307-308, 313-316, 339-351, 359-364, 382, 401-417, 421-425, 500-522, 526-593, 602->605, 605->601, 634-644, 648-649, 653, 663, 669, 671, 673, 675, 677, 679, 681, 684, 689->692, 692->694
nvtabular/inference/triton/model.py 50 50 18 0 0% 27-133
nvtabular/inference/triton/model_config_pb2.py 299 0 2 0 100%
nvtabular/inference/triton/model_hugectr.py 49 49 14 0 0% 27-125
nvtabular/inference/triton/model_pytorch.py 30 30 8 0 0% 27-89
nvtabular/io/init.py 4 0 0 0 100%
nvtabular/io/avro.py 88 88 30 0 0% 16-189
nvtabular/io/csv.py 54 4 20 5 88% 95, 99->103, 104, 106, 120
nvtabular/io/dask.py 179 7 68 11 93% 110, 113, 149, 224, 384->382, 412->415, 423, 427->429, 429->425, 434, 436
nvtabular/io/dataframe_engine.py 58 3 28 6 90% 47, 66, 85->89, 89->94, 91->94, 94->113, 122
nvtabular/io/dataset.py 294 33 136 23 86% 265, 267, 280, 289, 307-321, 424->493, 429-432, 437->447, 442-443, 454->452, 468->472, 483, 543->547, 590, 715-716, 720->722, 722->731, 732, 739-740, 746, 752, 847-848, 964-969, 975, 1025
nvtabular/io/dataset_engine.py 23 1 0 0 96% 45
nvtabular/io/hugectr.py 45 2 24 2 91% 34, 74->97, 101
nvtabular/io/parquet.py 486 19 154 12 95% 85-93, 117->119, 206-208, 331-336, 374-379, 495->502, 563->568, 569-570, 690, 694, 698, 736, 753, 757, 764->766, 884->889, 894->904, 931
nvtabular/io/shuffle.py 30 4 12 3 83% 41, 43-44, 48
nvtabular/io/writer.py 168 11 64 5 92% 46, 74, 120, 123, 200, 209, 212, 255, 276-278
nvtabular/io/writer_factory.py 18 2 8 2 85% 35, 60
nvtabular/loader/init.py 0 0 0 0 100%
nvtabular/loader/backend.py 325 13 136 10 95% 131, 138-139, 229->231, 241-245, 291-292, 331->335, 406, 410-411, 441, 547, 555
nvtabular/loader/tensorflow.py 131 21 38 7 82% 56, 64-67, 77, 87, 302, 317-319, 329->333, 348-350, 360-368, 371-374
nvtabular/loader/tf_utils.py 55 10 20 5 80% 29->32, 32->34, 39->41, 43, 50-51, 58-60, 66-70
nvtabular/loader/torch.py 71 12 10 1 77% 25-27, 30-36, 137-138
nvtabular/ops/init.py 21 0 0 0 100%
nvtabular/ops/bucketize.py 24 4 16 2 75% 45, 48-51
nvtabular/ops/categorify.py 514 66 298 44 85% 237, 254, 258, 266, 274, 276, 298, 317-318, 352-353, 415-417, 433, 482->484, 557, 595, 624->627, 628-630, 637-638, 651-653, 654->622, 670, 680, 682, 688, 704-705, 710, 713->716, 726, 750, 755, 771-774, 800, 804, 806, 818-821, 936, 938, 980->1001, 986->1001, 1002-1007, 1044, 1060->1065, 1064, 1074->1071, 1079->1071, 1087, 1095-1105
nvtabular/ops/clip.py 19 2 6 3 80% 45, 53->55, 56
nvtabular/ops/column_similarity.py 88 22 32 5 69% 84, 156-157, 166-168, 176-192, 207->217, 209->212, 213, 223
nvtabular/ops/data_stats.py 57 2 22 3 94% 91->93, 95, 97->87, 102
nvtabular/ops/difference_lag.py 26 0 8 1 97% 67->69
nvtabular/ops/dropna.py 8 0 0 0 100%
nvtabular/ops/fill.py 58 2 20 1 96% 93, 119
nvtabular/ops/filter.py 21 1 6 1 93% 44
nvtabular/ops/groupby.py 93 4 56 6 92% 72, 81, 83, 93->95, 105->110, 181
nvtabular/ops/hash_bucket.py 32 2 18 2 88% 73, 102
nvtabular/ops/hashed_cross.py 29 3 13 4 83% 51, 64, 78->exit, 79
nvtabular/ops/join_external.py 69 4 28 4 92% 96, 98, 116, 168
nvtabular/ops/join_groupby.py 82 5 28 2 94% 106, 109->116, 185-186, 189-190
nvtabular/ops/lambdaop.py 27 3 10 3 84% 61, 65, 78
nvtabular/ops/list_slice.py 64 22 26 1 59% 52-53, 105-119, 127-138
nvtabular/ops/logop.py 9 0 0 0 100%
nvtabular/ops/moments.py 65 0 20 0 100%
nvtabular/ops/normalize.py 65 6 14 2 87% 61->60, 67-68, 101-102, 124-125
nvtabular/ops/operator.py 15 1 2 1 88% 24
nvtabular/ops/rename.py 23 3 14 3 84% 46, 67-69
nvtabular/ops/stat_operator.py 8 0 0 0 100%
nvtabular/ops/target_encoding.py 148 11 64 5 91% 143, 163->167, 170->179, 222-223, 226-227, 236-242, 333->336
nvtabular/tools/init.py 0 0 0 0 100%
nvtabular/tools/data_gen.py 236 1 62 1 99% 323
nvtabular/tools/dataset_inspector.py 49 7 18 1 79% 31-38
nvtabular/tools/inspector_script.py 46 46 0 0 0% 17-168
nvtabular/utils.py 94 45 44 8 46% 30-31, 35-36, 49, 58-61, 63-65, 68, 71, 77, 83, 89-125, 144, 148->152
nvtabular/worker.py 68 1 30 2 97% 74->87, 94
nvtabular/workflow.py 143 9 65 4 93% 40, 126, 140-142, 245, 273-274, 351

TOTAL 5778 1008 2229 244 80%
Coverage XML written to file coverage.xml

Required test coverage of 70% reached. Total coverage: 79.99%
============ 799 passed, 9 skipped, 2 warnings in 628.16s (0:10:28) ============
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins5807744385034820837.sh

@jperez999 jperez999 merged commit 50f04df into NVIDIA-Merlin:main Jun 1, 2021
mikemckiernan pushed a commit that referenced this pull request Nov 24, 2022
* initial put together

* green on torch

* working sparse representation in tf and torch

* moving in the right direction

* clean up categorify

* more tests passing

* working a little better

* only one test failing now

* fixed formatting

* all tests green on dict change

* pytorch working sparse with test

* working tests

* horovod tf red only

* all greens on testing

* abstract complete

* all notebooks are green

* changed up the shuffle test in torch

* working all tests

* canceling out the tf horovod tests for failures on ci environment

* removing unused import

* fixes from review

* fixes pushing throughout

* triton and python fixes

* fix for flake8

* more of the review comments integrated

* fixes for tf tests

* black reformat

* checking tf

* deactivate test again for ci user permission issues

* deactivate test

* declaring tuple

* hide transform call

* added sparse to dense logic and switch

* torch dense testing in

* added tf test for sparse to dense logic

* flake8 unused dicttransform import

* adding safety check for linear build function

* naming fix

* black reformat

* fixed np calls unnecessary

* using new sparse api

Co-authored-by: Karl Higley <karlb@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
5 participants