Allowing to pass in a vocab in Categorify #935
Conversation
Click to view CI ResultsGitHub pull request #935 of commit e3ddab778dd54622a171dddce447dc4d0b7352bc, no merge conflicts.
Running as SYSTEM
Setting status of e3ddab778dd54622a171dddce447dc4d0b7352bc to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2766/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse e3ddab778dd54622a171dddce447dc4d0b7352bc^{commit} # timeout=10
Checking out Revision e3ddab778dd54622a171dddce447dc4d0b7352bc (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f e3ddab778dd54622a171dddce447dc4d0b7352bc # timeout=10
Commit message: "Allow to pass in vocabs in Categorify to fix make_feature_column_workflow"
> git rev-list --no-walk 26310aeecd05c9a1eb772aadcdf90c754f406b70 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins393578207587878685.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.3 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
108 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module bench.datasets.tools.train_hugectr
bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
|
|
rerun tests |
Click to view CI ResultsGitHub pull request #935 of commit e3ddab778dd54622a171dddce447dc4d0b7352bc, no merge conflicts.
Running as SYSTEM
Setting status of e3ddab778dd54622a171dddce447dc4d0b7352bc to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2770/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse e3ddab778dd54622a171dddce447dc4d0b7352bc^{commit} # timeout=10
Checking out Revision e3ddab778dd54622a171dddce447dc4d0b7352bc (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f e3ddab778dd54622a171dddce447dc4d0b7352bc # timeout=10
Commit message: "Allow to pass in vocabs in Categorify to fix make_feature_column_workflow"
> git rev-list --no-walk d75180f8f20473ce56b86922c9d96c406b510d67 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins1604705900853845016.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.3 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
108 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module bench.datasets.tools.train_hugectr
bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
|
There was a problem hiding this comment.
this looks good!
There are a couple of minor things I'd like to see before merging:
- We should move the pandas/cudf code into nvtabular/dispatch.py
- We should add an entry to the Categorify docstring for the 'vocabs' parameter
- I don't think this will work with encode_type='joint' (like when using this op to compute feature crosses). I'm not too concerned about this - but maybe we can throw an exception in the constructor if both vocabs and encode_type='joint' are both set?
Click to view CI ResultsGitHub pull request #935 of commit 66d934f114befde0c104791058aae361259b8bae, no merge conflicts.
Running as SYSTEM
Setting status of 66d934f114befde0c104791058aae361259b8bae to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2810/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse 66d934f114befde0c104791058aae361259b8bae^{commit} # timeout=10
Checking out Revision 66d934f114befde0c104791058aae361259b8bae (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 66d934f114befde0c104791058aae361259b8bae # timeout=10
Commit message: "Update .gitignore"
> git rev-list --no-walk 842fead98542f6b9ea85b37f2e6c205087a88db3 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins8912513169153605297.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.3 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
108 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module bench.datasets.tools.train_hugectr
bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
|
Click to view CI ResultsGitHub pull request #935 of commit 34c96879396fa1f3f7e3cee350b023fbb8e20c8f, no merge conflicts.
Running as SYSTEM
Setting status of 34c96879396fa1f3f7e3cee350b023fbb8e20c8f to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2813/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse 34c96879396fa1f3f7e3cee350b023fbb8e20c8f^{commit} # timeout=10
Checking out Revision 34c96879396fa1f3f7e3cee350b023fbb8e20c8f (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 34c96879396fa1f3f7e3cee350b023fbb8e20c8f # timeout=10
Commit message: "Merge branch 'main' into feature-cols-categorify"
> git rev-list --no-walk f7c3db141b3a74d74ae59888f268a5259a93d3c5 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins9043349621935770599.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.3 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
108 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module bench.datasets.tools.train_hugectr
bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
|
Click to view CI ResultsGitHub pull request #935 of commit e6536dc85ed06f4d71bee522e0fb7cd564c45fb1, no merge conflicts.
Running as SYSTEM
Setting status of e6536dc85ed06f4d71bee522e0fb7cd564c45fb1 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2814/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse e6536dc85ed06f4d71bee522e0fb7cd564c45fb1^{commit} # timeout=10
Checking out Revision e6536dc85ed06f4d71bee522e0fb7cd564c45fb1 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f e6536dc85ed06f4d71bee522e0fb7cd564c45fb1 # timeout=10
Commit message: "Update nvtabular/ops/categorify.py"
> git rev-list --no-walk 34c96879396fa1f3f7e3cee350b023fbb8e20c8f # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins3304963982174998869.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.3 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
108 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module bench.datasets.tools.train_hugectr
bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
|
|
rerun tests |
Click to view CI ResultsGitHub pull request #935 of commit 4902361e79f0abf2e19dede2ec01adb30f4201e9, no merge conflicts.
Running as SYSTEM
Setting status of 4902361e79f0abf2e19dede2ec01adb30f4201e9 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2816/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse 4902361e79f0abf2e19dede2ec01adb30f4201e9^{commit} # timeout=10
Checking out Revision 4902361e79f0abf2e19dede2ec01adb30f4201e9 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 4902361e79f0abf2e19dede2ec01adb30f4201e9 # timeout=10
Commit message: "Update nvtabular/ops/categorify.py"
> git rev-list --no-walk 4902361e79f0abf2e19dede2ec01adb30f4201e9 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins722899612749464217.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.3 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
108 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module bench.datasets.tools.train_hugectr
bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
|
Co-authored-by: Karl Higley <karlb@nvidia.com>
marcromeyn
force-pushed
the
feature-cols-categorify
branch
from
4902361
to
4d32576
Compare
Click to view CI ResultsGitHub pull request #935 of commit 4d32576175eab491f12be8bd7592166fc9dcbaf8, no merge conflicts.
Running as SYSTEM
Setting status of 4d32576175eab491f12be8bd7592166fc9dcbaf8 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2829/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse 4d32576175eab491f12be8bd7592166fc9dcbaf8^{commit} # timeout=10
Checking out Revision 4d32576175eab491f12be8bd7592166fc9dcbaf8 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 4d32576175eab491f12be8bd7592166fc9dcbaf8 # timeout=10
Commit message: "Addressing PR comments"
> git rev-list --no-walk c8dd7eb2a0de01818574913bb0ed04af58e7f0aa # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins86938168095787545.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
WARNING: You are using pip version 21.0.1; however, version 21.1.3 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Running black --check
All done! ✨ 🍰 ✨
108 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module bench.datasets.tools.train_hugectr
bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
|
Click to view CI ResultsGitHub pull request #935 of commit 3ffc73f7038fc7fdc32657d0fb34e1167516e8aa, no merge conflicts.
Running as SYSTEM
Setting status of 3ffc73f7038fc7fdc32657d0fb34e1167516e8aa to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2830/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse 3ffc73f7038fc7fdc32657d0fb34e1167516e8aa^{commit} # timeout=10
Checking out Revision 3ffc73f7038fc7fdc32657d0fb34e1167516e8aa (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3ffc73f7038fc7fdc32657d0fb34e1167516e8aa # timeout=10
Commit message: "Quick fix to try to make the tests pass"
> git rev-list --no-walk 4d32576175eab491f12be8bd7592166fc9dcbaf8 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins291720411122994120.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'error'
ERROR: Command errored out with exit status 1:
command: /usr/bin/python /usr/local/lib/python3.8/dist-packages/pip/_vendor/pep517/_in_process.py get_requires_for_build_wheel /tmp/tmp42_0mrg8
cwd: /var/jenkins_home/workspace/nvtabular_tests/nvtabular
Complete output (18 lines):
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/pip/_vendor/pep517/_in_process.py", line 280, in
main()
File "/usr/local/lib/python3.8/dist-packages/pip/_vendor/pep517/_in_process.py", line 263, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
File "/usr/local/lib/python3.8/dist-packages/pip/_vendor/pep517/_in_process.py", line 114, in get_requires_for_build_wheel
return hook(config_settings)
File "/usr/local/lib/python3.8/dist-packages/setuptools/build_meta.py", line 154, in get_requires_for_build_wheel
return self._get_build_requires(
File "/usr/local/lib/python3.8/dist-packages/setuptools/build_meta.py", line 135, in _get_build_requires
self.run_setup()
File "/usr/local/lib/python3.8/dist-packages/setuptools/build_meta.py", line 258, in run_setup
super(_BuildMetaLegacyBackend,
File "/usr/local/lib/python3.8/dist-packages/setuptools/build_meta.py", line 150, in run_setup
exec(compile(code, __file__, 'exec'), locals())
File "setup.py", line 56, in
cmdclass = versioneer.get_cmdclass()
AttributeError: module 'versioneer' has no attribute 'get_cmdclass'
----------------------------------------
WARNING: Discarding file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular. Command errored out with exit status 1: /usr/bin/python /usr/local/lib/python3.8/dist-packages/pip/_vendor/pep517/_in_process.py get_requires_for_build_wheel /tmp/tmp42_0mrg8 Check the logs for full command output.
ERROR: Command errored out with exit status 1: /usr/bin/python /usr/local/lib/python3.8/dist-packages/pip/_vendor/pep517/_in_process.py get_requires_for_build_wheel /tmp/tmp42_0mrg8 Check the logs for full command output.
WARNING: You are using pip version 21.0.1; however, version 21.1.3 is available.
You should consider upgrading via the '/usr/bin/python -m pip install --upgrade pip' command.
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins1995729761163832366.sh
|
|
@benfred The build is failing now with |
I a different PR I had to change the cpu CI to work around this (https://github.com/NVIDIA/NVTabular/pull/926/files#diff-f48959cf62357a95aff9d53b6b9cdbbf3aa81317d24eb321c296a7d9fd6866b7R43). I've pushed the same change here to see if it helps |
|
rerun tests |
1 similar comment
|
rerun tests |
Click to view CI ResultsGitHub pull request #935 of commit c5a82bef60fe1d123f389440f5c06ba383c03b9a, no merge conflicts.
Running as SYSTEM
Setting status of c5a82bef60fe1d123f389440f5c06ba383c03b9a to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2845/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse c5a82bef60fe1d123f389440f5c06ba383c03b9a^{commit} # timeout=10
Checking out Revision c5a82bef60fe1d123f389440f5c06ba383c03b9a (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f c5a82bef60fe1d123f389440f5c06ba383c03b9a # timeout=10
Commit message: "Update cpu-ci.yml"
> git rev-list --no-walk 3779be9b16585f589c38fb944304c2ee61a3aac4 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins7111287436070886359.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular-0.5.3+57.gc5a82be
Running black --check
All done! ✨ 🍰 ✨
108 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module bench.datasets.tools.train_hugectr
bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
|
Click to view CI ResultsGitHub pull request #935 of commit 1ef8e4361074cc0a5a3faaaf8ac5efb0326b38f7, no merge conflicts.
Running as SYSTEM
Setting status of 1ef8e4361074cc0a5a3faaaf8ac5efb0326b38f7 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2861/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse 1ef8e4361074cc0a5a3faaaf8ac5efb0326b38f7^{commit} # timeout=10
Checking out Revision 1ef8e4361074cc0a5a3faaaf8ac5efb0326b38f7 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1ef8e4361074cc0a5a3faaaf8ac5efb0326b38f7 # timeout=10
Commit message: "Update nvtabular/ops/categorify.py"
> git rev-list --no-walk e1595564fabec0c6f8756584c85cb18a20644485 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins1311705690513581580.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular-0.5.3+58.g1ef8e43
Running black --check
All done! ✨ 🍰 ✨
108 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module bench.datasets.tools.train_hugectr
bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
|
Click to view CI ResultsGitHub pull request #935 of commit 55e5ca947fe08fc27c246d5f6f7dcc24b43762f5, no merge conflicts.
Running as SYSTEM
Setting status of 55e5ca947fe08fc27c246d5f6f7dcc24b43762f5 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2865/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse 55e5ca947fe08fc27c246d5f6f7dcc24b43762f5^{commit} # timeout=10
Checking out Revision 55e5ca947fe08fc27c246d5f6f7dcc24b43762f5 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 55e5ca947fe08fc27c246d5f6f7dcc24b43762f5 # timeout=10
Commit message: "Merge branch 'main' into feature-cols-categorify"
> git rev-list --no-walk e1595564fabec0c6f8756584c85cb18a20644485 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins4922912435786826593.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.1.3)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (57.4.0)
Requirement already satisfied: wheel in /usr/local/lib/python3.8/dist-packages (0.36.2)
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Requirement already satisfied: pyarrow in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+60.g55e5ca9) (1.0.1)
Requirement already satisfied: distributed==2021.4.1 in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+60.g55e5ca9) (2021.4.1)
Requirement already satisfied: PyYAML>=5.3 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+60.g55e5ca9) (5.4.1)
Requirement already satisfied: numba>=0.53.1 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+60.g55e5ca9) (0.53.1)
Requirement already satisfied: pandas<1.3.0dev0,>=1.0 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+60.g55e5ca9) (1.1.5)
Requirement already satisfied: versioneer in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+60.g55e5ca9) (0.20)
Requirement already satisfied: tdqm in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+60.g55e5ca9) (0.0.1)
Requirement already satisfied: dask==2021.4.1 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+60.g55e5ca9) (2021.4.1)
Requirement already satisfied: fsspec>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+60.g55e5ca9) (2021.6.1)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+60.g55e5ca9) (1.6.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+60.g55e5ca9) (0.11.1)
Requirement already satisfied: partd>=0.3.10 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+60.g55e5ca9) (1.2.0)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+60.g55e5ca9) (2.4.0)
Requirement already satisfied: tornado>=6.0.3 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+60.g55e5ca9) (6.1)
Requirement already satisfied: tblib>=1.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+60.g55e5ca9) (1.7.0)
Requirement already satisfied: psutil>=5.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+60.g55e5ca9) (5.8.0)
Requirement already satisfied: zict>=0.1.3 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+60.g55e5ca9) (2.0.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+60.g55e5ca9) (8.0.1)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+60.g55e5ca9) (1.0.2)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (from distributed==2021.4.1->nvtabular==0.5.3+60.g55e5ca9) (57.4.0)
Requirement already satisfied: llvmlite<0.37,>=0.36.0rc1 in /usr/local/lib/python3.8/dist-packages (from numba>=0.53.1->nvtabular==0.5.3+60.g55e5ca9) (0.36.0)
Requirement already satisfied: numpy>=1.15 in /usr/local/lib/python3.8/dist-packages (from numba>=0.53.1->nvtabular==0.5.3+60.g55e5ca9) (1.20.2)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+60.g55e5ca9) (2.8.1)
Requirement already satisfied: pytz>=2017.2 in /usr/local/lib/python3.8/dist-packages (from pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+60.g55e5ca9) (2021.1)
Requirement already satisfied: locket in /usr/local/lib/python3.8/dist-packages (from partd>=0.3.10->dask==2021.4.1->nvtabular==0.5.3+60.g55e5ca9) (0.2.1)
Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.8/dist-packages (from python-dateutil>=2.7.3->pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+60.g55e5ca9) (1.15.0)
Requirement already satisfied: heapdict in /usr/local/lib/python3.8/dist-packages (from zict>=0.1.3->distributed==2021.4.1->nvtabular==0.5.3+60.g55e5ca9) (1.0.1)
Requirement already satisfied: tqdm in /usr/local/lib/python3.8/dist-packages (from tdqm->nvtabular==0.5.3+60.g55e5ca9) (4.61.2)
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
Running black --check
All done! ✨ 🍰 ✨
108 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module bench.datasets.tools.train_hugectr
bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
|
Click to view CI ResultsGitHub pull request #935 of commit c3f615c853d66cd641df7578bdbb5fa5aa6d1667, no merge conflicts.
Running as SYSTEM
Setting status of c3f615c853d66cd641df7578bdbb5fa5aa6d1667 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2874/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse c3f615c853d66cd641df7578bdbb5fa5aa6d1667^{commit} # timeout=10
Checking out Revision c3f615c853d66cd641df7578bdbb5fa5aa6d1667 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f c3f615c853d66cd641df7578bdbb5fa5aa6d1667 # timeout=10
Commit message: "Merge branch 'main' into feature-cols-categorify"
> git rev-list --no-walk a6739dec03b2670528472355adbf1d16b917eb28 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins5506574157971313495.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.1.3)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (57.4.0)
Requirement already satisfied: wheel in /usr/local/lib/python3.8/dist-packages (0.36.2)
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Requirement already satisfied: tdqm in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+63.gc3f615c) (0.0.1)
Requirement already satisfied: dask==2021.4.1 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+63.gc3f615c) (2021.4.1)
Requirement already satisfied: distributed==2021.4.1 in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+63.gc3f615c) (2021.4.1)
Requirement already satisfied: versioneer in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+63.gc3f615c) (0.20)
Requirement already satisfied: PyYAML>=5.3 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+63.gc3f615c) (5.4.1)
Requirement already satisfied: pandas<1.3.0dev0,>=1.0 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+63.gc3f615c) (1.1.5)
Requirement already satisfied: pyarrow in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+63.gc3f615c) (1.0.1)
Requirement already satisfied: numba>=0.53.1 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+63.gc3f615c) (0.53.1)
Requirement already satisfied: partd>=0.3.10 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+63.gc3f615c) (1.2.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+63.gc3f615c) (1.6.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+63.gc3f615c) (0.11.1)
Requirement already satisfied: fsspec>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+63.gc3f615c) (2021.6.1)
Requirement already satisfied: tblib>=1.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+63.gc3f615c) (1.7.0)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+63.gc3f615c) (1.0.2)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+63.gc3f615c) (2.4.0)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (from distributed==2021.4.1->nvtabular==0.5.3+63.gc3f615c) (57.4.0)
Requirement already satisfied: psutil>=5.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+63.gc3f615c) (5.8.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+63.gc3f615c) (8.0.1)
Requirement already satisfied: zict>=0.1.3 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+63.gc3f615c) (2.0.0)
Requirement already satisfied: tornado>=6.0.3 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+63.gc3f615c) (6.1)
Requirement already satisfied: numpy>=1.15 in /usr/local/lib/python3.8/dist-packages (from numba>=0.53.1->nvtabular==0.5.3+63.gc3f615c) (1.20.2)
Requirement already satisfied: llvmlite<0.37,>=0.36.0rc1 in /usr/local/lib/python3.8/dist-packages (from numba>=0.53.1->nvtabular==0.5.3+63.gc3f615c) (0.36.0)
Requirement already satisfied: pytz>=2017.2 in /usr/local/lib/python3.8/dist-packages (from pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+63.gc3f615c) (2021.1)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+63.gc3f615c) (2.8.1)
Requirement already satisfied: locket in /usr/local/lib/python3.8/dist-packages (from partd>=0.3.10->dask==2021.4.1->nvtabular==0.5.3+63.gc3f615c) (0.2.1)
Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.8/dist-packages (from python-dateutil>=2.7.3->pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+63.gc3f615c) (1.15.0)
Requirement already satisfied: heapdict in /usr/local/lib/python3.8/dist-packages (from zict>=0.1.3->distributed==2021.4.1->nvtabular==0.5.3+63.gc3f615c) (1.0.1)
Requirement already satisfied: tqdm in /usr/local/lib/python3.8/dist-packages (from tdqm->nvtabular==0.5.3+63.gc3f615c) (4.61.2)
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
Running black --check
All done! ✨ 🍰 ✨
109 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module bench.datasets.tools.train_hugectr
bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
|
Click to view CI ResultsGitHub pull request #935 of commit feff50e7ba0870f9fd51c12f7e4957dffdda0b1f, no merge conflicts.
Running as SYSTEM
Setting status of feff50e7ba0870f9fd51c12f7e4957dffdda0b1f to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2884/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse feff50e7ba0870f9fd51c12f7e4957dffdda0b1f^{commit} # timeout=10
Checking out Revision feff50e7ba0870f9fd51c12f7e4957dffdda0b1f (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f feff50e7ba0870f9fd51c12f7e4957dffdda0b1f # timeout=10
Commit message: "Merge branch 'main' into feature-cols-categorify"
> git rev-list --no-walk 04f42e04b4040cc6fe412f6d7cac7d8da5d1db22 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins6034723035166010996.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.1.3)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (57.4.0)
Requirement already satisfied: wheel in /usr/local/lib/python3.8/dist-packages (0.36.2)
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Requirement already satisfied: PyYAML>=5.3 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+65.gfeff50e) (5.4.1)
Requirement already satisfied: distributed==2021.4.1 in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+65.gfeff50e) (2021.4.1)
Requirement already satisfied: pandas<1.3.0dev0,>=1.0 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+65.gfeff50e) (1.1.5)
Requirement already satisfied: numba>=0.53.1 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+65.gfeff50e) (0.53.1)
Requirement already satisfied: dask==2021.4.1 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+65.gfeff50e) (2021.4.1)
Requirement already satisfied: pyarrow in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+65.gfeff50e) (1.0.1)
Requirement already satisfied: versioneer in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+65.gfeff50e) (0.20)
Requirement already satisfied: tdqm in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+65.gfeff50e) (0.0.1)
Requirement already satisfied: fsspec>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+65.gfeff50e) (2021.6.1)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+65.gfeff50e) (1.6.0)
Requirement already satisfied: partd>=0.3.10 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+65.gfeff50e) (1.2.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+65.gfeff50e) (0.11.1)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+65.gfeff50e) (2.4.0)
Requirement already satisfied: tblib>=1.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+65.gfeff50e) (1.7.0)
Requirement already satisfied: psutil>=5.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+65.gfeff50e) (5.8.0)
Requirement already satisfied: zict>=0.1.3 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+65.gfeff50e) (2.0.0)
Requirement already satisfied: tornado>=6.0.3 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+65.gfeff50e) (6.1)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+65.gfeff50e) (1.0.2)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+65.gfeff50e) (8.0.1)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (from distributed==2021.4.1->nvtabular==0.5.3+65.gfeff50e) (57.4.0)
Requirement already satisfied: numpy>=1.15 in /usr/local/lib/python3.8/dist-packages (from numba>=0.53.1->nvtabular==0.5.3+65.gfeff50e) (1.20.2)
Requirement already satisfied: llvmlite<0.37,>=0.36.0rc1 in /usr/local/lib/python3.8/dist-packages (from numba>=0.53.1->nvtabular==0.5.3+65.gfeff50e) (0.36.0)
Requirement already satisfied: pytz>=2017.2 in /usr/local/lib/python3.8/dist-packages (from pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+65.gfeff50e) (2021.1)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+65.gfeff50e) (2.8.1)
Requirement already satisfied: locket in /usr/local/lib/python3.8/dist-packages (from partd>=0.3.10->dask==2021.4.1->nvtabular==0.5.3+65.gfeff50e) (0.2.1)
Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.8/dist-packages (from python-dateutil>=2.7.3->pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+65.gfeff50e) (1.15.0)
Requirement already satisfied: heapdict in /usr/local/lib/python3.8/dist-packages (from zict>=0.1.3->distributed==2021.4.1->nvtabular==0.5.3+65.gfeff50e) (1.0.1)
Requirement already satisfied: tqdm in /usr/local/lib/python3.8/dist-packages (from tdqm->nvtabular==0.5.3+65.gfeff50e) (4.61.2)
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
Running black --check
All done! ✨ 🍰 ✨
109 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module bench.datasets.tools.train_hugectr
bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
|
|
@marcromeyn The unittests are failing here with what looks like an off by one error |
Click to view CI ResultsGitHub pull request #935 of commit f6183acc644a7d041a9bb2ebccd730fb4f81ef9c, has merge conflicts.
Running as SYSTEM
!!! PR mergeability status has changed !!!
PR now has NO merge conflicts
Setting status of f6183acc644a7d041a9bb2ebccd730fb4f81ef9c to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2891/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse f6183acc644a7d041a9bb2ebccd730fb4f81ef9c^{commit} # timeout=10
Checking out Revision f6183acc644a7d041a9bb2ebccd730fb4f81ef9c (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f f6183acc644a7d041a9bb2ebccd730fb4f81ef9c # timeout=10
Commit message: "Fixing prepend in dispatch._add_to_series"
> git rev-list --no-walk 9a86adc67b82f2095ac56823719fbc8e54f66281 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins2068987169614134547.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.1.3)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (57.4.0)
Requirement already satisfied: wheel in /usr/local/lib/python3.8/dist-packages (0.36.2)
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Requirement already satisfied: pandas<1.3.0dev0,>=1.0 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+66.gf6183ac) (1.1.5)
Requirement already satisfied: PyYAML>=5.3 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+66.gf6183ac) (5.4.1)
Requirement already satisfied: distributed==2021.4.1 in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+66.gf6183ac) (2021.4.1)
Requirement already satisfied: versioneer in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+66.gf6183ac) (0.20)
Requirement already satisfied: dask==2021.4.1 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+66.gf6183ac) (2021.4.1)
Requirement already satisfied: pyarrow in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+66.gf6183ac) (1.0.1)
Requirement already satisfied: numba>=0.53.1 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+66.gf6183ac) (0.53.1)
Requirement already satisfied: tdqm in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+66.gf6183ac) (0.0.1)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+66.gf6183ac) (0.11.1)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+66.gf6183ac) (1.6.0)
Requirement already satisfied: fsspec>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+66.gf6183ac) (2021.6.1)
Requirement already satisfied: partd>=0.3.10 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+66.gf6183ac) (1.2.0)
Requirement already satisfied: tblib>=1.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+66.gf6183ac) (1.7.0)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+66.gf6183ac) (2.4.0)
Requirement already satisfied: tornado>=6.0.3 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+66.gf6183ac) (6.1)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+66.gf6183ac) (8.0.1)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (from distributed==2021.4.1->nvtabular==0.5.3+66.gf6183ac) (57.4.0)
Requirement already satisfied: zict>=0.1.3 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+66.gf6183ac) (2.0.0)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+66.gf6183ac) (1.0.2)
Requirement already satisfied: psutil>=5.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+66.gf6183ac) (5.8.0)
Requirement already satisfied: llvmlite<0.37,>=0.36.0rc1 in /usr/local/lib/python3.8/dist-packages (from numba>=0.53.1->nvtabular==0.5.3+66.gf6183ac) (0.36.0)
Requirement already satisfied: numpy>=1.15 in /usr/local/lib/python3.8/dist-packages (from numba>=0.53.1->nvtabular==0.5.3+66.gf6183ac) (1.20.2)
Requirement already satisfied: pytz>=2017.2 in /usr/local/lib/python3.8/dist-packages (from pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+66.gf6183ac) (2021.1)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+66.gf6183ac) (2.8.1)
Requirement already satisfied: locket in /usr/local/lib/python3.8/dist-packages (from partd>=0.3.10->dask==2021.4.1->nvtabular==0.5.3+66.gf6183ac) (0.2.1)
Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.8/dist-packages (from python-dateutil>=2.7.3->pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+66.gf6183ac) (1.15.0)
Requirement already satisfied: heapdict in /usr/local/lib/python3.8/dist-packages (from zict>=0.1.3->distributed==2021.4.1->nvtabular==0.5.3+66.gf6183ac) (1.0.1)
Requirement already satisfied: tqdm in /usr/local/lib/python3.8/dist-packages (from tdqm->nvtabular==0.5.3+66.gf6183ac) (4.61.2)
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
Running black --check
All done! ✨ 🍰 ✨
109 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module bench.datasets.tools.train_hugectr
bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
|
Click to view CI ResultsGitHub pull request #935 of commit 456607ae4dbbeb1d348c9a005ea253141c1a6f33, no merge conflicts.
Running as SYSTEM
Setting status of 456607ae4dbbeb1d348c9a005ea253141c1a6f33 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2892/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse 456607ae4dbbeb1d348c9a005ea253141c1a6f33^{commit} # timeout=10
Checking out Revision 456607ae4dbbeb1d348c9a005ea253141c1a6f33 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 456607ae4dbbeb1d348c9a005ea253141c1a6f33 # timeout=10
Commit message: "Merge branch 'main' into feature-cols-categorify"
> git rev-list --no-walk f6183acc644a7d041a9bb2ebccd730fb4f81ef9c # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins5500282410223543448.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.1.3)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (57.4.0)
Requirement already satisfied: wheel in /usr/local/lib/python3.8/dist-packages (0.36.2)
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Requirement already satisfied: versioneer in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+68.g456607a) (0.20)
Requirement already satisfied: PyYAML>=5.3 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+68.g456607a) (5.4.1)
Requirement already satisfied: distributed==2021.4.1 in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+68.g456607a) (2021.4.1)
Requirement already satisfied: numba>=0.53.1 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+68.g456607a) (0.53.1)
Requirement already satisfied: tdqm in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+68.g456607a) (0.0.1)
Requirement already satisfied: pandas<1.3.0dev0,>=1.0 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+68.g456607a) (1.1.5)
Requirement already satisfied: dask==2021.4.1 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+68.g456607a) (2021.4.1)
Requirement already satisfied: pyarrow in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+68.g456607a) (1.0.1)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+68.g456607a) (1.6.0)
Requirement already satisfied: partd>=0.3.10 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+68.g456607a) (1.2.0)
Requirement already satisfied: fsspec>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+68.g456607a) (2021.6.1)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+68.g456607a) (0.11.1)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+68.g456607a) (1.0.2)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+68.g456607a) (2.4.0)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (from distributed==2021.4.1->nvtabular==0.5.3+68.g456607a) (57.4.0)
Requirement already satisfied: tornado>=6.0.3 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+68.g456607a) (6.1)
Requirement already satisfied: psutil>=5.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+68.g456607a) (5.8.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+68.g456607a) (8.0.1)
Requirement already satisfied: tblib>=1.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+68.g456607a) (1.7.0)
Requirement already satisfied: zict>=0.1.3 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+68.g456607a) (2.0.0)
Requirement already satisfied: llvmlite<0.37,>=0.36.0rc1 in /usr/local/lib/python3.8/dist-packages (from numba>=0.53.1->nvtabular==0.5.3+68.g456607a) (0.36.0)
Requirement already satisfied: numpy>=1.15 in /usr/local/lib/python3.8/dist-packages (from numba>=0.53.1->nvtabular==0.5.3+68.g456607a) (1.20.2)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+68.g456607a) (2.8.1)
Requirement already satisfied: pytz>=2017.2 in /usr/local/lib/python3.8/dist-packages (from pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+68.g456607a) (2021.1)
Requirement already satisfied: locket in /usr/local/lib/python3.8/dist-packages (from partd>=0.3.10->dask==2021.4.1->nvtabular==0.5.3+68.g456607a) (0.2.1)
Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.8/dist-packages (from python-dateutil>=2.7.3->pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+68.g456607a) (1.15.0)
Requirement already satisfied: heapdict in /usr/local/lib/python3.8/dist-packages (from zict>=0.1.3->distributed==2021.4.1->nvtabular==0.5.3+68.g456607a) (1.0.1)
Requirement already satisfied: tqdm in /usr/local/lib/python3.8/dist-packages (from tdqm->nvtabular==0.5.3+68.g456607a) (4.61.2)
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
Running black --check
All done! ✨ 🍰 ✨
109 files would be left unchanged.
Running flake8
./nvtabular/ops/categorify.py:37:1: F401 'nvtabular.dispatch._arange' imported but unused
./nvtabular/ops/categorify.py:37:1: F401 'nvtabular.dispatch._encode_list_column' imported but unused
./nvtabular/ops/categorify.py:37:1: F401 'nvtabular.dispatch._flatten_list_column' imported but unused
./nvtabular/ops/categorify.py:37:1: F401 'nvtabular.dispatch._from_host' imported but unused
./nvtabular/ops/categorify.py:37:1: F401 'nvtabular.dispatch._hash_series' imported but unused
./nvtabular/ops/categorify.py:37:1: F401 'nvtabular.dispatch._is_list_dtype' imported but unused
./nvtabular/ops/categorify.py:37:1: F401 'nvtabular.dispatch._parquet_writer_dispatch' imported but unused
./nvtabular/ops/categorify.py:37:1: F401 'nvtabular.dispatch._read_parquet_dispatch' imported but unused
./nvtabular/ops/categorify.py:37:1: F401 'nvtabular.dispatch._series_has_nulls' imported but unused
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins628072434382999635.sh
|
|
rerun tests |
Click to view CI ResultsGitHub pull request #935 of commit 419b07f18b99926b9227a14a483b21758dbb4cae, no merge conflicts.
Running as SYSTEM
Setting status of 419b07f18b99926b9227a14a483b21758dbb4cae to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2895/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse 419b07f18b99926b9227a14a483b21758dbb4cae^{commit} # timeout=10
Checking out Revision 419b07f18b99926b9227a14a483b21758dbb4cae (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 419b07f18b99926b9227a14a483b21758dbb4cae # timeout=10
Commit message: "Fixing flake8"
> git rev-list --no-walk 49044acc44eb8f7e64e2ba31509bbd363c6cf6e6 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins1907607570036027871.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.1.3)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (57.4.0)
Requirement already satisfied: wheel in /usr/local/lib/python3.8/dist-packages (0.36.2)
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Requirement already satisfied: dask==2021.4.1 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+69.g419b07f) (2021.4.1)
Requirement already satisfied: distributed==2021.4.1 in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+69.g419b07f) (2021.4.1)
Requirement already satisfied: pyarrow in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+69.g419b07f) (1.0.1)
Requirement already satisfied: PyYAML>=5.3 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+69.g419b07f) (5.4.1)
Requirement already satisfied: tdqm in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+69.g419b07f) (0.0.1)
Requirement already satisfied: versioneer in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+69.g419b07f) (0.20)
Requirement already satisfied: pandas<1.3.0dev0,>=1.0 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+69.g419b07f) (1.1.5)
Requirement already satisfied: numba>=0.53.1 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+69.g419b07f) (0.53.1)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+69.g419b07f) (1.6.0)
Requirement already satisfied: fsspec>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+69.g419b07f) (2021.6.1)
Requirement already satisfied: partd>=0.3.10 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+69.g419b07f) (1.2.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+69.g419b07f) (0.11.1)
Requirement already satisfied: tornado>=6.0.3 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (6.1)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (8.0.1)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (1.0.2)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (2.4.0)
Requirement already satisfied: tblib>=1.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (1.7.0)
Requirement already satisfied: zict>=0.1.3 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (2.0.0)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (from distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (57.4.0)
Requirement already satisfied: psutil>=5.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (5.8.0)
Requirement already satisfied: numpy>=1.15 in /usr/local/lib/python3.8/dist-packages (from numba>=0.53.1->nvtabular==0.5.3+69.g419b07f) (1.20.2)
Requirement already satisfied: llvmlite<0.37,>=0.36.0rc1 in /usr/local/lib/python3.8/dist-packages (from numba>=0.53.1->nvtabular==0.5.3+69.g419b07f) (0.36.0)
Requirement already satisfied: pytz>=2017.2 in /usr/local/lib/python3.8/dist-packages (from pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+69.g419b07f) (2021.1)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+69.g419b07f) (2.8.1)
Requirement already satisfied: locket in /usr/local/lib/python3.8/dist-packages (from partd>=0.3.10->dask==2021.4.1->nvtabular==0.5.3+69.g419b07f) (0.2.1)
Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.8/dist-packages (from python-dateutil>=2.7.3->pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+69.g419b07f) (1.15.0)
Requirement already satisfied: heapdict in /usr/local/lib/python3.8/dist-packages (from zict>=0.1.3->distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (1.0.1)
Requirement already satisfied: tqdm in /usr/local/lib/python3.8/dist-packages (from tdqm->nvtabular==0.5.3+69.g419b07f) (4.61.2)
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
Running black --check
All done! ✨ 🍰 ✨
109 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module nvtabular.ops.categorify
nvtabular/ops/categorify.py:459:15: I1101: Module 'nvtabular_cpp' has no 'inference' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
************* Module nvtabular.ops.fill
nvtabular/ops/fill.py:66:15: I1101: Module 'nvtabular_cpp' has no 'inference' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
************* Module bench.datasets.tools.train_hugectr
bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
|
Click to view CI ResultsGitHub pull request #935 of commit 419b07f18b99926b9227a14a483b21758dbb4cae, no merge conflicts.
Running as SYSTEM
Setting status of 419b07f18b99926b9227a14a483b21758dbb4cae to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2896/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse 419b07f18b99926b9227a14a483b21758dbb4cae^{commit} # timeout=10
Checking out Revision 419b07f18b99926b9227a14a483b21758dbb4cae (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 419b07f18b99926b9227a14a483b21758dbb4cae # timeout=10
Commit message: "Fixing flake8"
> git rev-list --no-walk 419b07f18b99926b9227a14a483b21758dbb4cae # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins2269438400353680660.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.1.3)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (57.4.0)
Requirement already satisfied: wheel in /usr/local/lib/python3.8/dist-packages (0.36.2)
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Requirement already satisfied: tdqm in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+69.g419b07f) (0.0.1)
Requirement already satisfied: numba>=0.53.1 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+69.g419b07f) (0.53.1)
Requirement already satisfied: pyarrow in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+69.g419b07f) (1.0.1)
Requirement already satisfied: pandas<1.3.0dev0,>=1.0 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+69.g419b07f) (1.1.5)
Requirement already satisfied: distributed==2021.4.1 in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+69.g419b07f) (2021.4.1)
Requirement already satisfied: dask==2021.4.1 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+69.g419b07f) (2021.4.1)
Requirement already satisfied: versioneer in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==0.5.3+69.g419b07f) (0.20)
Requirement already satisfied: PyYAML>=5.3 in /usr/local/lib/python3.8/dist-packages (from nvtabular==0.5.3+69.g419b07f) (5.4.1)
Requirement already satisfied: partd>=0.3.10 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+69.g419b07f) (1.2.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+69.g419b07f) (1.6.0)
Requirement already satisfied: fsspec>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+69.g419b07f) (2021.6.1)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask==2021.4.1->nvtabular==0.5.3+69.g419b07f) (0.11.1)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (1.0.2)
Requirement already satisfied: tblib>=1.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (1.7.0)
Requirement already satisfied: psutil>=5.0 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (5.8.0)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (from distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (57.4.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (8.0.1)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (2.4.0)
Requirement already satisfied: zict>=0.1.3 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (2.0.0)
Requirement already satisfied: tornado>=6.0.3 in /usr/local/lib/python3.8/dist-packages (from distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (6.1)
Requirement already satisfied: numpy>=1.15 in /usr/local/lib/python3.8/dist-packages (from numba>=0.53.1->nvtabular==0.5.3+69.g419b07f) (1.20.2)
Requirement already satisfied: llvmlite<0.37,>=0.36.0rc1 in /usr/local/lib/python3.8/dist-packages (from numba>=0.53.1->nvtabular==0.5.3+69.g419b07f) (0.36.0)
Requirement already satisfied: pytz>=2017.2 in /usr/local/lib/python3.8/dist-packages (from pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+69.g419b07f) (2021.1)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+69.g419b07f) (2.8.1)
Requirement already satisfied: locket in /usr/local/lib/python3.8/dist-packages (from partd>=0.3.10->dask==2021.4.1->nvtabular==0.5.3+69.g419b07f) (0.2.1)
Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.8/dist-packages (from python-dateutil>=2.7.3->pandas<1.3.0dev0,>=1.0->nvtabular==0.5.3+69.g419b07f) (1.15.0)
Requirement already satisfied: heapdict in /usr/local/lib/python3.8/dist-packages (from zict>=0.1.3->distributed==2021.4.1->nvtabular==0.5.3+69.g419b07f) (1.0.1)
Requirement already satisfied: tqdm in /usr/local/lib/python3.8/dist-packages (from tdqm->nvtabular==0.5.3+69.g419b07f) (4.61.2)
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
Running black --check
All done! ✨ 🍰 ✨
109 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
Running bandit
Running pylint
************* Module nvtabular.ops.categorify
nvtabular/ops/categorify.py:459:15: I1101: Module 'nvtabular_cpp' has no 'inference' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
************* Module nvtabular.ops.fill
nvtabular/ops/fill.py:66:15: I1101: Module 'nvtabular_cpp' has no 'inference' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
************* Module bench.datasets.tools.train_hugectr
bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
|
Click to view CI ResultsGitHub pull request #935 of commit ad2f61efc5e7c2c0ecb9b89a32664c43c768d0af, no merge conflicts.
Running as SYSTEM
Setting status of ad2f61efc5e7c2c0ecb9b89a32664c43c768d0af to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2902/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse ad2f61efc5e7c2c0ecb9b89a32664c43c768d0af^{commit} # timeout=10
Checking out Revision ad2f61efc5e7c2c0ecb9b89a32664c43c768d0af (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f ad2f61efc5e7c2c0ecb9b89a32664c43c768d0af # timeout=10
Commit message: "Merge branch 'main' into feature-cols-categorify"
> git rev-list --no-walk deed53a14aead05524deeb50fd45ba75523b07ba # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins3664444352533196477.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.1.3)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (57.4.0)
Requirement already satisfied: wheel in /usr/local/lib/python3.8/dist-packages (0.36.2)
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'error'
ERROR: Command errored out with exit status 1:
command: /usr/bin/python /var/jenkins_home/.local/lib/python3.8/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmpayr2gb3d
cwd: /var/jenkins_home/workspace/nvtabular_tests/nvtabular
Complete output (16 lines):
Traceback (most recent call last):
File "/var/jenkins_home/.local/lib/python3.8/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 280, in
main()
File "/var/jenkins_home/.local/lib/python3.8/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 263, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
File "/var/jenkins_home/.local/lib/python3.8/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 114, in get_requires_for_build_wheel
return hook(config_settings)
File "/usr/local/lib/python3.8/dist-packages/setuptools/build_meta.py", line 154, in get_requires_for_build_wheel
return self._get_build_requires(
File "/usr/local/lib/python3.8/dist-packages/setuptools/build_meta.py", line 135, in _get_build_requires
self.run_setup()
File "/usr/local/lib/python3.8/dist-packages/setuptools/build_meta.py", line 150, in run_setup
exec(compile(code, __file__, 'exec'), locals())
File "setup.py", line 66, in
define_macros=[("VERSION_INFO", versioneer.get_version())],
AttributeError: module 'versioneer' has no attribute 'get_version'
----------------------------------------
WARNING: Discarding file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular. Command errored out with exit status 1: /usr/bin/python /var/jenkins_home/.local/lib/python3.8/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmpayr2gb3d Check the logs for full command output.
ERROR: Command errored out with exit status 1: /usr/bin/python /var/jenkins_home/.local/lib/python3.8/site-packages/pip/_vendor/pep517/in_process/_in_process.py get_requires_for_build_wheel /tmp/tmpayr2gb3d Check the logs for full command output.
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins817958748879255520.sh
|
Click to view CI ResultsGitHub pull request #935 of commit e4cf7089ffbabdd33fc49a2c19c46123c3b524d0, no merge conflicts.
Running as SYSTEM
Setting status of e4cf7089ffbabdd33fc49a2c19c46123c3b524d0 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2916/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse e4cf7089ffbabdd33fc49a2c19c46123c3b524d0^{commit} # timeout=10
Checking out Revision e4cf7089ffbabdd33fc49a2c19c46123c3b524d0 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f e4cf7089ffbabdd33fc49a2c19c46123c3b524d0 # timeout=10
Commit message: "Merge branch 'main' into feature-cols-categorify"
> git rev-list --no-walk 40ccda0b43ac0bdfb3fc79837f66d7276fddcc77 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins8599164028311122005.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.1.3)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (57.4.0)
Requirement already satisfied: wheel in /usr/local/lib/python3.8/dist-packages (0.36.2)
Requirement already satisfied: pybind11 in /var/jenkins_home/.local/lib/python3.8/site-packages (2.7.0)
running develop
running egg_info
creating nvtabular.egg-info
writing nvtabular.egg-info/PKG-INFO
writing dependency_links to nvtabular.egg-info/dependency_links.txt
writing requirements to nvtabular.egg-info/requires.txt
writing top-level names to nvtabular.egg-info/top_level.txt
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE'
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
running build_ext
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.8 -c flagcheck.cpp -o flagcheck.o -std=c++17
building 'nvtabular_cpp' extension
creating build
creating build/temp.linux-x86_64-3.8
creating build/temp.linux-x86_64-3.8/cpp
creating build/temp.linux-x86_64-3.8/cpp/nvtabular
creating build/temp.linux-x86_64-3.8/cpp/nvtabular/inference
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.5.3+73.ge4cf708 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.5.3+73.ge4cf708 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.5.3+73.ge4cf708 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/categorify.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.5.3+73.ge4cf708 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/fill.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -std=c++17 -fvisibility=hidden -g0
creating build/lib.linux-x86_64-3.8
x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -o build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so
copying build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so ->
Creating /var/jenkins_home/.local/lib/python3.8/site-packages/nvtabular.egg-link (link to .)
nvtabular 0.5.3+73.ge4cf708 is already the active version in easy-install.pth
|
Click to view CI ResultsGitHub pull request #935 of commit 11f5b0379ff6074590a18147d6732f1644d1ca21, no merge conflicts.
Running as SYSTEM
Setting status of 11f5b0379ff6074590a18147d6732f1644d1ca21 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/2918/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/935/*:refs/remotes/origin/pr/935/* # timeout=10
> git rev-parse 11f5b0379ff6074590a18147d6732f1644d1ca21^{commit} # timeout=10
Checking out Revision 11f5b0379ff6074590a18147d6732f1644d1ca21 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 11f5b0379ff6074590a18147d6732f1644d1ca21 # timeout=10
Commit message: "Fix to match frequency sorting categorify changes"
> git rev-list --no-walk c4d3124cdebfa8d674b600f95ecff529443eecb0 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins4765283923681026855.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.1.3)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (57.4.0)
Requirement already satisfied: wheel in /usr/local/lib/python3.8/dist-packages (0.36.2)
Requirement already satisfied: pybind11 in /var/jenkins_home/.local/lib/python3.8/site-packages (2.7.0)
running develop
running egg_info
creating nvtabular.egg-info
writing nvtabular.egg-info/PKG-INFO
writing dependency_links to nvtabular.egg-info/dependency_links.txt
writing requirements to nvtabular.egg-info/requires.txt
writing top-level names to nvtabular.egg-info/top_level.txt
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE'
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
running build_ext
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.8 -c flagcheck.cpp -o flagcheck.o -std=c++17
building 'nvtabular_cpp' extension
creating build
creating build/temp.linux-x86_64-3.8
creating build/temp.linux-x86_64-3.8/cpp
creating build/temp.linux-x86_64-3.8/cpp/nvtabular
creating build/temp.linux-x86_64-3.8/cpp/nvtabular/inference
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.5.3+74.g11f5b03 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.5.3+74.g11f5b03 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.5.3+74.g11f5b03 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/categorify.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.5.3+74.g11f5b03 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/fill.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -std=c++17 -fvisibility=hidden -g0
creating build/lib.linux-x86_64-3.8
x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -o build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so
copying build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so ->
Creating /var/jenkins_home/.local/lib/python3.8/site-packages/nvtabular.egg-link (link to .)
nvtabular 0.5.3+74.g11f5b03 is already the active version in easy-install.pth
|
| @@ -227,7 +226,7 @@ def _get_parents(column): | |||
| features += features_replaced_buckets | |||
|
|
|||
| if len(categorifies) > 0: | |||
| features += categorifies.keys() >> Categorify() | |||
| features += categorifies.keys() >> Categorify(vocabs=pd.DataFrame(categorifies)) | |||
There was a problem hiding this comment.
This line fails if features have vocabularies of varying size. In particular, the sample notebook "using-feature-columns.ipynb" fails on this line with the following error. Am I missing anything, or this is a bug here?
I used docker image "merlin-tensorflow-training" that had nvtabular 0.6.1 installed.
---------------------------------------------------------------------------
ValueError Traceback (most recent call last)
/tmp/ipykernel_783/4041583971.py in <module>
----> 1 online_workflow, feature_columns = make_feature_column_workflow(feature_columns, "AdoptionSpeed")
/nvtabular/nvtabular/framework_utils/tensorflow/feature_column_utils.py in make_feature_column_workflow(feature_columns, label_name, category_dir)
227
228 if len(categorifies) > 0:
--> 229 features += categorifies.keys() >> Categorify(vocabs=pd.DataFrame(categorifies))
230
231 if len(hashes) > 0:
/usr/local/lib/python3.8/dist-packages/pandas/core/frame.py in __init__(self, data, index, columns, dtype, copy)
466
467 elif isinstance(data, dict):
--> 468 mgr = init_dict(data, index, columns, dtype=dtype)
469 elif isinstance(data, ma.MaskedArray):
470 import numpy.ma.mrecords as mrecords
/usr/local/lib/python3.8/dist-packages/pandas/core/internals/construction.py in init_dict(data, index, columns, dtype)
281 arr if not is_datetime64tz_dtype(arr) else arr.copy() for arr in arrays
282 ]
--> 283 return arrays_to_mgr(arrays, data_names, index, columns, dtype=dtype)
284
285
/usr/local/lib/python3.8/dist-packages/pandas/core/internals/construction.py in arrays_to_mgr(arrays, arr_names, index, columns, dtype, verify_integrity)
76 # figure out the index, if necessary
77 if index is None:
---> 78 index = extract_index(arrays)
79 else:
80 index = ensure_index(index)
/usr/local/lib/python3.8/dist-packages/pandas/core/internals/construction.py in extract_index(data)
395 lengths = list(set(raw_lengths))
396 if len(lengths) > 1:
--> 397 raise ValueError("arrays must all be same length")
398
399 if have_dicts:
ValueError: arrays must all be same length
There was a problem hiding this comment.
Thoughts on how to handle this @marcromeyn?
There was a problem hiding this comment.
Thanks for reporting! That looks like a bug to me - I opened #1062 to track
Allow to pass in vocabs in Categorify to fix make_feature_column_workflow
This also fixes #763.