Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Downgrade to Arrow 12.0.0 for aws-sdk-cpp and fix cudf_kafka builds for new CI containers #14296

Merged
merged 18 commits into from
Oct 19, 2023
Merged

Downgrade to Arrow 12.0.0 for aws-sdk-cpp and fix cudf_kafka builds for new CI containers #14296

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
3e8be1c
Temporarily add hard pins of a specific arrow build
vyasr Oct 18, 2023
985313f
Fix pinnings
vyasr Oct 18, 2023
2d1b406
Fix recipe
vyasr Oct 18, 2023
ff8a5b1
Fix build version
vyasr Oct 18, 2023
f98c903
Also fix dependencies.yaml
vyasr Oct 18, 2023
116c82c
Run dfg
vyasr Oct 18, 2023
c4e1a82
Specify libarrow dependency in the docs env as well
vyasr Oct 18, 2023
415bfbe
Add cuda-gdb to CUDA 12 requirements for cudf-kafka
vyasr Oct 18, 2023
b7431c3
Merge remote-tracking branch 'origin/branch-23.12' into fix/arrow_aws…
vyasr Oct 18, 2023
fb5e921
Make sure cuda.h is installed and patch path during conda build
vyasr Oct 19, 2023
240362b
Add some comments and clean up
vyasr Oct 19, 2023
05ece0a
Fix copyright
vyasr Oct 19, 2023
7691e0c
Merge branch 'branch-23.12' into fix/arrow_aws_pinning
vyasr Oct 19, 2023
f5a4e63
Only set CUDA_HOME for CUDA 12 builds
vyasr Oct 19, 2023
0b5bab4
Put back build command...
vyasr Oct 19, 2023
68818b2
Make sure RAPIDS_CUDA_VERSION is available in the build environment
vyasr Oct 19, 2023
ff6fe4a
Downgrade to arrow 12.0.0
vyasr Oct 19, 2023
0ffc3e7
Add one more comment
vyasr Oct 19, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion conda/environments/all_cuda-118_arch-x86_64.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ dependencies:
- hypothesis
- identify>=2.5.20
- ipython
- libarrow==12.0.1.*
- libarrow==12.0.1.*=hb6645e0_10_cpu
bdice marked this conversation as resolved.
Show resolved Hide resolved
- libcufile-dev=1.4.0.31
- libcufile=1.4.0.31
- libcurand-dev=10.3.0.86
Expand Down
2 changes: 1 addition & 1 deletion conda/environments/all_cuda-120_arch-x86_64.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ dependencies:
- hypothesis
- identify>=2.5.20
- ipython
- libarrow==12.0.1.*
- libarrow==12.0.1.*=hb6645e0_10_cpu
- libcufile-dev
- libcurand-dev
- libkvikio==23.12.*
Expand Down
2 changes: 1 addition & 1 deletion conda/recipes/libcudf/conda_build_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ aws_sdk_cpp_version:
- "<1.11"

libarrow_version:
- "=12"
- "==12.0.1.*=hb6645e0_10_cpu"
bdice marked this conversation as resolved.
Show resolved Hide resolved

dlpack_version:
- ">=0.5,<0.6.0a0"
Expand Down
6 changes: 4 additions & 2 deletions dependencies.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -225,7 +225,9 @@ dependencies:
- &gmock gmock>=1.13.0
# Hard pin the patch version used during the build. This must be kept
# in sync with the version pinned in get_arrow.cmake.
- libarrow==12.0.1.*
# Temporarily building a specific build string in order to choose one
# that is compatible with the aws-sdk-cpp version required above
vyasr marked this conversation as resolved.
Show resolved Hide resolved
- libarrow==12.0.1.*=hb6645e0_10_cpu
vyasr marked this conversation as resolved.
Show resolved Hide resolved
- librdkafka>=1.9.0,<1.10.0a0
# Align nvcomp version with rapids-cmake
- nvcomp==2.6.1
Expand Down Expand Up @@ -263,7 +265,7 @@ dependencies:
- output_types: [conda, requirements]
packages:
# Allow runtime version to float up to minor version
- libarrow==12.*
- libarrow==12.0.1.*=hb6645e0_10_cpu
bdice marked this conversation as resolved.
Show resolved Hide resolved
pyarrow_run:
common:
- output_types: [conda, requirements, pyproject]
Expand Down
Loading