Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Avoid --find-links in wheel jobs #1586

Merged
merged 9 commits into from
Jun 24, 2024

Conversation

jameslamb
Copy link
Member

@jameslamb jameslamb commented Jun 18, 2024

Description

Contributes to rapidsai/build-planning#69.

Proposes a stricter pattern for passing a librmm wheel from the wheel-build-cpp job that produced it into the wheel-build-python job wanting to use it (as a build dependency of rmm). This change improves the likelihood that issues with the librmm wheels will be caught in CI.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

Notes for Reviewers

How I tested this

  1. Added unsatisfiable requirements setuptools<65, setuptools>66 to the librmm wheel (this commit).

  2. With no changes to the build scripts here, saw CI happily ignore that and succeed despite that issue: (build link).

  3. Switched to the approach documented in Remove uses of 'pip --find-links' in CI build-planning#69 (comment), saw CI fail in the expected way (build link)

  Processing /tmp/librmm_dist/librmm_cu12-24.8.0a24-py3-none-any.whl

    ...

  ERROR: Cannot install librmm-cu12==24.8.0a24 because these package versions have conflicting dependencies.

  The conflict is caused by:
      librmm-cu12 24.8.0a24 depends on setuptools<65
      librmm-cu12 24.8.0a24 depends on setuptools>66

    ...

  ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts

@jameslamb jameslamb added the 2 - In Progress Currently a work in progress label Jun 18, 2024
@github-actions github-actions bot added Python Related to RMM Python API ci labels Jun 18, 2024
@github-actions github-actions bot removed the Python Related to RMM Python API label Jun 18, 2024
@jameslamb jameslamb added non-breaking Non-breaking change improvement Improvement / enhancement to an existing function labels Jun 18, 2024
@jameslamb jameslamb changed the title WIP: Avoid --find-links in wheel jobs Avoid --find-links in wheel jobs Jun 18, 2024
@jameslamb jameslamb marked this pull request as ready for review June 18, 2024 22:09
@jameslamb jameslamb requested a review from a team as a code owner June 18, 2024 22:09
@jameslamb jameslamb requested a review from bdice June 18, 2024 22:09
@jameslamb jameslamb requested a review from vyasr June 18, 2024 22:09
@jameslamb jameslamb added 3 - Ready for review Ready for review by team and removed 2 - In Progress Currently a work in progress labels Jun 24, 2024
@jameslamb jameslamb removed the 3 - Ready for review Ready for review by team label Jun 24, 2024
@jameslamb
Copy link
Member Author

Thanks for taking a look @vyasr !

@jameslamb
Copy link
Member Author

/merge

@rapids-bot rapids-bot bot merged commit 1ab4920 into rapidsai:branch-24.08 Jun 24, 2024
57 checks passed
@jameslamb jameslamb deleted the stricter-wheel-passing branch June 24, 2024 17:41
rapids-bot bot pushed a commit to rapidsai/kvikio that referenced this pull request Jul 3, 2024
Contributes to rapidsai/build-planning#69.

Proposes a stricter pattern for passing a `libkvikio` wheel from the `wheel-build-cpp` job that produced it into the `wheel-build-python` job wanting to use it (as a build dependency of `kvikio`). This change improves the likelihood that issues with the `libkivkio` wheels will be caught in CI.

## Notes for Reviewers

See rapidsai/rmm#1586 and rapidsai/build-planning#69 (comment) for details on how I tested this approach.

I didn't propose this on #369 because I hadn't quite finished testing the approach yet. But I do think we should do this for all of the C++ wheels (rapidsai/build-planning#33).

Authors:
  - James Lamb (https://github.com/jameslamb)

Approvers:
  - Mike Sarahan (https://github.com/msarahan)

URL: #397
rapids-bot bot pushed a commit to rapidsai/cugraph that referenced this pull request Jul 3, 2024
Contributes to rapidsai/build-planning#69
Contributes to rapidsai/build-planning#33

Proposes a stricter pattern for passing a `pylibcugraph` wheel from the `wheel-build-cpp` job that produced it into the `wheel-build-python` job wanting to use it (as a build dependency of `cugraph`). This change improves the likelihood that issues with the `pylibcugraph` wheels will be caught in CI.

## Notes for Reviewers

See rapidsai/rmm#1586 and rapidsai/build-planning#69 (comment) for details on how I tested this approach.

Authors:
  - James Lamb (https://github.com/jameslamb)

Approvers:
  - Mike Sarahan (https://github.com/msarahan)

URL: #4509
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci improvement Improvement / enhancement to an existing function non-breaking Non-breaking change
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants