Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(ci): install python dependencies with --only-binary :all: in manylinux #6120

Merged
merged 2 commits into from
May 4, 2024

Conversation

mayeut
Copy link
Contributor

@mayeut mayeut commented May 2, 2024

Description

Only install python dependencies from wheels in manylinux.

Motivation and Context

The latest version of google-re2 dropped support for manylinux2014.
google-re2 fails to build from sources thus failing the Linux release pipelines.

This PR forces installation from wheels on manylinux which thus fallback on the latest version of google-re2 with a wheel for manylinux2014.

Another solution would be to bump the manylinux images to manylinux_2_28 but that could have impact on downstream users (e.g. impossible to install wheel from rh7, amazon linux 2, ubuntu 18.04).

@mayeut mayeut requested a review from a team as a code owner May 2, 2024 06:08
Copy link

codecov bot commented May 2, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 57.04%. Comparing base (83194ed) to head (340cc0d).
Report is 27 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #6120      +/-   ##
==========================================
+ Coverage   56.95%   57.04%   +0.08%     
==========================================
  Files         506      506              
  Lines       30467    30935     +468     
  Branches     4592     4592              
==========================================
+ Hits        17353    17646     +293     
- Misses      12285    12463     +178     
+ Partials      829      826       -3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@mayeut mayeut marked this pull request as draft May 2, 2024 06:18
…nylinux

Signed-off-by: mayeut <mayeut@users.noreply.github.com>
@cjvolzka cjvolzka mentioned this pull request May 2, 2024
@justinchuby justinchuby added the run release CIs Use this label to trigger release tests in CI label May 2, 2024
@justinchuby justinchuby closed this May 2, 2024
@justinchuby justinchuby reopened this May 2, 2024
@mayeut
Copy link
Contributor Author

mayeut commented May 3, 2024

@justinchuby, I'm not sure yet the failure on python 3.12 aarch64 are related to the changes here. I won't have time to look into this before the end of next week I think.

@justinchuby justinchuby marked this pull request as ready for review May 3, 2024 14:53
@justinchuby
Copy link
Contributor

We can fix LinuxRelease_aarch64 in a separate PR

@justinchuby justinchuby added this pull request to the merge queue May 4, 2024
Merged via the queue into onnx:main with commit 9f6f3a0 May 4, 2024
65 of 68 checks passed
mayeut added a commit to mayeut/onnx that referenced this pull request May 4, 2024
@mayeut
Copy link
Contributor Author

mayeut commented May 4, 2024

@justinchuby, the failures on python 3.12 seem to be coming from this PR. The set of dependencies changes more than expected.

isdanni pushed a commit to isdanni/onnx that referenced this pull request May 6, 2024
…nylinux (onnx#6120)

### Description
Only install python dependencies from wheels in manylinux.

### Motivation and Context
The latest version of google-re2 dropped support for manylinux2014.
google-re2 fails to build from sources thus failing the Linux release
pipelines.

This PR forces installation from wheels on manylinux which thus fallback
on the latest version of google-re2 with a wheel for manylinux2014.

Another solution would be to bump the manylinux images to manylinux_2_28
but that could have impact on downstream users (e.g. impossible to
install wheel from rh7, amazon linux 2, ubuntu 18.04).

Signed-off-by: mayeut <mayeut@users.noreply.github.com>
Co-authored-by: Justin Chu <justinchuby@users.noreply.github.com>
Signed-off-by: isdanni <leedanni@gmail.com>
github-merge-queue bot pushed a commit that referenced this pull request May 6, 2024
### Description

Only install google-re2 from wheels.

### Motivation and Context

The latest version of google-re2 dropped support for manylinux2014.
google-re2 fails to build from sources thus failing the Linux release
pipelines.

This PR forces installation from wheels on manylinux which thus fallback
on the latest version of google-re2 with a wheel for manylinux2014.
It reverts #6120 which forced all
dependencies to be available as wheels (psutil is not which forbids
installing recent versions of jupyter/ipykernel).

Another solution would be to bump the manylinux images to manylinux_2_28
but that could have impact on downstream users (e.g. impossible to
install wheel from rh7, amazon linux 2, ubuntu 18.04).

Signed-off-by: mayeut <mayeut@users.noreply.github.com>
cjvolzka pushed a commit that referenced this pull request May 6, 2024
…nylinux (#6120)

### Description
Only install python dependencies from wheels in manylinux.

### Motivation and Context
The latest version of google-re2 dropped support for manylinux2014.
google-re2 fails to build from sources thus failing the Linux release
pipelines.

This PR forces installation from wheels on manylinux which thus fallback
on the latest version of google-re2 with a wheel for manylinux2014.

Another solution would be to bump the manylinux images to manylinux_2_28
but that could have impact on downstream users (e.g. impossible to
install wheel from rh7, amazon linux 2, ubuntu 18.04).

Signed-off-by: mayeut <mayeut@users.noreply.github.com>
Co-authored-by: Justin Chu <justinchuby@users.noreply.github.com>
(cherry picked from commit 9f6f3a0)
cjvolzka pushed a commit that referenced this pull request May 6, 2024
### Description

Only install google-re2 from wheels.

### Motivation and Context

The latest version of google-re2 dropped support for manylinux2014.
google-re2 fails to build from sources thus failing the Linux release
pipelines.

This PR forces installation from wheels on manylinux which thus fallback
on the latest version of google-re2 with a wheel for manylinux2014.
It reverts #6120 which forced all
dependencies to be available as wheels (psutil is not which forbids
installing recent versions of jupyter/ipykernel).

Another solution would be to bump the manylinux images to manylinux_2_28
but that could have impact on downstream users (e.g. impossible to
install wheel from rh7, amazon linux 2, ubuntu 18.04).

Signed-off-by: mayeut <mayeut@users.noreply.github.com>
(cherry picked from commit aa2cdac)
cjvolzka pushed a commit that referenced this pull request May 6, 2024
…nylinux (#6120)

### Description
Only install python dependencies from wheels in manylinux.

### Motivation and Context
The latest version of google-re2 dropped support for manylinux2014.
google-re2 fails to build from sources thus failing the Linux release
pipelines.

This PR forces installation from wheels on manylinux which thus fallback
on the latest version of google-re2 with a wheel for manylinux2014.

Another solution would be to bump the manylinux images to manylinux_2_28
but that could have impact on downstream users (e.g. impossible to
install wheel from rh7, amazon linux 2, ubuntu 18.04).

Signed-off-by: Matthieu Darbois <mayeut@users.noreply.github.com>
Co-authored-by: Justin Chu <justinchuby@users.noreply.github.com>
(cherry picked from commit 9f6f3a0)
cjvolzka pushed a commit that referenced this pull request May 6, 2024
### Description

Only install google-re2 from wheels.

### Motivation and Context

The latest version of google-re2 dropped support for manylinux2014.
google-re2 fails to build from sources thus failing the Linux release
pipelines.

This PR forces installation from wheels on manylinux which thus fallback
on the latest version of google-re2 with a wheel for manylinux2014.
It reverts #6120 which forced all
dependencies to be available as wheels (psutil is not which forbids
installing recent versions of jupyter/ipykernel).

Another solution would be to bump the manylinux images to manylinux_2_28
but that could have impact on downstream users (e.g. impossible to
install wheel from rh7, amazon linux 2, ubuntu 18.04).

Signed-off-by: Matthieu Darbois <mayeut@users.noreply.github.com>
(cherry picked from commit aa2cdac)
cjvolzka pushed a commit that referenced this pull request May 6, 2024
…nylinux (#6120)

### Description
Only install python dependencies from wheels in manylinux.

### Motivation and Context
The latest version of google-re2 dropped support for manylinux2014.
google-re2 fails to build from sources thus failing the Linux release
pipelines.

This PR forces installation from wheels on manylinux which thus fallback
on the latest version of google-re2 with a wheel for manylinux2014.

Another solution would be to bump the manylinux images to manylinux_2_28
but that could have impact on downstream users (e.g. impossible to
install wheel from rh7, amazon linux 2, ubuntu 18.04).

Signed-off-by: Matthieu Darbois <mayeut@users.noreply.github.com>
Co-authored-by: Justin Chu <justinchuby@users.noreply.github.com>
(cherry picked from commit 9f6f3a0)
cjvolzka pushed a commit that referenced this pull request May 6, 2024
### Description

Only install google-re2 from wheels.

### Motivation and Context

The latest version of google-re2 dropped support for manylinux2014.
google-re2 fails to build from sources thus failing the Linux release
pipelines.

This PR forces installation from wheels on manylinux which thus fallback
on the latest version of google-re2 with a wheel for manylinux2014.
It reverts #6120 which forced all
dependencies to be available as wheels (psutil is not which forbids
installing recent versions of jupyter/ipykernel).

Another solution would be to bump the manylinux images to manylinux_2_28
but that could have impact on downstream users (e.g. impossible to
install wheel from rh7, amazon linux 2, ubuntu 18.04).

Signed-off-by: Matthieu Darbois <mayeut@users.noreply.github.com>
(cherry picked from commit aa2cdac)
gramalingam pushed a commit to gramalingam/onnx that referenced this pull request Jun 6, 2024
…nylinux (onnx#6120)

### Description
Only install python dependencies from wheels in manylinux.

### Motivation and Context
The latest version of google-re2 dropped support for manylinux2014.
google-re2 fails to build from sources thus failing the Linux release
pipelines.

This PR forces installation from wheels on manylinux which thus fallback
on the latest version of google-re2 with a wheel for manylinux2014.

Another solution would be to bump the manylinux images to manylinux_2_28
but that could have impact on downstream users (e.g. impossible to
install wheel from rh7, amazon linux 2, ubuntu 18.04).

Signed-off-by: mayeut <mayeut@users.noreply.github.com>
Co-authored-by: Justin Chu <justinchuby@users.noreply.github.com>
Signed-off-by: Ganesan Ramalingam <grama@microsoft.com>
gramalingam pushed a commit to gramalingam/onnx that referenced this pull request Jun 6, 2024
### Description

Only install google-re2 from wheels.

### Motivation and Context

The latest version of google-re2 dropped support for manylinux2014.
google-re2 fails to build from sources thus failing the Linux release
pipelines.

This PR forces installation from wheels on manylinux which thus fallback
on the latest version of google-re2 with a wheel for manylinux2014.
It reverts onnx#6120 which forced all
dependencies to be available as wheels (psutil is not which forbids
installing recent versions of jupyter/ipykernel).

Another solution would be to bump the manylinux images to manylinux_2_28
but that could have impact on downstream users (e.g. impossible to
install wheel from rh7, amazon linux 2, ubuntu 18.04).

Signed-off-by: mayeut <mayeut@users.noreply.github.com>
Signed-off-by: Ganesan Ramalingam <grama@microsoft.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
run release CIs Use this label to trigger release tests in CI
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

None yet

2 participants