Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI][Python] Set up automated cleaning for old nightly wheels on gemfury #34687

Closed
raulcd opened this issue Mar 22, 2023 · 1 comment · Fixed by #34705
Closed

[CI][Python] Set up automated cleaning for old nightly wheels on gemfury #34687

raulcd opened this issue Mar 22, 2023 · 1 comment · Fixed by #34705
Assignees
@raulcd
Labels
Component: Continuous Integration Component: Python Type: enhancement
Milestone
12.0.0

Comments

@raulcd
Copy link
Member

raulcd commented Mar 22, 2023

Describe the enhancement requested

I have been given access to the arrow-nightlies gemfury wheels. At the moment we have ~21600 versions of different wheels uploaded there.
We upload around 30 per day. This should be ~2 years of daily wheels uploaded.

We should automate some clean up. Maybe keep the last 3 months?

Component(s)

Continuous Integration, Python
@lidavidm
Copy link
Member

We have this: https://github.com/apache/arrow-adbc/blob/main/ci/scripts/gemfury_clean.rb

raulcd added a commit to raulcd/arrow that referenced this issue Mar 23, 2023
@raulcd
apacheGH-34687: [CI][Python] Remove old nightly wheels from gemfury
f7b43ae
@github-actions github-actions bot mentioned this issue Mar 23, 2023
Merged
raulcd added a commit that referenced this issue Mar 27, 2023
@raulcd
GH-34687: [CI][Python] Create job to remove old nightly wheels from g…
0a21a4c 
…emfury (#34705)

### Rationale for this change

We haven't been cleaning nightly wheels from gemfury ever.

### What changes are included in this PR?

Add a new job that should clean them. This is mainly reused from the one on arrow-adbc: https://github.com/apache/arrow-adbc/blob/main/ci/scripts/gemfury_clean.rb

### Are these changes tested?

I will trigger via crossbow

### Are there any user-facing changes?

No
* Closes: #34687

Authored-by: Raúl Cumplido <raulcumplido@gmail.com>
Signed-off-by: Raúl Cumplido <raulcumplido@gmail.com>
@raulcd raulcd added this to the 12.0.0 milestone Mar 27, 2023
ArgusLi pushed a commit to Bit-Quill/arrow that referenced this issue May 15, 2023
@raulcd @ArgusLi
apacheGH-34687: [CI][Python] Create job to remove old nightly wheels …
2007a96 
…from gemfury (apache#34705)

### Rationale for this change

We haven't been cleaning nightly wheels from gemfury ever.

### What changes are included in this PR?

Add a new job that should clean them. This is mainly reused from the one on arrow-adbc: https://github.com/apache/arrow-adbc/blob/main/ci/scripts/gemfury_clean.rb

### Are these changes tested?

I will trigger via crossbow

### Are there any user-facing changes?

No
* Closes: apache#34687

Authored-by: Raúl Cumplido <raulcumplido@gmail.com>
Signed-off-by: Raúl Cumplido <raulcumplido@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@raulcd raulcd

Labels
Component: Continuous Integration Component: Python Type: enhancement
Projects
None yet
Milestone
12.0.0
Development

Successfully merging a pull request may close this issue.

GH-34687: [CI][Python] Create job to remove old nightly wheels from gemfury raulcd/arrow
2 participants
@lidavidm @raulcd