Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-48200][INFRA] Split build_python.yml into per-version cron jobs #46477

Closed
wants to merge 3 commits into from

Conversation

dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented May 8, 2024

What changes were proposed in this pull request?

This PR aims to split build_python.yml into per-version cron jobs.

Technically, this includes a revert of SPARK-48149 and choose the discussed alternative.

Why are the changes needed?

To recover Python CI successfully in ASF INFRA policy.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Manual review.

Was this patch authored or co-authored using generative AI tooling?

No.

@github-actions github-actions bot added the INFRA label May 8, 2024
@dongjoon-hyun
Copy link
Member Author

I realized that new pipeline is an error-prone style. This will choose the alternative simplest one, cc @HyukjinKwon .

@dongjoon-hyun
Copy link
Member Author

Could you review this PR, @viirya ?

@viirya
Copy link
Member

viirya commented May 8, 2024 via email

@dongjoon-hyun
Copy link
Member Author

Thank you so much, @viirya !

@dongjoon-hyun dongjoon-hyun deleted the SPARK-48200 branch May 8, 2024 16:42
@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented May 8, 2024

@viirya
Copy link
Member

viirya commented May 8, 2024

Thank you @dongjoon-hyun

Copy link
Member

@HyukjinKwon HyukjinKwon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lgtm

@dongjoon-hyun
Copy link
Member Author

Thank you, @HyukjinKwon !

JacobZheng0927 pushed a commit to JacobZheng0927/spark that referenced this pull request May 11, 2024
### What changes were proposed in this pull request?

This PR aims to split `build_python.yml` into per-version cron jobs.

Technically, this includes a revert of SPARK-48149 and choose [the discussed alternative](apache#46407 (comment)).

- apache#46407
- apache#46454

### Why are the changes needed?

To recover Python CI successfully in ASF INFRA policy.
- https://github.com/apache/spark/actions/workflows/build_python.yml

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Manual review.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#46477 from dongjoon-hyun/SPARK-48200.

Authored-by: Dongjoon Hyun <dhyun@apple.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
3 participants