Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-48097][INFRA] Limit GHA job execution time to up to 3 hours in build_and_test.yml #46344

Closed
wants to merge 1 commit into from

Conversation

dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented May 2, 2024

What changes were proposed in this pull request?

This PR aims to limit GHA job execution time to up to 3 hours in build_and_test.yml in order to avoid idle hung time.
New limit is applied for all jobs except three jobs (precondition, infra-image, and breaking-changes-buf) which didn't get a hung situation before.

Why are the changes needed?

Since SPARK-45010, Apache spark used 5 hours.

This is shorter than GitHub Action's the default value (6 hour) is used.

This PR reduces to 3 hour to follow new ASF INFRA policy which has been applied since April 20, 2024.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Manual review.

Was this patch authored or co-authored using generative AI tooling?

No.

@github-actions github-actions bot added the INFRA label May 2, 2024
@dongjoon-hyun
Copy link
Member Author

Could you review this PR, @HyukjinKwon ?

@dongjoon-hyun
Copy link
Member Author

Thank you, @HyukjinKwon !

@dongjoon-hyun dongjoon-hyun deleted the SPARK-48097 branch May 2, 2024 22:29
JacobZheng0927 pushed a commit to JacobZheng0927/spark that referenced this pull request May 11, 2024
… `build_and_test.yml`

### What changes were proposed in this pull request?

This PR aims to limit GHA job execution time to up to 3 hours in `build_and_test.yml` in order to avoid idle hung time.
New limit is applied for all jobs except three jobs (`precondition`, `infra-image`, and `breaking-changes-buf`) which didn't get a hung situation before.

### Why are the changes needed?

Since SPARK-45010, Apache spark used 5 hours.
- apache#42727

This is shorter than GitHub Action's the default value (6 hour) is used.

- https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#jobsjob_idtimeout-minutes
  > The maximum number of minutes to let a job run before GitHub automatically cancels it. Default: 360

This PR reduces to `3 hour` to follow new ASF INFRA policy which has been applied since April 20, 2024.
- https://infra.apache.org/github-actions-policy.html

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Manual review.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#46344 from dongjoon-hyun/SPARK-48097.

Authored-by: Dongjoon Hyun <dhyun@apple.com>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
2 participants