Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[HUDI-2280] Use GitHub Actions to build different scala spark versions #3489

Closed
wants to merge 1 commit into from

Conversation

xushiyan
Copy link
Member

@xushiyan xushiyan commented Aug 17, 2021

To save parallel jobs (limited to 10) in Azure CI, we can make use of GitHub Actions to run tasks to verify different build configurations.

Committer checklist

  • Has a corresponding JIRA in PR title & commit

  • Commit message is descriptive of the change

  • CI is green

  • Necessary doc changes done or have another open PR

  • For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.

@xushiyan
Copy link
Member Author

xushiyan commented Aug 17, 2021

@vinothchandar Does this look good? Travis can still serve in some way...
Or we can try GitHub Actions for this? as Travis may just stuck in queueing jobs forever.
The intention is to save the compute power in Azure to just run tests while handle build, checkstyle and other validations somewhere else.

@xushiyan xushiyan changed the title [HUDI-2280] Use travis to build different scala spark versions [HUDI-2280] CI to build with different scala spark versions Aug 17, 2021
@xushiyan xushiyan force-pushed the new-travis branch 3 times, most recently from 5a6725a to 05901ce Compare August 17, 2021 17:14
@xushiyan
Copy link
Member Author

@vinothchandar I've removed travis in the PR, as Travis will stuck from time to time while GA works totally fine for these 2 tasks. This PR will mark the CI cut-over : Azure for running tests and GA for building and validating project. I'm good with the cut-over, though there is a slight risk with Azure availability https://status.dev.azure.com/, which I think it's manageable.

@xushiyan
Copy link
Member Author

@hudi-bot run azure

@xushiyan
Copy link
Member Author

@hudi-bot run azure

@xushiyan xushiyan force-pushed the new-travis branch 2 times, most recently from 47db145 to 849f033 Compare August 18, 2021 18:57
@xushiyan
Copy link
Member Author

@hudi-bot run azure

@vinothchandar
Copy link
Member

@xushiyan I think this model of using github actions to build may be ok. Wondering if we should check with infra once, if thats okay. but high level, its nice since there will be green checks to make sure build is green at-least , while azure does the heavylifting

@xushiyan
Copy link
Member Author

@hudi-bot run azure

@xushiyan
Copy link
Member Author

@hudi-bot run azure

@xushiyan
Copy link
Member Author

@vinothchandar i can send an email to notify infra. Meanwhile waiting for the azure to pass.

@xushiyan xushiyan changed the title [HUDI-2280] CI to build with different scala spark versions [HUDI-2280] Use GitHub Actions to build different scala spark versions Aug 28, 2021
@apache apache deleted a comment from hudi-bot Aug 28, 2021
@hudi-bot
Copy link

hudi-bot commented Aug 28, 2021

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run travis re-run the last Travis build
  • @hudi-bot run azure re-run the last Azure build

@xushiyan
Copy link
Member Author

closing this in favor of #3556

@xushiyan xushiyan closed this Aug 28, 2021
@xushiyan xushiyan deleted the new-travis branch August 28, 2021 15:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants