Skip to content

Migrate integration tests to spark 2.4.4#1012

Merged
bvaradar merged 1 commit intoapache:masterfrom
umehrot2:integ-spark-2.4.4
Nov 14, 2019
Merged

Migrate integration tests to spark 2.4.4#1012
bvaradar merged 1 commit intoapache:masterfrom
umehrot2:integ-spark-2.4.4

Conversation

@umehrot2
Copy link
Copy Markdown
Contributor

This migrates integration tests to use Spark 2.4.4. The tests pass for me locally after building the docker images with spark 2.4.4. Let me know if you would like me to upload the docker images somewhere.

This is related to #1005 for migrating Hudi to Spark 2.4.4.

@bvaradar
Copy link
Copy Markdown
Contributor

@umehrot2 : I will review this sometime today. If they look good, I will push the docker images to apachehudi docker repo.

Copy link
Copy Markdown
Contributor

@bvaradar bvaradar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @umehrot2 : Code changes look good. I have uploaded Spark 2.4.4. docker images with your changes and have re-triggered tests. Once they pass, we can merge this PR.

@bvaradar bvaradar merged commit 92c69f5 into apache:master Nov 14, 2019
vinishjail97 pushed a commit to vinishjail97/hudi that referenced this pull request Nov 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants