Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upgrade Alluxio to 2.9.3 #19594

Merged
merged 1 commit into from
Jun 6, 2023
Merged

Upgrade Alluxio to 2.9.3 #19594

merged 1 commit into from
Jun 6, 2023

Conversation

beinan
Copy link
Member

@beinan beinan commented May 9, 2023 •
edited by apc999

Alluxio 2.9.3 supports more under storage for local cache
This will fix #19026

== RELEASE NOTES ==

Hive Changes
* Replace the version of Alluxio from 2.8.1 to 2.9.3

@beinan beinan requested a review from a team as a code owner May 9, 2023 04:36
@beinan beinan requested a review from ajaygeorge May 9, 2023 04:36
apc999
apc999 approved these changes May 9, 2023
View reviewed changes
Copy link
Contributor

@apc999 apc999 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do you want this commit to show up in release notes?

@beinan
Copy link
Member Author

beinan commented May 12, 2023

do you want this commit to show up in release notes?

good call, added

@beinan
Copy link
Member Author

beinan commented May 13, 2023

@kewang1024 @zacw7 any objections of merging this PR?

@kewang1024
Copy link
Collaborator

Can we elaborate what was in the upgrade? Or do we have a link?

@beinan
Copy link
Member Author

beinan commented May 16, 2023

Can we elaborate what was in the upgrade? Or do we have a link?

  1. We remove the restrictions of the under filesystem then all the presto users are using hdfs, s3, gcs and etc. can use local cache.
  2. Zero copy support (probably we need also need change something on presto side to enable it)

@apc999
Copy link
Contributor

apc999 commented May 16, 2023 •
edited

@kewang1024 this upgrade will resolve #19026

@apc999
Copy link
Contributor

apc999 commented May 17, 2023

@kewang1024 can you confirm? thanks

@kewang1024 kewang1024 self-requested a review May 26, 2023 18:35
This was referenced May 29, 2023
Open
Closed
@imjalpreet
Copy link
Member

@beinan Thanks for adding this support. Before we merge this PR, can we confirm if the upgarde to 2.9.3 version also fixes the issue mentioned in the description of this PR: #19038? CC: @arunthirupathi

@zacw7
Copy link
Member

zacw7 commented May 30, 2023

@beinan Thanks for adding this support. Before we merge this PR, can we confirm if the upgarde to 2.9.3 version also fixes the issue mentioned in the description of this PR: #19038? CC: @arunthirupathi

We were not able to pinpoint the root cause after extensive investigation. That error was not reproducible and only affected very limited workload so we think it's ok to proceed the upgrade.

@beinan beinan merged commit a2f056b into prestodb:master Jun 6, 2023
44 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ajaygeorge ajaygeorge ajaygeorge approved these changes

@apc999 apc999 apc999 approved these changes

@zacw7 zacw7 zacw7 approved these changes

@kewang1024 kewang1024 kewang1024 approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

hdfs is not supported as the external filesystem.
6 participants
@beinan @kewang1024 @apc999 @imjalpreet @zacw7 @ajaygeorge