Skip to content

[HUDI-5071] Upgrade com.google.guava:guava to 30.0-jre#6962

Closed
lxxawfl wants to merge 1 commit intoapache:masterfrom
lxxawfl:oscs_fix_cd5s3lgau51t5k2gfif0
Closed

[HUDI-5071] Upgrade com.google.guava:guava to 30.0-jre#6962
lxxawfl wants to merge 1 commit intoapache:masterfrom
lxxawfl:oscs_fix_cd5s3lgau51t5k2gfif0

Conversation

@lxxawfl
Copy link
Contributor

@lxxawfl lxxawfl commented Oct 16, 2022

Change Logs

There is 1 security vulnerability found in com.google.guava:guava 12.0.1

  • CVE-2018-10237. This PR upgrades com.google.guava:guava from 12.0.1 to 30.0-jre for vulnerability fix

Impact

Fix guava security vulnerability.

Risk level (write none, low medium or high below)

medium

Documentation Update

N/A

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@nsivabalan nsivabalan added dependencies Dependency updates priority:critical Production degraded; pipelines stalled labels Oct 21, 2022
@codope codope changed the title fix(sec): upgrade com.google.guava:guava to 30.0-jre [HUDI-5071] Upgrade com.google.guava:guava to 30.0-jre Oct 22, 2022
@codope
Copy link
Member

codope commented Oct 22, 2022

@lxxawfl Thanks for this fix. Unfortunately, if we upgrade guava here then it will run into conflict when we upgrade hudi-presto-bundle version in prestodb https://github.com/prestodb/presto/blob/0.277/pom.xml#L1263. I tried to build presto with hudi-presto-bundle incorporating this fix and it ran into following build failure:

[INFO] --- duplicate-finder-maven-plugin:1.2.1:check (default) @ presto-hive ---
[INFO] Checking compile classpath
[INFO] Checking runtime classpath
[INFO] Checking test classpath
[WARNING] Found duplicate and different classes in [com.google.guava:guava:26.0-jre, org.apache.hudi:hudi-presto-bundle:0.13.0-SNAPSHOT]:
[WARNING]   com.google.thirdparty.publicsuffix.PublicSuffixPatterns
[WARNING]   com.google.thirdparty.publicsuffix.PublicSuffixType
[WARNING]   com.google.thirdparty.publicsuffix.TrieParser
[WARNING] Found duplicate classes/resources in compile classpath.
[WARNING] Found duplicate and different classes in [com.google.guava:guava:26.0-jre, org.apache.hudi:hudi-presto-bundle:0.13.0-SNAPSHOT]:
[WARNING]   com.google.thirdparty.publicsuffix.PublicSuffixPatterns
[WARNING]   com.google.thirdparty.publicsuffix.PublicSuffixType
[WARNING]   com.google.thirdparty.publicsuffix.TrieParser
[WARNING] Found duplicate classes/resources in runtime classpath.
[WARNING] Found duplicate and different classes in [com.google.guava:guava:26.0-jre, org.apache.hudi:hudi-presto-bundle:0.13.0-SNAPSHOT]:
[WARNING]   com.google.thirdparty.publicsuffix.PublicSuffixPatterns
[WARNING]   com.google.thirdparty.publicsuffix.PublicSuffixType
[WARNING]   com.google.thirdparty.publicsuffix.TrieParser
[WARNING] Found duplicate classes/resources in test classpath.
...
...
[ERROR] Failed to execute goal org.basepom.maven:duplicate-finder-maven-plugin:1.2.1:check (default) on project presto-hive: Found duplicate classes/resources! -> [Help 1]

@codope
Copy link
Member

codope commented Nov 3, 2022

I don't think we can get rid of Guava right away as HBase depends Guava. I tried but ran into issues with Precondition class conflict when querying a Hudi table with metadata enabled. And we cannot upgrade directly because HBase depends on a particular version of guava that is used by hadoop (more specifically hadoop-common). When we upgrade to Hadoop 3 then guava will automatically get upgraded to version 27 which is compatible with that in Presto. So, IMO we should wait unti we have upgraded Hadoop libs in Hudi. https://issues.apache.org/jira/browse/HUDI-2955 tracks the effort

@codope codope added priority:high Significant impact; potential bugs and removed priority:critical Production degraded; pipelines stalled labels Nov 7, 2022
@nsivabalan nsivabalan added the release-0.12.2 Patches targetted for 0.12.2 label Dec 6, 2022
@codope codope removed the release-0.12.2 Patches targetted for 0.12.2 label Dec 7, 2022
@bvaradar bvaradar self-assigned this Feb 18, 2023
@bvaradar
Copy link
Contributor

bvaradar commented Mar 1, 2023

@codope @yihua : Should this PR be closed ?

@github-actions github-actions bot added the size:XS PR with lines of changes in <= 10 label Feb 26, 2024
@yihua
Copy link
Contributor

yihua commented Jun 23, 2024

Closing this PR. We'll revisit the guava update after Hadoop and Spark dependency upgrades.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Dependency updates priority:high Significant impact; potential bugs size:XS PR with lines of changes in <= 10

Projects

Status: No status
Status: ✅ Done

Development

Successfully merging this pull request may close these issues.

6 participants