Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade Default Parquet Library to 1.12.3 #6813

Closed
exalate-issue-sync bot opened this issue Apr 28, 2023 · 10 comments
Closed

Upgrade Default Parquet Library to 1.12.3 #6813

exalate-issue-sync bot opened this issue Apr 28, 2023 · 10 comments
Assignees

Comments

@exalate-issue-sync
Copy link

The parquet common library utilises java logging and version 1.8.2+ can respect logging setttings set via log4j.

@exalate-issue-sync
Copy link
Author

Wendy Wong commented: Marek: Satesh mentioned that there is a newer version of parquet common library 1.11. He is wondering if this version can be used?

@exalate-issue-sync
Copy link
Author

Marek Novotny commented: There are [compatibility tests|https://github.com/h2oai/h2o-3/blob/master/h2o-parsers/h2o-parquet-parser-tests/src/main/java/water/parser/parquet/ParseTestParquet.java#L216] with old parquet/avro fotmat which fail after doing upgrade any version higher than 1.8.1.
The lightweight assembly h2o-steam.jar contains parquet library even newer library parquet library {{1.12.2}} IMHO, they should use this jar instead since they require software without any vulnerabilities and h2o-steam.jar serves for that purpose.

@exalate-issue-sync
Copy link
Author

Wendy Wong commented: Will let Arun know. Thanks Marek.

@h2o-ops
Copy link
Collaborator

h2o-ops commented May 10, 2023

JIRA Issue Details

Jira Issue: PUBDEV-8985
Assignee: Marek Novotny
Reporter: Marek Novotny
State: In Progress
Fix Version: Backlog
Attachments: N/A
Development PRs: Available

@h2o-ops
Copy link
Collaborator

h2o-ops commented May 10, 2023

Linked PRs from JIRA

#6480

@exalate-issue-sync exalate-issue-sync bot changed the title Upgrade Default Parquet Library to 1.8.3 Upgrade Default Parquet Library to 1.12.3 May 17, 2023
@exalate-issue-sync
Copy link
Author

Wendy Wong commented: Marek: Satesh mentioned that there is a newer version of parquet common library 1.11. He is wondering if this version can be used?

@exalate-issue-sync
Copy link
Author

Marek Novotny commented: There are [compatibility tests|https://github.com/h2oai/h2o-3/blob/master/h2o-parsers/h2o-parquet-parser-tests/src/main/java/water/parser/parquet/ParseTestParquet.java#L216] with old parquet/avro fotmat which fail after doing upgrade any version higher than 1.8.1.
The lightweight assembly h2o-steam.jar contains parquet library even newer library parquet library {{1.12.2}} IMHO, they should use this jar instead since they require software without any vulnerabilities and h2o-steam.jar serves for that purpose.

@exalate-issue-sync
Copy link
Author

Wendy Wong commented: Will let Arun know. Thanks Marek.

@exalate-issue-sync
Copy link
Author

Exalate commented: h2o-ops commented: JIRA Issue Details

Jira Issue: PUBDEV-8985
Assignee: Marek Novotny
Reporter: Marek Novotny
State: In Progress
Fix Version: Backlog
Attachments: N/A
Development PRs: Available

@exalate-issue-sync
Copy link
Author

Exalate commented: h2o-ops commented: Linked PRs from JIRA

#6480

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants