Skip to content

PARQUET-1992: Manually download interop files inside the test and move encryption interop test to maven integration-test phase - #878

Merged
gszadovszky merged 8 commits into
apache:masterfrom
andersonm-ibm:manualIT
Mar 11, 2021
Merged

PARQUET-1992: Manually download interop files inside the test and move encryption interop test to maven integration-test phase#878
gszadovszky merged 8 commits into
apache:masterfrom
andersonm-ibm:manualIT

Conversation

@andersonm-ibm

@andersonm-ibm andersonm-ibm commented Mar 5, 2021

Copy link
Copy Markdown
Contributor

This PR is another option of solving the problem "Cannot build from tarball because of git submodules".

  1. Encryption interop tests run separately from unit tests - in integration-test phase
  2. Files for interop tests are downloaded manually, so git submodules are totally removed from the project
  • mvn package - doesn't run interop tests
  • mvn verify/install - run interop test and download files for interop from GitHub directly

@gszadovszky gszadovszky left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks a lot for working on this. Sorry about the confusion that I did accept the idea of using git submodules before. Haven't realized it would cause issues with the tarball.

You've mentioned in the jira and in this PR as well that integration tests are executed in the phase verify and are not in the phases package/install. Based on the maven lifecycle install does depend on verify so the integration tests will be executed. It is not a problem and neither is that you have moved this test from unit tests to IT. Just wanted to mention.

Comment thread .gitignore Outdated
.cache
*~
mvn_install.log
parquet-hadoop/parquet-testing

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would suggest using either a temporary directory outside of source tree or a place the files inside the target directory. target would have the benefit that it is not cleaned until explicitly invoked.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since you are using target now this change is unnecessary.

Comment thread .gitignore Outdated
.cache
*~
mvn_install.log
parquet-hadoop/parquet-testing

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since you are using target now this change is unnecessary.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants