Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clean up all integration tests and standardize the creation of schema, table config and segments #5385

Merged
merged 1 commit into from
May 15, 2020

Conversation

Jackie-Jiang
Copy link
Contributor

  • Create schema and table config based on the settings in the BaseClusterIntegrationTest
  • Remove the methods with huge arguments list
  • Always use the schema and table config in the cluster to create the segments
  • Simplify the cluster setup methods

The following integration tests are removed:

  • DefaultCommitterRealtimeIntegrationTest: Merged into LLCRealtimeClusterIntegrationTest
  • PinotURIUploadIntegrationTest: Already covered in the module-level FileUploadDownloadClientTest

ControllerPeriodicTasksIntegrationTest is refactored (was not running before because the wrong test name '*Tests')
RealtimeStressTest is removed as it is the same as BenchmarkRealtimeConsumptionSpeed

@codecov-io
Copy link

codecov-io commented May 14, 2020

Codecov Report

Merging #5385 into master will decrease coverage by 0.02%.
The diff coverage is 20.00%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #5385      +/-   ##
==========================================
- Coverage   56.91%   56.88%   -0.03%     
==========================================
  Files        1089     1089              
  Lines       55778    55781       +3     
  Branches     8365     8366       +1     
==========================================
- Hits        31746    31733      -13     
- Misses      21522    21532      +10     
- Partials     2510     2516       +6     
Impacted Files Coverage Δ
...e/pinot/common/utils/FileUploadDownloadClient.java 23.80% <0.00%> (ø)
...indexsegment/generator/SegmentGeneratorConfig.java 67.93% <33.33%> (-0.41%) ⬇️
...pache/pinot/core/util/SortedRangeIntersection.java 83.82% <0.00%> (-7.36%) ⬇️
...t/common/metadata/instance/InstanceZKMetadata.java 84.12% <0.00%> (-4.77%) ⬇️
.../startree/v2/builder/OffHeapSingleTreeBuilder.java 87.34% <0.00%> (-4.22%) ⬇️
...e/operator/dociditerators/SVScanDocIdIterator.java 49.42% <0.00%> (-2.30%) ⬇️
...g/apache/pinot/common/utils/helix/HelixHelper.java 49.10% <0.00%> (-1.80%) ⬇️
.../controller/helix/core/SegmentDeletionManager.java 70.49% <0.00%> (-1.64%) ⬇️
...rg/apache/pinot/broker/routing/RoutingManager.java 65.64% <0.00%> (-0.77%) ⬇️
...ntroller/helix/core/PinotHelixResourceManager.java 58.98% <0.00%> (-0.30%) ⬇️
... and 2 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6f840db...ddabdfa. Read the comment docs.

Copy link
Contributor

@npawar npawar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nicely done

@Jackie-Jiang Jackie-Jiang force-pushed the integration_tests_clean_up branch 2 times, most recently from 2b518e7 to cf613cc Compare May 15, 2020 00:10
…, table config and segments

- Create schema and table config based on the settings in the BaseClusterIntegrationTest
- Remove the methods with huge arguments list
- Always use the schema and table config in the cluster to create the segments
- Simplify the cluster setup methods

The following integration tests are removed:
- DefaultCommitterRealtimeIntegrationTest: Merged into LLCRealtimeClusterIntegrationTest
- PinotURIUploadIntegrationTest: Already covered in the module-level FileUploadDownloadClientTest

ControllerPeriodicTasksIntegrationTest is refactored (was not running before because the wrong test name '*Tests')
RealtimeStressTest is removed as it is the same as BenchmarkRealtimeConsumptionSpeed
@Jackie-Jiang Jackie-Jiang merged commit 46e2701 into apache:master May 15, 2020
@Jackie-Jiang Jackie-Jiang deleted the integration_tests_clean_up branch May 15, 2020 03:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants