Skip to content

HDDS-5749. Reuse mini-clusters in TestOzoneFsHAURLs#2647

Merged
sodonnel merged 1 commit intoapache:masterfrom
sodonnel:HDDS-5749
Sep 15, 2021
Merged

HDDS-5749. Reuse mini-clusters in TestOzoneFsHAURLs#2647
sodonnel merged 1 commit intoapache:masterfrom
sodonnel:HDDS-5749

Conversation

@sodonnel
Copy link
Contributor

What changes were proposed in this pull request?

TestOzoneFsHAURLs runs in about 104 seconds:

[INFO] Running org.apache.hadoop.fs.ozone.TestOzoneFsHAURLs
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 104.905 s - in org.apache.hadoop.fs.ozone.TestOzoneFsHAURLs

Reusing the mini-cluster across all the tests can reduce this time.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-5749

How was this patch tested?

Existing tests

@sodonnel
Copy link
Contributor Author

Ran in:

[INFO] Running org.apache.hadoop.fs.ozone.TestOzoneFsHAURLs
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.493 s - in org.apache.hadoop.fs.ozone.TestOzoneFsHAURLs

Saving about 50 seconds.

@sodonnel sodonnel merged commit ed30752 into apache:master Sep 15, 2021
errose28 added a commit to errose28/ozone that referenced this pull request Sep 30, 2021
* HDDS-4944: (81 commits)
  HDDS-5750. [Multi-Tenant] GetS3Secret should retrieve secret from new tables as well (apache#2649)
  HDDS-5476. [Multi-Tenant] Support Ozone s3 authentication with arbitrary accessId that is not same as the kerberos ID (apache#2635)
  HDDS-5770. Silent failures of k3s install are difficult to debug (apache#2667)
  HDDS-5759. Bump aspectj version (apache#2658)
  HDDS-5773. Avoid code duplication for mini cluster without datanodes (apache#2669)
  HDDS-5691. Restrict Recon NSSummaryEndpoint and ContainerEndpoint to admins. (apache#2638)
  HDDS-5771. Speed up TestDatanodeHddsVolumeFailureToleration by reducing dead interval (apache#2668)
  HDDS-5767. Unit check may timeout (apache#2664)
  HDDS-5765. Test cluster provider possibly returns null (apache#2663)
  HDDS-5768. Skip safemode check in TestOzoneManagerRocksDBLogging (apache#2665)
  HDDS-5766. Speed up some OM tests by skipping SCM safemode check (apache#2662)
  HDDS-5761. should not shutdown om when setting a bigger bucket quota  than volume quota (apache#2659)
  HDDS-5758. Speed up TestKeyInputStream and TestChunkInputStream by combining some tests (apache#2656)
  HDDS-5607. remove container manager v1 code (apache#2525)
  HDDS-5753. Split parts of misc suite (apache#2654)
  HDDS-5751. Use Mini Cluster Provider to speed up TestHDDSUpgrade (apache#2650)
  HDDS-5728. ContainerBalancer should use remaining space to calculate utilization. (apache#2625)
  HDDS-5402 Support list node based on NodeOperationalState and NodeState options in printTopology CLI (apache#2645)
  HDDS-5749. Reuse mini-clusters in TestOzoneFsHAURLs (apache#2647)
  HDDS-5717. Refactor TestOzoneManagerListVolumes to reuse mini-ozone clusters (apache#2615)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants