Skip to content

Comments

HDDS-11071. [hsync] 8th merge from master#6915

Merged
smengcl merged 98 commits intoapache:HDDS-7593from
smengcl:HDDS-11071-8th-merge-from-master
Jul 8, 2024
Merged

HDDS-11071. [hsync] 8th merge from master#6915
smengcl merged 98 commits intoapache:HDDS-7593from
smengcl:HDDS-11071-8th-merge-from-master

Conversation

@smengcl
Copy link
Contributor

@smengcl smengcl commented Jul 8, 2024

DO NOT merge from PR. For code review purpose only.

What changes were proposed in this pull request?

8th merge from master.

Merge remote-tracking branch 'asf/master' into HDDS-7593

Conflicts:
.github/workflows/build-ratis.yml
.mvn/extensions.xml
hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockInputStream.java
hadoop-hdds/client/src/test/java/org/apache/hadoop/hdds/scm/storage/DummyBlockInputStream.java
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/impl/BlockManagerImpl.java
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/certificate/authority/CertificateServer.java
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/certificate/authority/DefaultCAServer.java
hadoop-hdds/framework/src/test/java/org/apache/hadoop/hdds/security/x509/certificate/authority/TestDefaultCAServer.java
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/security/RootCARotationManager.java
hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/io/KeyInputStream.java
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/TestSecureOzoneCluster.java
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/TestSecureOzoneRpcClient.java
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/container/TestContainerReplication.java
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeysDeleteRequest.java
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OmKeysDeleteRequestWithFSO.java
hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/api/db.json
hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/src/views/diskUsage/diskUsage.tsx
pom.xml

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-11071

How was this patch tested?

  • Existing CI.

adoroszlai and others added 30 commits May 31, 2024 22:07
dependabot bot and others added 22 commits June 29, 2024 10:42
Conflicts:
.github/workflows/build-ratis.yml
.mvn/extensions.xml
hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockInputStream.java
hadoop-hdds/client/src/test/java/org/apache/hadoop/hdds/scm/storage/DummyBlockInputStream.java
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/impl/BlockManagerImpl.java
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/certificate/authority/CertificateServer.java
hadoop-hdds/framework/src/main/java/org/apache/hadoop/hdds/security/x509/certificate/authority/DefaultCAServer.java
hadoop-hdds/framework/src/test/java/org/apache/hadoop/hdds/security/x509/certificate/authority/TestDefaultCAServer.java
hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/security/RootCARotationManager.java
hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/io/KeyInputStream.java
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/TestSecureOzoneCluster.java
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/TestSecureOzoneRpcClient.java
hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/container/TestContainerReplication.java
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeysDeleteRequest.java
hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OmKeysDeleteRequestWithFSO.java
hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/api/db.json
hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/src/views/diskUsage/diskUsage.tsx
pom.xml
@smengcl smengcl changed the title Hdds 11071 8th merge from master HDDS-11071. [hsync] 8th merge from master Jul 8, 2024
@smengcl smengcl added the hbase HBase on Ozone support label Jul 8, 2024
@smengcl smengcl requested a review from jojochuang July 8, 2024 17:42
@smengcl
Copy link
Contributor Author

smengcl commented Jul 8, 2024

Looking at test failures.

https://github.com/apache/ozone/actions/runs/9844372941/job/27178008380?pr=6915#step:6:2657

[INFO] Running org.apache.hadoop.ozone.client.rpc.TestBlockOutputStream
Error:  Tests run: 24, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 24.693 s <<< FAILURE! - in org.apache.hadoop.ozone.client.rpc.TestBlockOutputStream
Error:  org.apache.hadoop.ozone.client.rpc.TestBlockOutputStream.testWriteMoreThanFlushSize(boolean, boolean)[3]  Time elapsed: 0.06 s  <<< FAILURE!
org.opentest4j.AssertionFailedError: expected: <1> but was: <0>
	at org.junit.jupiter.api.AssertionFailureBuilder.build(AssertionFailureBuilder.java:151)
	at org.junit.jupiter.api.AssertionFailureBuilder.buildAndThrow(AssertionFailureBuilder.java:132)
	at org.junit.jupiter.api.AssertEquals.failNotEqual(AssertEquals.java:197)
	at org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:150)
	at org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:145)
	at org.junit.jupiter.api.Assertions.assertEquals(Assertions.java:531)
	at org.apache.hadoop.ozone.client.rpc.TestBlockOutputStream.testWriteMoreThanFlushSize(TestBlockOutputStream.java:523)

https://github.com/apache/ozone/actions/runs/9844372941/job/27178010301?pr=6915#step:6:2704

[INFO] Running org.apache.hadoop.ozone.recon.TestReconAndAdminContainerCLI
Error:  Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 113.724 s <<< FAILURE! - in org.apache.hadoop.ozone.recon.TestReconAndAdminContainerCLI
Error:  org.apache.hadoop.ozone.recon.TestReconAndAdminContainerCLI.testNodesInDecommissionOrMaintenance(HddsProtos$NodeOperationalState,HddsProtos$NodeOperationalState, boolean)  Time elapsed: 47.151 s  <<< ERROR!
java.util.concurrent.TimeoutException: 
Timed out waiting for condition. Thread diagnostics:
Timestamp: 2024-07-08 06:07:32,752

"qtp1872061772-411" daemon prio=5 tid=411 timed_waiting
java.lang.Thread.State: TIMED_WAITING
        at java.base@17.0.11/jdk.internal.misc.Unsafe.park(Native Method)
...

@smengcl
Copy link
Contributor Author

smengcl commented Jul 8, 2024

Both flaky tests passed after retriggering.

@smengcl smengcl merged commit f7610c0 into apache:HDDS-7593 Jul 8, 2024
@smengcl
Copy link
Contributor Author

smengcl commented Jul 8, 2024

Pushed to feature branch. Thanks @jojochuang for the review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

hbase HBase on Ozone support

Projects

None yet

Development

Successfully merging this pull request may close these issues.