Skip to content

Conversation

@tomglliu
Copy link

BPServiceActor to provide new thread to handle IBR

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 11m 41s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ branch-2.10 Compile Tests _
+1 💚 mvninstall 16m 26s branch-2.10 passed
+1 💚 compile 1m 6s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 compile 0m 58s branch-2.10 passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07
+1 💚 checkstyle 0m 42s branch-2.10 passed
+1 💚 mvnsite 1m 10s branch-2.10 passed
+1 💚 javadoc 1m 28s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 0m 55s branch-2.10 passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07
-1 ❌ spotbugs 3m 0s /branch-spotbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html hadoop-hdfs-project/hadoop-hdfs in branch-2.10 has 1 extant spotbugs warnings.
_ Patch Compile Tests _
-1 ❌ mvninstall 0m 33s /patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch failed.
-1 ❌ compile 0m 41s /patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdkAzulSystems,Inc.-1.7.0_262-b10.txt hadoop-hdfs in the patch failed with JDK Azul Systems, Inc.-1.7.0_262-b10.
-1 ❌ javac 0m 41s /patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdkAzulSystems,Inc.-1.7.0_262-b10.txt hadoop-hdfs in the patch failed with JDK Azul Systems, Inc.-1.7.0_262-b10.
-1 ❌ compile 0m 36s /patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07.txt hadoop-hdfs in the patch failed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07.
-1 ❌ javac 0m 36s /patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07.txt hadoop-hdfs in the patch failed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07.
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 0m 31s /results-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs-project/hadoop-hdfs: The patch generated 1 new + 88 unchanged - 0 fixed = 89 total (was 88)
-1 ❌ mvnsite 0m 35s /patch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch failed.
+1 💚 javadoc 1m 14s the patch passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 0m 50s the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07
-1 ❌ spotbugs 0m 34s /patch-spotbugs-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch failed.
_ Other Tests _
-1 ❌ unit 0m 38s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch failed.
+1 💚 asflicense 0m 30s The patch does not generate ASF License warnings.
48m 20s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4820/1/artifact/out/Dockerfile
GITHUB PR #4820
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux fdf4ef26045c 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4 01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-2.10 / 19d085a
Default Java Private Build-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07
Multi-JDK versions /usr/lib/jvm/zulu-7-amd64:Azul Systems, Inc.-1.7.0_262-b10 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4820/1/testReport/
Max. process+thread count 83 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4820/1/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 11m 39s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ branch-2.10 Compile Tests _
+1 💚 mvninstall 16m 35s branch-2.10 passed
+1 💚 compile 1m 6s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 compile 1m 0s branch-2.10 passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07
+1 💚 checkstyle 0m 45s branch-2.10 passed
+1 💚 mvnsite 1m 11s branch-2.10 passed
+1 💚 javadoc 1m 26s branch-2.10 passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 0m 55s branch-2.10 passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07
-1 ❌ spotbugs 2m 56s /branch-spotbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html hadoop-hdfs-project/hadoop-hdfs in branch-2.10 has 1 extant spotbugs warnings.
_ Patch Compile Tests _
-1 ❌ mvninstall 0m 33s /patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch failed.
-1 ❌ compile 0m 38s /patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdkAzulSystems,Inc.-1.7.0_262-b10.txt hadoop-hdfs in the patch failed with JDK Azul Systems, Inc.-1.7.0_262-b10.
-1 ❌ javac 0m 38s /patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdkAzulSystems,Inc.-1.7.0_262-b10.txt hadoop-hdfs in the patch failed with JDK Azul Systems, Inc.-1.7.0_262-b10.
-1 ❌ compile 0m 33s /patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07.txt hadoop-hdfs in the patch failed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07.
-1 ❌ javac 0m 33s /patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07.txt hadoop-hdfs in the patch failed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07.
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 0m 31s /results-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs-project/hadoop-hdfs: The patch generated 1 new + 88 unchanged - 0 fixed = 89 total (was 88)
-1 ❌ mvnsite 0m 33s /patch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch failed.
+1 💚 javadoc 1m 13s the patch passed with JDK Azul Systems, Inc.-1.7.0_262-b10
+1 💚 javadoc 0m 48s the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07
-1 ❌ spotbugs 0m 32s /patch-spotbugs-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch failed.
_ Other Tests _
-1 ❌ unit 0m 35s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch failed.
+1 💚 asflicense 0m 29s The patch does not generate ASF License warnings.
48m 20s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4820/2/artifact/out/Dockerfile
GITHUB PR #4820
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets
uname Linux 20b0f76dc410 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4 01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision branch-2.10 / b4cb264
Default Java Private Build-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07
Multi-JDK versions /usr/lib/jvm/zulu-7-amd64:Azul Systems, Inc.-1.7.0_262-b10 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_342-8u342-b07-0ubuntu1~18.04-b07
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4820/2/testReport/
Max. process+thread count 83 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4820/2/console
versions git=2.17.1 maven=3.6.0 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

any(DatanodeRegistration.class),
anyString(),
any(StorageReceivedDeletedBlocks[].class));
int retries = 0;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LambdaTestUtils#waitFor

dnConf.outliersReportIntervalMs);
// get the value of maxDataLength.
sendIBRLock = new Object();
ibrExecutorService = Executors.newSingleThreadExecutor(
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ThreadFactory threadFactory = new ThreadFactoryBuilder()
    .setDaemon(true)
    .setNameFormat("IBR-executor-%d")
    .build()
ibrExecutorService = Executors.newSingleThreadExecutor(threadFactory);

return Time.monotonicNow();
}
}

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Avoid

try {
meta = FsDatasetUtil.getMetaFile(getBlockFile(b), b.getGenerationStamp());
} catch (IOException e) {
throw new FileNotFoundException("BlockId " + b.getBlockName() + " is not valid.");
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How did the old exception look like?

@github-actions
Copy link
Contributor

github-actions bot commented Nov 4, 2025

We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
If you feel like this was a mistake, or you would like to continue working on it, please feel free to re-open it and ask for a committer to remove the stale tag and review again.
Thanks all for your contribution.

@github-actions github-actions bot added the Stale label Nov 4, 2025
@github-actions github-actions bot closed this Nov 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants