Skip to content

Conversation

@prasad-acit
Copy link
Contributor

HDFS-16141. Address permission related issues with File / Directory

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 46s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ fgl Compile Tests _
+1 💚 mvninstall 33m 19s fgl passed
+1 💚 compile 1m 22s fgl passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 compile 1m 15s fgl passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚 checkstyle 0m 59s fgl passed
+1 💚 mvnsite 1m 20s fgl passed
+1 💚 javadoc 0m 56s fgl passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 javadoc 1m 25s fgl passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
-1 ❌ spotbugs 3m 13s /branch-spotbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html hadoop-hdfs-project/hadoop-hdfs in fgl has 1 extant spotbugs warnings.
+1 💚 shadedclient 18m 39s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 12s the patch passed
+1 💚 compile 1m 18s the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 javac 1m 18s the patch passed
+1 💚 compile 1m 8s the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚 javac 1m 9s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 0m 53s /results-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs-project/hadoop-hdfs: The patch generated 2 new + 62 unchanged - 0 fixed = 64 total (was 62)
+1 💚 mvnsite 1m 15s the patch passed
+1 💚 javadoc 0m 48s the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 javadoc 1m 19s the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
-1 ❌ spotbugs 3m 23s /new-spotbugs-hadoop-hdfs-project_hadoop-hdfs.html hadoop-hdfs-project/hadoop-hdfs generated 1 new + 1 unchanged - 0 fixed = 2 total (was 1)
+1 💚 shadedclient 19m 4s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 385m 31s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 38s The patch does not generate ASF License warnings.
477m 8s
Reason Tests
SpotBugs module:hadoop-hdfs-project/hadoop-hdfs
Dead store to parent in org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.createPathDirectories(FSDirectory, INodesInPath, PermissionStatus) At FSDirMkdirOp.java:org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.createPathDirectories(FSDirectory, INodesInPath, PermissionStatus) At FSDirMkdirOp.java:[line 292]
Failed junit tests hadoop.hdfs.TestFileCreation
hadoop.hdfs.server.namenode.snapshot.TestRandomOpsWithSnapshots
hadoop.hdfs.server.namenode.TestStartup
hadoop.hdfs.server.namenode.snapshot.TestSnapshot
hadoop.hdfs.server.namenode.TestNameEditsConfigs
hadoop.hdfs.TestPersistBlocks
hadoop.hdfs.TestRollingUpgradeRollback
hadoop.hdfs.TestStateAlignmentContextWithHA
hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade
hadoop.hdfs.TestAclsEndToEnd
hadoop.hdfs.server.namenode.TestAddBlockRetry
hadoop.hdfs.server.namenode.TestDecommissioningStatus
hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion
hadoop.hdfs.server.namenode.TestStorageRestore
hadoop.hdfs.server.namenode.snapshot.TestOrderedSnapshotDeletion
hadoop.hdfs.server.namenode.TestFSNamesystemLock
hadoop.hdfs.TestEncryptedTransfer
hadoop.hdfs.server.namenode.TestDecommissioningStatusWithBackoffMonitor
hadoop.hdfs.server.namenode.TestNameNodeRecovery
hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots
hadoop.hdfs.server.namenode.TestFSNamesystemLockReport
hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
hadoop.hdfs.server.namenode.TestCommitBlockSynchronization
hadoop.hdfs.TestViewDistributedFileSystem
hadoop.hdfs.server.namenode.TestPersistentStoragePolicySatisfier
hadoop.hdfs.server.namenode.TestCacheDirectives
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer
hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
hadoop.hdfs.server.namenode.snapshot.TestSnapRootDescendantDiff
hadoop.hdfs.server.namenode.TestFileTruncate
hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
hadoop.hdfs.server.namenode.snapshot.TestFSImageWithOrderedSnapshotDeletion
hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot
hadoop.hdfs.TestErasureCodingPolicyWithSnapshotWithRandomECPolicy
hadoop.hdfs.server.namenode.TestFSImage
hadoop.hdfs.server.datanode.TestBatchIbr
hadoop.hdfs.server.namenode.TestAddBlock
hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap
hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits
hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport
hadoop.hdfs.server.blockmanagement.TestReplicationPolicy
hadoop.hdfs.server.namenode.TestCacheDirectivesWithViewDFS
hadoop.hdfs.TestRollingUpgrade
hadoop.hdfs.TestDFSClientRetries
hadoop.hdfs.server.namenode.ha.TestObserverNode
hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
hadoop.hdfs.TestDFSUpgradeFromImage
hadoop.hdfs.server.namenode.TestFSNamesystem
hadoop.hdfs.TestDistributedFileSystem
hadoop.hdfs.TestErasureCodingPolicyWithSnapshot
hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot
hadoop.hdfs.TestRollingUpgradeDowngrade
hadoop.hdfs.server.namenode.TestDeleteRace
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3232/1/artifact/out/Dockerfile
GITHUB PR #3232
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell
uname Linux 4cd88990d195 4.15.0-147-generic #151-Ubuntu SMP Fri Jun 18 19:21:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision fgl / 60ac1605f25b086019da823d9ab074ba2ae064cf
Default Java Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3232/1/testReport/
Max. process+thread count 2463 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3232/1/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 45s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ fgl Compile Tests _
+1 💚 mvninstall 33m 15s fgl passed
+1 💚 compile 1m 26s fgl passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 compile 1m 14s fgl passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚 checkstyle 0m 59s fgl passed
+1 💚 mvnsite 1m 23s fgl passed
+1 💚 javadoc 0m 55s fgl passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 javadoc 1m 26s fgl passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
-1 ❌ spotbugs 3m 15s /branch-spotbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html hadoop-hdfs-project/hadoop-hdfs in fgl has 1 extant spotbugs warnings.
+1 💚 shadedclient 19m 5s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 13s the patch passed
+1 💚 compile 1m 17s the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 javac 1m 17s the patch passed
+1 💚 compile 1m 8s the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚 javac 1m 8s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 0m 53s the patch passed
+1 💚 mvnsite 1m 17s the patch passed
+1 💚 javadoc 0m 48s the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 javadoc 1m 20s the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
-1 ❌ spotbugs 3m 25s /new-spotbugs-hadoop-hdfs-project_hadoop-hdfs.html hadoop-hdfs-project/hadoop-hdfs generated 1 new + 0 unchanged - 1 fixed = 1 total (was 1)
+1 💚 shadedclient 18m 35s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 443m 49s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 💚 asflicense 1m 20s The patch does not generate ASF License warnings.
536m 1s
Reason Tests
SpotBugs module:hadoop-hdfs-project/hadoop-hdfs
Dead store to parent in org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.createPathDirectories(FSDirectory, INodesInPath, PermissionStatus) At FSDirMkdirOp.java:org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.createPathDirectories(FSDirectory, INodesInPath, PermissionStatus) At FSDirMkdirOp.java:[line 292]
Failed junit tests hadoop.hdfs.TestFileCreation
hadoop.hdfs.server.namenode.TestStartup
hadoop.hdfs.server.namenode.snapshot.TestSnapshot
hadoop.hdfs.server.namenode.TestNameEditsConfigs
hadoop.hdfs.TestPersistBlocks
hadoop.hdfs.TestRollingUpgradeRollback
hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade
hadoop.hdfs.TestAclsEndToEnd
hadoop.hdfs.server.namenode.TestAddBlockRetry
hadoop.hdfs.server.namenode.TestDecommissioningStatus
hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion
hadoop.hdfs.server.namenode.TestStorageRestore
hadoop.hdfs.server.namenode.snapshot.TestOrderedSnapshotDeletion
hadoop.hdfs.server.namenode.TestFSNamesystemLock
hadoop.hdfs.TestEncryptedTransfer
hadoop.hdfs.server.namenode.TestDecommissioningStatusWithBackoffMonitor
hadoop.hdfs.server.namenode.TestNameNodeRecovery
hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots
hadoop.hdfs.server.namenode.TestFSNamesystemLockReport
hadoop.fs.TestSymlinkHdfsFileSystem
hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
hadoop.hdfs.server.namenode.TestCommitBlockSynchronization
hadoop.hdfs.TestViewDistributedFileSystem
hadoop.hdfs.server.namenode.TestPersistentStoragePolicySatisfier
hadoop.hdfs.server.namenode.TestCacheDirectives
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer
hadoop.hdfs.server.namenode.snapshot.TestSnapRootDescendantDiff
hadoop.hdfs.server.namenode.TestFileTruncate
hadoop.hdfs.server.namenode.snapshot.TestFSImageWithOrderedSnapshotDeletion
hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot
hadoop.hdfs.TestErasureCodingPolicyWithSnapshotWithRandomECPolicy
hadoop.hdfs.server.datanode.TestBatchIbr
hadoop.hdfs.server.namenode.TestAddBlock
hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap
hadoop.hdfs.server.balancer.TestBalancerRPCDelay
hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits
hadoop.hdfs.TestViewDistributedFileSystemContract
hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport
hadoop.hdfs.server.namenode.TestParallelImageWrite
hadoop.hdfs.server.namenode.TestCacheDirectivesWithViewDFS
hadoop.hdfs.TestRollingUpgrade
hadoop.hdfs.TestDFSClientRetries
hadoop.hdfs.server.namenode.ha.TestEditLogTailer
hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
hadoop.hdfs.TestDFSUpgradeFromImage
hadoop.hdfs.server.namenode.TestFSNamesystem
hadoop.hdfs.TestDistributedFileSystem
hadoop.hdfs.TestErasureCodingPolicyWithSnapshot
hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot
hadoop.hdfs.TestRollingUpgradeDowngrade
hadoop.hdfs.server.namenode.TestDeleteRace
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3232/2/artifact/out/Dockerfile
GITHUB PR #3232
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell
uname Linux c98c0b7f5512 4.15.0-147-generic #151-Ubuntu SMP Fri Jun 18 19:21:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision fgl / 142d1a9ea48425b540fa775572eb48d53b78ce81
Default Java Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3232/2/testReport/
Max. process+thread count 2335 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3232/2/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

@prasad-acit prasad-acit force-pushed the HDFS-16141 branch 2 times, most recently from e713d8a to 1e7f847 Compare July 26, 2021 17:36
@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 1m 5s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ fgl Compile Tests _
-1 ❌ mvninstall 0m 30s /branch-mvninstall-root.txt root in fgl failed.
-1 ❌ compile 0m 29s /branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.txt hadoop-hdfs in fgl failed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.
-1 ❌ compile 0m 12s /branch-compile-hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.txt hadoop-hdfs in fgl failed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.
+1 💚 checkstyle 3m 44s fgl passed
-1 ❌ mvnsite 0m 25s /branch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in fgl failed.
-1 ❌ javadoc 0m 48s /branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.txt hadoop-hdfs in fgl failed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.
+1 💚 javadoc 1m 46s fgl passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
-1 ❌ spotbugs 0m 18s /branch-spotbugs-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in fgl failed.
+1 💚 shadedclient 27m 32s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
-1 ❌ mvninstall 0m 10s /patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch failed.
-1 ❌ compile 0m 11s /patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.txt hadoop-hdfs in the patch failed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.
-1 ❌ javac 0m 11s /patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.txt hadoop-hdfs in the patch failed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.
-1 ❌ compile 0m 11s /patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.txt hadoop-hdfs in the patch failed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.
-1 ❌ javac 0m 11s /patch-compile-hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.txt hadoop-hdfs in the patch failed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10.
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 0m 53s the patch passed
-1 ❌ mvnsite 0m 13s /patch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch failed.
-1 ❌ javadoc 0m 28s /patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.txt hadoop-hdfs in the patch failed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04.
+1 💚 javadoc 1m 20s the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
-1 ❌ spotbugs 0m 11s /patch-spotbugs-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch failed.
+1 💚 shadedclient 22m 54s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 0m 14s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch failed.
+1 💚 asflicense 0m 29s The patch does not generate ASF License warnings.
52m 16s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3232/3/artifact/out/Dockerfile
GITHUB PR #3232
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell
uname Linux de95ef7f5fef 4.15.0-147-generic #151-Ubuntu SMP Fri Jun 18 19:21:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision fgl / 1e7f847cbf8a4146d2d76429d629c481ea9fb301
Default Java Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3232/3/testReport/
Max. process+thread count 521 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3232/3/console
versions git=2.25.1 maven=3.6.3
Powered by Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 50s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ fgl Compile Tests _
+1 💚 mvninstall 33m 33s fgl passed
+1 💚 compile 1m 24s fgl passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 compile 1m 14s fgl passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚 checkstyle 0m 57s fgl passed
+1 💚 mvnsite 1m 22s fgl passed
+1 💚 javadoc 0m 55s fgl passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 javadoc 1m 25s fgl passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
-1 ❌ spotbugs 3m 19s /branch-spotbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html hadoop-hdfs-project/hadoop-hdfs in fgl has 1 extant spotbugs warnings.
+1 💚 shadedclient 18m 56s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 14s the patch passed
+1 💚 compile 1m 18s the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 javac 1m 18s the patch passed
+1 💚 compile 1m 9s the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚 javac 1m 9s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 0m 51s the patch passed
+1 💚 mvnsite 1m 13s the patch passed
+1 💚 javadoc 0m 48s the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 javadoc 1m 19s the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚 spotbugs 3m 22s hadoop-hdfs-project/hadoop-hdfs generated 0 new + 0 unchanged - 1 fixed = 0 total (was 1)
+1 💚 shadedclient 18m 53s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 389m 34s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 38s The patch does not generate ASF License warnings.
481m 16s
Reason Tests
Failed junit tests hadoop.hdfs.server.namenode.TestDeleteRace
hadoop.hdfs.server.namenode.ha.TestObserverNode
hadoop.hdfs.server.namenode.TestAuditLogs
hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap
hadoop.hdfs.server.namenode.TestNameNodeRecovery
hadoop.hdfs.server.namenode.TestDecommissioningStatusWithBackoffMonitor
hadoop.hdfs.TestDFSUpgradeFromImage
hadoop.hdfs.TestAclsEndToEnd
hadoop.hdfs.server.datanode.TestBatchIbr
hadoop.hdfs.server.namenode.snapshot.TestSnapshot
hadoop.hdfs.server.namenode.snapshot.TestOrderedSnapshotDeletion
hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
hadoop.hdfs.TestFileCreation
hadoop.hdfs.server.namenode.ha.TestEditLogTailer
hadoop.hdfs.TestErasureCodingPolicyWithSnapshot
hadoop.hdfs.TestErasureCodingPolicyWithSnapshotWithRandomECPolicy
hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits
hadoop.hdfs.TestViewDistributedFileSystem
hadoop.hdfs.TestDFSClientRetries
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer
hadoop.hdfs.TestAppendSnapshotTruncate
hadoop.hdfs.server.namenode.TestFileTruncate
hadoop.hdfs.TestRollingUpgrade
hadoop.hdfs.server.namenode.TestStorageRestore
hadoop.hdfs.server.namenode.TestAddBlockRetry
hadoop.hdfs.web.TestFSMainOperationsWebHdfs
hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots
hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
hadoop.hdfs.server.namenode.TestNameEditsConfigs
hadoop.hdfs.server.namenode.TestFSNamesystemLockReport
hadoop.hdfs.TestRollingUpgradeRollback
hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
hadoop.hdfs.server.namenode.TestCacheDirectivesWithViewDFS
hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
hadoop.hdfs.server.namenode.TestCommitBlockSynchronization
hadoop.hdfs.server.namenode.TestPersistentStoragePolicySatisfier
hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
hadoop.hdfs.server.namenode.TestFSImage
hadoop.hdfs.server.namenode.TestAddBlock
hadoop.hdfs.TestPersistBlocks
hadoop.hdfs.server.namenode.snapshot.TestSnapRootDescendantDiff
hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport
hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot
hadoop.hdfs.server.namenode.snapshot.TestFSImageWithOrderedSnapshotDeletion
hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
hadoop.fs.TestHDFSFileContextMainOperations
hadoop.fs.viewfs.TestViewFileSystemOverloadSchemeHdfsFileSystemContract
hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion
hadoop.hdfs.TestDFSRemove
hadoop.hdfs.server.namenode.TestFSNamesystemLock
hadoop.hdfs.server.namenode.TestFSNamesystem
hadoop.hdfs.TestDistributedFileSystem
hadoop.hdfs.server.namenode.TestDecommissioningStatus
hadoop.hdfs.server.namenode.TestCacheDirectives
hadoop.hdfs.server.namenode.TestStartup
hadoop.hdfs.TestRollingUpgradeDowngrade
hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot
hadoop.hdfs.TestEncryptedTransfer
hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3232/4/artifact/out/Dockerfile
GITHUB PR #3232
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell
uname Linux dbf186d4db7f 4.15.0-128-generic #131-Ubuntu SMP Wed Dec 9 06:57:35 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision fgl / 1e7f847cbf8a4146d2d76429d629c481ea9fb301
Default Java Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3232/4/testReport/
Max. process+thread count 2364 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3232/4/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

@prasad-acit
Copy link
Contributor Author

Sorry, some issue with the code push. Rebased and pushed again. Please @shvachko @xinglin help me to review the code.

Copy link
Contributor

@shvachko shvachko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TestFileCreation is still failing for me with

[INFO] Running org.apache.hadoop.hdfs.TestFileCreation
[ERROR] Tests run: 25, Failures: 0, Errors: 1, Skipped: 2, Time elapsed: 93.408 s <<< FAILURE! - in org.apache.hadoop.hdfs.TestFileCreation
[ERROR] testFileCreationNamenodeRestart(org.apache.hadoop.hdfs.TestFileCreation)  Time elapsed: 9.975 s  <<< ERROR!
org.apache.hadoop.ipc.RemoteException(java.lang.AssertionError): Must hold read Lock: key = range key: [1, 16385]
	at org.apache.hadoop.util.PartitionedGSet.getPartition(PartitionedGSet.java:133)
	at org.apache.hadoop.hdfs.server.namenode.INodeMap.get(INodeMap.java:268)
	at org.apache.hadoop.hdfs.server.namenode.FSDirectory.getInode(FSDirectory.java:1625)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.isFileDeleted(FSNamesystem.java:5752)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(FSNamesystem.java:3153)
	at org.apache.hadoop.hdfs.server.namenode.FSDirWriteFileOp.analyzeFileState(FSDirWriteFileOp.java:634)
	at org.apache.hadoop.hdfs.server.namenode.FSDirWriteFileOp.storeAllocatedBlock(FSDirWriteFileOp.java:238)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3036)
	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:908)

@prasad-acit do you think we can fix it here?

@prasad-acit
Copy link
Contributor Author

testFileCreationNamenodeRestart

I am not facing this issue with 3.1.1 branch. Some issue related restart scenario, let me take a look. I will update on this.

@shvachko
Copy link
Contributor

Why 3.1.1 branch? We are using fgl branch here, right?

@prasad-acit
Copy link
Contributor Author

Thanks @shvachko for review & feedback. I have addressed the comments, can you please take a look?
Failed test has nothing related to the version, i found the issue & handled.
Cause: Post restart, IBR & DN register threads also run with write global lock. When these threads release the lock, it has cascading effect on partition locks.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 1m 17s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 2 new or modified test files.
_ fgl Compile Tests _
+1 💚 mvninstall 37m 55s fgl passed
+1 💚 compile 1m 37s fgl passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 compile 1m 29s fgl passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚 checkstyle 1m 10s fgl passed
+1 💚 mvnsite 1m 35s fgl passed
+1 💚 javadoc 1m 4s fgl passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 javadoc 1m 33s fgl passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚 spotbugs 4m 3s fgl passed
+1 💚 shadedclient 21m 8s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 26s the patch passed
+1 💚 compile 1m 32s the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 javac 1m 32s the patch passed
+1 💚 compile 1m 22s the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚 javac 1m 22s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 1m 5s the patch passed
+1 💚 mvnsite 1m 39s the patch passed
+1 💚 javadoc 1m 0s the patch passed with JDK Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
+1 💚 javadoc 1m 31s the patch passed with JDK Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
+1 💚 spotbugs 4m 12s the patch passed
+1 💚 shadedclient 21m 38s patch has no errors when building and testing our client artifacts.
_ Other Tests _
-1 ❌ unit 392m 45s /patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 41s The patch does not generate ASF License warnings.
497m 56s
Reason Tests
Failed junit tests hadoop.hdfs.server.namenode.snapshot.TestRandomOpsWithSnapshots
hadoop.hdfs.server.namenode.TestStartup
hadoop.hdfs.server.namenode.snapshot.TestSnapshot
hadoop.hdfs.server.namenode.TestNameEditsConfigs
hadoop.hdfs.TestRollingUpgradeRollback
hadoop.hdfs.TestStateAlignmentContextWithHA
hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade
hadoop.hdfs.server.namenode.TestDecommissioningStatus
hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion
hadoop.hdfs.server.namenode.TestStorageRestore
hadoop.hdfs.server.namenode.snapshot.TestOrderedSnapshotDeletion
hadoop.hdfs.server.namenode.TestFSNamesystemLock
hadoop.hdfs.server.namenode.TestDecommissioningStatusWithBackoffMonitor
hadoop.hdfs.server.namenode.TestNameNodeRecovery
hadoop.hdfs.TestDFSShell
hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots
hadoop.hdfs.server.namenode.TestFSNamesystemLockReport
hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
hadoop.hdfs.server.namenode.TestCommitBlockSynchronization
hadoop.hdfs.TestViewDistributedFileSystem
hadoop.hdfs.server.namenode.TestPersistentStoragePolicySatisfier
hadoop.hdfs.server.namenode.TestCacheDirectives
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer
hadoop.hdfs.server.namenode.snapshot.TestSnapRootDescendantDiff
hadoop.hdfs.server.namenode.TestFileTruncate
hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints
hadoop.hdfs.server.namenode.snapshot.TestFSImageWithOrderedSnapshotDeletion
hadoop.hdfs.server.namenode.snapshot.TestXAttrWithSnapshot
hadoop.hdfs.TestErasureCodingPolicyWithSnapshotWithRandomECPolicy
hadoop.hdfs.server.namenode.TestFSImage
hadoop.hdfs.server.datanode.TestBlockScanner
hadoop.hdfs.server.datanode.TestBatchIbr
hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap
hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits
hadoop.hdfs.TestViewDistributedFileSystemContract
hadoop.hdfs.server.namenode.TestAuditLogs
hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport
hadoop.hdfs.server.blockmanagement.TestReplicationPolicy
hadoop.hdfs.server.namenode.TestCacheDirectivesWithViewDFS
hadoop.hdfs.TestSnapshotCommands
hadoop.hdfs.TestRollingUpgrade
hadoop.hdfs.server.namenode.TestFSImageWithSnapshot
hadoop.hdfs.TestDFSUpgradeFromImage
hadoop.hdfs.server.namenode.TestFSNamesystem
hadoop.hdfs.TestDistributedFileSystem
hadoop.hdfs.TestErasureCodingPolicyWithSnapshot
hadoop.hdfs.server.namenode.snapshot.TestAclWithSnapshot
hadoop.hdfs.TestRollingUpgradeDowngrade
hadoop.fs.viewfs.TestViewFsAtHdfsRoot
hadoop.hdfs.server.namenode.TestDeleteRace
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3232/6/artifact/out/Dockerfile
GITHUB PR #3232
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell
uname Linux bead5799df55 4.15.0-147-generic #151-Ubuntu SMP Fri Jun 18 19:21:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision fgl / 117814d
Default Java Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3232/6/testReport/
Max. process+thread count 2773 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3232/6/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

@shvachko
Copy link
Contributor

+1 this looks good now. Will commit in a bit

@shvachko
Copy link
Contributor

@prasad-acit I removed on commit those lines that you commented out.

@github-actions
Copy link
Contributor

We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
If you feel like this was a mistake, or you would like to continue working on it, please feel free to re-open it and ask for a committer to remove the stale tag and review again.
Thanks all for your contribution.

@github-actions github-actions bot added the Stale label Nov 27, 2025
@github-actions github-actions bot closed this Nov 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants