77 Pull requests merged by 22 people

• HDFS-17762. [ARR] Reset CallerContext information when async handler thread done

  #7539 merged Mar 31, 2025

• YARN-11802. Avoid reflection in TestAsyncDispatcher

  #7541 merged Mar 31, 2025

• HDFS-15230. Revert "HDFS-14884. Add sanity check that zone key equals feinfo key while setting Xattrs. Contributed by Mukul Kumar Singh."

  #7529 merged Mar 28, 2025

• HDFS-16644.java.io.IOException Invalid token in javax.security.sasl.qop

  #5962 merged Mar 28, 2025

• HADOOP-19437. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-kafka.

  #7547 merged Mar 28, 2025

• HADOOP-15224. Add option to set checksum on S3 object uploads

  #7396 merged Mar 28, 2025

• HDFS-17159.Can't decode Identifier HDFS tokens with only the hdfs client jar

  #5949 merged Mar 27, 2025

• HADOOP-19236 Incorporate VolcanoEngine Cloud TOS File System Implementation. (Part 1: Core implementation)

  #7504 merged Mar 27, 2025

• HADOOP-19474: [ABFS][FnsOverBlob] Listing Optimizations to avoid multiple iteration over list response.

  #7421 merged Mar 27, 2025

• YARN-11262. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-server-resourcemanager Part6.

  #7490 merged Mar 27, 2025

• YARN-11798. Precheck request separately to avoid redundant node checks and optimize performance for global scheduler.

  #7516 merged Mar 27, 2025

• YARN-11266. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-server-timelineservice-hbase-tests.

  #7538 merged Mar 27, 2025

• YARN-11796. Accept extra JDK 17 options in tests

  #7512 merged Mar 26, 2025

• Revert "HADOOP-19502. Add RegexpSingleline module to checkstyle.xml."

  #7534 merged Mar 25, 2025

• HADOOP-19502. Add RegexpSingleline module to checkstyle.xml.

  #7505 merged Mar 25, 2025

• YARN-11262. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-server-resourcemanager Part5.

  #7489 merged Mar 25, 2025

• HDFS-17749. [ARR] Fix wrong results due to the wrong usage of asyncComplete in getListing.

  #7466 merged Mar 25, 2025

• YARN-11262. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-server-resourcemanager Part4.

  #7488 merged Mar 25, 2025

• HADOOP-19508. Set charsetEncoder in HadoopArchiveLogs

  #7520 merged Mar 24, 2025

• YARN-11795. Skip BaseFederationPoliciesTest.testReinitilializeBad3() on JVMs where Mockito cannot mock ByteBuffers

  #7510 merged Mar 24, 2025

• HADOOP-18991 Remove commons-beanutils dependency from Hadoop 3

  #7524 merged Mar 24, 2025

• HADOOP-19488 fix temporary directory creation (branch-3.4)

  #7530 merged Mar 23, 2025

• HADOOP-19488 fix the temporary directory creation on Windows

  #7511 merged Mar 22, 2025

• HADOOP-19509. Add a config entry to make IPC.Client checkAsyncCall off by default.

  #7521 merged Mar 21, 2025

• YARN-11788. Remove unused unit tests.

  #7476 merged Mar 21, 2025

• HDFS-17714. MockResolver#removeLocation should also remove src path.

  #7313 merged Mar 21, 2025

• HDFS-17713. [ARR] Throtting asynchronous calls for each nameservice.

  #7304 merged Mar 21, 2025

• YARN-11787. [Federation] Enhance Exception Handling in FederationClientInterceptor#forceKillApplication.

  #7465 merged Mar 21, 2025

• HDFS-17759. Explicitly depend on jackson-core in hadoop-hdfs

  #7508 merged Mar 21, 2025

• HADOOP-19445 [branch-3.4]: ABFS: [FnsOverBlob][Tests] Add Tests For Negative Scenarios Identified for Rename Operation

  #7525 merged Mar 20, 2025

• HADOOP-19446. ABFS: [Backport to 3.4][FnsOverBlob][Tests] Add Tests For Negative Scenarios Identified for Delete Operation

  #7522 merged Mar 20, 2025

• YARN-11262. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-server-resourcemanager Part3.

  #7485 merged Mar 19, 2025

• MAPREDUCE-7504. Remove terminally deprecated Thread.suspend from TestMergeManager

  #7519 merged Mar 19, 2025

• HADOOP-19506. Fix TestThrottledInputStream when bandwidth is equal to throttle limit.

  #7517 merged Mar 19, 2025

• YARN-11797. Fix tests trying to connect to 0.0.0.0

  #7515 merged Mar 19, 2025

• HADOOP-18940. [ABFS] Remove commons IOUtils.close() from AbfsOutputStream

  #7506 merged Mar 18, 2025

• YARN-11799. Remove PrintStream write counting from TestYarnCLI

  #7518 merged Mar 18, 2025

• HADOOP-19500. Skip tests that require JavaScript engine when it's not available

  #7503 merged Mar 17, 2025

• MAPREDUCE-7503. Fix ByteBuf leaks in TestShuffleChannelHandler

  #7500 merged Mar 14, 2025

• HADOOP-19452. Client#call decrease asyncCallCounter incorrectlly when exceptions occur.

  #7384 merged Mar 13, 2025

• HDFS-17735. [ARR] LocalResolver#getDatanodesSubcluster adapts to async rpc.

  #7422 merged Mar 13, 2025

• YARN-11262. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-server-resourcemanager Part2.

  #7484 merged Mar 12, 2025

• YARN-11262. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-server-resourcemanager Part1.

  #7474 merged Mar 12, 2025

• HADOOP-19446. ABFS: [FnsOverBlob][Tests] Add Tests For Negative Scenarios Identified for Delete Operation

  #7376 merged Mar 12, 2025

• YARN-11765. Refactor: Move Clock Class from hadoop-mapreduce-project to hadoop-common-project for Reusability

  #7352 merged Mar 12, 2025

• HDFS-17743: Added support for random datanode ordering in getBlockLocations()

  #7447 merged Mar 11, 2025

• HADOOP-19444: ABFS: [FnsOverBlob][Tests] Add Tests For Negative Scenarios Identified for Ingress Operations

  #7424 merged Mar 11, 2025

• HDFS-17754: Add uriparser2 to notices

  #7481 merged Mar 11, 2025

• HDFS-17746. [ARR] The behavior of throwing exception in getListing should be consistent with sync mode.

  #7464 merged Mar 11, 2025

• HDFS-17750. [ARR] RouterWebHdfsMethods adapts to async rpc.

  #7462 merged Mar 11, 2025

• HADOOP-19487. Upgrade libopenssl to 3.1.1 for rsync on Windows

  #7487 merged Mar 10, 2025

• YARN-11786. Upgrade hadoop-yarn-server-timelineservice-hbase-tests to Support Trunk Compilation and Remove compatible hadoop version.

  #7453 merged Mar 10, 2025

• HADOOP-19086. Update commons-logging to 1.3.0

  #7472 merged Mar 7, 2025

• HDFS-17744. [ARR] getEnclosingRoot RPC adapts to async rpc.

  #7445 merged Mar 7, 2025

• YARN-11790: TestAmFilter#testProxyUpdate fails in some networks

  #7478 merged Mar 7, 2025

• HADOOP-19152. (3.4) Do not hard code security providers

  #7439 merged Mar 6, 2025

• HADOOP-19480. Upgrades AAL version to 1.0.0.

  #7469 merged Mar 6, 2025

• YARN-11776. Handle NPE in the RMDelegationTokenIdentifier if localServiceAddress is null.

  #7431 merged Mar 6, 2025

• HDFS-17753. Fix occasional failure of TestRouterHttpServerXFrame.

  #7467 merged Mar 6, 2025

• Integrate analytics accelerator into S3A.

  #7471 merged Mar 5, 2025

• HADOOP-19445: ABFS: [FnsOverBlob][Tests] Add Tests For Negative Scenarios Identified for Rename Operation

  #7386 merged Mar 5, 2025

• YARN-11785. Race condition in QueueMetrics due to non-thread-safe HashMap causes MetricsException.

  #7459 merged Mar 5, 2025

• HADOOP-19270 Use stable sort in commandQueue

  #7038 merged Mar 4, 2025

• YARN-11268. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-server-timelineservice-documentstore.

  #7450 merged Mar 4, 2025

• YARN-11263. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-server-nodemanager Part2.

  #7455 merged Mar 4, 2025

• HDFS-17748. Fix javadoc problems caused by HDFS-17496.

  #7460 merged Mar 4, 2025

• YARN-11783. Upgrade wro4j to 1.8.0

  #7457 merged Mar 4, 2025

• YARN-11244. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-client.

  #7438 merged Mar 4, 2025

• YARN-11782. [Federation] Fix incorrect error messages and improve failure handling.

  #7449 merged Mar 3, 2025

• HADOOP-19476. Create python3 symlink needed for mvnsite

  #7452 merged Mar 3, 2025

• HADOOP-19303. VectorIO API: support pass-down of a release() operator

  #7418 merged Mar 3, 2025

• HDFS-17733. [ARR] Optimize isMultiDestDirectory method using AsyncUtil class

  #7415 merged Mar 3, 2025

• HDFS-17731. [ARR] Add unit test for async RouterAdminServer.

  #7409 merged Mar 3, 2025

• HDFS-17745. TestRouterMountTable should reset defaultNSEnable to true after each test method.

  #7446 merged Mar 3, 2025

• YARN-11258. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-server-common.

  #7437 merged Mar 2, 2025

• YARN-11263. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-server-nodemanager Part1.

  #7390 merged Mar 2, 2025

• YARN-11762. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-server-globalpolicygenerator.

  #7389 merged Mar 1, 2025

47 Pull requests opened by 24 people

• YARN-11781. Implement Dynamic Requests Handling in CapacityScheduler

  #7448 opened Mar 1, 2025

• HADOOP-19477:Update GitHub Actions to latest versions

  #7454 opened Mar 2, 2025

• Do not merge, just for validating.

  #7456 opened Mar 2, 2025

• HADOOP-19471. ABFS: Support Fixed SAS Token at Container Level

  #7461 opened Mar 4, 2025

• HADOOP-19478. S3A: pull out new configuration load/probes under S3AStore

  #7463 opened Mar 4, 2025

• HDFS-17752. Host2DatanodeMap will not update when re-register a node …

  #7468 opened Mar 5, 2025

• HDFS-17751. [ARR] Add unit tests using asynchronous router rpc for all in org.apache.hadoop.hdfs.server.federation.router.

  #7470 opened Mar 5, 2025

• HADOOP-19481 Upgrade to com.google.guava 32.1.3-jre to fix security issues

  #7473 opened Mar 5, 2025

• HDFS-15474: Enable WebHdfsFileSystem to parse InvalidToken responce from HttpFS

  #7475 opened Mar 6, 2025

• HDFS-17705. Improve datasetlock related log output.

  #7477 opened Mar 6, 2025

• HADOOP-19485. S3A: upgrade AWS SDK

  #7479 opened Mar 7, 2025

• HADOOP-19282. STSClientFactory: do not use URIBuilder

  #7483 opened Mar 7, 2025

• HDFS-17755. Enhance refreshVolumes usability and code structure.

  #7486 opened Mar 8, 2025

• HDFS-17756. Fix endlessLoop issue caused by ReplicaMap#mergeAll method.

  #7491 opened Mar 9, 2025

• HADOOP-19489. Remove broken Centos 7 C++ precommit checks from CI

  #7493 opened Mar 10, 2025

• HADOOP-19490. S3A: AWS SDK 2.30+ incompatible with third party stores

  #7494 opened Mar 10, 2025

• HADOOP-19494: [ABFS] Fix Case Sensitivity Issue for hdi_isfolder metadata

  #7496 opened Mar 11, 2025

• YARN-11793: Replace Grizzly with Jetty in Jersey Test Framework

  #7497 opened Mar 11, 2025

• HDFS-17743: Added support for random datanode ordering in getBlockLocations()

  #7498 opened Mar 11, 2025

• YARN-11794. hadoop-yarn-csi does not build on included Centos 7 docker image

  #7499 opened Mar 12, 2025

• HADOOP-19501. Skip tests that depend on SecurityManager if the JVM does not support it

  #7507 opened Mar 14, 2025

• HADOOP-19497: [ABFS] Enable rename and create recovery from client transaction id over DFS endpoint

  #7509 opened Mar 15, 2025

• [WIP] Reduce Number of connections for concurrent users

  #7513 opened Mar 16, 2025

• HDFS-17760. Fix MoveToTrash throws ParentNotDirectoryException when there is a file inode with the same name in the trash

  #7514 opened Mar 17, 2025

• HADOOP-19406. ABFS: [FNSOverBlob] Support User Delegation SAS for FNS Blob

  #7523 opened Mar 20, 2025

• Don't merge. just for testing.

  #7526 opened Mar 21, 2025

• HADOOP-19447. Add Caching Mechanism to HostResolver to Avoid Redundant Hostname Resolutions

  #7527 opened Mar 21, 2025

• HADOOP-19398: Upgrade Dockerfile base to jammy

  #7532 opened Mar 23, 2025

• HDFS-17761. [ARR] RouterNetworkTopologyServlet adapts to async router rpc.

  #7533 opened Mar 25, 2025

• [HADOOP-18652][HADOOP-18856] Properly support root bucket paths in Path.suffix

  #7536 opened Mar 25, 2025

• HADOOP-19515. ABFS: Updating Documentations of Hadoop Drivers for Azure

  #7540 opened Mar 26, 2025

• YARN-11803. Skip SecurityManager tests in TestJavaSandboxLinuxContainerRuntime when SecurityManager is not available

  #7543 opened Mar 27, 2025

• HADOOP-19236 Incorporate VolcanoEngine Cloud TOS File System Implementation. (Part 2: Add unit tests)

  #7545 opened Mar 27, 2025

• YARN-11267. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-yarn-server-router.

  #7546 opened Mar 27, 2025

• HADOOP-19438. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-resourceestimator.

  #7548 opened Mar 28, 2025

• HADOOP-15224. Add option to set checksum on S3 objects

  #7550 opened Mar 28, 2025

• HDFS-17764. Connection#stop is blocking when FileSystem#close

  #7551 opened Mar 29, 2025

• HADOOP-19439. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-rumen.

  #7552 opened Mar 29, 2025

• HADOOP-19440. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-sls.

  #7553 opened Mar 29, 2025

• HADOOP-19441. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-streaming.

  #7554 opened Mar 29, 2025

• #HADOOP-19520 Fix preservedEntries count in CopyCommitter when preser…

  #7555 opened Mar 30, 2025

• HADOOP-19521. Fix time unit mismatch in method updateDeferredMetrics.

  #7557 opened Mar 31, 2025

• YARN-11805. Skip tests in TestTimelineWriterHBaseDown when InaccessibleObjectException is thrown

  #7558 opened Mar 31, 2025

• HADOOP-19522: ABFS: [FnsOverBlob] Rename Recovery Should Succeed When Marker File Exists with Destination Directory

  #7559 opened Mar 31, 2025

• HADOOP-19523. Upgrade to hadoop-thirdparty 1.4.0

  #7560 opened Mar 31, 2025

• HDFS-17766. [ARR] Avoid initializing unused threadPool in RouterAsyncRpcClient.

  #7561 opened Mar 31, 2025

• HADOOP-19517 [java.time] hadoop-common

  #7562 opened Mar 31, 2025

22 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• HADOOP-19399. S3A: support CRT client.

  #7443 commented on Mar 31, 2025 • 34 new comments

• HADOOP-19256 Support Conditional Writes in S3A

  #7329 commented on Mar 18, 2025 • 8 new comments

• HADOOP-19212 [JDK23] org.apache.hadoop.security.UserGroupInformation …

  #7434 commented on Mar 31, 2025 • 1 new comment

• HADOOP-19091: Add support for Tez to MagicS3GuardCommitter

  #7441 commented on Mar 28, 2025 • 0 new comments

• HADOOP-19259. Upgrade to jackson 2.14.3

  #7428 commented on Mar 9, 2025 • 0 new comments

• HADOOP-19469. Set Curator Connection Timeout.

  #7426 commented on Mar 1, 2025 • 0 new comments

• HADOOP-19415. [JDK17] Upgrade JUnit from 4 to 5 in hadoop-common Part6.

  #7419 commented on Mar 28, 2025 • 0 new comments

• HDFS-17732. addExpectedReplicasToPending should add EC block expectedStorages in PendingReconstructionBlocks.

  #7414 commented on Mar 7, 2025 • 0 new comments

• Bump io.netty:netty-common from 4.1.116.Final to 4.1.118.Final in /hadoop-project

  #7387 commented on Mar 24, 2025 • 0 new comments

• Bump io.netty:netty-handler from 4.1.116.Final to 4.1.118.Final in /hadoop-project

  #7377 commented on Mar 24, 2025 • 0 new comments

• YARN-11766. Implement DELAYED_OR operator in the scheduling process for Rich Placement Constraint.

  #7365 commented on Mar 4, 2025 • 0 new comments

• HADOOP-19256. steve's pr of conditional writes

  #7362 commented on Mar 4, 2025 • 0 new comments

• [DISCUSS] [JDK17] Upgrade JUnit / JavaDoc from 4 to 5.

  #7337 commented on Mar 9, 2025 • 0 new comments

• HDFS-17763: Backport HDFS-16547 feature to block observer transition if namenode is in safemode

  #7321 commented on Mar 27, 2025 • 0 new comments

• HADOOP-19384. S3A: Add support for ProfileCredentialsProvider

  #7284 commented on Mar 21, 2025 • 0 new comments

• HADOOP-19236. Integration of Volcano Engine TOS in Hadoop.

  #7194 commented on Mar 15, 2025 • 0 new comments

• HDFS-17658. HDFS decommissioning does not consider if Under Construction blocks are sufficiently replicated which causes HDFS Data Loss

  #7179 commented on Mar 1, 2025 • 0 new comments

• HADOOP-19212. Avoid Subject.getSubject method on newer JVMs

  #7081 commented on Mar 18, 2025 • 0 new comments

• HADOOP-19256 Integrate PutIfNotExist functionality into S3A createFile()

  #7011 commented on Mar 6, 2025 • 0 new comments

• HDFS-16757. Add a new method copyBlockCrossNamespace to DataNode

  #6926 commented on Mar 10, 2025 • 0 new comments

• Test PR: Test Jenkins. (WIP)

  #6707 commented on Mar 20, 2025 • 0 new comments

• HADOOP-18967: Allow no-downtime migration of HDFS clusters into secure mode

  #6293 commented on Mar 21, 2025 • 0 new comments