Skip to content

Merge #6

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1,240 commits into from
Mar 15, 2022
Merged

Merge #6

merged 1,240 commits into from
Mar 15, 2022

Conversation

@Deegue
Copy link
Owner

@Deegue Deegue commented Mar 15, 2022

No description provided.

GuoPhilipse and others added 30 commits November 19, 2021 01:02
@GuoPhilipse
HDFS-16328. Correct disk balancer desc (#3669)
0c1eb01 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
@tomscut
HDFS-16326. Simplify the code for DiskBalancer (#3663)
965e387 
Reviewed-by: Viraj Jasani <vjasani@apache.org>
@GuoPhilipse
HDFS-16334. Correct NameNode ACL description (#3678)
3d1ca6f 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
@ferhui
Revert "HADOOP-17995. Stale record should be remove when DataNodePeer…
8e9ad2d 
…Metrics#dumpSendPacketDownstreamAvgInfoAsJson (#3630)" (#3697)
@tomscut
HDFS-16335. Fix HDFSCommands.md (#3681)
20b78c8
@symious
HDFS-16320. Datanode retrieve slownode information from NameNode (#3654)
c88640c
@smarthanwang
HADOOP-17998. Allow get command to run with multi threads. (#3645)
63018dc
@tomscut
HDFS-16337. Show start time of Datanode on Web (#3682)
0ed817b 
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
@virajjasani
HADOOP-18018. unguava: remove Preconditions from hadoop-tools modules (…
c7ec189 
…#3688)
@virajjasani
HADOOP-18017. unguava: remove Preconditions from hadoop-yarn-project …
c0bdba8 
…modules (#3687)
@mukul1987
HDFS-16343. Add some debug logs when the dfsUsed are not used during …
faa4eea 
…Datanode startup. (#3694)
@afchung
YARN-11003. Make RMNode aware of all (OContainer inclusive) allocated…
5b1b2c8 
… resources (#3646)
@afchung
YARN-10760. Number of allocated OPPORTUNISTIC containers can dip belo…
d3f0b7e 
…w 0 (#3642)
@mehakmeet
HADOOP-18016. Make certain methods LimitedPrivate in S3AUtils.java (#…
a35f7de 
…3685)


Contributed By: Mehakmeet Singh
@hotcodemacha
YARN-10991. Fix to ignore the grouping "[]" for resourcesStr in parse…
08f3df3 
…ResourcesString method (#3592)

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
@fapifta
HADOOP-17975. Fallback to simple auth does not work for a secondary D…
ae3ba45 
…istributedFileSystem instance. (#3579)
@virajjasani
HDFS-16336. De-flake TestRollingUpgrade#testRollback (#3686)
e8566b3 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
@steveloughran
HADOOP-17979. Add Interface EtagSource to allow FileStatus subclasses…
98fe0d0 
… to provide etags (#3633)


Contributed by Steve Loughran
@haiyang1987
HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#…
99b161d 
…dumpSendPacketDownstreamAvgInfoAsJson (#3708)
@virajjasani
HDFS-16350. Datanode start time should be set after RPC server starts…
cdc13e9 
… successfully (#3711)
@tasanuma
HADOOP-18014. CallerContext should not include some characters. (#3698)
9c887e5 
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Mingliang Liu <liuml07@apache.org>
Reviewed-by: Hui Fei <ferhui@apache.org>
@GuoPhilipse
YARN-11007. Correct words in YARN documents (#3680)
c9d64ba 
Reviewed-by: cxorm <lianp964@gmail.com>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
@tomscut
HDFS-16339. Show the threshold when mover threads quota is exceeded (#…
86705ed 
…3689)

Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Hui Fei <ferhui@apache.org>
@virajjasani
HADOOP-18022. Add restrict-imports-enforcer-rule for Guava Preconditi…
215388b 
…ons and remove remaining usages (#3712)

Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
@tomscut
HDFS-16344. Improve DirectoryScanner.Stats#toString (#3695)
829af89 
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Reviewed-by: Hui Fei <ferhui@apache.org>
@smarthanwang
HADOOP-18023. Allow cp command to run with multi threads. (#3721)
932a78f
@GuoPhilipse
HADOOP-18026. Fix default value of Magic committer (#3723)
c65c87f 
Contributed by guophilipse
@Sushmasree-28
YARN-10975 EntityGroupFSTimelineStore#ActiveLogParser parses already …
7b840f2 
…processed files (#3735)

Contributed by  sravuri <sravuri@microsoft.com> and reviewed by Prabhu Joseph
@tomscut
HDFS-16361. Fix log format for QueryCommand (#3732). Contributed by t…
1ebdac2 
…omscut.
@virajjasani
HADOOP-18027. Include static imports in the maven plugin rules (#3733)
4dea4a7 
Reviewed-by: Steve Loughran <stevel@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
tomscut and others added 29 commits March 2, 2022 11:25
@tomscut
HDFS-16458. [SPS]: Fix bug for unit test of reconfiguring SPS mode (#…
9199787 
…4041)
@9uapaw
YARN-10983. Follow-up changes for YARN-10904. Contributed by Benjamin…
9e475ae 
… Teke
@ted12138
HADOOP-18128. Fix typo issues of outputstream.md (#4025)
902a793
@szilard-nemeth
YARN-11042. Fix testQueueSubmitWithACLsEnabledWithQueueMapping in Tes…
356d337 
…tAppManager. Contributed by Tamas Domok
@sunchao
Make upstream aware of 3.3.2 release
f800b65
@tomicooler
YARN-11076. Upgrade jQuery version in Yarn UI2. (#4046)
22fe79c 
Change-Id: I3cb1677741df5a1978e83029443d4a2d5d7e3d7f
@szilard-nemeth
Revert "YARN-10947. Simplify AbstractCSQueue#initializeQueueState. Co…
1c27c69 
…ntributed by Andras Gyori"

This reverts commit de526e1.

With this commit, the patch of
https://issues.apache.org/jira/browse/YARN-10850 has been committed.
@szilard-nemeth
YARN-10947. Simplify AbstractCSQueue#initializeQueueState. Contribute…
379baa5 
…d by Andras Gyori
@mehakmeet
HADOOP-18150. Fix ITestAuditManagerDisabled test in S3A. (#4044)
6995374 
Contributed by Mehakmeet Singh
@virajjasani
HDFS-16481. Provide support to set Http and Rpc ports in MiniJournalC…
2785682 
…luster (#4028). Contributed by Viraj Jasani.
@GauthamBanasandra
HADOOP-18151. Switch the baseurl for Centos 8 (#4047)
1956184 
* Centos 8 has reached its
  End-of-Life and thus its
  packages are no longer
  accessible from
  mirror.centos.org.
* This PR switches the baseurl
  to vault.centos.org where
  the packages are archived.
@GauthamBanasandra
HDFS-16462. Make HDFS get tool cross platform (#4003)
8f07081
@9uapaw
YARN-11049. MutableConfScheduler is referred as plain String instead …
851a4dc 
…of class name. Contributed by Szilard Nemeth
@pjfanning
HADOOP-17563. Upgrade BouncyCastle to 1.68 (#3980)
da5a774 
Contributed by PJ Fanning
@virajjasani
HADOOP-18131. Upgrade maven enforcer plugin and relevant dependencies (…
66b7240 
…#4000)

Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
@sodonnel
HDFS-16496. Snapshot diff on snapshotable directory fails with not sn…
49e4e4d 
…apshottable error (#4051)
@virajjasani
YARN-11081. TestYarnConfigurationFields consistently keeps failing (#…
56d8071 
…4027)

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
@szilard-nemeth
YARN-10945. Add javadoc to all methods of AbstractCSQueue. Contribute…
2ece950 
…d by Andras Gyori
@szilard-nemeth
YARN-10918. Simplify method: CapacitySchedulerQueueManager#parseQueue…
db8ae4b 
…. Contributed by Andras Gyori
@Apache9
HADOOP-17526 Use Slf4jRequestLog for HttpRequestLog (#4050)
db36747 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
@9uapaw
YARN-11052. Improve code quality in TestRMWebServicesNodeLabels. Cont…
9539ff1 
…ributed by Szilard Nemeth
@9uapaw
YARN-11036. Do not inherit from TestRMWebServicesCapacitySched. Contr…
383b734 
…ibuted by Tamas Domok
@GauthamBanasandra
HADOOP-18155. Refactor tests in TestFileUtil (#4053)
d0fa9b5
@szilard-nemeth
YARN-10049. FIFOOrderingPolicy Improvements. Contributed by Benjamin …
481da19 
…Teke
@szilard-nemeth
YARN-11067. Resource overcommitment due to incorrect resource normali…
ed65aa2 
…sation logical order. Contributed by Andras Gyori
@mukund-thakur
HADOOP-18112: Implement paging during multi object delete. (#4045)
672e380 
Multi object delete of size more than 1000 is not supported by S3 and 
fails with MalformedXML error. So implementing paging of requests to 
reduce the number of keys in a single request. Page size can be configured
using "fs.s3a.bulk.delete.page.size" 

 Contributed By: Mukund Thakur
@Hexiaoqiao
HDFS-15382. Split one FsDatasetImpl lock to block pool grain locks. (#…
a32cfc2 
…3941). Contributed by limingxiang.

Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
Signed-off-by: litao <tomleescut@gmail.com>
@omalley
HDFS-16495: RBF should prepend the client ip rather than append it.
7b5eac2 
Fixes #4054

Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
@omalley
HADOOP-18144: getTrashRoot in ViewFileSystem should return a path in …
8b8158f 
…ViewFS.

To get the new behavior, define fs.viewfs.trash.force-inside-mount-point to be true.

If the trash root for path p is in the same mount point as path p,
and one of:
* The mount point isn't at the top of the target fs.
* The resolved path of path is root (eg it is the fallback FS).
* The trash root isn't in user's target fs home directory.
get the corresponding viewFS path for the trash root and return it.
Otherwise, use <mnt>/.Trash/<user>.

Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
@Deegue Deegue merged commit 2a425d0 into Deegue:trunk Mar 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.