Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

sync #3

Merged
merged 363 commits into from Apr 7, 2021
Merged

sync #3

merged 363 commits into from Apr 7, 2021

Conversation

GuoPhilipse
Copy link
Owner

sync

Hexiaoqiao and others added 30 commits January 31, 2021 19:45
@Hexiaoqiao
HADOOP-17501. Fix logging typo in ShutdownHookManager. Contributed by…
06e836c 
… Fengnan Li.
@GauthamBanasandra
HADOOP-17506. Fix typo in BUILDING.txt (#2662)
9801b78
@GauthamBanasandra
HADOOP-17507. Add install notes GCC9, CMake 3.19 (#2663)
6fafdd7
@smengcl
HADOOP-17424. Replace HTrace with No-Op tracer (#2645)
1a205cc
@aajisaka
HADOOP-17354. Move Jenkinsfile outside of the root directory. (#2647)
84b154e 
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
@Nargeshdb
HDFS-15791. Possible Resource Leak in FSImageFormatProtobuf. (#2652)
115623a
@Hexiaoqiao
HDFS-15792. ClasscastException while loading FSImage. Contributed by …
b541346 
…Renukaprasad C.
@belugabehr
HADOOP-17482: Remove Commons Logger from FileSystem Class (#2633)
21a3fc3
@GauthamBanasandra
HADOOP-17508. Simplify deps install instructions (#2664)
a163aa7
@Hexiaoqiao
HDFS-15792. Addendum: ClasscastException while loading FSImage. Contr…
1b893e1 
…ibuted by Renukaprasad C.
@szilard-nemeth
YARN-10604. Support auto queue creation without mapping rules. Contri…
7d88953 
…buted by Andras Gyori
@szilard-nemeth
YARN-10605. Add queue-mappings-override.enable property in FS2CS conv…
9bf2ac0 
…ersions. Contributed by Andras Gyori
@crossfire
HDFS-15795. EC: Wrong checksum when reconstruction was failed by exce…
18978f2 
…ption. Contributed by Yushi Hayasaka (#2657)
@GauthamBanasandra
HADOOP-17509. Parallelize building of dependencies (#2669)
6c891c0 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
@steveloughran
HADOOP-15710. ABFS checkException to map 403 to AccessDeniedException. (
f37bf65 
#2648)



When 403 is returned from an ABFS HTTP call, an AccessDeniedException is raised.
The exception text is unchanged, for any application string matching on the getMessage() contents.

Contributed by Steve Loughran.
@bibinchundatt
YARN-10352 Skip schedule on not heartbeated nodes in Multi Node Place…
6fc26ad 
…ment. Contributed by Prabhu Joseph and Qi Zhu
@YaYun-Wang
HDFS-15624. fix the function of setting quota by storage type (#2377)
394b9f7 
1. puts NVDIMM to the end of storage type enum to make sure compatibility.
2. adds check to make sure the software layout version is satisfied

Co-authored-by: su xu <kevinbrandon@163.com>
Co-authored-by: huangtianhua <huangtianhua223@gmail.com>

Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: Vinayakumar B <vinayakumarb@apache.org>
@ferhui
HDFS-15803. EC: Remove unnecessary method (getWeight) in StripedRecon…
66ecee3 
…structionInfo. Contributed by huhaiyang
@steveloughran
HADOOP-17337. S3A NetworkBinding has a runtime dependency on shaded h…
26b9d48 
…ttpclient. (#2599)


Contributed by Steve Loughran.
@kihwal
HDFS-15799. Make DisallowedDatanodeException terse. Contributed by Ri…
182623d 
…chard Ross.
@ferhui
HDFS-15779. EC: fix NPE caused by StripedWriter.clearBuffers during r…
15a1f7a 
…econstruct block. Contributed by Hongbing Wang
@szilard-nemeth
YARN-10612. Fix findbugs issue introduced in YARN-10585. Contributed …
c174141 
…by Gergely Pollak
@bilaharith
HADOOP-17475. ABFS : add high performance listStatusIterator (#2548)
5f34271 
The ABFS connector now implements listStatusIterator() with
asynchronous prefetching of the next page(s) of results.
For listing large directories this can provide tangible speedups.

If for any reason this needs to be disabled, set
fs.azure.enable.abfslistiterator to false.

Contributed by Bilahari T H.
@ericbadger
YARN-10611. Fix that shaded should be used for google guava imports in …
5e719bf 
…YARN-10352. Contributed by Qi Zhu
@maobaolong
HDFS-15819. Fix import style #2681
b99dba3
HDFS-15798. EC: Reconstruct task failed, and It would be XmitsInProgr…
7ef2875 
…ess of DN has negative number. Contributed by huhaiyang
@aajisaka
HADOOP-17432. [JDK 16] KerberosUtil#getOidInstance is broken by JEP 3…
52217fc 
…96 (#2546)

Reviewed-by: Steve Loughran <stevel@apache.org>
@amahussein
HADOOP-17513. Checkstyle IllegalImport does not catch guava imports (#…
65857ea 
…2678)

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
@szilard-nemeth
YARN-10428. Zombie applications in the YARN queue using FAIR + sizeba…
79a4659 
…sedweight. Contributed by Guang Yang, Andras Gyori
@szilard-nemeth
YARN-10610. Add queuePath to RESTful API for CapacityScheduler consis…
c19326c 
…tent with FairScheduler queuePath. Contributed by Qi Zhu
saintstack and others added 29 commits March 31, 2021 10:43
@saintstack
Revert "HADOOP-16524. Automatic keystore reloading for HttpServer2"
22961a6 
This reverts commit a2975d2.
@bolerio @saintstack
HADOOP-16524. Automatic keystore reloading for HttpServer2
2c482fb 
Reapply of issue reverted first because it caused yarn failures and
then again because the commit message was incorrectly formatted
(and yet again because of commit message format).

Signed-off-by: stack <stack@apache.org>
@aajisaka
Revert "HADOOP-17608. Fix NPE in TestKMS (#2828)"
a94a23a 
This reverts commit d69088a.
@Hexiaoqiao
HDFS-15921. Improve the log for the Storage Policy Operations. Contri…
5eca748 
…buted by Bhavik Patel.
@brahmareddybattula
HDFS-15494. TestReplicaCachingGetSpaceUsed#testReplicaCachingGetSpace…
0665ce9 
…UsedByRBWReplica Fails on Windows. Contributed by Ravuri Sushma sree.
@pbacsko
YARN-10720. YARN WebAppProxyServlet should support connection timeout…
a0deda1 
… to prevent proxy server from hanging. Contributed by Qi Zhu.
@pbacsko
YARN-9618. NodesListManager event improvement. Contributed by Qi Zhu.
9f1655b
@pbacsko
YARN-10726. Log the size of DelegationTokenRenewer event queue in cas…
158758c 
…e of too many pending events. Contributed by Qi Zhu.
@virajjasani
HDFS-15931 : Fix non-static inner classes for better memory management (
4f28738 
#2830). Contributed by Viraj Jasani

Signed-off-by: Mingliang Liu <liuml07@apache.org>
@tomscut
HDFS-15892. Add metric for editPendingQ in FSEditLogAsync (#2770)
4bd0412 
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
@tomscut
HDFS-15938. Fix java doc in FSEditLog (#2837). Contributed by tomscut.
7c83f14 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
@brahmareddybattula
HDFS-15222. Correct the "hdfs fsck -list-corruptfileblocks" command o…
ed74479 
…utput. Contributed by Ravuri Sushma sree.
@brahmareddybattula
HADOOP-17610. DelegationTokenAuthenticator prints token information. …
478402c 
…Contributed by Ravuri Sushma sree.
@brahmareddybattula
HADOOP-17587. Kinit with keytab should not display the keytab file's …
bc7689a 
…full path in any logs. Contributed by Ravuri Sushma sree.
@GauthamBanasandra
HDFS-15944. Prevent truncation by snprintf (#2853)
70536ba
@tomscut
HDFS-15946. Fix java doc in FSPermissionChecker (#2855). Contributed …
3cb7644 
…by tomscut.

Signed-off-by: Mingliang Liu <liuml07@apache.org>
HDFS-15930: Fix some @param errors in DirectoryScanner. (#2829). Cont…
96e410a 
…ributed by Qi Zhu.

Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
HADOOP-17619: Fix DelegationTokenRenewer#updateRenewalTime java doc e…
5eaa1b7 
…rror. (#2846). Contributed by Qi Zhu.

Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
@jojochuang
HADOOP-17614. Bump netty to the latest 4.1.61. (#2850)
29a6769 
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
@GauthamBanasandra
HDFS-15950. Remove unused hdfs.proto import (#2858)
ca5e13f 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
@tomscut
HDFS-15951. Remove unused parameters in NameNodeProxiesClient (#2859)
9e2d5d6 
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
@GauthamBanasandra
HDFS-15947. Replace deprecated protobuf APIs (#2856)
6e1df1c
@virajjasani
HDFS-15940. Fixing and refactoring tests specific to Block recovery.(#…
de05cef 
…2844). Contributed by Viraj Jasani

Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
@ericbadger
YARN-10702. Add cluster metric for amount of CPU used by RM Event Pro…
26b8f67 
…cessor.

Contributed by Jim Brennan.
@virajjasani
HADOOP-17622. Avoid usage of deprecated IOUtils#cleanup API. (#2862)
3f2682b 
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
@GauthamBanasandra
HDFS-15949. Fix integer overflow (#2857)
36014b8 
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
HADOOP-17588. CryptoInputStream#close() should be syncronized. Contri…
e86050f 
…buted by RenukaPrasad C
@Hexiaoqiao
HDFS-15942. Increase Quota initialization threads. Contributed by Ste…
459df41 
…phen O'Donnell.
@GauthamBanasandra
HDFS-15909. Make fnmatch cross platform (#2792)
42ddb5c
@GuoPhilipse GuoPhilipse merged commit d4f968b into GuoPhilipse:trunk Apr 7, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone