Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

sync #5

Merged
merged 499 commits into from Oct 16, 2021
Merged

sync #5

merged 499 commits into from Oct 16, 2021

Conversation

GuoPhilipse
Copy link
Owner

NOTICE

Please create an issue in ASF JIRA before opening a pull request,
and you need to set the title of the pull request which starts with
the corresponding JIRA issue number. (e.g. HADOOP-XXXXX. Fix a typo in YYY.)
For more details, please see https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute

akshatb1 and others added 30 commits July 23, 2021 17:07
#3135)

YARN-10829. Support getApplications API in FederationClientInterceptor (#3135)
…rent length than the expected" as EOFException (#3040)


Some network exceptions can raise SdkClientException with message
`Data read has a different length than the expected`.

These should be recoverable.

Contributed by Bogdan Stolojan
…3203)

* YARN-10833. Set the X-FRAME-OPTIONS header for the default contexts.

* fixup: YARN-10833. Set the X-FRAME-OPTIONS header for the default contexts.

Co-authored-by: Benjamin Teke <bteke@cloudera.com>
…ngs (#2442)

Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
…tional reads - Added the invalid SpotBugs warning to findbugs-exclude.xml (#3223)
…old version MR tarball work with new version (3.0) of hadoop. (#3227)

Revert "HDFS-10845. Change defaults in hdfs-site.xml to match timeunit type. Contributed by Yiqun Lin"

This reverts commit b6d839a.

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
Bumps [http-proxy](https://github.com/http-party/node-http-proxy) from 1.18.0 to 1.18.1.
- [Release notes](https://github.com/http-party/node-http-proxy/releases)
- [Changelog](https://github.com/http-party/node-http-proxy/blob/master/CHANGELOG.md)
- [Commits](http-party/node-http-proxy@1.18.0...1.18.1)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
…). Contributed by tomscut.

Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
…mically (#3228). Contributed by Viraj Jasani.

Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
#2706)


This (big!) patch adds support for client side encryption in AWS S3,
with keys managed by AWS-KMS.

Read the documentation in encryption.md very, very carefully before
use and consider it unstable.

S3-CSE is enabled in the existing configuration option
"fs.s3a.server-side-encryption-algorithm":

fs.s3a.server-side-encryption-algorithm=CSE-KMS
fs.s3a.server-side-encryption.key=<KMS_KEY_ID>

You cannot enable CSE and SSE in the same client, although
you can still enable a default SSE option in the S3 console. 
  
* Filesystem list/get status operations subtract 16 bytes from the length
  of all files >= 16 bytes long to compensate for the padding which CSE
  adds.
* The SDK always warns about the specific algorithm chosen being
  deprecated. It is critical to use this algorithm for ranged
  GET requests to work (i.e. random IO). Ignore.
* Unencrypted files CANNOT BE READ.
  The entire bucket SHOULD be encrypted with S3-CSE.
* Uploading files may be a bit slower as blocks are now
  written sequentially.
* The Multipart Upload API is disabled when S3-CSE is active.

Contributed by Mehakmeet Singh
…eturned to the ATS before the domain log. Contributed by Xiaomin Zhang
…is invalid. (#3185)

* HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid

* HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid

* HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid

* HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid

* HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid

Co-authored-by: jiaguodong5 <jiaguodong5@jd.com>
…avoid failed volumes at datanodes. (#3175)

Change-Id: Iead25812d4073e3980893e3e76f7d2b03b57442a

Co-authored-by: Zhihai Xu <zxu@apache.org>
…3212)

Co-authored-by: Andras Gyori <gandras@cloudera.com>
Co-authored-by: zhujianghua <zhujianghua@zhujianghuadeMacBook-Pro.local>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
…bute provider permissions). Contributed by Stephen O'Donnell
…ails intermittently. Contributed by Andras Gyory & Prabhu Joseph
…ff enable (#3230)

Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
… namenode to crash when rolling editlog. Contributed by Wan Chang.

Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Stephen O'Donnell <sodonnel@apache.org>
…SocketTimeout exception. (#2836)

Co-authored-by: zhujianghua <zhujianghua@zhujianghuadeMacBook-Pro.local>
Reviewed-by: cxorm <lianp964@gmail.com>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
…3194)

YARN-10841. Fix token reset synchronization for UAM response token.  Contributed by Minni Mittal
S O'Donnell and others added 29 commits October 6, 2021 15:04
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
…OUtils (#3515)

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
…ion in hadoop-common-project modules (#3503)

Reviewed-by: Ahmed Hussein <ahussein@apache.org>
…ded. Contributed by Tamas Domok

Co-authored-by: Tamas Domok <tdomok@cloudera.com>
…e pending application is missing from usersManager. Contributed by Benjamin Teke

Co-authored-by: Benjamin Teke <bteke@cloudera.com>
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
…ion in hadoop-hdfs-project modules (#3530)

Reviewed-by: Ahmed Hussein <ahussein@apache.org>
…ion in hadoop-cloud-storage-project and hadoop-mapreduce-project modules (#3537)

Reviewed-by: Ahmed Hussein <ahussein@apache.org>
Co-authored-by: zhanghuazong <Zhz@20068867>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
* HDFS-16274. Improve log for FSNamesystem#startFileInt

* fix failed unit test
…ith quota disabled. Contributed by Chengwei Wang.
@GuoPhilipse GuoPhilipse merged commit de633b8 into GuoPhilipse:trunk Oct 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet