HADOOP-18073. Push latest changes from trunk to feature branch. #4944
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…ation. (apache#4686). Contributed by Ayush Saxena. Reviewed-by: Mingliang Liu <liuml07@apache.org>
Add the r3.3.4 changelog, release notes and jdiff xml files.
…pache#4702) Reduces size of data read to 1 MB Contributed by Ahmar Suhail
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com> Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
…onhistoryservice (apache#4603) Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com> Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
…. Contributed by fanshilun.
The name of the option to enable/disable thread level statistics is "fs.iostatistics.thread.level.enabled"; There is also an enabled() probe in IOStatisticsContext which can be used to see if the thread level statistics is active. Contributed by Viraj Jasani
… Contributed by ZanderXu. Reviewed-by: Inigo Goiri <inigoiri@apache.org> Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org> Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
…ed methods. (apache#4403). Contributed by fanshilun. Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
… pipeline creations. (apache#4594)
…licationTimeout REST APIs for Router. (apache#4715)
…jar (apache#4727) Contributed by Yubi Lee.
…m stats. (apache#4704) part of HADOOP-18103. Contributed By: Mukund Thakur
… error (apache#4680) When the MiniDFSClsuter detects that an exception caused an exit, it should include that exception as the cause for the AssertionError that it throws. The current AssertError simply reports the message "Test resulted in an unexpected exit" and provides a stack trace to the location of the check for an exit exception. This patch adds the original exception as the cause of the AssertError.
…rogress tailer if there are some abnormal JNs. (apache#4628)
… no longer in use (apache#4722) Contributed by Viraj Jasani.
… in RouterRpcServer.class (apache#4716). Contributed by ZanderXu. Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
…util.Shell (apache#4718). Contributed by Paul King. Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
…y REST APIs for Router. (apache#4733)
jobId.toString() to only be called when the ID isn't null. this doesn't surface in MR, but spark seems to manage it Change-Id: I06692ef30a4af510c660d7222292932a8d4b5147
… MemoryStateStore. (apache#4852)
…tests with prefetching (apache#4914) Contributed by Viraj Jasani
…pload Failed After YARN-11241. (apache#4893). Contributed by fanshilun. Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
…bleException (apache#4802). Contributed by Ashutosh Gupta. Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
…e#3691). Contributed by guophilipse. Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
…tem environment (apache#4884) Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
follow-on patch to HADOOP-18186. Contributed by: Viraj Jasani
…t to 1.9 (apache#4578) Reviewed-by: Ashutosh Gupta <ashugpt@amazon.com> Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
…en DN gets a reconstruction task (apache#4901)
…4909) This problem surfaced in impala integration tests IMPALA-11592. TestLocalCatalogRetries.test_fetch_metadata_retry fails in S3 build after the change HADOOP-17461. Add thread-level IOStatistics Context The actual GC race condition came with HADOOP-18091. S3A auditing leaks memory through ThreadLocal references The fix for this is, if our hypothesis is correct, in WeakReferenceMap.create() where a strong reference to the new value is kept in a local variable *and referred to later* so that the JVM will not GC it. Along with the fix, extra assertions ensure that if the problem is not fixed, applications will fail faster/more meaningfully. Contributed by Steve Loughran.
…ash.moveToAppropriateTrash (apache#4869) * HADOOP-18444 Add Support for localized trash for ViewFileSystem in Trash.moveToAppropriateTrash Signed-off-by: Xing Lin <xinglin@linkedin.com>
…ervice-hbase-client (apache#4773) Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com> Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
…ervice-hbase-common (apache#4774) Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com> Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com> Reviewed-by: Inigo Goiri <inigoiri@apache.org> Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
… S3AFileSystem field (apache#4926) Follow-on to HADOOP-18455. Contributed by Viraj Jasani
…ing XML received from an untrusted source (apache#4886) Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com> Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
part of HADOOP-18103. Also introducing a config fs.s3a.vectored.active.ranged.reads to configure the maximum number of number of range reads a single input stream can have active (downloading, or queued) to the central FileSystem instance's pool of queued operations. This stops a single stream overloading the shared thread pool. Contributed by: Mukund Thakur
|
💔 -1 overall
This message was automatically generated. |
|
ok, this is now the feature branch. i did this with the help of the github app closing this; if there are problems complain |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description of PR
This PR rebases the feature branch onto trunk.
How was this patch tested?
Not required