Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

YARN-8057 Inadequate information for handling catch clauses #362

Closed
wants to merge 1 commit into from

Conversation

ginolzh
Copy link

@ginolzh ginolzh commented Apr 10, 2018

The description of the problem:
https://issues.apache.org/jira/browse/YARN-8057
I added stack traces information to those two logging statements, so that the full exception information can be generated to the logs.

@@ -124,11 +124,11 @@ protected synchronized void cleanupRunningContainers() {
} catch (YarnException e) {
LOG.error("Failed to stop Container " +
startedContainer.getContainerId() +
"when stopping NMClientImpl");
"when stopping NMClientImpl", e);
Copy link
Contributor

@lqjack lqjack Apr 21, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what’s the e use for in log?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If there's no "e", the log here will only show the message "Failed to stop Container ### when stopping NMClientImpl". People will only know there's something wrong here, but will not know what's wrong here. (YarnException? IOException?)
If add an "e" here, the exception type and position where this exception happens will also be generated to the log, so that people will know what's wrong here.

@G361963
Copy link

G361963 commented Apr 29, 2018

Hey Iq you have been in my phone a lot and who ever you been on here with is hacking my phone so tell me what an WHY u messing with my phone

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 36 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
-1 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+1 mvninstall 1069 trunk passed
+1 compile 30 trunk passed
+1 checkstyle 22 trunk passed
+1 mvnsite 37 trunk passed
+1 shadedclient 672 branch has no errors when building and testing our client artifacts.
+1 javadoc 20 trunk passed
0 spotbugs 50 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 47 trunk passed
_ Patch Compile Tests _
+1 mvninstall 26 the patch passed
+1 compile 25 the patch passed
+1 javac 25 the patch passed
+1 checkstyle 14 the patch passed
+1 mvnsite 26 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedclient 709 patch has no errors when building and testing our client artifacts.
+1 javadoc 18 the patch passed
+1 findbugs 53 the patch passed
_ Other Tests _
-1 unit 1477 hadoop-yarn-client in the patch failed.
-1 asflicense 25 The patch generated 1 ASF License warnings.
4389
Reason Tests
Failed junit tests hadoop.yarn.client.TestFederationRMFailoverProxyProvider
hadoop.yarn.client.TestApplicationMasterServiceProtocolOnHA
hadoop.yarn.client.TestGetGroups
hadoop.yarn.client.TestResourceTrackerOnHA
hadoop.yarn.client.TestResourceManagerAdministrationProtocolPBClientImpl
hadoop.yarn.client.TestApplicationMasterServiceProtocolForTimelineV2
hadoop.yarn.client.cli.TestYarnCLI
hadoop.yarn.client.TestHedgingRequestRMFailoverProxyProvider
Subsystem Report/Notes
Docker Client=18.09.8 Server=18.09.8 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-362/1/artifact/out/Dockerfile
GITHUB PR #362
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle
uname Linux 881d67d89d9f 4.4.0-139-generic #165-Ubuntu SMP Wed Oct 24 10:58:50 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 7f1b76c
Default Java 1.8.0_212
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-362/1/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-362/1/testReport/
asflicense https://builds.apache.org/job/hadoop-multibranch/job/PR-362/1/artifact/out/patch-asflicense-problems.txt
Max. process+thread count 624 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-362/1/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 39 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
-1 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+1 mvninstall 1054 trunk passed
+1 compile 29 trunk passed
+1 checkstyle 18 trunk passed
+1 mvnsite 30 trunk passed
+1 shadedclient 670 branch has no errors when building and testing our client artifacts.
+1 javadoc 18 trunk passed
0 spotbugs 51 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 50 trunk passed
_ Patch Compile Tests _
+1 mvninstall 27 the patch passed
+1 compile 28 the patch passed
+1 javac 28 the patch passed
+1 checkstyle 13 the patch passed
+1 mvnsite 28 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedclient 700 patch has no errors when building and testing our client artifacts.
+1 javadoc 17 the patch passed
+1 findbugs 55 the patch passed
_ Other Tests _
+1 unit 1550 hadoop-yarn-client in the patch passed.
+1 asflicense 26 The patch does not generate ASF License warnings.
4428
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-362/2/artifact/out/Dockerfile
GITHUB PR #362
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle
uname Linux ea00fd72e063 4.4.0-157-generic #185-Ubuntu SMP Tue Jul 23 09:17:01 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / c7c7a88
Default Java 1.8.0_212
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-362/2/testReport/
Max. process+thread count 618 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-362/2/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 43 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
-1 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+1 mvninstall 1108 trunk passed
+1 compile 30 trunk passed
+1 checkstyle 20 trunk passed
+1 mvnsite 31 trunk passed
+1 shadedclient 700 branch has no errors when building and testing our client artifacts.
+1 javadoc 21 trunk passed
0 spotbugs 52 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 51 trunk passed
_ Patch Compile Tests _
+1 mvninstall 30 the patch passed
+1 compile 26 the patch passed
+1 javac 26 the patch passed
+1 checkstyle 15 the patch passed
+1 mvnsite 29 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedclient 736 patch has no errors when building and testing our client artifacts.
+1 javadoc 17 the patch passed
+1 findbugs 63 the patch passed
_ Other Tests _
+1 unit 1541 hadoop-yarn-client in the patch passed.
+1 asflicense 26 The patch does not generate ASF License warnings.
4566
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-362/3/artifact/out/Dockerfile
GITHUB PR #362
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle
uname Linux 309d7e2729fc 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / e872ceb
Default Java 1.8.0_212
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-362/3/testReport/
Max. process+thread count 619 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-362/3/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 74 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
-1 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
+1 mvninstall 1199 trunk passed
+1 compile 26 trunk passed
+1 checkstyle 20 trunk passed
+1 mvnsite 29 trunk passed
+1 shadedclient 814 branch has no errors when building and testing our client artifacts.
+1 javadoc 22 trunk passed
0 spotbugs 49 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 47 trunk passed
_ Patch Compile Tests _
+1 mvninstall 27 the patch passed
+1 compile 23 the patch passed
+1 javac 23 the patch passed
+1 checkstyle 15 the patch passed
+1 mvnsite 25 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedclient 925 patch has no errors when building and testing our client artifacts.
+1 javadoc 24 the patch passed
+1 findbugs 62 the patch passed
_ Other Tests _
+1 unit 1641 hadoop-yarn-client in the patch passed.
+1 asflicense 33 The patch does not generate ASF License warnings.
5107
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-362/4/artifact/out/Dockerfile
GITHUB PR #362
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle
uname Linux 5406e4752f6b 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 00b5a27
Default Java 1.8.0_222
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-362/4/testReport/
Max. process+thread count 609 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-362/4/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@lqjack
Copy link
Contributor

lqjack commented Sep 9, 2019

Hey Iq you have been in my phone a lot and who ever you been on here with is hacking my phone so tell me what an WHY u messing with my phone

I do nothing for your phone, however I will also receive the apple id is binding by other person now .

@ginolzh ginolzh closed this Sep 9, 2019
shanthoosh added a commit to shanthoosh/hadoop that referenced this pull request Oct 15, 2019
…stateful operators.

Verified with a test standalone job. Will add integration test for this as a part of fixing and reenabling standalone integration tests.

Author: Shanthoosh Venkataraman <svenkataraman@linkedin.com>

Reviewers: Boris Shkolnik <boryas@apache.org>

Closes apache#362 from shanthoosh/master
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
5 participants