Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

YARN-9880. In YARN ui2 attempts tab, The running Application Attempt's ElapsedTime is incorrect. #1626

Closed
wants to merge 3 commits into from

Conversation

cjn082030
Copy link
Contributor

@cjn082030 cjn082030 commented Oct 9, 2019

I found this problem where hadoop3.1.1 was used, want to upgrade to the latest version of hadoop, but found the running Application Attempt's ElapsedTime is also incorrect.

In UI1, get ElapsedTime from yarn server. In UI2, get currentTime from brower. Therefore, when the brower and the yarn server are not in the same time zones, the ElapsedTime is incorrect. While the Application‘s ElapsedTime is 29 Secs, the Application Attempt's ElapsedTime is 10 Hrs : 49 Mins : 55 Secs.

I think, in UI2, ElapsedTime should also come from the yarn server too.

…s ElapsedTime is incorrect. Contributed by Jenny.
@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 146 Docker mode activated.
_ Prechecks _
+1 dupname 1 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
-1 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
0 mvndep 69 Maven dependency ordering for branch
+1 mvninstall 1289 trunk passed
+1 compile 546 trunk passed
+1 checkstyle 88 trunk passed
+1 mvnsite 121 trunk passed
+1 shadedclient 1063 branch has no errors when building and testing our client artifacts.
+1 javadoc 82 trunk passed
0 spotbugs 19 Used deprecated FindBugs config; considering switching to SpotBugs.
0 findbugs 19 branch/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui no findbugs output file (findbugsXml.xml)
_ Patch Compile Tests _
0 mvndep 17 Maven dependency ordering for patch
+1 mvninstall 89 the patch passed
-1 jshint 220 The patch generated 1761 new + 0 unchanged - 0 fixed = 1761 total (was 0)
+1 compile 511 the patch passed
+1 javac 511 the patch passed
-0 checkstyle 96 hadoop-yarn-project/hadoop-yarn: The patch generated 2 new + 21 unchanged - 0 fixed = 23 total (was 21)
+1 mvnsite 120 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedclient 845 patch has no errors when building and testing our client artifacts.
+1 javadoc 70 the patch passed
0 findbugs 14 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui has no data from findbugs
_ Other Tests _
+1 unit 164 hadoop-yarn-server-common in the patch passed.
-1 unit 5256 hadoop-yarn-server-resourcemanager in the patch failed.
+1 unit 257 hadoop-yarn-ui in the patch passed.
+1 asflicense 44 The patch does not generate ASF License warnings.
11539
Reason Tests
Failed junit tests hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesAppAttempts
Subsystem Report/Notes
Docker Client=19.03.3 Server=19.03.3 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/1/artifact/out/Dockerfile
GITHUB PR #1626
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle jshint
uname Linux 9eec03fb3ead 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 1d27930
Default Java 1.8.0_222
jshint https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/1/artifact/out/diff-patch-jshint.txt
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/1/artifact/out/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/1/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/1/testReport/
Max. process+thread count 811 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui U: hadoop-yarn-project/hadoop-yarn
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/1/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1 jshint=2.10.2
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@cjn082030
Copy link
Contributor Author

I think, in UI2, ElapsedTime should also come from the yarn server too.
Can someone review it?

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 109 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
-1 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
0 mvndep 16 Maven dependency ordering for branch
+1 mvninstall 1362 trunk passed
+1 compile 629 trunk passed
+1 checkstyle 86 trunk passed
+1 mvnsite 122 trunk passed
+1 shadedclient 1023 branch has no errors when building and testing our client artifacts.
+1 javadoc 70 trunk passed
0 spotbugs 15 Used deprecated FindBugs config; considering switching to SpotBugs.
0 findbugs 15 branch/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui no findbugs output file (findbugsXml.xml)
_ Patch Compile Tests _
0 mvndep 16 Maven dependency ordering for patch
+1 mvninstall 99 the patch passed
-1 jshint 237 The patch generated 1761 new + 0 unchanged - 0 fixed = 1761 total (was 0)
-1 compile 179 hadoop-yarn in the patch failed.
-1 javac 179 hadoop-yarn in the patch failed.
-0 checkstyle 88 hadoop-yarn-project/hadoop-yarn: The patch generated 2 new + 21 unchanged - 0 fixed = 23 total (was 21)
+1 mvnsite 107 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedclient 894 patch has no errors when building and testing our client artifacts.
+1 javadoc 72 the patch passed
0 findbugs 16 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui has no data from findbugs
_ Other Tests _
+1 unit 163 hadoop-yarn-server-common in the patch passed.
-1 unit 5320 hadoop-yarn-server-resourcemanager in the patch failed.
+1 unit 324 hadoop-yarn-ui in the patch passed.
+1 asflicense 51 The patch does not generate ASF License warnings.
11372
Reason Tests
Failed junit tests hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesAppAttempts
Subsystem Report/Notes
Docker Client=19.03.3 Server=19.03.3 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/2/artifact/out/Dockerfile
GITHUB PR #1626
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle jshint
uname Linux 278607d675bf 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 4a700c2
Default Java 1.8.0_222
jshint https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/2/artifact/out/diff-patch-jshint.txt
compile https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/2/artifact/out/patch-compile-hadoop-yarn-project_hadoop-yarn.txt
javac https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/2/artifact/out/patch-compile-hadoop-yarn-project_hadoop-yarn.txt
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/2/artifact/out/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/2/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/2/testReport/
Max. process+thread count 818 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui U: hadoop-yarn-project/hadoop-yarn
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/2/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1 jshint=2.10.2
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 81 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
-1 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
0 mvndep 28 Maven dependency ordering for branch
+1 mvninstall 1375 trunk passed
+1 compile 558 trunk passed
+1 checkstyle 88 trunk passed
+1 mvnsite 168 trunk passed
+1 shadedclient 1121 branch has no errors when building and testing our client artifacts.
+1 javadoc 98 trunk passed
0 spotbugs 18 Used deprecated FindBugs config; considering switching to SpotBugs.
0 findbugs 18 branch/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site no findbugs output file (findbugsXml.xml)
0 findbugs 18 branch/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui no findbugs output file (findbugsXml.xml)
_ Patch Compile Tests _
0 mvndep 17 Maven dependency ordering for patch
+1 mvninstall 104 the patch passed
-1 jshint 225 The patch generated 1761 new + 0 unchanged - 0 fixed = 1761 total (was 0)
+1 compile 517 the patch passed
+1 javac 517 the patch passed
-0 checkstyle 93 hadoop-yarn-project/hadoop-yarn: The patch generated 2 new + 21 unchanged - 0 fixed = 23 total (was 21)
+1 mvnsite 153 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedclient 899 patch has no errors when building and testing our client artifacts.
+1 javadoc 94 the patch passed
0 findbugs 16 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site has no data from findbugs
0 findbugs 18 hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui has no data from findbugs
_ Other Tests _
+1 unit 177 hadoop-yarn-server-common in the patch passed.
-1 unit 5277 hadoop-yarn-server-resourcemanager in the patch failed.
+1 unit 15 hadoop-yarn-site in the patch passed.
+1 unit 253 hadoop-yarn-ui in the patch passed.
+1 asflicense 44 The patch does not generate ASF License warnings.
11821
Reason Tests
Failed junit tests hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesAppAttempts
Subsystem Report/Notes
Docker Client=19.03.3 Server=19.03.3 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/3/artifact/out/Dockerfile
GITHUB PR #1626
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle jshint
uname Linux 4db16c9dd15b 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / ec86f42
Default Java 1.8.0_222
jshint https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/3/artifact/out/diff-patch-jshint.txt
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/3/artifact/out/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/3/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/3/testReport/
Max. process+thread count 808 (vs. ulimit of 5500)
modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui U: hadoop-yarn-project/hadoop-yarn
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-1626/3/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1 jshint=2.10.2
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@cjn082030
Copy link
Contributor Author

Because it contains two commits, it is discarded.
New PR is #1651

@cjn082030 cjn082030 closed this Oct 12, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants