Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AQAvit Triage for Dry Run release-openjdk17-pipeline (Jan 2023 release prep) #4240

Closed
smlambert opened this issue Jan 13, 2023 · 9 comments
Closed
Assignees

Comments

@smlambert
Copy link
Contributor

smlambert commented Jan 13, 2023

JDK 8 Jenkins build pipeline triage tracked in #4245


JDK 17 Jenkins build pipeline: https://ci.adoptopenjdk.net/job/build-scripts/job/release-openjdk17-pipeline/12/ + Grid

Release Summary Report for release-openjdk17-pipeline

Report generated at: Sat, 14 Jan 2023 13:10:43 GMT

TRSS Build and TRSS Grid View
Jenkins Build URL https://ci.adoptopenjdk.net/job/build-scripts/job/release-openjdk17-pipeline/12/
Started by upstream project "build-scripts/utils/releaseTrigger_jdk17u" build number 111 at 1/13/2023, 5:14:50 PM


Build Jobs with Failures Triage Details/Actions
jdk17u-release-alpine-linux-x64-temurin_SmokeTests ⚠️ UNSTABLE ⚠️ adoptium/temurin-build#3212
jdk17u-release-linux-aarch64-temurin_SmokeTests ⚠️ UNSTABLE ⚠️ adoptium/temurin-build#3212
jdk17u-release-linux-arm-temurin ❌ FAILURE ❌ adoptium/ci-jenkins-pipelines#574
jdk17u-release-linux-ppc64le-temurin_SmokeTests ⚠️ UNSTABLE ⚠️ adoptium/temurin-build#3212
jdk17u-release-linux-s390x-temurin_SmokeTests ⚠️ UNSTABLE ⚠️ adoptium/temurin-build#3212
jdk17u-release-linux-x64-temurin_SmokeTests ⚠️ UNSTABLE ⚠️ adoptium/temurin-build#3212
jdk17u-release-windows-x64-temurin_SmokeTests ⚠️ UNSTABLE ⚠️ adoptium/temurin-build#3212
jdk17u-release-windows-x86-32-temurin_SmokeTests ⚠️ UNSTABLE ⚠️ adoptium/temurin-build#3212

Platforms with AQA Failures Triage Details/Actions Post-triage Status
Screen Shot 2023-01-14 at 9 17 29 AM details
Screen Shot 2023-01-14 at 9 18 42 AM details
Screen Shot 2023-01-14 at 9 13 52 AM details
Screen Shot 2023-01-14 at 9 17 20 AM details
Screen Shot 2023-01-14 at 9 19 44 AM details
Screen Shot 2023-01-14 at 9 20 33 AM details
Screen Shot 2023-01-14 at 9 21 08 AM details
@smlambert smlambert self-assigned this Jan 13, 2023
@smlambert smlambert changed the title AQAvit Triage for Dry Run Build Pipelines Jan 2023 release AQAvit Triage for Dry Run release-openjdk17-pipeline (Jan 2023 release prep) Jan 14, 2023
@smlambert
Copy link
Contributor Author

smlambert commented Jan 14, 2023

x86-64_linux

All AQA test jobs pass.

In pipeline 16, there were machine-related failures (jdk_lang fails on test-docker-centos8-x64-2, issue raised at adoptium/infrastructure#2886 & disabled that node).

@smlambert
Copy link
Contributor Author

smlambert commented Jan 14, 2023

x86-64_windows

Test_openjdk17_hs_extended.openjdk_x86-64_windows ⚠️ UNSTABLE ⚠️

Test_openjdk17_hs_extended.openjdk_x86-64_windows_testList_0 ⚠️ UNSTABLE ⚠️
jdk_tools_1 => deep history 3/15 passed | possible issues

Test_openjdk17_hs_extended.openjdk_x86-64_windows_testList_1 ⚠️ UNSTABLE ⚠️
jdk_tools_0 => deep history 3/15 passed | possible issues

jdk_tools contains one failing test, tools/jpackage/windows/Win8282351Test.java that appears to fail on most machines and pass on test-azure-win2012r2-x64-3 (Grinder 6319 passes) - raise adoptium/infrastructure#2885

light.exe : error LGHT0216 : An unexpected Win32 exception with error code 0x643 occurred: Action - 'ICE09' Fatal error during installation
[10:20:12.747] Returned: 216

[10:20:12.747] java.io.IOException: Command [C:\Program Files (x86)\WiX Toolset v3.14\bin\light.exe, -nologo, -spdb, -ext, WixUtilExtension, -out, C:\Users\jenkins\workspace\Test_openjdk17_hs_extended.openjdk_x86-64_windows_testList_1\aqa-tests\TKG\output_16736525633919\jdk_tools_0\work\scratch\1\.\test\output\Win8282351Test$-$$-$$$-1.0.msi, -sice:ICE27, -loc, C:\Users\jenkins\AppData\Local\Temp\jdk.jpackage13314125230607775367\config\MsiInstallerStrings_en.wxl, -cultures:en-us, C:\Users\jenkins\AppData\Local\Temp\jdk.jpackage13314125230607775367\wixobj\main.wixobj, C:\Users\jenkins\AppData\Local\Temp\jdk.jpackage13314125230607775367\wixobj\bundle.wixobj, C:\Users\jenkins\AppData\Local\Temp\jdk.jpackage13314125230607775367\wixobj\uui.wixobj] in C:\Users\jenkins\AppData\Local\Temp\jdk.jpackage13314125230607775367\images\win-msi.image\Win8282351Test exited with 216 code
	at jdk.jpackage/jdk.jpackage.internal.Executor.executeExpectSuccess(Executor.java:90)
	at jdk.jpackage/jdk.jpackage.internal.WixPipeline.execute(WixPipeline.java:135)
	at jdk.jpackage/jdk.jpackage.internal.WixPipeline.buildMsi(WixPipeline.java:99)
	at jdk.jpackage/jdk.jpackage.internal.WinMsiBundler.buildMSI(WinMsiBundler.java:557)
	at jdk.jpackage/jdk.jpackage.internal.WinMsiBundler.execute(WinMsiBundler.java:416)
	at jdk.jpackage/jdk.jpackage.internal.Arguments.generateBundle(Arguments.java:674)
	at jdk.jpackage/jdk.jpackage.internal.Arguments.processArguments(Arguments.java:551)
	at jdk.jpackage/jdk.jpackage.main.Main.execute(Main.java:91)
	at jdk.jpackage/jdk.jpackage.main.Main.main(Main.java:52)
[10:20:12.759] jdk.jpackage.internal.PackagerException: java.io.IOException: Command [C:\Program Files (x86)\WiX Toolset v3.14\bin\light.exe, -nologo, -spdb, -ext, WixUtilExtension, -out, C:\Users\jenkins\workspace\Test_openjdk17_hs_extended.openjdk_x86-64_windows_testList_1\aqa-tests\TKG\output_16736525633919\jdk_tools_0\work\scratch\1\.\test\output\Win8282351Test$-$$-$$$-1.0.msi, -sice:ICE27, -loc, C:\Users\jenkins\AppData\Local\Temp\jdk.jpackage13314125230607775367\config\MsiInstallerStrings_en.wxl, -cultures:en-us, C:\Users\jenkins\AppData\Local\Temp\jdk.jpackage13314125230607775367\wixobj\main.wixobj, C:\Users\jenkins\AppData\Local\Temp\jdk.jpackage13314125230607775367\wixobj\bundle.wixobj, C:\Users\jenkins\AppData\Local\Temp\jdk.jpackage13314125230607775367\wixobj\uui.wixobj] in C:\Users\jenkins\AppData\Local\Temp\jdk.jpackage13314125230607775367\images\win-msi.image\Win8282351Test exited with 216 code
	at jdk.jpackage/jdk.jpackage.internal.WinMsiBundler.execute(WinMsiBundler.java:419)
	at jdk.jpackage/jdk.jpackage.internal.Arguments.generateBundle(Arguments.java:674)
	at jdk.jpackage/jdk.jpackage.internal.Arguments.processArguments(Arguments.java:551)
	at jdk.jpackage/jdk.jpackage.main.Main.execute(Main.java:91)
	at jdk.jpackage/jdk.jpackage.main.Main.main(Main.java:52)
Caused by: java.io.IOException: Command [C:\Program Files (x86)\WiX Toolset v3.14\bin\light.exe, -nologo, -spdb, -ext, WixUtilExtension, -out, C:\Users\jenkins\workspace\Test_openjdk17_hs_extended.openjdk_x86-64_windows_testList_1\aqa-tests\TKG\output_16736525633919\jdk_tools_0\work\scratch\1\.\test\output\Win8282351Test$-$$-$$$-1.0.msi, -sice:ICE27, -loc, C:\Users\jenkins\AppData\Local\Temp\jdk.jpackage13314125230607775367\config\MsiInstallerStrings_en.wxl, -cultures:en-us, C:\Users\jenkins\AppData\Local\Temp\jdk.jpackage13314125230607775367\wixobj\main.wixobj, C:\Users\jenkins\AppData\Local\Temp\jdk.jpackage13314125230607775367\wixobj\bundle.wixobj, C:\Users\jenkins\AppData\Local\Temp\jdk.jpackage13314125230607775367\wixobj\uui.wixobj] in C:\Users\jenkins\AppData\Local\Temp\jdk.jpackage13314125230607775367\images\win-msi.image\Win8282351Test exited with 216 code
	at jdk.jpackage/jdk.jpackage.internal.Executor.executeExpectSuccess(Executor.java:90)
	at jdk.jpackage/jdk.jpackage.internal.WixPipeline.execute(WixPipeline.java:135)
	at jdk.jpackage/jdk.jpackage.internal.WixPipeline.buildMsi(WixPipeline.java:99)
	at jdk.jpackage/jdk.jpackage.internal.WinMsiBundler.buildMSI(WinMsiBundler.java:557)
	at jdk.jpackage/jdk.jpackage.internal.WinMsiBundler.execute(WinMsiBundler.java:416)
	... 4 more
[10:20:12.772] TRACE: exec: Done. Exit code: 1
[10:20:12.777] ERROR: Expected [0]. Actual [1]: Check command [C:\Users\Jenkins\workspace\Test_openjdk17_hs_extended.openjdk_x86-64_windows_testList_1\openjdkbinary\j2sdk-image\bin\jpackage.exe --dest .\test\output --name Win8282351Test$-$$-$$$ --type msi --app-image .\test\appimage\Win8282351Test --win-menu --win-shortcut --verbose](12) exited with 0 code
[10:20:12.777] [  FAILED  ] Win8282351Test.test; checks=4

@smlambert
Copy link
Contributor Author

smlambert commented Jan 14, 2023

x86-32_windows

Test_openjdk17_hs_extended.openjdk_x86-32_windows ⚠️ UNSTABLE ⚠️

Test_openjdk17_hs_extended.openjdk_x86-32_windows_testList_0 ⚠️ UNSTABLE ⚠️
jvm_compiler_2 => deep history 0/14 passed | possible issues

Test_openjdk17_hs_extended.openjdk_x86-32_windows_testList_1 ⚠️ UNSTABLE ⚠️
jdk_tools_2 => deep history 2/13 passed | possible issues - same issue as raised for x86-64_windows (Win8282351Test fails on all but 1 machine), raised adoptium/infrastructure#2885 and rerun in Grinder 6320 passes

Test_openjdk17_hs_sanity.openjdk_x86-32_windows ⚠️ UNSTABLE ⚠️
Rerun all

java -version
openjdk version "17.0.6" 2023-01-17
OpenJDK Runtime Environment Temurin-17.0.6+8 (build 17.0.6+8)
OpenJDK Client VM Temurin-17.0.6+8 (build 17.0.6+8, mixed mode, emulated-client)

jdk_util_2 => deep history 31/36 passed | possible issues - 1 testcase java/util/zip/ZipFile/Zip64SizeTest.java passes on all other machines, but fails 5/6 times on test-azure-win2016-x64-1 in deep history, rerun in Grinder 6321

--

@smlambert
Copy link
Contributor Author

smlambert commented Jan 14, 2023

aarch64_linux

Test_openjdk17_hs_extended.functional_aarch64_linux ❌ FAILURE ❌

Rerun all

java -version
openjdk version "17.0.6" 2023-01-17
OpenJDK Runtime Environment Temurin-17.0.6+8 (build 17.0.6+8)
OpenJDK 64-Bit Server VM Temurin-17.0.6+8 (build 17.0.6+8, mixed mode, sharing)

SecurityTests_0 => deep history 37/38 passed | possible issues

  • test terminates in the middle of the SecurityTests target running on test-docker-ubuntu1804-armv8l-2, has a long history of passing on other machines, this may be an issue with the static docker container, rerun in Grinder 6322 passes
17:41:16  [Tls13FunctionalTest] [INFO] Selected cipher suite: TLS_AES_128_GCM_SHA256
17:41:16  settings.mk:356: recipe for target 'extended.functional-..' failed
17:41:16  make[1]: *** [extended.functional-..] Terminated
17:41:16  makefile:53: recipe for target '_extended.functional' failed
17:41:16  make: *** [_extended.functional] Terminated
17:41:16  Terminated
17:41:16  /home/jenkins/workspace/Test_openjdk17_hs_extended.functional_aarch64_linux/aqa-tests/TKG/../TKG/settings.mk:356: recipe for target 'extended.functional-functional' failed
17:41:16  make[2]: *** [extended.functional-functional] Terminated
17:41:16  /home/jenkins/workspace/Test_openjdk17_hs_extended.functional_aarch64_linux/aqa-tests/TKG/../TKG/settings.mk:356: recipe for target 'extended.functional-security' failed
17:41:16  make[3]: *** [extended.functional-security] Terminated
17:41:16  autoGen.mk:24: recipe for target 'SecurityTests_0' failed
17:41:16  make[4]: *** [SecurityTests_0] Terminated

Test_openjdk17_hs_extended.openjdk_aarch64_linux ❌ FAILURE ❌
Rerun all

java -version
openjdk version "17.0.6" 2023-01-17
OpenJDK Runtime Environment Temurin-17.0.6+8 (build 17.0.6+8)
OpenJDK 64-Bit Server VM Temurin-17.0.6+8 (build 17.0.6+8, mixed mode, sharing)

jvm_compiler_1 => deep history 9/12 passed | possible issues - test terminates in the middle of the run on test-docker-ubuntu1804-armv8l-2, but passes on other machines, rerun in Grinder 6325 passes

[2023-01-08T13:17:15.103Z] settings.mk:356: recipe for target 'extended.openjdk-..' failed
[2023-01-08T13:17:15.103Z] make[1]: *** [extended.openjdk-..] Terminated
[2023-01-08T13:17:15.103Z] makefile:49: recipe for target '_extended.openjdk' failed
[2023-01-08T13:17:15.103Z] make: *** [_extended.openjdk] Terminated
[2023-01-08T13:17:15.103Z] Terminated
[2023-01-08T13:17:15.103Z] /home/jenkins/workspace/Test_openjdk17_hs_extended.openjdk_aarch64_linux/aqa-tests/TKG/../TKG/settings.mk:356: recipe for target 'extended.openjdk-openjdk' failed
[2023-01-08T13:17:15.103Z] make[2]: *** [extended.openjdk-openjdk] Terminated
[2023-01-08T13:17:15.103Z] autoGen.mk:406: recipe for target 'jvm_compiler_1' failed
[2023-01-08T13:17:15.103Z] make[3]: *** [jvm_compiler_1] Terminated

@smlambert
Copy link
Contributor Author

smlambert commented Jan 14, 2023

ppc64_aix

Test_openjdk17_hs_extended.openjdk_ppc64_aix ⚠️ UNSTABLE ⚠️

Test_openjdk17_hs_extended.openjdk_ppc64_aix_testList_2 ⚠️ UNSTABLE ⚠️
jdk_jmx_1 => deep history 13/14 passed | possible issues - 1 testcase javax/management/remote/mandatory/connection/BrokenConnectionTest.java in jdk_jmx target fails on test-osuosl-aix72-ppc64-2 but appears to pass on all other machines shown in deep history, rerun in Grinder 6324 passes

Test_openjdk17_hs_sanity.openjdk_ppc64_aix ⚠️ UNSTABLE ⚠️
Rerun all

java -version
openjdk version "17.0.6" 2023-01-17
OpenJDK Runtime Environment Temurin-17.0.6+8 (build 17.0.6+8)
OpenJDK 64-Bit Server VM Temurin-17.0.6+8 (build 17.0.6+8, mixed mode)

jdk_svc_sanity_0 => deep history 1/36 passed | possible issues
jdk_svc_sanity_1 => deep history 1/36 passed | possible issues

  • Test results: no tests selected since this target has no testcases enabled for AIX, it should be disabled for ppc64_aix, otherwise it will fail the test with no tests selected output. This failure is not a blocker for the release.

@smlambert
Copy link
Contributor Author

smlambert commented Jan 14, 2023

ppc64le_linux

Test_openjdk17_hs_extended.openjdk_ppc64le_linux ⚠️ UNSTABLE ⚠️

Test_openjdk17_hs_extended.openjdk_ppc64le_linux_testList_1 ⚠️ UNSTABLE ⚠️
jdk_nio_1 => deep history 14/15 passed | possible issues - 1 failed testcase java/nio/channels/FileChannel/MapTest.java on test-osuosl-ubuntu1604-ppc64le-2, test has not failed historically, rerun in Grinder 6326 passes

Test_openjdk17_hs_extended.openjdk_ppc64le_linux_testList_2 ⚠️ UNSTABLE ⚠️
jdk_beans_1 => deep history 12/15 passed | possible issues - 1 testcase fails on test-osuosl-ubuntu1604-ppc64le* machines, but no other machines, rerun in Grinder 6327 passes

jdk_jfr_0 => deep history 15/16 passed | possible issues - 1 testcase jdk/jfr/javaagent/TestPremainAgent.java fails on test-osuosl-ubuntu1604-ppc64le-1, but has historically passed on all others, rerun in Grinder 6328 passes

@smlambert
Copy link
Contributor Author

smlambert commented Jan 14, 2023

s390x_linux

Test_openjdk17_hs_extended.openjdk_s390x_linux ⚠️ UNSTABLE ⚠️

Test_openjdk17_hs_extended.openjdk_s390x_linux_testList_0 ⚠️ UNSTABLE ⚠️
jdk_imageio_1 => deep history 3/10 passed | possible issues
jdk_tools_1 => deep history 3/10 passed | possible issues - 1 testcase tools/jlink/JLinkReproducibleTest.java fails with

[2023-01-14T01:04:34.643Z] STDERR:
[2023-01-14T01:04:34.643Z] java.lang.RuntimeException: assertEquals: expected -1 to equal 28395
[2023-01-14T01:04:34.643Z] 	at jdk.test.lib.Asserts.fail(Asserts.java:594)
[2023-01-14T01:04:34.643Z] 	at jdk.test.lib.Asserts.assertEquals(Asserts.java:205)
[2023-01-14T01:04:34.643Z] 	at jdk.test.lib.Asserts.assertEquals(Asserts.java:189)
[2023-01-14T01:04:34.643Z] 	at JLinkReproducibleTest.main(JLinkReproducibleTest.java:115)
[2023-01-14T01:04:34.643Z] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[2023-01-14T01:04:34.643Z] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
[2023-01-14T01:04:34.643Z] 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[2023-01-14T01:04:34.643Z] 	at java.base/java.lang.reflect.Method.invoke(Method.java:568)
[2023-01-14T01:04:34.643Z] 	at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:312)
[2023-01-14T01:04:34.643Z] 	at java.base/java.lang.Thread.run(Thread.java:833)
  • rerun testList_0 targets on test-marist-ubuntu2004-s390x-1 in Grinder 6333 jdk_imageio passes and Grinder 6335 jdk_tools ?

Test_openjdk17_hs_extended.openjdk_s390x_linux_testList_1 ⚠️ UNSTABLE ⚠️
jdk_net_1 => deep history 5/16 passed | possible issues - 1 testcase sun/net/www/protocol/https/HttpsURLConnection/PostThruProxyWithAuth.java fails on test-docker-sles15-s390x-1 with java.lang.RuntimeException: Get hostname failed., related adoptium/infrastructure#2882

jdk_tools_0 => deep history 4/16 passed | possible issues

  • rerun testList_1 targets on test-marist-ubuntu2004-s390x-1 in Grinder 6334

Test_openjdk17_hs_extended.openjdk_s390x_linux_testList_2 ⚠️ UNSTABLE ⚠️ - passes on reruns listed below ✅
jdk_beans_1 => deep history 10/16 passed | possible issues
jdk_nio_0 => deep history 9/16 passed | possible issues
jdk_jmx_1 => deep history 11/16 passed | possible issues
jdk_rmi_1 => deep history 11/16 passed | possible issues
jdk_jmx_0 => deep history 12/17 passed | possible issues
jdk_jfr_0 => deep history 12/17 passed | possible issues
jdk_imageio_0 => deep history 3/16 passed | possible issues - 1 testcase javax/imageio/plugins/shared/ImageWriterCompressionTest.java fails on all machines except test-marist-ubuntu2004-s390x-1 historically, rerun in Grinder 6329

@smlambert
Copy link
Contributor Author

smlambert commented Jan 14, 2023

x86-64_alpine-linux

Test_openjdk17_hs_extended.openjdk_x86-64_alpine-linux ⚠️ UNSTABLE ⚠️

Test_openjdk17_hs_extended.openjdk_x86-64_alpine-linux_testList_0 ⚠️ UNSTABLE ⚠️
jdk_beans_0 => deep history 6/16 passed | possible issues

Test_openjdk17_hs_extended.openjdk_x86-64_alpine-linux_testList_1 ⚠️ UNSTABLE ⚠️
jdk_imageio_0 => deep history 6/15 passed | possible issues
jdk_imageio_1 => deep history 6/15 passed | possible issues

Test_openjdk17_hs_extended.openjdk_x86-64_alpine-linux_testList_2 ⚠️ UNSTABLE ⚠️
jdk_beans_1 => deep history 6/15 passed | possible issues

javax/imageio/plugins/shared/ImageWriterCompressionTest.java from jdk_imageio

STDERR:
[2022-12-11T15:03:21.092Z] java.lang.InternalError: java.lang.reflect.InvocationTargetException
[2022-12-11T15:03:21.092Z] 	at java.desktop/sun.font.FontManagerFactory$1.run(FontManagerFactory.java:87)
[2022-12-11T15:03:21.092Z] 	at java.base/java.security.AccessController.doPrivileged(AccessController.java:318)
[2022-12-11T15:03:21.092Z] 	at java.desktop/sun.font.FontManagerFactory.getInstance(FontManagerFactory.java:75)
...
[2022-12-11T15:03:21.092Z] 	... 40 more
[2022-12-11T15:03:21.092Z] Caused by: java.lang.NullPointerException: Cannot load from short array because "sun.awt.FontConfiguration.head" is null
[2022-12-11T15:03:21.092Z] 	at java.desktop/sun.awt.FontConfiguration.getVersion(FontConfiguration.java:1264)
[2022-12-11T15:03:21.092Z] 	at java.desktop/sun.awt.FontConfiguration.readFontConfigFile(FontConfiguration.java:224)

jdk_beans 5 testcases fail

Failed test cases: 
TEST: java/beans/PropertyChangeSupport/Test4682386.java
TEST: java/beans/XMLEncoder/javax_swing_DefaultCellEditor.java
TEST: java/beans/XMLEncoder/javax_swing_JTree.java
TEST: java/beans/XMLEncoder/Test4631471.java
TEST: java/beans/XMLEncoder/Test4903007.java
Test results: passed: 348; failed: 5

Need to check if some new testcases were added in that period in the upstream repo that are for headful not headless builds (and/or are we properly tagging all targets as headless) - possibly related: #2890 and #3138

@smlambert
Copy link
Contributor Author

Close in favour of #4254

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Status: Done
Development

No branches or pull requests

1 participant