j9mm.479 ASSERTION FAILED at ScavengerRootScanner.hpp:108/109 or MarkingSchemeRootMarker.cpp:53 ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env))) #15251

JasonFengJ9 · 2022-06-07T19:24:36Z

Failure link

From an internal build job/Test_openjdknext_j9_extended.system_aarch64_linux_Personal/1/tapResults/(cent7-aarch64-6):

openjdk version "19-internal" 2022-09-20
OpenJDK Runtime Environment (build 19-internal-adhoc.jenkins.BuildJDKnextaarch64linuxPersonal)
Eclipse OpenJ9 VM (build exclude19-52f04efbff5, JRE 19 Linux aarch64-64-Bit Compressed References 20220607_35 (JIT enabled, AOT enabled)
OpenJ9   - 52f04efbff5
OMR      - c60867497c6
JCL      - 5ccf02de16a based on jdk-19+25)

Rerun in Grinder - Change TARGET to run only the failed test targets.

Optional info

Failure output (captured from console output)

===============================================
Running test SC_Softmx_JitAot_Linux_1 ...
===============================================
SC_Softmx_JitAot_Linux_1 Start Time: Tue Jun  7 13:21:33 2022 Epoch Time (ms): 1654622493065
variation: Mode610
JVM_OPTIONS:  -Xcompressedrefs -Xjit -Xgcpolicy:gencon 

STF 13:21:38.243 - +------ Step 6 - Waiting for jvm1 and jvm2 to finish
STF 13:21:38.243 - | Wait for processes to meet expectations
STF 13:21:38.243 - |   Processes: [jvm1, jvm2]
STF 13:21:38.243 - |
STF 13:21:38.243 - Monitoring processes: jvm1 jvm2
STF 13:21:44.866 - Found dump at: /home/jenkins/workspace/Test_openjdknext_j9_extended.system_aarch64_linux_Personal_testList_2/aqa-tests/TKG/output_16546195099989/SC_Softmx_JitAot_Linux_1/20220607-132133-SharedClassesWorkloadTest_Softmx_Increase_JitAot/results/javacore.20220607.132143.14205.0002.txt
STF 13:21:44.867 - Found dump at: /home/jenkins/workspace/Test_openjdknext_j9_extended.system_aarch64_linux_Personal_testList_2/aqa-tests/TKG/output_16546195099989/SC_Softmx_JitAot_Linux_1/20220607-132133-SharedClassesWorkloadTest_Softmx_Increase_JitAot/results/core.20220607.132143.14205.0001.dmp
STF 13:21:51.423 - Found dump at: /home/jenkins/workspace/Test_openjdknext_j9_extended.system_aarch64_linux_Personal_testList_2/aqa-tests/TKG/output_16546195099989/SC_Softmx_JitAot_Linux_1/20220607-132133-SharedClassesWorkloadTest_Softmx_Increase_JitAot/results/Snap.20220607.132143.14205.0003.trc
STF 13:21:51.425 - **FAILED** Process jvm2 ended with exit code (255) and not the expected exit code/s (0,1)
STF 13:21:51.425 - Monitoring Report Summary:
STF 13:21:51.425 -   o Process jvm1 has crashed unexpectedly
STF 13:21:51.425 -   o Process jvm2 ended with exit code (255) and not the expected exit code/s (0,1)
STF 13:21:51.426 - Killing processes: jvm1 jvm2
STF 13:21:51.426 -   o Process jvm2 pid 14205 is not running
STF 13:21:51.426 -   o Process clean up attempt 1 for jvm1 pid 14204
STF 13:21:51.426 -   o Process jvm1 pid 14204 stop()
STF 13:21:55.427 -   o Process jvm1 pid 14204 killed
**FAILED** at step 6 (Waiting for jvm1 and jvm2 to finish). Expected return value=0 Actual=1 at /home/jenkins/workspace/Test_openjdknext_j9_extended.system_aarch64_linux_Personal_testList_2/aqa-tests/TKG/../TKG/output_16546195099989/SC_Softmx_JitAot_Linux_1/20220607-132133-SharedClassesWorkloadTest_Softmx_Increase_JitAot/execute.pl line 211.
STF 13:21:55.472 - **FAILED** execute script failed. Expected return value=0 Actual=1

SC_Softmx_JitAot_Linux_1_FAILED

aqa-tests/TKG/output_16546195099989/SC_Softmx_JitAot_Linux_1/20220607-132133-SharedClassesWorkloadTest_Softmx_Increase_JitAot/results/5.jvm2.stderr 
00000000006BFB00: Object neither in heap nor stack-allocated in thread load-6
00000000006BFB00:       O-Slot=00000000006CAF80
00000000006BFB00:       O-Slot value=0000000000080AF8
00000000006BFB00:       PC=0000FFFF94B91ECC
00000000006BFB00:       framesWalked=3
00000000006BFB00:       arg0EA=00000000006CAFE0
00000000006BFB00:       walkSP=00000000006CADE8
00000000006BFB00:       literals=0000000000000000
00000000006BFB00:       jitInfo=0000FFFF800721C8
00000000006BFB00:       method=0000000000061598 (java/lang/Thread.<init>()V) (JIT)
00000000006BFB00:       stack=00000000006C64F0-00000000006CBD10
17:21:43.490 0x1aca00    j9mm.479    *   ** ASSERTION FAILED ** at /home/jenkins/workspace/Build_JDKnext_aarch64_linux_Personal/openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:108: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))
JVMDUMP039I Processing dump event "traceassert", detail "" at 2022/06/07 13:21:43 - please wait.
JVMDUMP032I JVM requested System dump using '/home/jenkins/workspace/Test_openjdknext_j9_extended.system_aarch64_linux_Personal_testList_2/aqa-tests/TKG/output_16546195099989/SC_Softmx_JitAot_Linux_1/20220607-132133-SharedClassesWorkloadTest_Softmx_Increase_JitAot/results/core.20220607.132143.14205.0001.dmp' in response to an event
JVMDUMP010I System dump written to /home/jenkins/workspace/Test_openjdknext_j9_extended.system_aarch64_linux_Personal_testList_2/aqa-tests/TKG/output_16546195099989/SC_Softmx_JitAot_Linux_1/20220607-132133-SharedClassesWorkloadTest_Softmx_Increase_JitAot/results/core.20220607.132143.14205.0001.dmp
JVMDUMP032I JVM requested Java dump using '/home/jenkins/workspace/Test_openjdknext_j9_extended.system_aarch64_linux_Personal_testList_2/aqa-tests/TKG/output_16546195099989/SC_Softmx_JitAot_Linux_1/20220607-132133-SharedClassesWorkloadTest_Softmx_Increase_JitAot/results/javacore.20220607.132143.14205.0002.txt' in response to an event
JVMDUMP010I Java dump written to /home/jenkins/workspace/Test_openjdknext_j9_extended.system_aarch64_linux_Personal_testList_2/aqa-tests/TKG/output_16546195099989/SC_Softmx_JitAot_Linux_1/20220607-132133-SharedClassesWorkloadTest_Softmx_Increase_JitAot/results/javacore.20220607.132143.14205.0002.txt
JVMDUMP032I JVM requested Snap dump using '/home/jenkins/workspace/Test_openjdknext_j9_extended.system_aarch64_linux_Personal_testList_2/aqa-tests/TKG/output_16546195099989/SC_Softmx_JitAot_Linux_1/20220607-132133-SharedClassesWorkloadTest_Softmx_Increase_JitAot/results/Snap.20220607.132143.14205.0003.trc' in response to an event
JVMDUMP010I Snap dump written to /home/jenkins/workspace/Test_openjdknext_j9_extended.system_aarch64_linux_Personal_testList_2/aqa-tests/TKG/output_16546195099989/SC_Softmx_JitAot_Linux_1/20220607-132133-SharedClassesWorkloadTest_Softmx_Increase_JitAot/results/Snap.20220607.132143.14205.0003.trc
JVMDUMP013I Processed dump event "traceassert", detail "".

The text was updated successfully, but these errors were encountered:

JasonFengJ9 · 2022-06-08T14:52:06Z

job/Test_openjdknext_j9_sanity.openjdk_x86-64_mac_Personal/5/consoleFull(mac11x64rt07)

13:14:15  ===============================================
13:14:15  Running test jdk_util_0 ...
13:14:15  ===============================================
13:14:15  jdk_util_0 Start Time: Tue Jun  7 13:14:14 2022 Epoch Time (ms): 1654622054757
13:14:15  "/Users/jenkins/workspace/Test_openjdknext_j9_sanity.openjdk_x86-64_mac_Personal/openjdkbinary/j2sdk-image/bin/java" -Xshareclasses:destroyAll; "/Users/jenkins/workspace/Test_openjdknext_j9_sanity.openjdk_x86-64_mac_Personal/openjdkbinary/j2sdk-image/bin/java" -Xshareclasses:groupAccess,destroyAll; echo "cache cleanup done";
13:14:15  JVMSHRC005I No shared class caches available
13:14:15  JVMSHRC005I No shared class caches available
13:14:15  cache cleanup done
13:14:15  variation: -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache Mode150

13:21:35  TEST: java/util/ResourceBundle/modules/visibility/VisibilityTest.java

13:21:35  [2022-06-07T17:stderr:
13:21:35  000000001827A000: Object neither in heap nor stack-allocated in thread AgentVMThread
13:21:35  000000001827A000:	O-Slot=0000000018793BC0
13:21:35  000000001827A000:	O-Slot value=0000000017F27AB0
13:21:35  000000001827A000:	PC=000000002DAE36ED
13:21:35  000000001827A000:	framesWalked=5
13:21:35  000000001827A000:	arg0EA=0000000018793C28
13:21:35  000000001827A000:	walkSP=0000000018793AA0
13:21:35  000000001827A000:	literals=0000000017EEF790
13:21:35  000000001827A000:	jitInfo=00007F80BD0A5968
13:21:35  000000001827A000:	method=0000000017EEF890 (java/lang/Thread.<init>(Ljava/lang/Runnable;)V) (JIT)
13:21:35  000000001827A000:	stack=000000001878DAF8-0000000018794B70
13:21:35  17:20:13.394 0x18060900    j9mm.479    *   ** ASSERTION FAILED ** at /Users/jenkins/workspace/Build_JDKnext_x86-64_mac_Personal/openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:108: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))
13:21:35  JVMDUMP039I Processing dump event "traceassert", detail "" at 2022/06/07 13:20:13 - please wait.

JasonFengJ9 · 2022-06-09T12:29:25Z

view/Test_grinder/job/Grinder/24726/tapResults/(ub20x64rt3-2)

===============================================
Running test SharedClasses.SCM23.MultiThread_1 ...
===============================================
SharedClasses.SCM23.MultiThread_1 Start Time: Wed Jun  8 20:49:10 2022 Epoch Time (ms): 1654746550412
variation: Mode610
JVM_OPTIONS:  -Xcompressedrefs -Xjit -Xgcpolicy:gencon 

openjdk version "19-internal" 2022-09-20
OpenJDK Runtime Environment (build 19-internal-adhoc.jenkins.BuildJDKnextx86-64linuxPersonal)
Eclipse OpenJ9 VM (build exclude19-622b1ac1f26, JRE 19 Linux amd64-64-Bit Compressed References 20220608_1018 (JIT enabled, AOT enabled)
OpenJ9   - 622b1ac1f26
OMR      - c859f0d17d0
JCL      - 4cb748300c8 based on jdk-19+25)

MT2 20:58:21 >> Loaded 15000 classes...
MT5 stderr 0000000000016F00: Object neither in heap nor stack-allocated in thread main
MT5 stderr 0000000000016F00:	O-Slot=0000000000115578
MT5 stderr 0000000000016F00:	O-Slot value=00000000000B20B0
MT5 stderr 0000000000016F00:	PC=00007F3711F81CC2
MT5 stderr 0000000000016F00:	framesWalked=1
MT5 stderr 0000000000016F00:	arg0EA=0000000000115620
MT5 stderr 0000000000016F00:	walkSP=00000000001154E8
MT5 stderr 0000000000016F00:	literals=0000000000000000
MT5 stderr 0000000000016F00:	jitInfo=00007F3711614BF8
MT5 stderr 0000000000016F00:	method=00000000001FD830 (net/openj9/test/sc/LoaderSlaveMultiThread.run(Ljava/lang/String;I)V) (JIT)
MT5 stderr 0000000000016F00:	stack=000000000010E010-0000000000115730
MT5 stderr 03:58:21.356 0x1c3200    j9mm.479    *   ** ASSERTION FAILED ** at /home/jenkins/workspace/Build_JDKnext_x86-64_linux_Personal/openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:108: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))
MT5 stderr JVMDUMP039I Processing dump event "traceassert", detail "" at 2022/06/08 20:58:21 - please wait.

STF 22:54:17.293 - Heartbeat: Process MT5 is still running
STF 22:57:19.507 - **FAILED** Process MT5 has timed out
STF 22:57:19.519 - Collecting dumps for: MT5

STF 22:59:32.959 - Monitoring Report Summary:
STF 22:59:32.959 -   o Process SCC has crashed unexpectedly
STF 22:59:32.960 - Killing processes: SCC
STF 22:59:32.960 -   o Process SCC pid 3087881 is not running
**FAILED** at step 8 (Destroy cache). Expected return value=0 Actual=1 at /home/jenkins/workspace/Grinder/aqa-tests/TKG/../TKG/output_16547269554530/SharedClasses.SCM23.MultiThread_1/20220608-204910-SharedClasses/tearDown.pl line 67.
STF 22:59:32.969 - **FAILED** teardown script failed. Expected return value=0 Actual=1
STF 22:59:32.969 - 
STF 22:59:32.969 - =====================   R E S U L T S   =====================
STF 22:59:32.973 - Stage results:
STF 22:59:32.981 -   setUp:     pass
STF 22:59:32.984 -   execute:  *fail*
STF 22:59:32.984 -   teardown:  pass
STF 22:59:32.985 - 
STF 22:59:32.985 - Overall result: **FAILED**

SharedClasses.SCM23.MultiThread_1_FAILED

view/Test_grinder/job/Grinder/24722/consoleFull

01:39:06  ===============================================
01:39:06  Running test SharedClasses.SCM23.MultiThreadMultiCL_0 ...
01:39:06  ===============================================
01:39:06  SharedClasses.SCM23.MultiThreadMultiCL_0 Start Time: Wed Jun  8 22:39:06 2022 Epoch Time (ms): 1654753146392
01:39:06  "/home/jenkins/workspace/Grinder/openjdkbinary/j2sdk-image/bin/java" -Xshareclasses:destroyAll; "/home/jenkins/workspace/Grinder/openjdkbinary/j2sdk-image/bin/java" -Xshareclasses:groupAccess,destroyAll; echo "cache cleanup done";
01:39:06  JVMSHRC005I No shared class caches available
01:39:06  JVMSHRC005I No shared class caches available
01:39:06  cache cleanup done
01:39:06  variation: Mode110
01:39:06  JVM_OPTIONS:  -Xjit -Xgcpolicy:gencon -Xnocompressedrefs 

01:39:13  openjdk version "19-internal" 2022-09-20
01:39:13  OpenJDK Runtime Environment (build 19-internal-adhoc.jenkins.BuildJDKnextx86-64linuxPersonal)
01:39:13  Eclipse OpenJ9 VM (build exclude19-622b1ac1f26, JRE 19 Linux amd64-64-Bit Compressed References 20220608_1018 (JIT enabled, AOT enabled)
01:39:13  OpenJ9   - 622b1ac1f26
01:39:13  OMR      - c859f0d17d0
01:39:13  JCL      - 4cb748300c8 based on jdk-19+25)

01:59:40  MTM5 22:59:39 >> --> Threads 9000 to 9120 <--
01:59:40  MTM2 stderr 00007F5A800CAA00: Object neither in heap nor stack-allocated in thread main
01:59:40  MTM2 stderr 00007F5A800CAA00:	O-Slot=00007F5A8038BA30
01:59:40  MTM2 stderr 00007F5A800CAA00:	O-Slot value=00007F5A802FC5B0
01:59:40  MTM2 stderr 00007F5A800CAA00:	PC=00007F5A26BF0DC8
01:59:40  MTM2 stderr 00007F5A800CAA00:	framesWalked=1
01:59:40  MTM2 stderr 00007F5A800CAA00:	arg0EA=00007F5A8038BAD0
01:59:40  MTM2 stderr 00007F5A800CAA00:	walkSP=00007F5A8038B998
01:59:40  MTM2 stderr 00007F5A800CAA00:	literals=0000000000000000
01:59:40  MTM2 stderr 00007F5A800CAA00:	jitInfo=00007F5991136EF8
01:59:40  MTM2 stderr 00007F5A800CAA00:	method=00007F5A805F1610 (net/openj9/test/sc/LoaderSlaveMultiThreadMultiCL.run(Ljava/lang/String;I)V) (JIT)
01:59:40  MTM2 stderr 00007F5A800CAA00:	stack=00007F5A803844B0-00007F5A8038BBD0
01:59:40  MTM2 stderr 05:59:39.620 0x7f59d8003c00    j9mm.479    *   ** ASSERTION FAILED ** at /home/jenkins/workspace/Build_JDKnext_x86-64_linux_Personal/openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:108: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))
01:59:40  MTM2 stderr JVMDUMP039I Processing dump event "traceassert", detail "" at 2022/06/08 22:59:39 - please wait.

04:00:02  SharedClasses.SCM23.MultiThreadMultiCL_0_FAILED

pshipton · 2022-06-23T21:03:39Z

Didn't reproduce this 1x in https://openj9-jenkins.osuosl.org/view/Test/job/Grinder/1038
Trying again 3x x 3 https://openj9-jenkins.osuosl.org/view/Test/job/Grinder/1042

pshipton · 2022-06-27T20:08:05Z

The grinder failed, but the results were purged.
Trying another 1x (by accident) https://openj9-jenkins.osuosl.org/view/Test/job/Grinder/1070/

pshipton · 2022-06-27T22:52:39Z

The failure is recreated. @dmitripivkine pls take a look.

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Grinder/1070/system_test_output.tar.gz

dmitripivkine · 2022-06-28T13:54:36Z

For recreated failure:
There is bad O-slot 0x5cb1e0 in JIT frame for method=0x69718 (java/lang/Thread.<init>()V) (JIT) in java stack for thread 0x5bc600 contains 0xa29b0 not in heap or thread stack ranges:

20:08:22.424668000 *0x1B4C00 j9mm.481             Exception  * Object neither in heap nor stack-allocated in thread load-2
20:08:22.424672000  0x1B4C00 j9mm.482             Exception  * O-Slot=0x5cb1e0
20:08:22.424675000  0x1B4C00 j9mm.483             Exception  * O-Slot value=0xa29b0
20:08:22.424677000  0x1B4C00 j9mm.484             Exception  * PC=0xffff9cfc0cb0
20:08:22.424680000  0x1B4C00 j9mm.485             Exception  * framesWalked=5
20:08:22.424682000  0x1B4C00 j9mm.486             Exception  * arg0EA=0x5cb240
20:08:22.424684000  0x1B4C00 j9mm.487             Exception  * walkSP=0x5caf50
20:08:22.424686000  0x1B4C00 j9mm.488             Exception  * literals=0x8
20:08:22.424688000  0x1B4C00 j9mm.489             Exception  * jitInfo=0xffff94b048b8
20:08:22.424692000  0x1B4C00 j9mm.490             Exception  * method=0x69718 (java/lang/Thread.<init>()V) (JIT)
20:08:22.424695000  0x1B4C00 j9mm.493             Exception  * stack=0x5c66b0-0x5cbef0
20:08:22.424695000  0x1B4C00 j9mm.491             Exit       *<StackSlotValidator::reportStackSlot
20:08:22.424696000  0x1B4C00 j9mm.479             Assert     * ** ASSERTION FAILED ** at /home/jenkins/workspace/Build_JDK19_aarch64_linux_Nightly/openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:108: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))

<5bc600> JIT frame: bp = 0x00000000005CB238, pc = 0x0000FFFF9CFC0CB0, unwindSP = 0x00000000005CB170, cp = 0x0000000000067D90, arg0EA = 0x00000000005CB240, jitInfo = 0x0000FFFF94B048B8
<5bc600> 	Method: java/lang/Thread.<init>()V !j9method 0x0000000000069718
<5bc600> 	Bytecode index = 9, inlineDepth = 0, PC offset = 0x00000000000001D8
<5bc600> 	stackMap=0x0000FFFF94B04A58, slots=I16(0x0001) parmBaseOffset=I16(0x0008), parmSlots=U16(0x0001), localBaseOffset=I16(0xFFA0)
<5bc600> 	Described JIT args starting at 0x00000000005CB240 for U16(0x0001) slots
<5bc600> 		O-Slot: : a0[0x00000000005CB240] = 0x00000000FFC1F700
<5bc600> 	Described JIT temps starting at 0x00000000005CB1D8 for IDATA(0x000000000000000C) slots
<5bc600> 		O-Slot: : t11[0x00000000005CB1D8] = 0x0000000088FADFB8
<5bc600> 		O-Slot: : t10[0x00000000005CB1E0] = 0x00000000000A29B0 <----- from "Classes"
<5bc600> 		O-Slot: : t9[0x00000000005CB1E8] = 0x0000000088F65AE0
<5bc600> 		O-Slot: : t8[0x00000000005CB1F0] = 0x00000000FF827910
<5bc600> 		O-Slot: : t7[0x00000000005CB1F8] = 0x00000000FF8278C8
<5bc600> 		O-Slot: : t6[0x00000000005CB200] = 0x00000000FF8278C8
<5bc600> 		O-Slot: : t5[0x00000000005CB208] = 0x00000000FF8278C8
<5bc600> 		O-Slot: : t4[0x00000000005CB210] = 0x00000000FF827910
<5bc600> 		O-Slot: : t3[0x00000000005CB218] = 0x00000000FF8278C8
<5bc600> 		O-Slot: : t2[0x00000000005CB220] = 0x00000000FF8278C8
<5bc600> 		O-Slot: : t1[0x00000000005CB228] = 0x00000000FF8278C8
<5bc600> 		O-Slot: : t0[0x00000000005CB230] = 0x00000000FF827910
<5bc600> 	JIT-RegisterMap = UDATA(0x0000000000000000)
<5bc600> 	JIT-Frame-RegisterMap[0x00000000005CB1B0] = UDATA(0x00000000FF827738) (jit_r21)
<5bc600> 	JIT-Frame-RegisterMap[0x00000000005CB098] = UDATA(0x0000000000000000) (jit_r22)
<5bc600> 	JIT-Frame-RegisterMap[0x00000000005CAFB8] = UDATA(0x0000000000000000) (jit_r23)
<5bc600> 	JIT-Frame-RegisterMap[0x00000000005CAFC0] = UDATA(0x0000000000059600) (jit_r24)
<5bc600> 	JIT-Frame-RegisterMap[0x00000000005CAFC8] = UDATA(0x0000000000064A00) (jit_r25)
<5bc600> 	JIT-Frame-RegisterMap[0x00000000005CAFD0] = UDATA(0x00000000FFCC7978) (jit_r26)
<5bc600> 	JIT-Frame-RegisterMap[0x00000000005CAFD8] = UDATA(0x0000FFFFBDE6DBF2) (jit_r27)
<5bc600> 	JIT-Frame-RegisterMap[0x00000000005CAFE0] = UDATA(0x0000FFFFBDE6DB22) (jit_r28)

Actually bogus value 0xa29b0 is an address of ramStatics for !j9class 0xA6200 java/lang/Thread$ThreadNumbering:

> !j9statics 0x00000000000A6200
Static fields in java/lang/Thread$ThreadNumbering:
	0x00000000000A29B0 U Ljdk/internal/misc/Unsafe; (!j9romstaticfieldshape 0x0000FFFF957ABDB0) = !j9object 0x0000000088FADFB8
	0x00000000000A29C0 NEXT J (!j9romstaticfieldshape 0x0000FFFF957ABDBC) = 0x0000000000000009 (9)
	0x00000000000A29B8 next I (!j9romstaticfieldshape 0x0000FFFF957ABDC8) = 0x00000019 (25)

I wondering can it be missed indirection and intention was to get object pointer from ramStatics
@0xdaryl FYI

pshipton · 2022-06-30T15:02:56Z

https://openj9-jenkins.osuosl.org/job/Test_openjdk19_j9_sanity.openjdk_aarch64_linux_OpenJDK19/4
jdk_util_0
java/util/concurrent/FutureTask/ExplicitSet.java

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk19_j9_sanity.openjdk_aarch64_linux_OpenJDK19/4/openjdk_test_output.tar.gz

15:32:43  stderr:
15:32:43  0000000000543100: Object neither in heap nor stack-allocated in thread AgentVMThread
15:32:43  0000000000543100:	O-Slot=00000000006F4708
15:32:43  0000000000543100:	O-Slot value=00000000000A29B0
15:32:43  0000000000543100:	PC=0000FFFF8DCAC888
15:32:43  0000000000543100:	framesWalked=1
15:32:43  0000000000543100:	arg0EA=00000000006F4728
15:32:43  0000000000543100:	walkSP=00000000006F4698
15:32:43  0000000000543100:	literals=0000000000000000
15:32:43  0000000000543100:	jitInfo=0000FFFF6D86A238
15:32:43  0000000000543100:	method=00000000000696D8 (java/lang/Thread.genThreadName()Ljava/lang/String;) (JIT)
15:32:43  0000000000543100:	stack=00000000006EF288-00000000006F4AE0
15:32:43  19:32:32.515 0x543100    j9mm.479    *   ** ASSERTION FAILED ** at /home/jenkins/workspace/Build_JDK19_aarch64_linux_OpenJDK19/openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:108: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))

JasonFengJ9 · 2022-07-11T21:22:59Z

job/Test_openjdk19_j9_sanity.openjdk_ppc64_aix_testList_0/8/(paix819)

openjdk version "19" 2022-09-20
IBM Semeru Runtime Open Edition 19+29 (build 19+29)
Eclipse OpenJ9 VM 19+29 (build master-6b4a2db09, JRE 19 AIX ppc64-64-Bit Compressed References 20220919_13 (JIT enabled, AOT enabled)
OpenJ9   - 6b4a2db09
OMR      - ff6a49823
JCL      - 403c2088e2 based on jdk-19+29)

[2022-07-09T17:17:19.679Z] variation: -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache -XX:-JITServerTechPreviewMessage Mode650
[2022-07-09T17:17:19.679Z] JVM_OPTIONS:  -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache -XX:-JITServerTechPreviewMessage -XX:-UseCompressedOops 

[2022-07-09T17:40:41.124Z] TEST: java/lang/RuntimeTests/exec/SleepyCat.java

[2022-07-09T17:40:41.125Z] stderr:
[2022-07-09T17:40:41.125Z] 0000010010433200: Invalid class pointer in thread main
[2022-07-09T17:40:41.125Z] 0000010010433200:	O-Slot=000001001009C648
[2022-07-09T17:40:41.125Z] 0000010010433200:	O-Slot value=0A0000001FFB61F0
[2022-07-09T17:40:41.125Z] 0000010010433200:	PC=0000010010777C78
[2022-07-09T17:40:41.125Z] 0000010010433200:	framesWalked=9
[2022-07-09T17:40:41.125Z] 0000010010433200:	arg0EA=00000100220B1908
[2022-07-09T17:40:41.125Z] 0000010010433200:	walkSP=00000100220B1898
[2022-07-09T17:40:41.125Z] 0000010010433200:	literals=0000000000000010
[2022-07-09T17:40:41.125Z] 0000010010433200:	jitInfo=0000010021BD7498
[2022-07-09T17:40:41.125Z] 0000010010433200:	method=0000010023610B48 (java/lang/Thread$$Lambda$66/0x0000000000000000.test(Ljava/lang/Object;)Z) (JIT)
[2022-07-09T17:40:41.125Z] 0000010010433200:	stack=00000100220AC810-00000100220B20C0
[2022-07-09T17:40:41.125Z] 17:40:33.331 0x10022c41600    j9mm.479    *   ** ASSERTION FAILED ** at /home/jenkins/workspace/build-scripts/jobs/jdk19/jdk19-aix-ppc64-openj9/workspace/build/src/openj9/runtime/gc_glue_java/MarkingSchemeRootMarker.cpp:48: ((MM_StackSlotValidator(0, object, stackLocation, walkState).validate(_env)))
[2022-07-09T17:40:41.125Z] JVMDUMP039I Processing dump event "traceassert", detail "" at 2022/07/09 13:40:33 - please wait.

[2022-07-09T17:51:11.339Z] jdk_lang_1_FAILED

JasonFengJ9 · 2022-07-25T14:07:55Z

An internal build(ubu22s390x-rt3-1)

java version "11.0.16" 2022-07-19
IBM Semeru Runtime Certified Edition 11.0.16.0-rc1a (build 11.0.16+8)
Eclipse OpenJ9 VM 11.0.16.0-rc1a (build openj9-0.33.0-rc1a, JRE 11 Linux s390x-64-Bit Compressed References 20220721_339 (JIT enabled, AOT enabled)
OpenJ9   - 04a55b45b
OMR      - b58aa2708
JCL      - 78837d3d66 based on jdk-11.0.16+8)

[2022-07-22T03:41:01.438Z] variation: Mode650
[2022-07-22T03:41:01.438Z] JVM_OPTIONS:  -XX:-UseCompressedOops 

[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0A2A00: Invalid class pointer in stack allocated object in thread Thread-66
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0A2A00:	O-Slot=000003FE94008D30
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0A2A00:	O-Slot value=000003FE94008BC8
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0A2A00:	PC=000003FFA04D8E50
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0A2A00:	framesWalked=3
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0A2A00:	arg0EA=000003FE94008D38
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0A2A00:	walkSP=000003FE94008D10
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0A2A00:	literals=000003FFA04EC498
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0A2A00:	jitInfo=0000000000000000
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0A2A00:	method=000003FFA04EC498 (net/adoptopenjdk/test/hcrAgent/agent/TransformerMakerThread.run()V) (Interpreted)
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0A2A00:	stack=000003FE94003550-000003FE94008D90
[2022-07-22T03:42:13.706Z] LT  stderr 03:42:06.197 0x3fe9c087500    j9mm.479    *   ** ASSERTION FAILED ** at ../../../../../../openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:108: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))
[2022-07-22T03:42:13.706Z] LT  stderr JVMDUMP039I Processing dump event "traceassert", detail "" at 2022/07/22 03:42:06 - please wait.
[2022-07-22T03:42:13.706Z] LT  stderr JVMDUMP032I JVM requested System dump using '/home/jenkins/workspace/Test_openjdk11_j9_extended.system_s390x_linux_testList_0/aqa-tests/TKG/output_16584587027484/HCRLateAttachWorkload_previewEnabled_1/20220722-034101-HCRLateAttachWorkload/results/core.20220722.034206.186448.0001.dmp' in response to an event
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C08DE00: Invalid class pointer in stack allocated object in thread Thread-67
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C08DE00:	O-Slot=000003FE840206B0
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C08DE00:	O-Slot value=000003FE84020548
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C08DE00:	PC=000003FFA04D8E77
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C08DE00:	framesWalked=3
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C08DE00:	arg0EA=000003FE840206B8
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C08DE00:	walkSP=000003FE84020690
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C08DE00:	literals=000003FFA04EC498
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C08DE00:	jitInfo=0000000000000000
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C08DE00:	method=000003FFA04EC498 (net/adoptopenjdk/test/hcrAgent/agent/TransformerMakerThread.run()V) (Interpreted)
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C08DE00:	stack=000003FE8401AED0-000003FE84020710
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0B0D00: Invalid class pointer in stack allocated object in thread Thread-68
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0B0D00:	O-Slot=000003FE80071750
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0B0D00:	O-Slot value=000003FE800715E8
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0B0D00:	PC=000003FFA04D8E50
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0B0D00:	framesWalked=3
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0B0D00:	arg0EA=000003FE80071758
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0B0D00:	walkSP=000003FE80071730
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0B0D00:	literals=000003FFA04EC498
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0B0D00:	jitInfo=0000000000000000
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0B0D00:	method=000003FFA04EC498 (net/adoptopenjdk/test/hcrAgent/agent/TransformerMakerThread.run()V) (Interpreted)
[2022-07-22T03:42:13.706Z] LT  stderr 000003FE9C0B0D00:	stack=000003FE8006BF70-000003FE800717B0
[2022-07-22T03:42:13.706Z] STF 03:42:09.909 - Found dump at: /home/jenkins/workspace/Test_openjdk11_j9_extended.system_s390x_linux_testList_0/aqa-tests/TKG/output_16584587027484/HCRLateAttachWorkload_previewEnabled_1/20220722-034101-HCRLateAttachWorkload/results/javacore.20220722.034206.186448.0002.txt
[2022-07-22T03:42:13.706Z] STF 03:42:09.910 - Found dump at: /home/jenkins/workspace/Test_openjdk11_j9_extended.system_s390x_linux_testList_0/aqa-tests/TKG/output_16584587027484/HCRLateAttachWorkload_previewEnabled_1/20220722-034101-HCRLateAttachWorkload/results/core.20220722.034206.186448.0001.dmp
[2022-07-22T03:42:13.706Z] LT  stderr JVMDUMP010I System dump written to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_s390x_linux_testList_0/aqa-tests/TKG/output_16584587027484/HCRLateAttachWorkload_previewEnabled_1/20220722-034101-HCRLateAttachWorkload/results/core.20220722.034206.186448.0001.dmp
[2022-07-22T03:42:13.706Z] LT  stderr JVMDUMP032I JVM requested Java dump using '/home/jenkins/workspace/Test_openjdk11_j9_extended.system_s390x_linux_testList_0/aqa-tests/TKG/output_16584587027484/HCRLateAttachWorkload_previewEnabled_1/20220722-034101-HCRLateAttachWorkload/results/javacore.20220722.034206.186448.0002.txt' in response to an event
[2022-07-22T03:42:13.706Z] AG  stderr javacore file generated - /home/jenkins/workspace/Test_openjdk11_j9_extended.system_s390x_linux_testList_0/aqa-tests/TKG/output_16584587027484/HCRLateAttachWorkload_previewEnabled_1/20220722-034101-HCRLateAttachWorkload/results/javacore.20220722.034206.186448.0002.txt
[2022-07-22T03:42:13.706Z] AG  stderr core file generated - /home/jenkins/workspace/Test_openjdk11_j9_extended.system_s390x_linux_testList_0/aqa-tests/TKG/output_16584587027484/HCRLateAttachWorkload_previewEnabled_1/20220722-034101-HCRLateAttachWorkload/results/core.20220722.034206.186448.0001.dmp
[2022-07-22T03:42:13.706Z] AG  stderr Exception in thread "main" java.net.SocketException: Broken pipe (Write failed)
[2022-07-22T03:42:13.706Z] AG  stderr 	at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:110)
[2022-07-22T03:42:13.706Z] AG  stderr 	at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:129)
[2022-07-22T03:42:13.706Z] AG  stderr 	at java.base/openj9.internal.tools.attach.target.AttachmentConnection.streamSend(AttachmentConnection.java:105)
[2022-07-22T03:42:13.706Z] AG  stderr 	at jdk.attach/com.ibm.tools.attach.attacher.OpenJ9VirtualMachine.detach(OpenJ9VirtualMachine.java:206)
[2022-07-22T03:42:13.706Z] AG  stderr 	at net.adoptopenjdk.test.hcrAgent.agent.Attacher.main(Attacher.java:85)
[2022-07-22T03:42:13.706Z] STF 03:42:12.428 - Found dump at: /home/jenkins/workspace/Test_openjdk11_j9_extended.system_s390x_linux_testList_0/aqa-tests/TKG/output_16584587027484/HCRLateAttachWorkload_previewEnabled_1/20220722-034101-HCRLateAttachWorkload/results/Snap.20220722.034206.186448.0003.trc
[2022-07-22T03:42:13.706Z] LT  stderr JVMDUMP010I Java dump written to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_s390x_linux_testList_0/aqa-tests/TKG/output_16584587027484/HCRLateAttachWorkload_previewEnabled_1/20220722-034101-HCRLateAttachWorkload/results/javacore.20220722.034206.186448.0002.txt
[2022-07-22T03:42:13.706Z] LT  stderr JVMDUMP032I JVM requested Snap dump using '/home/jenkins/workspace/Test_openjdk11_j9_extended.system_s390x_linux_testList_0/aqa-tests/TKG/output_16584587027484/HCRLateAttachWorkload_previewEnabled_1/20220722-034101-HCRLateAttachWorkload/results/Snap.20220722.034206.186448.0003.trc' in response to an event
[2022-07-22T03:42:13.706Z] LT  stderr JVMDUMP010I Snap dump written to /home/jenkins/workspace/Test_openjdk11_j9_extended.system_s390x_linux_testList_0/aqa-tests/TKG/output_16584587027484/HCRLateAttachWorkload_previewEnabled_1/20220722-034101-HCRLateAttachWorkload/results/Snap.20220722.034206.186448.0003.trc
[2022-07-22T03:42:13.706Z] LT  stderr JVMDUMP013I Processed dump event "traceassert", detail "".
[2022-07-22T03:42:13.706Z] STF 03:42:12.430 - **FAILED** Process LT  has ended unexpectedly
[2022-07-22T03:42:13.706Z] AG  stderr Snap file generated - /home/jenkins/workspace/Test_openjdk11_j9_extended.system_s390x_linux_testList_0/aqa-tests/TKG/output_16584587027484/HCRLateAttachWorkload_previewEnabled_1/20220722-034101-HCRLateAttachWorkload/results/Snap.20220722.034206.186448.0003.trc
[2022-07-22T03:42:13.706Z] STF 03:42:12.431 - Monitoring Report Summary:
[2022-07-22T03:42:13.706Z] STF 03:42:12.431 -   o Process AG  has crashed unexpectedly
[2022-07-22T03:42:13.706Z] STF 03:42:12.431 -   o Process LT  has ended unexpectedly
[2022-07-22T03:42:13.706Z] STF 03:42:12.431 - Killing processes: AG  LT 
[2022-07-22T03:42:13.706Z] STF 03:42:12.431 -   o Process clean up attempt 1 for AG  pid 186451
[2022-07-22T03:42:13.706Z] STF 03:42:12.431 -   o Process AG  pid 186451 stop()
[2022-07-22T03:42:14.439Z] STF 03:42:13.433 -   o Process AG  pid 186451 killed
[2022-07-22T03:42:14.439Z] STF 03:42:13.433 -   o Process LT  pid 186448 is not running
[2022-07-22T03:42:14.440Z] **FAILED** at step 3 (Wait for Agent to complete). Expected return value=0 Actual=1 at /home/jenkins/workspace/Test_openjdk11_j9_extended.system_s390x_linux_testList_0/aqa-tests/TKG/../TKG/output_16584587027484/HCRLateAttachWorkload_previewEnabled_1/20220722-034101-HCRLateAttachWorkload/execute.pl line 157.
[2022-07-22T03:42:14.440Z] STF 03:42:13.828 - **FAILED** execute script failed. Expected return value=0 Actual=1
[2022-07-22T03:42:14.440Z] STF 03:42:13.828 - 
[2022-07-22T03:42:14.440Z] STF 03:42:13.828 - ====================   T E A R D O W N   ====================
[2022-07-22T03:42:14.440Z] STF 03:42:13.828 - Running teardown: perl /home/jenkins/workspace/Test_openjdk11_j9_extended.system_s390x_linux_testList_0/aqa-tests/TKG/../TKG/output_16584587027484/HCRLateAttachWorkload_previewEnabled_1/20220722-034101-HCRLateAttachWorkload/tearDown.pl
[2022-07-22T03:42:14.440Z] STF 03:42:13.936 - TEARDOWN stage completed
[2022-07-22T03:42:14.440Z] STF 03:42:13.945 - 
[2022-07-22T03:42:14.440Z] STF 03:42:13.945 - =====================   R E S U L T S   =====================
[2022-07-22T03:42:14.440Z] STF 03:42:13.945 - Stage results:
[2022-07-22T03:42:14.440Z] STF 03:42:13.945 -   setUp:     pass
[2022-07-22T03:42:14.440Z] STF 03:42:13.945 -   execute:  *fail*
[2022-07-22T03:42:14.440Z] STF 03:42:13.945 -   teardown:  pass
[2022-07-22T03:42:14.440Z] STF 03:42:13.945 - 
[2022-07-22T03:42:14.440Z] STF 03:42:13.945 - Overall result: **FAILED**
[2022-07-22T03:42:14.440Z] 
[2022-07-22T03:42:14.440Z] HCRLateAttachWorkload_previewEnabled_1_FAILED

50x internal grinder - passed

Same assertion as #15476

JasonFengJ9 · 2022-09-01T16:06:02Z

An internal build(p10sles021)

[2022-08-28T09:20:36.685Z] variation: Mode112
[2022-08-28T09:20:36.685Z] JVM_OPTIONS:  -Xgcpolicy:gencon -Xjit:count=0 -Xnocompressedrefs 

[2022-08-28T09:20:38.733Z] openjdk version "19" 2022-09-20
[2022-08-28T09:20:38.733Z] IBM Semeru Runtime Open Edition 19+36 (build 19+36)
[2022-08-28T09:20:38.733Z] Eclipse OpenJ9 VM 19+36 (build master-c14fe746e, JRE 19 Linux ppc64le-64-Bit Compressed References 20220919_32 (JIT enabled, AOT enabled)
[2022-08-28T09:20:38.733Z] OpenJ9   - c14fe746e
[2022-08-28T09:20:38.733Z] OMR      - 938f0686f
[2022-08-28T09:20:38.733Z] JCL      - f52075642c based on jdk-19+36)

[2022-08-28T09:21:41.693Z] LT  05:21:36.617 - Completed 14.9%. Number of tests started=4073 (+2522)
[2022-08-28T09:21:44.958Z] LT  stderr 00007FFFA4C83900: Object neither in heap nor stack-allocated in thread load-27
[2022-08-28T09:21:44.958Z] LT  stderr 00007FFFA4C83900:	O-Slot=00007FFDCC05E0E0
[2022-08-28T09:21:44.958Z] LT  stderr 00007FFFA4C83900:	O-Slot value=00007FFFA4426FB0
[2022-08-28T09:21:44.958Z] LT  stderr 00007FFFA4C83900:	PC=00007FFF0EF9FA14
[2022-08-28T09:21:44.958Z] LT  stderr 00007FFFA4C83900:	framesWalked=2
[2022-08-28T09:21:44.958Z] LT  stderr 00007FFFA4C83900:	arg0EA=00007FFDCC05E0F8
[2022-08-28T09:21:44.958Z] LT  stderr 00007FFFA4C83900:	walkSP=00007FFDCC05E018
[2022-08-28T09:21:44.958Z] LT  stderr 00007FFFA4C83900:	literals=0000000000000000
[2022-08-28T09:21:44.958Z] LT  stderr 00007FFFA4C83900:	jitInfo=00007FFE764C8C78
[2022-08-28T09:21:44.958Z] LT  stderr 00007FFFA4C83900:	method=00007FFFA423F860 (java/lang/Thread.genThreadName()Ljava/lang/String;) (JIT)
[2022-08-28T09:21:44.958Z] LT  stderr 00007FFFA4C83900:	stack=00007FFDCC024FA8-00007FFDCC05EB60
[2022-08-28T09:21:44.958Z] LT  stderr 09:21:43.780 0x7ffe68002400    j9mm.479    *   ** ASSERTION FAILED ** at /home/jenkins/workspace/build-scripts/jobs/jdk19/jdk19-linux-ppc64le-openj9/workspace/build/src/openj9/runtime/gc_glue_java/MarkingSchemeRootMarker.cpp:53: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, object, stackLocation, walkState).validate(_env)))
[2022-08-28T09:21:44.958Z] LT  stderr JVMDUMP039I Processing dump event "traceassert", detail "" at 2022/08/28 05:21:43 - please wait.

[2022-08-28T09:21:46.868Z] LambdaLoadTest_special_J9_5m_4_FAILED

Same as #13369 which was marked as dup of this.

JasonFengJ9 · 2022-09-01T16:08:35Z

An internal build(ub18-aarch64-1)

[2022-08-28T00:57:54.299Z] variation: Mode110
[2022-08-28T00:57:54.299Z] JVM_OPTIONS:  -Xjit -Xgcpolicy:gencon -Xnocompressedrefs 

[2022-08-28T00:57:59.706Z] openjdk version "19" 2022-09-20
[2022-08-28T00:57:59.706Z] IBM Semeru Runtime Open Edition 19+36 (build 19+36)
[2022-08-28T00:57:59.706Z] Eclipse OpenJ9 VM 19+36 (build master-c14fe746e, JRE 19 Linux aarch64-64-Bit Compressed References 20220920_32 (JIT enabled, AOT enabled)
[2022-08-28T00:57:59.706Z] OpenJ9   - c14fe746e
[2022-08-28T00:57:59.706Z] OMR      - 938f0686f
[2022-08-28T00:57:59.706Z] JCL      - f52075642c based on jdk-19+36)

[2022-08-28T00:58:46.461Z] LT  20:58:43.519 - Completed 13.4%. Number of tests started=1366 (+643)
[2022-08-28T00:58:46.461Z] LT  stderr 0000FFFFB8B1AC00: Object neither in heap nor stack-allocated in thread load-1
[2022-08-28T00:58:46.461Z] LT  stderr 0000FFFFB8B1AC00:	O-Slot=0000FFFEA01B2168
[2022-08-28T00:58:46.461Z] LT  stderr 0000FFFFB8B1AC00:	O-Slot value=0000FFFFB838B7B8
[2022-08-28T00:58:46.461Z] LT  stderr 0000FFFFB8B1AC00:	PC=0000FFFF1E56EF24
[2022-08-28T00:58:46.461Z] LT  stderr 0000FFFFB8B1AC00:	framesWalked=1
[2022-08-28T00:58:46.461Z] LT  stderr 0000FFFFB8B1AC00:	arg0EA=0000FFFEA01B2188
[2022-08-28T00:58:46.461Z] LT  stderr 0000FFFFB8B1AC00:	walkSP=0000FFFEA01B20F8
[2022-08-28T00:58:46.461Z] LT  stderr 0000FFFFB8B1AC00:	literals=0000000000000000
[2022-08-28T00:58:46.461Z] LT  stderr 0000FFFFB8B1AC00:	jitInfo=0000FFFEE4715D60
[2022-08-28T00:58:46.461Z] LT  stderr 0000FFFFB8B1AC00:	method=0000FFFFB819F6C0 (java/lang/Thread.genThreadName()Ljava/lang/String;) (JIT)
[2022-08-28T00:58:46.461Z] LT  stderr 0000FFFFB8B1AC00:	stack=0000FFFEA0148CF8-0000FFFEA01B2B00
[2022-08-28T00:58:46.461Z] LT  stderr 00:58:43.988 0xfffec0002400    j9mm.479    *   ** ASSERTION FAILED ** at /home/jenkins/workspace/build-scripts/jobs/jdk19/jdk19-linux-aarch64-openj9/workspace/build/src/openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:108: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))
[2022-08-28T00:58:46.461Z] LT  stderr JVMDUMP039I Processing dump event "traceassert", detail "" at 2022/08/27 20:58:43 - please wait.

[2022-08-28T00:58:49.987Z] LambdaLoadTest_J9_5m_0_FAILED

pshipton · 2022-09-08T00:53:48Z

Internal build (p10rhel053)
LambdaLoadTest_special_J9_5m_1 -Xgcpolicy:optthruput -Xjit:count=0 -Xnocompressedrefs

[2022-08-30T09:47:36.676Z] openjdk version "19-beta" 2022-09-20
[2022-08-30T09:47:36.676Z] IBM Semeru Runtime Open Edition 19+36-202208300535 (build 19-beta+36-202208300535)
[2022-08-30T09:47:36.676Z] Eclipse OpenJ9 VM 19+36-202208300535 (build master-e53d18b81, JRE 19 Linux ppc64le-64-Bit Compressed References 20220830_33 (JIT enabled, AOT enabled)
[2022-08-30T09:47:36.676Z] OpenJ9   - e53d18b81
[2022-08-30T09:47:36.676Z] OMR      - 938f0686f
[2022-08-30T09:47:36.676Z] JCL      - f52075642c based on jdk-19+36)

[2022-08-30T09:48:24.112Z] LT  stderr 00007FFF94C6A400: Object neither in heap nor stack-allocated in thread load-24
[2022-08-30T09:48:24.112Z] LT  stderr 00007FFF94C6A400:	O-Slot=00007FFDD8048EC0
[2022-08-30T09:48:24.112Z] LT  stderr 00007FFF94C6A400:	O-Slot value=00007FFF9440FCB0
[2022-08-30T09:48:24.112Z] LT  stderr 00007FFF94C6A400:	PC=00007FFF00D415E4
[2022-08-30T09:48:24.112Z] LT  stderr 00007FFF94C6A400:	framesWalked=1
[2022-08-30T09:48:24.112Z] LT  stderr 00007FFF94C6A400:	arg0EA=00007FFDD8048ED8
[2022-08-30T09:48:24.112Z] LT  stderr 00007FFF94C6A400:	walkSP=00007FFDD8048E58
[2022-08-30T09:48:24.112Z] LT  stderr 00007FFF94C6A400:	literals=0000000000000000
[2022-08-30T09:48:24.112Z] LT  stderr 00007FFF94C6A400:	jitInfo=00007FFEC8267878
[2022-08-30T09:48:24.112Z] LT  stderr 00007FFF94C6A400:	method=00007FFF9422E940 (java/lang/Thread.genThreadName()Ljava/lang/String;) (JIT)
[2022-08-30T09:48:24.112Z] LT  stderr 00007FFF94C6A400:	stack=00007FFDD8027F78-00007FFDD80499A0
[2022-08-30T09:48:24.112Z] LT  stderr 09:48:19.527 0x7ffe58002400    j9mm.479    *   ** ASSERTION FAILED ** at ../../../../../../openj9/runtime/gc_glue_java/MarkingSchemeRootMarker.cpp:53: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, object, stackLocation, walkState).validate(_env)))

JasonFengJ9 · 2022-09-12T21:46:11Z

Internal build(macaarch64rt1)

[2022-09-11T12:25:18.326Z] variation: Mode101
[2022-09-11T12:25:18.326Z] JVM_OPTIONS:  -Xjit -Xgcpolicy:optthruput -Xnocompressedrefs 

[2022-09-11T12:25:19.615Z] openjdk version "19-ea" 2022-09-20
[2022-09-11T12:25:19.615Z] IBM Semeru Runtime Open Edition 19+36 (build 19-ea+36)
[2022-09-11T12:25:19.615Z] Eclipse OpenJ9 VM 19+36 (build master-b8752ec8b, JRE 19 Mac OS X aarch64-64-Bit 20220920_37 (JIT enabled, AOT enabled)
[2022-09-11T12:25:19.615Z] OpenJ9   - b8752ec8b
[2022-09-11T12:25:19.615Z] OMR      - 647678f93
[2022-09-11T12:25:19.615Z] JCL      - 034a8c8f12 based on jdk-19+36)

[2022-09-11T12:28:21.399Z] LT  08:28:20.377 - Completed 60.0%. Number of tests started=11882 (+1241)
[2022-09-11T12:28:38.365Z] LT  stderr 00000001490C4F00: Object neither in heap nor stack-allocated in thread load-3
[2022-09-11T12:28:38.365Z] LT  stderr 00000001490C4F00:	O-Slot=0000000158521700
[2022-09-11T12:28:38.365Z] LT  stderr 00000001490C4F00:	O-Slot value=00000001517FF3B8
[2022-09-11T12:28:38.365Z] LT  stderr 00000001490C4F00:	PC=000000010FB57B9C
[2022-09-11T12:28:38.365Z] LT  stderr 00000001490C4F00:	framesWalked=1
[2022-09-11T12:28:38.365Z] LT  stderr 00000001490C4F00:	arg0EA=0000000158521718
[2022-09-11T12:28:38.365Z] LT  stderr 00000001490C4F00:	walkSP=0000000158521698
[2022-09-11T12:28:38.365Z] LT  stderr 00000001490C4F00:	literals=0000000000000000
[2022-09-11T12:28:38.365Z] LT  stderr 00000001490C4F00:	jitInfo=00000001602C64A8
[2022-09-11T12:28:38.365Z] LT  stderr 00000001490C4F00:	method=00000001515D03F0 (java/lang/Thread.genThreadName()Ljava/lang/String;) (JIT)
[2022-09-11T12:28:38.365Z] LT  stderr 00000001490C4F00:	stack=00000001584B8048-0000000158522090
[2022-09-11T12:28:38.365Z] LT  stderr 12:28:36.322 0x149171700    j9mm.479    *   ** ASSERTION FAILED ** at /Users/jenkins/workspace/build-scripts/jobs/jdk19/jdk19-mac-aarch64-openj9/workspace/build/src/openj9/runtime/gc_glue_java/MarkingSchemeRootMarker.cpp:53: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, object, stackLocation, walkState).validate(_env)))
[2022-09-11T12:28:38.365Z] LT  stderr JVMDUMP039I Processing dump event "traceassert", detail "" at 2022/09/11 08:28:36 - please wait.

[2022-09-11T12:28:54.857Z] LambdaLoadTest_special_J9_5m_0_FAILED

pshipton · 2022-09-14T16:07:29Z

Another occurrence #15885

JasonFengJ9 · 2022-09-20T22:19:53Z

An internal build(p10sles021)

openjdk version "19-beta" 2022-09-20
IBM Semeru Runtime Open Edition 19+36-202209200534 (build 19-beta+36-202209200534)
Eclipse OpenJ9 VM 19+36-202209200534 (build master-2184d058b, JRE 19 Linux ppc64le-64-Bit Compressed References 20220920_43 (JIT enabled, AOT enabled)
OpenJ9   - 2184d058b
OMR      - b1be89cf5
JCL      - b56bf70733 based on jdk-19+36)

[2022-09-20T08:52:21.700Z] variation: Mode121
[2022-09-20T08:52:21.700Z] JVM_OPTIONS:  -Xgcpolicy:optavgpause -Xjit:count=0 -Xnocompressedrefs 

[2022-09-20T08:53:05.531Z] LT  stderr 08:53:04.123 0x7ffe78002400    j9mm.479    *   ** ASSERTION FAILED ** at ../../../../../../openj9/runtime/gc_glue_java/MarkingSchemeRootMarker.cpp:53: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, object, stackLocation, walkState).validate(_env)))

dmitripivkine · 2022-09-20T23:33:36Z

LT  stderr 00007FFF84C6E300: Object neither in heap nor stack-allocated in thread load-29
LT  stderr 00007FFF84C6E300:	O-Slot=00007FFDA80A2650
LT  stderr 00007FFF84C6E300:	O-Slot value=00007FFF843F33B0
LT  stderr 00007FFF84C6E300:	PC=00007FFEEFE20014
LT  stderr 00007FFF84C6E300:	framesWalked=2
LT  stderr 00007FFF84C6E300:	arg0EA=00007FFDA80A2668
LT  stderr 00007FFF84C6E300:	walkSP=00007FFDA80A2568
LT  stderr 00007FFF84C6E300:	literals=0000000000000000
LT  stderr 00007FFF84C6E300:	jitInfo=00007FFEB418C138
LT  stderr 00007FFF84C6E300:	method=00007FFF8420EFE0 (java/lang/Thread.genThreadName()Ljava/lang/String;) (JIT)
LT  stderr 00007FFF84C6E300:	stack=00007FFDA80715F8-00007FFDA80A3150

dmitripivkine · 2022-11-18T14:41:59Z

correct, this still be the same issue:

[2022-11-18T06:31:05.794Z] 000000000F984400:	O-Slot value=000000000F8C64B0 <---

> !allclasses | grep java/lang/Thread$ThreadNumbering
0x000000000F8C6500	0x0000000000000328	0x00007F8DDB854268	0x00000000351ADBA0	0	java/lang/Thread$ThreadNumbering
0x00000000351ADBA0	0x00000220	0x00007F8DDB854268	0x00000020	0x0C804000	java/lang/Thread$ThreadNumbering
> !j9class 0x000000000F8C6500 | grep ramStatics
	0x48: UDATA* ramStatics = !j9x 0x000000000F8C64B0 <---

a7ehuo · 2022-11-21T04:46:37Z

I reproduced the issue on Power and I found something interesting in java/lang/Thread.genThreadName()Ljava/lang/String; that might explain why the object points to ramStatics. java/lang/Thread$ThreadNumbering.next()I is inlined into genThreadName. jdk/internal/misc/Unsafe.getAndAddInt(Ljava/lang/Object;JI)I is called by java/lang/Thread$ThreadNumbering.next()I and transformed by recognized call transformer. Accessing ramStatics is part of the transformed call. ramStatics is stored in temp slot 2 in block_6 (n78n). However in block_2, a known object String "Thread-" (n9n) is also stored in temp slot 2 (n107n). Later block 10 expects to initialize a String object with "Thread-" from temp slot 2 and next thread number. But temp slot 2 no longer contains object "Thread-" because it's overwritten by ramStatics loaded in block_6 after inlining and recognized call transformation. I'm still looking into how temp is supposed to be saved during inlining in this case

Post Inlining Trees: for java/lang/Thread.genThreadName()Ljava/lang/String;
...
n1n       BBStart <block_2> (freq 10000)                                                      [    0x76b5f03e46c0] bci=[-1,0,1103] rc=0 vc=15 vn=- li=- udi=- nc=0
n11n      treetop                                                                             [    0x76b5f03e49e0] bci=[-1,10,1103] rc=0 vc=15 vn=- li=- udi=- nc=1
n9n         aload  <string "Thread-">[#398  Static] (obj1) [flags 0x80000307 0x0 ]            [    0x76b5f03e4940] bci=[-1,7,1103] rc=2 vc=15 vn=- li=- udi=- nc=0
n107n     astore  <temp slot 2>[#440  Auto] (obj1) [flags 0x7 0x0 ]                           [    0x76b5f04a1130] bci=[-1,7,1103] rc=0 vc=0 vn=- li=- udi=- nc=1
n9n         ==>aload
n101n     ificmpne --> block_11 BBStart at n97n (HCRGuard/NonoverriddenTest )                 [    0x76b5f04a0f50] bci=[0,0,1095] rc=0 vc=0 vn=- li=- udi=- nc=2 flg=0x1020
n99n        iload  unknown static[#439  Static] [flags 0x10303 0x0 ]                          [    0x76b5f04a0eb0] bci=[-1,13,1103] rc=1 vc=0 vn=- li=- udi=- nc=0
n100n       iconst 0                                                                          [    0x76b5f04a0f00] bci=[-1,13,1103] rc=1 vc=0 vn=- li=- udi=- nc=0
n94n      BBEnd </block_2> ===== 
...
n70n      BBStart <block_6> (freq 10000)                                                      [    0x76b5f04a05a0] bci=[0,9,1095] rc=0 vc=0 vn=- li=- udi=- nc=0
n78n      astore  <temp slot 2>[#435  Auto] [flags 0x7 0x0 ]                                  [    0x76b5f04a0820] bci=[0,9,1095] rc=0 vc=0 vn=- li=- udi=- nc=1
n77n        aloadi  <ramStaticsFromClass>[#309  Shadow +72] [flags 0x10607 0x0 ]              [    0x76b5f04a07d0] bci=[0,9,1095] rc=1 vc=0 vn=- li=1 udi=- nc=1
n76n          aloadi  <classFromJavaLangClass>[#307  Shadow +16] [flags 0x10607 0x0 ]         [    0x76b5f04a0780] bci=[0,9,1095] rc=1 vc=0 vn=- li=1 udi=- nc=1
n75n            aload  <temp slot 2>[#435  Auto] [flags 0x7 0x0 ]                             [    0x76b5f04a0730] bci=[0,9,1095] rc=1 vc=0 vn=- li=1 udi=- nc=0
n82n      lstore  <temp slot 3>[#436  Auto] [flags 0x4 0x0 ]                                  [    0x76b5f04a0960] bci=[0,9,1095] rc=0 vc=0 vn=- li=- udi=- nc=1
n81n        land                                                                              [    0x76b5f04a0910] bci=[0,9,1095] rc=1 vc=0 vn=- li=1 udi=- nc=2
n79n          lload  <temp slot 3>[#436  Auto] [flags 0x4 0x0 ]                               [    0x76b5f04a0870] bci=[0,9,1095] rc=1 vc=0 vn=- li=1 udi=- nc=0
n80n          lconst -4                                                                       [    0x76b5f04a08c0] bci=[-1,0,1103] rc=1 vc=0 vn=- li=1 udi=- nc=0
n84n      BBEnd </block_6> =====  
...
n95n      BBStart <block_10> (freq 10000)                                                     [    0x76b5f04a0d70] bci=[-1,13,1103] rc=0 vc=0 vn=- li=- udi=- nc=0
n13n      treetop                                                                             [    0x76b5f03e4a80] bci=[-1,13,1103] rc=0 vc=15 vn=- li=- udi=- nc=1
n106n       iload  <temp slot 1>[#438  Auto] [flags 0x3 0x0 ]                                 [    0x76b5f04a10e0] bci=[-1,13,1103] rc=3 vc=0 vn=- li=- udi=- nc=0
n15n      treetop                                                                             [    0x76b5f03e4b20] bci=[-1,16,1103] rc=0 vc=15 vn=- li=- udi=- nc=1
n106n       ==>iload
n17n      treetop                                                                             [    0x76b5f03e4bc0] bci=[-1,19,1103] rc=0 vc=15 vn=- li=- udi=- nc=1
n16n        new  jitNewObject[#91  helper Method] [flags 0x400 0x0 ]                          [    0x76b5f03e4b70] bci=[-1,19,1103] rc=3 vc=15 vn=- li=- udi=- nc=1
n24n          loadaddr  java/lang/String[#411  Static] [flags 0x18307 0x0 ]                   [    0x76b5f03e4df0] bci=[-1,19,1103] rc=1 vc=15 vn=- li=- udi=- nc=0
n26n      treetop                                                                             [    0x76b5f03e4e90] bci=[-1,19,1103] rc=0 vc=15 vn=- li=- udi=- nc=1
n25n        call  java/lang/String.<init>(Ljava/lang/String;I)V[#425  final special Method] [flags 0x20500 0x0 ] ()  [    0x76b5f03e4e40] bci=[-1,19,1103] rc=1 vc=16 vn=- li=- udi=- nc=3 flg=0x20
n16n          ==>new
n108n         aload  <temp slot 2>[#440  Auto] (obj1) [flags 0x7 0x0 ]                        [    0x76b5f04a1180] bci=[-1,7,1103] rc=1 vc=0 vn=- li=- udi=- nc=0
n106n         ==>iload
n27n      allocationFence on n16n                                                             [    0x76b5f03e4ee0] bci=[-1,19,1103] rc=0 vc=15 vn=- li=- udi=- nc=0
n18n      areturn                                                                             [    0x76b5f03e4c10] bci=[-1,22,1103] rc=0 vc=15 vn=- li=- udi=- nc=1
n16n        ==>new
n2n       BBEnd </block_10> =====

pshipton · 2022-11-21T21:58:00Z

https://openj9-jenkins.osuosl.org/job/Test_openjdk19_j9_sanity.openjdk_aarch64_linux_Nightly/54
jdk_lang_1
java/lang/StackWalker/AcrossThreads.java

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk19_j9_sanity.openjdk_aarch64_linux_Nightly/54/openjdk_test_output.tar.gz

https://openj9-jenkins.osuosl.org/job/Test_openjdk19_j9_sanity.openjdk_x86-64_linux_Nightly/53
jdk_lang_0
java/lang/StackWalker/AcrossThreads.java

No diagnostics

pshipton · 2022-11-23T13:28:38Z

https://openj9-jenkins.osuosl.org/job/Test_openjdk19_j9_sanity.openjdk_ppc64_aix_Nightly/55
jdk_lang_1
java/lang/StackWalker/AcrossThreads.java

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk19_j9_sanity.openjdk_ppc64_aix_Nightly/55/openjdk_test_output.tar.gz

https://openj9-jenkins.osuosl.org/job/Test_openjdk19_j9_sanity.openjdk_x86-64_linux_Nightly/55
jdk_util_0
java/util/zip/FlaterTest.java

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk19_j9_sanity.openjdk_x86-64_linux_Nightly/55/openjdk_test_output.tar.gz

a7ehuo · 2022-11-23T18:54:50Z

What I suspected about overwritten temp slots in #15251 (comment) is not an issue. n107n (#440) and n78n (#435) have different sym refs and they are saved to different addresses.

After some discussion with @vijaysun-omr, he noticed #435 (n78n) which is ramStaticsFromClass was marked collected and showed up in the GC map when it shouldn't. n78n is created as part of the transformation of Unsafe.getAndAddInt in J9::RecognizedCallTransformer::processUnsafeAtomicCall. I'm experimenting a fix

a7ehuo · 2022-11-24T18:25:35Z

I'm still looking at how to properly fix this issue. Adding more details on what the issue is.

jdk/internal/misc/Unsafe.getAndAddInt(Ljava/lang/Object;JI)I is called by Thread$ThreadNumbering.next() which is inlined into Thread.genThreadName()
jdk/internal/misc/Unsafe.getAndAddInt(Ljava/lang/Object;JI)I is transformed in J9::RecognizedCallTransformer::processUnsafeAtomicCall to use helper call.

In the transformed IL tree, #435 first stores java lang class object (n43n) in block_2. If the class object is NULL, it jumps to blocks_7 where the helper call atomicFetchAndAdd loads #435 and adds an offset to it.

If java lang class object is not NULL, eventually if it is static, it gets to block_5 where ramStatics is also stored into #435 (n78n). And then blocks_7 loads the ramStatics from #435.

The issue here is that the first store (n43n) to #435 is collected and the second store (ramStatics) to #435 is not collected.

log.25864.9509.20221124.090509.25864.zip

Trees after recognized call transformer: for java/lang/Thread$ThreadNumbering.next()I

Call Stack Info
CalleeIndex CallerIndex ByteCodeIndex CalleeMethod
       0         -1          13       java/lang/Thread$ThreadNumbering.next()I

------------------------------------------------------------------------------------------------------------------------------------------------------------------------
n28n      BBStart <block_2>                                                                   [    0x710fc05e4f30] bci=[0,0,1095] rc=0 vc=0 vn=- li=- udi=- nc=0
n39n      NULLCHK on n30n [#32]                                                               [    0x710fc05e52a0] bci=[0,9,1095] rc=0 vc=0 vn=- li=- udi=- nc=1
n38n        PassThrough                                                                       [    0x710fc05e5250] bci=[0,9,1095] rc=1 vc=0 vn=- li=- udi=- nc=1
n30n          aload  java/lang/Thread$ThreadNumbering.U Ljdk/internal/misc/Unsafe;[#426  final Static] [flags 0xa0307 0x0 ]  [    0x710fc05e4fd0] bci=[0,0,1095] rc=2 vc=0 vn=- li=- udi=- nc=0
n41n      astore  <temp slot 1>[#434  Auto] [flags 0x7 0x0 ]                                  [    0x710fc05e5340] bci=[0,9,1095] rc=0 vc=0 vn=- li=- udi=- nc=1
n30n        ==>aload
n43n      astore  <temp slot 2>[#435  Auto] [flags 0x7 0x0 ]                                  [    0x710fc05e53e0] bci=[0,9,1095] rc=0 vc=0 vn=- li=- udi=- nc=1
n32n        aloadi  <javaLangClassFromClass>[#306  Shadow +48] [flags 0x607 0x0 ]             [    0x710fc05e5070] bci=[0,3,1095] rc=1 vc=0 vn=- li=- udi=- nc=1
n31n          loadaddr  java/lang/Thread$ThreadNumbering[#427  Static] [flags 0x18307 0x0 ]   [    0x710fc05e5020] bci=[0,3,1095] rc=1 vc=0 vn=- li=- udi=- nc=0
n45n      lstore  <temp slot 3>[#436  Auto] [flags 0x4 0x0 ]                                  [    0x710fc05e5480] bci=[0,9,1095] rc=0 vc=0 vn=- li=- udi=- nc=1
n33n        lload  java/lang/Thread$ThreadNumbering.NEXT J[#428  final Static] [flags 0xa0304 0x0 ]  [    0x710fc05e50c0] bci=[0,5,1095] rc=1 vc=0 vn=- li=- udi=- nc=0
n47n      istore  <temp slot 4>[#437  Auto] [flags 0x3 0x0 ]                                  [    0x710fc05e5520] bci=[0,9,1095] rc=0 vc=0 vn=- li=- udi=- nc=1
n34n        iconst 1                                                                          [    0x710fc05e5110] bci=[0,8,1095] rc=1 vc=0 vn=- li=- udi=- nc=0
n51n      ifacmpeq --> block_7 BBStart at n83n ()                                             [    0x710fc05e5660] bci=[0,9,1095] rc=0 vc=0 vn=- li=- udi=- nc=2 flg=0x20
n49n        aload  <temp slot 2>[#435  Auto] [flags 0x7 0x0 ]                                 [    0x710fc05e55c0] bci=[0,9,1095] rc=1 vc=0 vn=- li=- udi=- nc=0
n50n        aconst NULL                                                                       [    0x710fc05e5610] bci=[-1,0,1095] rc=1 vc=0 vn=- li=- udi=- nc=0
n53n      BBEnd </block_2> =====                  
...
n70n      BBStart <block_5>                                                                   [    0x710fc06a05a0] bci=[0,9,1095] rc=0 vc=0 vn=- li=- udi=- nc=0
n78n      astore  <temp slot 2>[#435  Auto] [flags 0x7 0x0 ]                                  [    0x710fc06a0820] bci=[0,9,1095] rc=0 vc=0 vn=- li=- udi=- nc=1
n77n        aloadi  <ramStaticsFromClass>[#309  Shadow +72] [flags 0x10607 0x0 ]              [    0x710fc06a07d0] bci=[0,9,1095] rc=1 vc=0 vn=- li=- udi=- nc=1
n76n          aloadi  <classFromJavaLangClass>[#307  Shadow +8] [flags 0x10607 0x0 ]          [    0x710fc06a0780] bci=[0,9,1095] rc=1 vc=0 vn=- li=- udi=- nc=1
n75n            aload  <temp slot 2>[#435  Auto] [flags 0x7 0x0 ]                             [    0x710fc06a0730] bci=[0,9,1095] rc=1 vc=0 vn=- li=- udi=- nc=0
n82n      lstore  <temp slot 3>[#436  Auto] [flags 0x4 0x0 ]                                  [    0x710fc06a0960] bci=[0,9,1095] rc=0 vc=0 vn=- li=- udi=- nc=1
n81n        land                                                                              [    0x710fc06a0910] bci=[0,9,1095] rc=1 vc=0 vn=- li=- udi=- nc=2
n79n          lload  <temp slot 3>[#436  Auto] [flags 0x4 0x0 ]                               [    0x710fc06a0870] bci=[0,9,1095] rc=1 vc=0 vn=- li=- udi=- nc=0
n80n          lconst -4                                                                       [    0x710fc06a08c0] bci=[-1,0,1095] rc=1 vc=0 vn=- li=- udi=- nc=0
n84n      BBEnd </block_5> =====                                                              [    0x710fc06a0a00] bci=[0,9,1095] rc=0 vc=0 vn=- li=- udi=- nc=0

n83n      BBStart <block_7>                                                                   [    0x710fc06a09b0] bci=[0,9,1095] rc=0 vc=0 vn=- li=- udi=- nc=0
n36n      treetop                                                                             [    0x710fc05e51b0] bci=[0,9,1095] rc=0 vc=0 vn=- li=- udi=- nc=1
n35n        icall  <atomicFetchAndAdd>[#371  helper Method] [flags 0x400 0x0 ] ()             [    0x710fc05e5160] bci=[0,9,1095] rc=2 vc=0 vn=- li=- udi=- nc=2 flg=0x20
n87n          aladd                                                                           [    0x710fc06a0af0] bci=[0,9,1095] rc=1 vc=0 vn=- li=- udi=- nc=2
n85n            aload  <temp slot 2>[#435  Auto] [flags 0x7 0x0 ]                             [    0x710fc06a0a50] bci=[0,9,1095] rc=1 vc=0 vn=- li=- udi=- nc=0
n86n            lload  <temp slot 3>[#436  Auto] [flags 0x4 0x0 ]                             [    0x710fc06a0aa0] bci=[0,9,1095] rc=1 vc=0 vn=- li=- udi=- nc=0
n48n          iload  <temp slot 4>[#437  Auto] [flags 0x3 0x0 ]                               [    0x710fc05e5570] bci=[0,9,1095] rc=1 vc=0 vn=- li=- udi=- nc=0
n37n      ireturn                                                                             [    0x710fc05e5200] bci=[0,12,1095] rc=0 vc=0 vn=- li=- udi=- nc=1
n35n        ==>icall
n29n      BBEnd </block_7> =====

pshipton · 2022-11-27T22:49:41Z

https://openj9-jenkins.osuosl.org/job/Test_openjdk19_j9_sanity.system_aarch64_linux_Nightly_testList_2/55
LambdaLoadTest_J9_5m_1

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk19_j9_sanity.system_aarch64_linux_Nightly_testList_2/55/system_test_output.tar.gz

https://openj9-jenkins.osuosl.org/job/Test_openjdk19_j9_sanity.system_aarch64_linux_Nightly_testList_1/56
LambdaLoadTest_J9_5m_1

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk19_j9_sanity.system_aarch64_linux_Nightly_testList_1/56/system_test_output.tar.gz

https://openj9-jenkins.osuosl.org/job/Test_openjdk19_j9_sanity.system_ppc64le_linux_Nightly_testList_1/56
LambdaLoadTest_CS_5m_0

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk19_j9_sanity.system_ppc64le_linux_Nightly_testList_1/56/system_test_output.tar.gz

https://openj9-jenkins.osuosl.org/job/Test_openjdk19_j9_sanity.openjdk_x86-64_linux_Nightly/58
jdk_lang_0
java/lang/StackWalker/AcrossThreads.java

pshipton · 2022-12-06T13:28:29Z

https://openj9-jenkins.osuosl.org/job/Test_openjdk19_j9_sanity.openjdk_x86-64_mac_Nightly/61
jdk_lang_0 & jdk_lang_1
java/lang/ThreadLocal/ThreadLocalSupplierTest.java

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk19_j9_sanity.openjdk_x86-64_mac_Nightly/61/openjdk_test_output.tar.gz

23:06:44  000000000D67A400: Object neither in heap nor stack-allocated in thread AgentVMThread
23:06:44  000000000D67A400:	O-Slot=000000000D78A830
23:06:44  000000000D67A400:	O-Slot value=000000000D4F8EB0
23:06:44  000000000D67A400:	PC=0000000022DCF02D
23:06:44  000000000D67A400:	framesWalked=2
23:06:44  000000000D67A400:	arg0EA=000000000D78A848
23:06:44  000000000D67A400:	walkSP=000000000D78A728
23:06:44  000000000D67A400:	literals=000000000D359130
23:06:44  000000000D67A400:	jitInfo=00007FC1C0140868
23:06:44  000000000D67A400:	method=000000000D380D08 (java/lang/Thread.genThreadName()Ljava/lang/String;) (JIT)
23:06:44  000000000D67A400:	stack=000000000D7845C8-000000000D78B650
23:06:44  04:04:45.923 0xd76e400    j9mm.479    *   ** ASSERTION FAILED ** at /Users/jenkins/workspace/Build_JDK19_x86-64_mac_Nightly/openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:109: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))

pshipton · 2022-12-08T12:10:56Z

Re-opening as there are excluded tests that need to be re-enabled.

JasonFengJ9 · 2023-01-03T21:31:36Z

JDK17 internal build(macaarch64rt8)

java version "17.0.6" 2023-01-17
IBM Semeru Runtime Certified Edition 17.0.6+9 (build 17.0.6+9)
Eclipse OpenJ9 VM 17.0.6+9 (build master-a2475ea96, JRE 17 Mac OS X aarch64-64-Bit 20230117_192 (JIT enabled, AOT enabled)
OpenJ9   - a2475ea96
OMR      - 7d8ea8b6b
JCL      - 9a3078373f based on jdk-17.0.6+9)

[2023-01-01T05:14:35.139Z] variation: Mode650
[2023-01-01T05:14:35.139Z] JVM_OPTIONS:  -XX:-UseCompressedOops 

[2023-01-01T05:21:22.891Z] TEST: jdk/incubator/vector/VectorMaxConversionTests.java#id0

[2023-01-01T05:21:22.898Z] STDERR:
[2023-01-01T05:21:22.898Z] WARNING: Using incubator modules: jdk.incubator.vector
[2023-01-01T05:21:22.898Z] 00000001588DD500: Misaligned stack-allocated object in thread MainThread
[2023-01-01T05:21:22.898Z] 00000001588DD500:	O-Slot=0000000142857040
[2023-01-01T05:21:22.898Z] 00000001588DD500:	O-Slot value=0000000142856FD4
[2023-01-01T05:21:22.898Z] 00000001588DD500:	PC=0000000130AFD6E4
[2023-01-01T05:21:22.898Z] 00000001588DD500:	framesWalked=1
[2023-01-01T05:21:22.898Z] 00000001588DD500:	arg0EA=00000001428579F8
[2023-01-01T05:21:22.898Z] 00000001588DD500:	walkSP=0000000142856DF8
[2023-01-01T05:21:22.898Z] 00000001588DD500:	literals=0000000000000000
[2023-01-01T05:21:22.898Z] 00000001588DD500:	jitInfo=000000014911E628
[2023-01-01T05:21:22.898Z] 00000001588DD500:	method=0000000298149E98 (jdk/incubator/vector/Byte256Vector.rearrange(Ljdk/incubator/vector/VectorShuffle;)Ljdk/incubator/vector/ByteVector;) (JIT)
[2023-01-01T05:21:22.898Z] 00000001588DD500:	stack=0000000142853040-00000001428588A0
[2023-01-01T05:21:22.898Z] 05:20:44.858 0x14201f500    j9mm.479    *   ** ASSERTION FAILED ** at /Users/jenkins/workspace/build-scripts/jobs/jdk17u/jdk17u-mac-aarch64-openj9-IBM/workspace/build/src/openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:109: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))
[2023-01-01T05:21:22.898Z] JVMDUMP039I Processing dump event "traceassert", detail "" at 2023/01/01 00:20:44 - please wait.

[2023-01-01T05:21:22.898Z] TEST RESULT: Failed. Unexpected exit from test [exit code: 255]
[2023-01-01T05:21:22.898Z] --------------------------------------------------
[2023-01-01T05:21:24.877Z] Test results: passed: 71; failed: 1
[2023-01-01T05:21:30.273Z] Report written to /Users/jenkins/workspace/Test_openjdk17_j9_extended.openjdk_aarch64_mac/aqa-tests/TKG/output_16725482488035/jdk_vector_1/report/html/report.html
[2023-01-01T05:21:30.273Z] Results written to /Users/jenkins/workspace/Test_openjdk17_j9_extended.openjdk_aarch64_mac/aqa-tests/TKG/output_16725482488035/jdk_vector_1/work
[2023-01-01T05:21:30.273Z] Error: Some tests failed or other problems occurred.
[2023-01-01T05:21:30.273Z] -----------------------------------
[2023-01-01T05:21:30.273Z] jdk_vector_1_FAILED

pshipton · 2023-01-03T22:44:28Z

@JasonFengJ9 pls open a new issue for the previous, this one is for jdk19 problems that should have been resolved.

The following four tests are reenabled since eclipse-openj9/openj9#15251 has been fixed. Previously they were exclude in adoptium#3750 SC_Softmx_JitAot SC_Softmx_JitAot_Linux SharedClasses.SCM23.MultiThread SharedClasses.SCM23.MultiThreadMultiCL Signed-off-by: Annabelle Huo <Annabelle.Huo@ibm.com>

a7ehuo · 2023-01-19T19:48:39Z

adoptium/aqa-tests#4261 is opened to reenabled the four excluded JDK19 tests

…4261) The following four tests are reenabled since eclipse-openj9/openj9#15251 has been fixed. Previously they were exclude in #3750 SC_Softmx_JitAot SC_Softmx_JitAot_Linux SharedClasses.SCM23.MultiThread SharedClasses.SCM23.MultiThreadMultiCL Signed-off-by: Annabelle Huo <Annabelle.Huo@ibm.com> Signed-off-by: Annabelle Huo <Annabelle.Huo@ibm.com>

pshipton · 2023-01-19T21:45:39Z

The tests have been unexcluded.

JasonFengJ9 added test failure segfault Issues that describe segfaults / JVM crashes jdk19 labels Jun 7, 2022

pshipton added this to the Release 0.34 (Java 19) milestone Jun 8, 2022

JasonFengJ9 mentioned this issue Jun 9, 2022

JDK19/18 excludes adoptium/aqa-tests#3750

Merged

JasonFengJ9 added the test excluded label Jun 9, 2022

pshipton added the comp:gc label Jun 27, 2022

dmitripivkine added comp:jit and removed comp:gc labels Jun 28, 2022

dmitripivkine mentioned this issue Jun 28, 2022

JDK19 LambdaLoadTest_CS_5m_0_FAILED j9mm.479 * ** ASSERTION FAILED ** at runtime\gc_glue_java\MarkingSchemeRootMarker.cpp:53: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, object, stackLocation, walkState).validate(_env))) #15410

Closed

pshipton mentioned this issue Sep 9, 2022

jdk19 Compiling method: java/lang/Thread.genThreadName() crash vmstate 0005FFFF #15855

Closed

dmitripivkine mentioned this issue Sep 14, 2022

Object neither in heap nor stack-allocated ASSERTION FAILED ScavengerRootScanner.hpp:109 #15885

Closed

knn-k mentioned this issue Nov 25, 2022

aarch64 mac LambdaLoadTest_J9_5m_0 crash vmState=0x00000000 Invalid class pointer in stack allocated object #16303

Closed

a7ehuo mentioned this issue Dec 1, 2022

Fix unsafe call transformation #16399

Merged

pshipton mentioned this issue Dec 2, 2022

jdk17 Jep389Tests_testClinkerFfi_UpCall Object neither in heap nor stack-allocated in thread main #16410

Closed

vijaysun-omr closed this as completed in 5d03563 Dec 6, 2022

pshipton reopened this Dec 8, 2022

JasonFengJ9 mentioned this issue Jan 4, 2023

j9mm.479 ASSERTION FAILED at gc_glue_java/ScavengerRootScanner.hpp:109: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env))) #16510

Closed

a7ehuo mentioned this issue Jan 19, 2023

Reenable JDK19 tests after the fix for eclipse-openj9/openj9#15251 adoptium/aqa-tests#4261

Merged

pshipton closed this as completed Jan 19, 2023

pshipton removed the test excluded label Jan 19, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

j9mm.479 ASSERTION FAILED at ScavengerRootScanner.hpp:108/109 or MarkingSchemeRootMarker.cpp:53 ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env))) #15251

j9mm.479 ASSERTION FAILED at ScavengerRootScanner.hpp:108/109 or MarkingSchemeRootMarker.cpp:53 ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env))) #15251

JasonFengJ9 commented Jun 7, 2022

JasonFengJ9 commented Jun 8, 2022

JasonFengJ9 commented Jun 9, 2022 •

edited

pshipton commented Jun 23, 2022 •

edited

pshipton commented Jun 27, 2022

pshipton commented Jun 27, 2022

dmitripivkine commented Jun 28, 2022

pshipton commented Jun 30, 2022

JasonFengJ9 commented Jul 11, 2022

JasonFengJ9 commented Jul 25, 2022 •

edited by pshipton

JasonFengJ9 commented Sep 1, 2022

JasonFengJ9 commented Sep 1, 2022

pshipton commented Sep 8, 2022

JasonFengJ9 commented Sep 12, 2022

pshipton commented Sep 14, 2022

JasonFengJ9 commented Sep 20, 2022

dmitripivkine commented Sep 20, 2022

dmitripivkine commented Nov 18, 2022

a7ehuo commented Nov 21, 2022 •

edited

pshipton commented Nov 21, 2022 •

edited

pshipton commented Nov 23, 2022 •

edited

a7ehuo commented Nov 23, 2022

a7ehuo commented Nov 24, 2022

pshipton commented Nov 27, 2022

pshipton commented Dec 6, 2022

pshipton commented Dec 8, 2022

JasonFengJ9 commented Jan 3, 2023

pshipton commented Jan 3, 2023

a7ehuo commented Jan 19, 2023

pshipton commented Jan 19, 2023

j9mm.479 ASSERTION FAILED at ScavengerRootScanner.hpp:108/109 or MarkingSchemeRootMarker.cpp:53 ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env))) #15251

j9mm.479 ASSERTION FAILED at ScavengerRootScanner.hpp:108/109 or MarkingSchemeRootMarker.cpp:53 ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env))) #15251

Comments

JasonFengJ9 commented Jun 7, 2022

Failure link

Optional info

Failure output (captured from console output)

JasonFengJ9 commented Jun 8, 2022

JasonFengJ9 commented Jun 9, 2022 • edited

pshipton commented Jun 23, 2022 • edited

pshipton commented Jun 27, 2022

pshipton commented Jun 27, 2022

dmitripivkine commented Jun 28, 2022

pshipton commented Jun 30, 2022

JasonFengJ9 commented Jul 11, 2022

JasonFengJ9 commented Jul 25, 2022 • edited by pshipton

JasonFengJ9 commented Sep 1, 2022

JasonFengJ9 commented Sep 1, 2022

pshipton commented Sep 8, 2022

JasonFengJ9 commented Sep 12, 2022

pshipton commented Sep 14, 2022

JasonFengJ9 commented Sep 20, 2022

dmitripivkine commented Sep 20, 2022

dmitripivkine commented Nov 18, 2022

a7ehuo commented Nov 21, 2022 • edited

pshipton commented Nov 21, 2022 • edited

pshipton commented Nov 23, 2022 • edited

a7ehuo commented Nov 23, 2022

a7ehuo commented Nov 24, 2022

pshipton commented Nov 27, 2022

pshipton commented Dec 6, 2022

pshipton commented Dec 8, 2022

JasonFengJ9 commented Jan 3, 2023

pshipton commented Jan 3, 2023

a7ehuo commented Jan 19, 2023

pshipton commented Jan 19, 2023

JasonFengJ9 commented Jun 9, 2022 •

edited

pshipton commented Jun 23, 2022 •

edited

JasonFengJ9 commented Jul 25, 2022 •

edited by pshipton

a7ehuo commented Nov 21, 2022 •

edited

pshipton commented Nov 21, 2022 •

edited

pshipton commented Nov 23, 2022 •

edited