Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

j9mm.479 ASSERTION FAILED at gc_glue_java/ScavengerRootScanner.hpp:109: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env))) #16510

Closed
JasonFengJ9 opened this issue Jan 4, 2023 · 27 comments

Comments

@JasonFengJ9
Copy link
Member

JasonFengJ9 commented Jan 4, 2023

JDK17 internal build(macaarch64rt8)

java version "17.0.6" 2023-01-17
IBM Semeru Runtime Certified Edition 17.0.6+9 (build 17.0.6+9)
Eclipse OpenJ9 VM 17.0.6+9 (build master-a2475ea96, JRE 17 Mac OS X aarch64-64-Bit 20230117_192 (JIT enabled, AOT enabled)
OpenJ9   - a2475ea96
OMR      - 7d8ea8b6b
JCL      - 9a3078373f based on jdk-17.0.6+9)

[2023-01-01T05:14:35.139Z] variation: Mode650
[2023-01-01T05:14:35.139Z] JVM_OPTIONS:  -XX:-UseCompressedOops 

[2023-01-01T05:21:22.891Z] TEST: jdk/incubator/vector/VectorMaxConversionTests.java#id0

[2023-01-01T05:21:22.898Z] STDERR:
[2023-01-01T05:21:22.898Z] WARNING: Using incubator modules: jdk.incubator.vector
[2023-01-01T05:21:22.898Z] 00000001588DD500: Misaligned stack-allocated object in thread MainThread
[2023-01-01T05:21:22.898Z] 00000001588DD500:	O-Slot=0000000142857040
[2023-01-01T05:21:22.898Z] 00000001588DD500:	O-Slot value=0000000142856FD4
[2023-01-01T05:21:22.898Z] 00000001588DD500:	PC=0000000130AFD6E4
[2023-01-01T05:21:22.898Z] 00000001588DD500:	framesWalked=1
[2023-01-01T05:21:22.898Z] 00000001588DD500:	arg0EA=00000001428579F8
[2023-01-01T05:21:22.898Z] 00000001588DD500:	walkSP=0000000142856DF8
[2023-01-01T05:21:22.898Z] 00000001588DD500:	literals=0000000000000000
[2023-01-01T05:21:22.898Z] 00000001588DD500:	jitInfo=000000014911E628
[2023-01-01T05:21:22.898Z] 00000001588DD500:	method=0000000298149E98 (jdk/incubator/vector/Byte256Vector.rearrange(Ljdk/incubator/vector/VectorShuffle;)Ljdk/incubator/vector/ByteVector;) (JIT)
[2023-01-01T05:21:22.898Z] 00000001588DD500:	stack=0000000142853040-00000001428588A0
[2023-01-01T05:21:22.898Z] 05:20:44.858 0x14201f500    j9mm.479    *   ** ASSERTION FAILED ** at /Users/jenkins/workspace/build-scripts/jobs/jdk17u/jdk17u-mac-aarch64-openj9-IBM/workspace/build/src/openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:109: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))
[2023-01-01T05:21:22.898Z] JVMDUMP039I Processing dump event "traceassert", detail "" at 2023/01/01 00:20:44 - please wait.

[2023-01-01T05:21:22.898Z] TEST RESULT: Failed. Unexpected exit from test [exit code: 255]
[2023-01-01T05:21:22.898Z] --------------------------------------------------
[2023-01-01T05:21:24.877Z] Test results: passed: 71; failed: 1
[2023-01-01T05:21:30.273Z] Report written to /Users/jenkins/workspace/Test_openjdk17_j9_extended.openjdk_aarch64_mac/aqa-tests/TKG/output_16725482488035/jdk_vector_1/report/html/report.html
[2023-01-01T05:21:30.273Z] Results written to /Users/jenkins/workspace/Test_openjdk17_j9_extended.openjdk_aarch64_mac/aqa-tests/TKG/output_16725482488035/jdk_vector_1/work
[2023-01-01T05:21:30.273Z] Error: Some tests failed or other problems occurred.
[2023-01-01T05:21:30.273Z] -----------------------------------
[2023-01-01T05:21:30.273Z] jdk_vector_1_FAILED

300x grinder - the assertion failure was reproduced while there were infra errors

Originally posted by @JasonFengJ9 in #15251 (comment)

@dmitripivkine
Copy link
Contributor

There are a few bad slots in the same thread stack, all of them have the same value:

Checking THREAD STACKS...  <gc check (1): from debugger: THREAD STACKS: slot 1588dd500(142857040) -> 142856fd4: not aligned>
  <gc check (2): from debugger: THREAD STACKS: slot 1588dd500(1428571d0) -> 142856fd4: not aligned>
  <gc check (3): from debugger: THREAD STACKS: slot 1588dd500(1428571e0) -> 142856fd4: not aligned>
  <gc check (4): from debugger: THREAD STACKS: slot 1588dd500(1428571e8) -> 142856fd4: not aligned>
  <gc check (5): from debugger: THREAD STACKS: slot 1588dd500(142857208) -> 142856fd4: not aligned>
  <gc check (6): from debugger: THREAD STACKS: slot 1588dd500(142857588) -> 142856fd4: not aligned>
  <gc check (7): from debugger: THREAD STACKS: slot 1588dd500(1428575e0) -> 142856fd4: not aligned>
  <gc check (8): from debugger: THREAD STACKS: slot 1588dd500(1428575e8) -> 142856fd4: not aligned>
  <gc check (9): from debugger: THREAD STACKS: slot 1588dd500(1428575f0) -> 142856fd4: not aligned>
<1588dd500> JIT frame: bp = 0x00000001428579E8, pc = 0x0000000130AFD6E4, unwindSP = 0x0000000142856E20, cp = 0x000000029814A600, arg0EA = 0x00000001428579F8, jitInfo = 0x000000014911E628
<1588dd500> 	Method: jdk/incubator/vector/Byte256Vector.rearrange(Ljdk/incubator/vector/VectorShuffle;)Ljdk/incubator/vector/ByteVector; !j9method 0x0000000298149E98
<1588dd500> 	Bytecode index = 7, inlineDepth = 0, PC offset = 0x0000000000013960
<1588dd500> 	stackMap=0x000000014912DB01, slots=I16(0x0002) parmBaseOffset=I16(0x0008), parmSlots=U16(0x0002), localBaseOffset=I16(0xF640)
<1588dd500> 	Described JIT args starting at 0x00000001428579F0 for U16(0x0002) slots
<1588dd500> 		O-Slot: : a1[0x00000001428579F0] = 0x0000000122305D00
<1588dd500> 		O-Slot: : a0[0x00000001428579F8] = 0x0000000122305D18
<1588dd500> 	Described JIT temps starting at 0x0000000142857028 for IDATA(0x0000000000000138) slots
<1588dd500> Address 0x000000014912F903
<1588dd500> Num internal ptr map bytes U8(0x1F)
<1588dd500> Address 0x000000014912F904
<1588dd500> Index of first internal ptr I16(0x012A)
<1588dd500> Address 0x000000014912F906
<1588dd500> Offset of first internal ptr I16(0xFF80)
<1588dd500> Address 0x000000014912F908
<1588dd500> Num distinct pinning arrays U8(0x0E)
<1588dd500> Before object slot walk &address : 0x00000001428579D0 address : 0x0000000122305D30 bp 0x00000001428579E8 offset of first internal ptr I16(0xFF80)
<1588dd500> After object slot walk for pinning array with &address : 0x00000001428579D0 old address 0x0000000122305D30 new address 0x0000000122305D30 displacement IDATA(0x0000000000000000)
<1588dd500> For pinning array U8(0x0D) num internal pointer stack slots U8(0x01)
<1588dd500> Before object slot walk &address : 0x00000001428579B0 address : 0x0000000000000000 bp 0x00000001428579E8 offset of first internal ptr I16(0xFF80)
<1588dd500> After object slot walk for pinning array with &address : 0x00000001428579B0 old address 0x0000000000000000 new address 0x0000000000000000 displacement IDATA(0x0000000000000000)
<1588dd500> For pinning array U8(0x09) num internal pointer stack slots U8(0x01)
<1588dd500> Before object slot walk &address : 0x00000001428579C0 address : 0x0000000000000000 bp 0x00000001428579E8 offset of first internal ptr I16(0xFF80)
<1588dd500> After object slot walk for pinning array with &address : 0x00000001428579C0 old address 0x0000000000000000 new address 0x0000000000000000 displacement IDATA(0x0000000000000000)
<1588dd500> For pinning array U8(0x0B) num internal pointer stack slots U8(0x00)
<1588dd500> Before object slot walk &address : 0x00000001428579B8 address : 0x0000000000000000 bp 0x00000001428579E8 offset of first internal ptr I16(0xFF80)
<1588dd500> After object slot walk for pinning array with &address : 0x00000001428579B8 old address 0x0000000000000000 new address 0x0000000000000000 displacement IDATA(0x0000000000000000)
<1588dd500> For pinning array U8(0x0A) num internal pointer stack slots U8(0x00)
<1588dd500> Before object slot walk &address : 0x0000000142857998 address : 0x0000000122305DC8 bp 0x00000001428579E8 offset of first internal ptr I16(0xFF80)
<1588dd500> After object slot walk for pinning array with &address : 0x0000000142857998 old address 0x0000000122305DC8 new address 0x0000000122305DC8 displacement IDATA(0x0000000000000000)
<1588dd500> For pinning array U8(0x06) num internal pointer stack slots U8(0x00)
<1588dd500> Before object slot walk &address : 0x0000000142857990 address : 0x0000000122305E00 bp 0x00000001428579E8 offset of first internal ptr I16(0xFF80)
<1588dd500> After object slot walk for pinning array with &address : 0x0000000142857990 old address 0x0000000122305E00 new address 0x0000000122305E00 displacement IDATA(0x0000000000000000)
<1588dd500> For pinning array U8(0x05) num internal pointer stack slots U8(0x00)
<1588dd500> Before object slot walk &address : 0x00000001428579C8 address : 0x0000000122305DC8 bp 0x00000001428579E8 offset of first internal ptr I16(0xFF80)
<1588dd500> After object slot walk for pinning array with &address : 0x00000001428579C8 old address 0x0000000122305DC8 new address 0x0000000122305DC8 displacement IDATA(0x0000000000000000)
<1588dd500> For pinning array U8(0x0C) num internal pointer stack slots U8(0x00)
<1588dd500> Before object slot walk &address : 0x0000000142857980 address : 0x00000001093809F0 bp 0x00000001428579E8 offset of first internal ptr I16(0xFF80)
<1588dd500> After object slot walk for pinning array with &address : 0x0000000142857980 old address 0x00000001093809F0 new address 0x00000001093809F0 displacement IDATA(0x0000000000000000)
<1588dd500> For pinning array U8(0x03) num internal pointer stack slots U8(0x00)
<1588dd500> Before object slot walk &address : 0x0000000142857978 address : 0x0000000122305E00 bp 0x00000001428579E8 offset of first internal ptr I16(0xFF80)
<1588dd500> After object slot walk for pinning array with &address : 0x0000000142857978 old address 0x0000000122305E00 new address 0x0000000122305E00 displacement IDATA(0x0000000000000000)
<1588dd500> For pinning array U8(0x02) num internal pointer stack slots U8(0x00)
<1588dd500> Before object slot walk &address : 0x0000000142857968 address : 0x0000000000000000 bp 0x00000001428579E8 offset of first internal ptr I16(0xFF80)
<1588dd500> After object slot walk for pinning array with &address : 0x0000000142857968 old address 0x0000000000000000 new address 0x0000000000000000 displacement IDATA(0x0000000000000000)
<1588dd500> For pinning array U8(0x00) num internal pointer stack slots U8(0x00)
<1588dd500> Before object slot walk &address : 0x0000000142857988 address : 0x0000000000000000 bp 0x00000001428579E8 offset of first internal ptr I16(0xFF80)
<1588dd500> After object slot walk for pinning array with &address : 0x0000000142857988 old address 0x0000000000000000 new address 0x0000000000000000 displacement IDATA(0x0000000000000000)
<1588dd500> For pinning array U8(0x04) num internal pointer stack slots U8(0x00)
<1588dd500> Before object slot walk &address : 0x0000000142857970 address : 0x0000000000000000 bp 0x00000001428579E8 offset of first internal ptr I16(0xFF80)
<1588dd500> After object slot walk for pinning array with &address : 0x0000000142857970 old address 0x0000000000000000 new address 0x0000000000000000 displacement IDATA(0x0000000000000000)
<1588dd500> For pinning array U8(0x01) num internal pointer stack slots U8(0x00)
<1588dd500> Before object slot walk &address : 0x00000001428579A0 address : 0x0000000122305D30 bp 0x00000001428579E8 offset of first internal ptr I16(0xFF80)
<1588dd500> After object slot walk for pinning array with &address : 0x00000001428579A0 old address 0x0000000122305D30 new address 0x0000000122305D30 displacement IDATA(0x0000000000000000)
<1588dd500> For pinning array U8(0x07) num internal pointer stack slots U8(0x00)
<1588dd500> Before object slot walk &address : 0x00000001428579A8 address : 0x0000000122305E38 bp 0x00000001428579E8 offset of first internal ptr I16(0xFF80)
<1588dd500> After object slot walk for pinning array with &address : 0x00000001428579A8 old address 0x0000000122305E38 new address 0x0000000122305E38 displacement IDATA(0x0000000000000000)
<1588dd500> For pinning array U8(0x08) num internal pointer stack slots U8(0x00)
<1588dd500> 		O-Slot: : t311[0x0000000142857028] = 0x0000000000000000
<1588dd500> 		I-Slot: : t310[0x0000000142857030] = 0x000000010707A688
<1588dd500> 		I-Slot: : t309[0x0000000142857038] = 0x0000000142856F28
<1588dd500> 		O-Slot: : t308[0x0000000142857040] = 0x0000000142856FD4 <--- here and below in the same frame
<1588dd500> 		SA-Obj[142857048]
<1588dd500> 			F-Slot[0x0000000142857058] = 0x0000000000000000
<1588dd500> 			F-Slot[0x0000000142857060] = 0x0000000000000000
<1588dd500> 		I-Slot: : t306[0x0000000142857050] = 0x0000000000000000
<1588dd500> 		I-Slot: : t305[0x0000000142857058] = 0x0000000000000000
<1588dd500> 		I-Slot: : t304[0x0000000142857060] = 0x0000000000000000
<1588dd500> 		SA-Obj[142857068]
<1588dd500> 			F-Slot[0x0000000142857078] = 0x0000000000000000
<1588dd500> 		I-Slot: : t302[0x0000000142857070] = 0x0000000000000000
<1588dd500> 		I-Slot: : t301[0x0000000142857078] = 0x0000000000000000
<1588dd500> 		I-Slot: : t300[0x0000000142857080] = 0x000000012701FFA8
<1588dd500> 		I-Slot: : t299[0x0000000142857088] = 0x000000012701FFA8
<1588dd500> 		O-Slot: : t298[0x0000000142857090] = 0x000000012701FFA8
<1588dd500> 		I-Slot: : t297[0x0000000142857098] = 0x00000001072C4DD0
<1588dd500> 		O-Slot: : t296[0x00000001428570A0] = 0x00000001093809F0
<1588dd500> 		O-Slot: : t295[0x00000001428570A8] = 0x0000000000000000
...

@dmitripivkine
Copy link
Contributor

@0xdaryl FYI

@JasonFengJ9
Copy link
Member Author

JDK17 internal build(ub18-aarch64-3)

java version "17.0.6" 2023-01-17
IBM Semeru Runtime Certified Edition 17.0.6+10 (build 17.0.6+10)
Eclipse OpenJ9 VM 17.0.6+10 (build master-6cadc1d9f, JRE 17 Linux aarch64-64-Bit Compressed References 20230117_322 (JIT enabled, AOT enabled)
OpenJ9   - 6cadc1d9f
OMR      - 4c214a89c
JCL      - 909686cb21 based on jdk-17.0.6+10)

[2023-01-28T20:27:51.204Z] variation: Mode650
[2023-01-28T20:27:51.204Z] JVM_OPTIONS:  -XX:-UseCompressedOops 

[2023-01-28T20:56:39.708Z] STDERR:
[2023-01-28T20:56:39.708Z] WARNING: Using incubator modules: jdk.incubator.vector
[2023-01-28T20:56:39.708Z] 0000FFFFA4284800: Misaligned stack-allocated object in thread MainThread
[2023-01-28T20:56:39.708Z] 0000FFFFA4284800:	O-Slot=0000FFFEF400A910
[2023-01-28T20:56:39.708Z] 0000FFFFA4284800:	O-Slot value=0000FFFEF400A6CC
[2023-01-28T20:56:39.708Z] 0000FFFFA4284800:	PC=0000FFFF696A44EC
[2023-01-28T20:56:39.708Z] 0000FFFFA4284800:	framesWalked=1
[2023-01-28T20:56:39.708Z] 0000FFFFA4284800:	arg0EA=0000FFFEF400ACE0
[2023-01-28T20:56:39.708Z] 0000FFFFA4284800:	walkSP=0000FFFEF400A3A8
[2023-01-28T20:56:39.708Z] 0000FFFFA4284800:	literals=0000000000000000
[2023-01-28T20:56:39.709Z] 0000FFFFA4284800:	jitInfo=0000FFFF6257A8D8
[2023-01-28T20:56:39.709Z] 0000FFFFA4284800:	method=0000FFFFA4470B10 (Int64VectorTests.EQInt64VectorTestsMasked(Ljava/util/function/IntFunction;Ljava/util/function/IntFunction;Ljava/util/function/IntFunction;)V) (JIT)
[2023-01-28T20:56:39.709Z] 0000FFFFA4284800:	stack=0000FFFEF4005FC0-0000FFFEF400B7E0
[2023-01-28T20:56:39.709Z] 20:56:24.095 0xffffa4284800    j9mm.479    *   ** ASSERTION FAILED ** at /home/jenkins/workspace/build-scripts/jobs/jdk17u/jdk17u-linux-aarch64-openj9-IBM/workspace/build/src/openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:109: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))
[2023-01-28T20:56:39.709Z] JVMDUMP039I Processing dump event "traceassert", detail "" at 2023/01/28 15:56:24 - please wait.

[2023-01-28T20:56:39.709Z] TEST RESULT: Failed. Unexpected exit from test [exit code: 255]
[2023-01-28T20:56:39.709Z] --------------------------------------------------
[2023-01-28T21:34:00.722Z] Test results: passed: 71; failed: 1
[2023-01-28T21:34:15.768Z] Report written to /home/jenkins/workspace/Test_openjdk17_j9_extended.openjdk_aarch64_linux/aqa-tests/TKG/output_16749220553905/jdk_vector_1/report/html/report.html
[2023-01-28T21:34:15.768Z] Results written to /home/jenkins/workspace/Test_openjdk17_j9_extended.openjdk_aarch64_linux/aqa-tests/TKG/output_16749220553905/jdk_vector_1/work
[2023-01-28T21:34:15.768Z] Error: Some tests failed or other problems occurred.
[2023-01-28T21:34:15.768Z] -----------------------------------
[2023-01-28T21:34:15.768Z] jdk_vector_1_FAILED

@dmitripivkine
Copy link
Contributor

this problem looks similar we observed earlier:
In JIT frame:

<ffffa4284800> JIT frame: bp = 0x0000FFFEF400ACC8, pc = 0x0000FFFF696A44EC, unwindSP = 0x0000FFFEF400A3D0, cp = 0x0000FFFEF403CB80, arg0EA = 0x0000FFFEF400ACE0, jitInfo = 0x0000FFFF6257A8D8
<ffffa4284800> 	Method: Int64VectorTests.EQInt64VectorTestsMasked(Ljava/util/function/IntFunction;Ljava/util/function/IntFunction;Ljava/util/function/IntFunction;)V !j9method 0x0000FFFFA4470B10
<ffffa4284800> 	Bytecode index = 3, inlineDepth = 0, PC offset = 0x0000000000017ADC
<ffffa4284800> 	stackMap=0x0000FFFF6258434B, slots=I16(0x0003) parmBaseOffset=I16(0x0008), parmSlots=U16(0x0003), localBaseOffset=I16(0xFA40)
<ffffa4284800> 	Described JIT args starting at 0x0000FFFEF400ACD0 for U16(0x0003) slots
<ffffa4284800> 		O-Slot: : a2[0x0000FFFEF400ACD0] = 0x0000FFFF82B27798
<ffffa4284800> 		O-Slot: : a1[0x0000FFFEF400ACD8] = 0x0000FFFF82B3CEF0
<ffffa4284800> 		O-Slot: : a0[0x0000FFFEF400ACE0] = 0x0000FFFF82B3CF50
<ffffa4284800> 	Described JIT temps starting at 0x0000FFFEF400A708 for IDATA(0x00000000000000B8) slots
<ffffa4284800> Address 0x0000FFFF6258580A
<ffffa4284800> Num internal ptr map bytes U8(0x3D)
<ffffa4284800> Address 0x0000FFFF6258580B
<ffffa4284800> Index of first internal ptr I16(0x0095)
<ffffa4284800> Address 0x0000FFFF6258580D
<ffffa4284800> Offset of first internal ptr I16(0xFED0)
<ffffa4284800> Address 0x0000FFFF6258580F
<ffffa4284800> Num distinct pinning arrays U8(0x16)
<ffffa4284800> Before object slot walk &address : 0x0000FFFEF400ABD0 address : 0x0000FFFFA2760138 bp 0x0000FFFEF400ACC8 offset of first internal ptr I16(0xFED0)
<ffffa4284800> After object slot walk for pinning array with &address : 0x0000FFFEF400ABD0 old address 0x0000FFFFA2760138 new address 0x0000FFFFA2760138 displacement IDATA(0x0000000000000000)
...
<ffffa4284800> For pinning array U8(0x12) num internal pointer stack slots U8(0x00)
<ffffa4284800> 		O-Slot: : t183[0x0000FFFEF400A708] = 0x0000FFFEF400A768
<ffffa4284800> 		I-Slot: : t182[0x0000FFFEF400A710] = 0x0000FFFFA24DAB80
<ffffa4284800> 		I-Slot: : t181[0x0000FFFEF400A718] = 0x0000FFFFA24DACA0
<ffffa4284800> 		I-Slot: : t180[0x0000FFFEF400A720] = 0x0000FFFFA24DAC18
...
<ffffa4284800> 		I-Slot: : t120[0x0000FFFEF400A900] = 0x0000FFFFA275FFC8
<ffffa4284800> 		I-Slot: : t119[0x0000FFFEF400A908] = 0x0000FFFF84BC8668
<ffffa4284800> 		O-Slot: : t118[0x0000FFFEF400A910] = 0x0000FFFEF400A6CC <--- misaligned address of inlined object
<ffffa4284800> 		I-Slot: : t117[0x0000FFFEF400A918] = 0x0000FFFFA275FFE0
<ffffa4284800> 		I-Slot: : t116[0x0000FFFEF400A920] = 0x0000FFFF82870710
...

Interestedly, there is inlined object at 0xFFFEF400A6C8 (closest aligned location)

> !j9object 0xFFFEF400A6C8
!J9Object 0x0000FFFEF400A6C8 {
	struct J9Class* clazz = !j9class 0xFFFEF437E800 // jdk/incubator/vector/IntVector$$Lambda$152/0x0000000000000000
	Object flags = 0x00000000;
	J lockword = 0x0000000000000000 (offset = 0) (java/lang/Object) <hidden>
	I arg$1 = 0x00000000 (offset = 8) (jdk/incubator/vector/IntVector$$Lambda$152/0x0000000000000000)
}

@knn-k
Copy link
Contributor

knn-k commented Feb 1, 2023

I started a 20x Grinder job on AArch64 Linux (internal job/Grinder/30827), but it seems it takes nearly an hour for running jdk_vector_1. The job might be killed by timeout after 20 hours.

@knn-k
Copy link
Contributor

knn-k commented Feb 2, 2023

2 failures out of 18 iterations in the Grinder job above.
Both of them are "Misaligned stack-allocated object in thread MainThread" in jdk/incubator/vector/Int64VectorTests.java.

It is unclear at this point if the failures are related to vector implementation or not.

@knn-k
Copy link
Contributor

knn-k commented Feb 2, 2023

I ran Int64VectorTests.java on AArch64 Linux in my environment, using the binary from #16510 (comment).
I got no failures from running it 80 times.

@knn-k
Copy link
Contributor

knn-k commented Feb 2, 2023

From the jdmpview "info jitm" output:

start=0xffff696766c4  end=0xffff69677db8   Int64VectorTests::EQInt64VectorTestsMasked(Ljava/util/function/IntFunction;Ljava/util/function/IntFunction;Ljava/util/function/IntFunction;)V
start=0xffff6968ca10  end=0xffff696a622c   Int64VectorTests::EQInt64VectorTestsMasked(Ljava/util/function/IntFunction;Ljava/util/function/IntFunction;Ljava/util/function/IntFunction;)V

There are two versions of JIT generated code for this method.
The first one is smaller than 6KB, while the second one is over 100 KB. "pc = 0x0000FFFF696A44EC" is in the address range of the second one.

@knn-k
Copy link
Contributor

knn-k commented Mar 12, 2023

I ran jdk_vector_1 on AArch64 Linux in my environment 20 times, and got no test failures.
A 20x Grinder job (job/Grinder/31519/) on AArch64 macOS generated one failure.

@knn-k
Copy link
Contributor

knn-k commented Mar 13, 2023

I ran 3x20 Grinder jobs on AArch64 macOS (31570, 31571, 31573) with the following option to take the JIT trace file, but I was not able to reproduce the failure.

-Xjit:{Int64VectorTests.EQInt64VectorTestsMasked*}(traceFull,log=eqInt64.txt)

@knn-k
Copy link
Contributor

knn-k commented Mar 14, 2023

Another Grinder job (31579) fails with a different Java method, Byte256Vector.rearrange() in VectorMaxConversionTests.

[2023-03-13T11:44:35.769Z] 000000014C03CF00: Misaligned stack-allocated object in thread MainThread
[2023-03-13T11:44:35.769Z] 000000014C03CF00:	O-Slot=000000014C086220
[2023-03-13T11:44:35.769Z] 000000014C03CF00:	O-Slot value=000000014C0861B4
[2023-03-13T11:44:35.769Z] 000000014C03CF00:	PC=000000013034ACAC
[2023-03-13T11:44:35.769Z] 000000014C03CF00:	framesWalked=3
[2023-03-13T11:44:35.769Z] 000000014C03CF00:	arg0EA=000000014C086BD8
[2023-03-13T11:44:35.769Z] 000000014C03CF00:	walkSP=000000014C085E88
[2023-03-13T11:44:35.769Z] 000000014C03CF00:	literals=0000000000000000
[2023-03-13T11:44:35.769Z] 000000014C03CF00:	jitInfo=00000002A0566128
[2023-03-13T11:44:35.769Z] 000000014C03CF00:	method=00000002A036A698 (jdk/incubator/vector/Byte256Vector.rearrange(Ljdk/incubator/vector/VectorShuffle;)Ljdk/incubator/vector/ByteVector;) (JIT)
[2023-03-13T11:44:35.769Z] 000000014C03CF00:	stack=000000014C082240-000000014C087AA0

From the jdmpview "info jitm" output:

start=0x13034995c  end=0x13035ed60   jdk/incubator/vector/Byte256Vector::rearrange(Ljdk/incubator/vector/VectorShuffle;)Ljdk/incubator/vector/ByteVector;
start=0x12fdc7754  end=0x12fdc799c   jdk/incubator/vector/Byte256Vector::rearrange(Ljdk/incubator/vector/VectorShuffle;)Ljdk/incubator/vector/ByteVector;

The size of the first one is 85KB, and the second one is only 584 bytes long. "PC=000000013034ACAC" is in the range of the first one.

>  !stack 0x14c03cf00
<14c03cf00>                             known but unhandled frame type com.ibm.j9ddr.vm29.pointer.U8Pointer @ 0x00000005

 FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT

<14c03cf00>     !j9method 0x0000000140E277D0   java/lang/Class.copyFields([Ljava/lang/reflect/Field;)[Ljava/lang/reflect/Field;
<14c03cf00>     !j9method 0x0000000140E277F0   java/lang/Class.lookupCachedFields(Ljava/lang/Class$CacheKey;)[Ljava/lang/reflect/Field;
<14c03cf00>     !j9method 0x0000000140E26570   java/lang/Class.getDeclaredFields()[Ljava/lang/reflect/Field;
<14c03cf00>     !j9method 0x0000000280205400   jdk/internal/vm/vector/VectorSupport.isNonCapturingLambda(Ljava/lang/Object;)Z
<14c03cf00>     !j9method 0x0000000280205120   jdk/internal/vm/vector/VectorSupport.broadcastCoerced(Ljava/lang/Class;Ljava/lang/Class;IJLjdk/internal/vm/vector/VectorSupport$VectorSpecies;Ljdk/internal/vm/vector/VectorSupport$BroadcastOperation;)Ljava/lang/Object;
<14c03cf00>     !j9method 0x00000002A036C220   jdk/incubator/vector/Byte256Vector$Byte256Mask.maskAll(Z)Ljdk/incubator/vector/Byte256Vector$Byte256Mask;
<14c03cf00>     !j9method 0x00000002A034E288   jdk/incubator/vector/ByteVector$ByteSpecies.maskAll(Z)Ljdk/incubator/vector/VectorMask;
<14c03cf00>     !j9method 0x00000002A036C1E0   jdk/incubator/vector/Byte256Vector$Byte256Mask.anyTrue()Z
<14c03cf00>     !j9method 0x00000001411920D0   jdk/incubator/vector/AbstractShuffle.checkIndexes()Ljdk/incubator/vector/VectorShuffle;
<14c03cf00>     !j9method 0x00000002A033CB08   jdk/incubator/vector/ByteVector.rearrangeTemplate(Ljava/lang/Class;Ljdk/incubator/vector/VectorShuffle;)Ljdk/incubator/vector/ByteVector;
<14c03cf00>     !j9method 0x00000002A036A418   jdk/incubator/vector/Byte256Vector.rearrange(Ljdk/incubator/vector/VectorShuffle;)Ljdk/incubator/vector/Byte256Vector;
<14c03cf00>     !j9method 0x00000002A036A698   jdk/incubator/vector/Byte256Vector.rearrange(Ljdk/incubator/vector/VectorShuffle;)Ljdk/incubator/vector/ByteVector;
<14c03cf00>     !j9method 0x00000002A033C988   jdk/incubator/vector/ByteVector.sliceTemplate(ILjdk/incubator/vector/Vector;)Ljdk/incubator/vector/ByteVector;

@knn-k
Copy link
Contributor

knn-k commented Mar 14, 2023

Another failure in the job 31579 with Vector128ConversionTests:

[2023-03-13T11:58:21.674Z] 0000000126832D00: Misaligned stack-allocated object in thread MainThread
[2023-03-13T11:58:21.674Z] 0000000126832D00:	O-Slot=000000012A8A7C80
[2023-03-13T11:58:21.674Z] 0000000126832D00:	O-Slot value=000000012A8A7C34
[2023-03-13T11:58:21.674Z] 0000000126832D00:	PC=0000000158FBCFC0
[2023-03-13T11:58:21.674Z] 0000000126832D00:	framesWalked=1
[2023-03-13T11:58:21.674Z] 0000000126832D00:	arg0EA=000000012A8A8648
[2023-03-13T11:58:21.674Z] 0000000126832D00:	walkSP=000000012A8A7A48
[2023-03-13T11:58:21.674Z] 0000000126832D00:	literals=0000000000000000
[2023-03-13T11:58:21.674Z] 0000000126832D00:	jitInfo=00000001783F88A8
[2023-03-13T11:58:21.674Z] 0000000126832D00:	method=0000000140F32198 (jdk/incubator/vector/Byte256Vector.rearrange(Ljdk/incubator/vector/VectorShuffle;)Ljdk/incubator/vector/ByteVector;) (JIT)
[2023-03-13T11:58:21.674Z] 0000000126832D00:	stack=000000012A8A4C40-000000012A8AA4A0

The output above points to the method Byte256Vector.rearrange(), but the call stack looks different from the previous one:

> !stack 0x126832d00
<126832d00>                             known but unhandled frame type com.ibm.j9ddr.vm29.pointer.U8Pointer @ 0x00000005

 FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT  FAULT

<126832d00>     !j9method 0x0000000140F03A28   jdk/incubator/vector/ByteVector.bTest(ILjdk/incubator/vector/Vector;Ljdk/incubator/vector/ByteVector$FBinTest;)Ljdk/incubator/vector/AbstractMask;
<126832d00>     !j9method 0x0000000140F05DE8   jdk/incubator/vector/ByteVector.lambda$compareTemplate$41(ILjdk/incubator/vector/ByteVector;Ljdk/incubator/vector/ByteVector;)Ljdk/incubator/vector/VectorMask;
<126832d00>     !j9method 0x00000002A825C568   jdk/incubator/vector/ByteVector$$Lambda$168/0x0000000000000000.apply(ILjava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;
<126832d00>     !j9method 0x0000000298134D40   jdk/internal/vm/vector/VectorSupport.compare(ILjava/lang/Class;Ljava/lang/Class;Ljava/lang/Class;ILjdk/internal/vm/vector/VectorSupport$Vector;Ljdk/internal/vm/vector/VectorSupport$Vector;Ljdk/internal/vm/vector/VectorSupport$VectorCompareOp;)Ljdk/internal/vm/vector/VectorSupport$VectorMask;
<126832d00>     !j9method 0x0000000140F04288   jdk/incubator/vector/ByteVector.compareTemplate(Ljava/lang/Class;Ljdk/incubator/vector/VectorOperators$Comparison;Ljdk/incubator/vector/Vector;)Ljdk/incubator/vector/VectorMask;
<126832d00>     !j9method 0x0000000140F31DF8   jdk/incubator/vector/Byte256Vector.compare(Ljdk/incubator/vector/VectorOperators$Comparison;Ljdk/incubator/vector/Vector;)Ljdk/incubator/vector/Byte256Vector$Byte256Mask;
<126832d00>     !j9method 0x0000000140F322D8   jdk/incubator/vector/Byte256Vector.compare(Ljdk/incubator/vector/VectorOperators$Comparison;Ljdk/incubator/vector/Vector;)Ljdk/incubator/vector/VectorMask;
<126832d00>     !j9method 0x00000002A825A1D0   jdk/incubator/vector/AbstractShuffle.checkIndexes()Ljdk/incubator/vector/VectorShuffle;
<126832d00>     !j9method 0x0000000140F04608   jdk/incubator/vector/ByteVector.rearrangeTemplate(Ljava/lang/Class;Ljdk/incubator/vector/VectorShuffle;)Ljdk/incubator/vector/ByteVector;
<126832d00>     !j9method 0x0000000140F31F18   jdk/incubator/vector/Byte256Vector.rearrange(Ljdk/incubator/vector/VectorShuffle;)Ljdk/incubator/vector/Byte256Vector;
<126832d00>     !j9method 0x0000000140F32198   jdk/incubator/vector/Byte256Vector.rearrange(Ljdk/incubator/vector/VectorShuffle;)Ljdk/incubator/vector/ByteVector;
<126832d00>     !j9method 0x0000000140F04488   jdk/incubator/vector/ByteVector.sliceTemplate(ILjdk/incubator/vector/Vector;)Ljdk/incubator/vector/ByteVector;

In both cases, "O-Slot value" points to an address in the stack near the "O-Slot" value, but the distance ("O-Slot" - "O-Slot value") is different.

@knn-k
Copy link
Contributor

knn-k commented Mar 17, 2023

I don't think it guarantees anything, but I got no failures in 3x20 Grinder jobs with the -Xjit:disableEscapeAnalysis option.
(jobs 31669, 31673, 31687)

@knn-k
Copy link
Contributor

knn-k commented Mar 17, 2023

2 more x20 Grinder jobs with -Xjit:disableEscapeAnalysis: 31688, 31691
No failures.

@0xdaryl
Copy link
Contributor

0xdaryl commented Mar 21, 2023

As this is an intermittent failure only seen in an incubator feature this should not hold up 0.38. Moving out to 0.40.

@JasonFengJ9
Copy link
Member Author

JDK17 aarch64_mac 0.38 m2 build(macaarch64rt6)

openjdk version "17.0.7" 2023-04-18
IBM Semeru Runtime Open Edition 17.0.7.0-m2 (build 17.0.7+5)
Eclipse OpenJ9 VM 17.0.7.0-m2 (build v0.38.0-release-353bdb06f, JRE 17 Mac OS X aarch64-64-Bit 20230418_290 (JIT enabled, AOT enabled)
OpenJ9   - 353bdb06f
OMR      - 855813495
JCL      - 267a5a72c4a based on jdk-17.0.7+5)

[2023-03-29T23:10:30.268Z] STDERR:
[2023-03-29T23:10:30.268Z] WARNING: Using incubator modules: jdk.incubator.vector
[2023-03-29T23:10:30.268Z] 0000000137022B00: Misaligned stack-allocated object in thread MainThread
[2023-03-29T23:10:30.268Z] 0000000137022B00:	O-Slot=0000000136128818
[2023-03-29T23:10:30.268Z] 0000000137022B00:	O-Slot value=00000001361287AC
[2023-03-29T23:10:30.268Z] 0000000137022B00:	PC=00000001705F0000
[2023-03-29T23:10:30.268Z] 0000000137022B00:	framesWalked=1
[2023-03-29T23:10:30.268Z] 0000000137022B00:	arg0EA=00000001361291E8
[2023-03-29T23:10:30.268Z] 0000000137022B00:	walkSP=00000001361285C8
[2023-03-29T23:10:30.268Z] 0000000137022B00:	literals=0000000000000000
[2023-03-29T23:10:30.268Z] 0000000137022B00:	jitInfo=00000002A042C8E8
[2023-03-29T23:10:30.268Z] 0000000137022B00:	method=0000000298342D98 (jdk/incubator/vector/Byte256Vector.rearrange(Ljdk/incubator/vector/VectorShuffle;)Ljdk/incubator/vector/ByteVector;) (JIT)
[2023-03-29T23:10:30.268Z] 0000000137022B00:	stack=0000000136124840-000000013612A0B0
[2023-03-29T23:10:30.268Z] 23:09:48.714 0x137022b00    j9mm.479    *   ** ASSERTION FAILED ** at /Users/jenkins/workspace/build-scripts/jobs/jdk17u/jdk17u-mac-aarch64-openj9/workspace/build/src/openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:109: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))
[2023-03-29T23:10:30.268Z] JVMDUMP039I Processing dump event "traceassert", detail "" at 2023/03/29 19:09:48 - please wait.

@JasonFengJ9
Copy link
Member Author

JDK19 aarch64_linux(ub18-aarch64-5)

[2023-04-16T21:48:57.968Z] variation: Mode150
[2023-04-16T21:48:57.968Z] JVM_OPTIONS:  -XX:+UseCompressedOops 

[2023-04-16T23:08:20.786Z] TEST: jdk/incubator/vector/VectorReshapeTests.java

[2023-04-16T23:08:20.786Z] STDERR:
[2023-04-16T23:08:20.786Z] WARNING: Using incubator modules: jdk.incubator.vector
[2023-04-16T23:08:20.786Z] 00000000001D8A00: Misaligned stack-allocated object in thread MainThread
[2023-04-16T23:08:20.786Z] 00000000001D8A00:	O-Slot=00000000002255C0
[2023-04-16T23:08:20.786Z] 00000000001D8A00:	O-Slot value=0000000000225524
[2023-04-16T23:08:20.786Z] 00000000001D8A00:	PC=0000FFFF9B680388
[2023-04-16T23:08:20.786Z] 00000000001D8A00:	framesWalked=1
[2023-04-16T23:08:20.786Z] 00000000001D8A00:	arg0EA=0000000000226208
[2023-04-16T23:08:20.786Z] 00000000001D8A00:	walkSP=0000000000225328
[2023-04-16T23:08:20.786Z] 00000000001D8A00:	literals=0000000000000000
[2023-04-16T23:08:20.786Z] 00000000001D8A00:	jitInfo=0000FFFF22FD1B38
[2023-04-16T23:08:20.786Z] 00000000001D8A00:	method=00000000003BE440 (jdk/incubator/vector/Byte128Vector.slice(I)Ljdk/incubator/vector/AbstractVector;) (JIT)
[2023-04-16T23:08:20.786Z] 00000000001D8A00:	stack=0000000000222628-0000000000227E50
[2023-04-16T23:08:20.786Z] 23:08:05.777 0x1d8a00    j9mm.479    *   ** ASSERTION FAILED ** at /home/jenkins/workspace/build-scripts/jobs/jdk19u/jdk19u-linux-aarch64-openj9/workspace/build/src/openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:109: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))
[2023-04-16T23:08:20.786Z] JVMDUMP039I Processing dump event "traceassert", detail "" at 2023/04/16 19:08:05 - please wait.

[2023-04-16T23:08:20.787Z] TEST RESULT: Failed. Unexpected exit from test [exit code: 255]
[2023-04-16T23:08:20.787Z] --------------------------------------------------
[2023-04-16T23:08:20.787Z] Test results: passed: 71; failed: 1
[2023-04-16T23:08:32.879Z] Report written to /home/jenkins/workspace/Test_openjdk19_j9_extended.openjdk_aarch64_linux/aqa-tests/TKG/output_16816712428066/jdk_vector_0/report/html/report.html
[2023-04-16T23:08:32.879Z] Results written to /home/jenkins/workspace/Test_openjdk19_j9_extended.openjdk_aarch64_linux/aqa-tests/TKG/output_16816712428066/jdk_vector_0/work
[2023-04-16T23:08:32.879Z] Error: Some tests failed or other problems occurred.
[2023-04-16T23:08:32.879Z] -----------------------------------
[2023-04-16T23:08:32.879Z] jdk_vector_0_FAILED

@JasonFengJ9 JasonFengJ9 changed the title JDK17 j9mm.479 ASSERTION FAILED at gc_glue_java/ScavengerRootScanner.hpp:109: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env))) j9mm.479 ASSERTION FAILED at gc_glue_java/ScavengerRootScanner.hpp:109: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env))) Apr 17, 2023
@knn-k
Copy link
Contributor

knn-k commented Apr 18, 2023

Again, the wrong object reference (O-Slot value=0x225524) points to somewhere between O-Slot (0x2255C0) and walkSP (0x225328).

The call stack of the MainThread looks like this:

1XMCURTHDINFO  Current thread
3XMTHREADINFO      "MainThread" J9VMThread:0x00000000001D8A00, omrthread_t:0x0000FFFFB4293320, java/lang/Thread:0x000000
00E013D438, state:R, prio=5
3XMJAVALTHREAD            (java/lang/Thread getId:0x1B, isDaemon:false)
3XMJAVALTHRCCL            jdk/internal/loader/ClassLoaders$AppClassLoader(0x00000000E0061578)
3XMTHREADINFO1            (native thread ID:0x16D0, native priority:0x5, native policy:UNKNOWN, vmstate:R, vm thread fla
gs:0x00001020)
3XMTHREADINFO2            (native stack address range from:0x0000FFFF98410000, to:0x0000FFFF98450000, size:0x40000)
3XMCPUTIME               CPU usage total: 32.342072125 secs, current category="Application"
3XMHEAPALLOC             Heap bytes allocated since last GC cycle=0 (0x0)
3XMTHREADINFO3           Java callstack:
4XESTACKTRACE                at jdk/incubator/vector/AbstractShuffle.prepare(AbstractShuffle.java:65(Compiled Code))
4XESTACKTRACE                at jdk/incubator/vector/AbstractShuffle.<init>(AbstractShuffle.java:51(Compiled Code))
4XESTACKTRACE                at jdk/incubator/vector/Byte128Vector$Byte128Shuffle.<init>(Byte128Vector.java:819(Compiled
 Code))
4XESTACKTRACE                at jdk/incubator/vector/Byte128Vector.shuffleFromOp(Byte128Vector.java:165(Compiled Code))
4XESTACKTRACE                at jdk/incubator/vector/Byte128Vector.shuffleFromOp(Byte128Vector.java:41(Compiled Code))
4XESTACKTRACE                at jdk/incubator/vector/AbstractSpecies.shuffleFromOp(AbstractSpecies.java:349(Compiled Cod
e))
4XESTACKTRACE                at jdk/incubator/vector/Byte128Vector.lambda$iotaShuffle$1(Byte128Vector.java:148(Compiled
Code))
4XESTACKTRACE                at jdk/incubator/vector/Byte128Vector$$Lambda$472/0x0000000000000000.apply(Bytecode PC:8(Co
mpiled Code))
4XESTACKTRACE                at jdk/internal/vm/vector/VectorSupport.shuffleIota(VectorSupport.java:217(Compiled Code))
4XESTACKTRACE                at jdk/incubator/vector/Byte128Vector.iotaShuffle(Byte128Vector.java:147(Compiled Code))
4XESTACKTRACE                at jdk/incubator/vector/Byte128Vector.iotaShuffle(Byte128Vector.java:41(Compiled Code))
4XESTACKTRACE                at jdk/incubator/vector/ByteVector.sliceTemplate(ByteVector.java:2322(Compiled Code))
4XESTACKTRACE                at jdk/incubator/vector/Byte128Vector.slice(Byte128Vector.java:424(Compiled Code))
4XESTACKTRACE                at jdk/incubator/vector/Byte128Vector.slice(Byte128Vector.java:41(Compiled Code))
4XESTACKTRACE                at jdk/incubator/vector/AbstractVector.convertShapeTemplate(AbstractVector.java:377(Compile
d Code))
4XESTACKTRACE                at jdk/incubator/vector/Byte128Vector.convertShape(Byte128Vector.java:248(Compiled Code))
4XESTACKTRACE                at jdk/incubator/vector/AbstractVector.castShape(AbstractVector.java:293(Compiled Code))
4XESTACKTRACE                at VectorReshapeTests.testVectorRebracket(VectorReshapeTests.java:741(Compiled Code))

The size of the compiled method Byte128Vector::slice() is as large as 76KB.

        start=0xffff9b66f05c  end=0xffff9b6823f0   jdk/incubator/vector/Byte128Vector::slice(I)Ljdk/incubator/vector/AbstractVector;

@dmitripivkine
Copy link
Contributor

There is another manifestation: #17601

@JasonFengJ9
Copy link
Member Author

https://openj9-jenkins.osuosl.org/job/Test_openjdk17_j9_sanity.openjdk_aarch64_linux_Nightly_testList_1/13/consoleFull

20:05:26  variation: -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache Mode650
20:05:26  JVM_OPTIONS:  -Xdump:system:none -Xdump:heap:none -Xdump:system:events=gpf+abort+traceassert+corruptcache -XX:-UseCompressedOops 

20:06:45  TEST: java/math/BigInteger/BigIntegerTest.java

20:06:45  baz shifstderr:
20:06:45  0000FFFF9C6A5F00: Misaligned stack-allocated object in thread AgentVMThread
20:06:45  0000FFFF9C6A5F00:	O-Slot=0000FFFF61ACEDF0
20:06:45  0000FFFF9C6A5F00:	O-Slot value=0000FFFF000F5BC4
20:06:45  0000FFFF9C6A5F00:	PC=0000FFFF63822264
20:06:45  0000FFFF9C6A5F00:	framesWalked=1
20:06:45  0000FFFF9C6A5F00:	arg0EA=0000FFFF000F61E8
20:06:45  0000FFFF9C6A5F00:	walkSP=0000FFFF000F57C8
20:06:45  0000FFFF9C6A5F00:	literals=0000000000000000
20:06:45  0000FFFF9C6A5F00:	jitInfo=0000FFFF540AF818
20:06:45  0000FFFF9C6A5F00:	method=0000FFFF0803C540 (java/math/BigInteger.smallToString(ILjava/lang/StringBuilder;I)V) (JIT)
20:06:45  0000FFFF9C6A5F00:	stack=0000FFFF000F0FA0-0000FFFF000F6840
20:06:45  00:06:35.626 0xffff0c002400    j9mm.479    *   ** ASSERTION FAILED ** at /home/jenkins/workspace/Build_JDK17_aarch64_linux_Nightly/openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:109: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))
20:06:45  JVMDUMP039I Processing dump event "traceassert", detail "" at 2023/07/15 00:06:35 - please wait.

20:06:45  TEST RESULT: Error. Agent communication error: java.io.EOFException; check console log for any additional details
20:06:45  --------------------------------------------------
20:06:45  Test results: passed: 43; error: 1
20:07:03  Report written to /home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_aarch64_linux_Nightly_testList_1/aqa-tests/TKG/output_16893781348309/jdk_math_1/report/html/report.html
20:07:03  Results written to /home/jenkins/workspace/Test_openjdk17_j9_sanity.openjdk_aarch64_linux_Nightly_testList_1/aqa-tests/TKG/output_16893781348309/jdk_math_1/work
20:07:03  Error: Some tests failed or other problems occurred.
20:07:03  -----------------------------------
20:07:03  jdk_math_1_FAILED

@knn-k
Copy link
Contributor

knn-k commented Jul 18, 2023

The failure with java/math/BigInteger.smallToString() in BigIntegerTest is investigated in #17751.

@knn-k
Copy link
Contributor

knn-k commented Jul 21, 2023

PR #17825 has been merged.
Let's see how it goes with other tests with misaligned object in the stack.

@knn-k
Copy link
Contributor

knn-k commented Aug 3, 2023

It is almost 2 weeks since PR #17825 was merged. I think this issue can be closed now.

@JasonFengJ9
Copy link
Member Author

Not seen in recent builds.
Closing

@JasonFengJ9
Copy link
Member Author

JDK8 s390x_linux 0.41 milestone 1(rhel7s390x-svl-rt10-1)

[2023-09-06T20:06:36.004Z] variation: Mode650
[2023-09-06T20:06:36.004Z] JVM_OPTIONS:  -XX:-UseCompressedOops 

[2023-09-06T20:08:13.878Z] LT  stderr 20:08:12.044 0x3fea0084900    j9mm.479    *   ** ASSERTION FAILED ** at /home/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-linux-s390x-openj9/workspace/build/src/openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:109: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))
[2023-09-06T20:08:13.878Z] LT  stderr 20:08:12.044 0x3fec4002200    j9mm.479    *   ** ASSERTION FAILED ** at /home/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-linux-s390x-openj9/workspace/build/src/openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:109: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))
[2023-09-06T20:08:13.878Z] LT  stderr 000003FF9C830D00:	framesWalked=3
[2023-09-06T20:08:13.878Z] LT  stderr 000003FF9C830D00:	arg0EA=000003FEA0075FA8
[2023-09-06T20:08:13.878Z] LT  stderr 000003FF9C830D00:	walkSP=000003FEA0075F80
[2023-09-06T20:08:13.878Z] LT  stderr 000003FF9C830D00:	literals=000003FF9C59E0E8
[2023-09-06T20:08:13.878Z] LT  stderr 000003FF9C830D00:	jitInfo=0000000000000000
[2023-09-06T20:08:13.878Z] LT  stderr 000003FF9C830D00:	method=000003FF9C59E0E8 (net/adoptopenjdk/test/hcrAgent/agent/TransformerMakerThread.run()V) (Interpreted)
[2023-09-06T20:08:13.878Z] LT  stderr 000003FF9C830D00:	stack=000003FEA0074820-000003FEA0076000
[2023-09-06T20:08:13.878Z] LT  stderr 20:08:12.044 0x3febc002200    j9mm.479    *   ** ASSERTION FAILED ** at /home/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-linux-s390x-openj9/workspace/build/src/openj9/runtime/gc_glue_java/ScavengerRootScanner.hpp:109: ((MM_StackSlotValidator(MM_StackSlotValidator::NOT_ON_HEAP, *slotPtr, stackLocation, walkState).validate(_env)))

[2023-09-06T20:08:34.384Z] STF 13:08:34.082 - Overall result: **FAILED**
[2023-09-06T20:08:34.384Z] -----------------------------------
[2023-09-06T20:08:34.384Z] HCRLateAttachWorkload_1_FAILED

50x internal grinder

@JasonFengJ9 JasonFengJ9 reopened this Sep 8, 2023
@knn-k
Copy link
Contributor

knn-k commented Sep 8, 2023

@JasonFengJ9 I think it is better to open a separate issue for the failure on zLinux above.

@JasonFengJ9
Copy link
Member Author

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants