Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix crash in compiled method while building DDR #13897

Open
gita-omr opened this issue Nov 10, 2021 · 9 comments
Open

Fix crash in compiled method while building DDR #13897

gita-omr opened this issue Nov 10, 2021 · 9 comments
Labels
arch:power comp:infra comp:jit segfault Issues that describe segfaults / JVM crashes

Comments

@gita-omr
Copy link
Contributor

gita-omr commented Nov 10, 2021

Looks like some unknown failure during PR test [1]:

11:48:50  Compiling 13 files for BUILD_DDR_TOOLS
11:48:54  Compiling 89 properties into resource bundles for java.desktop
11:48:54  Creating support/modules_libs/java.base/libjncrypto.so from 2 file(s)
11:48:54  Creating support/modules_libs/java.base/libverify.so from 1 file(s)
11:48:54  Creating support/modules_libs/java.base/libjava.so from 71 file(s)
11:48:54  Creating support/native/java.base/libfdlibm.a from 57 file(s)
11:48:54  Creating support/modules_libs/java.base/libzip.so from 5 file(s)
11:48:54  Creating support/modules_libs/java.base/libjimage.so from 6 file(s)
11:48:54  Creating support/modules_libs/java.base/libjli.so from 8 file(s)
11:48:54  Creating support/modules_libs/java.base/libnet.so from 21 file(s)
11:48:54  Creating support/modules_libs/java.base/libnio.so from 22 file(s)
11:49:35  Generating DDR pointer and structure class files
11:49:35  Generating DDR pointer class source files
11:49:35  Generating DDR structure stub source files
11:49:35  superset directory name : /home/jenkins/workspace/Build_JDK17_ppc64le_linux_Personal/build/linux-ppc64le-server-release/vm/
11:49:35  superset file name : superset.dat
11:49:35  superset directory name: /home/jenkins/workspace/Build_JDK17_ppc64le_linux_Personal/build/linux-ppc64le-server-release/vm/
11:49:35  superset file name: superset.dat
11:49:35  Writing generated classes to /home/jenkins/workspace/Build_JDK17_ppc64le_linux_Personal/build/linux-ppc64le-server-release/support/gensrc/openj9.dtfj/com/ibm/j9ddr/vm29/pointer/generated
11:49:35  Writing generated classes to /home/jenkins/workspace/Build_JDK17_ppc64le_linux_Personal/build/linux-ppc64le-server-release/support/gensrc/openj9.dtfj/com/ibm/j9ddr/vm29/structure
11:49:36  Unhandled exception
11:49:36  Type=Segmentation error vmState=0x00000000
11:49:36  J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
11:49:36  Handler1=0000100000BD4970 Handler2=0000100000E1C300
11:49:36  R0=0000100012582118 R1=000010000079D810 R2=0000000000000000 R3=000000010000002C
11:49:36  R4=00000000000BAE00 R5=000000009C476820 R6=0000000000000010 R7=00000000000000C0
11:49:36  R8=00000000FF9DBB68 R9=00000000FF9DBB28 R10=00001000020E9340 R11=0000000000000068
11:49:36  R12=0000000088002422 R13=00001000007A6900 R14=00000000001268E0 R15=0000000000099200
11:49:36  R16=0000100023760038 R17=0000000000002000 R18=0000000000000000 R19=00000000FF6536C0
11:49:36  R20=0000000000000000 R21=0000000000000000 R22=0000000000000000 R23=00000000002F9D00
11:49:36  R24=00000000000BFB00 R25=00000000002A9000 R26=000000009C476820 R27=000000009C476820
11:49:36  R28=000000009C466B40 R29=000000009C447F60 R30=00000000FF9DBB50 R31=00000000FF9DBB68
11:49:36  NIP=000010001258212C MSR=800000010280F033 ORIG_GPR3=00000000000081C8 CTR=00001000017ADE38
11:49:36  LINK=0000100012582118 XER=0000000000000000 CCR=0000000028002424 SOFTE=0000000000000001
11:49:36  TRAP=0000000000000300 DAR=0000000000000020 dsisr=0000000040000000 RESULT=0000000000000000
11:49:36  FPR0 000000009c466b40 (f: 2621860608.000000, d: 1.295371e-314)
11:49:36  FPR1 3ff0000000000000 (f: 0.000000, d: 1.000000e+00)
11:49:36  FPR2 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR3 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR4 3fe3333340000000 (f: 1073741824.000000, d: 6.000000e-01)
11:49:36  FPR5 3fc36baa80000000 (f: 2147483648.000000, d: 1.517232e-01)
11:49:36  FPR6 3fe5555560000000 (f: 1610612736.000000, d: 6.666667e-01)
11:49:36  FPR7 3f2b4e8780000000 (f: 2147483648.000000, d: 2.083340e-04)
11:49:36  FPR8 006f0070006d0061 (f: 7143521.000000, d: 1.379622e-306)
11:49:36  FPR9 0065006e0069006c (f: 6881388.000000, d: 9.346057e-307)
11:49:36  FPR10 007400730069004c (f: 6881356.000000, d: 1.780215e-306)
11:49:36  FPR11 37f4802f80000000 (f: 2147483648.000000, d: 3.765388e-39)
11:49:36  FPR12 4143381f80000000 (f: 2147483648.000000, d: 2.519103e+06)
11:49:36  FPR13 3fdb9b2820000000 (f: 536870912.000000, d: 4.313450e-01)
11:49:36  FPR14 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR15 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR16 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR17 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR18 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR19 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR20 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR21 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR22 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR23 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR24 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR25 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR26 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR27 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR28 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR29 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR30 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  FPR31 0000000000000000 (f: 0.000000, d: 0.000000e+00)
11:49:36  
11:49:36  Compiled_method=com/ibm/j9ddr/tools/PointerGenerator.omitFieldImplementation(Lcom/ibm/j9ddr/StructureReader$StructureDescriptor;Lcom/ibm/j9ddr/StructureReader$FieldDescriptor;)Z
11:49:36  Target=2_90_20210916_35 (Linux 3.10.0-1160.25.1.el7.ppc64le)
11:49:36  CPU=ppc64le (8 logical CPUs) (0x1de290000 RAM)
11:49:36  ----------- Stack Backtrace -----------
11:49:36  (0x0000100000E169E4 [libj9prt29.so+0x369e4])
11:49:36  (0x0000100000E1D708 [libj9prt29.so+0x3d708])
11:49:36  (0x0000100000E16AA8 [libj9prt29.so+0x36aa8])
11:49:36  (0x0000100000E16C10 [libj9prt29.so+0x36c10])
11:49:36  (0x0000100000E166E4 [libj9prt29.so+0x366e4])
11:49:36  (0x0000100000E1D708 [libj9prt29.so+0x3d708])
11:49:36  (0x0000100000E167D8 [libj9prt29.so+0x367d8])
11:49:36  (0x0000100000BD47F0 [libj9vm29.so+0x447f0])
11:49:36  (0x0000100000E1D708 [libj9prt29.so+0x3d708])
11:49:36  (0x0000100000BD4B24 [libj9vm29.so+0x44b24])
11:49:36  (0x0000100000E1C560 [libj9prt29.so+0x3c560])
11:49:36  __kernel_sigtramp_rt64+0x0 (0x0000100000050478)
11:49:36  (0x0000100000CF9840 [libj9vm29.so+0x169840])
11:49:36  (0x0000100000BAE5C0 [libj9vm29.so+0x1e5c0])
11:49:36  (0x0000100000BD9060 [libj9vm29.so+0x49060])
11:49:36  (0x0000100000D098B8 [libj9vm29.so+0x1798b8])
11:49:36  (0x0000100000E1D708 [libj9prt29.so+0x3d708])
11:49:36  (0x0000100000D0998C [libj9vm29.so+0x17998c])
11:49:36  (0x0000100000BDBA94 [libj9vm29.so+0x4ba94])
11:49:36  (0x0000100000BD8678 [libj9vm29.so+0x48678])
11:49:36  (0x00001000000CCD98 [libjli.so+0xcd98])
11:49:36  (0x00001000000D1E28 [libjli.so+0x11e28])
11:49:36  (0x0000100000108CD4 [libpthread.so.0+0x8cd4])
11:49:36  clone+0xe4 (0x0000100000297F14 [libc.so.6+0x127f14])


[1] https://openj9-jenkins.osuosl.org/job/Build_JDK17_ppc64le_linux_Personal/68/console

@pshipton
Copy link
Member

The crash is not in the port library, it's in the JIT. Also the link will quickly expire, making this Issue useless.

If it's failing in PR testing, and we haven't seen this crash before, how do we know the PR being tested isn't causing the crash?

@pshipton pshipton added the segfault Issues that describe segfaults / JVM crashes label Nov 10, 2021
@gita-omr gita-omr changed the title Fix crash in the port library Fix crash during method compilation library Nov 10, 2021
@gita-omr gita-omr changed the title Fix crash during method compilation library Fix crash during method compilation Nov 10, 2021
@gita-omr
Copy link
Contributor Author

gita-omr commented Nov 10, 2021

The change in the PR can only affect methods that use Vector API. I think the compiled method that crashed does not use Vector API.

@gita-omr gita-omr changed the title Fix crash during method compilation Fix crash in compiled method Nov 10, 2021
@gita-omr
Copy link
Contributor Author

I added some more context into the description in case the link expires before we can get to investigate this failure, which most likely is very intermittent.

@gita-omr gita-omr changed the title Fix crash in compiled method Fix crash in compiled method while building DDR Nov 11, 2021
@pshipton
Copy link
Member

Another crash on plinux #13906

@0xdaryl
Copy link
Contributor

0xdaryl commented Nov 11, 2021

@zl-wang : there have been some Power Linux crashes appearing in the builds over the past couple of days. Could you have someone triage please?

@zl-wang
Copy link
Contributor

zl-wang commented Nov 11, 2021

@IBMJimmyk please take a look

@pshipton
Copy link
Member

The crash is with the boot JVM, as follows. There have been issues fixed since this build, if necessary we can update the boot JVM being used.

1CIJAVAVERSION JRE 17 Linux ppc64le-64 (build 17+35)
1CIVMVERSION   20210916_35
1CIJ9VMTAG     openj9-0.28.0-m2

@gita-omr
Copy link
Contributor Author

Yes, DDR is built with boot JDK. To add debug options, use DDR_TOOLS_OPTIONS in DDR.gmk.

@pshipton
Copy link
Member

@AdamBrousseau can we update the JDK17 boot JVM to the 0.29.1 M1 pls.

AdamBrousseau added a commit to AdamBrousseau/openj9 that referenced this issue Nov 11, 2021
Related eclipse-openj9#13897

Signed-off-by: Adam Brousseau <adam.brousseau88@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
arch:power comp:infra comp:jit segfault Issues that describe segfaults / JVM crashes
Projects
None yet
Development

No branches or pull requests

4 participants