JDK19 serviceability_jvmti_j9_0_FAILED serviceability/jvmti/stress/StackTrace/Suspended/GetStackTraceSuspendedStressTest.java Fatal error: Carrier thread is NOT expected to be suspended

[JasonFengJ9]

Failure link

From an internal build(ub18-aarch64-8):

openjdk version "19.0.2" 2023-01-17
IBM Semeru Runtime Open Edition 19.0.2+7 (build 19.0.2+7)
Eclipse OpenJ9 VM 19.0.2+7 (build master-ff024fc42, JRE 19 Linux aarch64-64-Bit Compressed References 20230117_80 (JIT enabled, AOT enabled)
OpenJ9   - ff024fc42
OMR      - e6796be5b
JCL      - 889e2e0ea1 based on jdk-19.0.2+7)

Rerun in Grinder - Change TARGET to run only the failed test targets.

Optional info

Failure output (captured from console output)

[2023-04-03T02:06:10.918Z] variation: Mode150
[2023-04-03T02:06:10.918Z] JVM_OPTIONS:  -XX:+UseCompressedOops 

[2023-04-03T02:07:34.580Z] TEST: serviceability/jvmti/stress/StackTrace/Suspended/GetStackTraceSuspendedStressTest.java

[2023-04-03T02:07:34.581Z] VThread-Consumer-59: started
[2023-04-03T02:07:34.581Z] Thread: 0xffff28012db0, name: ForkJoinPool-1-worker-3, state(100005):  ALIVE RUNNABLE SUSPENDED, attrs: kernel daemon
[2023-04-03T02:07:34.581Z] JVMTI Stack Trace for thread ForkJoinPool-1-worker-3: frame count: 10
[2023-04-03T02:07:34.581Z]  0: jdk/internal/vm/Continuation: enterImpl()Z
[2023-04-03T02:07:34.581Z]  1: jdk/internal/vm/Continuation: run()V
[2023-04-03T02:07:34.581Z]  2: java/lang/VirtualThread: runContinuation()V
[2023-04-03T02:07:34.581Z]  3: java/lang/VirtualThread$$Lambda$8.0x0000000000000000: run()V
[2023-04-03T02:07:34.581Z]  4: java/util/concurrent/ForkJoinTask$AdaptedRunnableAction: exec()Z
[2023-04-03T02:07:34.581Z]  5: java/util/concurrent/ForkJoinTask: doExec()I
[2023-04-03T02:07:34.581Z]  6: java/util/concurrent/ForkJoinPool$WorkQueue: topLevelExec(Ljava/util/concurrent/ForkJoinTask;Ljava/util/concurrent/ForkJoinPool$WorkQueue;)V
[2023-04-03T02:07:34.581Z]  7: java/util/concurrent/ForkJoinPool: scan(Ljava/util/concurrent/ForkJoinPool$WorkQueue;II)I
[2023-04-03T02:07:34.581Z]  8: java/util/concurrent/ForkJoinPool: runWorker(Ljava/util/concurrent/ForkJoinPool$WorkQueue;)V
[2023-04-03T02:07:34.581Z]  9: java/util/concurrent/ForkJoinWorkerThread: run()V
[2023-04-03T02:07:34.581Z] 
[2023-04-03T02:07:34.581Z] STDERR:
[2023-04-03T02:07:34.581Z] 
[2023-04-03T02:07:34.581Z] Fatal error: Carrier thread is NOT expected to be suspended

[2023-04-03T02:07:34.582Z] TEST RESULT: Failed. Unexpected exit from test [exit code: 87]
[2023-04-03T02:07:34.582Z] --------------------------------------------------
[2023-04-03T02:09:02.937Z] Test results: passed: 120; failed: 1
[2023-04-03T02:09:03.400Z] Report written to /home/jenkins/workspace/Test_openjdk19_j9_extended.openjdk_aarch64_linux/jvmtest/openjdk/report/html/report.html
[2023-04-03T02:09:03.400Z] Results written to /home/jenkins/workspace/Test_openjdk19_j9_extended.openjdk_aarch64_linux/aqa-tests/TKG/output_16804873859410/serviceability_jvmti_j9_0/work
[2023-04-03T02:09:03.400Z] Error: Some tests failed or other problems occurred.
[2023-04-03T02:09:03.400Z] -----------------------------------
[2023-04-03T02:09:03.400Z] serviceability_jvmti_j9_0_FAILED

50x internal grinder

Also seen JDK19 ppc64_aix

FYI @babsingh @fengxue-IS

[babsingh]

Test case: https://github.com/ibmruntimes/openj9-openjdk-jdk/blob/openj9/test/hotspot/jtreg/serviceability/jvmti/stress/StackTrace/Suspended/libGetStackTraceSuspendedStress.cpp

Only the virtual thread is suspended but the carrier thread also shows up as suspended.

This is identical to #16689 which is targeted for JDK20.

@dipak-bagadiya is working on the fix: #16943.

[babsingh]

@dipak-bagadiya can you confirm if this issue is a duplicate of #16689 and it will be fixed with #16943?

[pshipton]

For the record, the grinder failed this test 2 times, also serviceability/jvmti/vthread/SuspendResume2/SuspendResume2.java once with a timeout but no diagnostics.

11:20:58  ## TestSuspendResume: started
11:20:58  
11:20:58  ## Agent: test_vthread_suspend_all started
11:20:58  ## Agent: thread[0] 0xffff940b1c08 TestedThread0: state after resume:  ALIVE RUNNABLE (5)
11:20:58  ## Agent: thread[1] 0xffff940b1c10 TestedThread1: state after resume:  ALIVE WAITING WAITING_INDEFINITELY PARKED (657)
11:20:58  ## Agent: thread[2] 0xffff940b1c18 TestedThread2: state after suspend:  ALIVE WAITING WAITING_INDEFINITELY PARKED SUSPENDED (1049233)
11:20:58  ## Agent: thread[3] 0xffff940b1c20 TestedThread3: state after suspend:  ALIVE RUNNABLE SUSPENDED (1048581)
11:20:58  ## Agent: thread[4] 0xffff940b1c28 TestedThread4: state after suspend:  ALIVE RUNNABLE SUSPENDED (1048581)
11:20:58  ## Agent: thread[5] 0xffff940b1c30 TestedThread5: state after suspend:  ALIVE RUNNABLE SUSPENDED (1048581)
11:20:58  ## Agent: thread[6] 0xffff940b1c38 TestedThread6: state after suspend:  ALIVE RUNNABLE SUSPENDED (1048581)
11:20:58  ## Agent: thread[7] 0xffff940b1c40 TestedThread7: state after suspend:  ALIVE RUNNABLE SUSPENDED (1048581)
11:20:58  ## Agent: thread[8] 0xffff940b1c48 TestedThread8: state after suspend:  ALIVE RUNNABLE SUSPENDED (1048581)
11:20:58  ## Agent: thread[9] 0xffff940b1c50 TestedThread9: state after suspend:  ALIVE RUNNABLE SUSPENDED (1048581)
11:20:58  ## Agent: thread[10] 0xffff940b1c58 TestedThread10: state after suspend:  ALIVE WAITING WAITING_INDEFINITELY PARKED SUSPENDED (1049233)
11:20:58  ## Agent: thread[11] 0xffff940b1c60 TestedThread11: state after suspend:  ALIVE RUNNABLE SUSPENDED (1048581)
11:20:58  ## Agent: thread[12] 0xffff940b1c68 TestedThread12: state after suspend:  ALIVE RUNNABLE SUSPENDED (1048581)
11:20:58  ## Agent: thread[13] 0xffff940b1c70 TestedThread13: state after suspend:  ALIVE RUNNABLE SUSPENDED (1048581)
11:20:58  ## Agent: thread[14] 0xffff940b1c78 TestedThread14: state after suspend:  ALIVE RUNNABLE SUSPENDED (1048581)
11:20:58  ## Agent: thread[15] 0xffff940b1c88 TestedThread15: state after suspend:  ALIVE RUNNABLE SUSPENDED (1048581)
11:20:58  Timeout refired 960 times

11:20:58  Timeout information:
11:20:58  Running jstack on process 28131
11:20:58  2023-04-06T11:08:30.255648859
11:20:58  Error getting data from 28131: Exception connecting to 28131
11:20:58  --- Timeout information end.

[dipak-bagadiya]

@babsingh @pshipton Yes, this issue is duplicate and will be fixed in #16943

[JasonFengJ9]

Closing as dup of #16689