Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

QuartzScheduler.shutdown hangs on Windows #448

Open
adamretter opened this issue May 21, 2019 · 2 comments

Comments

Projects
None yet
2 participants
@adamretter
Copy link

commented May 21, 2019

We have a Java 8 application, that we test on Java 8 and 11. It uses Quartz 2.3.1 and is built with Maven 3.6.1.


Update

The hang happens when both running tests concurrently, and non-concurrently. See further comments below ...


We are using the maven-surefire-plugin 3.0.0-M3 to run our tests. On Windows 10, when we have configured it to run tests in parallel using:

<configuration>
    <forkCount>2C</forkCount>
    <reuseForks>true</reuseForks>
</configuration>

We find that when running our test-suite Quartz can cause our application to hang on shutdown. When this happens we can see that there are two JVM forks, each running tests, and one JVM (launcher) which is coordinating. The stack traces from the two JVMs running tests both show that Quartz has hung when calling org.quartz.simpl.SimpleThreadPool.shutdown(SimpleThreadPool.java:371).

Looking at the Quartz SimpleThreadPool code it looks like it is waiting for busyWorkers.size() == 0, however you can see from the strack-traces that there are no workers, so somehow Quartz has got tripped up.

Please advise, how can we resolve this bug?

Below are the stack traces:

Tests VM 1

2019-05-21 07:12:18
Full thread dump OpenJDK 64-Bit Server VM (11.0.2+9 mixed mode):

Threads class SMR info:
_java_thread_list=0x000001d3c5014070, length=17, elements={
0x000001d3a493f800, 0x000001d3c0b35800, 0x000001d3c0b36800, 0x000001d3c14c2800,
0x000001d3c14c3000, 0x000001d3c0b4a800, 0x000001d3c0b50000, 0x000001d3c0b51000,
0x000001d3c15e4800, 0x000001d3c15ed000, 0x000001d3c171f000, 0x000001d3c1751000,
0x000001d3c289f800, 0x000001d3c4942000, 0x000001d3c4941000, 0x000001d3c494b000,
0x000001d3c494c000
}

"main" #1 prio=5 os_prio=0 cpu=20687.50ms elapsed=705.53s tid=0x000001d3a493f800 nid=0x135c in Object.wait()  [0x000000227eefd000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(java.base@11.0.2/Native Method)
	- waiting on <no object reference available>
	at org.quartz.simpl.SimpleThreadPool.shutdown(SimpleThreadPool.java:371)
	- waiting to re-lock in wait() <0x00000000b691cdb8> (a java.lang.Object)
	at org.quartz.core.QuartzScheduler.shutdown(QuartzScheduler.java:712)
	at org.quartz.impl.StdScheduler.shutdown(StdScheduler.java:206)
	at org.exist.scheduler.impl.QuartzSchedulerImpl.shutdown(QuartzSchedulerImpl.java:181)
	at org.exist.storage.BrokerPool.shutdown(BrokerPool.java:1585)
	at org.exist.storage.BrokerPool.shutdown(BrokerPool.java:1554)
	at org.exist.storage.journal.AbstractJournalTest.deleteWithoutCommit(AbstractJournalTest.java:453)
	at org.exist.storage.journal.AbstractJournalTest.deleteWithoutCommit_isRepeatable(AbstractJournalTest.java:470)
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@11.0.2/Native Method)
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@11.0.2/NativeMethodAccessorImpl.java:62)
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@11.0.2/DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(java.base@11.0.2/Method.java:566)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)

"Reference Handler" #2 daemon prio=10 os_prio=2 cpu=0.00ms elapsed=705.33s tid=0x000001d3c0b35800 nid=0x10e4 waiting on condition  [0x000000227f6fe000]
   java.lang.Thread.State: RUNNABLE
	at java.lang.ref.Reference.waitForReferencePendingList(java.base@11.0.2/Native Method)
	at java.lang.ref.Reference.processPendingReferences(java.base@11.0.2/Reference.java:241)
	at java.lang.ref.Reference$ReferenceHandler.run(java.base@11.0.2/Reference.java:213)

"Finalizer" #3 daemon prio=8 os_prio=1 cpu=31.25ms elapsed=705.33s tid=0x000001d3c0b36800 nid=0x1170 in Object.wait()  [0x000000227f7ff000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(java.base@11.0.2/Native Method)
	- waiting on <no object reference available>
	at java.lang.ref.ReferenceQueue.remove(java.base@11.0.2/ReferenceQueue.java:155)
	- waiting to re-lock in wait() <0x00000000b1e00f40> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(java.base@11.0.2/ReferenceQueue.java:176)
	at java.lang.ref.Finalizer$FinalizerThread.run(java.base@11.0.2/Finalizer.java:170)

"Signal Dispatcher" #4 daemon prio=9 os_prio=2 cpu=0.00ms elapsed=705.18s tid=0x000001d3c14c2800 nid=0xd90 runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Attach Listener" #5 daemon prio=5 os_prio=2 cpu=0.00ms elapsed=705.18s tid=0x000001d3c14c3000 nid=0xad8 waiting on condition  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread0" #6 daemon prio=9 os_prio=2 cpu=37359.38ms elapsed=705.18s tid=0x000001d3c0b4a800 nid=0x3d4 waiting on condition  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE
   No compile task

"C1 CompilerThread0" #7 daemon prio=9 os_prio=2 cpu=4687.50ms elapsed=705.18s tid=0x000001d3c0b50000 nid=0x11f0 waiting on condition  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE
   No compile task

"Sweeper thread" #8 daemon prio=9 os_prio=2 cpu=140.63ms elapsed=705.18s tid=0x000001d3c0b51000 nid=0x35c runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Service Thread" #9 daemon prio=9 os_prio=0 cpu=0.00ms elapsed=705.12s tid=0x000001d3c15e4800 nid=0x13a8 runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Common-Cleaner" #10 daemon prio=8 os_prio=1 cpu=46.88ms elapsed=705.05s tid=0x000001d3c15ed000 nid=0x12b4 in Object.wait()  [0x000000227fffe000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(java.base@11.0.2/Native Method)
	- waiting on <no object reference available>
	at java.lang.ref.ReferenceQueue.remove(java.base@11.0.2/ReferenceQueue.java:155)
	- waiting to re-lock in wait() <0x00000000b1f01798> (a java.lang.ref.ReferenceQueue$Lock)
	at jdk.internal.ref.CleanerImpl.run(java.base@11.0.2/CleanerImpl.java:148)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)
	at jdk.internal.misc.InnocuousThread.run(java.base@11.0.2/InnocuousThread.java:134)

"surefire-forkedjvm-command-thread" #11 daemon prio=5 os_prio=0 cpu=15.63ms elapsed=704.63s tid=0x000001d3c171f000 nid=0x2e4 runnable  [0x00000022000ff000]
   java.lang.Thread.State: RUNNABLE
	at java.io.FileInputStream.readBytes(java.base@11.0.2/Native Method)
	at java.io.FileInputStream.read(java.base@11.0.2/FileInputStream.java:279)
	at java.io.BufferedInputStream.fill(java.base@11.0.2/BufferedInputStream.java:252)
	at java.io.BufferedInputStream.read(java.base@11.0.2/BufferedInputStream.java:271)
	- locked <0x00000000b1e0dff8> (a java.io.BufferedInputStream)
	at java.io.DataInputStream.readInt(java.base@11.0.2/DataInputStream.java:392)
	at org.apache.maven.surefire.booter.MasterProcessCommand.decode(MasterProcessCommand.java:115)
	at org.apache.maven.surefire.booter.CommandReader$CommandRunnable.run(CommandReader.java:390)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"surefire-forkedjvm-ping-30s" #12 daemon prio=5 os_prio=0 cpu=453.13ms elapsed=703.89s tid=0x000001d3c1751000 nid=0xc9c runnable  [0x00000022001fe000]
   java.lang.Thread.State: RUNNABLE
	at java.io.FileInputStream.readBytes(java.base@11.0.2/Native Method)
	at java.io.FileInputStream.read(java.base@11.0.2/FileInputStream.java:279)
	at java.io.BufferedInputStream.read1(java.base@11.0.2/BufferedInputStream.java:290)
	at java.io.BufferedInputStream.read(java.base@11.0.2/BufferedInputStream.java:351)
	- locked <0x00000000b9759e88> (a java.io.BufferedInputStream)
	at sun.nio.cs.StreamDecoder.readBytes(java.base@11.0.2/StreamDecoder.java:284)
	at sun.nio.cs.StreamDecoder.implRead(java.base@11.0.2/StreamDecoder.java:326)
	at sun.nio.cs.StreamDecoder.read(java.base@11.0.2/StreamDecoder.java:178)
	- locked <0x00000000b9759f90> (a java.io.InputStreamReader)
	at java.io.InputStreamReader.read(java.base@11.0.2/InputStreamReader.java:185)
	at java.io.Reader.read(java.base@11.0.2/Reader.java:189)
	at java.util.Scanner.readInput(java.base@11.0.2/Scanner.java:882)
	at java.util.Scanner.findWithinHorizon(java.base@11.0.2/Scanner.java:1796)
	at java.util.Scanner.hasNextLine(java.base@11.0.2/Scanner.java:1610)
	at org.apache.maven.surefire.booter.PpidChecker$ProcessInfoConsumer.execute(PpidChecker.java:354)
	at org.apache.maven.surefire.booter.PpidChecker.windows(PpidChecker.java:228)
	at org.apache.maven.surefire.booter.PpidChecker.isProcessAlive(PpidChecker.java:115)
	at org.apache.maven.surefire.booter.ForkedBooter$2.run(ForkedBooter.java:214)
	at java.util.concurrent.Executors$RunnableAdapter.call(java.base@11.0.2/Executors.java:515)
	at java.util.concurrent.FutureTask.runAndReset(java.base@11.0.2/FutureTask.java:305)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(java.base@11.0.2/ScheduledThreadPoolExecutor.java:305)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"ForkJoinPool.commonPool-worker-3" #22 daemon prio=5 os_prio=0 cpu=109.38ms elapsed=690.46s tid=0x000001d3c289f800 nid=0x10f4 waiting on condition  [0x0000002200aff000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b2975ee0> (a java.util.concurrent.ForkJoinPool)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.ForkJoinPool.runWorker(java.base@11.0.2/ForkJoinPool.java:1628)
	at java.util.concurrent.ForkJoinWorkerThread.run(java.base@11.0.2/ForkJoinWorkerThread.java:177)

"org.eclipse.jetty.util.RolloverFileOutputStream" #37 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=687.68s tid=0x000001d3c4942000 nid=0xf5c in Object.wait()  [0x00000022017ff000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(java.base@11.0.2/Native Method)
	- waiting on <no object reference available>
	at java.util.TimerThread.mainLoop(java.base@11.0.2/Timer.java:553)
	- waiting to re-lock in wait() <0x00000000b39436f0> (a java.util.TaskQueue)
	at java.util.TimerThread.run(java.base@11.0.2/Timer.java:506)

"JUnit-ForkJoinPool-1-worker-3" #46 daemon prio=5 os_prio=0 cpu=578.13ms elapsed=667.10s tid=0x000001d3c4941000 nid=0x157c waiting on condition  [0x00000022020ff000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b2976b20> (a java.util.concurrent.ForkJoinPool)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.ForkJoinPool.runWorker(java.base@11.0.2/ForkJoinPool.java:1628)
	at java.util.concurrent.ForkJoinWorkerThread.run(java.base@11.0.2/ForkJoinWorkerThread.java:177)

"db.exist.blob-store.persistent-writer" #698 prio=5 os_prio=0 cpu=0.00ms elapsed=562.62s tid=0x000001d3c494b000 nid=0xd08 waiting on condition  [0x000000222acff000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b6900628> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.LinkedBlockingQueue.take(java.base@11.0.2/LinkedBlockingQueue.java:433)
	at org.exist.storage.blob.BlobStoreImpl$PersistentWriter.run(BlobStoreImpl.java:1562)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"db.exist.blob-store.vacuum" #699 prio=5 os_prio=0 cpu=0.00ms elapsed=562.62s tid=0x000001d3c494c000 nid=0x2a0 waiting on condition  [0x000000222adff000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b6900848> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.PriorityBlockingQueue.take(java.base@11.0.2/PriorityBlockingQueue.java:547)
	at org.exist.storage.blob.BlobStoreImpl$BlobVacuum.run(BlobStoreImpl.java:1631)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"VM Thread" os_prio=2 cpu=156.25ms elapsed=705.46s tid=0x000001d3c0b2d800 nid=0x740 runnable  

"GC Thread#0" os_prio=2 cpu=1015.63ms elapsed=705.53s tid=0x000001d3a4994800 nid=0x107c runnable  

"GC Thread#1" os_prio=2 cpu=1000.00ms elapsed=703.81s tid=0x000001d3c1874000 nid=0x12f4 runnable  

"G1 Main Marker" os_prio=2 cpu=15.63ms elapsed=705.53s tid=0x000001d3a49b5000 nid=0x13d0 runnable  

"G1 Conc#0" os_prio=2 cpu=2375.00ms elapsed=705.53s tid=0x000001d3a49b6800 nid=0xcec runnable  

"G1 Refine#0" os_prio=2 cpu=0.00ms elapsed=705.53s tid=0x000001d3a4a06800 nid=0x1258 runnable  

"G1 Young RemSet Sampling" os_prio=2 cpu=46.88ms elapsed=705.53s tid=0x000001d3a4a07800 nid=0x1268 runnable  
"VM Periodic Task Thread" os_prio=2 cpu=125.00ms elapsed=705.06s tid=0x000001d3c15e8800 nid=0x10c8 waiting on condition  

JNI global refs: 19, weak refs: 0


Tests VM 2

2019-05-21 07:12:33
Full thread dump OpenJDK 64-Bit Server VM (11.0.2+9 mixed mode):

Threads class SMR info:
_java_thread_list=0x000001b99fbd4e70, length=17, elements={
0x000001b9ffb3f800, 0x000001b99dd30800, 0x000001b99dd23000, 0x000001b99e6c3000,
0x000001b99dd4c000, 0x000001b99dd4e000, 0x000001b99dd36800, 0x000001b99dd64800,
0x000001b99e7da800, 0x000001b99e7e6800, 0x000001b99e884800, 0x000001b99ea7c800,
0x000001b99f0c3800, 0x000001b99e90d000, 0x000001b9a0097000, 0x000001b9a008b800,
0x000001b9a0094800
}

"main" #1 prio=5 os_prio=0 cpu=19671.88ms elapsed=721.55s tid=0x000001b9ffb3f800 nid=0xd6c in Object.wait()  [0x000000697e5fd000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(java.base@11.0.2/Native Method)
	- waiting on <no object reference available>
	at org.quartz.simpl.SimpleThreadPool.shutdown(SimpleThreadPool.java:371)
	- waiting to re-lock in wait() <0x00000000b8d00028> (a java.lang.Object)
	at org.quartz.core.QuartzScheduler.shutdown(QuartzScheduler.java:712)
	at org.quartz.impl.StdScheduler.shutdown(StdScheduler.java:206)
	at org.exist.scheduler.impl.QuartzSchedulerImpl.shutdown(QuartzSchedulerImpl.java:181)
	at org.exist.storage.BrokerPool.shutdown(BrokerPool.java:1585)
	at org.exist.storage.BrokerPool.shutdown(BrokerPool.java:1554)
	at org.exist.storage.journal.AbstractJournalTest.replaceSameContentWithoutCommitThenDeleteWithoutCommit(AbstractJournalTest.java:1250)
	at org.exist.storage.journal.AbstractJournalTest.replaceSameContentWithoutCommitThenDeleteWithoutCommit_isRepeatable(AbstractJournalTest.java:1264)
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@11.0.2/Native Method)
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@11.0.2/NativeMethodAccessorImpl.java:62)
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@11.0.2/DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(java.base@11.0.2/Method.java:566)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)

"Reference Handler" #2 daemon prio=10 os_prio=2 cpu=0.00ms elapsed=721.52s tid=0x000001b99dd30800 nid=0x10ec waiting on condition  [0x000000697ecff000]
   java.lang.Thread.State: RUNNABLE
	at java.lang.ref.Reference.waitForReferencePendingList(java.base@11.0.2/Native Method)
	at java.lang.ref.Reference.processPendingReferences(java.base@11.0.2/Reference.java:241)
	at java.lang.ref.Reference$ReferenceHandler.run(java.base@11.0.2/Reference.java:213)

"Finalizer" #3 daemon prio=8 os_prio=1 cpu=0.00ms elapsed=721.52s tid=0x000001b99dd23000 nid=0x13ec in Object.wait()  [0x000000697edfe000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(java.base@11.0.2/Native Method)
	- waiting on <no object reference available>
	at java.lang.ref.ReferenceQueue.remove(java.base@11.0.2/ReferenceQueue.java:155)
	- waiting to re-lock in wait() <0x00000000b1ef26e0> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(java.base@11.0.2/ReferenceQueue.java:176)
	at java.lang.ref.Finalizer$FinalizerThread.run(java.base@11.0.2/Finalizer.java:170)

"Signal Dispatcher" #4 daemon prio=9 os_prio=2 cpu=0.00ms elapsed=721.51s tid=0x000001b99e6c3000 nid=0xd7c runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Attach Listener" #5 daemon prio=5 os_prio=2 cpu=0.00ms elapsed=721.51s tid=0x000001b99dd4c000 nid=0xf14 waiting on condition  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread0" #6 daemon prio=9 os_prio=2 cpu=37671.88ms elapsed=721.51s tid=0x000001b99dd4e000 nid=0xf0c waiting on condition  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE
   No compile task

"C1 CompilerThread0" #7 daemon prio=9 os_prio=2 cpu=4937.50ms elapsed=721.51s tid=0x000001b99dd36800 nid=0x1e4 waiting on condition  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE
   No compile task

"Sweeper thread" #8 daemon prio=9 os_prio=2 cpu=140.63ms elapsed=721.51s tid=0x000001b99dd64800 nid=0x1e0 runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Service Thread" #9 daemon prio=9 os_prio=0 cpu=0.00ms elapsed=721.46s tid=0x000001b99e7da800 nid=0x13fc runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Common-Cleaner" #10 daemon prio=8 os_prio=1 cpu=15.63ms elapsed=721.38s tid=0x000001b99e7e6800 nid=0x9a4 in Object.wait()  [0x000000697f6fe000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(java.base@11.0.2/Native Method)
	- waiting on <no object reference available>
	at java.lang.ref.ReferenceQueue.remove(java.base@11.0.2/ReferenceQueue.java:155)
	- waiting to re-lock in wait() <0x00000000b243eed8> (a java.lang.ref.ReferenceQueue$Lock)
	at jdk.internal.ref.CleanerImpl.run(java.base@11.0.2/CleanerImpl.java:148)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)
	at jdk.internal.misc.InnocuousThread.run(java.base@11.0.2/InnocuousThread.java:134)

"surefire-forkedjvm-command-thread" #11 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=721.32s tid=0x000001b99e884800 nid=0x1088 runnable  [0x000000697f7ff000]
   java.lang.Thread.State: RUNNABLE
	at java.io.FileInputStream.readBytes(java.base@11.0.2/Native Method)
	at java.io.FileInputStream.read(java.base@11.0.2/FileInputStream.java:279)
	at java.io.BufferedInputStream.fill(java.base@11.0.2/BufferedInputStream.java:252)
	at java.io.BufferedInputStream.read(java.base@11.0.2/BufferedInputStream.java:271)
	- locked <0x00000000b1edc5b8> (a java.io.BufferedInputStream)
	at java.io.DataInputStream.readInt(java.base@11.0.2/DataInputStream.java:392)
	at org.apache.maven.surefire.booter.MasterProcessCommand.decode(MasterProcessCommand.java:115)
	at org.apache.maven.surefire.booter.CommandReader$CommandRunnable.run(CommandReader.java:390)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"surefire-forkedjvm-ping-30s" #12 daemon prio=5 os_prio=0 cpu=484.38ms elapsed=721.13s tid=0x000001b99ea7c800 nid=0x136c waiting on condition  [0x000000697f8fe000]
   java.lang.Thread.State: TIMED_WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b24af260> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.2/LockSupport.java:234)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@11.0.2/AbstractQueuedSynchronizer.java:2123)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.2/ScheduledThreadPoolExecutor.java:1182)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.2/ScheduledThreadPoolExecutor.java:899)
	at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.2/ThreadPoolExecutor.java:1054)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1114)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"ForkJoinPool.commonPool-worker-3" #22 daemon prio=5 os_prio=0 cpu=62.50ms elapsed=713.65s tid=0x000001b99f0c3800 nid=0x1540 waiting on condition  [0x00000069001fe000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b2886468> (a java.util.concurrent.ForkJoinPool)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.ForkJoinPool.runWorker(java.base@11.0.2/ForkJoinPool.java:1628)
	at java.util.concurrent.ForkJoinWorkerThread.run(java.base@11.0.2/ForkJoinWorkerThread.java:177)

"JUnit-ForkJoinPool-1-worker-3" #96 daemon prio=5 os_prio=0 cpu=1140.63ms elapsed=691.76s tid=0x000001b99e90d000 nid=0x1774 waiting on condition  [0x0000006904bfe000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b3cdb2f8> (a java.util.concurrent.ForkJoinPool)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.ForkJoinPool.runWorker(java.base@11.0.2/ForkJoinPool.java:1628)
	at java.util.concurrent.ForkJoinWorkerThread.run(java.base@11.0.2/ForkJoinWorkerThread.java:177)

"org.eclipse.jetty.util.RolloverFileOutputStream" #168 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=678.79s tid=0x000001b9a0097000 nid=0x15cc in Object.wait()  [0x00000069091ff000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(java.base@11.0.2/Native Method)
	- waiting on <no object reference available>
	at java.util.TimerThread.mainLoop(java.base@11.0.2/Timer.java:553)
	- waiting to re-lock in wait() <0x00000000b40569e8> (a java.util.TaskQueue)
	at java.util.TimerThread.run(java.base@11.0.2/Timer.java:506)

"db.exist.blob-store.persistent-writer" #1478 prio=5 os_prio=0 cpu=0.00ms elapsed=564.03s tid=0x000001b9a008b800 nid=0xd10 waiting on condition  [0x000000695adfe000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b8d00820> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.LinkedBlockingQueue.take(java.base@11.0.2/LinkedBlockingQueue.java:433)
	at org.exist.storage.blob.BlobStoreImpl$PersistentWriter.run(BlobStoreImpl.java:1562)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"db.exist.blob-store.vacuum" #1479 prio=5 os_prio=0 cpu=0.00ms elapsed=564.03s tid=0x000001b9a0094800 nid=0x16f0 waiting on condition  [0x000000695aefe000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b8d00a40> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.PriorityBlockingQueue.take(java.base@11.0.2/PriorityBlockingQueue.java:547)
	at org.exist.storage.blob.BlobStoreImpl$BlobVacuum.run(BlobStoreImpl.java:1631)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"VM Thread" os_prio=2 cpu=312.50ms elapsed=721.52s tid=0x000001b99dcfb800 nid=0x10a4 runnable  

"GC Thread#0" os_prio=2 cpu=343.75ms elapsed=721.55s tid=0x000001b9ffb94800 nid=0x1314 runnable  

"GC Thread#1" os_prio=2 cpu=562.50ms elapsed=721.07s tid=0x000001b99eb21800 nid=0x1388 runnable  

"G1 Main Marker" os_prio=2 cpu=0.00ms elapsed=721.55s tid=0x000001b9ffbb5000 nid=0x11e8 runnable  

"G1 Conc#0" os_prio=2 cpu=656.25ms elapsed=721.55s tid=0x000001b9ffbb7000 nid=0x1224 runnable  

"G1 Refine#0" os_prio=2 cpu=0.00ms elapsed=721.54s tid=0x000001b9ffc07800 nid=0x10d0 runnable  

"G1 Young RemSet Sampling" os_prio=2 cpu=15.63ms elapsed=721.54s tid=0x000001b9ffc09000 nid=0x1160 runnable  
"VM Periodic Task Thread" os_prio=2 cpu=140.63ms elapsed=721.38s tid=0x000001b99e7e5800 nid=0xd98 waiting on condition  

JNI global refs: 19, weak refs: 0

Launcher (coordinator) VM

2019-05-21 07:12:56
Full thread dump OpenJDK 64-Bit Server VM (11.0.2+9 mixed mode):

Threads class SMR info:
_java_thread_list=0x000001ab7a213ef0, length=33, elements={
0x000001ab54a9e000, 0x000001ab71c5f800, 0x000001ab71c69000, 0x000001ab71ccd000,
0x000001ab71cce800, 0x000001ab71cd2800, 0x000001ab71cd4800, 0x000001ab71c79000,
0x000001ab71f3e000, 0x000001ab71f31000, 0x000001ab73016800, 0x000001ab74c7c000,
0x000001ab74eab800, 0x000001ab73360800, 0x000001ab76559800, 0x000001ab7a3c2800,
0x000001ab7a3c6000, 0x000001ab7a3c2000, 0x000001ab7a3c4000, 0x000001ab7a3c3800,
0x000001ab7a3c5000, 0x000001ab7a3c6800, 0x000001ab7a3c1000, 0x000001ab7a3c7800,
0x000001ab7a3cb000, 0x000001ab7a3c8800, 0x000001ab7a3cf000, 0x000001ab7a3cc800,
0x000001ab7a3cd000, 0x000001ab7a3ca000, 0x000001ab77d7b800, 0x000001ab77d7c000,
0x000001ab77d7d000
}

"main" #1 prio=5 os_prio=0 cpu=2593.75ms elapsed=810.08s tid=0x000001ab54a9e000 nid=0x13c8 waiting on condition  [0x00000090482fe000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b3a4c400> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.LinkedBlockingQueue.take(java.base@11.0.2/LinkedBlockingQueue.java:433)
	at java.util.concurrent.ExecutorCompletionService.take(java.base@11.0.2/ExecutorCompletionService.java:200)
	at org.apache.maven.lifecycle.internal.builder.multithreaded.MultiThreadedBuilder.multiThreadedProjectTaskSegmentBuild(MultiThreadedBuilder.java:142)
	at org.apache.maven.lifecycle.internal.builder.multithreaded.MultiThreadedBuilder.build(MultiThreadedBuilder.java:103)
	at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:305)
	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:192)
	at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:105)
	at org.apache.maven.cli.MavenCli.execute(MavenCli.java:956)
	at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
	at org.apache.maven.cli.MavenCli.main(MavenCli.java:192)
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@11.0.2/Native Method)
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@11.0.2/NativeMethodAccessorImpl.java:62)
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@11.0.2/DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(java.base@11.0.2/Method.java:566)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:282)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:225)
	at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:406)
	at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:347)

"Reference Handler" #2 daemon prio=10 os_prio=2 cpu=0.00ms elapsed=810.05s tid=0x000001ab71c5f800 nid=0x1278 waiting on condition  [0x00000090489fe000]
   java.lang.Thread.State: RUNNABLE
	at java.lang.ref.Reference.waitForReferencePendingList(java.base@11.0.2/Native Method)
	at java.lang.ref.Reference.processPendingReferences(java.base@11.0.2/Reference.java:241)
	at java.lang.ref.Reference$ReferenceHandler.run(java.base@11.0.2/Reference.java:213)

"Finalizer" #3 daemon prio=8 os_prio=1 cpu=15.63ms elapsed=810.05s tid=0x000001ab71c69000 nid=0x13c4 in Object.wait()  [0x0000009048afe000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(java.base@11.0.2/Native Method)
	- waiting on <0x00000000b1e8f4d0> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(java.base@11.0.2/ReferenceQueue.java:155)
	- waiting to re-lock in wait() <0x00000000b1e8f4d0> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(java.base@11.0.2/ReferenceQueue.java:176)
	at java.lang.ref.Finalizer$FinalizerThread.run(java.base@11.0.2/Finalizer.java:170)

"Signal Dispatcher" #4 daemon prio=9 os_prio=2 cpu=0.00ms elapsed=810.03s tid=0x000001ab71ccd000 nid=0x13dc runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Attach Listener" #5 daemon prio=5 os_prio=2 cpu=0.00ms elapsed=810.03s tid=0x000001ab71cce800 nid=0x11fc waiting on condition  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread0" #6 daemon prio=9 os_prio=2 cpu=54734.38ms elapsed=810.03s tid=0x000001ab71cd2800 nid=0x10f0 waiting on condition  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE
   No compile task

"C1 CompilerThread0" #7 daemon prio=9 os_prio=2 cpu=9625.00ms elapsed=810.03s tid=0x000001ab71cd4800 nid=0x414 waiting on condition  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE
   No compile task

"Sweeper thread" #8 daemon prio=9 os_prio=2 cpu=546.88ms elapsed=810.03s tid=0x000001ab71c79000 nid=0x12c8 runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Service Thread" #9 daemon prio=9 os_prio=0 cpu=0.00ms elapsed=810.00s tid=0x000001ab71f3e000 nid=0x11d8 runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Common-Cleaner" #10 daemon prio=8 os_prio=1 cpu=0.00ms elapsed=810.00s tid=0x000001ab71f31000 nid=0x1384 in Object.wait()  [0x00000090492ff000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(java.base@11.0.2/Native Method)
	- waiting on <0x00000000b1fb0138> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(java.base@11.0.2/ReferenceQueue.java:155)
	- waiting to re-lock in wait() <0x00000000b1fb0138> (a java.lang.ref.ReferenceQueue$Lock)
	at jdk.internal.ref.CleanerImpl.run(java.base@11.0.2/CleanerImpl.java:148)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)
	at jdk.internal.misc.InnocuousThread.run(java.base@11.0.2/InnocuousThread.java:134)

"BuilderThread 0" #13 prio=5 os_prio=0 cpu=1703.13ms elapsed=806.35s tid=0x000001ab73016800 nid=0x1360 waiting on condition  [0x00000090496fe000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b3d071d8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.LinkedBlockingQueue.take(java.base@11.0.2/LinkedBlockingQueue.java:433)
	at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.2/ThreadPoolExecutor.java:1054)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1114)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"BuilderThread 1" #14 prio=5 os_prio=0 cpu=35890.63ms elapsed=804.45s tid=0x000001ab74c7c000 nid=0xea8 waiting on condition  [0x00000090497fe000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000c72bb400> (a java.util.concurrent.FutureTask)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.FutureTask.awaitDone(java.base@11.0.2/FutureTask.java:447)
	at java.util.concurrent.FutureTask.get(java.base@11.0.2/FutureTask.java:190)
	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:477)
	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.runSuitesForkOnceMultiple(ForkStarter.java:383)
	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:298)
	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:247)
	at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1161)
	at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1002)
	at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:848)
	at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:137)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:210)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:156)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:148)
	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117)
	at org.apache.maven.lifecycle.internal.builder.multithreaded.MultiThreadedBuilder$1.call(MultiThreadedBuilder.java:202)
	at org.apache.maven.lifecycle.internal.builder.multithreaded.MultiThreadedBuilder$1.call(MultiThreadedBuilder.java:198)
	at java.util.concurrent.FutureTask.run(java.base@11.0.2/FutureTask.java:264)
	at java.util.concurrent.Executors$RunnableAdapter.call(java.base@11.0.2/Executors.java:515)
	at java.util.concurrent.FutureTask.run(java.base@11.0.2/FutureTask.java:264)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"BuilderThread 2" #15 prio=5 os_prio=0 cpu=546.88ms elapsed=804.45s tid=0x000001ab74eab800 nid=0x938 waiting on condition  [0x00000090498ff000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b3d071d8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.LinkedBlockingQueue.take(java.base@11.0.2/LinkedBlockingQueue.java:433)
	at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.2/ThreadPoolExecutor.java:1054)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1114)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"BuilderThread 3" #16 prio=5 os_prio=0 cpu=546.88ms elapsed=804.45s tid=0x000001ab73360800 nid=0xa54 waiting on condition  [0x00000090499ff000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b3d071d8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.LinkedBlockingQueue.take(java.base@11.0.2/LinkedBlockingQueue.java:433)
	at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.2/ThreadPoolExecutor.java:1054)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1114)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"resolver-1" #18 daemon prio=5 os_prio=0 cpu=15.63ms elapsed=748.54s tid=0x000001ab76559800 nid=0x138c waiting on condition  [0x0000009049cfe000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b4245cc0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.LinkedBlockingQueue.take(java.base@11.0.2/LinkedBlockingQueue.java:433)
	at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.2/ThreadPoolExecutor.java:1054)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1114)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"resolver-2" #19 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=748.54s tid=0x000001ab7a3c2800 nid=0x10b8 waiting on condition  [0x0000009049dfe000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b4245cc0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.LinkedBlockingQueue.take(java.base@11.0.2/LinkedBlockingQueue.java:433)
	at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.2/ThreadPoolExecutor.java:1054)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1114)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"resolver-3" #20 daemon prio=5 os_prio=0 cpu=46.88ms elapsed=745.66s tid=0x000001ab7a3c6000 nid=0x1084 waiting on condition  [0x0000009049efe000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b4245cc0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.LinkedBlockingQueue.take(java.base@11.0.2/LinkedBlockingQueue.java:433)
	at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.2/ThreadPoolExecutor.java:1054)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1114)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"resolver-4" #21 daemon prio=5 os_prio=0 cpu=15.63ms elapsed=745.66s tid=0x000001ab7a3c2000 nid=0x10d4 waiting on condition  [0x0000009049ffe000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b4245cc0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.LinkedBlockingQueue.take(java.base@11.0.2/LinkedBlockingQueue.java:433)
	at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.2/ThreadPoolExecutor.java:1054)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1114)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"resolver-5" #22 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=745.66s tid=0x000001ab7a3c4000 nid=0xd64 waiting on condition  [0x000000904a0fe000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b4245cc0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.LinkedBlockingQueue.take(java.base@11.0.2/LinkedBlockingQueue.java:433)
	at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.2/ThreadPoolExecutor.java:1054)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1114)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"timeout-check-timer" #23 daemon prio=5 os_prio=0 cpu=62.50ms elapsed=744.78s tid=0x000001ab7a3c3800 nid=0x1200 waiting on condition  [0x000000904a1ff000]
   java.lang.Thread.State: TIMED_WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000c72bb9a0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.2/LockSupport.java:234)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@11.0.2/AbstractQueuedSynchronizer.java:2123)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.2/ScheduledThreadPoolExecutor.java:1182)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.2/ScheduledThreadPoolExecutor.java:899)
	at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.2/ThreadPoolExecutor.java:1054)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1114)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"ping-timer-10s" #24 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=744.37s tid=0x000001ab7a3c5000 nid=0x250 waiting on condition  [0x000000904a2fe000]
   java.lang.Thread.State: TIMED_WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000c72bbbe0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.2/LockSupport.java:234)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@11.0.2/AbstractQueuedSynchronizer.java:2123)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.2/ScheduledThreadPoolExecutor.java:1182)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.2/ScheduledThreadPoolExecutor.java:899)
	at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.2/ThreadPoolExecutor.java:1054)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1114)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"surefire-fork-starter" #26 daemon prio=5 os_prio=0 cpu=15.63ms elapsed=744.36s tid=0x000001ab7a3c6800 nid=0x1080 runnable  [0x000000904a3fe000]
   java.lang.Thread.State: RUNNABLE
	at java.lang.ProcessImpl.waitForInterruptibly(java.base@11.0.2/Native Method)
	at java.lang.ProcessImpl.waitFor(java.base@11.0.2/ProcessImpl.java:484)
	at org.apache.maven.surefire.shade.common.org.apache.maven.shared.utils.cli.CommandLineUtils$1.call(CommandLineUtils.java:279)
	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:615)
	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.access$600(ForkStarter.java:116)
	at org.apache.maven.plugin.surefire.booterclient.ForkStarter$1.call(ForkStarter.java:372)
	at org.apache.maven.plugin.surefire.booterclient.ForkStarter$1.call(ForkStarter.java:348)
	at java.util.concurrent.FutureTask.run(java.base@11.0.2/FutureTask.java:264)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"surefire-fork-starter" #27 daemon prio=5 os_prio=0 cpu=15.63ms elapsed=744.36s tid=0x000001ab7a3c1000 nid=0x1354 waiting on condition  [0x000000904a4ff000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000c7a7f870> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.ArrayBlockingQueue.take(java.base@11.0.2/ArrayBlockingQueue.java:417)
	at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.2/ThreadPoolExecutor.java:1054)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1114)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"surefire-fork-starter" #28 daemon prio=5 os_prio=0 cpu=15.63ms elapsed=744.36s tid=0x000001ab7a3c7800 nid=0xd2c waiting on condition  [0x000000904a5fe000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000c7a7f870> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.ArrayBlockingQueue.take(java.base@11.0.2/ArrayBlockingQueue.java:417)
	at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.2/ThreadPoolExecutor.java:1054)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1114)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"surefire-fork-starter" #29 daemon prio=5 os_prio=0 cpu=15.63ms elapsed=744.36s tid=0x000001ab7a3cb000 nid=0x1064 runnable  [0x000000904a6fe000]
   java.lang.Thread.State: RUNNABLE
	at java.lang.ProcessImpl.waitForInterruptibly(java.base@11.0.2/Native Method)
	at java.lang.ProcessImpl.waitFor(java.base@11.0.2/ProcessImpl.java:484)
	at org.apache.maven.surefire.shade.common.org.apache.maven.shared.utils.cli.CommandLineUtils$1.call(CommandLineUtils.java:279)
	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:615)
	at org.apache.maven.plugin.surefire.booterclient.ForkStarter.access$600(ForkStarter.java:116)
	at org.apache.maven.plugin.surefire.booterclient.ForkStarter$1.call(ForkStarter.java:372)
	at org.apache.maven.plugin.surefire.booterclient.ForkStarter$1.call(ForkStarter.java:348)
	at java.util.concurrent.FutureTask.run(java.base@11.0.2/FutureTask.java:264)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1128)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"ThreadedStreamConsumer" #32 daemon prio=5 os_prio=0 cpu=109.38ms elapsed=744.30s tid=0x000001ab7a3c8800 nid=0x2dc waiting on condition  [0x000000904a8fe000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000c72c5fe8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.ArrayBlockingQueue.take(java.base@11.0.2/ArrayBlockingQueue.java:417)
	at org.apache.maven.plugin.surefire.booterclient.output.ThreadedStreamConsumer$Pumper.run(ThreadedStreamConsumer.java:83)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"ThreadedStreamConsumer" #34 daemon prio=5 os_prio=0 cpu=265.63ms elapsed=744.29s tid=0x000001ab7a3cf000 nid=0x1020 waiting on condition  [0x000000904a9fe000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000c7c4e850> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.ArrayBlockingQueue.take(java.base@11.0.2/ArrayBlockingQueue.java:417)
	at org.apache.maven.plugin.surefire.booterclient.output.ThreadedStreamConsumer$Pumper.run(ThreadedStreamConsumer.java:83)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"Thread-5" #40 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=744.28s tid=0x000001ab7a3cc800 nid=0xee0 waiting on condition  [0x000000904adff000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000c7c447b0> (a java.util.concurrent.Semaphore$NonfairSync)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(java.base@11.0.2/AbstractQueuedSynchronizer.java:885)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(java.base@11.0.2/AbstractQueuedSynchronizer.java:1039)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(java.base@11.0.2/AbstractQueuedSynchronizer.java:1345)
	at java.util.concurrent.Semaphore.acquire(java.base@11.0.2/Semaphore.java:318)
	at org.apache.maven.plugin.surefire.booterclient.lazytestprovider.TestProvidingInputStream.awaitNextTest(TestProvidingInputStream.java:181)
	at org.apache.maven.plugin.surefire.booterclient.lazytestprovider.TestProvidingInputStream.beforeNextCommand(TestProvidingInputStream.java:144)
	at org.apache.maven.plugin.surefire.booterclient.lazytestprovider.AbstractCommandStream.read(AbstractCommandStream.java:100)
	at org.apache.maven.surefire.shade.common.org.apache.maven.shared.utils.cli.StreamFeeder.feed(StreamFeeder.java:123)
	at org.apache.maven.surefire.shade.common.org.apache.maven.shared.utils.cli.StreamFeeder.run(StreamFeeder.java:60)

"Thread-6" #41 daemon prio=5 os_prio=0 cpu=62.50ms elapsed=744.28s tid=0x000001ab7a3cd000 nid=0x1130 runnable  [0x000000904aefe000]
   java.lang.Thread.State: RUNNABLE
	at java.io.FileInputStream.readBytes(java.base@11.0.2/Native Method)
	at java.io.FileInputStream.read(java.base@11.0.2/FileInputStream.java:279)
	at java.io.BufferedInputStream.read1(java.base@11.0.2/BufferedInputStream.java:290)
	at java.io.BufferedInputStream.read(java.base@11.0.2/BufferedInputStream.java:351)
	- locked <0x00000000c72e06b0> (a java.io.BufferedInputStream)
	at sun.nio.cs.StreamDecoder.readBytes(java.base@11.0.2/StreamDecoder.java:284)
	at sun.nio.cs.StreamDecoder.implRead(java.base@11.0.2/StreamDecoder.java:326)
	at sun.nio.cs.StreamDecoder.read(java.base@11.0.2/StreamDecoder.java:178)
	- locked <0x00000000c7c4f2c8> (a java.io.InputStreamReader)
	at java.io.InputStreamReader.read(java.base@11.0.2/InputStreamReader.java:185)
	at java.io.BufferedReader.fill(java.base@11.0.2/BufferedReader.java:161)
	at java.io.BufferedReader.readLine(java.base@11.0.2/BufferedReader.java:326)
	- locked <0x00000000c7c4f2c8> (a java.io.InputStreamReader)
	at java.io.BufferedReader.readLine(java.base@11.0.2/BufferedReader.java:392)
	at org.apache.maven.surefire.shade.common.org.apache.maven.shared.utils.cli.StreamPumper.run(StreamPumper.java:89)

"Thread-7" #42 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=744.28s tid=0x000001ab7a3ca000 nid=0x1040 runnable  [0x000000904affe000]
   java.lang.Thread.State: RUNNABLE
	at java.io.FileInputStream.readBytes(java.base@11.0.2/Native Method)
	at java.io.FileInputStream.read(java.base@11.0.2/FileInputStream.java:279)
	at sun.nio.cs.StreamDecoder.readBytes(java.base@11.0.2/StreamDecoder.java:284)
	at sun.nio.cs.StreamDecoder.implRead(java.base@11.0.2/StreamDecoder.java:326)
	at sun.nio.cs.StreamDecoder.read(java.base@11.0.2/StreamDecoder.java:178)
	- locked <0x00000000c7c51e38> (a java.io.InputStreamReader)
	at java.io.InputStreamReader.read(java.base@11.0.2/InputStreamReader.java:185)
	at java.io.BufferedReader.fill(java.base@11.0.2/BufferedReader.java:161)
	at java.io.BufferedReader.readLine(java.base@11.0.2/BufferedReader.java:326)
	- locked <0x00000000c7c51e38> (a java.io.InputStreamReader)
	at java.io.BufferedReader.readLine(java.base@11.0.2/BufferedReader.java:392)
	at org.apache.maven.surefire.shade.common.org.apache.maven.shared.utils.cli.StreamPumper.run(StreamPumper.java:89)

"Thread-11" #50 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=744.26s tid=0x000001ab77d7b800 nid=0x1104 waiting on condition  [0x000000904b4fe000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000c72caa48> (a java.util.concurrent.Semaphore$NonfairSync)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(java.base@11.0.2/AbstractQueuedSynchronizer.java:885)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(java.base@11.0.2/AbstractQueuedSynchronizer.java:1039)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(java.base@11.0.2/AbstractQueuedSynchronizer.java:1345)
	at java.util.concurrent.Semaphore.acquire(java.base@11.0.2/Semaphore.java:318)
	at org.apache.maven.plugin.surefire.booterclient.lazytestprovider.TestProvidingInputStream.awaitNextTest(TestProvidingInputStream.java:181)
	at org.apache.maven.plugin.surefire.booterclient.lazytestprovider.TestProvidingInputStream.beforeNextCommand(TestProvidingInputStream.java:144)
	at org.apache.maven.plugin.surefire.booterclient.lazytestprovider.AbstractCommandStream.read(AbstractCommandStream.java:100)
	at org.apache.maven.surefire.shade.common.org.apache.maven.shared.utils.cli.StreamFeeder.feed(StreamFeeder.java:123)
	at org.apache.maven.surefire.shade.common.org.apache.maven.shared.utils.cli.StreamFeeder.run(StreamFeeder.java:60)

"Thread-12" #51 daemon prio=5 os_prio=0 cpu=15.63ms elapsed=744.26s tid=0x000001ab77d7c000 nid=0xb44 runnable  [0x000000904b5fe000]
   java.lang.Thread.State: RUNNABLE
	at java.io.FileInputStream.readBytes(java.base@11.0.2/Native Method)
	at java.io.FileInputStream.read(java.base@11.0.2/FileInputStream.java:279)
	at java.io.BufferedInputStream.read1(java.base@11.0.2/BufferedInputStream.java:290)
	at java.io.BufferedInputStream.read(java.base@11.0.2/BufferedInputStream.java:351)
	- locked <0x00000000c72d6920> (a java.io.BufferedInputStream)
	at sun.nio.cs.StreamDecoder.readBytes(java.base@11.0.2/StreamDecoder.java:284)
	at sun.nio.cs.StreamDecoder.implRead(java.base@11.0.2/StreamDecoder.java:326)
	at sun.nio.cs.StreamDecoder.read(java.base@11.0.2/StreamDecoder.java:178)
	- locked <0x00000000c72d6908> (a java.io.InputStreamReader)
	at java.io.InputStreamReader.read(java.base@11.0.2/InputStreamReader.java:185)
	at java.io.BufferedReader.fill(java.base@11.0.2/BufferedReader.java:161)
	at java.io.BufferedReader.readLine(java.base@11.0.2/BufferedReader.java:326)
	- locked <0x00000000c72d6908> (a java.io.InputStreamReader)
	at java.io.BufferedReader.readLine(java.base@11.0.2/BufferedReader.java:392)
	at org.apache.maven.surefire.shade.common.org.apache.maven.shared.utils.cli.StreamPumper.run(StreamPumper.java:89)

"Thread-13" #52 daemon prio=5 os_prio=0 cpu=15.63ms elapsed=744.26s tid=0x000001ab77d7d000 nid=0x1228 runnable  [0x000000904b6fe000]
   java.lang.Thread.State: RUNNABLE
	at java.io.FileInputStream.readBytes(java.base@11.0.2/Native Method)
	at java.io.FileInputStream.read(java.base@11.0.2/FileInputStream.java:279)
	at sun.nio.cs.StreamDecoder.readBytes(java.base@11.0.2/StreamDecoder.java:284)
	at sun.nio.cs.StreamDecoder.implRead(java.base@11.0.2/StreamDecoder.java:326)
	at sun.nio.cs.StreamDecoder.read(java.base@11.0.2/StreamDecoder.java:178)
	- locked <0x00000000c72db518> (a java.io.InputStreamReader)
	at java.io.InputStreamReader.read(java.base@11.0.2/InputStreamReader.java:185)
	at java.io.BufferedReader.fill(java.base@11.0.2/BufferedReader.java:161)
	at java.io.BufferedReader.readLine(java.base@11.0.2/BufferedReader.java:326)
	- locked <0x00000000c72db518> (a java.io.InputStreamReader)
	at java.io.BufferedReader.readLine(java.base@11.0.2/BufferedReader.java:392)
	at org.apache.maven.surefire.shade.common.org.apache.maven.shared.utils.cli.StreamPumper.run(StreamPumper.java:89)

"VM Thread" os_prio=2 cpu=156.25ms elapsed=810.05s tid=0x000001ab71c39000 nid=0x1074 runnable  

"GC Thread#0" os_prio=2 cpu=2781.25ms elapsed=810.08s tid=0x000001ab54ab6000 nid=0x3e8 runnable  

"GC Thread#1" os_prio=2 cpu=3062.50ms elapsed=809.74s tid=0x000001ab7242e000 nid=0x1298 runnable  

"G1 Main Marker" os_prio=2 cpu=15.63ms elapsed=810.08s tid=0x000001ab54ad7800 nid=0x200 runnable  

"G1 Conc#0" os_prio=2 cpu=10312.50ms elapsed=810.08s tid=0x000001ab54ad8800 nid=0xf4c runnable  

"G1 Refine#0" os_prio=2 cpu=343.75ms elapsed=810.07s tid=0x000001ab54b33000 nid=0x13b4 runnable  

"G1 Refine#1" os_prio=2 cpu=0.00ms elapsed=809.74s tid=0x000001ab7208e000 nid=0x3c8 runnable  

"G1 Young RemSet Sampling" os_prio=2 cpu=15.63ms elapsed=810.07s tid=0x000001ab54b34000 nid=0x13e8 runnable  
"VM Periodic Task Thread" os_prio=2 cpu=125.00ms elapsed=810.00s tid=0x000001ab71f2c800 nid=0x530 waiting on condition  

JNI global refs: 19, weak refs: 0

adamretter added a commit to adamretter/exist that referenced this issue May 21, 2019

@dizzzz

This comment has been minimized.

Copy link

commented May 21, 2019

Nice catch @adamretter

@adamretter

This comment has been minimized.

Copy link
Author

commented May 21, 2019

I am afraid to report that after reducing our tests to running linearly in a single JVM fork which is not reused from test to test, we are still experiencing the same shutdown issue occasionally:

Below is the stacktrace from running in a single JVM with no other concurrent tests.

2019-05-21 13:22:58
Full thread dump OpenJDK 64-Bit Server VM (11.0.2+9 mixed mode):

Threads class SMR info:
_java_thread_list=0x000001ad4a44ff40, length=15, elements={
0x000001ad2a33b000, 0x000001ad4752b800, 0x000001ad47537800, 0x000001ad47597800,
0x000001ad4759a000, 0x000001ad4759c000, 0x000001ad47553800, 0x000001ad47554800,
0x000001ad477e6800, 0x000001ad477ed800, 0x000001ad4792c000, 0x000001ad47951000,
0x000001ad4a583800, 0x000001ad4815c000, 0x000001ad48157800
}

"main" #1 prio=5 os_prio=0 cpu=9718.75ms elapsed=2279.87s tid=0x000001ad2a33b000 nid=0xd60 in Object.wait()  [0x000000ab292fd000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(java.base@11.0.2/Native Method)
	- waiting on <no object reference available>
	at org.quartz.simpl.SimpleThreadPool.shutdown(SimpleThreadPool.java:371)
	- waiting to re-lock in wait() <0x00000000b5f00400> (a java.lang.Object)
	at org.quartz.core.QuartzScheduler.shutdown(QuartzScheduler.java:712)
	at org.quartz.impl.StdScheduler.shutdown(StdScheduler.java:206)
	at org.exist.scheduler.impl.QuartzSchedulerImpl.shutdown(QuartzSchedulerImpl.java:181)
	at org.exist.storage.BrokerPool.shutdown(BrokerPool.java:1585)
	at org.exist.storage.BrokerPool.shutdown(BrokerPool.java:1554)
	at org.exist.test.ExistEmbeddedServer.stopDb(ExistEmbeddedServer.java:166)
	at org.exist.test.ExistEmbeddedServer.restart(ExistEmbeddedServer.java:146)
	at org.exist.test.ExistEmbeddedServer.restart(ExistEmbeddedServer.java:141)
	at org.exist.storage.AbstractRecoverTest.replaceWithoutCommitThenDeleteWithoutCommitAndLoad(AbstractRecoverTest.java:575)
	at org.exist.storage.AbstractRecoverTest.replaceWithoutCommitThenDeleteWithoutCommitAndLoad_isRepeatable(AbstractRecoverTest.java:597)
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@11.0.2/Native Method)
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@11.0.2/NativeMethodAccessorImpl.java:62)
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@11.0.2/DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(java.base@11.0.2/Method.java:566)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)

"Reference Handler" #2 daemon prio=10 os_prio=2 cpu=0.00ms elapsed=2279.84s tid=0x000001ad4752b800 nid=0x111c waiting on condition  [0x000000ab299fe000]
   java.lang.Thread.State: RUNNABLE
	at java.lang.ref.Reference.waitForReferencePendingList(java.base@11.0.2/Native Method)
	at java.lang.ref.Reference.processPendingReferences(java.base@11.0.2/Reference.java:241)
	at java.lang.ref.Reference$ReferenceHandler.run(java.base@11.0.2/Reference.java:213)

"Finalizer" #3 daemon prio=8 os_prio=1 cpu=31.25ms elapsed=2279.84s tid=0x000001ad47537800 nid=0xb0c in Object.wait()  [0x000000ab29afe000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(java.base@11.0.2/Native Method)
	- waiting on <no object reference available>
	at java.lang.ref.ReferenceQueue.remove(java.base@11.0.2/ReferenceQueue.java:155)
	- waiting to re-lock in wait() <0x00000000b1ecff48> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(java.base@11.0.2/ReferenceQueue.java:176)
	at java.lang.ref.Finalizer$FinalizerThread.run(java.base@11.0.2/Finalizer.java:170)

"Signal Dispatcher" #4 daemon prio=9 os_prio=2 cpu=0.00ms elapsed=2279.82s tid=0x000001ad47597800 nid=0xcc4 runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Attach Listener" #5 daemon prio=5 os_prio=2 cpu=0.00ms elapsed=2279.82s tid=0x000001ad4759a000 nid=0x123c waiting on condition  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread0" #6 daemon prio=9 os_prio=2 cpu=15406.25ms elapsed=2279.82s tid=0x000001ad4759c000 nid=0xb1c waiting on condition  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE
   No compile task

"C1 CompilerThread0" #7 daemon prio=9 os_prio=2 cpu=3343.75ms elapsed=2279.82s tid=0x000001ad47553800 nid=0x260 waiting on condition  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE
   No compile task

"Sweeper thread" #8 daemon prio=9 os_prio=2 cpu=93.75ms elapsed=2279.82s tid=0x000001ad47554800 nid=0xd18 runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Service Thread" #9 daemon prio=9 os_prio=0 cpu=0.00ms elapsed=2279.79s tid=0x000001ad477e6800 nid=0xf50 runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Common-Cleaner" #10 daemon prio=8 os_prio=1 cpu=31.25ms elapsed=2279.78s tid=0x000001ad477ed800 nid=0xf34 in Object.wait()  [0x000000ab2a2ff000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(java.base@11.0.2/Native Method)
	- waiting on <no object reference available>
	at java.lang.ref.ReferenceQueue.remove(java.base@11.0.2/ReferenceQueue.java:155)
	- waiting to re-lock in wait() <0x00000000b24796b0> (a java.lang.ref.ReferenceQueue$Lock)
	at jdk.internal.ref.CleanerImpl.run(java.base@11.0.2/CleanerImpl.java:148)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)
	at jdk.internal.misc.InnocuousThread.run(java.base@11.0.2/InnocuousThread.java:134)

"surefire-forkedjvm-command-thread" #11 daemon prio=5 os_prio=0 cpu=31.25ms elapsed=2279.71s tid=0x000001ad4792c000 nid=0x660 runnable  [0x000000ab2a3fe000]
   java.lang.Thread.State: RUNNABLE
	at java.io.FileInputStream.readBytes(java.base@11.0.2/Native Method)
	at java.io.FileInputStream.read(java.base@11.0.2/FileInputStream.java:279)
	at java.io.BufferedInputStream.fill(java.base@11.0.2/BufferedInputStream.java:252)
	at java.io.BufferedInputStream.read(java.base@11.0.2/BufferedInputStream.java:271)
	- locked <0x00000000b1eb9ce0> (a java.io.BufferedInputStream)
	at java.io.DataInputStream.readInt(java.base@11.0.2/DataInputStream.java:392)
	at org.apache.maven.surefire.booter.MasterProcessCommand.decode(MasterProcessCommand.java:115)
	at org.apache.maven.surefire.booter.CommandReader$CommandRunnable.run(CommandReader.java:390)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"surefire-forkedjvm-ping-30s" #12 daemon prio=5 os_prio=0 cpu=2593.75ms elapsed=2279.57s tid=0x000001ad47951000 nid=0x184 waiting on condition  [0x000000ab2a4fe000]
   java.lang.Thread.State: TIMED_WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b2478860> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.parkNanos(java.base@11.0.2/LockSupport.java:234)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@11.0.2/AbstractQueuedSynchronizer.java:2123)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.2/ScheduledThreadPoolExecutor.java:1182)
	at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@11.0.2/ScheduledThreadPoolExecutor.java:899)
	at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@11.0.2/ThreadPoolExecutor.java:1054)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@11.0.2/ThreadPoolExecutor.java:1114)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@11.0.2/ThreadPoolExecutor.java:628)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"ForkJoinPool.commonPool-worker-3" #22 daemon prio=5 os_prio=0 cpu=15.63ms elapsed=2276.83s tid=0x000001ad4a583800 nid=0x11b8 waiting on condition  [0x000000ab2adfe000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b6506fd0> (a java.util.concurrent.ForkJoinPool)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.ForkJoinPool.runWorker(java.base@11.0.2/ForkJoinPool.java:1628)
	at java.util.concurrent.ForkJoinWorkerThread.run(java.base@11.0.2/ForkJoinWorkerThread.java:177)

"db.exist.blob-store.persistent-writer" #1153 prio=5 os_prio=0 cpu=0.00ms elapsed=2213.65s tid=0x000001ad4815c000 nid=0xb78 waiting on condition  [0x000000ab718ff000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b5f80178> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.LinkedBlockingQueue.take(java.base@11.0.2/LinkedBlockingQueue.java:433)
	at org.exist.storage.blob.BlobStoreImpl$PersistentWriter.run(BlobStoreImpl.java:1562)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"db.exist.blob-store.vacuum" #1154 prio=5 os_prio=0 cpu=0.00ms elapsed=2213.65s tid=0x000001ad48157800 nid=0x4b8 waiting on condition  [0x000000ab719ff000]
   java.lang.Thread.State: WAITING (parking)
	at jdk.internal.misc.Unsafe.park(java.base@11.0.2/Native Method)
	- parking to wait for  <0x00000000b5f80398> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(java.base@11.0.2/LockSupport.java:194)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.2/AbstractQueuedSynchronizer.java:2081)
	at java.util.concurrent.PriorityBlockingQueue.take(java.base@11.0.2/PriorityBlockingQueue.java:547)
	at org.exist.storage.blob.BlobStoreImpl$BlobVacuum.run(BlobStoreImpl.java:1631)
	at java.lang.Thread.run(java.base@11.0.2/Thread.java:834)

"VM Thread" os_prio=2 cpu=171.88ms elapsed=2279.84s tid=0x000001ad47504000 nid=0x1128 runnable  

"GC Thread#0" os_prio=2 cpu=265.63ms elapsed=2279.87s tid=0x000001ad2a353000 nid=0x9c4 runnable  

"GC Thread#1" os_prio=2 cpu=203.13ms elapsed=2279.51s tid=0x000001ad47975000 nid=0x2b0 runnable  

"G1 Main Marker" os_prio=2 cpu=0.00ms elapsed=2279.87s tid=0x000001ad2a375000 nid=0x10b8 runnable  

"G1 Conc#0" os_prio=2 cpu=203.13ms elapsed=2279.87s tid=0x000001ad2a376800 nid=0x13cc runnable  

"G1 Refine#0" os_prio=2 cpu=15.63ms elapsed=2279.86s tid=0x000001ad2a3cf000 nid=0x10bc runnable  

"G1 Young RemSet Sampling" os_prio=2 cpu=46.88ms elapsed=2279.86s tid=0x000001ad2a3d0000 nid=0xdd8 runnable  
"VM Periodic Task Thread" os_prio=2 cpu=93.75ms elapsed=2279.78s tid=0x000001ad477ea000 nid=0x8c4 waiting on condition  

JNI global refs: 18, weak refs: 0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.