Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Crash after class replacement on Windows 8 / Java 8 #42

Open
mbeckh opened this issue Aug 20, 2014 · 8 comments
Open

Crash after class replacement on Windows 8 / Java 8 #42

mbeckh opened this issue Aug 20, 2014 · 8 comments

Comments

@mbeckh
Copy link

mbeckh commented Aug 20, 2014 

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000c0052b50, pid=13708, tid=336
#
# JRE version: Java(TM) SE Runtime Environment (8.0-b132) (build 1.8.0-b132)
# Java VM: Dynamic Code Evolution 64-Bit Server VM (25.5-b02-dcevmlight-58 mixed mode windows-amd64 compressed oops)
# Problematic frame:
# C  0x00000000c0052b50
#
# Failed to write core dump. Minidumps are not enabled by default on client versions of Windows
#
# If you would like to submit a bug report, please visit:
#   https://github.com/Guidewire/DCEVM/issues
#

---------------  T H R E A D  ---------------

Current thread (0x000000001aaed000):  JavaThread "http-nio-8443-exec-7" daemon [_thread_in_Java, id=336, stack(0x000000002c920000,0x000000002ca20000)]

siginfo: ExceptionCode=0xc0000005, ExceptionInformation=0x0000000000000008 0x00000000c0052b50

Registers:
RAX=0x00000000c004d9a8, RBX=0x000000001d1bd458, RCX=0x0000000002251260, RDX=0x00000000e4c8f910
RSP=0x000000002ca1c4c0, RBP=0x00000000c004d9a8, RSI=0x0000000100bd3470, RDI=0x00000001007370a0
R8 =0x0000000000000048, R9 =0x00000000e2cd9340, R10=0x0000000100bd3470, R11=0x000000002017a68e
R12=0x0000000000000000, R13=0x000000002ca1c4a0, R14=0x000000002ca1c5b8, R15=0x000000001aaed000
RIP=0x00000000c0052b50, EFLAGS=0x0000000000010246

Top of Stack: (sp=0x000000002ca1c4c0)
0x000000002ca1c4c0:   000000002ca1c4c0 0000000025578de9
0x000000002ca1c4d0:   000000002ca1c500 0000000004ba2e38
0x000000002ca1c4e0:   0000000004ba2e38 00000000c004d9a8
0x000000002ca1c4f0:   00000000e4c8f910 00000000e2cd9378
0x000000002ca1c500:   00000000c004d9a8 00000000e4c90088
0x000000002ca1c510:   40584000e4c8f910 00000000e2cd9378
0x000000002ca1c520:   0000000000000061 00000000c0052b50
0x000000002ca1c530:   000000002ca1c598 0000000002157350
0x000000002ca1c540:   0000000002157350 00000000c004d9a8
0x000000002ca1c550:   00000000e4c90088 000000002ca1c558
0x000000002ca1c560:   0000000025571dfe 000000002ca1c5b8
0x000000002ca1c570:   0000000025571eb8 000000001d517110
0x000000002ca1c580:   0000000025571e20 000000002ca1c548
0x000000002ca1c590:   000000002ca1c5b0 000000002ca1c600
0x000000002ca1c5a0:   0000000002157350 0000000000000000
0x000000002ca1c5b0:   00000000c004d9a8 00000000e4c90188 

Instructions: (pc=0x00000000c0052b50)
0x00000000c0052b30:   00 00 00 00 00 80 59 40 05 00 00 00 00 00 00 00
0x00000000c0052b40:   93 1f 00 20 00 00 00 00 00 00 00 00 00 e0 75 40
0x00000000c0052b50:   05 00 00 00 00 00 00 00 93 1f 00 20 00 00 00 00
0x00000000c0052b60:   00 00 00 00 00 80 59 40 00 00 00 00 00 00 00 00 


Register to memory mapping:

RAX=0x00000000c004d9a8 is an oop
jdk.nashorn.internal.scripts.JO4P0 
 - klass: 'jdk/nashorn/internal/scripts/JO4P0'
RBX=0x000000001d1bd458 is an unknown value
RCX=0x0000000002251260 is at begin+31 in a stub
MethodHandle::interpreter_entry::_linkToStatic [0x0000000002251241, 0x0000000002251285[ (68 bytes)
RDX=0x00000000e4c8f910 is an oop
java.lang.Class 
 - klass: 'java/lang/Class'
RSP=0x000000002ca1c4c0 is pointing into the stack for thread: 0x000000001aaed000
RBP=0x00000000c004d9a8 is an oop
jdk.nashorn.internal.scripts.JO4P0 
 - klass: 'jdk/nashorn/internal/scripts/JO4P0'
RSI=0x0000000100bd3470 is an unknown value
RDI=0x00000001007370a0 is an unknown value
R8 =0x0000000000000048 is an unknown value
R9 =0x00000000e2cd9340 is an oop
java.lang.invoke.MemberName 
 - klass: 'java/lang/invoke/MemberName'
R10=0x0000000100bd3470 is an unknown value
R11=0x000000002017a68e is an unknown value
R12=0x0000000000000000 is an unknown value
R13=0x000000002ca1c4a0 is pointing into the stack for thread: 0x000000001aaed000
R14=0x000000002ca1c5b8 is pointing into the stack for thread: 0x000000001aaed000
R15=0x000000001aaed000 is a thread


Stack: [0x000000002c920000,0x000000002ca20000],  sp=0x000000002ca1c4c0,  free space=1009k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C  0x00000000c0052b50


---------------  P R O C E S S  ---------------

Java Threads: ( => current thread )
  0x000000001aaf1800 JavaThread "http-nio-8443-exec-10" daemon [_thread_blocked, id=7868, stack(0x000000002da00000,0x000000002db00000)]
  0x000000001aaed800 JavaThread "http-nio-8443-exec-9" daemon [_thread_blocked, id=11356, stack(0x000000002d700000,0x000000002d800000)]
  0x000000001aaf0800 JavaThread "http-nio-8443-exec-8" daemon [_thread_blocked, id=2144, stack(0x000000002d600000,0x000000002d700000)]
=>0x000000001aaed000 JavaThread "http-nio-8443-exec-7" daemon [_thread_in_Java, id=336, stack(0x000000002c920000,0x000000002ca20000)]
  0x000000001aaf0000 JavaThread "http-nio-8443-exec-6" daemon [_thread_in_Java, id=4048, stack(0x000000002c820000,0x000000002c920000)]
  0x000000001aaec000 JavaThread "http-nio-8443-exec-5" daemon [_thread_blocked, id=3812, stack(0x0000000026b90000,0x0000000026c90000)]
  0x000000001aaef000 JavaThread "http-nio-8443-exec-4" daemon [_thread_blocked, id=11996, stack(0x0000000026a90000,0x0000000026b90000)]
  0x0000000012149000 JavaThread "http-nio-8443-exec-3" daemon [_thread_blocked, id=344, stack(0x00000000266f0000,0x00000000267f0000)]
  0x0000000014f28000 JavaThread "http-apr-8080-exec-2" daemon [_thread_blocked, id=9112, stack(0x000000002c720000,0x000000002c820000)]
  0x0000000014f27000 JavaThread "http-apr-8080-exec-1" daemon [_thread_blocked, id=8772, stack(0x000000002c520000,0x000000002c620000)]
  0x0000000014f26800 JavaThread "http-nio-8443-exec-2" daemon [_thread_blocked, id=2664, stack(0x0000000029250000,0x0000000029350000)]
  0x0000000014f1e000 JavaThread "http-nio-8443-exec-1" daemon [_thread_blocked, id=14060, stack(0x00000000181b0000,0x00000000182b0000)]
  0x0000000014f29800 JavaThread "QuartzScheduler_project-host1408535836612_MisfireHandler" [_thread_blocked, id=11720, stack(0x0000000025bc0000,0x0000000025cc0000)]
  0x0000000014f22800 JavaThread "QuartzScheduler_project-host1408535836612_ClusterManager" [_thread_blocked, id=2772, stack(0x0000000023080000,0x0000000023180000)]
  0x000000001ac96800 JavaThread "jscompiler" daemon [_thread_blocked, id=11912, stack(0x0000000028e50000,0x0000000029050000)]
  0x000000001ac8f800 JavaThread "project_QuartzSchedulerThread" [_thread_blocked, id=788, stack(0x0000000021010000,0x0000000021110000)]
  0x000000001ac8c000 JavaThread "project_Worker-10" [_thread_blocked, id=14040, stack(0x0000000020f10000,0x0000000021010000)]
  0x000000001ac8e000 JavaThread "project_Worker-9" [_thread_blocked, id=8800, stack(0x0000000020e10000,0x0000000020f10000)]
  0x000000001ac8d800 JavaThread "project_Worker-8" [_thread_blocked, id=312, stack(0x0000000020d10000,0x0000000020e10000)]
  0x000000001ac8f000 JavaThread "project_Worker-7" [_thread_blocked, id=14624, stack(0x0000000020c10000,0x0000000020d10000)]
  0x000000001ac88000 JavaThread "project_Worker-6" [_thread_blocked, id=12752, stack(0x0000000020b10000,0x0000000020c10000)]
  0x000000001ac8b000 JavaThread "project_Worker-5" [_thread_blocked, id=13324, stack(0x0000000020a10000,0x0000000020b10000)]
  0x000000001ac87800 JavaThread "project_Worker-4" [_thread_blocked, id=13736, stack(0x0000000020910000,0x0000000020a10000)]
  0x000000001ac8a800 JavaThread "project_Worker-3" [_thread_blocked, id=10704, stack(0x000000001d8a0000,0x000000001d9a0000)]
  0x000000001ac89800 JavaThread "project_Worker-2" [_thread_blocked, id=9580, stack(0x000000001b050000,0x000000001b150000)]
  0x000000001ac89000 JavaThread "project_Worker-1" [_thread_blocked, id=1924, stack(0x0000000019cb0000,0x0000000019db0000)]
  0x0000000014f25000 JavaThread "Abandoned connection cleanup thread" daemon [_thread_blocked, id=12700, stack(0x00000000189b0000,0x0000000018ab0000)]
  0x0000000014f23800 JavaThread "RMI TCP Connection(idle)" daemon [_thread_blocked, id=11632, stack(0x00000000184b0000,0x00000000185b0000)]
  0x0000000014f21000 JavaThread "ajp-apr-8009-AsyncTimeout" daemon [_thread_blocked, id=12544, stack(0x00000000180b0000,0x00000000181b0000)]
  0x0000000014f1f000 JavaThread "ajp-apr-8009-Acceptor-0" daemon [_thread_in_native, id=7816, stack(0x0000000017fb0000,0x00000000180b0000)]
  0x0000000014f20800 JavaThread "ajp-apr-8009-Poller" daemon [_thread_blocked, id=12016, stack(0x0000000017eb0000,0x0000000017fb0000)]
  0x0000000014f1f800 JavaThread "http-nio-8443-Acceptor-0" daemon [_thread_in_native, id=13152, stack(0x0000000017db0000,0x0000000017eb0000)]
  0x000000001214d000 JavaThread "http-nio-8443-ClientPoller-1" daemon [_thread_in_native, id=14824, stack(0x0000000017cb0000,0x0000000017db0000)]
  0x000000001214f000 JavaThread "http-nio-8443-ClientPoller-0" daemon [_thread_in_native, id=12020, stack(0x0000000017bb0000,0x0000000017cb0000)]
  0x0000000012150000 JavaThread "http-apr-8080-AsyncTimeout" daemon [_thread_blocked, id=10816, stack(0x0000000017ab0000,0x0000000017bb0000)]
  0x000000001214b800 JavaThread "http-apr-8080-Acceptor-0" daemon [_thread_in_native, id=14264, stack(0x00000000179b0000,0x0000000017ab0000)]
  0x000000001214e800 JavaThread "http-apr-8080-Sendfile" daemon [_thread_blocked, id=13500, stack(0x00000000178b0000,0x00000000179b0000)]
  0x000000001214d800 JavaThread "http-apr-8080-Poller" daemon [_thread_blocked, id=13868, stack(0x00000000177b0000,0x00000000178b0000)]
  0x000000001214a000 JavaThread "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon [_thread_blocked, id=14952, stack(0x00000000174b0000,0x00000000175b0000)]
  0x000000001214a800 JavaThread "NioBlockingSelector.BlockPoller-1" daemon [_thread_in_native, id=6436, stack(0x0000000016eb0000,0x0000000016fb0000)]
  0x000000001214c000 JavaThread "GC Daemon" daemon [_thread_blocked, id=7384, stack(0x0000000015be0000,0x0000000015ce0000)]
  0x0000000013cf5000 JavaThread "RMI TCP Connection(idle)" daemon [_thread_blocked, id=11296, stack(0x0000000014810000,0x0000000014910000)]
  0x0000000013ca2800 JavaThread "RMI Scheduler(0)" daemon [_thread_blocked, id=7500, stack(0x0000000014710000,0x0000000014810000)]
  0x0000000013c7e000 JavaThread "RMI TCP Connection(idle)" daemon [_thread_blocked, id=15068, stack(0x0000000014610000,0x0000000014710000)]
  0x000000001317a000 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=6784, stack(0x0000000013a10000,0x0000000013b10000)]
  0x000000001316f800 JavaThread "RMI TCP Accept-1099" daemon [_thread_in_native, id=11680, stack(0x0000000013910000,0x0000000013a10000)]
  0x0000000013161000 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=1352, stack(0x0000000013430000,0x0000000013530000)]
  0x0000000012fb3000 JavaThread "AsyncFileHandlerWriter-529116035" daemon [_thread_blocked, id=6928, stack(0x0000000013330000,0x0000000013430000)]
  0x00000000121ea000 JavaThread "Service Thread" daemon [_thread_blocked, id=14712, stack(0x0000000012e30000,0x0000000012f30000)]
  0x000000001215d800 JavaThread "C1 CompilerThread3" daemon [_thread_in_native, id=14456, stack(0x0000000012d30000,0x0000000012e30000)]
  0x0000000012146000 JavaThread "C2 CompilerThread2" daemon [_thread_in_native, id=2004, stack(0x0000000012c30000,0x0000000012d30000)]
  0x0000000012153800 JavaThread "C2 CompilerThread1" daemon [_thread_in_native, id=13080, stack(0x0000000012b30000,0x0000000012c30000)]
  0x000000001215a800 JavaThread "C2 CompilerThread0" daemon [_thread_in_native, id=5372, stack(0x0000000012a30000,0x0000000012b30000)]
  0x0000000012144800 JavaThread "JDWP Command Reader" daemon [_thread_in_native, id=14832, stack(0x0000000012930000,0x0000000012a30000)]
  0x0000000012139800 JavaThread "JDWP Event Helper Thread" daemon [_thread_blocked, id=7672, stack(0x0000000012830000,0x0000000012930000)]
  0x0000000012125800 JavaThread "JDWP Transport Listener: dt_shmem" daemon [_thread_blocked, id=8940, stack(0x0000000012730000,0x0000000012830000)]
  0x000000001212f000 JavaThread "Attach Listener" daemon [_thread_blocked, id=14360, stack(0x0000000012630000,0x0000000012730000)]
  0x000000001212d000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=6300, stack(0x0000000012530000,0x0000000012630000)]
  0x00000000120e6000 JavaThread "Finalizer" daemon [_thread_in_vm, id=13336, stack(0x0000000012430000,0x0000000012530000)]
  0x00000000120dc800 JavaThread "Reference Handler" daemon [_thread_blocked, id=14960, stack(0x0000000012330000,0x0000000012430000)]
  0x0000000002052800 JavaThread "main" [_thread_in_native, id=4460, stack(0x0000000001f50000,0x0000000002050000)]

Other Threads:
  0x00000000120d6000 VMThread [stack: 0x0000000012230000,0x0000000012330000] [id=13728]
  0x000000001317d800 WatcherThread [stack: 0x0000000013b10000,0x0000000013c10000] [id=1616]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap:
 def new generation   total 471872K, used 33992K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,   1% used [0x00000000c0000000, 0x00000000c074c6c0, 0x00000000d99a0000)
  from space 52416K,  50% used [0x00000000dccd0000, 0x00000000de6b5c80, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 185876K, used 111524K [0x00000000e0000000, 0x00000000eb585000, 0x0000000100000000)
   the space 185876K,  59% used [0x00000000e0000000, 0x00000000e6ce9340, 0x00000000e6ce9400, 0x00000000eb585000)
 Metaspace       used 112413K, capacity 136737K, committed 138944K, reserved 1165312K
  class space    used 17815K, capacity 20991K, committed 23040K, reserved 1048576K

Card table byte_map: [0x0000000011510000,0x0000000011720000] byte_map_base: 0x0000000010f10000

Polling page: 0x0000000000850000

CodeCache: size=245760Kb used=82106Kb max_used=85565Kb free=163653Kb
 bounds [0x0000000002150000, 0x0000000007520000, 0x0000000011150000]
 total_blobs=16700 nmethods=15976 adapters=639
 compilation: enabled

Compilation events (10 events):
Event: 86.868 Thread 0x0000000012153800 20221       4       java.lang.Class::cast (27 bytes)
Event: 86.868 Thread 0x000000001215d800 nmethod 20263 0x0000000006331950 code [0x0000000006331b00, 0x00000000063321a8]
Event: 86.868 Thread 0x000000001215d800 20359       2       java.lang.invoke.LambdaForm$MH/1463691182::guard (59 bytes)
Event: 86.869 Thread 0x0000000012153800 nmethod 20221 0x0000000004acd9d0 code [0x0000000004acdb00, 0x0000000004acdbf8]
Event: 86.869 Thread 0x0000000012153800 20218       4       sun.invoke.util.ValueConversions::castReference (20 bytes)
Event: 86.869 Thread 0x000000001215d800 nmethod 20359 0x0000000004ace910 code [0x0000000004aceaa0, 0x0000000004aced48]
Event: 86.870 Thread 0x000000001215d800 20368       2       java.lang.invoke.LambdaForm$MH/1364557829::guard (66 bytes)
Event: 86.870 Thread 0x000000001215d800 nmethod 20368 0x0000000004ace150 code [0x0000000004ace2e0, 0x0000000004ace588]
Event: 86.870 Thread 0x000000001215d800 20362       2       java.lang.invoke.LambdaForm$MH/324463640::guard (71 bytes)
Event: 86.870 Thread 0x0000000012153800 nmethod 20218 0x0000000004acdcd0 code [0x0000000004acde20, 0x0000000004acdf88]

GC Heap History (10 events):
Event: 23.379 GC heap before
{Heap before GC invocations=7 (full 5):
 def new generation   total 471872K, used 419456K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K, 100% used [0x00000000c0000000, 0x00000000d99a0000, 0x00000000d99a0000)
  from space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 129776K, used 77863K [0x00000000e0000000, 0x00000000e7ebc000, 0x0000000100000000)
   the space 129776K,  59% used [0x00000000e0000000, 0x00000000e4c09ff0, 0x00000000e4c0a000, 0x00000000e7ebc000)
 Metaspace       used 63167K, capacity 65679K, committed 74560K, reserved 1112064K
  class space    used 8124K, capacity 9024K, committed 11136K, reserved 1048576K
Event: 23.446 GC heap after
Heap after GC invocations=8 (full 5):
 def new generation   total 471872K, used 30248K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,   0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000d99a0000)
  from space 52416K,  57% used [0x00000000d99a0000, 0x00000000db72a060, 0x00000000dccd0000)
  to   space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
 tenured generation   total 129776K, used 77863K [0x00000000e0000000, 0x00000000e7ebc000, 0x0000000100000000)
   the space 129776K,  59% used [0x00000000e0000000, 0x00000000e4c09ff0, 0x00000000e4c0a000, 0x00000000e7ebc000)
 Metaspace       used 63167K, capacity 65679K, committed 74560K, reserved 1112064K
  class space    used 8124K, capacity 9024K, committed 11136K, reserved 1048576K
}
Event: 27.968 GC heap before
{Heap before GC invocations=8 (full 5):
 def new generation   total 471872K, used 349990K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,  76% used [0x00000000c0000000, 0x00000000d383f8d0, 0x00000000d99a0000)
  from space 52416K,  57% used [0x00000000d99a0000, 0x00000000db72a060, 0x00000000dccd0000)
  to   space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
 tenured generation   total 129776K, used 77863K [0x00000000e0000000, 0x00000000e7ebc000, 0x0000000100000000)
   the space 129776K,  59% used [0x00000000e0000000, 0x00000000e4c09ff0, 0x00000000e4c0a000, 0x00000000e7ebc000)
 Metaspace       used 80301K, capacity 90238K, committed 92192K, reserved 1126400K
  class space    used 12382K, capacity 14430K, committed 16384K, reserved 1048576K
Event: 28.335 GC heap after
Heap after GC invocations=9 (full 6):
 def new generation   total 471872K, used 0K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,   0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000d99a0000)
  from space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
  to   space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
 tenured generation   total 185876K, used 111524K [0x00000000e0000000, 0x00000000eb585000, 0x0000000100000000)
   the space 185876K,  59% used [0x00000000e0000000, 0x00000000e6ce9340, 0x00000000e6ce9400, 0x00000000eb585000)
 Metaspace       used 79229K, capacity 88661K, committed 92192K, reserved 1126400K
  class space    used 11910K, capacity 13801K, committed 16384K, reserved 1048576K
}
Event: 31.494 GC heap before
{Heap before GC invocations=9 (full 6):
 def new generation   total 471872K, used 419456K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K, 100% used [0x00000000c0000000, 0x00000000d99a0000, 0x00000000d99a0000)
  from space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
  to   space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
 tenured generation   total 185876K, used 111524K [0x00000000e0000000, 0x00000000eb585000, 0x0000000100000000)
   the space 185876K,  59% used [0x00000000e0000000, 0x00000000e6ce9340, 0x00000000e6ce9400, 0x00000000eb585000)
 Metaspace       used 88176K, capacity 107571K, committed 109632K, reserved 1138688K
  class space    used 15059K, capacity 18047K, committed 20096K, reserved 1048576K
Event: 31.512 GC heap after
Heap after GC invocations=10 (full 6):
 def new generation   total 471872K, used 3348K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,   0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000d99a0000)
  from space 52416K,   6% used [0x00000000dccd0000, 0x00000000dd015030, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 185876K, used 111524K [0x00000000e0000000, 0x00000000eb585000, 0x0000000100000000)
   the space 185876K,  59% used [0x00000000e0000000, 0x00000000e6ce9340, 0x00000000e6ce9400, 0x00000000eb585000)
 Metaspace       used 88176K, capacity 107571K, committed 109632K, reserved 1138688K
  class space    used 15059K, capacity 18047K, committed 20096K, reserved 1048576K
}
Event: 37.848 GC heap before
{Heap before GC invocations=10 (full 6):
 def new generation   total 471872K, used 422804K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K, 100% used [0x00000000c0000000, 0x00000000d99a0000, 0x00000000d99a0000)
  from space 52416K,   6% used [0x00000000dccd0000, 0x00000000dd015030, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 185876K, used 111524K [0x00000000e0000000, 0x00000000eb585000, 0x0000000100000000)
   the space 185876K,  59% used [0x00000000e0000000, 0x00000000e6ce9340, 0x00000000e6ce9400, 0x00000000eb585000)
 Metaspace       used 100153K, capacity 121455K, committed 123584K, reserved 1150976K
  class space    used 16659K, capacity 19747K, committed 21760K, reserved 1048576K
Event: 37.885 GC heap after
Heap after GC invocations=11 (full 6):
 def new generation   total 471872K, used 17808K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,   0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000d99a0000)
  from space 52416K,  33% used [0x00000000d99a0000, 0x00000000dab042b8, 0x00000000dccd0000)
  to   space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
 tenured generation   total 185876K, used 111524K [0x00000000e0000000, 0x00000000eb585000, 0x0000000100000000)
   the space 185876K,  59% used [0x00000000e0000000, 0x00000000e6ce9340, 0x00000000e6ce9400, 0x00000000eb585000)
 Metaspace       used 100153K, capacity 121455K, committed 123584K, reserved 1150976K
  class space    used 16659K, capacity 19747K, committed 21760K, reserved 1048576K
}
Event: 86.774 GC heap before
{Heap before GC invocations=11 (full 6):
 def new generation   total 471872K, used 435619K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,  99% used [0x00000000c0000000, 0x00000000d98049c8, 0x00000000d99a0000)
  from space 52416K,  33% used [0x00000000d99a0000, 0x00000000dab042b8, 0x00000000dccd0000)
  to   space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
 tenured generation   total 185876K, used 111524K [0x00000000e0000000, 0x00000000eb585000, 0x0000000100000000)
   the space 185876K,  59% used [0x00000000e0000000, 0x00000000e6ce9340, 0x00000000e6ce9400, 0x00000000eb585000)
 Metaspace       used 112408K, capacity 136737K, committed 138944K, reserved 1165312K
  class space    used 17814K, capacity 20991K, committed 23040K, reserved 1048576K
Event: 86.818 GC heap after
Heap after GC invocations=12 (full 6):
 def new generation   total 471872K, used 26519K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,   0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000d99a0000)
  from space 52416K,  50% used [0x00000000dccd0000, 0x00000000de6b5c80, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 185876K, used 111524K [0x00000000e0000000, 0x00000000eb585000, 0x0000000100000000)
   the space 185876K,  59% used [0x00000000e0000000, 0x00000000e6ce9340, 0x00000000e6ce9400, 0x00000000eb585000)
 Metaspace       used 112408K, capacity 136737K, committed 138944K, reserved 1165312K
  class space    used 17814K, capacity 20991K, committed 23040K, reserved 1048576K
}

Deoptimization events (10 events):
Event: 55.141 Thread 0x000000001aaed000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x0000000005e8fc44 method=java.lang.reflect.Array.newInstance(Ljava/lang/Class;I)Ljava/lang/Object; @ 2
Event: 55.143 Thread 0x000000001aaed000 Uncommon trap: reason=bimorphic action=maybe_recompile pc=0x0000000002355394 method=sun.reflect.generics.reflectiveObjects.ParameterizedTypeImpl.equals(Ljava/lang/Object;)Z @ 20
Event: 55.143 Thread 0x000000001aaed000 Uncommon trap: reason=bimorphic action=maybe_recompile pc=0x0000000002355394 method=sun.reflect.generics.reflectiveObjects.ParameterizedTypeImpl.equals(Ljava/lang/Object;)Z @ 20
Event: 55.149 Thread 0x000000001aaed000 Uncommon trap: reason=bimorphic action=maybe_recompile pc=0x0000000002355394 method=sun.reflect.generics.reflectiveObjects.ParameterizedTypeImpl.equals(Ljava/lang/Object;)Z @ 20
Event: 55.149 Thread 0x000000001aaed000 Uncommon trap: reason=bimorphic action=maybe_recompile pc=0x0000000002355394 method=sun.reflect.generics.reflectiveObjects.ParameterizedTypeImpl.equals(Ljava/lang/Object;)Z @ 20
Event: 55.490 Thread 0x000000001aaed800 Uncommon trap: reason=unreached action=reinterpret pc=0x0000000006f50e80 method=sun.util.locale.BaseLocale.equals(Ljava/lang/Object;)Z @ 51
Event: 55.491 Thread 0x000000001aaed800 Uncommon trap: reason=unreached action=reinterpret pc=0x0000000006f64d6c method=sun.util.locale.BaseLocale.equals(Ljava/lang/Object;)Z @ 51
Event: 59.108 Thread 0x0000000014f26800 Uncommon trap: reason=null_assert action=make_not_entrant pc=0x0000000006f4d69c method=java.util.concurrent.locks.ReentrantReadWriteLock$Sync.tryAcquireShared(I)I @ 129
Event: 59.108 Thread 0x0000000014f26800 Uncommon trap: reason=unreached action=reinterpret pc=0x0000000006f4cde4 method=java.util.concurrent.locks.ReentrantReadWriteLock$Sync.tryReleaseShared(I)Z @ 9
Event: 59.108 Thread 0x000000001aaf1800 Uncommon trap: reason=null_assert action=make_not_entrant pc=0x0000000006f4d69c method=java.util.concurrent.locks.ReentrantReadWriteLock$Sync.tryAcquireShared(I)I @ 129

Internal exceptions (10 events):
Event: 59.015 Thread 0x000000001aaed800 Exception  (0x00000000d74a5400) thrown at [C:\Jenkins\workspace\DCEVM-light-8u05\jdk\JDK1.8.0_05-x64\k\product\oops\compressed\slave\dcevm-win\hotspot\src\share\vm\prims\jvm.cpp, line 1249]
Event: 59.015 Thread 0x000000001aaed800 Exception  (0x00000000d74a8a20) thrown at [C:\Jenkins\workspace\DCEVM-light-8u05\jdk\JDK1.8.0_05-x64\k\product\oops\compressed\slave\dcevm-win\hotspot\src\share\vm\prims\jvm.cpp, line 1249]
Event: 59.015 Thread 0x000000001aaed800 Exception  (0x00000000d74a9d88) thrown at [C:\Jenkins\workspace\DCEVM-light-8u05\jdk\JDK1.8.0_05-x64\k\product\oops\compressed\slave\dcevm-win\hotspot\src\share\vm\classfile\systemDictionary.cØøc <‚M@
Event: 59.017 Thread 0x000000001aaed800 Exception  (0x00000000d74cc580) thrown at [C:\Jenkins\workspace\DCEVM-light-8u05\jdk\JDK1.8.0_05-x64\k\product\oops\compressed\slave\dcevm-win\hotspot\src\share\vm\prims\jvm.cpp, line 1249]
Event: 59.018 Thread 0x000000001aaed800 Exception  (0x00000000d74cdec0) thrown at [C:\Jenkins\workspace\DCEVM-light-8u05\jdk\JDK1.8.0_05-x64\k\product\oops\compressed\slave\dcevm-win\hotspot\src\share\vm\prims\jvm.cpp, line 1249]
Event: 59.018 Thread 0x000000001aaed800 Exception  (0x00000000d74d2b38) thrown at [C:\Jenkins\workspace\DCEVM-light-8u05\jdk\JDK1.8.0_05-x64\k\product\oops\compressed\slave\dcevm-win\hotspot\src\share\vm\prims\jvm.cpp, line 1249]
Event: 59.018 Thread 0x000000001aaed800 Exception  (0x00000000d74ed698) thrown at [C:\Jenkins\workspace\DCEVM-light-8u05\jdk\JDK1.8.0_05-x64\k\product\oops\compressed\slave\dcevm-win\hotspot\src\share\vm\prims\jvm.cpp, line 1249]
Event: 59.018 Thread 0x000000001aaed800 Exception  (0x00000000d74eefd8) thrown at [C:\Jenkins\workspace\DCEVM-light-8u05\jdk\JDK1.8.0_05-x64\k\product\oops\compressed\slave\dcevm-win\hotspot\src\share\vm\prims\jvm.cpp, line 1249]
Event: 59.019 Thread 0x000000001aaed800 Exception  (0x00000000d74f3c50) thrown at [C:\Jenkins\workspace\DCEVM-light-8u05\jdk\JDK1.8.0_05-x64\k\product\oops\compressed\slave\dcevm-win\hotspot\src\share\vm\prims\jvm.cpp, line 1249]
Event: 59.019 Thread 0x000000001aaed800 Exception  (0x00000000d74f4e68) thrown at [C:\Jenkins\workspace\DCEVM-light-8u05\jdk\JDK1.8.0_05-x64\k\product\oops\compressed\slave\dcevm-win\hotspot\src\share\vm�ë¼�â�M@

Events (10 events):
Event: 86.835 Thread 0x0000000012153800 flushing nmethod 0x0000000004a49090
Event: 86.835 Thread 0x0000000012153800 flushing nmethod 0x0000000004a6e050
Event: 86.836 Thread 0x0000000012153800 flushing nmethod 0x0000000004a9bed0
Event: 86.836 Thread 0x0000000012153800 flushing nmethod 0x0000000004aaa910
Event: 86.837 Thread 0x0000000012153800 flushing nmethod 0x0000000004babc90
Event: 86.837 Thread 0x000000001215d800 flushing nmethod 0x0000000004cc9990
Event: 86.838 Thread 0x000000001215d800 flushing nmethod 0x0000000004e4b950
Event: 86.838 Thread 0x000000001215d800 flushing nmethod 0x0000000005d40f50
Event: 86.840 Thread 0x000000001215d800 flushing nmethod 0x0000000005e4f690
Event: 86.844 Thread 0x000000001215d800 flushing nmethod 0x0000000006f4d250


Dynamic libraries:
0x00007ff7feaa0000 - 0x00007ff7fead4000     C:\Java\jdk1.8.0\bin\java.exe
0x00007ffabf4f0000 - 0x00007ffabf69a000     C:\WINDOWS\SYSTEM32\ntdll.dll
0x00007ffabeb60000 - 0x00007ffabec9a000     C:\WINDOWS\system32\KERNEL32.DLL
0x00007ffabc980000 - 0x00007ffabca8f000     C:\WINDOWS\system32\KERNELBASE.dll
0x00007ffabaf50000 - 0x00007ffabafd8000     C:\WINDOWS\system32\apphelp.dll
0x00007ffab85e0000 - 0x00007ffab862f000     C:\WINDOWS\AppPatch\AppPatch64\AcGenral.DLL
0x00007ffabef70000 - 0x00007ffabf017000     C:\WINDOWS\system32\msvcrt.dll
0x00007ffabc6a0000 - 0x00007ffabc6cb000     C:\WINDOWS\SYSTEM32\SspiCli.dll
0x00007ffabe7a0000 - 0x00007ffabe7f1000     C:\WINDOWS\system32\SHLWAPI.dll
0x00007ffabf130000 - 0x00007ffabf2a1000     C:\WINDOWS\system32\USER32.dll
0x00007ffabcd70000 - 0x00007ffabcee8000     C:\WINDOWS\system32\ole32.dll
0x00007ffabd0d0000 - 0x00007ffabe4f0000     C:\WINDOWS\system32\SHELL32.dll
0x00007ffabbed0000 - 0x00007ffabbeee000     C:\WINDOWS\SYSTEM32\USERENV.dll
0x00007ffabe9a0000 - 0x00007ffabea45000     C:\WINDOWS\system32\ADVAPI32.dll
0x00007ffab3f70000 - 0x00007ffab3f8b000     C:\WINDOWS\SYSTEM32\MPR.dll
0x00007ffabe660000 - 0x00007ffabe797000     C:\WINDOWS\system32\RPCRT4.dll
0x00007ffabecd0000 - 0x00007ffabed27000     C:\WINDOWS\SYSTEM32\sechost.dll
0x00007ffabcef0000 - 0x00007ffabd0c6000     C:\WINDOWS\SYSTEM32\combase.dll
0x00007ffabe500000 - 0x00007ffabe644000     C:\WINDOWS\system32\GDI32.dll
0x00007ffabc860000 - 0x00007ffabc874000     C:\WINDOWS\SYSTEM32\profapi.dll
0x00007ffabb1f0000 - 0x00007ffabb28f000     C:\WINDOWS\SYSTEM32\SHCORE.dll
0x00007ffabf2b0000 - 0x00007ffabf2e4000     C:\WINDOWS\system32\IMM32.DLL
0x00007ffabf3b0000 - 0x00007ffabf4e9000     C:\WINDOWS\system32\MSCTF.dll
0x00007ffabaab0000 - 0x00007ffabad0a000     C:\WINDOWS\WinSxS\amd64_microsoft.windows.common-controls_6595b64144ccf1df_6.0.9600.17031_none_6242a4b3ecbb55a1\COMCTL32.dll
0x000000006ccd0000 - 0x000000006cda2000     C:\Java\jdk1.8.0\jre\bin\msvcr100.dll
0x000000006b0e0000 - 0x000000006b8d6000     C:\Java\jdk1.8.0\jre\bin\dcevm\jvm.dll
0x00007ffab4d60000 - 0x00007ffab4d69000     C:\WINDOWS\SYSTEM32\WSOCK32.dll
0x00007ffab8e50000 - 0x00007ffab8e6f000     C:\WINDOWS\SYSTEM32\WINMM.dll
0x00007ffabe650000 - 0x00007ffabe657000     C:\WINDOWS\system32\PSAPI.DLL
0x00007ffabf0d0000 - 0x00007ffabf128000     C:\WINDOWS\system32\WS2_32.dll
0x00007ffab8dd0000 - 0x00007ffab8dfa000     C:\WINDOWS\SYSTEM32\WINMMBASE.dll
0x00007ffabe4f0000 - 0x00007ffabe4f9000     C:\WINDOWS\system32\NSI.dll
0x00007ffabcd20000 - 0x00007ffabcd6a000     C:\WINDOWS\SYSTEM32\cfgmgr32.dll
0x00007ffabb6f0000 - 0x00007ffabb716000     C:\WINDOWS\SYSTEM32\DEVOBJ.dll
0x000000006d290000 - 0x000000006d29f000     C:\Java\jdk1.8.0\jre\bin\verify.dll
0x000000006c470000 - 0x000000006c498000     C:\Java\jdk1.8.0\jre\bin\java.dll
0x000000006b960000 - 0x000000006b995000     C:\Java\jdk1.8.0\jre\bin\jdwp.dll
0x000000006c2d0000 - 0x000000006c2d8000     C:\Java\jdk1.8.0\jre\bin\npt.dll
0x000000006c450000 - 0x000000006c466000     C:\Java\jdk1.8.0\jre\bin\zip.dll
0x000000006b950000 - 0x000000006b95b000     C:\Java\jdk1.8.0\jre\bin\dt_shmem.dll
0x000000006b940000 - 0x000000006b94d000     C:\Java\jdk1.8.0\jre\bin\management.dll
0x000000006c430000 - 0x000000006c44a000     C:\Java\jdk1.8.0\jre\bin\net.dll
0x00007ffabc120000 - 0x00007ffabc178000     C:\WINDOWS\system32\mswsock.dll
0x000000006c410000 - 0x000000006c421000     C:\Java\jdk1.8.0\jre\bin\nio.dll
0x00007ffab5060000 - 0x00007ffab5074000     C:\WINDOWS\system32\napinsp.dll
0x00007ffab5040000 - 0x00007ffab5059000     C:\WINDOWS\system32\pnrpnsp.dll
0x00007ffab7be0000 - 0x00007ffab7bf9000     C:\WINDOWS\system32\NLAapi.dll
0x00007ffabbf30000 - 0x00007ffabbfd3000     C:\WINDOWS\SYSTEM32\DNSAPI.dll
0x00007ffab5080000 - 0x00007ffab508c000     C:\WINDOWS\System32\winrnr.dll
0x000000006d740000 - 0x000000006d766000     C:\Program Files\Bonjour\mdnsNSP.dll
0x00007ffab6150000 - 0x00007ffab6179000     C:\WINDOWS\SYSTEM32\Iphlpapi.DLL
0x00007ffab6130000 - 0x00007ffab613a000     C:\WINDOWS\SYSTEM32\WINNSI.DLL
0x00007ffab57f0000 - 0x00007ffab57f9000     C:\Windows\System32\rasadhlp.dll
0x00007ffab5f50000 - 0x00007ffab5fb8000     C:\WINDOWS\System32\fwpuclnt.dll
0x00007ffabc180000 - 0x00007ffabc19e000     C:\WINDOWS\SYSTEM32\CRYPTSP.dll
0x00007ffabbcf0000 - 0x00007ffabbd25000     C:\WINDOWS\system32\rsaenh.dll
0x00007ffabc3b0000 - 0x00007ffabc3d6000     C:\WINDOWS\SYSTEM32\bcrypt.dll
0x00007ffabc6d0000 - 0x00007ffabc730000     C:\WINDOWS\system32\bcryptprimitives.dll
0x00007ffabc730000 - 0x00007ffabc73a000     C:\WINDOWS\SYSTEM32\CRYPTBASE.dll
0x0000000180000000 - 0x000000018018c000     C:\Java\apache-tomcat-8.0.8\bin\tcnative-1.dll
0x000000006b910000 - 0x000000006b934000     C:\Java\jdk1.8.0\jre\bin\sunec.dll
0x000000006b900000 - 0x000000006b90b000     C:\Java\jdk1.8.0\jre\bin\sunmscapi.dll
0x00007ffabca90000 - 0x00007ffabcc67000     C:\WINDOWS\system32\CRYPT32.dll
0x00007ffabc910000 - 0x00007ffabc922000     C:\WINDOWS\system32\MSASN1.dll
0x00007ffab7470000 - 0x00007ffab75f8000     C:\WINDOWS\SYSTEM32\dbghelp.dll

VM Arguments:
jvm_args: -Xdebug -Xrunjdwp:transport=dt_shmem,address=56507,suspend=y,server=n -Dnet.jawr.debug.on=true -Dclient.code=clientname -Xmn512m -Xmx1024m -Dcom.sun.management.jmxremote= -Dcom.sun.management.jmxremote.port=1099 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Djava.rmi.server.hostname=127.0.0.1 -Djava.util.logging.config.file=C:\Users\username\.IntelliJIdea13\system\tomcat\Unnamed_project\conf\logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.endorsed.dirs=C:\Java\apache-tomcat-8.0.8\endorsed -Dcatalina.base=C:\Users\username\.IntelliJIdea13\system\tomcat\Unnamed_project -Dcatalina.home=C:\Java\apache-tomcat-8.0.8 -Djava.io.tmpdir=C:\Java\apache-tomcat-8.0.8\temp 
java_command: org.apache.catalina.startup.Bootstrap start
java_class_path (initial): C:\Java\apache-tomcat-8.0.8\bin\bootstrap.jar;C:\Java\apache-tomcat-8.0.8\bin\tomcat-juli.jar
Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=C:\Java\jdk1.8.0
JRE_HOME=C:\Java\jdk1.8.0
CLASSPATH=C:\Java\apache-tomcat-8.0.8\bin\bootstrap.jar;C:\Java\apache-tomcat-8.0.8\bin\tomcat-juli.jar
PATH=C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\Java\apache-maven-3.2.1\bin;"C:\Program Files\Tools";"C:\Program Files (x86)\Tools"
USERNAME=username
OS=Windows_NT
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 58 Stepping 9, GenuineIntel



---------------  S Y S T E M  ---------------

OS: Windows 8.1 , 64 bit Build 9600 

CPU:total 8 (4 cores per cpu, 2 threads per core) family 6 model 58 stepping 9, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, aes, clmul, erms, ht, tsc, tscinvbit

Memory: 4k page, physical 16734380k(10737844k free), swap 19224748k(8152884k free)

vm_info: Dynamic Code Evolution 64-Bit Server VM (25.5-b02-dcevmlight-58) for windows-amd64 JRE (1.8.0), built on May  5 2014 22:51:21 by "" with MS VC++ 10.0 (VS2010)

time: Wed Aug 20 13:58:22 2014
elapsed time: 86 seconds
@skybber
Copy link
Contributor

skybber commented Sep 5, 2014

Can you try the last DCEVM version (jdk8u20) against the last openjdk version? I have no problems with that on linux :(

@mbeckh
Copy link
Author

mbeckh commented Sep 5, 2014

Crashes with a different error, but still crashes. The problem still seems to occur on the first execution of the embedded Nashorn scripting engine after a class reload.

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000223bd228, pid=16504, tid=15936
#
# JRE version: Java(TM) SE Runtime Environment (8.0_20-b26) (build 1.8.0_20-b26)
# Java VM: Dynamic Code Evolution 64-Bit Server VM (25.20-b21-dcevmlight-dev mixed mode windows-amd64 compressed oops)
# Problematic frame:
# C  0x00000000223bd228
#
# Failed to write core dump. Minidumps are not enabled by default on client versions of Windows
#
# If you would like to submit a bug report, please visit:
#   https://github.com/Guidewire/DCEVM/issues
#
---------------  T H R E A D  ---------------
Current thread (0x0000000020c7a800):  JavaThread "http-nio-8443-exec-5" daemon [_thread_in_Java, id=15936, stack(0x0000000034700000,0x0000000034800000)]
siginfo: ExceptionCode=0xc0000005, ExceptionInformation=0x0000000000000008 0x00000000223bd228
Registers:
RAX=0x00000000c8198a98, RBX=0x00000000124f0250, RCX=0x0000000002d327a0, RDX=0x00000000e5e50638
RSP=0x00000000347f8f10, RBP=0x00000000e016ebf8, RSI=0x0000000100e56370, RDI=0x000000010000bdf8
R8 =0x0000000000000040, R9 =0x00000000e041ba80, R10=0x0000000100e56370, R11=0x00000000201cac6e
R12=0x0000000000000000, R13=0x00000000347f8ef0, R14=0x00000000347f8fb8, R15=0x0000000020c7a800
RIP=0x00000000223bd228, EFLAGS=0x0000000000010246
Top of Stack: (sp=0x00000000347f8f10)
0x00000000347f8f10:   00000000239725d8 0000000000000000
0x00000000347f8f20:   00000000347f8f90 0000000002c37850
0x00000000347f8f30:   0000000002c37850 00000000c8198a98
0x00000000347f8f40:   00000000e5e50638 00000000e016ebf8
0x00000000347f8f50:   00000000347f8f50 00000000229141fe
0x00000000347f8f60:   00000000347f8fb8 00000000229142a8
0x00000000347f8f70:   0000000023399258 0000000022914210
0x00000000347f8f80:   00000000347f8f38 00000000347f8fb0
0x00000000347f8f90:   00000000347f9000 0000000002c37850
0x00000000347f8fa0:   00000000e016ebf8 00000000e5e50638
0x00000000347f8fb0:   00000000c8198a98 00000000e5eb2b20
0x00000000347f8fc0:   00000000347f8fc0 000000002392ea1e
0x00000000347f8fd0:   00000000347f9020 000000002392ead8
0x00000000347f8fe0:   00000000223fe1a8 000000002392ea40
0x00000000347f8ff0:   00000000347f8fb0 00000000347f9018
0x00000000347f9000:   00000000347f9068 0000000002c37850 
Instructions: (pc=0x00000000223bd228)
0x00000000223bd208:   03 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00
0x00000000223bd218:   b8 7f de 00 01 00 00 00 48 ff d9 00 01 00 00 00
0x00000000223bd228:   00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x00000000223bd238:   00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 
Register to memory mapping:
RAX=
[error occurred during error reporting (printing register info), id 0xc0000005]
Stack: [0x0000000034700000,0x0000000034800000],  sp=0x00000000347f8f10,  free space=995k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C  0x00000000223bd228
---------------  P R O C E S S  ---------------
Java Threads: ( => current thread )
  0x000000002efa1800 JavaThread "RMI TCP Connection(14)-127.0.0.1" daemon [_thread_in_native, id=7548, stack(0x0000000014fc0000,0x00000000150c0000)]
  0x000000002efa2800 JavaThread "http-nio-8443-exec-10" daemon [_thread_blocked, id=17396, stack(0x00000000403c0000,0x00000000404c0000)]
  0x000000002ef9f800 JavaThread "http-nio-8443-exec-9" daemon [_thread_blocked, id=8360, stack(0x00000000402c0000,0x00000000403c0000)]
  0x0000000015737800 JavaThread "http-nio-8443-exec-8" daemon [_thread_blocked, id=14288, stack(0x00000000401c0000,0x00000000402c0000)]
  0x0000000015734800 JavaThread "http-nio-8443-exec-7" daemon [_thread_blocked, id=14312, stack(0x00000000400c0000,0x00000000401c0000)]
  0x0000000020c7b800 JavaThread "http-nio-8443-exec-6" daemon [_thread_blocked, id=9940, stack(0x0000000034800000,0x0000000034900000)]
=>0x0000000020c7a800 JavaThread "http-nio-8443-exec-5" daemon [_thread_in_Java, id=15936, stack(0x0000000034700000,0x0000000034800000)]
  0x0000000020c77000 JavaThread "http-nio-8443-exec-4" daemon [_thread_blocked, id=9044, stack(0x00000000325a0000,0x00000000326a0000)]
  0x0000000020c79000 JavaThread "http-nio-8443-exec-3" daemon [_thread_blocked, id=9004, stack(0x00000000324a0000,0x00000000325a0000)]
  0x0000000020c7a000 JavaThread "http-apr-8080-exec-2" daemon [_thread_blocked, id=9708, stack(0x00000000323a0000,0x00000000324a0000)]
  0x0000000020c78800 JavaThread "http-apr-8080-exec-1" daemon [_thread_blocked, id=12360, stack(0x00000000322a0000,0x00000000323a0000)]
  0x0000000020c75800 JavaThread "http-nio-8443-exec-2" daemon [_thread_blocked, id=16240, stack(0x00000000321a0000,0x00000000322a0000)]
  0x0000000020c6e000 JavaThread "http-nio-8443-exec-1" daemon [_thread_in_native, id=4612, stack(0x0000000031090000,0x0000000031190000)]
  0x0000000020c77800 JavaThread "RMI TCP Connection(10)-127.0.0.1" daemon [_thread_in_native, id=16516, stack(0x0000000024bc0000,0x0000000024cc0000)]
  0x0000000020c72800 JavaThread "RMI TCP Connection(9)-127.0.0.1" daemon [_thread_in_native, id=15652, stack(0x0000000023ab0000,0x0000000023bb0000)]
  0x0000000020c71800 JavaThread "JMX server connection timeout 64" daemon [_thread_blocked, id=17320, stack(0x00000000237a0000,0x00000000238a0000)]
  0x0000000020c73000 JavaThread "QuartzScheduler_project-mogh20131409928260120_MisfireHandler" [_thread_blocked, id=6916, stack(0x0000000022180000,0x0000000022280000)]
  0x0000000020c74800 JavaThread "QuartzScheduler_project-mogh20131409928260120_ClusterManager" [_thread_blocked, id=8652, stack(0x0000000019870000,0x0000000019970000)]
  0x0000000020c6d000 JavaThread "project_QuartzSchedulerThread" [_thread_blocked, id=10948, stack(0x0000000022960000,0x0000000022a60000)]
  0x000000001577d800 JavaThread "project_Worker-10" [_thread_blocked, id=12236, stack(0x00000000230a0000,0x00000000231a0000)]
  0x0000000015740800 JavaThread "project_Worker-9" [_thread_blocked, id=17212, stack(0x0000000022fa0000,0x00000000230a0000)]
  0x0000000015741000 JavaThread "project_Worker-8" [_thread_blocked, id=8900, stack(0x0000000022ea0000,0x0000000022fa0000)]
  0x000000001573f800 JavaThread "project_Worker-7" [_thread_blocked, id=6764, stack(0x0000000022da0000,0x0000000022ea0000)]
  0x000000001573f000 JavaThread "project_Worker-6" [_thread_blocked, id=16480, stack(0x0000000022ca0000,0x0000000022da0000)]
  0x000000001573b000 JavaThread "project_Worker-5" [_thread_blocked, id=5608, stack(0x0000000022ba0000,0x0000000022ca0000)]
  0x000000001573e000 JavaThread "project_Worker-4" [_thread_blocked, id=4876, stack(0x0000000022aa0000,0x0000000022ba0000)]
  0x000000001573a800 JavaThread "project_Worker-3" [_thread_blocked, id=9728, stack(0x000000001f620000,0x000000001f720000)]
  0x000000001573d800 JavaThread "project_Worker-2" [_thread_blocked, id=16828, stack(0x000000001c280000,0x000000001c380000)]
  0x0000000015736800 JavaThread "project_Worker-1" [_thread_blocked, id=5300, stack(0x00000000171a0000,0x00000000172a0000)]
  0x0000000015739000 JavaThread "Abandoned connection cleanup thread" daemon [_thread_blocked, id=7776, stack(0x000000001c7a0000,0x000000001c8a0000)]
  0x0000000015733000 JavaThread "ajp-apr-8009-AsyncTimeout" daemon [_thread_blocked, id=9268, stack(0x0000000017ea0000,0x0000000017fa0000)]
  0x0000000015736000 JavaThread "ajp-apr-8009-Acceptor-0" daemon [_thread_in_native, id=11256, stack(0x0000000017da0000,0x0000000017ea0000)]
  0x0000000015735000 JavaThread "ajp-apr-8009-Poller" daemon [_thread_blocked, id=10424, stack(0x0000000017ca0000,0x0000000017da0000)]
  0x0000000015733800 JavaThread "http-nio-8443-Acceptor-0" daemon [_thread_in_native, id=5456, stack(0x0000000017ba0000,0x0000000017ca0000)]
  0x0000000015732000 JavaThread "http-nio-8443-ClientPoller-1" daemon [_thread_in_native, id=14136, stack(0x0000000017aa0000,0x0000000017ba0000)]
  0x000000001577e800 JavaThread "http-nio-8443-ClientPoller-0" daemon [_thread_in_native, id=12480, stack(0x00000000179a0000,0x0000000017aa0000)]
  0x000000001577d000 JavaThread "http-apr-8080-AsyncTimeout" daemon [_thread_blocked, id=11856, stack(0x00000000178a0000,0x00000000179a0000)]
  0x000000001577c000 JavaThread "http-apr-8080-Acceptor-0" daemon [_thread_in_native, id=8964, stack(0x00000000177a0000,0x00000000178a0000)]
  0x000000001577f000 JavaThread "http-apr-8080-Sendfile" daemon [_thread_blocked, id=16460, stack(0x00000000176a0000,0x00000000177a0000)]
  0x000000001577a800 JavaThread "http-apr-8080-Poller" daemon [_thread_blocked, id=10744, stack(0x00000000175a0000,0x00000000176a0000)]
  0x000000001577b800 JavaThread "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon [_thread_blocked, id=7152, stack(0x00000000172a0000,0x00000000173a0000)]
  0x000000001577a000 JavaThread "NioBlockingSelector.BlockPoller-1" daemon [_thread_in_native, id=8468, stack(0x0000000016e90000,0x0000000016f90000)]
  0x0000000015779000 JavaThread "GC Daemon" daemon [_thread_blocked, id=13268, stack(0x0000000016b90000,0x0000000016c90000)]
  0x0000000014037800 JavaThread "RMI Scheduler(0)" daemon [_thread_blocked, id=9612, stack(0x0000000014ec0000,0x0000000014fc0000)]
  0x0000000014080000 JavaThread "RMI TCP Connection(7)-127.0.0.1" daemon [_thread_blocked, id=13212, stack(0x0000000014dc0000,0x0000000014ec0000)]
  0x0000000013f05000 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=15840, stack(0x00000000147c0000,0x00000000148c0000)]
  0x0000000013ef6800 JavaThread "RMI TCP Accept-1099" daemon [_thread_in_native, id=17360, stack(0x00000000146c0000,0x00000000147c0000)]
  0x0000000013ee7000 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=10352, stack(0x00000000141f0000,0x00000000142f0000)]
  0x0000000013735800 JavaThread "AsyncFileHandlerWriter-529116035" daemon [_thread_blocked, id=6460, stack(0x0000000013cf0000,0x0000000013df0000)]
  0x0000000012c01800 JavaThread "Service Thread" daemon [_thread_blocked, id=17132, stack(0x0000000013bf0000,0x0000000013cf0000)]
  0x00000000135fa800 JavaThread "C1 CompilerThread3" daemon [_thread_blocked, id=9000, stack(0x0000000013af0000,0x0000000013bf0000)]
  0x0000000012c0e000 JavaThread "C2 CompilerThread2" daemon [_thread_in_native, id=13800, stack(0x00000000139f0000,0x0000000013af0000)]
  0x0000000012c0c800 JavaThread "C2 CompilerThread1" daemon [_thread_in_native, id=16304, stack(0x00000000138f0000,0x00000000139f0000)]
  0x0000000012c04000 JavaThread "C2 CompilerThread0" daemon [_thread_in_native, id=14296, stack(0x00000000137f0000,0x00000000138f0000)]
  0x0000000012bf2000 JavaThread "JDWP Command Reader" daemon [_thread_in_native, id=9952, stack(0x00000000134f0000,0x00000000135f0000)]
  0x0000000012bf0800 JavaThread "JDWP Event Helper Thread" daemon [_thread_blocked, id=7664, stack(0x00000000133f0000,0x00000000134f0000)]
  0x0000000012bee000 JavaThread "JDWP Transport Listener: dt_shmem" daemon [_thread_blocked, id=11220, stack(0x00000000132f0000,0x00000000133f0000)]
  0x0000000012be6000 JavaThread "Attach Listener" daemon [_thread_blocked, id=9564, stack(0x00000000131f0000,0x00000000132f0000)]
  0x0000000012be3800 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=16832, stack(0x00000000130f0000,0x00000000131f0000)]
  0x0000000012b9e000 JavaThread "Finalizer" daemon [_thread_blocked, id=13224, stack(0x0000000012ff0000,0x00000000130f0000)]
  0x0000000012b96800 JavaThread "Reference Handler" daemon [_thread_blocked, id=5552, stack(0x0000000012ef0000,0x0000000012ff0000)]
  0x00000000011c0800 JavaThread "main" [_thread_in_native, id=6944, stack(0x0000000002b30000,0x0000000002c30000)]
Other Threads:
  0x0000000012b8c800 VMThread [stack: 0x0000000012c10000,0x0000000012d10000] [id=17252]
  0x0000000013f07800 WatcherThread [stack: 0x00000000148c0000,0x00000000149c0000] [id=7108]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap:
 def new generation   total 471872K, used 141071K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,  32% used [0x00000000c0000000, 0x00000000c84ce280, 0x00000000d99a0000)
  from space 52416K,   9% used [0x00000000d99a0000, 0x00000000d9e95c08, 0x00000000dccd0000)
  to   space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
 tenured generation   total 214896K, used 136736K [0x00000000e0000000, 0x00000000ed1dc000, 0x0000000100000000)
   the space 214896K,  63% used [0x00000000e0000000, 0x00000000e8588098, 0x00000000e8588200, 0x00000000ed1dc000)
 Metaspace       used 128268K, capacity 161214K, committed 165976K, reserved 1187840K
  class space    used 19640K, capacity 24026K, committed 27776K, reserved 1048576K
Card table byte_map: [0x0000000011ff0000,0x0000000012200000] byte_map_base: 0x00000000119f0000
Polling page: 0x0000000001370000
CodeCache: size=245760Kb used=4665Kb max_used=117319Kb free=241094Kb
 bounds [0x0000000002c30000, 0x0000000009f10000, 0x0000000011c30000]
 total_blobs=2120 nmethods=1377 adapters=660
 compilation: enabled
Compilation events (10 events):
Event: 354.311 Thread 0x00000000135fa800 nmethod 26817 0x0000000003b9b110 code [0x0000000003b9b2a0, 0x0000000003b9b4c8]
Event: 354.311 Thread 0x00000000135fa800 26818       2       java.lang.invoke.LambdaForm$MH/902338590::convert (21 bytes)
Event: 354.311 Thread 0x0000000012c0e000 nmethod 26535 0x0000000003b9add0 code [0x0000000003b9af20, 0x0000000003b9aff8]
Event: 354.311 Thread 0x0000000012c0e000 26510       4       java.lang.invoke.LambdaForm$DMH/253601149::invokeStatic_LL_L (15 bytes)
Event: 354.311 Thread 0x00000000135fa800 nmethod 26818 0x0000000003b9a8d0 code [0x0000000003b9aa40, 0x0000000003b9ac28]
Event: 354.311 Thread 0x00000000135fa800 26832       2       java.util.concurrent.locks.ReentrantLock$NonfairSync::lock (25 bytes)
Event: 354.312 Thread 0x00000000135fa800 nmethod 26832 0x0000000003b9a350 code [0x0000000003b9a4e0, 0x0000000003b9a738]
Event: 354.312 Thread 0x00000000135fa800 26819       2       java.lang.invoke.LambdaForm$MH/2135223690::collect (23 bytes)
Event: 354.312 Thread 0x0000000012c0e000 nmethod 26510 0x0000000003b9a050 code [0x0000000003b9a1a0, 0x0000000003b9a248]
Event: 354.312 Thread 0x0000000012c0e000 26536       4       java.lang.invoke.LambdaForm$DMH/1706140841::invokeStatic_LL_I (15 bytes)
GC Heap History (10 events):
Event: 49.624 GC heap before
{Heap before GC invocations=15 (full 6):
 def new generation   total 471872K, used 425106K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K, 100% used [0x00000000c0000000, 0x00000000d99a0000, 0x00000000d99a0000)
  from space 52416K,  10% used [0x00000000d99a0000, 0x00000000d9f24940, 0x00000000dccd0000)
  to   space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
 tenured generation   total 181748K, used 120382K [0x00000000e0000000, 0x00000000eb17d000, 0x0000000100000000)
   the space 181748K,  66% used [0x00000000e0000000, 0x00000000e758fba8, 0x00000000e758fc00, 0x00000000eb17d000)
 Metaspace       used 108674K, capacity 137338K, committed 140376K, reserved 1163264K
  class space    used 18744K, capacity 23267K, committed 26240K, reserved 1048576K
Event: 49.668 GC heap after
Heap after GC invocations=16 (full 6):
 def new generation   total 471872K, used 14474K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,   0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000d99a0000)
  from space 52416K,  27% used [0x00000000dccd0000, 0x00000000ddaf2ab8, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 181748K, used 120382K [0x00000000e0000000, 0x00000000eb17d000, 0x0000000100000000)
   the space 181748K,  66% used [0x00000000e0000000, 0x00000000e758fba8, 0x00000000e758fc00, 0x00000000eb17d000)
 Metaspace       used 108674K, capacity 137338K, committed 140376K, reserved 1163264K
  class space    used 18744K, capacity 23267K, committed 26240K, reserved 1048576K
}
Event: 52.907 GC heap before
{Heap before GC invocations=16 (full 6):
 def new generation   total 471872K, used 117441K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,  24% used [0x00000000c0000000, 0x00000000c648dc18, 0x00000000d99a0000)
  from space 52416K,  27% used [0x00000000dccd0000, 0x00000000ddaf2ab8, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 181748K, used 120382K [0x00000000e0000000, 0x00000000eb17d000, 0x0000000100000000)
   the space 181748K,  66% used [0x00000000e0000000, 0x00000000e758fba8, 0x00000000e758fc00, 0x00000000eb17d000)
 Metaspace       used 111537K, capacity 140190K, committed 143180K, reserved 1165312K
  class space    used 19110K, capacity 23648K, committed 26624K, reserved 1048576K
Event: 53.318 GC heap after
Heap after GC invocations=17 (full 7):
 def new generation   total 471872K, used 0K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,   0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000d99a0000)
  from space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 214896K, used 128937K [0x00000000e0000000, 0x00000000ed1dc000, 0x0000000100000000)
   the space 214896K,  59% used [0x00000000e0000000, 0x00000000e7dea628, 0x00000000e7dea800, 0x00000000ed1dc000)
 Metaspace       used 108917K, capacity 136508K, committed 143180K, reserved 1165312K
  class space    used 17959K, capacity 22145K, committed 26624K, reserved 1048576K
}
Event: 114.349 GC heap before
{Heap before GC invocations=17 (full 7):
 def new generation   total 471872K, used 419456K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K, 100% used [0x00000000c0000000, 0x00000000d99a0000, 0x00000000d99a0000)
  from space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 214896K, used 128937K [0x00000000e0000000, 0x00000000ed1dc000, 0x0000000100000000)
   the space 214896K,  59% used [0x00000000e0000000, 0x00000000e7dea628, 0x00000000e7dea800, 0x00000000ed1dc000)
 Metaspace       used 122225K, capacity 150998K, committed 156632K, reserved 1177600K
  class space    used 19158K, capacity 23414K, committed 27648K, reserved 1048576K
Event: 114.455 GC heap after
Heap after GC invocations=18 (full 7):
 def new generation   total 471872K, used 45346K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,   0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000d99a0000)
  from space 52416K,  86% used [0x00000000d99a0000, 0x00000000dc5e8938, 0x00000000dccd0000)
  to   space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
 tenured generation   total 214896K, used 128937K [0x00000000e0000000, 0x00000000ed1dc000, 0x0000000100000000)
   the space 214896K,  59% used [0x00000000e0000000, 0x00000000e7dea628, 0x00000000e7dea800, 0x00000000ed1dc000)
 Metaspace       used 122225K, capacity 150998K, committed 156632K, reserved 1177600K
  class space    used 19158K, capacity 23414K, committed 27648K, reserved 1048576K
}
Event: 185.376 GC heap before
{Heap before GC invocations=18 (full 7):
 def new generation   total 471872K, used 464802K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K, 100% used [0x00000000c0000000, 0x00000000d99a0000, 0x00000000d99a0000)
  from space 52416K,  86% used [0x00000000d99a0000, 0x00000000dc5e8938, 0x00000000dccd0000)
  to   space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
 tenured generation   total 214896K, used 128937K [0x00000000e0000000, 0x00000000ed1dc000, 0x0000000100000000)
   the space 214896K,  59% used [0x00000000e0000000, 0x00000000e7dea628, 0x00000000e7dea800, 0x00000000ed1dc000)
 Metaspace       used 125333K, capacity 154686K, committed 160088K, reserved 1181696K
  class space    used 19393K, capacity 23700K, committed 27776K, reserved 1048576K
Event: 185.451 GC heap after
Heap after GC invocations=19 (full 7):
 def new generation   total 471872K, used 43519K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,   0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000d99a0000)
  from space 52416K,  83% used [0x00000000dccd0000, 0x00000000df74fc10, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 214896K, used 134084K [0x00000000e0000000, 0x00000000ed1dc000, 0x0000000100000000)
   the space 214896K,  62% used [0x00000000e0000000, 0x00000000e82f1180, 0x00000000e82f1200, 0x00000000ed1dc000)
 Metaspace       used 125333K, capacity 154686K, committed 160088K, reserved 1181696K
  class space    used 19393K, capacity 23700K, committed 27776K, reserved 1048576K
}
Event: 246.435 GC heap before
{Heap before GC invocations=19 (full 7):
 def new generation   total 471872K, used 462975K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K, 100% used [0x00000000c0000000, 0x00000000d99a0000, 0x00000000d99a0000)
  from space 52416K,  83% used [0x00000000dccd0000, 0x00000000df74fc10, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 214896K, used 134084K [0x00000000e0000000, 0x00000000ed1dc000, 0x0000000100000000)
   the space 214896K,  62% used [0x00000000e0000000, 0x00000000e82f1180, 0x00000000e82f1200, 0x00000000ed1dc000)
 Metaspace       used 128011K, capacity 160532K, committed 165208K, reserved 1187840K
  class space    used 19626K, capacity 24007K, committed 27776K, reserved 1048576K
Event: 246.455 GC heap after
Heap after GC invocations=20 (full 7):
 def new generation   total 471872K, used 5079K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,   0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000d99a0000)
  from space 52416K,   9% used [0x00000000d99a0000, 0x00000000d9e95c08, 0x00000000dccd0000)
  to   space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
 tenured generation   total 214896K, used 136736K [0x00000000e0000000, 0x00000000ed1dc000, 0x0000000100000000)
   the space 214896K,  63% used [0x00000000e0000000, 0x00000000e8588098, 0x00000000e8588200, 0x00000000ed1dc000)
 Metaspace       used 128011K, capacity 160532K, committed 165208K, reserved 1187840K
  class space    used 19626K, capacity 24007K, committed 27776K, reserved 1048576K
}
Deoptimization events (10 events):
Event: 238.695 Thread 0x0000000015737800 Uncommon trap: reason=bimorphic action=maybe_recompile pc=0x0000000003bef390 method=org.springframework.core.ResolvableType.variableResolverSourceEquals
(Lorg/springframework/core/ResolvableType$VariableResolver;)Z @ 27
Event: 238.695 Thread 0x0000000015737800 Uncommon trap: reason=bimorphic action=maybe_recompile pc=0x00000000061cc5a0 method=org.springframework.core.ResolvableType.variableResolverSourceEquals
(Lorg/springframework/core/ResolvableType$VariableResolver;)Z @ 27
Event: 238.697 Thread 0x0000000015737800 Uncommon trap: reason=bimorphic action=maybe_recompile pc=0x0000000008fd304c method=java.util.Collections$UnmodifiableList$1.hasNext()Z @ 4
Event: 238.723 Thread 0x0000000020c77000 Uncommon trap: reason=bimorphic action=maybe_recompile pc=0x00000000050a9c30 method=java.util.Collections$UnmodifiableList$1.hasNext()Z @ 4
Event: 238.797 Thread 0x0000000020c77000 Uncommon trap: reason=unloaded action=reinterpret pc=0x0000000009335ed4 method=org.springframework.util.ObjectUtils.nullSafeEquals(Ljava/lang/Object;Ljava/lang/Object;)Z @ 75
Event: 239.192 Thread 0x0000000015734800 Uncommon trap: reason=speculate_class_check action=maybe_recompile pc=0x0000000005f664dc method=jdk.nashorn.internal.runtime.ScriptFunction.isNonStrictFunction
(Ljava/lang/Object;Ljava/lang/Object;Ljdk/nashorn/internal/runtime/ScriptFunctionData;)Z @ 19
Event: 246.184 Thread 0x0000000020c77000 Uncommon trap: reason=unreached action=reinterpret pc=0x00000000090d5d34 method=org.apache.log4j.spi.LoggingEvent.
(Ljava/lang/String;Lorg/apache/log4j/Category;Lorg/apache/log4j/Priority;Ljava/lang/Object;Ljava/lang/Throwable;)V @ 45
Event: 246.632 Thread 0x0000000020c7a800 Uncommon trap: reason=speculate_class_check action=maybe_recompile pc=0x00000000060e8a5c method=jdk.nashorn.internal.runtime.ScriptRuntime.INSTANCEOF
(Ljava/lang/Object;Ljava/lang/Object;)Z @ 8
Event: 263.247 Thread 0x000000002efa2800 Uncommon trap: reason=speculate_class_check action=maybe_recompile pc=0x00000000060e8a5c method=jdk.nashorn.internal.runtime.ScriptRuntime.INSTANCEOF
(Ljava/lang/Object;Ljava/lang/Object;)Z @ 8
Event: 264.669 Thread 0x0000000020c6e000 Uncommon trap: reason=speculate_class_check action=maybe_recompile pc=0x00000000060e8a5c method=jdk.nashorn.internal.runtime.ScriptRuntime.INSTANCEOF
(Ljava/lang/Object;Ljava/lang/Object;)Z @ 8
Internal exceptions (10 events):
Event: 230.191 Thread 0x0000000015737800 Implicit null exception at 0x0000000008beb443 to 0x0000000008beb7b8
Event: 230.191 Thread 0x0000000015737800 Exception  (0x00000000ce6069d8) thrown at [Q:\dcevm\dcevm-master\hotspot\src\share\vm\runtime\sharedRuntime.cpp, line 604]
Event: 230.200 Thread 0x0000000015737800 Implicit null exception at 0x0000000008beb443 to 0x0000000008beb7b8
Event: 230.200 Thread 0x0000000015737800 Exception  (0x00000000d27f5c10) thrown at [Q:\dcevm\dcevm-master\hotspot\src\share\vm\runtime\sharedRuntime.cpp, line 604]
Event: 246.180 Thread 0x0000000020c77000 Exception  (0x00000000d8efb338) thrown at [Q:\dcevm\dcevm-master\hotspot\src\share\vm\runtime\reflection.cpp, line 1085]
Event: 302.702 Thread 0x0000000015737800 Exception  (0x00000000c6c73cd8) thrown at [Q:\dcevm\dcevm-master\hotspot\src\share\vm\prims\jvm.cpp, line 1276]
Event: 302.702 Thread 0x0000000015737800 Exception  (0x00000000c6c74f28) thrown at [Q:\dcevm\dcevm-master\hotspot\src\share\vm\prims\jvm.cpp, line 1276]
Event: 302.703 Thread 0x0000000015737800 Exception  (0x00000000c6c790b0) thrown at [Q:\dcevm\dcevm-master\hotspot\src\share\vm\prims\jvm.cpp, line 1276]
Event: 329.497 Thread 0x0000000015737800 Exception  (0x00000000c6cb04d0) thrown at [Q:\dcevm\dcevm-master\hotspot\src\share\vm\interpreter\linkResolver.cpp, line 1166]
Event: 340.703 Thread 0x0000000015737800 Exception  (0x00000000c6cb1090) thrown at [Q:\dcevm\dcevm-master\hotspot\src\share\vm\runtime\reflection.cpp, line 1085]
Events (10 events):
Event: 354.289 Thread 0x0000000020c6e000 DEOPT PACKING pc=0x00000000030a22bd sp=0x000000003118d2b0
Event: 354.289 Thread 0x0000000020c6e000 DEOPT UNPACKING pc=0x0000000002c775bf sp=0x000000003118d100 mode 0
Event: 354.293 Thread 0x0000000020c6e000 DEOPT PACKING pc=0x0000000002e9680a sp=0x000000003118c2c0
Event: 354.293 Thread 0x0000000020c6e000 DEOPT UNPACKING pc=0x0000000002c775bf sp=0x000000003118c020 mode 0
Event: 354.295 Thread 0x0000000020c6e000 DEOPT PACKING pc=0x00000000030a22bd sp=0x000000003118d2b0
Event: 354.295 Thread 0x0000000020c6e000 DEOPT UNPACKING pc=0x0000000002c775bf sp=0x000000003118d100 mode 0
Event: 354.303 Thread 0x0000000020c6e000 DEOPT PACKING pc=0x00000000030a22bd sp=0x000000003118d2b0
Event: 354.303 Thread 0x0000000020c6e000 DEOPT UNPACKING pc=0x0000000002c775bf sp=0x000000003118d100 mode 0
Event: 354.311 Thread 0x0000000020c6e000 DEOPT PACKING pc=0x00000000030a22bd sp=0x000000003118d2b0
Event: 354.311 Thread 0x0000000020c6e000 DEOPT UNPACKING pc=0x0000000002c775bf sp=0x000000003118d100 mode 0
Dynamic libraries:
0x00007ff67a560000 - 0x00007ff67a594000     C:\Java\jdk1.8.0_20\bin\java.exe
0x00007ffe3fd40000 - 0x00007ffe3feea000     C:\WINDOWS\SYSTEM32\ntdll.dll
0x00007ffe3dfc0000 - 0x00007ffe3e0fa000     C:\WINDOWS\system32\KERNEL32.DLL
0x00007ffe3d180000 - 0x00007ffe3d28f000     C:\WINDOWS\system32\KERNELBASE.dll
0x00007ffe3b440000 - 0x00007ffe3b4c8000     C:\WINDOWS\system32\apphelp.dll
0x00007ffe3baf0000 - 0x00007ffe3bb3f000     C:\WINDOWS\AppPatch\AppPatch64\AcGenral.DLL
0x00007ffe3f9b0000 - 0x00007ffe3fa57000     C:\WINDOWS\system32\msvcrt.dll
0x00007ffe3cef0000 - 0x00007ffe3cf1b000     C:\WINDOWS\SYSTEM32\SspiCli.dll
0x00007ffe3da00000 - 0x00007ffe3da51000     C:\WINDOWS\system32\SHLWAPI.dll
0x00007ffe3de40000 - 0x00007ffe3dfb1000     C:\WINDOWS\system32\USER32.dll
0x00007ffe3dc00000 - 0x00007ffe3dd78000     C:\WINDOWS\system32\ole32.dll
0x00007ffe3e590000 - 0x00007ffe3f9b0000     C:\WINDOWS\system32\SHELL32.dll
0x00007ffe3c6b0000 - 0x00007ffe3c6ce000     C:\WINDOWS\SYSTEM32\USERENV.dll
0x00007ffe3e4e0000 - 0x00007ffe3e585000     C:\WINDOWS\system32\ADVAPI32.dll
0x00007ffe348c0000 - 0x00007ffe348db000     C:\WINDOWS\SYSTEM32\MPR.dll
0x00007ffe3d5c0000 - 0x00007ffe3d6f7000     C:\WINDOWS\system32\RPCRT4.dll
0x00007ffe3fc00000 - 0x00007ffe3fc57000     C:\WINDOWS\SYSTEM32\sechost.dll
0x00007ffe3d7d0000 - 0x00007ffe3d9a6000     C:\WINDOWS\SYSTEM32\combase.dll
0x00007ffe3e100000 - 0x00007ffe3e244000     C:\WINDOWS\system32\GDI32.dll
0x00007ffe3d0b0000 - 0x00007ffe3d0c4000     C:\WINDOWS\SYSTEM32\profapi.dll
0x00007ffe3ba20000 - 0x00007ffe3babf000     C:\WINDOWS\SYSTEM32\SHCORE.dll
0x00007ffe3d9b0000 - 0x00007ffe3d9e4000     C:\WINDOWS\system32\IMM32.DLL
0x00007ffe3dac0000 - 0x00007ffe3dbf9000     C:\WINDOWS\system32\MSCTF.dll
0x00007ffe3b5e0000 - 0x00007ffe3b83a000     C:\WINDOWS\WinSxS\amd64_microsoft.windows.common-controls_6595b64144ccf1df_6.0.9600.17031_none_6242a4b3ecbb55a1\COMCTL32.dll
0x0000000070840000 - 0x0000000070912000     C:\Java\jdk1.8.0_20\jre\bin\msvcr100.dll
0x000000006ec60000 - 0x000000006f433000     C:\Java\jdk1.8.0_20\jre\bin\dcevm\jvm.dll
0x00007ffe35f40000 - 0x00007ffe35f49000     C:\WINDOWS\SYSTEM32\WSOCK32.dll
0x00007ffe3aaf0000 - 0x00007ffe3ab0f000     C:\WINDOWS\SYSTEM32\WINMM.dll
0x00007ffe3d7c0000 - 0x00007ffe3d7c7000     C:\WINDOWS\system32\PSAPI.DLL
0x00007ffe1c800000 - 0x00007ffe1c8d4000     C:\WINDOWS\SYSTEM32\MSVCR110.dll
0x00007ffe3da60000 - 0x00007ffe3dab8000     C:\WINDOWS\system32\WS2_32.dll
0x00007ffe3aab0000 - 0x00007ffe3aada000     C:\WINDOWS\SYSTEM32\WINMMBASE.dll
0x00007ffe3d9f0000 - 0x00007ffe3d9f9000     C:\WINDOWS\system32\NSI.dll
0x00007ffe3d570000 - 0x00007ffe3d5ba000     C:\WINDOWS\SYSTEM32\cfgmgr32.dll
0x00007ffe3bf40000 - 0x00007ffe3bf66000     C:\WINDOWS\SYSTEM32\DEVOBJ.dll
0x000000006ffd0000 - 0x000000006ffdf000     C:\Java\jdk1.8.0_20\jre\bin\verify.dll
0x000000006ffa0000 - 0x000000006ffc8000     C:\Java\jdk1.8.0_20\jre\bin\java.dll
0x0000000070e00000 - 0x0000000070e35000     C:\Java\jdk1.8.0_20\jre\bin\jdwp.dll
0x0000000070df0000 - 0x0000000070df8000     C:\Java\jdk1.8.0_20\jre\bin\npt.dll
0x000000006ff80000 - 0x000000006ff96000     C:\Java\jdk1.8.0_20\jre\bin\zip.dll
0x0000000070de0000 - 0x0000000070deb000     C:\Java\jdk1.8.0_20\jre\bin\dt_shmem.dll
0x0000000070dd0000 - 0x0000000070ddd000     C:\Java\jdk1.8.0_20\jre\bin\management.dll
0x000000006ff60000 - 0x000000006ff7a000     C:\Java\jdk1.8.0_20\jre\bin\net.dll
0x00007ffe3c970000 - 0x00007ffe3c9c8000     C:\WINDOWS\system32\mswsock.dll
0x000000006ff40000 - 0x000000006ff51000     C:\Java\jdk1.8.0_20\jre\bin\nio.dll
0x00007ffe35ee0000 - 0x00007ffe35ef4000     C:\WINDOWS\system32\napinsp.dll
0x00007ffe35ec0000 - 0x00007ffe35ed9000     C:\WINDOWS\system32\pnrpnsp.dll
0x00007ffe38350000 - 0x00007ffe38369000     C:\WINDOWS\system32\NLAapi.dll
0x00007ffe3c770000 - 0x00007ffe3c813000     C:\WINDOWS\SYSTEM32\DNSAPI.dll
0x00007ffe35eb0000 - 0x00007ffe35ebc000     C:\WINDOWS\System32\winrnr.dll
0x00000000711b0000 - 0x00000000711d6000     C:\Program Files\Bonjour\mdnsNSP.dll
0x00007ffe36fe0000 - 0x00007ffe37009000     C:\WINDOWS\SYSTEM32\Iphlpapi.DLL
0x00007ffe36fd0000 - 0x00007ffe36fda000     C:\WINDOWS\SYSTEM32\WINNSI.DLL
0x00007ffe362a0000 - 0x00007ffe362a9000     C:\Windows\System32\rasadhlp.dll
0x00007ffe36790000 - 0x00007ffe367f8000     C:\WINDOWS\System32\fwpuclnt.dll
0x00007ffe3c9d0000 - 0x00007ffe3c9ee000     C:\WINDOWS\SYSTEM32\CRYPTSP.dll
0x00007ffe3c5f0000 - 0x00007ffe3c625000     C:\WINDOWS\system32\rsaenh.dll
0x00007ffe3cc00000 - 0x00007ffe3cc26000     C:\WINDOWS\SYSTEM32\bcrypt.dll
0x00007ffe3cf20000 - 0x00007ffe3cf80000     C:\WINDOWS\system32\bcryptprimitives.dll
0x00007ffe3cf80000 - 0x00007ffe3cf8a000     C:\WINDOWS\SYSTEM32\CRYPTBASE.dll
0x00007ffe366c0000 - 0x00007ffe366d4000     C:\WINDOWS\SYSTEM32\dhcpcsvc6.DLL
0x00007ffe366a0000 - 0x00007ffe366b9000     C:\WINDOWS\SYSTEM32\dhcpcsvc.DLL
0x0000000180000000 - 0x000000018018c000     C:\Java\apache-tomcat-8.0.8\bin\tcnative-1.dll
0x0000000070da0000 - 0x0000000070dc4000     C:\Java\jdk1.8.0_20\jre\bin\sunec.dll
0x0000000070d90000 - 0x0000000070d9b000     C:\Java\jdk1.8.0_20\jre\bin\sunmscapi.dll
0x00007ffe3d2e0000 - 0x00007ffe3d4b7000     C:\WINDOWS\system32\CRYPT32.dll
0x00007ffe3d160000 - 0x00007ffe3d172000     C:\WINDOWS\system32\MSASN1.dll
0x00007ffe37cb0000 - 0x00007ffe37e38000     C:\WINDOWS\SYSTEM32\dbghelp.dll
VM Arguments:
jvm_args: -Xdebug -Xrunjdwp:transport=dt_shmem,address=56507,suspend=y,server=n -Dnet.jawr.debug.on=true -Dclient.code=client -Xmn512m -Xmx1024m -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote= -
Dcom.sun.management.jmxremote.port=1099 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Djava.rmi.server.hostname=127.0.0.1 -
Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.endorsed.dirs=C:\Java\apache-tomcat-8.0.8\endorsed -Dcatalina.base=C:\Users\username\.IntelliJIdea13\system\tomcat\Unnamed_project -
Dcatalina.home=C:\Java\apache-tomcat-8.0.8 -Djava.io.tmpdir=C:\Java\apache-tomcat-8.0.8\temp 
java_command: org.apache.catalina.startup.Bootstrap start
java_class_path (initial): C:\Java\apache-tomcat-8.0.8\bin\bootstrap.jar;C:\Java\apache-tomcat-8.0.8\bin\tomcat-juli.jar
Launcher Type: SUN_STANDARD
Environment Variables:
JAVA_HOME=C:\Java\jdk1.8.0_20
JRE_HOME=C:\Java\jdk1.8.0_20
CLASSPATH=C:\Java\apache-tomcat-8.0.8\bin\bootstrap.jar;C:\Java\apache-tomcat-8.0.8\bin\tomcat-juli.jar
PATH=C:\ProgramData\Oracle\Java\javapath;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem
USERNAME=username
OS=Windows_NT
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 58 Stepping 9, GenuineIntel
---------------  S Y S T E M  ---------------
OS: Windows 8.1 , 64 bit Build 9600 
CPU:total 8 (4 cores per cpu, 2 threads per core) family 6 model 58 stepping 9, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, aes, clmul, erms, ht, tsc, tscinvbit, tscinv
Memory: 4k page, physical 16734380k(9503300k free), swap 19224748k(6277500k free)
vm_info: Dynamic Code Evolution 64-Bit Server VM (25.20-b21-dcevmlight-dev) for windows-amd64 JRE (1.8.0), built on Sep  4 2014 11:48:58 by "xxx" with MS VC++ 11.0 (VS2012)
time: Fri Sep 05 16:49:48 2014
elapsed time: 354 seconds (0d 0h 5m 54s)

@skybber
Copy link
Contributor

skybber commented Sep 6, 2014

Which kind of code change(evolution) did you do? According the tack trace threre is some change in a lambda expression. It can be the root of the problem.

@mbeckh
Copy link
Author

mbeckh commented Sep 8, 2014

The actual change I had made was just a print statement for testing. However, I am not sure, what IntelliJ is recompiling behind the scenes. After the change, regular Java code seems to work just fine and the (changed) code also runs fine. The JVM does not crash until the jawr library tries to use Nashorn scripting code for compiling less files.

By the way: The crash happens with both Oracle JDK and the OpenJDK-based Azul JVM.

@idubrov
Copy link
Contributor

idubrov commented Sep 8, 2014

I think that these crashes are related to invokeDynamic/method handles stuff. Actually, there is MethodHandle::interpreter_entry::_linkToStatic call which might be the cause.

Try adding -XX:+UnlockDiagnosticVMOptions -XX:+VerifyMethodHandles to the JVM arguments to see if DCEVM somehow corrupts method handles.

@mbeckh
Copy link
Author

mbeckh commented Sep 9, 2014

Thanks for looking into this issue. Here's the dump when running with the two options added.

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x0000000000000000, pid=10020, tid=13188
#
# JRE version: Java(TM) SE Runtime Environment (8.0_20-b26) (build 1.8.0_20-b26)
# Java VM: Dynamic Code Evolution 64-Bit Server VM (25.20-b21-dcevmlight-dev mixed mode windows-amd64 compressed oops)
# Problematic frame:
# C  0x0000000000000000
#
# Failed to write core dump. Minidumps are not enabled by default on client versions of Windows
#
# If you would like to submit a bug report, please visit:
#   https://github.com/Guidewire/DCEVM/issues
#
---------------  T H R E A D  ---------------
Current thread (0x0000000015015000):  JavaThread "http-nio-8443-exec-8" daemon [_thread_in_Java, id=13188, stack(0x0000000031400000,0x0000000031500000)]
siginfo: ExceptionCode=0xc0000005, ExceptionInformation=0x0000000000000008 0x0000000000000000
Registers:
RAX=0x00000000ce4bce40, RBX=0x00000000119d0250, RCX=0x0000000002212a80, RDX=0x00000000e5d1f128
RSP=0x00000000314f9280, RBP=0x00000000e016af28, RSI=0x0000000100e67770, RDI=0x000000010000bdf8
R8 =0x0000000000000040, R9 =0x00000000e041ab70, R10=0x0000000100e67770, R11=0x00000000201cceee
R12=0x0000000000000000, R13=0x00000000314f9260, R14=0x00000000314f9328, R15=0x0000000015015000
RIP=0x0000000000000000, EFLAGS=0x0000000000010246
Top of Stack: (sp=0x00000000314f9280)
0x00000000314f9280:   00000000314f9370 000000006ecead75
0x00000000314f9290:   00000000314f9300 0000000002117850
0x00000000314f92a0:   0000000002117850 00000000ce4bce40
0x00000000314f92b0:   00000000e5d1f128 00000000e016af28
0x00000000314f92c0:   00000000314f92c0 0000000021a565fe
0x00000000314f92d0:   00000000314f9328 0000000021a566a8
0x00000000314f92e0:   0000000021702258 0000000021a56610
0x00000000314f92f0:   00000000314f92a8 00000000314f9320
0x00000000314f9300:   00000000314f9370 0000000002117850
0x00000000314f9310:   00000000e016af28 00000000e5d1f128
0x00000000314f9320:   00000000ce4bce40 00000000e5d6faf8
0x00000000314f9330:   00000000314f9330 0000000023f61636
0x00000000314f9340:   00000000314f9398 0000000023f616f0
0x00000000314f9350:   00000000204669a8 0000000023f61658
0x00000000314f9360:   00000000314f9320 00000000314f9388
0x00000000314f9370:   00000000314f93e0 0000000002117acd 
Instructions: (pc=0x0000000000000000)
0xffffffffffffffe0:   
Register to memory mapping:
RAX=
[error occurred during error reporting (printing register info), id 0xc0000005]
Stack: [0x0000000031400000,0x0000000031500000],  sp=0x00000000314f9280,  free space=996k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
---------------  P R O C E S S  ---------------
Java Threads: ( => current thread )
  0x000000001fbba800 JavaThread "http-nio-8443-exec-10" daemon [_thread_blocked, id=16500, stack(0x0000000035420000,0x0000000035520000)]
  0x0000000020dd8000 JavaThread "http-nio-8443-exec-9" daemon [_thread_blocked, id=1268, stack(0x00000000339d0000,0x0000000033ad0000)]
=>0x0000000015015000 JavaThread "http-nio-8443-exec-8" daemon [_thread_in_Java, id=13188, stack(0x0000000031400000,0x0000000031500000)]
  0x0000000015014800 JavaThread "http-nio-8443-exec-7" daemon [_thread_blocked, id=17756, stack(0x00000000317e0000,0x00000000318e0000)]
  0x0000000022845000 JavaThread "http-nio-8443-exec-6" daemon [_thread_blocked, id=17744, stack(0x0000000031300000,0x0000000031400000)]
  0x0000000022848000 JavaThread "http-nio-8443-exec-5" daemon [_thread_blocked, id=5240, stack(0x0000000031200000,0x0000000031300000)]
  0x0000000022844000 JavaThread "http-nio-8443-exec-4" daemon [_thread_in_Java, id=18336, stack(0x000000002ded0000,0x000000002dfd0000)]
  0x0000000022847000 JavaThread "http-nio-8443-exec-3" daemon [_thread_blocked, id=14400, stack(0x000000002bbc0000,0x000000002bcc0000)]
  0x0000000022846800 JavaThread "http-apr-8080-exec-2" daemon [_thread_blocked, id=2856, stack(0x000000002a3c0000,0x000000002a4c0000)]
  0x0000000022845800 JavaThread "http-apr-8080-exec-1" daemon [_thread_blocked, id=7324, stack(0x000000002a1b0000,0x000000002a2b0000)]
  0x0000000022841000 JavaThread "http-nio-8443-exec-2" daemon [_thread_blocked, id=15660, stack(0x0000000023860000,0x0000000023960000)]
  0x0000000022843800 JavaThread "http-nio-8443-exec-1" daemon [_thread_blocked, id=14104, stack(0x0000000017330000,0x0000000017430000)]
  0x0000000022842000 JavaThread "QuartzScheduler_project-mogh20131410249192023_MisfireHandler" [_thread_blocked, id=11648, stack(0x000000002a2c0000,0x000000002a3c0000)]
  0x0000000022842800 JavaThread "QuartzScheduler_project-mogh20131410249192023_ClusterManager" [_thread_blocked, id=14872, stack(0x0000000029020000,0x0000000029120000)]
  0x0000000020dd6800 JavaThread "jscompiler" daemon [_thread_blocked, id=12056, stack(0x000000002a4e0000,0x000000002a6e0000)]
  0x0000000020dd2000 JavaThread "project_QuartzSchedulerThread" [_thread_blocked, id=7904, stack(0x0000000023660000,0x0000000023760000)]
  0x0000000020dcc000 JavaThread "project_Worker-10" [_thread_blocked, id=15932, stack(0x0000000022580000,0x0000000022680000)]
  0x0000000020dcf000 JavaThread "project_Worker-9" [_thread_blocked, id=8468, stack(0x0000000022480000,0x0000000022580000)]
  0x0000000020dcc800 JavaThread "project_Worker-8" [_thread_blocked, id=16560, stack(0x0000000022380000,0x0000000022480000)]
  0x0000000020dcd800 JavaThread "project_Worker-7" [_thread_blocked, id=16136, stack(0x0000000022280000,0x0000000022380000)]
  0x0000000020dce000 JavaThread "project_Worker-6" [_thread_blocked, id=9012, stack(0x0000000022180000,0x0000000022280000)]
  0x0000000020dcb000 JavaThread "project_Worker-5" [_thread_blocked, id=14504, stack(0x0000000022080000,0x0000000022180000)]
  0x0000000014964800 JavaThread "project_Worker-4" [_thread_blocked, id=18032, stack(0x0000000021f80000,0x0000000022080000)]
  0x000000001501d800 JavaThread "project_Worker-3" [_thread_blocked, id=17864, stack(0x0000000021e80000,0x0000000021f80000)]
  0x000000001501e000 JavaThread "project_Worker-2" [_thread_blocked, id=8836, stack(0x00000000204f0000,0x00000000205f0000)]
  0x0000000015019800 JavaThread "project_Worker-1" [_thread_blocked, id=6372, stack(0x000000001e530000,0x000000001e630000)]
  0x000000001501b000 JavaThread "RMI TCP Connection(idle)" daemon [_thread_blocked, id=9708, stack(0x0000000016530000,0x0000000016630000)]
  0x0000000015013000 JavaThread "Abandoned connection cleanup thread" daemon [_thread_blocked, id=17760, stack(0x0000000018e00000,0x0000000018f00000)]
  0x0000000015011800 JavaThread "ajp-apr-8009-AsyncTimeout" daemon [_thread_blocked, id=16884, stack(0x0000000017230000,0x0000000017330000)]
  0x0000000015010800 JavaThread "ajp-apr-8009-Acceptor-0" daemon [_thread_in_native, id=10396, stack(0x0000000017130000,0x0000000017230000)]
  0x0000000015013800 JavaThread "ajp-apr-8009-Poller" daemon [_thread_blocked, id=5272, stack(0x0000000017030000,0x0000000017130000)]
  0x0000000015010000 JavaThread "http-nio-8443-Acceptor-0" daemon [_thread_in_native, id=7148, stack(0x0000000016f30000,0x0000000017030000)]
  0x000000001500f000 JavaThread "http-nio-8443-ClientPoller-1" daemon [_thread_in_native, id=13628, stack(0x0000000016e30000,0x0000000016f30000)]
  0x0000000015012000 JavaThread "http-nio-8443-ClientPoller-0" daemon [_thread_in_native, id=18052, stack(0x0000000016d30000,0x0000000016e30000)]
  0x0000000014965800 JavaThread "http-apr-8080-AsyncTimeout" daemon [_thread_blocked, id=10420, stack(0x0000000016c30000,0x0000000016d30000)]
  0x0000000014967800 JavaThread "http-apr-8080-Acceptor-0" daemon [_thread_in_native, id=7796, stack(0x0000000016b30000,0x0000000016c30000)]
  0x0000000014967000 JavaThread "http-apr-8080-Sendfile" daemon [_thread_blocked, id=9716, stack(0x0000000016a30000,0x0000000016b30000)]
  0x0000000014964000 JavaThread "http-apr-8080-Poller" daemon [_thread_blocked, id=6756, stack(0x0000000016630000,0x0000000016730000)]
  0x0000000014966000 JavaThread "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon [_thread_blocked, id=15724, stack(0x0000000016730000,0x0000000016830000)]
  0x0000000014961800 JavaThread "NioBlockingSelector.BlockPoller-1" daemon [_thread_in_native, id=7520, stack(0x0000000016320000,0x0000000016420000)]
  0x0000000014963000 JavaThread "GC Daemon" daemon [_thread_blocked, id=5384, stack(0x0000000016020000,0x0000000016120000)]
  0x0000000014962800 JavaThread "RMI Scheduler(0)" daemon [_thread_blocked, id=15576, stack(0x0000000015f20000,0x0000000016020000)]
  0x0000000014961000 JavaThread "RMI TCP Connection(idle)" daemon [_thread_blocked, id=9296, stack(0x0000000015c20000,0x0000000015d20000)]
  0x00000000144f0800 JavaThread "RMI TCP Connection(idle)" daemon [_thread_blocked, id=2872, stack(0x0000000015b20000,0x0000000015c20000)]
  0x00000000133e9000 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=8828, stack(0x0000000013c50000,0x0000000013d50000)]
  0x00000000133db000 JavaThread "RMI TCP Accept-1099" daemon [_thread_in_native, id=14276, stack(0x0000000013b50000,0x0000000013c50000)]
  0x00000000133ce800 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=7560, stack(0x00000000136d0000,0x00000000137d0000)]
  0x0000000012c13800 JavaThread "AsyncFileHandlerWriter-529116035" daemon [_thread_blocked, id=10616, stack(0x00000000131d0000,0x00000000132d0000)]
  0x0000000012b68800 JavaThread "Service Thread" daemon [_thread_blocked, id=11000, stack(0x00000000130d0000,0x00000000131d0000)]
  0x00000000120ee000 JavaThread "C1 CompilerThread3" daemon [_thread_in_vm, id=5964, stack(0x0000000012fd0000,0x00000000130d0000)]
  0x00000000120ed000 JavaThread "C2 CompilerThread2" daemon [_thread_in_native, id=12844, stack(0x0000000012ed0000,0x0000000012fd0000)]
  0x0000000012ad0800 JavaThread "C2 CompilerThread1" daemon [_thread_in_native, id=5428, stack(0x0000000012dd0000,0x0000000012ed0000)]
  0x00000000120e3000 JavaThread "C2 CompilerThread0" daemon [_thread_in_native, id=13932, stack(0x0000000012cd0000,0x0000000012dd0000)]
  0x00000000120dc000 JavaThread "JDWP Command Reader" daemon [_thread_in_native, id=16744, stack(0x00000000129d0000,0x0000000012ad0000)]
  0x00000000120cf800 JavaThread "JDWP Event Helper Thread" daemon [_thread_blocked, id=17268, stack(0x00000000128d0000,0x00000000129d0000)]
  0x00000000120cc800 JavaThread "JDWP Transport Listener: dt_shmem" daemon [_thread_blocked, id=10700, stack(0x00000000127d0000,0x00000000128d0000)]
  0x00000000120b9800 JavaThread "Attach Listener" daemon [_thread_blocked, id=14704, stack(0x00000000126d0000,0x00000000127d0000)]
  0x00000000120b7000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=8872, stack(0x00000000125d0000,0x00000000126d0000)]
  0x000000001207d800 JavaThread "Finalizer" daemon [_thread_blocked, id=17584, stack(0x00000000124d0000,0x00000000125d0000)]
  0x0000000012076000 JavaThread "Reference Handler" daemon [_thread_blocked, id=5460, stack(0x00000000123d0000,0x00000000124d0000)]
  0x0000000000710800 JavaThread "main" [_thread_in_native, id=13776, stack(0x0000000002010000,0x0000000002110000)]
Other Threads:
  0x000000001206e800 VMThread [stack: 0x00000000120f0000,0x00000000121f0000] [id=14852]
  0x00000000133ea000 WatcherThread [stack: 0x0000000013d50000,0x0000000013e50000] [id=1480]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread:  ([mutex/lock_event])
[0x000000000070daf0] CodeCache_lock - owner thread: 0x0000000000000000
Heap:
 def new generation   total 471872K, used 239309K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,  57% used [0x00000000c0000000, 0x00000000ce9b3708, 0x00000000d99a0000)
  from space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 214240K, used 128543K [0x00000000e0000000, 0x00000000ed138000, 0x0000000100000000)
   the space 214240K,  59% used [0x00000000e0000000, 0x00000000e7d87c60, 0x00000000e7d87e00, 0x00000000ed138000)
 Metaspace       used 119752K, capacity 147248K, committed 152832K, reserved 1175552K
  class space    used 18852K, capacity 23020K, committed 27136K, reserved 1048576K
Card table byte_map: [0x00000000114d0000,0x00000000116e0000] byte_map_base: 0x0000000010ed0000
Polling page: 0x0000000000980000
CodeCache: size=245760Kb used=98295Kb max_used=98295Kb free=147464Kb
 bounds [0x0000000002110000, 0x0000000008150000, 0x0000000011110000]
 total_blobs=17528 nmethods=16800 adapters=646
 compilation: enabled
Compilation events (10 events):
Event: 84.278 Thread 0x00000000120ee000 nmethod 20822 0x000000000810f210 code [0x000000000810f380, 0x000000000810f548]
Event: 84.278 Thread 0x00000000120e3000 nmethod 20708 0x000000000810d990 code [0x000000000810dae0, 0x000000000810dbb8]
Event: 84.278 Thread 0x00000000120ee000 20914       2       java.lang.invoke.LambdaForm$MH/595377631::convert (29 bytes)
Event: 84.278 Thread 0x00000000120e3000 20698       4       java.lang.invoke.LambdaForm$DMH/26540753::invokeStatic_LL_L (15 bytes)
Event: 84.279 Thread 0x00000000120ee000 nmethod 20914 0x00000000081103d0 code [0x0000000008110560, 0x00000000081107b8]
Event: 84.279 Thread 0x00000000120ee000 20646       2       java.security.Permission:: (10 bytes)
Event: 84.279 Thread 0x00000000120ee000 nmethod 20646 0x000000000810d650 code [0x000000000810d7a0, 0x000000000810d910]
Event: 84.279 Thread 0x00000000120ee000 20740       2       jdk.nashorn.internal.runtime.ScriptObject::hasProperty (35 bytes)
Event: 84.279 Thread 0x00000000120e3000 nmethod 20698 0x00000000081100d0 code [0x0000000008110220, 0x00000000081102c8]
Event: 84.279 Thread 0x00000000120e3000 20696       4       java.lang.invoke.LambdaForm$BMH/353511991::reinvoke (26 bytes)
GC Heap History (10 events):
Event: 32.636 GC heap before
{Heap before GC invocations=12 (full 6):
 def new generation   total 471872K, used 452734K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K, 100% used [0x00000000c0000000, 0x00000000d99a0000, 0x00000000d99a0000)
  from space 52416K,  63% used [0x00000000dccd0000, 0x00000000ded4fa18, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 181056K, used 88572K [0x00000000e0000000, 0x00000000eb0d0000, 0x0000000100000000)
   the space 181056K,  48% used [0x00000000e0000000, 0x00000000e567f368, 0x00000000e567f400, 0x00000000eb0d0000)
 Metaspace       used 83381K, capacity 93098K, committed 100736K, reserved 1132544K
  class space    used 11746K, capacity 14357K, committed 17280K, reserved 1048576K
Event: 32.739 GC heap after
Heap after GC invocations=13 (full 6):
 def new generation   total 471872K, used 27848K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,   0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000d99a0000)
  from space 52416K,  53% used [0x00000000d99a0000, 0x00000000db4d22f0, 0x00000000dccd0000)
  to   space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
 tenured generation   total 181056K, used 112470K [0x00000000e0000000, 0x00000000eb0d0000, 0x0000000100000000)
   the space 181056K,  62% used [0x00000000e0000000, 0x00000000e6dd5888, 0x00000000e6dd5a00, 0x00000000eb0d0000)
 Metaspace       used 83381K, capacity 93098K, committed 100736K, reserved 1132544K
  class space    used 11746K, capacity 14357K, committed 17280K, reserved 1048576K
}
Event: 38.553 GC heap before
{Heap before GC invocations=13 (full 6):
 def new generation   total 471872K, used 447304K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K, 100% used [0x00000000c0000000, 0x00000000d99a0000, 0x00000000d99a0000)
  from space 52416K,  53% used [0x00000000d99a0000, 0x00000000db4d22f0, 0x00000000dccd0000)
  to   space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
 tenured generation   total 181056K, used 112470K [0x00000000e0000000, 0x00000000eb0d0000, 0x0000000100000000)
   the space 181056K,  62% used [0x00000000e0000000, 0x00000000e6dd5888, 0x00000000e6dd5a00, 0x00000000eb0d0000)
 Metaspace       used 99332K, capacity 122768K, committed 125952K, reserved 1150976K
  class space    used 17329K, capacity 21634K, committed 24576K, reserved 1048576K
Event: 38.620 GC heap after
Heap after GC invocations=14 (full 6):
 def new generation   total 471872K, used 9082K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,   0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000d99a0000)
  from space 52416K,  17% used [0x00000000dccd0000, 0x00000000dd5aebd8, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 181056K, used 132832K [0x00000000e0000000, 0x00000000eb0d0000, 0x0000000100000000)
   the space 181056K,  73% used [0x00000000e0000000, 0x00000000e81b8238, 0x00000000e81b8400, 0x00000000eb0d0000)
 Metaspace       used 99332K, capacity 122768K, committed 125952K, reserved 1150976K
  class space    used 17329K, capacity 21634K, committed 24576K, reserved 1048576K
}
Event: 41.292 GC heap before
{Heap before GC invocations=14 (full 6):
 def new generation   total 471872K, used 428538K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K, 100% used [0x00000000c0000000, 0x00000000d99a0000, 0x00000000d99a0000)
  from space 52416K,  17% used [0x00000000dccd0000, 0x00000000dd5aebd8, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 181056K, used 132832K [0x00000000e0000000, 0x00000000eb0d0000, 0x0000000100000000)
   the space 181056K,  73% used [0x00000000e0000000, 0x00000000e81b8238, 0x00000000e81b8400, 0x00000000eb0d0000)
 Metaspace       used 100462K, capacity 125580K, committed 128640K, reserved 1153024K
  class space    used 17580K, capacity 21962K, committed 24960K, reserved 1048576K
Event: 41.322 GC heap after
Heap after GC invocations=15 (full 6):
 def new generation   total 471872K, used 6302K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,   0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000d99a0000)
  from space 52416K,  12% used [0x00000000d99a0000, 0x00000000d9fc78d0, 0x00000000dccd0000)
  to   space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
 tenured generation   total 181056K, used 132832K [0x00000000e0000000, 0x00000000eb0d0000, 0x0000000100000000)
   the space 181056K,  73% used [0x00000000e0000000, 0x00000000e81b8238, 0x00000000e81b8400, 0x00000000eb0d0000)
 Metaspace       used 100462K, capacity 125580K, committed 128640K, reserved 1153024K
  class space    used 17580K, capacity 21962K, committed 24960K, reserved 1048576K
}
Event: 49.014 GC heap before
{Heap before GC invocations=15 (full 6):
 def new generation   total 471872K, used 425758K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K, 100% used [0x00000000c0000000, 0x00000000d99a0000, 0x00000000d99a0000)
  from space 52416K,  12% used [0x00000000d99a0000, 0x00000000d9fc78d0, 0x00000000dccd0000)
  to   space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
 tenured generation   total 181056K, used 132832K [0x00000000e0000000, 0x00000000eb0d0000, 0x0000000100000000)
   the space 181056K,  73% used [0x00000000e0000000, 0x00000000e81b8238, 0x00000000e81b8400, 0x00000000eb0d0000)
 Metaspace       used 108313K, capacity 136270K, committed 139392K, reserved 1163264K
  class space    used 18522K, capacity 22959K, committed 25984K, reserved 1048576K
Event: 49.094 GC heap after
Heap after GC invocations=16 (full 6):
 def new generation   total 471872K, used 24340K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,   0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000d99a0000)
  from space 52416K,  46% used [0x00000000dccd0000, 0x00000000de4951c0, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 181056K, used 132832K [0x00000000e0000000, 0x00000000eb0d0000, 0x0000000100000000)
   the space 181056K,  73% used [0x00000000e0000000, 0x00000000e81b8238, 0x00000000e81b8400, 0x00000000eb0d0000)
 Metaspace       used 108313K, capacity 136270K, committed 139392K, reserved 1163264K
  class space    used 18522K, capacity 22959K, committed 25984K, reserved 1048576K
}
Event: 52.631 GC heap before
{Heap before GC invocations=16 (full 6):
 def new generation   total 471872K, used 227956K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,  48% used [0x00000000c0000000, 0x00000000cc6d80f0, 0x00000000d99a0000)
  from space 52416K,  46% used [0x00000000dccd0000, 0x00000000de4951c0, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 181056K, used 132832K [0x00000000e0000000, 0x00000000eb0d0000, 0x0000000100000000)
   the space 181056K,  73% used [0x00000000e0000000, 0x00000000e81b8238, 0x00000000e81b8400, 0x00000000eb0d0000)
 Metaspace       used 112073K, capacity 140040K, committed 143104K, reserved 1165312K
  class space    used 18871K, capacity 23326K, committed 26368K, reserved 1048576K
Event: 53.100 GC heap after
Heap after GC invocations=17 (full 7):
 def new generation   total 471872K, used 0K [0x00000000c0000000, 0x00000000e0000000, 0x00000000e0000000)
  eden space 419456K,   0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000d99a0000)
  from space 52416K,   0% used [0x00000000dccd0000, 0x00000000dccd0000, 0x00000000e0000000)
  to   space 52416K,   0% used [0x00000000d99a0000, 0x00000000d99a0000, 0x00000000dccd0000)
 tenured generation   total 214240K, used 128543K [0x00000000e0000000, 0x00000000ed138000, 0x0000000100000000)
   the space 214240K,  59% used [0x00000000e0000000, 0x00000000e7d87c60, 0x00000000e7d87e00, 0x00000000ed138000)
 Metaspace       used 109692K, capacity 136548K, committed 143104K, reserved 1165312K
  class space    used 17857K, capacity 22002K, committed 26368K, reserved 1048576K
}
Deoptimization events (10 events):
Event: 62.608 Thread 0x0000000022848000 Uncommon trap: reason=bimorphic action=maybe_recompile pc=0x0000000004540b50 method=java.util.AbstractList.rangeCheckForAdd(I)V @ 6
Event: 62.609 Thread 0x0000000015014800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x0000000004706024 method=java.util.AbstractList.equals(Ljava/lang/Object;)Z @ 8
Event: 62.609 Thread 0x0000000015014800 Uncommon trap: reason=bimorphic action=maybe_recompile pc=0x0000000004540b50 method=java.util.AbstractList.rangeCheckForAdd(I)V @ 6
Event: 62.612 Thread 0x0000000022843800 Uncommon trap: reason=bimorphic action=maybe_recompile pc=0x0000000004540b50 method=java.util.AbstractList.rangeCheckForAdd(I)V @ 6
Event: 62.618 Thread 0x0000000022843800 Uncommon trap: reason=unreached action=reinterpret pc=0x0000000002b2c658 method=java.io.ExpiringCache.put(Ljava/lang/String;Ljava/lang/String;)V @ 29
Event: 62.897 Thread 0x0000000020dd8000 Uncommon trap: reason=speculate_class_check action=maybe_recompile pc=0x0000000006ee3648 method=jdk.nashorn.internal.runtime.linker.NashornGuards.isMap(Ljava/lang/Object;Ljdk/nashorn/internal/runtime/PropertyMap;)Z @ 1
Event: 62.907 Thread 0x0000000020dd8000 Uncommon trap: reason=speculate_class_check action=maybe_recompile pc=0x0000000005e7fa38 method=jdk.nashorn.internal.runtime.JSType.toBoolean(Ljava/lang/Object;)Z @ 25
Event: 62.907 Thread 0x0000000020dd8000 Uncommon trap: reason=speculate_class_check action=maybe_recompile pc=0x0000000005e7fa38 method=jdk.nashorn.internal.runtime.JSType.toBoolean(Ljava/lang/Object;)Z @ 25
Event: 63.031 Thread 0x0000000020dd8000 Uncommon trap: reason=speculate_class_check action=maybe_recompile pc=0x0000000004d832f0 method=jdk.nashorn.internal.runtime.linker.NashornGuards.isMap(Ljava/lang/Object;Ljdk/nashorn/internal/runtime/PropertyMap;)Z @ 1
Event: 63.107 Thread 0x00000000144f0800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x000000000398e410 method=java.io.DataOutputStream.writeInt(I)V @ 12
Internal exceptions (10 events):
Event: 62.322 Thread 0x0000000015015000 Exception  (0x00000000c9fa34a8) thrown at [Q:\dcevm\dcevm-master\hotspot\src\share\vm\prims\jvm.cpp, line 1276]
Event: 62.322 Thread 0x0000000015015000 Exception  (0x00000000c9fa9968) thrown at [Q:\dcevm\dcevm-master\hotspot\src\share\vm\prims\jvm.cpp, line 1276]
Event: 62.322 Thread 0x0000000015015000 Exception  (0x00000000c9faaeb8) thrown at [Q:\dcevm\dcevm-master\hotspot\src\share\vm\prims\jvm.cpp, line 1276]
Event: 62.324 Thread 0x0000000015015000 Exception  (0x00000000c9fb0788) thrown at [Q:\dcevm\dcevm-master\hotspot\src\share\vm\prims\jvm.cpp, line 1276]
Event: 62.324 Thread 0x0000000015015000 Exception  (0x00000000c9fb1bd8) thrown at [Q:\dcevm\dcevm-master\hotspot\src\share\vm\prims\jvm.cpp, line 1276]
Event: 62.324 Thread 0x0000000015015000 Exception  (0x00000000c9fb5628) thrown at [Q:\dcevm\dcevm-master\hotspot\src\share\vm\prims\jvm.cpp, line 1276]
Event: 62.324 Thread 0x0000000015015000 Exception  (0x00000000c9fb5e90) thrown at [Q:\dcevm\dcevm-master\hotspot\src\share\vm\classfile\systemDictionary.cpp, line 192]
Event: 62.428 Thread 0x0000000015015000 Implicit null exception at 0x00000000051fe5b6 to 0x00000000051fe5da
Event: 62.566 Thread 0x0000000015015000 Exception  (0x00000000cb5a9168) thrown at [Q:\dcevm\dcevm-master\hotspot\src\share\vm\prims\jvm.cpp, line 1276]
Event: 62.567 Thread 0x0000000015015000 Exception  (0x00000000cb5aa648) thrown at [Q:\dcevm\dcevm-master\hotspot\src\share\vm\prims\jvm.cpp, line 1276]
Events (10 events):
Event: 84.217 Executing VM operation: RevokeBias
Event: 84.217 Executing VM operation: RevokeBias done
Event: 84.217 Executing VM operation: RevokeBias
Event: 84.217 Executing VM operation: RevokeBias done
Event: 84.219 Executing VM operation: RevokeBias
Event: 84.219 Executing VM operation: RevokeBias done
Event: 84.220 Executing VM operation: RevokeBias
Event: 84.220 Executing VM operation: RevokeBias done
Event: 84.221 Executing VM operation: RevokeBias
Event: 84.221 Executing VM operation: RevokeBias done
Dynamic libraries:
0x00007ff67a560000 - 0x00007ff67a594000     C:\Java\jdk1.8.0_20\bin\java.exe
0x00007ffe3fd40000 - 0x00007ffe3feea000     C:\WINDOWS\SYSTEM32\ntdll.dll
0x00007ffe3dfc0000 - 0x00007ffe3e0fa000     C:\WINDOWS\system32\KERNEL32.DLL
0x00007ffe3d180000 - 0x00007ffe3d28f000     C:\WINDOWS\system32\KERNELBASE.dll
0x00007ffe3b440000 - 0x00007ffe3b4c8000     C:\WINDOWS\system32\apphelp.dll
0x00007ffe3baf0000 - 0x00007ffe3bb3f000     C:\WINDOWS\AppPatch\AppPatch64\AcGenral.DLL
0x00007ffe3f9b0000 - 0x00007ffe3fa57000     C:\WINDOWS\system32\msvcrt.dll
0x00007ffe3cef0000 - 0x00007ffe3cf1b000     C:\WINDOWS\SYSTEM32\SspiCli.dll
0x00007ffe3da00000 - 0x00007ffe3da51000     C:\WINDOWS\system32\SHLWAPI.dll
0x00007ffe3de40000 - 0x00007ffe3dfb1000     C:\WINDOWS\system32\USER32.dll
0x00007ffe3dc00000 - 0x00007ffe3dd78000     C:\WINDOWS\system32\ole32.dll
0x00007ffe3e590000 - 0x00007ffe3f9b0000     C:\WINDOWS\system32\SHELL32.dll
0x00007ffe3c6b0000 - 0x00007ffe3c6ce000     C:\WINDOWS\SYSTEM32\USERENV.dll
0x00007ffe3e4e0000 - 0x00007ffe3e585000     C:\WINDOWS\system32\ADVAPI32.dll
0x00007ffe348c0000 - 0x00007ffe348db000     C:\WINDOWS\SYSTEM32\MPR.dll
0x00007ffe3d5c0000 - 0x00007ffe3d6f7000     C:\WINDOWS\system32\RPCRT4.dll
0x00007ffe3fc00000 - 0x00007ffe3fc57000     C:\WINDOWS\SYSTEM32\sechost.dll
0x00007ffe3d7d0000 - 0x00007ffe3d9a6000     C:\WINDOWS\SYSTEM32\combase.dll
0x00007ffe3e100000 - 0x00007ffe3e244000     C:\WINDOWS\system32\GDI32.dll
0x00007ffe3d0b0000 - 0x00007ffe3d0c4000     C:\WINDOWS\SYSTEM32\profapi.dll
0x00007ffe3ba20000 - 0x00007ffe3babf000     C:\WINDOWS\SYSTEM32\SHCORE.dll
0x00007ffe3d9b0000 - 0x00007ffe3d9e4000     C:\WINDOWS\system32\IMM32.DLL
0x00007ffe3dac0000 - 0x00007ffe3dbf9000     C:\WINDOWS\system32\MSCTF.dll
0x00007ffe3b5e0000 - 0x00007ffe3b83a000     C:\WINDOWS\WinSxS\amd64_microsoft.windows.common-controls_6595b64144ccf1df_6.0.9600.17031_none_6242a4b3ecbb55a1\COMCTL32.dll
0x0000000070840000 - 0x0000000070912000     C:\Java\jdk1.8.0_20\jre\bin\msvcr100.dll
0x000000006ec60000 - 0x000000006f433000     C:\Java\jdk1.8.0_20\jre\bin\dcevm\jvm.dll
0x00007ffe35f40000 - 0x00007ffe35f49000     C:\WINDOWS\SYSTEM32\WSOCK32.dll
0x00007ffe3aaf0000 - 0x00007ffe3ab0f000     C:\WINDOWS\SYSTEM32\WINMM.dll
0x00007ffe3d7c0000 - 0x00007ffe3d7c7000     C:\WINDOWS\system32\PSAPI.DLL
0x00007ffe1c740000 - 0x00007ffe1c814000     C:\WINDOWS\SYSTEM32\MSVCR110.dll
0x00007ffe3da60000 - 0x00007ffe3dab8000     C:\WINDOWS\system32\WS2_32.dll
0x00007ffe3aab0000 - 0x00007ffe3aada000     C:\WINDOWS\SYSTEM32\WINMMBASE.dll
0x00007ffe3d9f0000 - 0x00007ffe3d9f9000     C:\WINDOWS\system32\NSI.dll
0x00007ffe3d570000 - 0x00007ffe3d5ba000     C:\WINDOWS\SYSTEM32\cfgmgr32.dll
0x00007ffe3bf40000 - 0x00007ffe3bf66000     C:\WINDOWS\SYSTEM32\DEVOBJ.dll
0x000000006ffd0000 - 0x000000006ffdf000     C:\Java\jdk1.8.0_20\jre\bin\verify.dll
0x000000006ffa0000 - 0x000000006ffc8000     C:\Java\jdk1.8.0_20\jre\bin\java.dll
0x0000000070e00000 - 0x0000000070e35000     C:\Java\jdk1.8.0_20\jre\bin\jdwp.dll
0x0000000070df0000 - 0x0000000070df8000     C:\Java\jdk1.8.0_20\jre\bin\npt.dll
0x000000006ff80000 - 0x000000006ff96000     C:\Java\jdk1.8.0_20\jre\bin\zip.dll
0x0000000070de0000 - 0x0000000070deb000     C:\Java\jdk1.8.0_20\jre\bin\dt_shmem.dll
0x0000000070dd0000 - 0x0000000070ddd000     C:\Java\jdk1.8.0_20\jre\bin\management.dll
0x000000006ff60000 - 0x000000006ff7a000     C:\Java\jdk1.8.0_20\jre\bin\net.dll
0x00007ffe3c970000 - 0x00007ffe3c9c8000     C:\WINDOWS\system32\mswsock.dll
0x000000006ff40000 - 0x000000006ff51000     C:\Java\jdk1.8.0_20\jre\bin\nio.dll
0x00007ffe35ee0000 - 0x00007ffe35ef4000     C:\WINDOWS\system32\napinsp.dll
0x00007ffe35ec0000 - 0x00007ffe35ed9000     C:\WINDOWS\system32\pnrpnsp.dll
0x00007ffe38350000 - 0x00007ffe38369000     C:\WINDOWS\system32\NLAapi.dll
0x00007ffe3c770000 - 0x00007ffe3c813000     C:\WINDOWS\SYSTEM32\DNSAPI.dll
0x00007ffe35eb0000 - 0x00007ffe35ebc000     C:\WINDOWS\System32\winrnr.dll
0x00000000711b0000 - 0x00000000711d6000     C:\Program Files\Bonjour\mdnsNSP.dll
0x00007ffe36fe0000 - 0x00007ffe37009000     C:\WINDOWS\SYSTEM32\Iphlpapi.DLL
0x00007ffe36fd0000 - 0x00007ffe36fda000     C:\WINDOWS\SYSTEM32\WINNSI.DLL
0x00007ffe362a0000 - 0x00007ffe362a9000     C:\Windows\System32\rasadhlp.dll
0x00007ffe36790000 - 0x00007ffe367f8000     C:\WINDOWS\System32\fwpuclnt.dll
0x00007ffe3c9d0000 - 0x00007ffe3c9ee000     C:\WINDOWS\SYSTEM32\CRYPTSP.dll
0x00007ffe3c5f0000 - 0x00007ffe3c625000     C:\WINDOWS\system32\rsaenh.dll
0x00007ffe3cc00000 - 0x00007ffe3cc26000     C:\WINDOWS\SYSTEM32\bcrypt.dll
0x00007ffe3cf20000 - 0x00007ffe3cf80000     C:\WINDOWS\system32\bcryptprimitives.dll
0x00007ffe3cf80000 - 0x00007ffe3cf8a000     C:\WINDOWS\SYSTEM32\CRYPTBASE.dll
0x00007ffe366c0000 - 0x00007ffe366d4000     C:\WINDOWS\SYSTEM32\dhcpcsvc6.DLL
0x00007ffe366a0000 - 0x00007ffe366b9000     C:\WINDOWS\SYSTEM32\dhcpcsvc.DLL
0x0000000180000000 - 0x000000018018c000     C:\Java\apache-tomcat-8.0.8\bin\tcnative-1.dll
0x0000000070da0000 - 0x0000000070dc4000     C:\Java\jdk1.8.0_20\jre\bin\sunec.dll
0x0000000070d90000 - 0x0000000070d9b000     C:\Java\jdk1.8.0_20\jre\bin\sunmscapi.dll
0x00007ffe3d2e0000 - 0x00007ffe3d4b7000     C:\WINDOWS\system32\CRYPT32.dll
0x00007ffe3d160000 - 0x00007ffe3d172000     C:\WINDOWS\system32\MSASN1.dll
0x00007ffe37cb0000 - 0x00007ffe37e38000     C:\WINDOWS\SYSTEM32\dbghelp.dll
VM Arguments:
jvm_args: -Xdebug -Xrunjdwp:transport=dt_shmem,address=56507,suspend=y,server=n -Dnet.jawr.debug.on=true -Dclient.code=client -Xmn512m -Xmx1024m -Dcom.sun.management.jmxremote -XX:+UnlockDiagnosticVMOptions -XX:+VerifyMethodHandles -Dcom.sun.management.jmxremote= -Dcom.sun.management.jmxremote.port=1099 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Djava.rmi.server.hostname=127.0.0.1 -Djava.util.logging.config.file=C:\Users\username\.IntelliJIdea13\system\tomcat\Unnamed_project\conf\logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.endorsed.dirs=C:\Java\apache-tomcat-8.0.8\endorsed -Dcatalina.base=C:\Users\username\.IntelliJIdea13\system\tomcat\Unnamed_project -Dcatalina.home=C:\Java\apache-tomcat-8.0.8 -Djava.io.tmpdir=C:\Java\apache-tomcat-8.0.8\temp 
java_command: org.apache.catalina.startup.Bootstrap start
java_class_path (initial): C:\Java\apache-tomcat-8.0.8\bin\bootstrap.jar;C:\Java\apache-tomcat-8.0.8\bin\tomcat-juli.jar
Launcher Type: SUN_STANDARD
Environment Variables:
JAVA_HOME=C:\Java\jdk1.8.0_20
JRE_HOME=C:\Java\jdk1.8.0_20
CLASSPATH=C:\Java\apache-tomcat-8.0.8\bin\bootstrap.jar;C:\Java\apache-tomcat-8.0.8\bin\tomcat-juli.jar
PATH=C:\ProgramData\Oracle\Java\javapath;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\
USERNAME=username
OS=Windows_NT
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 58 Stepping 9, GenuineIntel
---------------  S Y S T E M  ---------------
OS: Windows 8.1 , 64 bit Build 9600 
CPU:total 8 (4 cores per cpu, 2 threads per core) family 6 model 58 stepping 9, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, aes, clmul, erms, ht, tsc, tscinvbit, tscinv
Memory: 4k page, physical 16734380k(9546660k free), swap 19224748k(6319620k free)
vm_info: Dynamic Code Evolution 64-Bit Server VM (25.20-b21-dcevmlight-dev) for windows-amd64 JRE (1.8.0), built on Sep  4 2014 11:48:58 by "username" with MS VC++ 11.0 (VS2012)
time: Tue Sep 09 09:54:10 2014
elapsed time: 84 seconds (0d 0h 1m 24s)

@idubrov
Copy link
Contributor

idubrov commented Sep 9, 2014

Hmm, this second report is less useful than the first one. I guess I need to see more of these crashes to figure out what could be the case. Unfortunately, my company delayed transition to Java 8 so don't have much time working on Java 8 stuff.

The current theory is still that something is wrong while transitioning method handles (see jvmtiRedefineClasses2.cpp, search for update_member_name).

@erkieh erkieh mentioned this issue Nov 9, 2014
Closed
@erkieh
Copy link

erkieh commented Nov 18, 2014

Is there a jdk8u20 Windows version available for download somewhere? I was able to compile DCEVM for JDK7, but not for JDK8. I get a ADLC.exe crash during compilation.

The tests in my fork of https://github.com/erkieh/HotswapAgent fail ~90% of the time with a fatal error for JDK8u5 whereas for JDK7 fatal errors are rare. The errors seem similar.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@idubrov @skybber @erkieh @mbeckh