Details
Description
ADDITIONAL SYSTEM INFORMATION :
FULL PRODUCT VERSION :
# JRE version: Java(TM) SE Runtime Environment (13.0+33) (build 13+33)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (13+33, mixed mode, sharing, tiered, compressed oops, g1 gc, bsd-amd64)
FULL OS VERSION :
Darwin KAJALLA-M-61TS 18.7.0 Darwin Kernel Version 18.7.0: Tue Aug 20 16:57:14 PDT 2019; root:xnu-4903.271.2~2/RELEASE_X86_64 x86_64
A DESCRIPTION OF THE PROBLEM :
JVM crashes with a sample Spring boot application when running on Oracle JDK13 with Appdynamics agent
ERROR MESSAGES/STACK TRACES THAT OCCUR :
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00000001111ab826, pid=37880, tid=25859
#
# JRE version: Java(TM) SE Runtime Environment (13.0+33) (build 13+33)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (13+33, mixed mode, sharing, tiered, compressed oops, g1 gc, bsd-amd64)
# Problematic frame:
# V [libjvm.dylib+0x3ab826] JfrEventClassTransformer::on_klass_creation(InstanceKlass*&, ClassFileParser&, Thread*)+0x3ea
#
# Core dump will be written. Default location: /cores/core.37880
#
# An error report file with more information is saved as:
# /Users/karthik.jalla/Downloads/spring-reactive-sample-master/boot-tomcat/hs_err_pid37880.log
#
# If you would like to submit a bug report, please visit:
# http://bugreport.java.com/bugreport/crash.jsp
#
REGRESSION : Last worked in version 11.0.4
STEPS TO FOLLOW TO REPRODUCE THE PROBLEM :
we can supply a repro on request since it involves our AppDynamics agent
ACTUAL -
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00000001111ab826, pid=37880, tid=25859
#
# JRE version: Java(TM) SE Runtime Environment (13.0+33) (build 13+33)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (13+33, mixed mode, sharing, tiered, compressed oops, g1 gc, bsd-amd64)
# Problematic frame:
# V [libjvm.dylib+0x3ab826] JfrEventClassTransformer::on_klass_creation(InstanceKlass*&, ClassFileParser&, Thread*)+0x3ea
#
# Core dump will be written. Default location: /cores/core.37880
#
# If you would like to submit a bug report, please visit:
# http://bugreport.java.com/bugreport/crash.jsp
#
--------------- S U M M A R Y ------------
Command Line: -Dappdynamics.controller.hostName=ec2-13-232-182-166.ap-south-1.compute.amazonaws.com -Dappdynamics.controller.port=8090 -Dappdynamics.agent.accountAccessKey=d74b917f-0d0b-4121-8dc5-d1851644b73f -Dappdynamics.agent.accountName=customer1 -Dappdynamics.controller.ssl.enabled=false -Dappdynamics.agent.applicationName=TestApp -Dappdynamics.agent.tierName=tier -Dappdynamics.agent.nodeName=node -javaagent:/Users/karthik.jalla/Downloads/AppServerAgent-4.5.15.27926/javaagent.jar target/spring-reactive-sample-boot-tomcat-0.0.1-SNAPSHOT.jar
Host: MacBookPro14,3 x86_64 2900 MHz, 8 cores, 16G, Darwin 18.7.0
Time: Tue Oct 15 15:00:16 2019 IST elapsed time: 9 seconds (0d 0h 0m 9s)
--------------- T H R E A D ---------------
Current thread (0x00007fc2f7d2e800): JavaThread "AD Thread Pool-Global1" daemon [_thread_in_vm, id=25859, stack(0x000070000b882000,0x000070000b982000)]
Stack: [0x000070000b882000,0x000070000b982000], sp=0x000070000b980a10, free space=1018k
Native frames: (J=compiled Java code, A=aot compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.dylib+0x3ab826] JfrEventClassTransformer::on_klass_creation(InstanceKlass*&, ClassFileParser&, Thread*)+0x3ea
V [libjvm.dylib+0x511843] KlassFactory::create_from_stream(ClassFileStream*, Symbol*, ClassLoaderData*, Handle, InstanceKlass const*, GrowableArray<Handle>*, Thread*)+0x1a9
V [libjvm.dylib+0x6fa73e] SystemDictionary::parse_stream(Symbol*, Handle, Handle, ClassFileStream*, InstanceKlass const*, GrowableArray<Handle>*, Thread*)+0xde
V [libjvm.dylib+0x501690] VM_RedefineClasses::load_new_class_versions(Thread*)+0x306
V [libjvm.dylib+0x501242] VM_RedefineClasses::doit_prologue()+0xf0
V [libjvm.dylib+0x789800] VMThread::execute(VM_Operation*)+0x13e
V [libjvm.dylib+0x4e8452] JvmtiEnv::RedefineClasses(int, _jvmtiClassDefinition const*)+0x28
V [libjvm.dylib+0x4b4843] jvmti_RedefineClasses(_jvmtiEnv*, int, _jvmtiClassDefinition const*)+0x10b
C [libinstrument.dylib+0x40e7] redefineClasses+0x440
j sun.instrument.InstrumentationImpl.redefineClasses0(J[Ljava/lang/instrument/ClassDefinition;)V+0 java.instrument@13
j sun.instrument.InstrumentationImpl.redefineClasses([Ljava/lang/instrument/ClassDefinition;)V+73 java.instrument@13
j com.singularity.ee.agent.appagent.services.bciengine.DeferredClassInstrumenter.processApprovedClasses(Ljava/util/List;I)V+76 com.appdynamics.appagent
j com.singularity.ee.agent.appagent.services.bciengine.ADeferredClassRetransformer.transformDeferredClasses(Ljava/util/Collection;)Ljava/util/Collection;+208 com.appdynamics.appagent
j com.singularity.ee.agent.appagent.services.bciengine.asm.DeferredClassBCIHandler.retransformClass(Ljava/util/Collection;)Ljava/util/Collection;+5 com.appdynamics.appagent
j com.singularity.ee.agent.appagent.services.bciengine.asm.DeferredClassBCIHandler.run()V+51 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.AgentScheduledExecutorServiceImpl$SafeRunnable.run()V+52 com.appdynamics.appagent
j java.util.concurrent.Executors$RunnableAdapter.call()Ljava/lang/Object;+4 java.base@13
j com.singularity.ee.util.javaspecific.scheduler.ADFutureTask$Sync.innerRun()V+22 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADFutureTask.run()V+4 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADScheduledThreadPoolExecutor$ADScheduledFutureTask.access$301(Lcom/singularity/ee/util/javaspecific/scheduler/ADScheduledThreadPoolExecutor$ADScheduledFutureTask;)V+1 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADScheduledThreadPoolExecutor$ADScheduledFutureTask.run()V+15 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADThreadPoolExecutor$Worker.runTask(Ljava/lang/Runnable;)V+252 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADThreadPoolExecutor$Worker.run()V+28 com.appdynamics.appagent
j java.lang.Thread.run()V+11 java.base@13
v ~StubRoutines::call_stub
V [libjvm.dylib+0x3992db] JavaCalls::call_helper(JavaValue*, methodHandle const&, JavaCallArguments*, Thread*)+0x285
V [libjvm.dylib+0x3986e5] JavaCalls::call_virtual(JavaValue*, Klass*, Symbol*, Symbol*, JavaCallArguments*, Thread*)+0xe7
V [libjvm.dylib+0x3987a2] JavaCalls::call_virtual(JavaValue*, Handle, Klass*, Symbol*, Symbol*, Thread*)+0x62
V [libjvm.dylib+0x4196e4] thread_entry(JavaThread*, Thread*)+0x78
V [libjvm.dylib+0x730070] JavaThread::thread_main_inner()+0x86
V [libjvm.dylib+0x72feae] JavaThread::run()+0x124
V [libjvm.dylib+0x72dccd] Thread::call_run()+0x71
V [libjvm.dylib+0x626605] thread_native_entry(Thread*)+0x132
C [libsystem_pthread.dylib+0x32eb] _pthread_body+0x7e
C [libsystem_pthread.dylib+0x6249] _pthread_start+0x42
C [libsystem_pthread.dylib+0x240d] thread_start+0xd
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j sun.instrument.InstrumentationImpl.redefineClasses0(J[Ljava/lang/instrument/ClassDefinition;)V+0 java.instrument@13
j sun.instrument.InstrumentationImpl.redefineClasses([Ljava/lang/instrument/ClassDefinition;)V+73 java.instrument@13
j com.singularity.ee.agent.appagent.services.bciengine.DeferredClassInstrumenter.processApprovedClasses(Ljava/util/List;I)V+76 com.appdynamics.appagent
j com.singularity.ee.agent.appagent.services.bciengine.ADeferredClassRetransformer.transformDeferredClasses(Ljava/util/Collection;)Ljava/util/Collection;+208 com.appdynamics.appagent
j com.singularity.ee.agent.appagent.services.bciengine.asm.DeferredClassBCIHandler.retransformClass(Ljava/util/Collection;)Ljava/util/Collection;+5 com.appdynamics.appagent
j com.singularity.ee.agent.appagent.services.bciengine.asm.DeferredClassBCIHandler.run()V+51 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.AgentScheduledExecutorServiceImpl$SafeRunnable.run()V+52 com.appdynamics.appagent
j java.util.concurrent.Executors$RunnableAdapter.call()Ljava/lang/Object;+4 java.base@13
j com.singularity.ee.util.javaspecific.scheduler.ADFutureTask$Sync.innerRun()V+22 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADFutureTask.run()V+4 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADScheduledThreadPoolExecutor$ADScheduledFutureTask.access$301(Lcom/singularity/ee/util/javaspecific/scheduler/ADScheduledThreadPoolExecutor$ADScheduledFutureTask;)V+1 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADScheduledThreadPoolExecutor$ADScheduledFutureTask.run()V+15 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADThreadPoolExecutor$Worker.runTask(Ljava/lang/Runnable;)V+252 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADThreadPoolExecutor$Worker.run()V+28 com.appdynamics.appagent
j java.lang.Thread.run()V+11 java.base@13
v ~StubRoutines::call_stub
FREQUENCY : always
FULL PRODUCT VERSION :
# JRE version: Java(TM) SE Runtime Environment (13.0+33) (build 13+33)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (13+33, mixed mode, sharing, tiered, compressed oops, g1 gc, bsd-amd64)
FULL OS VERSION :
Darwin KAJALLA-M-61TS 18.7.0 Darwin Kernel Version 18.7.0: Tue Aug 20 16:57:14 PDT 2019; root:xnu-4903.271.2~2/RELEASE_X86_64 x86_64
A DESCRIPTION OF THE PROBLEM :
JVM crashes with a sample Spring boot application when running on Oracle JDK13 with Appdynamics agent
ERROR MESSAGES/STACK TRACES THAT OCCUR :
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00000001111ab826, pid=37880, tid=25859
#
# JRE version: Java(TM) SE Runtime Environment (13.0+33) (build 13+33)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (13+33, mixed mode, sharing, tiered, compressed oops, g1 gc, bsd-amd64)
# Problematic frame:
# V [libjvm.dylib+0x3ab826] JfrEventClassTransformer::on_klass_creation(InstanceKlass*&, ClassFileParser&, Thread*)+0x3ea
#
# Core dump will be written. Default location: /cores/core.37880
#
# An error report file with more information is saved as:
# /Users/karthik.jalla/Downloads/spring-reactive-sample-master/boot-tomcat/hs_err_pid37880.log
#
# If you would like to submit a bug report, please visit:
# http://bugreport.java.com/bugreport/crash.jsp
#
REGRESSION : Last worked in version 11.0.4
STEPS TO FOLLOW TO REPRODUCE THE PROBLEM :
we can supply a repro on request since it involves our AppDynamics agent
ACTUAL -
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00000001111ab826, pid=37880, tid=25859
#
# JRE version: Java(TM) SE Runtime Environment (13.0+33) (build 13+33)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (13+33, mixed mode, sharing, tiered, compressed oops, g1 gc, bsd-amd64)
# Problematic frame:
# V [libjvm.dylib+0x3ab826] JfrEventClassTransformer::on_klass_creation(InstanceKlass*&, ClassFileParser&, Thread*)+0x3ea
#
# Core dump will be written. Default location: /cores/core.37880
#
# If you would like to submit a bug report, please visit:
# http://bugreport.java.com/bugreport/crash.jsp
#
--------------- S U M M A R Y ------------
Command Line: -Dappdynamics.controller.hostName=ec2-13-232-182-166.ap-south-1.compute.amazonaws.com -Dappdynamics.controller.port=8090 -Dappdynamics.agent.accountAccessKey=d74b917f-0d0b-4121-8dc5-d1851644b73f -Dappdynamics.agent.accountName=customer1 -Dappdynamics.controller.ssl.enabled=false -Dappdynamics.agent.applicationName=TestApp -Dappdynamics.agent.tierName=tier -Dappdynamics.agent.nodeName=node -javaagent:/Users/karthik.jalla/Downloads/AppServerAgent-4.5.15.27926/javaagent.jar target/spring-reactive-sample-boot-tomcat-0.0.1-SNAPSHOT.jar
Host: MacBookPro14,3 x86_64 2900 MHz, 8 cores, 16G, Darwin 18.7.0
Time: Tue Oct 15 15:00:16 2019 IST elapsed time: 9 seconds (0d 0h 0m 9s)
--------------- T H R E A D ---------------
Current thread (0x00007fc2f7d2e800): JavaThread "AD Thread Pool-Global1" daemon [_thread_in_vm, id=25859, stack(0x000070000b882000,0x000070000b982000)]
Stack: [0x000070000b882000,0x000070000b982000], sp=0x000070000b980a10, free space=1018k
Native frames: (J=compiled Java code, A=aot compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.dylib+0x3ab826] JfrEventClassTransformer::on_klass_creation(InstanceKlass*&, ClassFileParser&, Thread*)+0x3ea
V [libjvm.dylib+0x511843] KlassFactory::create_from_stream(ClassFileStream*, Symbol*, ClassLoaderData*, Handle, InstanceKlass const*, GrowableArray<Handle>*, Thread*)+0x1a9
V [libjvm.dylib+0x6fa73e] SystemDictionary::parse_stream(Symbol*, Handle, Handle, ClassFileStream*, InstanceKlass const*, GrowableArray<Handle>*, Thread*)+0xde
V [libjvm.dylib+0x501690] VM_RedefineClasses::load_new_class_versions(Thread*)+0x306
V [libjvm.dylib+0x501242] VM_RedefineClasses::doit_prologue()+0xf0
V [libjvm.dylib+0x789800] VMThread::execute(VM_Operation*)+0x13e
V [libjvm.dylib+0x4e8452] JvmtiEnv::RedefineClasses(int, _jvmtiClassDefinition const*)+0x28
V [libjvm.dylib+0x4b4843] jvmti_RedefineClasses(_jvmtiEnv*, int, _jvmtiClassDefinition const*)+0x10b
C [libinstrument.dylib+0x40e7] redefineClasses+0x440
j sun.instrument.InstrumentationImpl.redefineClasses0(J[Ljava/lang/instrument/ClassDefinition;)V+0 java.instrument@13
j sun.instrument.InstrumentationImpl.redefineClasses([Ljava/lang/instrument/ClassDefinition;)V+73 java.instrument@13
j com.singularity.ee.agent.appagent.services.bciengine.DeferredClassInstrumenter.processApprovedClasses(Ljava/util/List;I)V+76 com.appdynamics.appagent
j com.singularity.ee.agent.appagent.services.bciengine.ADeferredClassRetransformer.transformDeferredClasses(Ljava/util/Collection;)Ljava/util/Collection;+208 com.appdynamics.appagent
j com.singularity.ee.agent.appagent.services.bciengine.asm.DeferredClassBCIHandler.retransformClass(Ljava/util/Collection;)Ljava/util/Collection;+5 com.appdynamics.appagent
j com.singularity.ee.agent.appagent.services.bciengine.asm.DeferredClassBCIHandler.run()V+51 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.AgentScheduledExecutorServiceImpl$SafeRunnable.run()V+52 com.appdynamics.appagent
j java.util.concurrent.Executors$RunnableAdapter.call()Ljava/lang/Object;+4 java.base@13
j com.singularity.ee.util.javaspecific.scheduler.ADFutureTask$Sync.innerRun()V+22 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADFutureTask.run()V+4 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADScheduledThreadPoolExecutor$ADScheduledFutureTask.access$301(Lcom/singularity/ee/util/javaspecific/scheduler/ADScheduledThreadPoolExecutor$ADScheduledFutureTask;)V+1 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADScheduledThreadPoolExecutor$ADScheduledFutureTask.run()V+15 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADThreadPoolExecutor$Worker.runTask(Ljava/lang/Runnable;)V+252 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADThreadPoolExecutor$Worker.run()V+28 com.appdynamics.appagent
j java.lang.Thread.run()V+11 java.base@13
v ~StubRoutines::call_stub
V [libjvm.dylib+0x3992db] JavaCalls::call_helper(JavaValue*, methodHandle const&, JavaCallArguments*, Thread*)+0x285
V [libjvm.dylib+0x3986e5] JavaCalls::call_virtual(JavaValue*, Klass*, Symbol*, Symbol*, JavaCallArguments*, Thread*)+0xe7
V [libjvm.dylib+0x3987a2] JavaCalls::call_virtual(JavaValue*, Handle, Klass*, Symbol*, Symbol*, Thread*)+0x62
V [libjvm.dylib+0x4196e4] thread_entry(JavaThread*, Thread*)+0x78
V [libjvm.dylib+0x730070] JavaThread::thread_main_inner()+0x86
V [libjvm.dylib+0x72feae] JavaThread::run()+0x124
V [libjvm.dylib+0x72dccd] Thread::call_run()+0x71
V [libjvm.dylib+0x626605] thread_native_entry(Thread*)+0x132
C [libsystem_pthread.dylib+0x32eb] _pthread_body+0x7e
C [libsystem_pthread.dylib+0x6249] _pthread_start+0x42
C [libsystem_pthread.dylib+0x240d] thread_start+0xd
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j sun.instrument.InstrumentationImpl.redefineClasses0(J[Ljava/lang/instrument/ClassDefinition;)V+0 java.instrument@13
j sun.instrument.InstrumentationImpl.redefineClasses([Ljava/lang/instrument/ClassDefinition;)V+73 java.instrument@13
j com.singularity.ee.agent.appagent.services.bciengine.DeferredClassInstrumenter.processApprovedClasses(Ljava/util/List;I)V+76 com.appdynamics.appagent
j com.singularity.ee.agent.appagent.services.bciengine.ADeferredClassRetransformer.transformDeferredClasses(Ljava/util/Collection;)Ljava/util/Collection;+208 com.appdynamics.appagent
j com.singularity.ee.agent.appagent.services.bciengine.asm.DeferredClassBCIHandler.retransformClass(Ljava/util/Collection;)Ljava/util/Collection;+5 com.appdynamics.appagent
j com.singularity.ee.agent.appagent.services.bciengine.asm.DeferredClassBCIHandler.run()V+51 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.AgentScheduledExecutorServiceImpl$SafeRunnable.run()V+52 com.appdynamics.appagent
j java.util.concurrent.Executors$RunnableAdapter.call()Ljava/lang/Object;+4 java.base@13
j com.singularity.ee.util.javaspecific.scheduler.ADFutureTask$Sync.innerRun()V+22 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADFutureTask.run()V+4 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADScheduledThreadPoolExecutor$ADScheduledFutureTask.access$301(Lcom/singularity/ee/util/javaspecific/scheduler/ADScheduledThreadPoolExecutor$ADScheduledFutureTask;)V+1 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADScheduledThreadPoolExecutor$ADScheduledFutureTask.run()V+15 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADThreadPoolExecutor$Worker.runTask(Ljava/lang/Runnable;)V+252 com.appdynamics.appagent
j com.singularity.ee.util.javaspecific.scheduler.ADThreadPoolExecutor$Worker.run()V+28 com.appdynamics.appagent
j java.lang.Thread.run()V+11 java.base@13
v ~StubRoutines::call_stub
FREQUENCY : always
Attachments
Issue Links
- duplicates
-
JDK-8230400 Missing constant pool entry for a method in stacktrace
-
- Resolved
-
-
JDK-8249009 Custom JFR event class transformation not thread safe
-
- Resolved
-
-
JDK-8249009 Custom JFR event class transformation not thread safe
-
- Resolved
-