Uploaded image for project: 'JDK'
  1. JDK
  2. JDK-8244709

Apache Tomcat 7.0.78 on build 1.8.0_131 gave Internal Error in jvmtiThreadState

    Details

    • Subcomponent:
    • CPU:
      x86_64
    • OS:
      linux

      Description

      ADDITIONAL SYSTEM INFORMATION :
       
      I get the Tomcat version and Java version as follows:

      $ sudo service tomcat version
      Server version: Apache Tomcat/7.0.78
      Server built: Jun 9 2017 19:56:49 UTC
      Server number: 7.0.78.0
      OS Name: Linux
      OS Version: 2.6.32-358.el6.x86_64
      Architecture: amd64
      JVM Version: 1.8.0_131-debug-b11
      JVM Vendor: Oracle Corporation




      A DESCRIPTION OF THE PROBLEM :
      I was running a Spring Boot java application that I've been developing for a few years, and it gave me the following in catalina.out:


      ERROR MESSAGES/STACK TRACES THAT OCCUR :
      This from catalina.out:

      11884 INFO: http-bio-12380-exec-1 ------------------=--------------------------------------------
      11885 # To suppress the following error report, specify this argument
      11886 # after -XX: or in .hotspotrc: SuppressErrorAt=/jvmtiThreadState.hpp:170
      11887 May 10, 2020 4:59:52 PM org.apache.catalina.filters.RequestDumperFilter doLog
      11888 INFO: http-bio-12380-exec-1 ------------------=--------------------------------------------
      11889 May 10, 2020 4:59:52 PM org.apache.catalina.filters.RequestDumperFilter doLog
      11890 INFO: http-bio-12380-exec-1 authType=null
      11891 May 10, 2020 4:59:52 PM org.apache.catalina.filters.RequestDumperFilter doLog
      11892 INFO: http-bio-12380-exec-1 contentType=application/json; odata.metadata=minimal
      11893 May 10, 2020 4:59:52 PM org.apache.catalina.filters.RequestDumperFilter doLog
      11894 INFO: http-bio-12380-exec-1 header=Set-Cookie=JSESSIONID=99999999999999999999999999999999; Path=/deviceinfo; HttpOnly
      11895 May 10, 2020 4:59:52 PM org.apache.catalina.filters.RequestDumperFilter doLog
      11896 INFO: http-bio-12380-exec-1 header=OData-Version=4.0
      11897 May 10, 2020 4:59:52 PM org.apache.catalina.filters.RequestDumperFilter doLog
      11898 INFO: http-bio-12380-exec-1 header=Content-Type=application/json; odata.metadata=minimal
      11899 May 10, 2020 4:59:52 PM org.apache.catalina.filters.RequestDumperFilter doLog
      11900 INFO: http-bio-12380-exec-1 header=Content-Length=149
      11901 May 10, 2020 4:59:52 PM org.apache.catalina.filters.RequestDumperFilter doLog
      11902 INFO: http-bio-12380-exec-1 header=Date=Sun, 10 May 2020 23:59:52 GMT
      11903 May 10, 2020 4:59:52 PM org.apache.catalina.filters.RequestDumperFilter doLog
      11904 INFO: http-bio-12380-exec-1 remoteUser=null
      11905 May 10, 2020 4:59:52 PM org.apache.catalina.filters.RequestDumperFilter doLog
      11906 INFO: http-bio-12380-exec-1 status=200
      11907 May 10, 2020 4:59:52 PM org.apache.catalina.filters.RequestDumperFilter doLog
      11908 INFO: http-bio-12380-exec-1 END TIME =10-May-2020 16:59:52
      11909 May 10, 2020 4:59:52 PM org.apache.catalina.filters.RequestDumperFilter doLog
      11910 INFO: http-bio-12380-exec-1 ===============================================================
      11911 #
      11912 # A fatal error has been detected by the Java Runtime Environment:
      11913 #
      11914 # Internal Error (/builddir/build/BUILD/java-1.8.0-openjdk-1.8.0.131-0.b11.el6_9.x86_64/openjdk/hotspot/src/share/vm/prims/jvmtiThreadState.hpp:170), pid=15924, tid=0x00007f8ae38fa700
      11915 # assert(_exception_caught == false) failed: _exception_caught is out of phase
      11916 #
      11917 # JRE version: OpenJDK Runtime Environment (8.0_131-b11) (build 1.8.0_131-debug-b11)
      11918 # Java VM: OpenJDK 64-Bit Server VM (25.131-b11-debug mixed mode linux-amd64 compressed oops)
      11919 # Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
      11920 #
      11921 # An error report file with more information is saved as:
      11922 # /tmp/hs_err_pid15924.log
      11923 #
      11924 # If you would like to submit a bug report, please visit:
      11925 # http://bugreport.java.com/bugreport/crash.jsp
      11926 #
      11927 Current thread is 140234500056832
      11928 Dumping core ...
      11929 May 10, 2020 6:03:12 PM org.apache.catalina.startup.Catalina stopServer
      11930 SEVERE: Could not contact localhost:8005. Tomcat may not be running.
      11931 May 10, 2020 6:03:13 PM org.apache.catalina.startup.Catalina stopServer
      11932 SEVERE: Catalina.stop:
      11933 java.net.ConnectException: Connection refused (Connection refused)
      11934 at java.net.PlainSocketImpl.socketConnect(Native Method)
      11935 at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
      11936 at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
      11937 at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
      11938 at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
      11939 at java.net.Socket.connect(Socket.java:589)
      11940 at java.net.Socket.connect(Socket.java:538)
      11941 at java.net.Socket.<init>(Socket.java:434)
      11942 at java.net.Socket.<init>(Socket.java:211)
      11943 at org.apache.catalina.startup.Catalina.stopServer(Catalina.java:499)
      11944 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      11945 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      11946 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      11947 at java.lang.reflect.Method.invoke(Method.java:498)
      11948 at org.apache.catalina.startup.Bootstrap.stopServer(Bootstrap.java:343)
      11949 at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:430)

      This from /tmp/hs_err_pid15924.log :

      #
      # A fatal error has been detected by the Java Runtime Environment:
      #
      # Internal Error (/builddir/build/BUILD/java-1.8.0-openjdk-1.8.0.131-0.b11.el6_9.x86_64/openjdk/hotspot/src/share/vm/prims/jvmtiThreadState.hpp:170), pid=15924, tid=0x00007f8ae38fa700
      # assert(_exception_caught == false) failed: _exception_caught is out of phase
      #
      # JRE version: OpenJDK Runtime Environment (8.0_131-b11) (build 1.8.0_131-debug-b11)
      # Java VM: OpenJDK 64-Bit Server VM (25.131-b11-debug mixed mode linux-amd64 compressed oops)
      # Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
      #
      # If you would like to submit a bug report, please visit:
      # http://bugreport.java.com/bugreport/crash.jsp
      #

      --------------- T H R E A D ---------------

      Current thread (0x00007f8ae9594800): JavaThread "scheduler_Worker-7" [_thread_in_vm, id=16260, stack(0x00007f8ae37fa000,0x00007f8ae38fb000)]

      Stack: [0x00007f8ae37fa000,0x00007f8ae38fb000], sp=0x00007f8ae38f8080, free space=1016k
      Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
      V [libjvm.so+0xcf2dd9]
      V [libjvm.so+0xcf4100]
      V [libjvm.so+0x67dc7d]
      V [libjvm.so+0x994a0d]
      V [libjvm.so+0x993b6d]
      V [libjvm.so+0xbbb7b0]
      V [libjvm.so+0xbbbc06]
      V [libjvm.so+0x91fe30] JVM_InvokeMethod+0x2d0
      C [libjava.so+0x10248] Java_sun_reflect_NativeMethodAccessorImpl_invoke0+0x38
      J 5931 sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (0 bytes) @ 0x00007f8b334a4654 [0x00007f8b334a44e0+0x174]
      J 9814 C1 sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (104 bytes) @ 0x00007f8b34105b7c [0x00007f8b341040c0+0x1abc]
      J 2262 C2 java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (62 bytes) @ 0x00007f8b333ffb28 [0x00007f8b333ff9e0+0x148]
      j com.mysql.jdbc.SQLError.createCommunicationsException(Lcom/mysql/jdbc/ConnectionImpl;JJLjava/lang/Exception;)Ljava/sql/SQLException;+97
      j com.mysql.jdbc.MysqlIO.send(Lcom/mysql/jdbc/Buffer;I)V+330
      J 11820 C2 com.mysql.jdbc.MysqlIO.sendCommand(ILjava/lang/String;Lcom/mysql/jdbc/Buffer;ZLjava/lang/String;)Lcom/mysql/jdbc/Buffer; (399 bytes) @ 0x00007f8b346a9a90 [0x00007f8b346a9900+0x190]
      J 15809 C2 com.mysql.jdbc.MysqlIO.sqlQueryDirect(Lcom/mysql/jdbc/StatementImpl;Ljava/lang/String;Ljava/lang/String;Lcom/mysql/jdbc/Buffer;IIIZLjava/lang/String;[Lcom/mysql/jdbc/Field;)Lcom/mysql/jdbc/ResultSetInternalMethods; (1376 bytes) @ 0x00007f8b35033ee4 [0x00007f8b35033500+0x9e4]
      J 11712 C2 com.mysql.jdbc.ConnectionImpl.execSQL(Lcom/mysql/jdbc/StatementImpl;Ljava/lang/String;ILcom/mysql/jdbc/Buffer;IIZLjava/lang/String;[Lcom/mysql/jdbc/Field;Z)Lcom/mysql/jdbc/ResultSetInternalMethods; (554 bytes) @ 0x00007f8b33ee6a18 [0x00007f8b33ee6620+0x3f8]
      J 12507 C2 com.mysql.jdbc.ConnectionImpl.setAutoCommit(Z)V (221 bytes) @ 0x00007f8b33c083d0 [0x00007f8b33c08120+0x2b0]
      J 17361 C2 org.apache.commons.pool.impl.GenericObjectPool.borrowObject()Ljava/lang/Object; (461 bytes) @ 0x00007f8b35560654 [0x00007f8b35560180+0x4d4]
      J 16963 C2 org.springframework.jdbc.object.StoredProcedure.execute(Ljava/util/Map;)Ljava/util/Map; (32 bytes) @ 0x00007f8b353fe8b0 [0x00007f8b353fbba0+0x2d10]
      J 18061 C2 com.eneura.dim.scheduler.EmailJobWorker.sendPendingEmails()V (203 bytes) @ 0x00007f8b355b1eec [0x00007f8b355b1dc0+0x12c]
      J 18062 C2 sun.reflect.GeneratedMethodAccessor46.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object; (62 bytes) @ 0x00007f8b335efb38 [0x00007f8b335efae0+0x58]
      J 17355 C2 org.quartz.core.JobRunShell.run()V (757 bytes) @ 0x00007f8b35543228 [0x00007f8b35541180+0x20a8]
      J 10658% C2 org.quartz.simpl.SimpleThreadPool$WorkerThread.run()V (325 bytes) @ 0x00007f8b33f9de6c [0x00007f8b33f9dca0+0x1cc]
      v ~StubRoutines::call_stub
      V [libjvm.so+0x88dd02]
      V [libjvm.so+0xb2ac2c]
      V [libjvm.so+0x88d66d]
      V [libjvm.so+0x88cb78]
      V [libjvm.so+0x88cc6b]
      V [libjvm.so+0x9152fe]
      V [libjvm.so+0xc926a2]
      V [libjvm.so+0xc92531]
      V [libjvm.so+0xb212c5]
      C [libpthread.so.0+0x7851]




      STEPS TO FOLLOW TO REPRODUCE THE PROBLEM :
      It has only happened once; it looks like a Java Quartz scheduled operation was running, trying to create an email message from data in our MySQL database.

      ACTUAL -
      The jvm crashed hence this report

      FREQUENCY : rarely


        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              webbuggrp Webbug Group
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: