Uploaded image for project: 'JDK'
  1. JDK
  2. JDK-8256455

Crash with # Problematic frame: # J 3468 c2 com.rsa.jcm.c.ai.update([BII[BI)

    Details

      Description

      ADDITIONAL SYSTEM INFORMATION :
      Linux x64. The exact details are in the logs below.

      A DESCRIPTION OF THE PROBLEM :
      I am running a client-server test where the client creates multiple threads and connects to the server in each thread. About 50% of the time the client process fails with a core dump.

      I don't think it's feasible for you to reproduce this problem, however I'm hoping that an experienced engineer can interpret the supplied logs and identify any obvious issues.

      ERROR MESSAGES/STACK TRACES THAT OCCUR :
      hs_err_pid11750.log:
      #
      # A fatal error has been detected by the Java Runtime Environment:
      #
      # SIGSEGV (0xb) at pc=0x00007f0153d553ec, pid=11750, tid=12293
      #
      # JRE version: Java(TM) SE Runtime Environment (11.0.6+8) (build 11.0.6+8-LTS)
      # Java VM: Java HotSpot(TM) 64-Bit Server VM (11.0.6+8-LTS, mixed mode, tiered, compressed oops, serial gc, linux-amd64)
      # Problematic frame:
      # J 3468 c2 com.rsa.jcm.c.ai.update([BII[BI)I (281 bytes) @ 0x00007f0153d553ec [0x00007f0153d545e0+0x0000000000000e0c]
      #
      # Core dump will be written. Default location: Core dumps may be processed with "/usr/share/apport/apport %p %s %c %d %P %E" (or dumping to /emc/raisoc/core.11750)
      #
      # If you would like to submit a bug report, please visit:
      # http://bugreport.java.com/bugreport/crash.jsp
      #

      --------------- S U M M A R Y ------------

      Command Line: -Xmx1024m com.rsa.test.performance.framework.client.HttpClient -random CTRDRBG -httpport 38888 -httpsport 38889 -server prf-rh7x64-02 -json sunjsse.json -resultDir /tmp/bnebill/client/results

      Host: Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz, 1 cores, 1G, Ubuntu 16.04.7 LTS
      Time: Tue Nov 3 10:30:11 2020 AEST elapsed time: 276 seconds (0d 0h 4m 36s)

      --------------- T H R E A D ---------------

      Current thread (0x00007f01643db000): JavaThread "client-thread-2" [_thread_in_Java, id=12293, stack(0x00007f0148cd2000,0x00007f0148dd3000)]

      Stack: [0x00007f0148cd2000,0x00007f0148dd3000], sp=0x00007f0148dd1380, free space=1020k
      Native frames: (J=compiled Java code, A=aot compiled Java code, j=interpreted, Vv=VM code, C=native code)
      J 3468 c2 com.rsa.jcm.c.ai.update([BII[BI)I (281 bytes) @ 0x00007f0153d553ec [0x00007f0153d545e0+0x0000000000000e0c]
      J 5302 c2 com.rsa.jsse.engine.util.b.a(Ljavax/crypto/Cipher;[BIILjava/nio/ByteBuffer;)V (44 bytes) @ 0x00007f0153f4b114 [0x00007f0153f4b000+0x0000000000000114]
      J 4309 c2 com.rsa.sslj.x.bU.b(Lcom/rsa/sslj/x/ay;[Ljava/nio/ByteBuffer;IILcom/rsa/sslj/x/aC;)I (251 bytes) @ 0x00007f0153e2a458 [0x00007f0153e29960+0x0000000000000af8]
      J 3911 c2 com.rsa.sslj.x.bQ.a(Lcom/rsa/sslj/x/ay;[Ljava/nio/ByteBuffer;IILcom/rsa/sslj/x/aC;)I (435 bytes) @ 0x00007f0153d8e034 [0x00007f0153d8dd80+0x00000000000002b4]
      J 3923 c2 com.rsa.sslj.x.ao.h()V (100 bytes) @ 0x00007f0153dfd0bc [0x00007f0153dfcd60+0x000000000000035c]
      J 5466 c2 com.rsa.sslj.x.ao.a(II)V (134 bytes) @ 0x00007f0153ec9fb4 [0x00007f0153ec9b80+0x0000000000000434]
      J 5480 c2 com.rsa.sslj.x.ag.a()V (148 bytes) @ 0x00007f0153f3d800 [0x00007f0153f3d6a0+0x0000000000000160]
      J 5876 c2 com.rsa.test.performance.framework.client.HttpClientHandler$1.run()V (418 bytes) @ 0x00007f0153fa09a0 [0x00007f0153fa05e0+0x00000000000003c0]
      v ~StubRoutines::call_stub
      V [libjvm.so+0x884d59] JavaCalls::call_helper(JavaValue*, methodHandle const&, JavaCallArguments*, Thread*)+0x3b9
      V [libjvm.so+0x882d0d] JavaCalls::call_virtual(JavaValue*, Handle, Klass*, Symbol*, Symbol*, Thread*)+0x1ed
      V [libjvm.so+0x92d61c] thread_entry(JavaThread*, Thread*)+0x6c
      V [libjvm.so+0xdc63da] JavaThread::thread_main_inner()+0x1fa
      V [libjvm.so+0xdc6741] JavaThread::run()+0x351
      V [libjvm.so+0xdc234a] Thread::call_run()+0x13a
      V [libjvm.so+0xc098fe] thread_native_entry(Thread*)+0xee


      siginfo: si_signo: 11 (SIGSEGV), si_code: 2 (SEGV_ACCERR), si_addr: 0x00000000c0bc0000

      Register to memory mapping:

      RAX=0x00000000c0bbffe0 is an oop: [B
      {0x00000000c0bbffe0} - klass: {type array byte}
       - length: 16
      RBX=0x00000000c0b772e0 is an oop: com.rsa.jcm.c.v
      {0x00000000c0b772e0} - klass: 'com/rsa/jcm/c/v'
      RCX=0x00000000c0bbffe0 is an oop: [B
      {0x00000000c0bbffe0} - klass: {type array byte}
       - length: 16
      RDX=0x0000000000000004 is an unknown value
      RSP=0x00007f0148dd1380 is pointing into the stack for thread: 0x00007f01643db000
      RBP=0x0000000000000010 is an unknown value
      RSI=0x0000000000000004 is an unknown value
      RDI=0x00000000c0b40ec8 is an oop: [B
      {0x00000000c0b40ec8} - klass: {type array byte}
       - length: 20
      R8 =0x00000000ffffff88 is an unallocated location in the heap
      R9 =0x00000000c0bbffa0 is an oop: [B
      {0x00000000c0bbffa0} - klass: {type array byte}
       - length: 16
      R10=0x0000000000000004 is an unknown value
      R11=0x0000000000000009 is an unknown value
      R12=0x0 is NULL
      R13=0x0 is NULL
      R14=0x00000000c0bbff78 is an oop: com.rsa.jcm.c.bg
      {0x00000000c0bbff78} - klass: 'com/rsa/jcm/c/bg'
      R15=0x00007f01643db000 is a thread


      Registers:
      RAX=0x00000000c0bbffe0, RBX=0x00000000c0b772e0, RCX=0x00000000c0bbffe0, RDX=0x0000000000000004
      RSP=0x00007f0148dd1380, RBP=0x0000000000000010, RSI=0x0000000000000004, RDI=0x00000000c0b40ec8
      R8 =0x00000000ffffff88, R9 =0x00000000c0bbffa0, R10=0x0000000000000004, R11=0x0000000000000009
      R12=0x0000000000000000, R13=0x0000000000000000, R14=0x00000000c0bbff78, R15=0x00007f01643db000
      RIP=0x00007f0153d553ec, EFLAGS=0x0000000000010293, CSGSFS=0x0000000000000033, ERR=0x0000000000000004
        TRAPNO=0x000000000000000e

      Top of Stack: (sp=0x00007f0148dd1380)
      0x00007f0148dd1380: 0000000e00000014 00000000c0027d80
      0x00007f0148dd1390: 0000001400000000 00007f0153c7ad8c
      0x00007f0148dd13a0: 00000000d635a2f8 00000000d635a268
      0x00007f0148dd13b0: 0000008000000015 0000000000000040

      Instructions: (pc=0x00007f0153d553ec)
      0x00007f0153d553cc: f2 7c e3 44 8b dd 41 83 c3 f9 41 3b f3 0f 8d 6b
      0x00007f0153d553dc: 0d 00 00 90 4c 63 d6 c4 81 79 6e 5c 11 10 8b c8
      0x00007f0153d553ec: c4 a1 61 ef 5c 10 10 c4 a1 79 7e 5c 10 10 c4 81
      0x00007f0153d553fc: 79 6e 5c 11 14 c4 a1 61 ef 5c 10 14 c4 a1 79 7e

      Stack slot to memory mapping:
      stack at sp + 0 slots: 0x0000000e00000014 is an unknown value
      stack at sp + 1 slots: 0x00000000c0027d80 is an oop: [B
      {0x00000000c0027d80} - klass: {type array byte}
       - length: 20
      stack at sp + 2 slots: 0x0000001400000000 is an unknown value
      stack at sp + 3 slots: 0x00007f0153c7ad8c is at entry_point+332 in (nmethod*)0x00007f0153c7aa90
      stack at sp + 4 slots: 0x00000000d635a2f8 is an oop: com.rsa.jcm.c.ch
      {0x00000000d635a2f8} - klass: 'com/rsa/jcm/c/ch'
      stack at sp + 5 slots: 0x00000000d635a268 is an oop: [B
      {0x00000000d635a268} - klass: {type array byte}
       - length: 128
      stack at sp + 6 slots: 0x0000008000000015 is an unknown value
      stack at sp + 7 slots: 0x0000000000000040 is an unknown value



      --------------- P R O C E S S ---------------

      Threads class SMR info:
      _java_thread_list=0x00007f01643c39f0, length=20, elements={
      0x00007f0164015000, 0x00007f01640ff800, 0x00007f0164103800, 0x00007f0164116000,
      0x00007f0164118000, 0x00007f016411a000, 0x00007f016411c000, 0x00007f016417c000,
      0x00007f016418d800, 0x00007f01643bb000, 0x00007f01643b9800, 0x00007f01643b1000,
      0x00007f01643db000, 0x00007f01643bd000, 0x00007f016436b000, 0x00007f01643bf000,
      0x00007f01643c9000, 0x00007f0164391800, 0x00007f016432d800, 0x00007f01643b2000
      }

      Java Threads: ( => current thread )
        0x00007f0164015000 JavaThread "main" [_thread_blocked, id=11751, stack(0x00007f016ab88000,0x00007f016ac89000)]
        0x00007f01640ff800 JavaThread "Reference Handler" daemon [_thread_blocked, id=11753, stack(0x00007f014b256000,0x00007f014b357000)]
        0x00007f0164103800 JavaThread "Finalizer" daemon [_thread_blocked, id=11754, stack(0x00007f014b155000,0x00007f014b256000)]
        0x00007f0164116000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=11755, stack(0x00007f014ad33000,0x00007f014ae34000)]
        0x00007f0164118000 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=11756, stack(0x00007f014ac32000,0x00007f014ad33000)]
        0x00007f016411a000 JavaThread "C1 CompilerThread0" daemon [_thread_blocked, id=11757, stack(0x00007f014ab31000,0x00007f014ac32000)]
        0x00007f016411c000 JavaThread "Sweeper thread" daemon [_thread_blocked, id=11758, stack(0x00007f014aa30000,0x00007f014ab31000)]
        0x00007f016417c000 JavaThread "Service Thread" daemon [_thread_blocked, id=11759, stack(0x00007f014a92f000,0x00007f014aa30000)]
        0x00007f016418d800 JavaThread "Common-Cleaner" daemon [_thread_blocked, id=11761, stack(0x00007f014a72d000,0x00007f014a82e000)]
        0x00007f01643bb000 JavaThread "Keep-Alive-Timer" daemon [_thread_blocked, id=12290, stack(0x00007f01493d9000,0x00007f01494da000)]
        0x00007f01643b9800 JavaThread "client-thread-0" [_thread_blocked, id=12291, stack(0x00007f01494da000,0x00007f01495db000)]
        0x00007f01643b1000 JavaThread "client-thread-1" [_thread_in_Java, id=12292, stack(0x00007f01491d7000,0x00007f01492d8000)]
      =>0x00007f01643db000 JavaThread "client-thread-2" [_thread_in_Java, id=12293, stack(0x00007f0148cd2000,0x00007f0148dd3000)]
        0x00007f01643bd000 JavaThread "client-thread-3" [_thread_in_vm, id=12294, stack(0x00007f0148fd5000,0x00007f01490d6000)]
        0x00007f016436b000 JavaThread "client-thread-4" [_thread_blocked, id=12295, stack(0x00007f0148dd3000,0x00007f0148ed4000)]
        0x00007f01643bf000 JavaThread "client-thread-5" [_thread_blocked, id=12296, stack(0x00007f0148ed4000,0x00007f0148fd5000)]
        0x00007f01643c9000 JavaThread "client-thread-6" [_thread_in_Java, id=12297, stack(0x00007f01495db000,0x00007f01496dc000)]
        0x00007f0164391800 JavaThread "client-thread-7" [_thread_blocked, id=12298, stack(0x00007f01490d6000,0x00007f01491d7000)]
        0x00007f016432d800 JavaThread "client-thread-8" [_thread_blocked, id=12299, stack(0x00007f01492d8000,0x00007f01493d9000)]
        0x00007f01643b2000 JavaThread "client-thread-9" [_thread_blocked, id=12300, stack(0x00007f0148bd1000,0x00007f0148cd2000)]

      Other Threads:
        0x00007f01640f7000 VMThread "VM Thread" [stack: 0x00007f014b358000,0x00007f014b458000] [id=11752] _threads_hazard_ptr=0x00007f01643c39f0
        0x00007f0164184800 WatcherThread [stack: 0x00007f014a82f000,0x00007f014a92f000] [id=11760]

      Threads with active compile tasks:
      C2 CompilerThread06836 4 java.security.Signature::initVerify (63 bytes)

      VM state:synchronizing (normal execution)

      VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
      [0x00007f016400cdd0] Safepoint_lock - owner thread: 0x00007f01640f7000
      [0x00007f016400ce60] Threads_lock - owner thread: 0x00007f01640f7000
      [0x00007f016400d5b0] Heap_lock - owner thread: 0x00007f01643bd000

      Heap address: 0x00000000c0000000, size: 1024 MB, Compressed Oops mode: 32-bit
      Narrow klass base: 0x0000000000000000, Narrow klass shift: 3
      Compressed class space size: 1073741824 Address: 0x0000000100000000

      Heap:
       def new generation total 10880K, used 10880K [0x00000000c0000000, 0x00000000c0bc0000, 0x00000000d5550000)
        eden space 9728K, 100% used [0x00000000c0000000, 0x00000000c0980000, 0x00000000c0980000)
        from space 1152K, 100% used [0x00000000c0aa0000, 0x00000000c0bc0000, 0x00000000c0bc0000)
        to space 1152K, 0% used [0x00000000c0980000, 0x00000000c0980000, 0x00000000c0aa0000)
       tenured generation total 23928K, used 14717K [0x00000000d5550000, 0x00000000d6cae000, 0x0000000100000000)
         the space 23928K, 61% used [0x00000000d5550000, 0x00000000d63af618, 0x00000000d63af800, 0x00000000d6cae000)
       Metaspace used 20676K, capacity 20938K, committed 21376K, reserved 1069056K
        class space used 2030K, capacity 2144K, committed 2176K, reserved 1048576K

      Card table byte_map: [0x00007f014bdae000,0x00007f014bfaf000] _byte_map_base: 0x00007f014b7ae000

      Polling page: 0x00007f016aca7000

      Metaspace:

      Usage:
        Non-class: 18.35 MB capacity, 18.21 MB (>99%) used, 124.64 KB ( <1%) free+waste, 23.56 KB ( <1%) overhead.
            Class: 2.09 MB capacity, 1.98 MB ( 95%) used, 104.70 KB ( 5%) free+waste, 8.56 KB ( <1%) overhead.
             Both: 20.45 MB capacity, 20.19 MB ( 99%) used, 229.34 KB ( 1%) free+waste, 32.12 KB ( <1%) overhead.

      Virtual space:
        Non-class space: 20.00 MB reserved, 18.75 MB ( 94%) committed
            Class space: 1.00 GB reserved, 2.12 MB ( <1%) committed
                   Both: 1.02 GB reserved, 20.88 MB ( 2%) committed

      Chunk freelists:
         Non-Class: 37.25 KB
             Class: 0 bytes
              Both: 37.25 KB

      CodeHeap 'non-profiled nmethods': size=120036Kb used=5294Kb max_used=5294Kb free=114741Kb
       bounds [0x00007f0153c4c000, 0x00007f015417c000, 0x00007f015b185000]
      CodeHeap 'profiled nmethods': size=120032Kb used=6998Kb max_used=7858Kb free=113033Kb
       bounds [0x00007f014c714000, 0x00007f014cef4000, 0x00007f0153c4c000]
      CodeHeap 'non-nmethods': size=5692Kb used=1106Kb max_used=1153Kb free=4585Kb
       bounds [0x00007f014c185000, 0x00007f014c3f5000, 0x00007f014c714000]
       total_blobs=9367 nmethods=4220 adapters=357
       compilation: enabled
                    stopped_count=0, restarted_count=0
       full_count=0

      Compilation events (10 events):
      Event: 275.775 Thread 0x00007f016411a000 nmethod 6835 0x00007f014c7d1690 code [0x00007f014c7d1860, 0x00007f014c7d1bc8]
      Event: 275.799 Thread 0x00007f0164118000 6836 4 java.security.Signature::initVerify (63 bytes)
      Event: 275.924 Thread 0x00007f016411a000 6838 2 com.rsa.sslj.x.eW::b (19 bytes)
      Event: 275.924 Thread 0x00007f016411a000 nmethod 6838 0x00007f014c73d290 code [0x00007f014c73d440, 0x00007f014c73d628]
      Event: 275.928 Thread 0x00007f016411a000 6839 ! 3 com.rsa.cryptoj.e.kz::generateKeyPair (90 bytes)
      Event: 275.929 Thread 0x00007f016411a000 nmethod 6839 0x00007f014caa5010 code [0x00007f014caa52e0, 0x00007f014caa6048]
      Event: 275.936 Thread 0x00007f016411a000 6840 ! 2 com.rsa.sslj.x.cx::a (125 bytes)
      Event: 275.937 Thread 0x00007f016411a000 nmethod 6840 0x00007f014cace290 code [0x00007f014cace540, 0x00007f014caced18]
      Event: 276.040 Thread 0x00007f016411a000 6842 3 com.rsa.jcm.c.jl::i (108 bytes)
      Event: 276.041 Thread 0x00007f016411a000 nmethod 6842 0x00007f014c82be90 code [0x00007f014c82c080, 0x00007f014c82c4d8]

      GC Heap History (10 events):
      Event: 275.888 GC heap before
      {Heap before GC invocations=8910 (full 288):
       def new generation total 10880K, used 10867K [0x00000000c0000000, 0x00000000c0bc0000, 0x00000000d5550000)
        eden space 9728K, 99% used [0x00000000c0000000, 0x00000000c097cef0, 0x00000000c0980000)
        from space 1152K, 99% used [0x00000000c0980000, 0x00000000c0a9fff8, 0x00000000c0aa0000)
        to space 1152K, 0% used [0x00000000c0aa0000, 0x00000000c0aa0000, 0x00000000c0bc0000)
       tenured generation total 23928K, used 22375K [0x00000000d5550000, 0x00000000d6cae000, 0x0000000100000000)
         the space 23928K, 93% used [0x00000000d5550000, 0x00000000d6b29f20, 0x00000000d6b2a000, 0x00000000d6cae000)
       Metaspace used 20676K, capacity 20938K, committed 21376K, reserved 1069056K
        class space used 2030K, capacity 2144K, committed 2176K, reserved 1048576K
      }
      Event: 275.890 GC heap after
      {Heap after GC invocations=8911 (full 288):
       def new generation total 10880K, used 1152K [0x00000000c0000000, 0x00000000c0bc0000, 0x00000000d5550000)
        eden space 9728K, 0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000c0980000)
        from space 1152K, 100% used [0x00000000c0aa0000, 0x00000000c0bc0000, 0x00000000c0bc0000)
        to space 1152K, 0% used [0x00000000c0980000, 0x00000000c0980000, 0x00000000c0aa0000)
       tenured generation total 23928K, used 23310K [0x00000000d5550000, 0x00000000d6cae000, 0x0000000100000000)
         the space 23928K, 97% used [0x00000000d5550000, 0x00000000d6c13830, 0x00000000d6c13a00, 0x00000000d6cae000)
       Metaspace used 20676K, capacity 20938K, committed 21376K, reserved 1069056K
        class space used 2030K, capacity 2144K, committed 2176K, reserved 1048576K
      }
      Event: 275.978 GC heap before
      {Heap before GC invocations=8911 (full 288):
       def new generation total 10880K, used 10874K [0x00000000c0000000, 0x00000000c0bc0000, 0x00000000d5550000)
        eden space 9728K, 99% used [0x00000000c0000000, 0x00000000c097e918, 0x00000000c0980000)
        from space 1152K, 100% used [0x00000000c0aa0000, 0x00000000c0bc0000, 0x00000000c0bc0000)
        to space 1152K, 0% used [0x00000000c0980000, 0x00000000c0980000, 0x00000000c0aa0000)
       tenured generation total 23928K, used 23310K [0x00000000d5550000, 0x00000000d6cae000, 0x0000000100000000)
         the space 23928K, 97% used [0x00000000d5550000, 0x00000000d6c13830, 0x00000000d6c13a00, 0x00000000d6cae000)
       Metaspace used 20676K, capacity 20938K, committed 21376K, reserved 1069056K
        class space used 2030K, capacity 2144K, committed 2176K, reserved 1048576K
      }
      Event: 275.979 GC heap after
      {Heap after GC invocations=8912 (full 288):
       def new generation total 10880K, used 831K [0x00000000c0000000, 0x00000000c0bc0000, 0x00000000d5550000)
        eden space 9728K, 0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000c0980000)
        from space 1152K, 72% used [0x00000000c0980000, 0x00000000c0a4fd48, 0x00000000c0aa0000)
        to space 1152K, 0% used [0x00000000c0aa0000, 0x00000000c0aa0000, 0x00000000c0bc0000)
       tenured generation total 23928K, used 23311K [0x00000000d5550000, 0x00000000d6cae000, 0x0000000100000000)
         the space 23928K, 97% used [0x00000000d5550000, 0x00000000d6c13dc0, 0x00000000d6c13e00, 0x00000000d6cae000)
       Metaspace used 20676K, capacity 20938K, committed 21376K, reserved 1069056K
        class space used 2030K, capacity 2144K, committed 2176K, reserved 1048576K
      }
      Event: 276.050 GC heap before
      {Heap before GC invocations=8912 (full 288):
       def new generation total 10880K, used 10559K [0x00000000c0000000, 0x00000000c0bc0000, 0x00000000d5550000)
        eden space 9728K, 100% used [0x00000000c0000000, 0x00000000c0980000, 0x00000000c0980000)
        from space 1152K, 72% used [0x00000000c0980000, 0x00000000c0a4fd48, 0x00000000c0aa0000)
        to space 1152K, 0% used [0x00000000c0aa0000, 0x00000000c0aa0000, 0x00000000c0bc0000)
       tenured generation total 23928K, used 23311K [0x00000000d5550000, 0x00000000d6cae000, 0x0000000100000000)
         the space 23928K, 97% used [0x00000000d5550000, 0x00000000d6c13dc0, 0x00000000d6c13e00, 0x00000000d6cae000)
       Metaspace used 20676K, capacity 20938K, committed 21376K, reserved 1069056K
        class space used 2030K, capacity 2144K, committed 2176K, reserved 1048576K
      }
      Event: 276.080 GC heap after
      {Heap after GC invocations=8913 (full 289):
       def new generation total 10880K, used 0K [0x00000000c0000000, 0x00000000c0bc0000, 0x00000000d5550000)
        eden space 9728K, 0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000c0980000)
        from space 1152K, 0% used [0x00000000c0aa0000, 0x00000000c0aa0000, 0x00000000c0bc0000)
        to space 1152K, 0% used [0x00000000c0980000, 0x00000000c0980000, 0x00000000c0aa0000)
       tenured generation total 23928K, used 12491K [0x00000000d5550000, 0x00000000d6cae000, 0x0000000100000000)
         the space 23928K, 52% used [0x00000000d5550000, 0x00000000d6182c80, 0x00000000d6182e00, 0x00000000d6cae000)
       Metaspace used 20676K, capacity 20938K, committed 21376K, reserved 1069056K
        class space used 2030K, capacity 2144K, committed 2176K, reserved 1048576K
      }
      Event: 276.166 GC heap before
      {Heap before GC invocations=8913 (full 289):
       def new generation total 10880K, used 9727K [0x00000000c0000000, 0x00000000c0bc0000, 0x00000000d5550000)
        eden space 9728K, 99% used [0x00000000c0000000, 0x00000000c097ff88, 0x00000000c0980000)
        from space 1152K, 0% used [0x00000000c0aa0000, 0x00000000c0aa0000, 0x00000000c0bc0000)
        to space 1152K, 0% used [0x00000000c0980000, 0x00000000c0980000, 0x00000000c0aa0000)
       tenured generation total 23928K, used 12491K [0x00000000d5550000, 0x00000000d6cae000, 0x0000000100000000)
         the space 23928K, 52% used [0x00000000d5550000, 0x00000000d6182c80, 0x00000000d6182e00, 0x00000000d6cae000)
       Metaspace used 20676K, capacity 20938K, committed 21376K, reserved 1069056K
        class space used 2030K, capacity 2144K, committed 2176K, reserved 1048576K
      }
      Event: 276.167 GC heap after
      {Heap after GC invocations=8914 (full 289):
       def new generation total 10880K, used 1152K [0x00000000c0000000, 0x00000000c0bc0000, 0x00000000d5550000)
        eden space 9728K, 0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000c0980000)
        from space 1152K, 100% used [0x00000000c0980000, 0x00000000c0aa0000, 0x00000000c0aa0000)
        to space 1152K, 0% used [0x00000000c0aa0000, 0x00000000c0aa0000, 0x00000000c0bc0000)
       tenured generation total 23928K, used 14290K [0x00000000d5550000, 0x00000000d6cae000, 0x0000000100000000)
         the space 23928K, 59% used [0x00000000d5550000, 0x00000000d6344a90, 0x00000000d6344c00, 0x00000000d6cae000)
       Metaspace used 20676K, capacity 20938K, committed 21376K, reserved 1069056K
        class space used 2030K, capacity 2144K, committed 2176K, reserved 1048576K
      }
      Event: 276.252 GC heap before
      {Heap before GC invocations=8914 (full 289):
       def new generation total 10880K, used 10867K [0x00000000c0000000, 0x00000000c0bc0000, 0x00000000d5550000)
        eden space 9728K, 99% used [0x00000000c0000000, 0x00000000c097cd68, 0x00000000c0980000)
        from space 1152K, 100% used [0x00000000c0980000, 0x00000000c0aa0000, 0x00000000c0aa0000)
        to space 1152K, 0% used [0x00000000c0aa0000, 0x00000000c0aa0000, 0x00000000c0bc0000)
       tenured generation total 23928K, used 14290K [0x00000000d5550000, 0x00000000d6cae000, 0x0000000100000000)
         the space 23928K, 59% used [0x00000000d5550000, 0x00000000d6344a90, 0x00000000d6344c00, 0x00000000d6cae000)
       Metaspace used 20676K, capacity 20938K, committed 21376K, reserved 1069056K
        class space used 2030K, capacity 2144K, committed 2176K, reserved 1048576K
      }
      Event: 276.253 GC heap after
      {Heap after GC invocations=8915 (full 289):
       def new generation total 10880K, used 1152K [0x00000000c0000000, 0x00000000c0bc0000, 0x00000000d5550000)
        eden space 9728K, 0% used [0x00000000c0000000, 0x00000000c0000000, 0x00000000c0980000)
        from space 1152K, 100% used [0x00000000c0aa0000, 0x00000000c0bc0000, 0x00000000c0bc0000)
        to space 1152K, 0% used [0x00000000c0980000, 0x00000000c0980000, 0x00000000c0aa0000)
       tenured generation total 23928K, used 14717K [0x00000000d5550000, 0x00000000d6cae000, 0x0000000100000000)
         the space 23928K, 61% used [0x00000000d5550000, 0x00000000d63af618, 0x00000000d63af800, 0x00000000d6cae000)
       Metaspace used 20676K, capacity 20938K, committed 21376K, reserved 1069056K
        class space used 2030K, capacity 2144K, committed 2176K, reserved 1048576K
      }

      Deoptimization events (10 events):
      Event: 275.308 Thread 0x00007f01643b1000 Uncommon trap: reason=unstable_if action=reinterpret pc=0x00007f015415fef8 method=com.rsa.jcm.c.ju.a(Ljava/lang/String;Lcom/rsa/jcm/c/jc;)Lcom/rsa/crypto/KeyAgreement; @ 6 c2
      Event: 275.308 Thread 0x00007f01643b1000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00007f015417671c method=com.rsa.cryptoj.e.ks.a(Ljava/security/PrivateKey;Ljava/lang/String;Lcom/rsa/crypto/CryptoModule;)Lcom/rsa/crypto/PrivateKey; @ 1 c2
      Event: 275.313 Thread 0x00007f01643b9800 Uncommon trap: reason=unstable_if action=reinterpret pc=0x00007f015415e620 method=com.rsa.cryptoj.e.fj.a(Ljava/lang/String;Lcom/rsa/crypto/PrivateKey;Lcom/rsa/crypto/CryptoModule;)Lcom/rsa/cryptoj/e/fq; @ 102 c2
      Event: 275.313 Thread 0x00007f01643b9800 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00007f015417671c method=com.rsa.cryptoj.e.ks.a(Ljava/security/PrivateKey;Ljava/lang/String;Lcom/rsa/crypto/CryptoModule;)Lcom/rsa/crypto/PrivateKey; @ 1 c2
      Event: 275.317 Thread 0x00007f01643db000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00007f0154168b4c method=com.rsa.sslj.x.cx.a(Lcom/rsa/sslj/x/cv;Lcom/rsa/sslj/x/ap;Lcom/rsa/sslj/x/eT;)V @ 36 c2
      Event: 275.317 Thread 0x00007f01643db000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00007f0154153cf4 method=com.rsa.cryptoj.e.os.a(Ljava/security/PublicKey;)Lcom/rsa/crypto/PublicKey; @ 24 c2
      Event: 275.318 Thread 0x00007f01643db000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00007f015417671c method=com.rsa.cryptoj.e.ks.a(Ljava/security/PrivateKey;Ljava/lang/String;Lcom/rsa/crypto/CryptoModule;)Lcom/rsa/crypto/PrivateKey; @ 1 c2
      Event: 275.319 Thread 0x00007f01643bd000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00007f0154168b4c method=com.rsa.sslj.x.cx.a(Lcom/rsa/sslj/x/cv;Lcom/rsa/sslj/x/ap;Lcom/rsa/sslj/x/eT;)V @ 36 c2
      Event: 275.319 Thread 0x00007f01643bd000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00007f0154153cf4 method=com.rsa.cryptoj.e.os.a(Ljava/security/PublicKey;)Lcom/rsa/crypto/PublicKey; @ 24 c2
      Event: 275.321 Thread 0x00007f01643bd000 Uncommon trap: reason=class_check action=maybe_recompile pc=0x00007f015417671c method=com.rsa.cryptoj.e.ks.a(Ljava/security/PrivateKey;Ljava/lang/String;Lcom/rsa/crypto/CryptoModule;)Lcom/rsa/crypto/PrivateKey; @ 1 c2

      Classes redefined (0 events):
      No events

      Internal exceptions (6 events):
      Event: 2.825 Thread 0x00007f01643c1000 Exception <a 'java/lang/NoSuchMethodError'{0x00000000c084bf10}: java.lang.invoke.DirectMethodHandle$Holder.invokeSpecialIFC(Ljava/lang/Object;Ljava/lang/Object;I)I> (0x00000000c084bf10) thrown at [/opt/mach5/mesos/work_dir/slaves/6e54f4af-e606-43b0-80ce-0
      Event: 13.343 Thread 0x00007f01643c9000 Implicit null exception at 0x00007f0153d4a3d0 to 0x00007f0153d51d96
      Event: 19.376 Thread 0x00007f01643b9800 Implicit null exception at 0x00007f0153d2628f to 0x00007f0153d26cd2
      Event: 43.619 Thread 0x00007f01643bd000 Implicit null exception at 0x00007f0153e1b1b0 to 0x00007f0153e1b265
      Event: 43.622 Thread 0x00007f01643bd000 Implicit null exception at 0x00007f0153e33980 to 0x00007f0153e36ad6
      Event: 159.724 Thread 0x00007f01643c7000 Implicit null exception at 0x00007f0153fef5bf to 0x00007f0153ff23c6

      Events (10 events):
      Event: 275.888 Executing VM operation: GenCollectForAllocation
      Event: 275.890 Executing VM operation: GenCollectForAllocation done
      Event: 275.976 Executing VM operation: GenCollectForAllocation
      Event: 275.979 Executing VM operation: GenCollectForAllocation done
      Event: 276.046 Executing VM operation: GenCollectForAllocation
      Event: 276.100 Executing VM operation: GenCollectForAllocation done
      Event: 276.163 Executing VM operation: GenCollectForAllocation
      Event: 276.167 Executing VM operation: GenCollectForAllocation done
      Event: 276.247 Executing VM operation: GenCollectForAllocation
      Event: 276.253 Executing VM operation: GenCollectForAllocation done


      Dynamic libraries:
      00400000-00401000 r-xp 00000000 00:32 25648956 /emc/bnebill/antjava/linux/x64/sun/11_06/bin/java
      00600000-00601000 r--p 00000000 00:32 25648956 /emc/bnebill/antjava/linux/x64/sun/11_06/bin/java
      00601000-00602000 rw-p 00001000 00:32 25648956 /emc/bnebill/antjava/linux/x64/sun/11_06/bin/java
      015e3000-01648000 rw-p 00000000 00:00 0 [heap]
      c0000000-c0bc0000 rw-p 00000000 00:00 0
      c0bc0000-d5550000 ---p 00000000 00:00 0
      d5550000-d6cae000 rw-p 00000000 00:00 0
      d6cae000-100000000 ---p 00000000 00:00 0
      100000000-100220000 rw-p 00000000 00:00 0
      100220000-140000000 ---p 00000000 00:00 0
      7f012bdbc000-7f012c000000 rw-p 00000000 00:00 0
      7f012c000000-7f012c995000 rw-p 00000000 00:00 0
      7f012c995000-7f0130000000 ---p 00000000 00:00 0
      7f0130000000-7f013003d000 rw-p 00000000 00:00 0
      7f013003d000-7f0134000000 ---p 00000000 00:00 0
      7f0134000000-7f0134089000 rw-p 00000000 00:00 0
      7f0134089000-7f0138000000 ---p 00000000 00:00 0
      7f0138000000-7f0139ebe000 rw-p 00000000 00:00 0
      7f0139ebe000-7f013c000000 ---p 00000000 00:00 0
      7f013c000000-7f013c068000 rw-p 00000000 00:00 0
      7f013c068000-7f0140000000 ---p 00000000 00:00 0
      7f0140000000-7f0140037000 rw-p 00000000 00:00 0
      7f0140037000-7f0144000000 ---p 00000000 00:00 0
      7f0144000000-7f01446f6000 rw-p 00000000 00:00 0
      7f01446f6000-7f0148000000 ---p 00000000 00:00 0
      7f014818b000-7f014824b000 rw-p 00000000 00:00 0
      7f014824b000-7f014838b000 ---p 00000000 00:00 0
      7f014838b000-7f014858b000 rw-p 00000000 00:00 0
      7f014858b000-7f014878b000 rw-p 00000000 00:00 0
      7f014878b000-7f014898b000 rw-p 00000000 00:00 0
      7f014898b000-7f01489cb000 r-xp 00000000 00:32 25662321 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libsunec.so
      7f01489cb000-7f0148bca000 ---p 00040000 00:32 25662321 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libsunec.so
      7f0148bca000-7f0148bcf000 r--p 0003f000 00:32 25662321 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libsunec.so
      7f0148bcf000-7f0148bd1000 rw-p 00044000 00:32 25662321 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libsunec.so
      7f0148bd1000-7f0148bd5000 ---p 00000000 00:00 0
      7f0148bd5000-7f0148cd2000 rw-p 00000000 00:00 0
      7f0148cd2000-7f0148cd6000 ---p 00000000 00:00 0
      7f0148cd6000-7f0148dd3000 rw-p 00000000 00:00 0
      7f0148dd3000-7f0148dd7000 ---p 00000000 00:00 0
      7f0148dd7000-7f0148ed4000 rw-p 00000000 00:00 0
      7f0148ed4000-7f0148ed8000 ---p 00000000 00:00 0
      7f0148ed8000-7f0148fd5000 rw-p 00000000 00:00 0
      7f0148fd5000-7f0148fd9000 ---p 00000000 00:00 0
      7f0148fd9000-7f01490d6000 rw-p 00000000 00:00 0
      7f01490d6000-7f01490da000 ---p 00000000 00:00 0
      7f01490da000-7f01491d7000 rw-p 00000000 00:00 0
      7f01491d7000-7f01491db000 ---p 00000000 00:00 0
      7f01491db000-7f01492d8000 rw-p 00000000 00:00 0
      7f01492d8000-7f01492dc000 ---p 00000000 00:00 0
      7f01492dc000-7f01493d9000 rw-p 00000000 00:00 0
      7f01493d9000-7f01493dd000 ---p 00000000 00:00 0
      7f01493dd000-7f01494da000 rw-p 00000000 00:00 0
      7f01494da000-7f01494de000 ---p 00000000 00:00 0
      7f01494de000-7f01495db000 rw-p 00000000 00:00 0
      7f01495db000-7f01495df000 ---p 00000000 00:00 0
      7f01495df000-7f01496dc000 rw-p 00000000 00:00 0
      7f01496dc000-7f01496f3000 r-xp 00000000 08:01 542878 /lib/x86_64-linux-gnu/libresolv-2.23.so
      7f01496f3000-7f01498f3000 ---p 00017000 08:01 542878 /lib/x86_64-linux-gnu/libresolv-2.23.so
      7f01498f3000-7f01498f4000 r--p 00017000 08:01 542878 /lib/x86_64-linux-gnu/libresolv-2.23.so
      7f01498f4000-7f01498f5000 rw-p 00018000 08:01 542878 /lib/x86_64-linux-gnu/libresolv-2.23.so
      7f01498f5000-7f01498f7000 rw-p 00000000 00:00 0
      7f01498f7000-7f01498fc000 r-xp 00000000 08:01 542866 /lib/x86_64-linux-gnu/libnss_dns-2.23.so
      7f01498fc000-7f0149afc000 ---p 00005000 08:01 542866 /lib/x86_64-linux-gnu/libnss_dns-2.23.so
      7f0149afc000-7f0149afd000 r--p 00005000 08:01 542866 /lib/x86_64-linux-gnu/libnss_dns-2.23.so
      7f0149afd000-7f0149afe000 rw-p 00006000 08:01 542866 /lib/x86_64-linux-gnu/libnss_dns-2.23.so
      7f0149afe000-7f0149b00000 r-xp 00000000 08:01 529935 /lib/x86_64-linux-gnu/libnss_mdns4_minimal.so.2
      7f0149b00000-7f0149cff000 ---p 00002000 08:01 529935 /lib/x86_64-linux-gnu/libnss_mdns4_minimal.so.2
      7f0149cff000-7f0149d00000 r--p 00001000 08:01 529935 /lib/x86_64-linux-gnu/libnss_mdns4_minimal.so.2
      7f0149d00000-7f0149d01000 rw-p 00002000 08:01 529935 /lib/x86_64-linux-gnu/libnss_mdns4_minimal.so.2
      7f0149d01000-7f0149d03000 r-xp 00000000 00:32 25662295 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libextnet.so
      7f0149d03000-7f0149f02000 ---p 00002000 00:32 25662295 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libextnet.so
      7f0149f02000-7f0149f03000 r--p 00001000 00:32 25662295 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libextnet.so
      7f0149f03000-7f0149f04000 rw-p 00002000 00:32 25662295 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libextnet.so
      7f0149f04000-7f014a104000 rw-p 00000000 00:00 0
      7f014a104000-7f014a304000 rw-p 00000000 00:00 0
      7f014a304000-7f014a31b000 r-xp 00000000 00:32 25662314 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libnet.so
      7f014a31b000-7f014a51a000 ---p 00017000 00:32 25662314 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libnet.so
      7f014a51a000-7f014a51b000 r--p 00016000 00:32 25662314 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libnet.so
      7f014a51b000-7f014a51c000 rw-p 00017000 00:32 25662314 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libnet.so
      7f014a51c000-7f014a52c000 r-xp 00000000 00:32 25662315 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libnio.so
      7f014a52c000-7f014a72b000 ---p 00010000 00:32 25662315 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libnio.so
      7f014a72b000-7f014a72c000 r--p 0000f000 00:32 25662315 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libnio.so
      7f014a72c000-7f014a72d000 rw-p 00010000 00:32 25662315 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libnio.so
      7f014a72d000-7f014a731000 ---p 00000000 00:00 0
      7f014a731000-7f014a82e000 rw-p 00000000 00:00 0
      7f014a82e000-7f014a82f000 ---p 00000000 00:00 0
      7f014a82f000-7f014a92f000 rw-p 00000000 00:00 0
      7f014a92f000-7f014a933000 ---p 00000000 00:00 0
      7f014a933000-7f014aa30000 rw-p 00000000 00:00 0
      7f014aa30000-7f014aa34000 ---p 00000000 00:00 0
      7f014aa34000-7f014ab31000 rw-p 00000000 00:00 0
      7f014ab31000-7f014ab35000 ---p 00000000 00:00 0
      7f014ab35000-7f014ac32000 rw-p 00000000 00:00 0
      7f014ac32000-7f014ac36000 ---p 00000000 00:00 0
      7f014ac36000-7f014ad33000 rw-p 00000000 00:00 0
      7f014ad33000-7f014ad37000 ---p 00000000 00:00 0
      7f014ad37000-7f014ae34000 rw-p 00000000 00:00 0
      7f014ae34000-7f014b155000 r--p 00000000 08:01 663037 /usr/lib/locale/locale-archive
      7f014b155000-7f014b159000 ---p 00000000 00:00 0
      7f014b159000-7f014b256000 rw-p 00000000 00:00 0
      7f014b256000-7f014b25a000 ---p 00000000 00:00 0
      7f014b25a000-7f014b357000 rw-p 00000000 00:00 0
      7f014b357000-7f014b358000 ---p 00000000 00:00 0
      7f014b358000-7f014bc64000 rw-p 00000000 00:00 0
      7f014bc64000-7f014bdae000 ---p 00000000 00:00 0
      7f014bdae000-7f014bdb4000 rw-p 00000000 00:00 0
      7f014bdb4000-7f014be58000 ---p 00000000 00:00 0
      7f014be58000-7f014be65000 rw-p 00000000 00:00 0
      7f014be65000-7f014bfae000 ---p 00000000 00:00 0
      7f014bfae000-7f014bfba000 rw-p 00000000 00:00 0
      7f014bfba000-7f014c09a000 ---p 00000000 00:00 0
      7f014c09a000-7f014c0aa000 rw-p 00000000 00:00 0
      7f014c0aa000-7f014c185000 ---p 00000000 00:00 0
      7f014c185000-7f014c3f5000 rwxp 00000000 00:00 0
      7f014c3f5000-7f014c714000 ---p 00000000 00:00 0
      7f014c714000-7f014cef4000 rwxp 00000000 00:00 0
      7f014cef4000-7f0153c4c000 ---p 00000000 00:00 0
      7f0153c4c000-7f015417c000 rwxp 00000000 00:00 0
      7f015417c000-7f015b185000 ---p 00000000 00:00 0
      7f015b185000-7f01635a4000 r--s 00000000 00:32 25662325 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/modules
      7f01635a4000-7f01635bf000 r-xp 00000000 00:32 25662306 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libjimage.so
      7f01635bf000-7f01637be000 ---p 0001b000 00:32 25662306 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libjimage.so
      7f01637be000-7f01637c0000 r--p 0001a000 00:32 25662306 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libjimage.so
      7f01637c0000-7f01637c1000 rw-p 0001c000 00:32 25662306 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libjimage.so
      7f01637c1000-7f01637c8000 r-xp 00000000 00:32 25662324 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libzip.so
      7f01637c8000-7f01639c7000 ---p 00007000 00:32 25662324 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libzip.so
      7f01639c7000-7f01639c8000 r--p 00006000 00:32 25662324 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libzip.so
      7f01639c8000-7f01639c9000 rw-p 00007000 00:32 25662324 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libzip.so
      7f01639c9000-7f01639df000 r-xp 00000000 08:01 529045 /lib/x86_64-linux-gnu/libnsl-2.23.so
      7f01639df000-7f0163bde000 ---p 00016000 08:01 529045 /lib/x86_64-linux-gnu/libnsl-2.23.so
      7f0163bde000-7f0163bdf000 r--p 00015000 08:01 529045 /lib/x86_64-linux-gnu/libnsl-2.23.so
      7f0163bdf000-7f0163be0000 rw-p 00016000 08:01 529045 /lib/x86_64-linux-gnu/libnsl-2.23.so
      7f0163be0000-7f0163be2000 rw-p 00000000 00:00 0
      7f0163be2000-7f0163bed000 r-xp 00000000 08:01 542876 /lib/x86_64-linux-gnu/libnss_nis-2.23.so
      7f0163bed000-7f0163dec000 ---p 0000b000 08:01 542876 /lib/x86_64-linux-gnu/libnss_nis-2.23.so
      7f0163dec000-7f0163ded000 r--p 0000a000 08:01 542876 /lib/x86_64-linux-gnu/libnss_nis-2.23.so
      7f0163ded000-7f0163dee000 rw-p 0000b000 08:01 542876 /lib/x86_64-linux-gnu/libnss_nis-2.23.so
      7f0163dee000-7f0163df9000 r-xp 00000000 08:01 542868 /lib/x86_64-linux-gnu/libnss_files-2.23.so
      7f0163df9000-7f0163ff8000 ---p 0000b000 08:01 542868 /lib/x86_64-linux-gnu/libnss_files-2.23.so
      7f0163ff8000-7f0163ff9000 r--p 0000a000 08:01 542868 /lib/x86_64-linux-gnu/libnss_files-2.23.so
      7f0163ff9000-7f0163ffa000 rw-p 0000b000 08:01 542868 /lib/x86_64-linux-gnu/libnss_files-2.23.so
      7f0163ffa000-7f0164000000 rw-p 00000000 00:00 0
      7f0164000000-7f0164568000 rw-p 00000000 00:00 0
      7f0164568000-7f0168000000 ---p 00000000 00:00 0
      7f0168094000-7f01680bd000 r-xp 00000000 00:32 25662302 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libjava.so
      7f01680bd000-7f01682bc000 ---p 00029000 00:32 25662302 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libjava.so
      7f01682bc000-7f01682bd000 r--p 00028000 00:32 25662302 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libjava.so
      7f01682bd000-7f01682bf000 rw-p 00029000 00:32 25662302 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libjava.so
      7f01682bf000-7f01682cc000 r-xp 00000000 00:32 25662323 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libverify.so
      7f01682cc000-7f01684cb000 ---p 0000d000 00:32 25662323 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libverify.so
      7f01684cb000-7f01684cd000 r--p 0000c000 00:32 25662323 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libverify.so
      7f01684cd000-7f01684ce000 rw-p 0000e000 00:32 25662323 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libverify.so
      7f01684ce000-7f01684d5000 r-xp 00000000 08:01 542882 /lib/x86_64-linux-gnu/librt-2.23.so
      7f01684d5000-7f01686d4000 ---p 00007000 08:01 542882 /lib/x86_64-linux-gnu/librt-2.23.so
      7f01686d4000-7f01686d5000 r--p 00006000 08:01 542882 /lib/x86_64-linux-gnu/librt-2.23.so
      7f01686d5000-7f01686d6000 rw-p 00007000 08:01 542882 /lib/x86_64-linux-gnu/librt-2.23.so
      7f01686d6000-7f01687de000 r-xp 00000000 08:01 529046 /lib/x86_64-linux-gnu/libm-2.23.so
      7f01687de000-7f01689dd000 ---p 00108000 08:01 529046 /lib/x86_64-linux-gnu/libm-2.23.so
      7f01689dd000-7f01689de000 r--p 00107000 08:01 529046 /lib/x86_64-linux-gnu/libm-2.23.so
      7f01689de000-7f01689df000 rw-p 00108000 08:01 529046 /lib/x86_64-linux-gnu/libm-2.23.so
      7f01689df000-7f0169b20000 r-xp 00000000 00:32 25662336 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/server/libjvm.so
      7f0169b20000-7f0169d20000 ---p 01141000 00:32 25662336 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/server/libjvm.so
      7f0169d20000-7f0169dde000 r--p 01141000 00:32 25662336 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/server/libjvm.so
      7f0169dde000-7f0169e17000 rw-p 011ff000 00:32 25662336 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/server/libjvm.so
      7f0169e17000-7f0169e6e000 rw-p 00000000 00:00 0
      7f0169e6e000-7f016a02e000 r-xp 00000000 08:01 529042 /lib/x86_64-linux-gnu/libc-2.23.so
      7f016a02e000-7f016a22e000 ---p 001c0000 08:01 529042 /lib/x86_64-linux-gnu/libc-2.23.so
      7f016a22e000-7f016a232000 r--p 001c0000 08:01 529042 /lib/x86_64-linux-gnu/libc-2.23.so
      7f016a232000-7f016a234000 rw-p 001c4000 08:01 529042 /lib/x86_64-linux-gnu/libc-2.23.so
      7f016a234000-7f016a238000 rw-p 00000000 00:00 0
      7f016a238000-7f016a23b000 r-xp 00000000 08:01 529040 /lib/x86_64-linux-gnu/libdl-2.23.so
      7f016a23b000-7f016a43a000 ---p 00003000 08:01 529040 /lib/x86_64-linux-gnu/libdl-2.23.so
      7f016a43a000-7f016a43b000 r--p 00002000 08:01 529040 /lib/x86_64-linux-gnu/libdl-2.23.so
      7f016a43b000-7f016a43c000 rw-p 00003000 08:01 529040 /lib/x86_64-linux-gnu/libdl-2.23.so
      7f016a43c000-7f016a44c000 r-xp 00000000 00:32 25662287 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/jli/libjli.so
      7f016a44c000-7f016a64b000 ---p 00010000 00:32 25662287 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/jli/libjli.so
      7f016a64b000-7f016a64c000 r--p 0000f000 00:32 25662287 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/jli/libjli.so
      7f016a64c000-7f016a64d000 rw-p 00010000 00:32 25662287 /emc/bnebill/antjava/linux/x64/sun/11_06/lib/jli/libjli.so
      7f016a64d000-7f016a665000 r-xp 00000000 08:01 529043 /lib/x86_64-linux-gnu/libpthread-2.23.so
      7f016a665000-7f016a864000 ---p 00018000 08:01 529043 /lib/x86_64-linux-gnu/libpthread-2.23.so
      7f016a864000-7f016a865000 r--p 00017000 08:01 529043 /lib/x86_64-linux-gnu/libpthread-2.23.so
      7f016a865000-7f016a866000 rw-p 00018000 08:01 529043 /lib/x86_64-linux-gnu/libpthread-2.23.so
      7f016a866000-7f016a86a000 rw-p 00000000 00:00 0
      7f016a86a000-7f016a883000 r-xp 00000000 08:01 529169 /lib/x86_64-linux-gnu/libz.so.1.2.8
      7f016a883000-7f016aa82000 ---p 00019000 08:01 529169 /lib/x86_64-linux-gnu/libz.so.1.2.8
      7f016aa82000-7f016aa83000 r--p 00018000 08:01 529169 /lib/x86_64-linux-gnu/libz.so.1.2.8
      7f016aa83000-7f016aa84000 rw-p 00019000 08:01 529169 /lib/x86_64-linux-gnu/libz.so.1.2.8
      7f016aa84000-7f016aaaa000 r-xp 00000000 08:01 542864 /lib/x86_64-linux-gnu/ld-2.23.so
      7f016aaac000-7f016ab88000 rw-p 00000000 00:00 0
      7f016ab88000-7f016ab8c000 ---p 00000000 00:00 0
      7f016ab8c000-7f016ac8e000 rw-p 00000000 00:00 0
      7f016ac93000-7f016ac98000 rw-p 00000000 00:00 0
      7f016ac98000-7f016ac9f000 ---p 00000000 00:00 0
      7f016ac9f000-7f016aca7000 rw-s 00000000 08:01 529871 /tmp/hsperfdata_raisoc/11750
      7f016aca7000-7f016aca8000 ---p 00000000 00:00 0
      7f016aca8000-7f016aca9000 r--p 00000000 00:00 0
      7f016aca9000-7f016acaa000 r--p 00025000 08:01 542864 /lib/x86_64-linux-gnu/ld-2.23.so
      7f016acaa000-7f016acab000 rw-p 00026000 08:01 542864 /lib/x86_64-linux-gnu/ld-2.23.so
      7f016acab000-7f016acac000 rw-p 00000000 00:00 0
      7ffdec561000-7ffdec582000 rw-p 00000000 00:00 0 [stack]
      7ffdec5cc000-7ffdec5ce000 r--p 00000000 00:00 0 [vvar]
      7ffdec5ce000-7ffdec5d0000 r-xp 00000000 00:00 0 [vdso]
      ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]


      VM Arguments:
      jvm_args: -Xmx1024m
      java_command: com.rsa.test.performance.framework.client.HttpClient -random CTRDRBG -httpport 38888 -httpsport 38889 -server prf-rh7x64-02 -json sunjsse.json -resultDir /tmp/bnebill/client/results
      java_class_path (initial): /tmp/bnebill/client/lib/sslj-7.0-RC2-7.0.0.0.jar:/tmp/bnebill/client/lib/sslj_performance.jar:/tmp/bnebill/client/lib/asn1x-4.2.jar:/tmp/bnebill/client/lib/sslj-test-7.0-RC2-7.0.0.0.jar:/tmp/bnebill/client/lib/asn1x-test-4.2.jar:/tmp/bnebill/client/lib/sslj.performance.nonfips.linux_x64.jar:/tmp/bnebill/client/lib/junit-4.12.jar:/tmp/bnebill/client/lib/asn1x_NoObf-4.2.jar:/tmp/bnebill/client/lib/gson-1.7.1-1.7.1.jar:/tmp/bnebill/client/lib/hamcrest-core-1.3.jar:/tmp/bnebill/client/lib/cryptoj-6.2.5.1-RC3-6.2.5.1.jar
      Launcher Type: SUN_STANDARD

      [Global flags]
           intx CICompilerCount = 2 {product} {ergonomic}
         size_t InitialHeapSize = 33554432 {product} {ergonomic}
         size_t MaxHeapSize = 1073741824 {product} {command line}
         size_t MaxNewSize = 357892096 {product} {ergonomic}
         size_t MinHeapDeltaBytes = 196608 {product} {ergonomic}
         size_t NewSize = 11141120 {product} {ergonomic}
          uintx NonNMethodCodeHeapSize = 5825164 {pd product} {ergonomic}
          uintx NonProfiledCodeHeapSize = 122916538 {pd product} {ergonomic}
         size_t OldSize = 22413312 {product} {ergonomic}
          uintx ProfiledCodeHeapSize = 122916538 {pd product} {ergonomic}
          uintx ReservedCodeCacheSize = 251658240 {pd product} {ergonomic}
           bool SegmentedCodeCache = true {product} {ergonomic}
           bool UseCompressedClassPointers = true {lp64_product} {ergonomic}
           bool UseCompressedOops = true {lp64_product} {ergonomic}
           bool UseSerialGC = true {product} {ergonomic}

      Logging:
      Log output configuration:
       #0: stdout all=warning uptime,level,tags
       #1: stderr all=off uptime,level,tags

      Environment Variables:
      JAVA_HOME=/emc/bnebill/antjava/linux/x64/sun/11
      PATH=/emc/raisoc/bin:/emc/bnebill/antjava/linux/x64/sun/11/bin:/emc/bnebill/antjava/cc/ant/1.8.2/bin:/opt/gradle/bin:/opt/lsb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
      SHELL=/bin/bash
      DISPLAY=localhost:11.0

      Signal Handlers:
      SIGSEGV: [libjvm.so+0xe2c860], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
      SIGBUS: [libjvm.so+0xe2c860], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
      SIGFPE: [libjvm.so+0xe2c860], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
      SIGPIPE: [libjvm.so+0xbff730], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
      SIGXFSZ: [libjvm.so+0xbff730], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
      SIGILL: [libjvm.so+0xe2c860], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
      SIGUSR2: [libjvm.so+0xbff5d0], sa_mask[0]=00000000000000000000000000000000, sa_flags=SA_RESTART|SA_SIGINFO
      SIGHUP: [libjvm.so+0xbff930], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
      SIGINT: [libjvm.so+0xbff930], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
      SIGTERM: [libjvm.so+0xbff930], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
      SIGQUIT: [libjvm.so+0xbff930], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO


      --------------- S Y S T E M ---------------

      OS:DISTRIB_ID=Ubuntu
      DISTRIB_RELEASE=16.04
      DISTRIB_CODENAME=xenial
      DISTRIB_DESCRIPTION="Ubuntu 16.04.7 LTS"
      uname:Linux 4.4.0-193-generic #224-Ubuntu SMP Tue Oct 6 17:15:28 UTC 2020 x86_64
      libc:glibc 2.23 NPTL 2.23
      rlimit: STACK 8192k, CORE infinity, NPROC 7812, NOFILE 1048576, AS infinity, DATA infinity, FSIZE infinity
      load average:4.94 4.17 2.65

      /proc/meminfo:
      MemTotal: 2043880 kB
      MemFree: 306072 kB
      MemAvailable: 1461908 kB
      Buffers: 206088 kB
      Cached: 1036208 kB
      SwapCached: 1680 kB
      Active: 1137472 kB
      Inactive: 370200 kB
      Active(anon): 226180 kB
      Inactive(anon): 75656 kB
      Active(file): 911292 kB
      Inactive(file): 294544 kB
      Unevictable: 0 kB
      Mlocked: 0 kB
      SwapTotal: 1046524 kB
      SwapFree: 1023088 kB
      Dirty: 100 kB
      Writeback: 0 kB
      AnonPages: 264192 kB
      Mapped: 76116 kB
      Shmem: 36440 kB
      Slab: 167012 kB
      SReclaimable: 137948 kB
      SUnreclaim: 29064 kB
      KernelStack: 5664 kB
      PageTables: 14696 kB
      NFS_Unstable: 0 kB
      Bounce: 0 kB
      WritebackTmp: 0 kB
      CommitLimit: 2068464 kB
      Committed_AS: 1456196 kB
      VmallocTotal: 34359738367 kB
      VmallocUsed: 0 kB
      VmallocChunk: 0 kB
      HardwareCorrupted: 0 kB
      AnonHugePages: 0 kB
      CmaTotal: 0 kB
      CmaFree: 0 kB
      HugePages_Total: 0
      HugePages_Free: 0
      HugePages_Rsvd: 0
      HugePages_Surp: 0
      Hugepagesize: 2048 kB
      DirectMap4k: 1300352 kB
      DirectMap2M: 796672 kB


      /proc/sys/kernel/threads-max (system-wide limit on the number of threads):
      15624


      /proc/sys/vm/max_map_count (maximum number of memory map areas a process may have):
      65530


      /proc/sys/kernel/pid_max (system-wide limit on number of process identifiers):
      32768



      container (cgroup) information:
      container_type: cgroupv1
      cpu_cpuset_cpus: 0
      cpu_memory_nodes: 0
      active_processor_count: 1
      cpu_quota: -1
      cpu_period: 100000
      cpu_shares: -1
      memory_limit_in_bytes: -1
      memory_and_swap_limit_in_bytes: -2
      memory_soft_limit_in_bytes: -1
      memory_usage_in_bytes: 540073984
      memory_max_usage_in_bytes: 1136939008


      CPU:total 1 (initial active 1) (1 cores per cpu, 1 threads per core) family 6 model 79 stepping 1, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, aes, clmul, 3dnowpref, tsc, tscinvbit, fma
      CPU Model and flags from /proc/cpuinfo:
      model name : Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz
      flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx rdtscp lm constant_tsc arch_perfmon nopl tsc_reliable nonstop_tsc pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 movbe popcnt aes xsave avx hypervisor lahf_lm 3dnowprefetch kaiser arat

      Memory: 4k page, physical 2043880k(306072k free), swap 1046524k(1023088k free)

      vm_info: Java HotSpot(TM) 64-Bit Server VM (11.0.6+8-LTS) for linux-amd64 JRE (11.0.6+8-LTS), built on Dec 11 2019 09:23:32 by "mach5one" with gcc 7.3.0

      END.

      **********************************************************
      jhsdb jstack output:
      Attaching to core core from executable /emc/bnebill/antjava/linux/x64/sun/11/bin/java, please wait...
      Debugger attached successfully.
      Server compiler detected.
      JVM version is 11.0.6+8-LTS
      Deadlock Detection:

      No deadlocks found.

      "client-thread-9" #392 prio=5 tid=0x00007f01643b2000 nid=0x300c runnable [0x00007f0148cd0000]
         java.lang.Thread.State: RUNNABLE
         JavaThread state: _thread_blocked
       - java.net.SocketInputStream.socketRead0(java.io.FileDescriptor, byte[], int, int, int) @bci=0 (Compiled frame; information may be imprecise)
       - java.net.SocketInputStream.socketRead(java.io.FileDescriptor, byte[], int, int, int) @bci=8, line=115 (Compiled frame)
       - java.net.SocketInputStream.read(byte[], int, int, int) @bci=114, line=168 (Compiled frame)
       - java.net.SocketInputStream.read(byte[], int, int) @bci=11, line=140 (Compiled frame)
       - com.rsa.sslj.x.ag.c(byte[], int, int) @bci=38 (Compiled frame)
       - com.rsa.sslj.x.ag.a(boolean) @bci=77 (Compiled frame)
       - com.rsa.sslj.x.ag.a(int) @bci=136 (Compiled frame)
      - locked <0x00000000c06436b0> (a com.rsa.sslj.x.ag)
       - com.rsa.sslj.x.ag.a(java.nio.ByteBuffer) @bci=127 (Compiled frame)
       - com.rsa.sslj.x.ag.a(byte[], int, int) @bci=7 (Compiled frame)
       - com.rsa.sslj.x.bS.write(byte[], int, int) @bci=7 (Compiled frame)
       - java.io.BufferedOutputStream.flushBuffer() @bci=20, line=81 (Compiled frame)
       - java.io.BufferedOutputStream.flush() @bci=1, line=142 (Compiled frame)
      - locked <0x00000000c065b248> (a java.io.BufferedOutputStream)
       - java.io.PrintStream.flush() @bci=12, line=417 (Compiled frame)
      - locked <0x00000000c065b220> (a java.io.PrintStream)
       - com.rsa.test.performance.framework.client.HttpClientHandler$1.run() @bci=126, line=227 (Compiled frame)


      "client-thread-8" #391 prio=5 tid=0x00007f016432d800 nid=0x300b runnable [0x00007f01493d7000]
         java.lang.Thread.State: RUNNABLE
         JavaThread state: _thread_blocked
       - java.net.SocketInputStream.socketRead0(java.io.FileDescriptor, byte[], int, int, int) @bci=0 (Compiled frame; information may be imprecise)
       - java.net.SocketInputStream.socketRead(java.io.FileDescriptor, byte[], int, int, int) @bci=8, line=115 (Compiled frame)
       - java.net.SocketInputStream.read(byte[], int, int, int) @bci=114, line=168 (Compiled frame)
       - java.net.SocketInputStream.read(byte[], int, int) @bci=11, line=140 (Compiled frame)
       - com.rsa.sslj.x.ag.c(byte[], int, int) @bci=38 (Compiled frame)
       - com.rsa.sslj.x.ag.a(boolean) @bci=77 (Compiled frame)
       - com.rsa.sslj.x.ag.b(java.nio.ByteBuffer) @bci=235 (Compiled frame)
       - com.rsa.sslj.x.ag.b(byte[], int, int) @bci=7 (Compiled frame)
       - com.rsa.sslj.x.bR.read(byte[], int, int) @bci=7 (Compiled frame)
       - java.io.BufferedInputStream.fill() @bci=217, line=252 (Compiled frame)
       - java.io.BufferedInputStream.read() @bci=12, line=271 (Compiled frame)
      - locked <0x00000000c048b7b8> (a java.io.BufferedInputStream)
       - com.rsa.test.performance.framework.client.HttpClientHandler$1.run() @bci=187, line=240 (Compiled frame)


      "client-thread-7" #390 prio=5 tid=0x00007f0164391800 nid=0x300a runnable [0x00007f01491d5000]
         java.lang.Thread.State: RUNNABLE
         JavaThread state: _thread_blocked
       - java.net.PlainSocketImpl.socketConnect(java.net.InetAddress, int, int) @bci=0 (Compiled frame; information may be imprecise)
       - java.net.AbstractPlainSocketImpl.doConnect(java.net.InetAddress, int, int) @bci=64, line=399 (Compiled frame)
      - locked <0x00000000c0626720> (a java.net.SocksSocketImpl)
       - java.net.AbstractPlainSocketImpl.connectToAddress(java.net.InetAddress, int, int) @bci=23, line=242 (Compiled frame)
       - java.net.AbstractPlainSocketImpl.connect(java.net.SocketAddress, int) @bci=78, line=224 (Compiled frame)
       - java.net.SocksSocketImpl.connect(java.net.SocketAddress, int) @bci=381, line=403 (Compiled frame)
       - java.net.Socket.connect(java.net.SocketAddress, int) @bci=179, line=608 (Compiled frame)
       - java.net.Socket.connect(java.net.SocketAddress) @bci=3, line=557 (Compiled frame)
       - java.net.Socket.<init>(java.net.SocketAddress, java.net.SocketAddress, boolean) @bci=82, line=453 (Compiled frame)
       - java.net.Socket.<init>(java.net.InetAddress, int) @bci=23, line=263 (Compiled frame)
       - javax.net.DefaultSocketFactory.createSocket(java.net.InetAddress, int) @bci=6, line=277 (Compiled frame)
       - com.rsa.sslj.x.aw.<init>(com.rsa.sslj.x.eT, java.net.InetAddress, int) @bci=7 (Compiled frame)
       - com.rsa.sslj.x.av.createSocket(java.lang.String, int) @bci=13 (Compiled frame)
       - com.rsa.test.performance.framework.client.JsseHttpClient.createSSLSocket(java.lang.String, java.lang.String, java.net.URL, java.lang.String) @bci=69, line=62 (Compiled frame)
       - com.rsa.test.performance.framework.client.HttpClientHandler$1.run() @bci=43, line=215 (Compiled frame)


      "client-thread-6" #389 prio=5 tid=0x00007f01643c9000 nid=0x3009 runnable [0x0000000000000000]
         java.lang.Thread.State: RUNNABLE
         JavaThread state: _thread_in_java


      "client-thread-5" #388 prio=5 tid=0x00007f01643bf000 nid=0x3008 runnable [0x00007f0148fd3000]
         java.lang.Thread.State: RUNNABLE
         JavaThread state: _thread_blocked
       - java.net.SocketInputStream.socketRead0(java.io.FileDescriptor, byte[], int, int, int) @bci=0 (Compiled frame; information may be imprecise)
       - java.net.SocketInputStream.socketRead(java.io.FileDescriptor, byte[], int, int, int) @bci=8, line=115 (Compiled frame)
       - java.net.SocketInputStream.read(byte[], int, int, int) @bci=114, line=168 (Compiled frame)
       - java.net.SocketInputStream.read(byte[], int, int) @bci=11, line=140 (Compiled frame)
       - com.rsa.sslj.x.ag.c(byte[], int, int) @bci=38 (Compiled frame)
       - com.rsa.sslj.x.ag.a(boolean) @bci=77 (Compiled frame)
       - com.rsa.sslj.x.ag.b(java.nio.ByteBuffer) @bci=235 (Compiled frame)
       - com.rsa.sslj.x.ag.b(byte[], int, int) @bci=7 (Compiled frame)
       - com.rsa.sslj.x.bR.read(byte[], int, int) @bci=7 (Compiled frame)
       - java.io.BufferedInputStream.fill() @bci=217, line=252 (Compiled frame)
       - java.io.BufferedInputStream.read() @bci=12, line=271 (Compiled frame)
      - locked <0x00000000c04d20c8> (a java.io.BufferedInputStream)
       - com.rsa.test.performance.framework.client.HttpClientHandler$1.run() @bci=187, line=240 (Compiled frame)


      "client-thread-4" #387 prio=5 tid=0x00007f016436b000 nid=0x3007 runnable [0x00007f0148ed2000]
         java.lang.Thread.State: RUNNABLE
         JavaThread state: _thread_blocked
       - java.net.SocketInputStream.socketRead0(java.io.FileDescriptor, byte[], int, int, int) @bci=0 (Compiled frame; information may be imprecise)
       - java.net.SocketInputStream.socketRead(java.io.FileDescriptor, byte[], int, int, int) @bci=8, line=115 (Compiled frame)
       - java.net.SocketInputStream.read(byte[], int, int, int) @bci=114, line=168 (Compiled frame)
       - java.net.SocketInputStream.read(byte[], int, int) @bci=11, line=140 (Compiled frame)
       - com.rsa.sslj.x.ag.c(byte[], int, int) @bci=38 (Compiled frame)
       - com.rsa.sslj.x.ag.a(boolean) @bci=77 (Compiled frame)
       - com.rsa.sslj.x.ag.a(int) @bci=136 (Compiled frame)
      - locked <0x00000000c05da380> (a com.rsa.sslj.x.ag)
       - com.rsa.sslj.x.ag.a(java.nio.ByteBuffer) @bci=127 (Compiled frame)
       - com.rsa.sslj.x.ag.a(byte[], int, int) @bci=7 (Compiled frame)
       - com.rsa.sslj.x.bS.write(byte[], int, int) @bci=7 (Compiled frame)
       - java.io.BufferedOutputStream.flushBuffer() @bci=20, line=81 (Compiled frame)
       - java.io.BufferedOutputStream.flush() @bci=1, line=142 (Compiled frame)
      - locked <0x00000000c0726310> (a java.io.BufferedOutputStream)
       - java.io.PrintStream.flush() @bci=12, line=417 (Compiled frame)
      - locked <0x00000000c07262e8> (a java.io.PrintStream)
       - com.rsa.test.performance.framework.client.HttpClientHandler$1.run() @bci=126, line=227 (Compiled frame)


      "client-thread-3" #386 prio=5 tid=0x00007f01643bd000 nid=0x3006 runnable [0x00007f01490d2000]
         java.lang.Thread.State: RUNNABLE
         JavaThread state: _thread_in_vm
       - com.rsa.cryptoj.e.om.a(int, byte[], byte[], byte[]) @bci=1 (Compiled frame)
       - com.rsa.cryptoj.e.om.engineGenerateSecret(java.security.spec.KeySpec) @bci=53 (Compiled frame)
       - javax.crypto.SecretKeyFactory.generateSecret(java.security.spec.KeySpec) @bci=12, line=338 (Compiled frame)
       - com.rsa.sslj.x.cr.a(int, byte[], byte[], byte[], int, java.lang.String, com.rsa.jsafe.provider.JsafeJCE) @bci=31 (Compiled frame)
       - com.rsa.sslj.x.cr.a(byte[], byte[], com.rsa.jsafe.provider.JsafeJCE, int, java.lang.String) @bci=50 (Compiled frame)
       - com.rsa.sslj.x.dA.a(com.rsa.sslj.x.cv, com.rsa.sslj.x.ap, com.rsa.sslj.x.eT) @bci=59 (Compiled frame)
       - com.rsa.sslj.x.eZ.a(com.rsa.sslj.x.fb, com.rsa.sslj.x.cv, com.rsa.sslj.x.ap, com.rsa.sslj.x.eT) @bci=65 (Compiled frame)
       - com.rsa.sslj.x.dq.run() @bci=98 (Compiled frame)
       - com.rsa.sslj.x.fa$1$1.run() @bci=7 (Compiled frame)
       - java.security.AccessController.doPrivileged(java.security.PrivilegedAction, java.security.AccessControlContext) @bci=0 (Compiled frame)
       - com.rsa.sslj.x.fa$1.run() @bci=17 (Compiled frame)
       - com.rsa.sslj.x.ag.a(int) @bci=62 (Compiled frame)
      - locked <0x00000000c0788418> (a com.rsa.sslj.x.ag)
       - com.rsa.sslj.x.ag.a(java.nio.ByteBuffer) @bci=127 (Compiled frame)
       - com.rsa.sslj.x.ag.a(byte[], int, int) @bci=7 (Compiled frame)
       - com.rsa.sslj.x.bS.write(byte[], int, int) @bci=7 (Compiled frame)
       - java.io.BufferedOutputStream.flushBuffer() @bci=20, line=81 (Compiled frame)
       - java.io.BufferedOutputStream.flush() @bci=1, line=142 (Compiled frame)
      - locked <0x00000000c079de30> (a java.io.BufferedOutputStream)
       - java.io.PrintStream.flush() @bci=12, line=417 (Compiled frame)
      - locked <0x00000000c079de08> (a java.io.PrintStream)
       - com.rsa.test.performance.framework.client.HttpClientHandler$1.run() @bci=126, line=227 (Compiled frame)


      "client-thread-2" #385 prio=5 tid=0x00007f01643db000 nid=0x3005 runnable [0x0000000000000000]
         java.lang.Thread.State: RUNNABLE
         JavaThread state: _thread_in_java


      "client-thread-1" #384 prio=5 tid=0x00007f01643b1000 nid=0x3004 runnable [0x0000000000000000]
         java.lang.Thread.State: RUNNABLE
         JavaThread state: _thread_in_java


      "client-thread-0" #383 prio=5 tid=0x00007f01643b9800 nid=0x3003 runnable [0x00007f01495d9000]
         java.lang.Thread.State: RUNNABLE
         JavaThread state: _thread_blocked
       - java.net.SocketInputStream.socketRead0(java.io.FileDescriptor, byte[], int, int, int) @bci=0 (Compiled frame; information may be imprecise)
       - java.net.SocketInputStream.socketRead(java.io.FileDescriptor, byte[], int, int, int) @bci=8, line=115 (Compiled frame)
       - java.net.SocketInputStream.read(byte[], int, int, int) @bci=114, line=168 (Compiled frame)
       - java.net.SocketInputStream.read(byte[], int, int) @bci=11, line=140 (Compiled frame)
       - com.rsa.sslj.x.ag.c(byte[], int, int) @bci=38 (Compiled frame)
       - com.rsa.sslj.x.ag.a(boolean) @bci=77 (Compiled frame)
       - com.rsa.sslj.x.ag.a(int) @bci=136 (Compiled frame)
      - locked <0x00000000c07b79b0> (a com.rsa.sslj.x.ag)
       - com.rsa.sslj.x.ag.a(java.nio.ByteBuffer) @bci=127 (Compiled frame)
       - com.rsa.sslj.x.ag.a(byte[], int, int) @bci=7 (Compiled frame)
       - com.rsa.sslj.x.bS.write(byte[], int, int) @bci=7 (Compiled frame)
       - java.io.BufferedOutputStream.flushBuffer() @bci=20, line=81 (Compiled frame)
       - java.io.BufferedOutputStream.flush() @bci=1, line=142 (Compiled frame)
      - locked <0x00000000c07d9738> (a java.io.BufferedOutputStream)
       - java.io.PrintStream.flush() @bci=12, line=417 (Compiled frame)
      - locked <0x00000000c07d9710> (a java.io.PrintStream)
       - com.rsa.test.performance.framework.client.HttpClientHandler$1.run() @bci=126, line=227 (Compiled frame)


      "Keep-Alive-Timer" #382 daemon prio=8 tid=0x00007f01643bb000 nid=0x3002 waiting on condition [0x00007f01494d8000]
         java.lang.Thread.State: TIMED_WAITING (sleeping)
         JavaThread state: _thread_blocked
       - java.lang.Thread.sleep(long) @bci=0 (Interpreted frame)
       - sun.net.www.http.KeepAliveCache.run() @bci=3, line=168 (Interpreted frame)
       - java.lang.Thread.run() @bci=11, line=834 (Interpreted frame)
       - jdk.internal.misc.InnocuousThread.run() @bci=20, line=134 (Interpreted frame)


      "Common-Cleaner" #9 daemon prio=8 tid=0x00007f016418d800 nid=0x2df1 in Object.wait() [0x00007f014a82c000]
         java.lang.Thread.State: TIMED_WAITING (on object monitor)
         JavaThread state: _thread_blocked
       - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
      - waiting on <0x00000000d5796008> (a java.lang.ref.ReferenceQueue$Lock)
       - java.lang.ref.ReferenceQueue.remove(long) @bci=59, line=155 (Interpreted frame)
      - waiting to re-lock in wait() <0x00000000d5796008> (a java.lang.ref.ReferenceQueue$Lock)
       - jdk.internal.ref.CleanerImpl.run() @bci=65, line=148 (Interpreted frame)
       - java.lang.Thread.run() @bci=11, line=834 (Interpreted frame)
       - jdk.internal.misc.InnocuousThread.run() @bci=20, line=134 (Interpreted frame)


      "Signal Dispatcher" #4 daemon prio=9 tid=0x00007f0164116000 nid=0x2deb runnable [0x0000000000000000]
         java.lang.Thread.State: RUNNABLE
         JavaThread state: _thread_blocked


      "Finalizer" #3 daemon prio=8 tid=0x00007f0164103800 nid=0x2dea in Object.wait() [0x00007f014b254000]
         java.lang.Thread.State: WAITING (on object monitor)
         JavaThread state: _thread_blocked
       - java.lang.Object.wait(long) @bci=0 (Interpreted frame)
      - waiting on <0x00000000d5795818> (a java.lang.ref.ReferenceQueue$Lock)
       - java.lang.ref.ReferenceQueue.remove(long) @bci=59, line=155 (Interpreted frame)
      - waiting to re-lock in wait() <0x00000000d5795818> (a java.lang.ref.ReferenceQueue$Lock)
       - java.lang.ref.ReferenceQueue.remove() @bci=2, line=176 (Interpreted frame)
       - java.lang.ref.Finalizer$FinalizerThread.run() @bci=37, line=170 (Interpreted frame)


      "Reference Handler" #2 daemon prio=10 tid=0x00007f01640ff800 nid=0x2de9 waiting on condition [0x00007f014b355000]
         java.lang.Thread.State: RUNNABLE
         JavaThread state: _thread_blocked
       - java.lang.ref.Reference.waitForReferencePendingList() @bci=0 (Interpreted frame)
       - java.lang.ref.Reference.processPendingReferences() @bci=0, line=241 (Interpreted frame)
       - java.lang.ref.Reference$ReferenceHandler.run() @bci=0, line=213 (Interpreted frame)


      "main" #1 prio=5 tid=0x00007f0164015000 nid=0x2de7 waiting on condition [0x00007f016ac87000]
         java.lang.Thread.State: WAITING (parking)
         JavaThread state: _thread_blocked
       - jdk.internal.misc.Unsafe.park(boolean, long) @bci=0 (Compiled frame; information may be imprecise)
      - parking to wait for <0x00000000d5de0f20> (a java/util/concurrent/CountDownLatch$Sync)
       - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=194 (Compiled frame)
       - java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt() @bci=1, line=885 (Interpreted frame)
       - java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(int) @bci=55, line=1039 (Interpreted frame)
       - java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(int) @bci=24, line=1345 (Interpreted frame)
       - java.util.concurrent.CountDownLatch.await() @bci=5, line=232 (Interpreted frame)
       - com.rsa.test.performance.framework.client.HttpClientHandler.startTest(int, int, int, java.lang.String, java.lang.String, java.net.URL) @bci=177, line=274 (Interpreted frame)
       - com.rsa.test.performance.framework.client.HttpClientHandler.runTest() @bci=254, line=153 (Interpreted frame)
       - com.rsa.test.performance.framework.client.HttpClient.start() @bci=14, line=66 (Interpreted frame)
       - com.rsa.test.performance.framework.client.HttpClient.main(java.lang.String[]) @bci=277, line=137 (Interpreted frame)

      *************************************************************
      Output of jhsdb jmap:
      Attaching to core core from executable /emc/bnebill/antjava/linux/x64/sun/11/bin/java, please wait...
      Debugger attached successfully.
      Server compiler detected.
      JVM version is 11.0.6+8-LTS
      0x0000000000400000 8K /emc/bnebill/antjava/linux/x64/sun/11/bin/java
      0x00007f016a86a000 102K /lib/x86_64-linux-gnu/libz.so.1
      0x00007f016a64d000 135K /lib/x86_64-linux-gnu/libpthread.so.0
      0x00007f016a43c000 77K /emc/bnebill/antjava/linux/x64/sun/11_06/bin/../lib/jli/libjli.so
      0x00007f016a238000 14K /lib/x86_64-linux-gnu/libdl.so.2
      0x00007f0169e6e000 1825K /lib/x86_64-linux-gnu/libc.so.6
      0x00007f016aa84000 158K /lib64/ld-linux-x86-64.so.2
      0x00007f01689df000 22295K /emc/bnebill/antjava/linux/x64/sun/11_06/lib/server/libjvm.so
      0x00007f01686d6000 1063K /lib/x86_64-linux-gnu/libm.so.6
      0x00007f01684ce000 30K /lib/x86_64-linux-gnu/librt.so.1
      0x00007f01682bf000 64K /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libverify.so
      0x00007f0168094000 207K /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libjava.so
      0x00007f0163dee000 46K /lib/x86_64-linux-gnu/libnss_files.so.2
      0x00007f0163be2000 46K /lib/x86_64-linux-gnu/libnss_nis.so.2
      0x00007f01639c9000 90K /lib/x86_64-linux-gnu/libnsl.so.1
      0x00007f01637c1000 37K /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libzip.so
      0x00007f01635a4000 137K /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libjimage.so
      0x00007f014a51c000 85K /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libnio.so
      0x00007f014a304000 113K /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libnet.so
      0x00007f0149d01000 12K /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libextnet.so
      0x00007f0149afe000 10K /lib/x86_64-linux-gnu/libnss_mdns4_minimal.so.2
      0x00007f01498f7000 26K /lib/x86_64-linux-gnu/libnss_dns.so.2
      0x00007f01496dc000 98K /lib/x86_64-linux-gnu/libresolv.so.2
      0x00007f014898b000 312K /emc/bnebill/antjava/linux/x64/sun/11_06/lib/libsunec.so

      *******************************************************************
      Output of jhsdb jinfo:
      Attaching to core core from executable /emc/bnebill/antjava/linux/x64/sun/11/bin/java, please wait...
      Debugger attached successfully.
      Server compiler detected.
      JVM version is 11.0.6+8-LTS
      Java System Properties:

      awt.toolkit = sun.awt.X11.XToolkit
      java.specification.version = 11
      sun.cpu.isalist =
      sun.jnu.encoding = UTF-8
      java.class.path = /tmp/bnebill/client/lib/sslj-7.0-RC2-7.0.0.0.jar:/tmp/bnebill/client/lib/sslj_performance.jar:/tmp/bnebill/client/lib/asn1x-4.2.jar:/tmp/bnebill/client/lib/sslj-test-7.0-RC2-7.0.0.0.jar:/tmp/bnebill/client/lib/asn1x-test-4.2.jar:/tmp/bnebill/client/lib/sslj.performance.nonfips.linux_x64.jar:/tmp/bnebill/client/lib/junit-4.12.jar:/tmp/bnebill/client/lib/asn1x_NoObf-4.2.jar:/tmp/bnebill/client/lib/gson-1.7.1-1.7.1.jar:/tmp/bnebill/client/lib/hamcrest-core-1.3.jar:/tmp/bnebill/client/lib/cryptoj-6.2.5.1-RC3-6.2.5.1.jar
      java.vm.vendor = Oracle Corporation
      sun.arch.data.model = 64
      java.vendor.url = http://java.oracle.com/
      user.timezone = Australia/Brisbane
      com.rsa.cryptoj.connect.timeout = 5000
      os.name = Linux
      sun.java.launcher = SUN_STANDARD
      sun.boot.library.path = /emc/bnebill/antjava/linux/x64/sun/11_06/lib
      sun.java.command = com.rsa.test.performance.framework.client.HttpClient -random CTRDRBG -httpport 38888 -httpsport 38889 -server prf-rh7x64-02 -json sunjsse.json -resultDir /tmp/bnebill/client/results
      jdk.debug = release
      sun.cpu.endian = little
      user.home = /emc/raisoc
      user.language = en
      java.specification.vendor = Oracle Corporation
      java.version.date = 2020-01-14
      java.home = /emc/bnebill/antjava/linux/x64/sun/11_06
      file.separator = /
      java.vm.compressedOopsMode = 32-bit
      line.separator =

      java.specification.name = Java Platform API Specification
      java.awt.graphicsenv = sun.awt.X11GraphicsEnvironment
      sun.management.compiler = HotSpot 64-Bit Tiered Compilers
      java.runtime.version = 11.0.6+8-LTS
      user.name = raisoc
      path.separator = :
      os.version = 4.4.0-193-generic
      java.runtime.name = Java(TM) SE Runtime Environment
      file.encoding = UTF-8
      java.vm.name = Java HotSpot(TM) 64-Bit Server VM
      java.vendor.version = 18.9
      java.vendor.url.bug = http://bugreport.java.com/bugreport/
      java.io.tmpdir = /tmp
      java.version = 11.0.6
      user.dir = /emc/raisoc
      os.arch = amd64
      java.vm.specification.name = Java Virtual Machine Specification
      java.awt.printerjob = sun.print.PSPrinterJob
      sun.os.patch.level = unknown
      java.library.path = /usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib
      java.vendor = Oracle Corporation
      java.vm.version = 11.0.6+8-LTS
      sun.io.unicode.encoding = UnicodeLittle
      java.class.version = 55.0

      VM Flags:
      Non-default VM flags: -XX:CICompilerCount=2 -XX:InitialHeapSize=33554432 -XX:MaxHeapSize=1073741824 -XX:MaxNewSize=357892096 -XX:MinHeapDeltaBytes=196608 -XX:NewSize=11141120 -XX:NonNMethodCodeHeapSize=5825164 -XX:NonProfiledCodeHeapSize=122916538 -XX:OldSize=22413312 -XX:ProfiledCodeHeapSize=122916538 -XX:ReservedCodeCacheSize=251658240 -XX:+SegmentedCodeCache -XX:+UseCompressedClassPointers -XX:+UseCompressedOops -XX:+UseFastUnorderedTimeStamps -XX:+UseSerialGC
      Command line: -Xmx1024m

      ***************************************************************
      Output of jhsdb jsnap:
      Attaching to core core from executable /emc/bnebill/antjava/linux/x64/sun/11/bin/java, please wait...
      Debugger attached successfully.
      Server compiler detected.
      JVM version is 11.0.6+8-LTS
      java.threads.started=387 event(s)
      java.threads.live=16
      java.threads.livePeak=16
      java.threads.daemon=5
      java.cls.loadedClasses=3056 event(s)
      java.cls.unloadedClasses=0 event(s)
      java.cls.sharedLoadedClasses=0 event(s)
      java.cls.sharedUnloadedClasses=0 event(s)
      java.ci.totalTime=206815861734 tick(s)
      java.property.java.vm.specification.version=11
      java.property.java.vm.specification.name=Java Virtual Machine Specification
      java.property.java.vm.specification.vendor=Oracle Corporation
      java.property.java.vm.version=11.0.6+8-LTS
      java.property.java.vm.name=Java HotSpot(TM) 64-Bit Server VM
      java.property.java.vm.vendor=Oracle Corporation
      java.property.java.vm.info=mixed mode
      java.property.jdk.debug=release
      java.property.java.library.path=/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib
      java.property.java.class.path=/tmp/bnebill/client/lib/sslj-7.0-RC2-7.0.0.0.jar:/tmp/bnebill/client/lib/sslj_performance.jar:/tmp/bnebill/client/lib/asn1x-4.2.jar:/tmp/bnebill/client/lib/sslj-test-7.0-RC2-7.0.0.0.jar:/tmp/bnebill/client/lib/asn1x-test-4.2.jar:/tmp/bnebill/client/lib/sslj.performance.nonfips.linux_x64.jar:/tmp/bnebill/client/lib/junit-4.12.jar:/tmp/bnebill/client/lib/asn1x_NoObf-4.2.jar:/tmp/bnebill/client/lib/gson-1.7.1-1.7.1.jar:/tmp/bnebill/client/lib/hamcrest-core-1.3.jar:/tmp/bnebill/client/lib/cryptoj-6.2.5.1-RC3-6.2.5.1.jar
      java.property.java.version=11.0.6
      java.property.java.home=/emc/bnebill/antjava/linux/x64/sun/11_06
      java.rt.vmFlags=
      java.rt.vmArgs=-Xmx1024m


      REGRESSION : Last worked in version 8

      STEPS TO FOLLOW TO REPRODUCE THE PROBLEM :
      This bug occurs while performance testing TLS connections using a commercial cryptographic toolkit. It would not be feasible for you to reproduce it.


      FREQUENCY : often


        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              webbuggrp Webbug Group
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: