Uploaded image for project: 'JDK'
  1. JDK
  2. JDK-8029166

SIGSEGV during garbage collection in Apache Lucene with ConcMarkSweepGC on JDK 8

    XMLWordPrintable

    Details

    • Subcomponent:
      gc
    • OS:
      linux

      Description

      FULL PRODUCT VERSION :
      Java HotSpot(TM) Client VM (25.0-b58) for linux-x86 JRE (1.8.0-ea-b116), built on Nov 14 2013 01:52:44 by "java_re" with gcc 4.3.0 20080428 (Red Hat 4.3.0-8)

      FULL OS VERSION :
      Linux 3.8.0-33-generic #48~precise1-Ubuntu SMP Thu Oct 24 16:28:06 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux

      EXTRA RELEVANT SYSTEM CONFIGURATION :
      JVM config used: -client -XX:+UseConcMarkSweepGC

      A DESCRIPTION OF THE PROBLEM :
      Garbage collection SIGSEGVs with the following output:

      # A fatal error has been detected by the Java Runtime Environment:
      #
      # SIGSEGV (0xb) at pc=0xf6fc55f1, pid=11654, tid=4098882368
      #
      # JRE version: Java(TM) SE Runtime Environment (8.0-b116) (build 1.8.0-ea-b116)
      # Java VM: Java HotSpot(TM) Client VM (25.0-b58 mixed mode linux-x86 )
      # Problematic frame:
      # V [libjvm.so+0x4475f1] ObjArrayKlass::oop_oop_iterate_nv(oopDesc*, ParScanWithoutBarrierClosure*)+0x61
      #
      # Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
      #
      # If you would like to submit a bug report, please visit:
      # http://bugreport.sun.com/bugreport/crash.jsp

      The full stack trace from hs_err.pid is:

      Stack: [0xf447f000,0xf4500000], sp=0xf44fef90, free space=511k
      Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
      V [libjvm.so+0x4475f1] ObjArrayKlass::oop_oop_iterate_nv(oopDesc*, ParScanWithoutBarrierClosure*)+0x61
      V [libjvm.so+0x47326f] ParScanThreadState::trim_queues(int)+0xdf
      V [libjvm.so+0x473762] ParEvacuateFollowersClosure::do_void()+0x22
      V [libjvm.so+0x4736ed] ParNewGenTask::work(unsigned int)+0x12d
      V [libjvm.so+0x58b6d9] GangWorker::loop()+0xe9
      V [libjvm.so+0x58b2c8] GangWorker::run()+0x18
      V [libjvm.so+0x461689] java_start(Thread*)+0x119
      C [libpthread.so.0+0x6d4c] start_thread+0xcc

      As garbage collections runs in parallel to main application logic this is not easy reproducible. We are filing the bug report, because Apahe Lucene's 24/7 tests have never seen this before and looks like a new regression. Maybe a review of the code from the above stack trace shows something like a missing NULL check or whatever.

      THE PROBLEM WAS REPRODUCIBLE WITH -Xint FLAG: Did not try

      THE PROBLEM WAS REPRODUCIBLE WITH -server FLAG: Did not try

      REGRESSION. Last worked in version 7u45

      STEPS TO FOLLOW TO REPRODUCE THE PROBLEM :
      Happens from time to time when running Apache Lucene tests (see http://jenkins.thetaphi.de/, especially this build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/8349/ )

      EXPECTED VERSUS ACTUAL BEHAVIOR :
      The JVM should not crash.
      ERROR MESSAGES/STACK TRACES THAT OCCUR :
      #
      # A fatal error has been detected by the Java Runtime Environment:
      #
      # SIGSEGV (0xb) at pc=0xf6fc55f1, pid=11654, tid=4098882368
      #
      # JRE version: Java(TM) SE Runtime Environment (8.0-b116) (build 1.8.0-ea-b116)
      # Java VM: Java HotSpot(TM) Client VM (25.0-b58 mixed mode linux-x86 )
      # Problematic frame:
      # V [libjvm.so+0x4475f1] ObjArrayKlass::oop_oop_iterate_nv(oopDesc*, ParScanWithoutBarrierClosure*)+0x61
      #
      # Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
      #
      # If you would like to submit a bug report, please visit:
      # http://bugreport.sun.com/bugreport/crash.jsp
      #

      --------------- T H R E A D ---------------

      Current thread (0xf6a14000): GCTaskThread [stack: 0xf447f000,0xf4500000] [id=11664]

      siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR), si_addr=0x00000004

      Registers:
      EAX=0x00000001, EBX=0xd38e7398, ECX=0xf6a1b9fc, EDX=0x00000000
      ESP=0xf44fef90, EBP=0xf44fefb8, ESI=0xd8587934, EDI=0x00000001
      EIP=0xf6fc55f1, EFLAGS=0x00010293, CR2=0x00000004

        Top of Stack: (sp=0xf44fef90)
      0xf44fef90: f6a14000 00000004 00000001 004679aa
      0xf44fefa0: d896dedc 00000002 fffffff8 f6a1d228
      0xf44fefb0: d0f9687c 00000001 f44ff008 f6ff126f
      0xf44fefc0: d23291a8 d77cf828 d0f9687c 00000001
      0xf44fefd0: d0f969c0 d0f9687c d0f968a8 f6a1b6c4
      0xf44fefe0: 01a1b6d0 f6a9d5b0 f6a1b6c4 e06111e0
      0xf44feff0: 0a261d78 0a271d78 d77cf828 d0f96958
      0xf44ff000: f6a1ced0 f6a6d430 f44ff058 f6ff1762

      Instructions: (pc=0xf6fc55f1)
      0xf6fc55d1: 1e 85 db 74 6b 8b 45 10 39 58 28 76 63 8b 3b 8b
      0xf6fc55e1: 53 04 89 f8 83 e0 03 83 f8 03 0f 84 97 00 00 00
      0xf6fc55f1: 8b 4a 04 83 f9 00 0f 8e 9b 00 00 00 f6 c1 01 0f
      0xf6fc5601: 85 94 00 00 00 c1 f9 02 89 4d dc 8b 4d 10 80 3d

      Register to memory mapping:

      EAX=0x00000001 is an unknown value
      EBX=
      [error occurred during error reporting (printing register info), id 0xb]

      Stack: [0xf447f000,0xf4500000], sp=0xf44fef90, free space=511k
      Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
      V [libjvm.so+0x4475f1] ObjArrayKlass::oop_oop_iterate_nv(oopDesc*, ParScanWithoutBarrierClosure*)+0x61
      V [libjvm.so+0x47326f] ParScanThreadState::trim_queues(int)+0xdf
      V [libjvm.so+0x473762] ParEvacuateFollowersClosure::do_void()+0x22
      V [libjvm.so+0x4736ed] ParNewGenTask::work(unsigned int)+0x12d
      V [libjvm.so+0x58b6d9] GangWorker::loop()+0xe9
      V [libjvm.so+0x58b2c8] GangWorker::run()+0x18
      V [libjvm.so+0x461689] java_start(Thread*)+0x119
      C [libpthread.so.0+0x6d4c] start_thread+0xcc


      --------------- P R O C E S S ---------------

      Java Threads: ( => current thread )
        0xd2811800 JavaThread "TEST-TestPagedBytes.testDataInputOutput2-seed#[3861E4A6DB805158]" [_thread_blocked, id=15385, stack(0xd2b00000,0xd2b51000)]
        0xd15ccc00 JavaThread "SUITE-TestPagedBytes-seed#[3861E4A6DB805158]" [_thread_blocked, id=15384, stack(0xf3804000,0xf3855000)]
        0xd1e80c00 JavaThread "Service Thread" daemon [_thread_blocked, id=11703, stack(0xf3a2e000,0xf3a7f000)]
        0xd1e75400 JavaThread "C1 CompilerThread0" daemon [_thread_blocked, id=11702, stack(0xd1715000,0xd1796000)]
        0xd1e73c00 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=11701, stack(0xf3c2e000,0xf3c7f000)]
        0xd1e72400 JavaThread "Surrogate Locker Thread (Concurrent GC)" daemon [_thread_blocked, id=11700, stack(0xf3e2e000,0xf3e7f000)]
        0xd1e11800 JavaThread "Finalizer" daemon [_thread_blocked, id=11694, stack(0xf402e000,0xf407f000)]
        0xd1e10000 JavaThread "Reference Handler" daemon [_thread_blocked, id=11693, stack(0xf422e000,0xf427f000)]
        0xf6a0a800 JavaThread "main" [_thread_blocked, id=11657, stack(0xf6b01000,0xf6b52000)]

      Other Threads:
        0xd1e0cc00 VMThread [stack: 0xd1f60000,0xd1fe1000] [id=11690]
        0xd1e82c00 WatcherThread [stack: 0xd1694000,0xd1715000] [id=11704]

      =>0xf6a14000 (exited) GCTaskThread [stack: 0xf447f000,0xf4500000] [id=11664]

      VM state:at safepoint (normal execution)

      VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
      [0xf6a08038] Threads_lock - owner thread: 0xd1e0cc00
      [0xf6a084b0] Heap_lock - owner thread: 0xd2811800

      Heap:
       par new generation total 116864K, used 114353K [0xd3800000, 0xdb6c0000, 0xde2a0000)
        eden space 103936K, 97% used [0xd3800000, 0xd9b0c598, 0xd9d80000)
        from space 12928K, 100% used [0xdaa20000, 0xdb6c0000, 0xdb6c0000)
        to space 12928K, 90% used [0xd9d80000, 0xda8ee050, 0xdaa20000)
       concurrent mark-sweep generation total 340944K, used 274668K [0xde2a0000, 0xf2f94000, 0xf3800000)
       Metaspace used 11824K, capacity 11928K, committed 12056K, reserved 12592K

      Card table byte_map: [0xd36ff000,0xd3800000] byte_map_base: 0xd3063000

      Marking Bits: (CMSBitMap*) 0xf6ad99e8
       Bits: [0xd2c53000, 0xd36fe000)

      Mod Union Table: (CMSBitMap*) 0xf6ad9a48
       Bits: [0xf4854000, 0xf4869560)

      Polling page: 0xf77a2000

      CodeCache: size=32768Kb used=15739Kb max_used=15739Kb free=17028Kb
       bounds [0xf496b000, 0xf58d3000, 0xf696b000]
       total_blobs=8085 nmethods=7863 adapters=154
       compilation: enabled

      Compilation events (10 events):
      Event: 463.953 Thread 0xd1e75400 8036 org.apache.lucene.search.TestRegexpRandom2$DumbRegexpQuery::<init> (37 bytes)
      Event: 463.954 Thread 0xd1e75400 nmethod 8036 0xf58c43c8 code [0xf58c4510, 0xf58c4700]
      Event: 465.837 Thread 0xd1e75400 8037 java.lang.Class::createAnnotationData (192 bytes)
      Event: 465.838 Thread 0xd1e75400 nmethod 8037 0xf58c4888 code [0xf58c4ab0, 0xf58c4f38]
      Event: 466.632 Thread 0xd1e75400 8038 org.apache.lucene.util.PagedBytes$PagedBytesDataInput::nextBlock (39 bytes)
      Event: 466.633 Thread 0xd1e75400 nmethod 8038 0xf58c54c8 code [0xf58c55d0, 0xf58c56bc]
      Event: 466.669 Thread 0xd1e75400 8039 % org.apache.lucene.util.TestPagedBytes::testDataInputOutput2 @ 175 (376 bytes)
      Event: 466.673 Thread 0xd1e75400 nmethod 8039% 0xf58c5788 code [0xf58c5c30, 0xf58c6d38]
      Event: 466.674 Thread 0xd1e75400 8040 % org.apache.lucene.util.TestPagedBytes::testDataInputOutput2 @ 323 (376 bytes)
      Event: 466.678 Thread 0xd1e75400 nmethod 8040% 0xf58c9d48 code [0xf58ca1f0, 0xf58cb358]

      GC Heap History (10 events):
      Event: 465.907 GC heap after
      Heap after GC invocations=6014 (full 22):
       par new generation total 116864K, used 226K [0xd3800000, 0xdb6c0000, 0xde2a0000)
        eden space 103936K, 0% used [0xd3800000, 0xd3800000, 0xd9d80000)
        from space 12928K, 1% used [0xdaa20000, 0xdaa58b28, 0xdb6c0000)
        to space 12928K, 0% used [0xd9d80000, 0xd9d80000, 0xdaa20000)
       concurrent mark-sweep generation total 272984K, used 177550K [0xde2a0000, 0xeed36000, 0xf3800000)
       Metaspace used 11817K, capacity 11928K, committed 12056K, reserved 12592K
      }
      Event: 467.287 GC heap before
      {Heap before GC invocations=6014 (full 22):
       par new generation total 116864K, used 103536K [0xd3800000, 0xdb6c0000, 0xde2a0000)
        eden space 103936K, 99% used [0xd3800000, 0xd9ce37c0, 0xd9d80000)
        from space 12928K, 1% used [0xdaa20000, 0xdaa58b28, 0xdb6c0000)
        to space 12928K, 0% used [0xd9d80000, 0xd9d80000, 0xdaa20000)
       concurrent mark-sweep generation total 272984K, used 177550K [0xde2a0000, 0xeed36000, 0xf3800000)
       Metaspace used 11824K, capacity 11928K, committed 12056K, reserved 12592K
      Event: 467.304 GC heap after
      Heap after GC invocations=6015 (full 22):
       par new generation total 116864K, used 12928K [0xd3800000, 0xdb6c0000, 0xde2a0000)
        eden space 103936K, 0% used [0xd3800000, 0xd3800000, 0xd9d80000)
        from space 12928K, 100% used [0xd9d80000, 0xdaa20000, 0xdaa20000)
        to space 12928K, 0% used [0xdaa20000, 0xdaa20000, 0xdb6c0000)
       concurrent mark-sweep generation total 272984K, used 178198K [0xde2a0000, 0xeed36000, 0xf3800000)
       Metaspace used 11824K, capacity 11928K, committed 12056K, reserved 12592K
      }
      Event: 467.861 GC heap before
      {Heap before GC invocations=6015 (full 22):
       par new generation total 116864K, used 116683K [0xd3800000, 0xdb6c0000, 0xde2a0000)
        eden space 103936K, 99% used [0xd3800000, 0xd9d52ed0, 0xd9d80000)
        from space 12928K, 100% used [0xd9d80000, 0xdaa20000, 0xdaa20000)
        to space 12928K, 0% used [0xdaa20000, 0xdaa20000, 0xdb6c0000)
       concurrent mark-sweep generation total 272984K, used 178198K [0xde2a0000, 0xeed36000, 0xf3800000)
       Metaspace used 11824K, capacity 11928K, committed 12056K, reserved 12592K
      Event: 467.864 GC heap after
      Heap after GC invocations=6016 (full 22):
       par new generation total 116864K, used 2363K [0xd3800000, 0xdb6c0000, 0xde2a0000)
        eden space 103936K, 0% used [0xd3800000, 0xd3800000, 0xd9d80000)
        from space 12928K, 18% used [0xdaa20000, 0xdac6edc0, 0xdb6c0000)
        to space 12928K, 0% used [0xd9d80000, 0xd9d80000, 0xdaa20000)
       concurrent mark-sweep generation total 272984K, used 178292K [0xde2a0000, 0xeed36000, 0xf3800000)
       Metaspace used 11824K, capacity 11928K, committed 12056K, reserved 12592K
      }
      Event: 468.381 GC heap before
      {Heap before GC invocations=6016 (full 22):
       par new generation total 116864K, used 106299K [0xd3800000, 0xdb6c0000, 0xde2a0000)
        eden space 103936K, 100% used [0xd3800000, 0xd9d80000, 0xd9d80000)
        from space 12928K, 18% used [0xdaa20000, 0xdac6edc0, 0xdb6c0000)
        to space 12928K, 0% used [0xd9d80000, 0xd9d80000, 0xdaa20000)
       concurrent mark-sweep generation total 272984K, used 178292K [0xde2a0000, 0xeed36000, 0xf3800000)
       Metaspace used 11824K, capacity 11928K, committed 12056K, reserved 12592K
      Event: 468.495 GC heap after
      Heap after GC invocations=6017 (full 22):
       par new generation total 116864K, used 12928K [0xd3800000, 0xdb6c0000, 0xde2a0000)
        eden space 103936K, 0% used [0xd3800000, 0xd3800000, 0xd9d80000)
        from space 12928K, 100% used [0xd9d80000, 0xdaa20000, 0xdaa20000)
        to space 12928K, 0% used [0xdaa20000, 0xdaa20000, 0xdb6c0000)
       concurrent mark-sweep generation total 282008K, used 202873K [0xde2a0000, 0xef606000, 0xf3800000)
       Metaspace used 11824K, capacity 11928K, committed 12056K, reserved 12592K
      }
      Event: 468.672 GC heap before
      {Heap before GC invocations=6017 (full 22):
       par new generation total 116864K, used 116864K [0xd3800000, 0xdb6c0000, 0xde2a0000)
        eden space 103936K, 100% used [0xd3800000, 0xd9d80000, 0xd9d80000)
        from space 12928K, 100% used [0xd9d80000, 0xdaa20000, 0xdaa20000)
        to space 12928K, 0% used [0xdaa20000, 0xdaa20000, 0xdb6c0000)
       concurrent mark-sweep generation total 282008K, used 202873K [0xde2a0000, 0xef606000, 0xf3800000)
       Metaspace used 11824K, capacity 11928K, committed 12056K, reserved 12592K
      Event: 468.928 GC heap after
      Heap after GC invocations=6018 (full 22):
       par new generation total 116864K, used 12928K [0xd3800000, 0xdb6c0000, 0xde2a0000)
        eden space 103936K, 0% used [0xd3800000, 0xd3800000, 0xd9d80000)
        from space 12928K, 100% used [0xdaa20000, 0xdb6c0000, 0xdb6c0000)
        to space 12928K, 0% used [0xd9d80000, 0xd9d80000, 0xdaa20000)
       concurrent mark-sweep generation total 328016K, used 261702K [0xde2a0000, 0xf22f4000, 0xf3800000)
       Metaspace used 11824K, capacity 11928K, committed 12056K, reserved 12592K
      }
      Event: 469.200 GC heap before
      {Heap before GC invocations=6018 (full 23):
       par new generation total 116864K, used 114353K [0xd3800000, 0xdb6c0000, 0xde2a0000)
        eden space 103936K, 97% used [0xd3800000, 0xd9b0c598, 0xd9d80000)
        from space 12928K, 100% used [0xdaa20000, 0xdb6c0000, 0xdb6c0000)
        to space 12928K, 0% used [0xd9d80000, 0xd9d80000, 0xdaa20000)
       concurrent mark-sweep generation total 328016K, used 261702K [0xde2a0000, 0xf22f4000, 0xf3800000)
       Metaspace used 11824K, capacity 11928K, committed 12056K, reserved 12592K

      Deoptimization events (0 events):
      No events

      Internal exceptions (10 events):
      Event: 466.614 Thread 0xd2811800 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0xd6ec41c0) thrown at [/HUDSON/workspace/8-2-build-linux-i586/jdk8/742/hotspot/src/share/vm/runtime/sharedRuntime.cpp, line 593]
      Event: 466.616 Thread 0xd2811800 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0xd6f8ce70) thrown at [/HUDSON/workspace/8-2-build-linux-i586/jdk8/742/hotspot/src/share/vm/runtime/sharedRuntime.cpp, line 593]
      Event: 466.616 Thread 0xd2811800 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0xd6f8fe00) thrown at [/HUDSON/workspace/8-2-build-linux-i586/jdk8/742/hotspot/src/share/vm/runtime/sharedRuntime.cpp, line 593]
      Event: 466.616 Thread 0xd2811800 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0xd6fa10c0) thrown at [/HUDSON/workspace/8-2-build-linux-i586/jdk8/742/hotspot/src/share/vm/runtime/sharedRuntime.cpp, line 593]
      Event: 466.616 Thread 0xd2811800 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0xd6fa4150) thrown at [/HUDSON/workspace/8-2-build-linux-i586/jdk8/742/hotspot/src/share/vm/runtime/sharedRuntime.cpp, line 593]
      Event: 466.617 Thread 0xd2811800 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0xd6fec058) thrown at [/HUDSON/workspace/8-2-build-linux-i586/jdk8/742/hotspot/src/share/vm/runtime/sharedRuntime.cpp, line 593]
      Event: 466.617 Thread 0xd2811800 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0xd702f220) thrown at [/HUDSON/workspace/8-2-build-linux-i586/jdk8/742/hotspot/src/share/vm/runtime/sharedRuntime.cpp, line 593]
      Event: 466.618 Thread 0xd2811800 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0xd703fa78) thrown at [/HUDSON/workspace/8-2-build-linux-i586/jdk8/742/hotspot/src/share/vm/runtime/sharedRuntime.cpp, line 593]
      Event: 466.619 Thread 0xd2811800 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0xd70f0ee8) thrown at [/HUDSON/workspace/8-2-build-linux-i586/jdk8/742/hotspot/src/share/vm/runtime/sharedRuntime.cpp, line 593]
      Event: 466.619 Thread 0xd2811800 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0xd70f4f30) thrown at [/HUDSON/workspace/8-2-build-linux-i586/jdk8/742/hotspot/src/share/vm/runtime/sharedRuntime.cpp, line 593]

      Events (10 events):
      Event: 467.304 Executing VM operation: GenCollectForAllocation done
      Event: 467.861 Executing VM operation: GenCollectForAllocation
      Event: 467.864 Executing VM operation: GenCollectForAllocation done
      Event: 468.381 Executing VM operation: GenCollectForAllocation
      Event: 468.495 Executing VM operation: GenCollectForAllocation done
      Event: 468.672 Executing VM operation: GenCollectForAllocation
      Event: 468.928 Executing VM operation: GenCollectForAllocation done
      Event: 468.932 Executing VM operation: CMS_Initial_Mark
      Event: 468.938 Executing VM operation: CMS_Initial_Mark done
      Event: 469.200 Executing VM operation: GenCollectForAllocation


      Dynamic libraries:
      08048000-08049000 r-xp 00000000 09:01 25223403 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/bin/java
      08049000-0804a000 rw-p 00000000 09:01 25223403 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/bin/java
      091f4000-09215000 rw-p 00000000 00:00 0 [heap]
      cf9e5000-cfe5e000 rw-p 00000000 00:00 0
      cfe5e000-cfe61000 ---p 00000000 00:00 0
      cfe61000-cfeaf000 rw-p 00000000 00:00 0
      cfeaf000-cfeb2000 ---p 00000000 00:00 0
      cfeb2000-cff80000 rw-p 00000000 00:00 0
      cff80000-d0000000 ---p 00000000 00:00 0
      d0000000-d00f9000 rw-p 00000000 00:00 0
      d00f9000-d0100000 ---p 00000000 00:00 0
      d010a000-d010d000 ---p 00000000 00:00 0
      d010d000-d015b000 rw-p 00000000 00:00 0
      d015b000-d015e000 ---p 00000000 00:00 0
      d015e000-d01ac000 rw-p 00000000 00:00 0
      d01ac000-d01af000 ---p 00000000 00:00 0
      d01af000-d02fd000 rw-p 00000000 00:00 0
      d02fd000-d0300000 ---p 00000000 00:00 0
      d0300000-d034e000 rw-p 00000000 00:00 0
      d034e000-d0351000 ---p 00000000 00:00 0
      d0351000-d039f000 rw-p 00000000 00:00 0
      d039f000-d03a2000 ---p 00000000 00:00 0
      d03a2000-d04f0000 rw-p 00000000 00:00 0
      d04f0000-d04f3000 ---p 00000000 00:00 0
      d04f3000-d0541000 rw-p 00000000 00:00 0
      d0541000-d0544000 ---p 00000000 00:00 0
      d0544000-d0592000 rw-p 00000000 00:00 0
      d0592000-d0595000 ---p 00000000 00:00 0
      d0595000-d05e3000 rw-p 00000000 00:00 0
      d05e3000-d05e6000 ---p 00000000 00:00 0
      d05e6000-d0634000 rw-p 00000000 00:00 0
      d0634000-d0637000 ---p 00000000 00:00 0
      d0637000-d0685000 rw-p 00000000 00:00 0
      d0685000-d0688000 ---p 00000000 00:00 0
      d0688000-d06d6000 rw-p 00000000 00:00 0
      d06d6000-d06d9000 ---p 00000000 00:00 0
      d06d9000-d0727000 rw-p 00000000 00:00 0
      d0727000-d072a000 ---p 00000000 00:00 0
      d072a000-d0778000 rw-p 00000000 00:00 0
      d0778000-d077b000 ---p 00000000 00:00 0
      d077b000-d07c9000 rw-p 00000000 00:00 0
      d07c9000-d07cc000 ---p 00000000 00:00 0
      d07cc000-d081a000 rw-p 00000000 00:00 0
      d081a000-d081d000 ---p 00000000 00:00 0
      d081d000-d086b000 rw-p 00000000 00:00 0
      d086b000-d086e000 ---p 00000000 00:00 0
      d086e000-d08bc000 rw-p 00000000 00:00 0
      d08bc000-d08bf000 ---p 00000000 00:00 0
      d08bf000-d090d000 rw-p 00000000 00:00 0
      d090d000-d0910000 ---p 00000000 00:00 0
      d0910000-d095e000 rw-p 00000000 00:00 0
      d095e000-d0961000 ---p 00000000 00:00 0
      d0961000-d09af000 rw-p 00000000 00:00 0
      d09af000-d09b2000 ---p 00000000 00:00 0
      d09b2000-d0a00000 rw-p 00000000 00:00 0
      d0a00000-d0adc000 rw-p 00000000 00:00 0
      d0adc000-d0b00000 ---p 00000000 00:00 0
      d0b00000-d0c00000 rw-p 00000000 00:00 0
      d0c00000-d0e00000 rw-p 00000000 00:00 0
      d0e00000-d0efe000 rw-p 00000000 00:00 0
      d0efe000-d0f00000 ---p 00000000 00:00 0
      d0f00000-d1000000 rw-p 00000000 00:00 0
      d1000000-d1100000 rw-p 00000000 00:00 0
      d1100000-d1200000 rw-p 00000000 00:00 0
      d1200000-d1300000 rw-p 00000000 00:00 0
      d1300000-d13f9000 rw-p 00000000 00:00 0
      d13f9000-d1400000 ---p 00000000 00:00 0
      d1400000-d1500000 rw-p 00000000 00:00 0
      d1500000-d15d2000 rw-p 00000000 00:00 0
      d15d2000-d1600000 ---p 00000000 00:00 0
      d1603000-d1643000 rw-p 00000000 00:00 0
      d1643000-d1646000 ---p 00000000 00:00 0
      d1646000-d1694000 rw-p 00000000 00:00 0
      d1694000-d1695000 ---p 00000000 00:00 0
      d1695000-d1715000 rw-p 00000000 00:00 0 [stack:11704]
      d1715000-d1718000 ---p 00000000 00:00 0
      d1718000-d1877000 rw-p 00000000 00:00 0 [stack:11702]
      d1877000-d1a00000 r--p 00000000 09:01 7439259 /usr/lib/locale/locale-archive
      d1a00000-d1a21000 rw-p 00000000 00:00 0
      d1a21000-d1b00000 ---p 00000000 00:00 0
      d1b0a000-d1b0d000 ---p 00000000 00:00 0
      d1b0d000-d1b5b000 rw-p 00000000 00:00 0
      d1b5b000-d1c00000 r--s 010b4000 09:01 25215748 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/ext/jfxrt.jar
      d1c00000-d1c8d000 rw-p 00000000 00:00 0
      d1c8d000-d1d00000 ---p 00000000 00:00 0
      d1d00000-d1dfb000 rw-p 00000000 00:00 0
      d1dfb000-d1e00000 ---p 00000000 00:00 0
      d1e00000-d1f00000 rw-p 00000000 00:00 0
      d1f0f000-d1f12000 ---p 00000000 00:00 0
      d1f12000-d1f60000 rw-p 00000000 00:00 0
      d1f60000-d1f61000 ---p 00000000 00:00 0
      d1f61000-d1fe1000 rw-p 00000000 00:00 0 [stack:11690]
      d1fe1000-d21b4000 r--s 03c80000 09:01 25182936 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/rt.jar
      d21b4000-d25fa000 rw-p 00000000 00:00 0
      d25fa000-d2600000 ---p 00000000 00:00 0
      d2600000-d2621000 rw-p 00000000 00:00 0
      d2621000-d2700000 ---p 00000000 00:00 0
      d2707000-d277f000 r--s 010d3000 09:01 24961454 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/lib/tools.jar
      d277f000-d2780000 ---p 00000000 00:00 0
      d2780000-d2800000 rw-p 00000000 00:00 0 [stack:11682]
      d2800000-d2821000 rw-p 00000000 00:00 0
      d2821000-d2900000 ---p 00000000 00:00 0
      d2900000-d29ff000 rw-p 00000000 00:00 0
      d29ff000-d2a00000 ---p 00000000 00:00 0
      d2a00000-d2afe000 rw-p 00000000 00:00 0
      d2afe000-d2b00000 ---p 00000000 00:00 0
      d2b00000-d2b03000 ---p 00000000 00:00 0
      d2b03000-d2b51000 rw-p 00000000 00:00 0 [stack:15385]
      d2b51000-d2b52000 ---p 00000000 00:00 0
      d2b52000-d2bd2000 rw-p 00000000 00:00 0 [stack:11677]
      d2bd2000-d2bd3000 ---p 00000000 00:00 0
      d2bd3000-d373f000 rw-p 00000000 00:00 0 [stack:11676]
      d373f000-d3754000 ---p 00000000 00:00 0
      d3754000-d37fb000 rw-p 00000000 00:00 0
      d37fb000-d37ff000 ---p 00000000 00:00 0
      d37ff000-db6c0000 rw-p 00000000 00:00 0
      db6c0000-de2a0000 ---p 00000000 00:00 0
      de2a0000-f2f94000 rw-p 00000000 00:00 0
      f2f94000-f3800000 ---p 00000000 00:00 0
      f3804000-f3807000 ---p 00000000 00:00 0
      f3807000-f38fc000 rw-p 00000000 00:00 0 [stack:15384]
      f38fc000-f3900000 ---p 00000000 00:00 0
      f3900000-f393b000 rw-p 00000000 00:00 0
      f393b000-f3a00000 ---p 00000000 00:00 0
      f3a2e000-f3a31000 ---p 00000000 00:00 0
      f3a31000-f3a7f000 rw-p 00000000 00:00 0 [stack:11703]
      f3a7f000-f3a80000 ---p 00000000 00:00 0
      f3a80000-f3b00000 rw-p 00000000 00:00 0 [stack:11673]
      f3b00000-f3b25000 rw-p 00000000 00:00 0
      f3b25000-f3c00000 ---p 00000000 00:00 0
      f3c2e000-f3c31000 ---p 00000000 00:00 0
      f3c31000-f3c7f000 rw-p 00000000 00:00 0 [stack:11701]
      f3c7f000-f3c80000 ---p 00000000 00:00 0
      f3c80000-f3d00000 rw-p 00000000 00:00 0 [stack:11672]
      f3d00000-f3d38000 rw-p 00000000 00:00 0
      f3d38000-f3e00000 ---p 00000000 00:00 0
      f3e12000-f3e2e000 r--s 00393000 09:01 25215749 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/ext/cldrdata.jar
      f3e2e000-f3e31000 ---p 00000000 00:00 0
      f3e31000-f3e7f000 rw-p 00000000 00:00 0 [stack:11700]
      f3e7f000-f3e80000 ---p 00000000 00:00 0
      f3e80000-f3f00000 rw-p 00000000 00:00 0 [stack:11669]
      f3f00000-f3f2d000 rw-p 00000000 00:00 0
      f3f2d000-f4000000 ---p 00000000 00:00 0
      f400c000-f4016000 r--s 00209000 09:01 25215752 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/ext/localedata.jar
      f4016000-f4029000 r-xp 00000000 09:01 46244482 /lib/i386-linux-gnu/libresolv-2.15.so
      f4029000-f402a000 ---p 00013000 09:01 46244482 /lib/i386-linux-gnu/libresolv-2.15.so
      f402a000-f402b000 r--p 00013000 09:01 46244482 /lib/i386-linux-gnu/libresolv-2.15.so
      f402b000-f402c000 rw-p 00014000 09:01 46244482 /lib/i386-linux-gnu/libresolv-2.15.so
      f402c000-f402e000 rw-p 00000000 00:00 0
      f402e000-f4031000 ---p 00000000 00:00 0
      f4031000-f407f000 rw-p 00000000 00:00 0 [stack:11694]
      f407f000-f4080000 ---p 00000000 00:00 0
      f4080000-f4100000 rw-p 00000000 00:00 0 [stack:11668]
      f4100000-f41fd000 rw-p 00000000 00:00 0
      f41fd000-f4200000 ---p 00000000 00:00 0
      f4205000-f4209000 r--s 00094000 09:01 25182845 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/jsse.jar
      f4209000-f422e000 r--s 000f6000 09:01 21971354 /var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.13.jar
      f422e000-f4231000 ---p 00000000 00:00 0
      f4231000-f427f000 rw-p 00000000 00:00 0 [stack:11693]
      f427f000-f4280000 ---p 00000000 00:00 0
      f4280000-f4300000 rw-p 00000000 00:00 0 [stack:11666]
      f4300000-f438c000 rw-p 00000000 00:00 0
      f438c000-f4400000 ---p 00000000 00:00 0
      f4403000-f4412000 r-xp 00000000 09:01 25182917 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/i386/libnio.so
      f4412000-f4413000 rw-p 0000e000 09:01 25182917 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/i386/libnio.so
      f4413000-f4431000 r--s 001bb000 09:01 24921705 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant.jar
      f4431000-f447f000 rw-p 00000000 00:00 0
      f447f000-f4480000 ---p 00000000 00:00 0
      f4480000-f4500000 rw-p 00000000 00:00 0 [stack:11664]
      f4500000-f4521000 rw-p 00000000 00:00 0
      f4521000-f4600000 ---p 00000000 00:00 0
      f4601000-f4603000 rw-p 00000000 00:00 0
      f4603000-f4608000 r-xp 00000000 09:01 46244538 /lib/i386-linux-gnu/libnss_dns-2.15.so
      f4608000-f4609000 r--p 00004000 09:01 46244538 /lib/i386-linux-gnu/libnss_dns-2.15.so
      f4609000-f460a000 rw-p 00005000 09:01 46244538 /lib/i386-linux-gnu/libnss_dns-2.15.so
      f460a000-f4612000 r-xp 00000000 09:01 25182879 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/i386/libmanagement.so
      f4612000-f4613000 rw-p 00007000 09:01 25182879 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/i386/libmanagement.so
      f4613000-f4614000 r--s 00001000 09:01 24920592 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-antlr.jar
      f4614000-f4616000 r--s 00001000 09:01 24921649 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bcel.jar
      f4616000-f4617000 r--s 00001000 09:01 24921006 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar
      f4617000-f4618000 r--s 00000000 09:01 24921455 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-regexp.jar
      f4618000-f4619000 r--s 00002000 09:01 24920598 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar
      f4619000-f461b000 r--s 00001000 09:01 24921720 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.jar
      f461b000-f461c000 r--s 00000000 09:01 24920432 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar
      f461c000-f461e000 r--s 00013000 09:01 24920361 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar
      f461e000-f461f000 r--s 00009000 09:01 24920848 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar
      f461f000-f4621000 r--s 00017000 09:01 24920318 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar
      f4621000-f4622000 r--s 00000000 09:01 24920238 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar
      f4622000-f4623000 r--s 00000000 09:01 24921343 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar
      f4623000-f4624000 r--s 00003000 09:01 24921363 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar
      f4624000-f467f000 rw-p 00000000 00:00 0
      f467f000-f4680000 ---p 00000000 00:00 0
      f4680000-f4700000 rw-p 00000000 00:00 0 [stack:11662]
      f4700000-f4722000 rw-p 00000000 00:00 0
      f4722000-f4800000 ---p 00000000 00:00 0
      f4800000-f4801000 r--s 00000000 09:01 24921724 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar
      f4801000-f4802000 r--s 00001000 09:01 24921520 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar
      f4802000-f4803000 r--s 00000000 09:01 24921304 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar
      f4803000-f4805000 r--s 00008000 09:01 24920135 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar
      f4805000-f481a000 r--s 00116000 09:01 21922832 /var/lib/jenkins/.ant/lib/ivy-2.3.0.jar
      f481a000-f481f000 r--s 0002b000 08:21 2097199 /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.13.jar
      f481f000-f4833000 r-xp 00000000 09:01 25182890 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/i386/libnet.so
      f4833000-f4834000 rw-p 00014000 09:01 25182890 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/i386/libnet.so
      f4834000-f486a000 rw-p 00000000 00:00 0
      f486a000-f486b000 ---p 00000000 00:00 0
      f486b000-f4929000 rw-p 00000000 00:00 0 [stack:11660]
      f4929000-f496b000 ---p 00000000 00:00 0
      f496b000-f58d3000 rwxp 00000000 00:00 0
      f58d3000-f696b000 ---p 00000000 00:00 0
      f696b000-f6984000 r-xp 00000000 09:01 25182883 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/i386/libzip.so
      f6984000-f6985000 rw-p 00018000 09:01 25182883 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/i386/libzip.so
      f6985000-f6990000 r-xp 00000000 09:01 46244544 /lib/i386-linux-gnu/libnss_files-2.15.so
      f6990000-f6991000 r--p 0000a000 09:01 46244544 /lib/i386-linux-gnu/libnss_files-2.15.so
      f6991000-f6992000 rw-p 0000b000 09:01 46244544 /lib/i386-linux-gnu/libnss_files-2.15.so
      f6992000-f699c000 r-xp 00000000 09:01 46244542 /lib/i386-linux-gnu/libnss_nis-2.15.so
      f699c000-f699d000 r--p 00009000 09:01 46244542 /lib/i386-linux-gnu/libnss_nis-2.15.so
      f699d000-f699e000 rw-p 0000a000 09:01 46244542 /lib/i386-linux-gnu/libnss_nis-2.15.so
      f699e000-f69b4000 r-xp 00000000 09:01 46244450 /lib/i386-linux-gnu/libnsl-2.15.so
      f69b4000-f69b5000 r--p 00015000 09:01 46244450 /lib/i386-linux-gnu/libnsl-2.15.so
      f69b5000-f69b6000 rw-p 00016000 09:01 46244450 /lib/i386-linux-gnu/libnsl-2.15.so
      f69b6000-f69b8000 rw-p 00000000 00:00 0
      f69b8000-f69bf000 r-xp 00000000 09:01 46244545 /lib/i386-linux-gnu/libnss_compat-2.15.so
      f69bf000-f69c0000 r--p 00006000 09:01 46244545 /lib/i386-linux-gnu/libnss_compat-2.15.so
      f69c0000-f69c1000 rw-p 00007000 09:01 46244545 /lib/i386-linux-gnu/libnss_compat-2.15.so
      f69c1000-f69c3000 r--s 00004000 09:01 24920823 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar
      f69c3000-f69ca000 r--s 00037000 08:21 2097210 /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar
      f69ca000-f69d2000 rw-s 00000000 00:11 1739023 /tmp/hsperfdata_jenkins/11654
      f69d2000-f69f6000 r-xp 00000000 09:01 25182912 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/i386/libjava.so
      f69f6000-f69f7000 rw-p 00023000 09:01 25182912 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/i386/libjava.so
      f69f7000-f69fe000 r-xp 00000000 09:01 46244531 /lib/i386-linux-gnu/librt-2.15.so
      f69fe000-f69ff000 r--p 00006000 09:01 46244531 /lib/i386-linux-gnu/librt-2.15.so
      f69ff000-f6a00000 rw-p 00007000 09:01 46244531 /lib/i386-linux-gnu/librt-2.15.so
      f6a00000-f6afd000 rw-p 00000000 00:00 0
      f6afd000-f6b00000 ---p 00000000 00:00 0
      f6b00000-f6b01000 r--s 00001000 09:01 24921688 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar
      f6b01000-f6b04000 ---p 00000000 00:00 0
      f6b04000-f6b52000 rw-p 00000000 00:00 0 [stack:11657]
      f6b52000-f6b7c000 r-xp 00000000 09:01 46244540 /lib/i386-linux-gnu/libm-2.15.so
      f6b7c000-f6b7d000 r--p 00029000 09:01 46244540 /lib/i386-linux-gnu/libm-2.15.so
      f6b7d000-f6b7e000 rw-p 0002a000 09:01 46244540 /lib/i386-linux-gnu/libm-2.15.so
      f6b7e000-f7179000 r-xp 00000000 09:01 25190404 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/i386/client/libjvm.so
      f7179000-f719d000 rw-p 005fb000 09:01 25190404 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/i386/client/libjvm.so
      f719d000-f75be000 rw-p 00000000 00:00 0
      f75be000-f7762000 r-xp 00000000 09:01 46244547 /lib/i386-linux-gnu/libc-2.15.so
      f7762000-f7764000 r--p 001a4000 09:01 46244547 /lib/i386-linux-gnu/libc-2.15.so
      f7764000-f7765000 rw-p 001a6000 09:01 46244547 /lib/i386-linux-gnu/libc-2.15.so
      f7765000-f7768000 rw-p 00000000 00:00 0
      f7768000-f776b000 r-xp 00000000 09:01 46244546 /lib/i386-linux-gnu/libdl-2.15.so
      f776b000-f776c000 r--p 00002000 09:01 46244546 /lib/i386-linux-gnu/libdl-2.15.so
      f776c000-f776d000 rw-p 00003000 09:01 46244546 /lib/i386-linux-gnu/libdl-2.15.so
      f776d000-f7781000 r-xp 00000000 09:01 25190402 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/i386/jli/libjli.so
      f7781000-f7782000 rw-p 00013000 09:01 25190402 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/i386/jli/libjli.so
      f7782000-f7783000 rw-p 00000000 00:00 0
      f7783000-f779a000 r-xp 00000000 09:01 46244508 /lib/i386-linux-gnu/libpthread-2.15.so
      f779a000-f779b000 r--p 00016000 09:01 46244508 /lib/i386-linux-gnu/libpthread-2.15.so
      f779b000-f779c000 rw-p 00017000 09:01 46244508 /lib/i386-linux-gnu/libpthread-2.15.so
      f779c000-f779e000 rw-p 00000000 00:00 0
      f779e000-f779f000 r--s 00001000 09:01 24921046 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar
      f779f000-f77a1000 r--s 00002000 09:01 24921172 /var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar
      f77a1000-f77a2000 rw-p 00000000 00:00 0
      f77a2000-f77a3000 ---p 00000000 00:00 0
      f77a3000-f77ae000 r-xp 00000000 09:01 25182928 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/i386/libverify.so
      f77ae000-f77af000 rw-p 0000b000 09:01 25182928 /var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/jre/lib/i386/libverify.so
      f77af000-f77b1000 rw-p 00000000 00:00 0
      f77b1000-f77b2000 r-xp 00000000 00:00 0 [vdso]
      f77b2000-f77d2000 r-xp 00000000 09:01 46244529 /lib/i386-linux-gnu/ld-2.15.so
      f77d2000-f77d3000 r--p 0001f000 09:01 46244529 /lib/i386-linux-gnu/ld-2.15.so
      f77d3000-f77d4000 rw-p 00020000 09:01 46244529 /lib/i386-linux-gnu/ld-2.15.so
      ffcde000-ffcdf000 rwxp 00000000 00:00 0
      ffd10000-ffd32000 rw-p 00000000 00:00 0 [stack]

      VM Arguments:
      jvm_args: -XX:+UseConcMarkSweepGC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/heapdumps -Dtests.prefix=tests -Dtests.seed=3861E4A6DB805158 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=4.7 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.slow=true -Dtests.asserts.gracious=false -Dtests.multiplier=3 -DtempDir=. -Djava.io.tmpdir=. -Djunit4.tempDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/test/temp -Dclover.db.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/clover/db -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Djava.security.policy=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/tools/junit4/tests.policy -Dlucene.version=4.7-SNAPSHOT -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Djunit4.childvm.cwd=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/test/J0 -Djunit4.childvm.id=0 -Dtests.disableHdfs=true -Dfile.encoding=UTF-8 -ea:org.apache.lucene... -ea:org.apache.solr...
      java_command: com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/test/temp/junit4-J0-20131124_131747_681.events @/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/test/temp/junit4-J0-20131124_131747_681.suites -stdin
      java_class_path (initial): /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.13.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/build/core/classes/test:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.3.0.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.j
      Launcher Type: SUN_STANDARD

      Environment Variables:
      JAVA_HOME=/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116
      PATH=/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b116/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
      SHELL=/bin/bash

      Signal Handlers:
      SIGSEGV: [libjvm.so+0x570ed0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGBUS: [libjvm.so+0x570ed0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGFPE: [libjvm.so+0x45c6f0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGPIPE: [libjvm.so+0x45c6f0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGXFSZ: [libjvm.so+0x45c6f0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGILL: [libjvm.so+0x45c6f0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
      SIGUSR2: [libjvm.so+0x45de00], sa_mask[0]=0x00000004, sa_flags=0x10000004
      SIGHUP: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
      SIGINT: [libjvm.so+0x45f210], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGTERM: [libjvm.so+0x45f210], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
      SIGQUIT: [libjvm.so+0x45f210], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004


      --------------- S Y S T E M ---------------

      OS:DISTRIB_ID=Ubuntu
      DISTRIB_RELEASE=12.04
      DISTRIB_CODENAME=precise
      DISTRIB_DESCRIPTION="Ubuntu 12.04.3 LTS"

      uname:Linux 3.8.0-33-generic #48~precise1-Ubuntu SMP Thu Oct 24 16:28:06 UTC 2013 x86_64
      libc:glibc 2.15 NPTL 2.15
      rlimit: STACK 8192k, CORE 0k, NPROC 63640, NOFILE 32768, AS infinity
      load average:3.24 3.55 3.54

      /proc/meminfo:
      MemTotal: 8168808 kB
      MemFree: 495912 kB
      Buffers: 203244 kB
      Cached: 1948348 kB
      SwapCached: 1440 kB
      Active: 3183684 kB
      Inactive: 1945864 kB
      Active(anon): 2407916 kB
      Inactive(anon): 646072 kB
      Active(file): 775768 kB
      Inactive(file): 1299792 kB
      Unevictable: 0 kB
      Mlocked: 0 kB
      SwapTotal: 8291444 kB
      SwapFree: 8279832 kB
      Dirty: 632 kB
      Writeback: 0 kB
      AnonPages: 2977072 kB
      Mapped: 605516 kB
      Shmem: 76028 kB
      Slab: 276520 kB
      SReclaimable: 226520 kB
      SUnreclaim: 50000 kB
      KernelStack: 3224 kB
      PageTables: 20572 kB
      NFS_Unstable: 0 kB
      Bounce: 0 kB
      WritebackTmp: 0 kB
        CommitLimit: 12375848 kB
        Committed_AS: 5542732 kB
      VmallocTotal: 34359738367 kB
      VmallocUsed: 39544 kB
      VmallocChunk: 34359694312 kB
      HardwareCorrupted: 0 kB
      AnonHugePages: 0 kB
      HugePages_Total: 0
      HugePages_Free: 0
      HugePages_Rsvd: 0
      HugePages_Surp: 0
      Hugepagesize: 2048 kB
      DirectMap4k: 73408 kB
      DirectMap2M: 8306688 kB


      CPU:total 8 (4 cores per cpu, 2 threads per core) family 6 model 30 stepping 5, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, ht, tsc, tscinvbit

      /proc/cpuinfo:
      processor: 0
      vendor_id: GenuineIntel
      cpu family: 6
      model: 30
      model name: Intel(R) Xeon(R) CPU X3440 @ 2.53GHz
      stepping: 5
      microcode: 0x3
      cpu MHz: 2528.000
      cache size: 8192 KB
      physical id: 0
      siblings: 8
      core id: 0
      cpu cores: 4
      apicid: 0
      initial apicid: 0
      fpu: yes
      fpu_exception: yes
      cpuid level: 11
      wp: yes
      flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
      bogomips: 5053.98
      clflush size: 64
      cache_alignment: 64
      address sizes: 36 bits physical, 48 bits virtual
      power management:

      processor: 1
      vendor_id: GenuineIntel
      cpu family: 6
      model: 30
      model name: Intel(R) Xeon(R) CPU X3440 @ 2.53GHz
      stepping: 5
      microcode: 0x3
      cpu MHz: 2261.000
      cache size: 8192 KB
      physical id: 0
      siblings: 8
      core id: 1
      cpu cores: 4
      apicid: 2
      initial apicid: 2
      fpu: yes
      fpu_exception: yes
      cpuid level: 11
      wp: yes
      flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
      bogomips: 5053.98
      clflush size: 64
      cache_alignment: 64
      address sizes: 36 bits physical, 48 bits virtual
      power management:

      processor: 2
      vendor_id: GenuineIntel
      cpu family: 6
      model: 30
      model name: Intel(R) Xeon(R) CPU X3440 @ 2.53GHz
      stepping: 5
      microcode: 0x3
      cpu MHz: 2528.000
      cache size: 8192 KB
      physical id: 0
      siblings: 8
      core id: 2
      cpu cores: 4
      apicid: 4
      initial apicid: 4
      fpu: yes
      fpu_exception: yes
      cpuid level: 11
      wp: yes
      flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
      bogomips: 5053.98
      clflush size: 64
      cache_alignment: 64
      address sizes: 36 bits physical, 48 bits virtual
      power management:

      processor: 3
      vendor_id: GenuineIntel
      cpu family: 6
      model: 30
      model name: Intel(R) Xeon(R) CPU X3440 @ 2.53GHz
      stepping: 5
      microcode: 0x3
      cpu MHz: 2528.000
      cache size: 8192 KB
      physical id: 0
      siblings: 8
      core id: 3
      cpu cores: 4
      apicid: 6
      initial apicid: 6
      fpu: yes
      fpu_exception: yes
      cpuid level: 11
      wp: yes
      flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
      bogomips: 5053.98
      clflush size: 64
      cache_alignment: 64
      address sizes: 36 bits physical, 48 bits virtual
      power management:

      processor: 4
      vendor_id: GenuineIntel
      cpu family: 6
      model: 30
      model name: Intel(R) Xeon(R) CPU X3440 @ 2.53GHz
      stepping: 5
      microcode: 0x3
      cpu MHz: 2528.000
      cache size: 8192 KB
      physical id: 0
      siblings: 8
      core id: 0
      cpu cores: 4
      apicid: 1
      initial apicid: 1
      fpu: yes
      fpu_exception: yes
      cpuid level: 11
      wp: yes
      flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
      bogomips: 5053.98
      clflush size: 64
      cache_alignment: 64
      address sizes: 36 bits physical, 48 bits virtual
      power management:

      processor: 5
      vendor_id: GenuineIntel
      cpu family: 6
      model: 30
      model name: Intel(R) Xeon(R) CPU X3440 @ 2.53GHz
      stepping: 5
      microcode: 0x3
      cpu MHz: 2528.000
      cache size: 8192 KB
      physical id: 0
      siblings: 8
      core id: 1
      cpu cores: 4
      apicid: 3
      initial apicid: 3
      fpu: yes
      fpu_exception: yes
      cpuid level: 11
      wp: yes
      flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
      bogomips: 5053.98
      clflush size: 64
      cache_alignment: 64
      address sizes: 36 bits physical, 48 bits virtual
      power management:

      processor: 6
      vendor_id: GenuineIntel
      cpu family: 6
      model: 30
      model name: Intel(R) Xeon(R) CPU X3440 @ 2.53GHz
      stepping: 5
      microcode: 0x3
      cpu MHz: 1197.000
      cache size: 8192 KB
      physical id: 0
      siblings: 8
      core id: 2
      cpu cores: 4
      apicid: 5
      initial apicid: 5
      fpu: yes
      fpu_exception: yes
      cpuid level: 11
      wp: yes
      flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
      bogomips: 5053.98
      clflush size: 64
      cache_alignment: 64
      address sizes: 36 bits physical, 48 bits virtual
      power management:

      processor: 7
      vendor_id: GenuineIntel
      cpu family: 6
      model: 30
      model name: Intel(R) Xeon(R) CPU X3440 @ 2.53GHz
      stepping: 5
      microcode: 0x3
      cpu MHz: 2528.000
      cache size: 8192 KB
      physical id: 0
      siblings: 8
      core id: 3
      cpu cores: 4
      apicid: 7
      initial apicid: 7
      fpu: yes
      fpu_exception: yes
      cpuid level: 11
      wp: yes
      flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
      bogomips: 5053.98
      clflush size: 64
      cache_alignment: 64
      address sizes: 36 bits physical, 48 bits virtual
      power management:



      Memory: 4k page, physical 8168808k(495912k free), swap 8291444k(8279832k free)

      vm_info: Java HotSpot(TM) Client VM (25.0-b58) for linux-x86 JRE (1.8.0-ea-b116), built on Nov 14 2013 01:52:44 by "java_re" with gcc 4.3.0 20080428 (Red Hat 4.3.0-8)

      time: Sun Nov 24 13:25:37 2013
      elapsed time: 469 seconds


      REPRODUCIBILITY :
      This bug can be reproduced rarely.

        Attachments

          Activity

            People

            Assignee:
            jmasa Jon Masamitsu (Inactive)
            Reporter:
            webbuggrp Webbug Group
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: