WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.openjdk.jmh.util.Utils (file:/local/home/hohensee/workspaces/test/target/benchmarks.jar) to field java.io.PrintStream.charOut WARNING: Please consider reporting this to the maintainers of org.openjdk.jmh.util.Utils WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Throughput, ops/time # Benchmark: org.sample.MyBenchmark.testMethod # Run progress: 0.00% complete, ETA 00:41:40 # Fork: 1 of 5 # Warmup Iteration 1: 1801240546.576 ops/s # Warmup Iteration 2: 1802065352.408 ops/s # Warmup Iteration 3: 1750959274.751 ops/s # Warmup Iteration 4: 1754491290.508 ops/s # Warmup Iteration 5: 1743005424.131 ops/s Iteration 1: 1746792110.268 ops/s Iteration 2: 1748006466.382 ops/s Iteration 3: 1739570065.489 ops/s Iteration 4: 1744431400.417 ops/s Iteration 5: 1735777742.666 ops/s # Run progress: 4.00% complete, ETA 00:40:11 # Fork: 2 of 5 # Warmup Iteration 1: 1802403402.749 ops/s # Warmup Iteration 2: 1806648734.220 ops/s # Warmup Iteration 3: 1792869996.584 ops/s # Warmup Iteration 4: 1789330065.710 ops/s # Warmup Iteration 5: 1790669246.065 ops/s Iteration 1: 1791343021.614 ops/s Iteration 2: 1774392979.233 ops/s Iteration 3: 1785808396.261 ops/s Iteration 4: 1793944210.102 ops/s Iteration 5: 1791724571.039 ops/s # Run progress: 8.00% complete, ETA 00:38:30 # Fork: 3 of 5 # Warmup Iteration 1: 1803390183.196 ops/s # Warmup Iteration 2: 1802733471.831 ops/s # Warmup Iteration 3: 1746825722.345 ops/s # Warmup Iteration 4: 1731922535.884 ops/s # Warmup Iteration 5: 1737348989.809 ops/s Iteration 1: 1726865531.462 ops/s Iteration 2: 1741487290.992 ops/s Iteration 3: 1735173638.473 ops/s Iteration 4: 1740361497.285 ops/s Iteration 5: 1758446852.985 ops/s # Run progress: 12.00% complete, ETA 00:36:49 # Fork: 4 of 5 # Warmup Iteration 1: 1802574939.797 ops/s # Warmup Iteration 2: 1802644251.614 ops/s # Warmup Iteration 3: 1743504648.916 ops/s # Warmup Iteration 4: 1749769663.263 ops/s # Warmup Iteration 5: 1753941902.238 ops/s Iteration 1: 1751413946.440 ops/s Iteration 2: 1745593528.513 ops/s Iteration 3: 1742714223.460 ops/s Iteration 4: 1736620932.047 ops/s Iteration 5: 1727230951.290 ops/s # Run progress: 16.00% complete, ETA 00:35:09 # Fork: 5 of 5 # Warmup Iteration 1: 1793815352.044 ops/s # Warmup Iteration 2: 1799093193.671 ops/s # Warmup Iteration 3: 1744498857.350 ops/s # Warmup Iteration 4: 1748520800.383 ops/s # Warmup Iteration 5: 1747833224.941 ops/s Iteration 1: 1741216157.504 ops/s Iteration 2: 1744142009.803 ops/s Iteration 3: 1749513112.558 ops/s Iteration 4: 1743550160.312 ops/s Iteration 5: 1744549302.996 ops/s Result "org.sample.MyBenchmark.testMethod": 1751226803.984 ±(99.9%) 14922119.473 ops/s [Average] (min, avg, max) = (1726865531.462, 1751226803.984, 1793944210.102), stdev = 19920602.570 CI (99.9%): [1736304684.511, 1766148923.456] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = LBQ) # Run progress: 20.00% complete, ETA 00:33:28 # Fork: 1 of 5 # Warmup Iteration 1: 379.022 ns/op # Warmup Iteration 2: 502.607 ns/op # Warmup Iteration 3: 582.627 ns/op # Warmup Iteration 4: 526.609 ns/op # Warmup Iteration 5: 506.713 ns/op Iteration 1: 465.263 ns/op Iteration 2: 486.869 ns/op Iteration 3: 493.659 ns/op Iteration 4: 515.598 ns/op Iteration 5: 577.406 ns/op # Run progress: 24.00% complete, ETA 00:31:48 # Fork: 2 of 5 # Warmup Iteration 1: 434.068 ns/op # Warmup Iteration 2: 480.353 ns/op # Warmup Iteration 3: 546.492 ns/op # Warmup Iteration 4: 572.630 ns/op # Warmup Iteration 5: 577.729 ns/op Iteration 1: 488.062 ns/op Iteration 2: 498.624 ns/op Iteration 3: 518.391 ns/op Iteration 4: 498.532 ns/op Iteration 5: 499.320 ns/op # Run progress: 28.00% complete, ETA 00:30:08 # Fork: 3 of 5 # Warmup Iteration 1: 467.982 ns/op # Warmup Iteration 2: 464.289 ns/op # Warmup Iteration 3: 464.099 ns/op # Warmup Iteration 4: 543.013 ns/op # Warmup Iteration 5: 530.059 ns/op Iteration 1: 466.856 ns/op Iteration 2: 463.064 ns/op Iteration 3: 475.062 ns/op Iteration 4: 522.767 ns/op Iteration 5: 554.006 ns/op # Run progress: 32.00% complete, ETA 00:28:28 # Fork: 4 of 5 # Warmup Iteration 1: 453.516 ns/op # Warmup Iteration 2: 424.226 ns/op # Warmup Iteration 3: 404.825 ns/op # Warmup Iteration 4: 464.685 ns/op # Warmup Iteration 5: 561.574 ns/op Iteration 1: 604.576 ns/op Iteration 2: 550.450 ns/op Iteration 3: 534.464 ns/op Iteration 4: 490.986 ns/op Iteration 5: 465.497 ns/op # Run progress: 36.00% complete, ETA 00:26:47 # Fork: 5 of 5 # Warmup Iteration 1: 512.558 ns/op # Warmup Iteration 2: 523.855 ns/op # Warmup Iteration 3: 589.898 ns/op # Warmup Iteration 4: 580.664 ns/op # Warmup Iteration 5: 567.645 ns/op Iteration 1: 508.083 ns/op Iteration 2: 476.421 ns/op Iteration 3: 507.962 ns/op Iteration 4: 495.342 ns/op Iteration 5: 478.882 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 505.446 ±(99.9%) 26.927 ns/op [Average] (min, avg, max) = (463.064, 505.446, 604.576), stdev = 35.946 CI (99.9%): [478.519, 532.372] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = ABQ_NF) # Run progress: 40.00% complete, ETA 00:25:07 # Fork: 1 of 5 # Warmup Iteration 1: 305.378 ns/op # Warmup Iteration 2: 289.238 ns/op # Warmup Iteration 3: 366.143 ns/op # Warmup Iteration 4: 367.288 ns/op # Warmup Iteration 5: 303.112 ns/op Iteration 1: 269.596 ns/op Iteration 2: 263.404 ns/op Iteration 3: 272.429 ns/op Iteration 4: 304.319 ns/op Iteration 5: 295.902 ns/op # Run progress: 44.00% complete, ETA 00:23:26 # Fork: 2 of 5 # Warmup Iteration 1: 296.012 ns/op # Warmup Iteration 2: 286.316 ns/op # Warmup Iteration 3: 250.163 ns/op # Warmup Iteration 4: 261.120 ns/op # Warmup Iteration 5: 301.134 ns/op Iteration 1: 279.412 ns/op Iteration 2: 247.495 ns/op Iteration 3: 282.565 ns/op Iteration 4: 313.185 ns/op Iteration 5: 349.612 ns/op # Run progress: 48.00% complete, ETA 00:21:46 # Fork: 3 of 5 # Warmup Iteration 1: 369.957 ns/op # Warmup Iteration 2: 407.731 ns/op # Warmup Iteration 3: 435.554 ns/op # Warmup Iteration 4: 374.244 ns/op # Warmup Iteration 5: 345.473 ns/op Iteration 1: 411.480 ns/op Iteration 2: 392.015 ns/op Iteration 3: 353.005 ns/op Iteration 4: 341.640 ns/op Iteration 5: 305.666 ns/op # Run progress: 52.00% complete, ETA 00:20:05 # Fork: 4 of 5 # Warmup Iteration 1: 309.865 ns/op # Warmup Iteration 2: 294.742 ns/op # Warmup Iteration 3: 298.809 ns/op # Warmup Iteration 4: 302.990 ns/op # Warmup Iteration 5: 286.071 ns/op Iteration 1: 268.515 ns/op Iteration 2: 257.017 ns/op Iteration 3: 268.879 ns/op Iteration 4: 286.043 ns/op Iteration 5: 266.530 ns/op # Run progress: 56.00% complete, ETA 00:18:25 # Fork: 5 of 5 # Warmup Iteration 1: 310.976 ns/op # Warmup Iteration 2: 301.413 ns/op # Warmup Iteration 3: 247.892 ns/op # Warmup Iteration 4: 256.262 ns/op # Warmup Iteration 5: 281.455 ns/op Iteration 1: 262.363 ns/op Iteration 2: 235.804 ns/op Iteration 3: 229.360 ns/op Iteration 4: 225.668 ns/op Iteration 5: 327.886 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 292.392 ±(99.9%) 35.910 ns/op [Average] (min, avg, max) = (225.668, 292.392, 411.480), stdev = 47.939 CI (99.9%): [256.482, 328.302] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = ABQ_F) # Run progress: 60.00% complete, ETA 00:16:44 # Fork: 1 of 5 # Warmup Iteration 1: 6825.064 ns/op # Warmup Iteration 2: 7286.058 ns/op # Warmup Iteration 3: 6952.471 ns/op # Warmup Iteration 4: 6885.837 ns/op # Warmup Iteration 5: 6863.538 ns/op Iteration 1: 6879.252 ns/op Iteration 2: 8381.171 ns/op Iteration 3: 10677.256 ns/op Iteration 4: 10625.406 ns/op Iteration 5: 10690.172 ns/op # Run progress: 64.00% complete, ETA 00:15:04 # Fork: 2 of 5 # Warmup Iteration 1: 6755.398 ns/op # Warmup Iteration 2: 7120.132 ns/op # Warmup Iteration 3: 6815.374 ns/op # Warmup Iteration 4: 6857.359 ns/op # Warmup Iteration 5: 6809.221 ns/op Iteration 1: 6923.745 ns/op Iteration 2: 6902.236 ns/op Iteration 3: 6845.290 ns/op Iteration 4: 7047.473 ns/op Iteration 5: 6868.864 ns/op # Run progress: 68.00% complete, ETA 00:13:23 # Fork: 3 of 5 # Warmup Iteration 1: 6843.882 ns/op # Warmup Iteration 2: 8210.878 ns/op # Warmup Iteration 3: 10783.539 ns/op # Warmup Iteration 4: 10760.393 ns/op # Warmup Iteration 5: 10733.199 ns/op Iteration 1: 10672.755 ns/op Iteration 2: 10670.952 ns/op Iteration 3: 10678.713 ns/op Iteration 4: 10712.643 ns/op Iteration 5: 10732.634 ns/op # Run progress: 72.00% complete, ETA 00:11:43 # Fork: 4 of 5 # Warmup Iteration 1: 6636.433 ns/op # Warmup Iteration 2: 7067.829 ns/op # Warmup Iteration 3: 7604.776 ns/op # Warmup Iteration 4: 10219.492 ns/op # Warmup Iteration 5: 10156.894 ns/op Iteration 1: 10142.022 ns/op Iteration 2: 10123.912 ns/op Iteration 3: 10127.214 ns/op Iteration 4: 10153.104 ns/op Iteration 5: 10167.883 ns/op # Run progress: 76.00% complete, ETA 00:10:02 # Fork: 5 of 5 # Warmup Iteration 1: 6916.184 ns/op # Warmup Iteration 2: 7251.466 ns/op # Warmup Iteration 3: 6776.782 ns/op # Warmup Iteration 4: 6630.438 ns/op # Warmup Iteration 5: 6965.458 ns/op Iteration 1: 6675.741 ns/op Iteration 2: 6504.371 ns/op Iteration 3: 6557.520 ns/op Iteration 4: 6771.690 ns/op Iteration 5: 6767.677 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 8771.988 ±(99.9%) 1384.790 ns/op [Average] (min, avg, max) = (6504.371, 8771.988, 10732.634), stdev = 1848.656 CI (99.9%): [7387.198, 10156.778] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = PBQ) # Run progress: 80.00% complete, ETA 00:08:22 # Fork: 1 of 5 # Warmup Iteration 1: 433.457 ns/op # Warmup Iteration 2: 423.334 ns/op # Warmup Iteration 3: 414.498 ns/op # Warmup Iteration 4: 427.858 ns/op # Warmup Iteration 5: 421.749 ns/op Iteration 1: 430.264 ns/op Iteration 2: 432.280 ns/op Iteration 3: 434.303 ns/op Iteration 4: 434.277 ns/op Iteration 5: 442.579 ns/op # Run progress: 84.00% complete, ETA 00:06:41 # Fork: 2 of 5 # Warmup Iteration 1: 403.751 ns/op # Warmup Iteration 2: 396.519 ns/op # Warmup Iteration 3: 394.809 ns/op # Warmup Iteration 4: 443.687 ns/op # Warmup Iteration 5: 443.511 ns/op Iteration 1: 447.234 ns/op Iteration 2: 472.495 ns/op Iteration 3: 474.534 ns/op Iteration 4: 470.328 ns/op Iteration 5: 407.226 ns/op # Run progress: 88.00% complete, ETA 00:05:01 # Fork: 3 of 5 # Warmup Iteration 1: 388.043 ns/op # Warmup Iteration 2: 386.720 ns/op # Warmup Iteration 3: 378.587 ns/op # Warmup Iteration 4: 369.987 ns/op # Warmup Iteration 5: 367.566 ns/op Iteration 1: 366.523 ns/op Iteration 2: 364.928 ns/op Iteration 3: 363.115 ns/op Iteration 4: 370.191 ns/op Iteration 5: 373.138 ns/op # Run progress: 92.00% complete, ETA 00:03:21 # Fork: 4 of 5 # Warmup Iteration 1: 396.223 ns/op # Warmup Iteration 2: 391.073 ns/op # Warmup Iteration 3: 387.464 ns/op # Warmup Iteration 4: 375.587 ns/op # Warmup Iteration 5: 375.392 ns/op Iteration 1: 380.448 ns/op Iteration 2: 390.808 ns/op Iteration 3: 392.391 ns/op Iteration 4: 383.759 ns/op Iteration 5: 380.342 ns/op # Run progress: 96.00% complete, ETA 00:01:40 # Fork: 5 of 5 # Warmup Iteration 1: 432.164 ns/op # Warmup Iteration 2: 431.147 ns/op # Warmup Iteration 3: 425.281 ns/op # Warmup Iteration 4: 413.067 ns/op # Warmup Iteration 5: 412.822 ns/op Iteration 1: 414.736 ns/op Iteration 2: 420.784 ns/op Iteration 3: 420.709 ns/op Iteration 4: 418.598 ns/op Iteration 5: 420.911 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 412.276 ±(99.9%) 25.928 ns/op [Average] (min, avg, max) = (363.115, 412.276, 474.534), stdev = 34.612 CI (99.9%): [386.349, 438.204] (assumes normal distribution) # Run complete. Total time: 00:41:52 REMEMBER: The numbers below are just data. To gain reusable insights, you need to follow up on why the numbers are the way they are. Use profilers (see -prof, -lprof), design factorial experiments, perform baseline and negative tests that provide experimental control, make sure the benchmarking environment is safe on JVM/OS/HW level, ask for reviews from the domain experts. Do not assume the numbers tell you what you want them to tell. Benchmark (capacity) (type) Mode Cnt Score Error Units o.sample.MyBenchmark.testMethod N/A N/A thrpt 25 1751226803.984 ± 14922119.473 ops/s o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 LBQ avgt 25 505.446 ± 26.927 ns/op o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 ABQ_NF avgt 25 292.392 ± 35.910 ns/op o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 ABQ_F avgt 25 8771.988 ± 1384.790 ns/op o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 PBQ avgt 25 412.276 ± 25.928 ns/op