WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.openjdk.jmh.util.Utils (file:/local/home/hohensee/workspaces/test/target/benchmarks.jar) to field java.io.PrintStream.charOut WARNING: Please consider reporting this to the maintainers of org.openjdk.jmh.util.Utils WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Throughput, ops/time # Benchmark: org.sample.MyBenchmark.testMethod # Run progress: 0.00% complete, ETA 00:41:40 # Fork: 1 of 5 # Warmup Iteration 1: 1785659016.858 ops/s # Warmup Iteration 2: 1792343594.572 ops/s # Warmup Iteration 3: 1800859510.115 ops/s # Warmup Iteration 4: 1808257383.008 ops/s # Warmup Iteration 5: 1810595702.397 ops/s Iteration 1: 1802672211.480 ops/s Iteration 2: 1799139463.827 ops/s Iteration 3: 1803453329.653 ops/s Iteration 4: 1802384020.676 ops/s Iteration 5: 1803971811.493 ops/s # Run progress: 4.00% complete, ETA 00:40:17 # Fork: 2 of 5 # Warmup Iteration 1: 1799603618.065 ops/s # Warmup Iteration 2: 1802238659.477 ops/s # Warmup Iteration 3: 1752477359.266 ops/s # Warmup Iteration 4: 1752296103.389 ops/s # Warmup Iteration 5: 1753280008.054 ops/s Iteration 1: 1756233913.648 ops/s Iteration 2: 1758964257.160 ops/s Iteration 3: 1755388119.628 ops/s Iteration 4: 1749569917.719 ops/s Iteration 5: 1754693611.985 ops/s # Run progress: 8.00% complete, ETA 00:38:36 # Fork: 3 of 5 # Warmup Iteration 1: 1796807866.671 ops/s # Warmup Iteration 2: 1794849917.358 ops/s # Warmup Iteration 3: 1738549858.832 ops/s # Warmup Iteration 4: 1736736137.889 ops/s # Warmup Iteration 5: 1736528599.280 ops/s Iteration 1: 1725173724.248 ops/s Iteration 2: 1722434206.951 ops/s Iteration 3: 1724343641.876 ops/s Iteration 4: 1728258397.558 ops/s Iteration 5: 1742256446.829 ops/s # Run progress: 12.00% complete, ETA 00:36:55 # Fork: 4 of 5 # Warmup Iteration 1: 1798506195.997 ops/s # Warmup Iteration 2: 1803186904.119 ops/s # Warmup Iteration 3: 1751179208.474 ops/s # Warmup Iteration 4: 1747470493.719 ops/s # Warmup Iteration 5: 1747177733.144 ops/s Iteration 1: 1747416110.750 ops/s Iteration 2: 1741266794.588 ops/s Iteration 3: 1736925945.713 ops/s Iteration 4: 1733846825.905 ops/s Iteration 5: 1744250851.155 ops/s # Run progress: 16.00% complete, ETA 00:35:15 # Fork: 5 of 5 # Warmup Iteration 1: 1794990886.986 ops/s # Warmup Iteration 2: 1798344165.917 ops/s # Warmup Iteration 3: 1742175478.436 ops/s # Warmup Iteration 4: 1730390428.261 ops/s # Warmup Iteration 5: 1735499621.866 ops/s Iteration 1: 1718035448.069 ops/s Iteration 2: 1715698153.965 ops/s Iteration 3: 1709410822.298 ops/s Iteration 4: 1724164336.907 ops/s Iteration 5: 1725622149.235 ops/s Result "org.sample.MyBenchmark.testMethod": 1749022980.533 ±(99.9%) 22716865.495 ops/s [Average] (min, avg, max) = (1709410822.298, 1749022980.533, 1803971811.493), stdev = 30326365.501 CI (99.9%): [1726306115.038, 1771739846.028] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = LBQ) # Run progress: 20.00% complete, ETA 00:33:34 # Fork: 1 of 5 # Warmup Iteration 1: 217.673 ns/op # Warmup Iteration 2: 228.375 ns/op # Warmup Iteration 3: 239.882 ns/op # Warmup Iteration 4: 247.789 ns/op # Warmup Iteration 5: 210.262 ns/op Iteration 1: 208.429 ns/op Iteration 2: 223.561 ns/op Iteration 3: 213.956 ns/op Iteration 4: 224.874 ns/op Iteration 5: 245.156 ns/op # Run progress: 24.00% complete, ETA 00:31:53 # Fork: 2 of 5 # Warmup Iteration 1: 231.469 ns/op # Warmup Iteration 2: 220.556 ns/op # Warmup Iteration 3: 216.939 ns/op # Warmup Iteration 4: 239.887 ns/op # Warmup Iteration 5: 228.087 ns/op Iteration 1: 212.703 ns/op Iteration 2: 219.116 ns/op Iteration 3: 238.069 ns/op Iteration 4: 211.341 ns/op Iteration 5: 234.214 ns/op # Run progress: 28.00% complete, ETA 00:30:13 # Fork: 3 of 5 # Warmup Iteration 1: 238.020 ns/op # Warmup Iteration 2: 247.750 ns/op # Warmup Iteration 3: 259.958 ns/op # Warmup Iteration 4: 238.290 ns/op # Warmup Iteration 5: 258.171 ns/op Iteration 1: 243.525 ns/op Iteration 2: 220.287 ns/op Iteration 3: 227.058 ns/op Iteration 4: 209.648 ns/op Iteration 5: 253.295 ns/op # Run progress: 32.00% complete, ETA 00:28:32 # Fork: 4 of 5 # Warmup Iteration 1: 244.619 ns/op # Warmup Iteration 2: 232.338 ns/op # Warmup Iteration 3: 217.435 ns/op # Warmup Iteration 4: 218.986 ns/op # Warmup Iteration 5: 220.651 ns/op Iteration 1: 215.327 ns/op Iteration 2: 207.530 ns/op Iteration 3: 232.593 ns/op Iteration 4: 226.012 ns/op Iteration 5: 227.548 ns/op # Run progress: 36.00% complete, ETA 00:26:51 # Fork: 5 of 5 # Warmup Iteration 1: 227.871 ns/op # Warmup Iteration 2: 221.138 ns/op # Warmup Iteration 3: 242.686 ns/op # Warmup Iteration 4: 203.722 ns/op # Warmup Iteration 5: 208.402 ns/op Iteration 1: 215.392 ns/op Iteration 2: 208.353 ns/op Iteration 3: 225.929 ns/op Iteration 4: 260.429 ns/op Iteration 5: 235.161 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 225.580 ±(99.9%) 10.837 ns/op [Average] (min, avg, max) = (207.530, 225.580, 260.429), stdev = 14.467 CI (99.9%): [214.743, 236.417] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = ABQ_NF) # Run progress: 40.00% complete, ETA 00:25:11 # Fork: 1 of 5 # Warmup Iteration 1: 384.172 ns/op # Warmup Iteration 2: 462.170 ns/op # Warmup Iteration 3: 503.041 ns/op # Warmup Iteration 4: 408.373 ns/op # Warmup Iteration 5: 378.601 ns/op Iteration 1: 383.395 ns/op Iteration 2: 435.196 ns/op Iteration 3: 394.844 ns/op Iteration 4: 398.234 ns/op Iteration 5: 404.178 ns/op # Run progress: 44.00% complete, ETA 00:23:30 # Fork: 2 of 5 # Warmup Iteration 1: 347.439 ns/op # Warmup Iteration 2: 349.357 ns/op # Warmup Iteration 3: 369.206 ns/op # Warmup Iteration 4: 394.510 ns/op # Warmup Iteration 5: 388.474 ns/op Iteration 1: 388.086 ns/op Iteration 2: 413.805 ns/op Iteration 3: 439.252 ns/op Iteration 4: 410.954 ns/op Iteration 5: 408.846 ns/op # Run progress: 48.00% complete, ETA 00:21:49 # Fork: 3 of 5 # Warmup Iteration 1: 389.463 ns/op # Warmup Iteration 2: 461.382 ns/op # Warmup Iteration 3: 504.045 ns/op # Warmup Iteration 4: 469.333 ns/op # Warmup Iteration 5: 445.869 ns/op Iteration 1: 445.093 ns/op Iteration 2: 482.628 ns/op Iteration 3: 392.280 ns/op Iteration 4: 387.140 ns/op Iteration 5: 406.166 ns/op # Run progress: 52.00% complete, ETA 00:20:09 # Fork: 4 of 5 # Warmup Iteration 1: 371.234 ns/op # Warmup Iteration 2: 482.135 ns/op # Warmup Iteration 3: 519.192 ns/op # Warmup Iteration 4: 377.405 ns/op # Warmup Iteration 5: 396.346 ns/op Iteration 1: 404.368 ns/op Iteration 2: 401.991 ns/op Iteration 3: 415.594 ns/op Iteration 4: 415.144 ns/op Iteration 5: 414.400 ns/op # Run progress: 56.00% complete, ETA 00:18:28 # Fork: 5 of 5 # Warmup Iteration 1: 369.753 ns/op # Warmup Iteration 2: 423.931 ns/op # Warmup Iteration 3: 446.351 ns/op # Warmup Iteration 4: 416.721 ns/op # Warmup Iteration 5: 394.552 ns/op Iteration 1: 423.095 ns/op Iteration 2: 432.632 ns/op Iteration 3: 432.105 ns/op Iteration 4: 437.332 ns/op Iteration 5: 427.081 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 415.754 ±(99.9%) 16.758 ns/op [Average] (min, avg, max) = (383.395, 415.754, 482.628), stdev = 22.371 CI (99.9%): [398.996, 432.511] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = ABQ_F) # Run progress: 60.00% complete, ETA 00:16:47 # Fork: 1 of 5 # Warmup Iteration 1: 7114.694 ns/op # Warmup Iteration 2: 6461.513 ns/op # Warmup Iteration 3: 6615.940 ns/op # Warmup Iteration 4: 6681.055 ns/op # Warmup Iteration 5: 6696.752 ns/op Iteration 1: 6447.598 ns/op Iteration 2: 6771.183 ns/op Iteration 3: 6765.801 ns/op Iteration 4: 6743.624 ns/op Iteration 5: 6747.281 ns/op # Run progress: 64.00% complete, ETA 00:15:06 # Fork: 2 of 5 # Warmup Iteration 1: 7309.004 ns/op # Warmup Iteration 2: 7025.418 ns/op # Warmup Iteration 3: 7040.598 ns/op # Warmup Iteration 4: 7031.601 ns/op # Warmup Iteration 5: 6961.816 ns/op Iteration 1: 7007.544 ns/op Iteration 2: 6998.321 ns/op Iteration 3: 6908.497 ns/op Iteration 4: 6898.786 ns/op Iteration 5: 6806.916 ns/op # Run progress: 68.00% complete, ETA 00:13:26 # Fork: 3 of 5 # Warmup Iteration 1: 7120.550 ns/op # Warmup Iteration 2: 6603.184 ns/op # Warmup Iteration 3: 6679.716 ns/op # Warmup Iteration 4: 6647.558 ns/op # Warmup Iteration 5: 6670.130 ns/op Iteration 1: 6640.390 ns/op Iteration 2: 6664.533 ns/op Iteration 3: 6837.093 ns/op Iteration 4: 6664.277 ns/op Iteration 5: 6577.385 ns/op # Run progress: 72.00% complete, ETA 00:11:45 # Fork: 4 of 5 # Warmup Iteration 1: 7236.059 ns/op # Warmup Iteration 2: 6766.813 ns/op # Warmup Iteration 3: 6704.411 ns/op # Warmup Iteration 4: 6698.552 ns/op # Warmup Iteration 5: 6687.760 ns/op Iteration 1: 6682.482 ns/op Iteration 2: 6703.237 ns/op Iteration 3: 6695.677 ns/op Iteration 4: 6694.490 ns/op Iteration 5: 6734.070 ns/op # Run progress: 76.00% complete, ETA 00:10:04 # Fork: 5 of 5 # Warmup Iteration 1: 7361.120 ns/op # Warmup Iteration 2: 6962.867 ns/op # Warmup Iteration 3: 6967.817 ns/op # Warmup Iteration 4: 6947.602 ns/op # Warmup Iteration 5: 6990.092 ns/op Iteration 1: 6968.542 ns/op Iteration 2: 6967.920 ns/op Iteration 3: 6934.112 ns/op Iteration 4: 6919.707 ns/op Iteration 5: 6971.308 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 6790.031 ±(99.9%) 109.690 ns/op [Average] (min, avg, max) = (6447.598, 6790.031, 7007.544), stdev = 146.433 CI (99.9%): [6680.341, 6899.721] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = PBQ) # Run progress: 80.00% complete, ETA 00:08:23 # Fork: 1 of 5 # Warmup Iteration 1: 433.561 ns/op # Warmup Iteration 2: 459.544 ns/op # Warmup Iteration 3: 647.066 ns/op # Warmup Iteration 4: 539.701 ns/op # Warmup Iteration 5: 434.979 ns/op Iteration 1: 433.463 ns/op Iteration 2: 432.350 ns/op Iteration 3: 436.517 ns/op Iteration 4: 445.786 ns/op Iteration 5: 438.007 ns/op # Run progress: 84.00% complete, ETA 00:06:43 # Fork: 2 of 5 # Warmup Iteration 1: 491.803 ns/op # Warmup Iteration 2: 495.961 ns/op # Warmup Iteration 3: 436.316 ns/op # Warmup Iteration 4: 429.560 ns/op # Warmup Iteration 5: 416.227 ns/op Iteration 1: 421.303 ns/op Iteration 2: 433.101 ns/op Iteration 3: 433.540 ns/op Iteration 4: 439.108 ns/op Iteration 5: 437.485 ns/op # Run progress: 88.00% complete, ETA 00:05:02 # Fork: 3 of 5 # Warmup Iteration 1: 417.663 ns/op # Warmup Iteration 2: 421.829 ns/op # Warmup Iteration 3: 369.411 ns/op # Warmup Iteration 4: 367.668 ns/op # Warmup Iteration 5: 404.647 ns/op Iteration 1: 429.568 ns/op Iteration 2: 426.991 ns/op Iteration 3: 426.833 ns/op Iteration 4: 435.121 ns/op Iteration 5: 447.719 ns/op # Run progress: 92.00% complete, ETA 00:03:21 # Fork: 4 of 5 # Warmup Iteration 1: 419.738 ns/op # Warmup Iteration 2: 397.067 ns/op # Warmup Iteration 3: 458.753 ns/op # Warmup Iteration 4: 492.231 ns/op # Warmup Iteration 5: 470.490 ns/op Iteration 1: 466.641 ns/op Iteration 2: 531.030 ns/op Iteration 3: 616.194 ns/op Iteration 4: 467.137 ns/op Iteration 5: 432.749 ns/op # Run progress: 96.00% complete, ETA 00:01:40 # Fork: 5 of 5 # Warmup Iteration 1: 496.391 ns/op # Warmup Iteration 2: 498.277 ns/op # Warmup Iteration 3: 461.229 ns/op # Warmup Iteration 4: 457.534 ns/op # Warmup Iteration 5: 445.764 ns/op Iteration 1: 435.053 ns/op Iteration 2: 442.734 ns/op Iteration 3: 442.831 ns/op Iteration 4: 380.906 ns/op Iteration 5: 378.233 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 444.416 ±(99.9%) 33.785 ns/op [Average] (min, avg, max) = (378.233, 444.416, 616.194), stdev = 45.102 CI (99.9%): [410.631, 478.201] (assumes normal distribution) # Run complete. Total time: 00:41:59 REMEMBER: The numbers below are just data. To gain reusable insights, you need to follow up on why the numbers are the way they are. Use profilers (see -prof, -lprof), design factorial experiments, perform baseline and negative tests that provide experimental control, make sure the benchmarking environment is safe on JVM/OS/HW level, ask for reviews from the domain experts. Do not assume the numbers tell you what you want them to tell. Benchmark (capacity) (type) Mode Cnt Score Error Units o.sample.MyBenchmark.testMethod N/A N/A thrpt 25 1749022980.533 ± 22716865.495 ops/s o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 LBQ avgt 25 225.580 ± 10.837 ns/op o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 ABQ_NF avgt 25 415.754 ± 16.758 ns/op o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 ABQ_F avgt 25 6790.031 ± 109.690 ns/op o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 PBQ avgt 25 444.416 ± 33.785 ns/op