Master branch - Gateway - Read latency 2020-07-24 20:46:43,032 [main] INFO com.azure.cosmos.benchmark.AsyncReadBenchmark - [1000000] operations performed in [303] seconds. 7/24/20 8:46:43 PM ============================================================= -- Meters ---------------------------------------------------------------------- #Successful Operations count = 1000000 mean rate = 3299.95 events/second 1-minute rate = 3311.18 events/second 5-minute rate = 3176.15 events/second 15-minute rate = 3052.23 events/second #Unsuccessful Operations count = 0 mean rate = 0.00 events/second 1-minute rate = 0.00 events/second 5-minute rate = 0.00 events/second 15-minute rate = 0.00 events/second -- Timers ---------------------------------------------------------------------- Latency count = 1000000 mean rate = 3299.98 calls/second 1-minute rate = 3311.19 calls/second 5-minute rate = 3176.89 calls/second 15-minute rate = 3053.68 calls/second min = 1.96 milliseconds max = 28.01 milliseconds mean = 2.90 milliseconds stddev = 1.15 milliseconds median = 2.71 milliseconds 75% <= 2.96 milliseconds 95% <= 3.78 milliseconds 98% <= 4.88 milliseconds 99% <= 6.93 milliseconds 99.9% <= 20.92 milliseconds Master branch - Gateway - Query Clause in Parallel 2020-07-24 21:00:47,130 [reactor-http-epoll-5] INFO com.azure.cosmos.benchmark.AsyncQueryBenchmark - total pages so far: 10000 2020-07-24 21:00:47,131 [main] INFO com.azure.cosmos.benchmark.AsyncQueryBenchmark - [10000] operations performed in [201] seconds. 7/24/20 9:00:47 PM ============================================================= -- Meters ---------------------------------------------------------------------- #Successful Operations count = 10000 mean rate = 49.63 events/second 1-minute rate = 48.15 events/second 5-minute rate = 43.26 events/second 15-minute rate = 39.83 events/second #Unsuccessful Operations count = 0 mean rate = 0.00 events/second 1-minute rate = 0.00 events/second 5-minute rate = 0.00 events/second 15-minute rate = 0.00 events/second -- Timers ---------------------------------------------------------------------- Latency count = 10000 mean rate = 49.63 calls/second 1-minute rate = 48.15 calls/second 5-minute rate = 43.26 calls/second 15-minute rate = 39.83 calls/second min = 125.46 milliseconds max = 778.06 milliseconds mean = 214.29 milliseconds stddev = 81.99 milliseconds median = 186.23 milliseconds 75% <= 248.33 milliseconds 95% <= 373.38 milliseconds 98% <= 458.61 milliseconds 99% <= 510.79 milliseconds 99.9% <= 778.06 milliseconds Reactor Netty branch - Gateway - Read Latency 2020-07-24 20:54:12,286 [main] INFO com.azure.cosmos.benchmark.AsyncReadBenchmark - [1000000] operations performed in [302] seconds. 7/24/20 8:54:12 PM ============================================================= -- Meters ---------------------------------------------------------------------- #Successful Operations count = 1000000 mean rate = 3308.15 events/second 1-minute rate = 3294.13 events/second 5-minute rate = 3231.70 events/second 15-minute rate = 3160.81 events/second #Unsuccessful Operations count = 0 mean rate = 0.00 events/second 1-minute rate = 0.00 events/second 5-minute rate = 0.00 events/second 15-minute rate = 0.00 events/second -- Timers ---------------------------------------------------------------------- Latency count = 1000000 mean rate = 3308.17 calls/second 1-minute rate = 3294.16 calls/second 5-minute rate = 3232.45 calls/second 15-minute rate = 3162.25 calls/second min = 2.04 milliseconds max = 20.78 milliseconds mean = 2.91 milliseconds stddev = 1.13 milliseconds median = 2.71 milliseconds 75% <= 2.96 milliseconds 95% <= 3.83 milliseconds 98% <= 5.38 milliseconds 99% <= 6.86 milliseconds 99.9% <= 20.78 milliseconds Reactor Netty branch - Gateway - Query Clause in Parallel 2020-07-24 21:07:14,417 [reactor-http-epoll-3] INFO com.azure.cosmos.benchmark.AsyncQueryBenchmark - total pages so far: 10000 2020-07-24 21:07:14,418 [main] INFO com.azure.cosmos.benchmark.AsyncQueryBenchmark - [10000] operations performed in [280] seconds. 7/24/20 9:07:14 PM ============================================================= -- Meters ---------------------------------------------------------------------- #Successful Operations count = 10000 mean rate = 35.61 events/second 1-minute rate = 34.50 events/second 5-minute rate = 31.38 events/second 15-minute rate = 27.96 events/second #Unsuccessful Operations count = 0 mean rate = 0.00 events/second 1-minute rate = 0.00 events/second 5-minute rate = 0.00 events/second 15-minute rate = 0.00 events/second -- Timers ---------------------------------------------------------------------- Latency count = 10000 mean rate = 35.61 calls/second 1-minute rate = 34.50 calls/second 5-minute rate = 31.38 calls/second 15-minute rate = 27.96 calls/second min = 117.68 milliseconds max = 726.33 milliseconds mean = 291.54 milliseconds stddev = 94.71 milliseconds median = 277.49 milliseconds 75% <= 345.25 milliseconds 95% <= 469.75 milliseconds 98% <= 549.00 milliseconds 99% <= 591.32 milliseconds 99.9% <= 647.08 milliseconds 2020-07-24 21:11:52,473 [reactor-http-epoll-8] INFO com.azure.cosmos.benchmark.AsyncQueryBenchmark - total pages so far: 10000 2020-07-24 21:11:52,474 [main] INFO com.azure.cosmos.benchmark.AsyncQueryBenchmark - [10000] operations performed in [209] seconds. 7/24/20 9:11:52 PM ============================================================= -- Meters ---------------------------------------------------------------------- #Successful Operations count = 10000 mean rate = 47.72 events/second 1-minute rate = 47.76 events/second 5-minute rate = 42.40 events/second 15-minute rate = 39.20 events/second #Unsuccessful Operations count = 0 mean rate = 0.00 events/second 1-minute rate = 0.00 events/second 5-minute rate = 0.00 events/second 15-minute rate = 0.00 events/second -- Timers ---------------------------------------------------------------------- Latency count = 10000 mean rate = 47.72 calls/second 1-minute rate = 47.75 calls/second 5-minute rate = 42.40 calls/second 15-minute rate = 39.20 calls/second min = 121.39 milliseconds max = 664.35 milliseconds mean = 210.29 milliseconds stddev = 57.71 milliseconds median = 202.58 milliseconds 75% <= 230.49 milliseconds 95% <= 315.46 milliseconds 98% <= 377.79 milliseconds 99% <= 444.62 milliseconds 99.9% <= 562.34 milliseconds