Rate limiting significantly impacts results

[howardjohn]

Here I set the rate limit to 10qps, and my response are crazy high, up to 18s. This service is absolutely not that slow.

# oha -q 10 -c 100 "${DESTINATION}"
Summary:
  Success rate: 1.0000
  Total:        19.9057 secs
  Slowest:      19.4002 secs
  Fastest:      0.1017 secs
  Average:      7.4746 secs
  Requests/sec: 10.0473

  Total data:   200.00 KiB
  Size/request: 1024 B
  Size/sec:     10.05 KiB

Response time histogram:
  1.754 [19] |■■■■■■■■■■■■■■■■
  3.509 [23] |■■■■■■■■■■■■■■■■■■■■
  5.263 [32] |■■■■■■■■■■■■■■■■■■■■■■■■■■■■
  7.018 [36] |■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■
  8.772 [33] |■■■■■■■■■■■■■■■■■■■■■■■■■■■■■
  10.526 [7]  |■■■■■■
  12.281 [9]  |■■■■■■■■
  14.035 [13] |■■■■■■■■■■■
  15.790 [14] |■■■■■■■■■■■■
  17.544 [9]  |■■■■■■■■
  19.298 [5]  |■■■■

Latency distribution:
  10% in 1.9994 secs
  25% in 4.3002 secs
  50% in 6.6000 secs
  75% in 10.6993 secs
  90% in 14.7995 secs
  95% in 16.6002 secs
  99% in 18.6991 secs

Details (average, fastest, slowest):
  DNS+dialup:   5.5760 secs, 0.0336 secs, 16.1002 secs
  DNS-lookup:   5.4315 secs, 0.0298 secs, 16.0029 secs

Status code distribution:
  [200] 200 responses

Without a high rate limit, this drops down to more reasonable levels:

# oha -q 10000 -c 100 "${DESTINATION}"
Summary:
  Success rate: 1.0000
  Total:        0.0714 secs
  Slowest:      0.0631 secs
  Fastest:      0.0010 secs
  Average:      0.0235 secs
  Requests/sec: 2801.0961

  Total data:   200.00 KiB
  Size/request: 1024 B
  Size/sec:     2.74 MiB

Response time histogram:
  0.006 [100] |■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■
  0.011 [0]   |
  0.017 [0]   |
  0.023 [0]   |
  0.028 [0]   |
  0.034 [0]   |
  0.039 [6]   |■
  0.045 [51]  |■■■■■■■■■■■■■■■■
  0.051 [42]  |■■■■■■■■■■■■■
  0.056 [0]   |
  0.062 [1]   |

Latency distribution:
  10% in 0.0012 secs
  25% in 0.0014 secs
  50% in 0.0365 secs
  75% in 0.0456 secs
  90% in 0.0489 secs
  95% in 0.0497 secs
  99% in 0.0512 secs

Details (average, fastest, slowest):
  DNS+dialup:   0.0398 secs, 0.0309 secs, 0.0624 secs
  DNS-lookup:   0.0370 secs, 0.0272 secs, 0.0622 secs

Status code distribution:
  [200] 200 responses

One other note, in hey, the rate is -q*-z:

# hey -q 10 -c 100 "${DESTINATION}"

Summary:
  Total:        0.2059 secs
  Slowest:      0.0145 secs
  Fastest:      0.0023 secs
  Average:      0.0082 secs
  Requests/sec: 971.3312

[hatoo]

Fixed by #104