Commits on Aug 3, 2023

1. proxy: v2.207.0 …

   In 2.13, the default inbound and outbound HTTP request queue capacity
   decreased from 10,000 requests to 100 requests (in PR #2078). This
   change results in proxies shedding load much more aggressively while
   under high load to a single destination service, resulting in increased
   error rates in comparison to 2.12 (see #11055 for
   details).
   
   This commit changes the default HTTP request queue capacities for the
   inbound and outbound proxies back to 10,000 requests, the way they were
   in 2.12 and earlier. In manual load testing I've verified that
   increasing the queue capacity results in a substantial decrease in 503
   Service Unavailable errors emitted by the proxy: with a queue capacity
   of 100 requests, the load test described [here] observed a failure rate
   of 51.51% of requests, while with a queue capacity of 10,000 requests,
   the same load test observes no failures.
   
   Note that I did not modify the TCP connection queue capacities, or the
   control plane request queue capacity. These were previously configured
   by the same variable before #2078, but were split out into separate vars
   in that change. I don't think the queue capacity limits for TCP
   connection establishment or for control plane requests are currently
   resulting in instability the way the decreased request queue capacity
   is, so I decided to make a more focused change to just the HTTP request
   queues for the proxies.
   
   [here]: #11055 (comment)
   
   ---
   
   * Increase HTTP request queue capacity (linkerd/linkerd2-proxy#2449)
   
   Signed-off-by: Eliza Weisman <eliza@buoyant.io>

   

   hawkw committed Aug 3, 2023
   Configuration menu

   • View commit details
   • Copy full SHA for 28b9bef
   • Browse repository at this point

   Copy the full SHA

   28b9bef View commit details

   Browse the repository at this point in the history