diff --git a/tests/results/dp-perf/release-2.1.2/release-2.1.2-oss.md b/tests/results/dp-perf/release-2.1.2/release-2.1.2-oss.md new file mode 100644 index 0000000000..8eff6379b9 --- /dev/null +++ b/tests/results/dp-perf/release-2.1.2/release-2.1.2-oss.md @@ -0,0 +1,86 @@ +# Results + +## Test environment + +NGINX Plus: false + +NGINX Gateway Fabric: + +- Commit: 8241478604f782eca497329ae47507b978d117b1 +- Date: 2025-09-24T18:19:40Z +- Dirty: false + +GKE Cluster: + +- Node count: 15 +- k8s version: v1.33.4-gke.1134000 +- vCPUs per node: 2 +- RAM per node: 4015668Ki +- Max pods per node: 110 +- Zone: us-east1-b +- Instance Type: e2-medium + +## Test1: Running latte path based routing + +```text +Requests [total, rate, throughput] 30000, 1000.03, 999.97 +Duration [total, attack, wait] 30.001s, 29.999s, 1.799ms +Latencies [min, mean, 50, 90, 95, 99, max] 909.791µs, 1.868ms, 1.507ms, 2.142ms, 2.756ms, 8.611ms, 60.614ms +Bytes In [total, mean] 4770000, 159.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +## Test2: Running coffee header based routing + +```text +Requests [total, rate, throughput] 30000, 1000.00, 999.95 +Duration [total, attack, wait] 30.002s, 30s, 1.712ms +Latencies [min, mean, 50, 90, 95, 99, max] 991.792µs, 2.102ms, 1.659ms, 2.466ms, 3.321ms, 11.629ms, 73.799ms +Bytes In [total, mean] 4800000, 160.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +## Test3: Running coffee query based routing + +```text +Requests [total, rate, throughput] 30000, 1000.04, 999.98 +Duration [total, attack, wait] 30.001s, 29.999s, 1.599ms +Latencies [min, mean, 50, 90, 95, 99, max] 964.301µs, 2.088ms, 1.589ms, 2.194ms, 2.891ms, 12.188ms, 77.709ms +Bytes In [total, mean] 5040000, 168.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +## Test4: Running tea GET method based routing + +```text +Requests [total, rate, throughput] 30000, 1000.01, 999.96 +Duration [total, attack, wait] 30.001s, 30s, 1.373ms +Latencies [min, mean, 50, 90, 95, 99, max] 935.247µs, 1.88ms, 1.503ms, 2.006ms, 2.429ms, 11.029ms, 73.867ms +Bytes In [total, mean] 4710000, 157.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +## Test5: Running tea POST method based routing + +```text +Requests [total, rate, throughput] 30000, 1000.01, 999.97 +Duration [total, attack, wait] 30.001s, 30s, 1.329ms +Latencies [min, mean, 50, 90, 95, 99, max] 981.259µs, 1.759ms, 1.535ms, 1.991ms, 2.43ms, 7.522ms, 29.702ms +Bytes In [total, mean] 4710000, 157.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` diff --git a/tests/results/dp-perf/release-2.1.2/release-2.1.2-plus.md b/tests/results/dp-perf/release-2.1.2/release-2.1.2-plus.md new file mode 100644 index 0000000000..87a07d08c5 --- /dev/null +++ b/tests/results/dp-perf/release-2.1.2/release-2.1.2-plus.md @@ -0,0 +1,86 @@ +# Results + +## Test environment + +NGINX Plus: true + +NGINX Gateway Fabric: + +- Commit: 8241478604f782eca497329ae47507b978d117b1 +- Date: 2025-09-25T01:19:35Z +- Dirty: false + +GKE Cluster: + +- Node count: 15 +- k8s version: v1.33.4-gke.1134000 +- vCPUs per node: 2 +- RAM per node: 4015672Ki +- Max pods per node: 110 +- Zone: us-south1-a +- Instance Type: e2-medium + +## Test1: Running latte path based routing + +```text +Requests [total, rate, throughput] 30000, 1000.04, 1000.01 +Duration [total, attack, wait] 30s, 29.999s, 899.747µs +Latencies [min, mean, 50, 90, 95, 99, max] 755.39µs, 1.083ms, 972.127µs, 1.139ms, 1.257ms, 3.409ms, 34.066ms +Bytes In [total, mean] 4830000, 161.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +## Test2: Running coffee header based routing + +```text +Requests [total, rate, throughput] 30000, 1000.04, 1000.01 +Duration [total, attack, wait] 30s, 29.999s, 960.429µs +Latencies [min, mean, 50, 90, 95, 99, max] 790.502µs, 1.086ms, 1.017ms, 1.192ms, 1.293ms, 2.776ms, 13.993ms +Bytes In [total, mean] 4860000, 162.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +## Test3: Running coffee query based routing + +```text +Requests [total, rate, throughput] 30000, 1000.00, 999.97 +Duration [total, attack, wait] 30.001s, 30s, 956.779µs +Latencies [min, mean, 50, 90, 95, 99, max] 807.149µs, 1.174ms, 1.02ms, 1.204ms, 1.338ms, 4.79ms, 37.843ms +Bytes In [total, mean] 5100000, 170.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +## Test4: Running tea GET method based routing + +```text +Requests [total, rate, throughput] 30000, 1000.04, 1000.00 +Duration [total, attack, wait] 30s, 29.999s, 1.032ms +Latencies [min, mean, 50, 90, 95, 99, max] 773.587µs, 1.065ms, 1.006ms, 1.176ms, 1.264ms, 2.48ms, 20.731ms +Bytes In [total, mean] 4770000, 159.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +## Test5: Running tea POST method based routing + +```text +Requests [total, rate, throughput] 30000, 1000.00, 999.97 +Duration [total, attack, wait] 30.001s, 30s, 937.91µs +Latencies [min, mean, 50, 90, 95, 99, max] 805.184µs, 1.194ms, 1.011ms, 1.191ms, 1.312ms, 4.171ms, 58.715ms +Bytes In [total, mean] 4770000, 159.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` diff --git a/tests/results/ngf-upgrade/release-2.1.2/http-oss.png b/tests/results/ngf-upgrade/release-2.1.2/http-oss.png new file mode 100644 index 0000000000..f0aabc0cc9 Binary files /dev/null and b/tests/results/ngf-upgrade/release-2.1.2/http-oss.png differ diff --git a/tests/results/ngf-upgrade/release-2.1.2/http-plus.png b/tests/results/ngf-upgrade/release-2.1.2/http-plus.png new file mode 100644 index 0000000000..13fa449578 Binary files /dev/null and b/tests/results/ngf-upgrade/release-2.1.2/http-plus.png differ diff --git a/tests/results/ngf-upgrade/release-2.1.2/https-oss.png b/tests/results/ngf-upgrade/release-2.1.2/https-oss.png new file mode 100644 index 0000000000..f0aabc0cc9 Binary files /dev/null and b/tests/results/ngf-upgrade/release-2.1.2/https-oss.png differ diff --git a/tests/results/ngf-upgrade/release-2.1.2/https-plus.png b/tests/results/ngf-upgrade/release-2.1.2/https-plus.png new file mode 100644 index 0000000000..13fa449578 Binary files /dev/null and b/tests/results/ngf-upgrade/release-2.1.2/https-plus.png differ diff --git a/tests/results/ngf-upgrade/release-2.1.2/release-2.1.2-oss.md b/tests/results/ngf-upgrade/release-2.1.2/release-2.1.2-oss.md new file mode 100644 index 0000000000..9cd1545a99 --- /dev/null +++ b/tests/results/ngf-upgrade/release-2.1.2/release-2.1.2-oss.md @@ -0,0 +1,53 @@ +# Results + +## Test environment + +NGINX Plus: false + +NGINX Gateway Fabric: + +- Commit: 8241478604f782eca497329ae47507b978d117b1 +- Date: 2025-09-24T18:19:40Z +- Dirty: false + +GKE Cluster: + +- Node count: 15 +- k8s version: v1.33.4-gke.1134000 +- vCPUs per node: 2 +- RAM per node: 4015668Ki +- Max pods per node: 110 +- Zone: us-east1-b +- Instance Type: e2-medium + +## Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 6000, 100.01, 99.66 +Duration [total, attack, wait] 59.994s, 59.993s, 1.742ms +Latencies [min, mean, 50, 90, 95, 99, max] 579.788µs, 236.428ms, 1.95ms, 12.814ms, 2.333s, 4.553s, 5.076s +Bytes In [total, mean] 928726, 154.79 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 99.65% +Status Codes [code:count] 0:21 200:5979 +Error Set: +Get "https://cafe.example.com/tea": dial tcp 0.0.0.0:0->10.142.0.59:443: connect: connection refused +``` + +![https-oss.png](https-oss.png) + +## Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 6000, 100.01, 99.64 +Duration [total, attack, wait] 59.994s, 59.992s, 1.987ms +Latencies [min, mean, 50, 90, 95, 99, max] 591.987µs, 232.293ms, 1.892ms, 12.183ms, 2.28s, 4.543s, 5.056s +Bytes In [total, mean] 962458, 160.41 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 99.63% +Status Codes [code:count] 0:22 200:5978 +Error Set: +Get "http://cafe.example.com/coffee": dial tcp 0.0.0.0:0->10.142.0.59:80: connect: connection refused +``` + +![http-oss.png](http-oss.png) diff --git a/tests/results/ngf-upgrade/release-2.1.2/release-2.1.2-plus.md b/tests/results/ngf-upgrade/release-2.1.2/release-2.1.2-plus.md new file mode 100644 index 0000000000..fcd02d5f8c --- /dev/null +++ b/tests/results/ngf-upgrade/release-2.1.2/release-2.1.2-plus.md @@ -0,0 +1,57 @@ +# Results + +## Test environment + +NGINX Plus: true + +NGINX Gateway Fabric: + +- Commit: 8241478604f782eca497329ae47507b978d117b1 +- Date: 2025-09-25T01:19:35Z +- Dirty: false + +GKE Cluster: + +- Node count: 15 +- k8s version: v1.33.4-gke.1134000 +- vCPUs per node: 2 +- RAM per node: 4015672Ki +- Max pods per node: 110 +- Zone: us-south1-a +- Instance Type: e2-medium + +## Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 6000, 100.01, 99.61 +Duration [total, attack, wait] 59.994s, 59.992s, 2.553ms +Latencies [min, mean, 50, 90, 95, 99, max] 501.4µs, 629.899ms, 1.546ms, 2.856s, 5.518s, 7.81s, 8.341s +Bytes In [total, mean] 928271, 154.71 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 99.60% +Status Codes [code:count] 0:24 200:5976 +Error Set: +Get "https://cafe.example.com/tea": read tcp 10.206.0.17:60039->10.206.0.24:443: read: connection reset by peer +Get "https://cafe.example.com/tea": write tcp 10.206.0.17:44027->10.206.0.24:443: write: connection reset by peer +Get "https://cafe.example.com/tea": dial tcp 0.0.0.0:0->10.206.0.24:443: connect: connection refused +``` + +![https-plus.png](https-plus.png) + +## Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 6000, 100.01, 99.61 +Duration [total, attack, wait] 59.994s, 59.992s, 2.318ms +Latencies [min, mean, 50, 90, 95, 99, max] 492.213µs, 611.258ms, 1.381ms, 2.64s, 5.498s, 7.789s, 8.344s +Bytes In [total, mean] 962095, 160.35 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 99.60% +Status Codes [code:count] 0:24 200:5976 +Error Set: +Get "http://cafe.example.com/coffee": read tcp 10.206.0.17:42805->10.206.0.24:80: read: connection reset by peer +Get "http://cafe.example.com/coffee": read tcp 10.206.0.17:46097->10.206.0.24:80: read: connection reset by peer +Get "http://cafe.example.com/coffee": dial tcp 0.0.0.0:0->10.206.0.24:80: connect: connection refused +``` + +![http-plus.png](http-plus.png) diff --git a/tests/results/reconfig/release-2.1.2/release-2.1.2-oss.md b/tests/results/reconfig/release-2.1.2/release-2.1.2-oss.md new file mode 100644 index 0000000000..379726047f --- /dev/null +++ b/tests/results/reconfig/release-2.1.2/release-2.1.2-oss.md @@ -0,0 +1,111 @@ +# Results + +## Test environment + +NGINX Plus: false + +NGINX Gateway Fabric: + +- Commit: 8241478604f782eca497329ae47507b978d117b1 +- Date: 2025-09-24T18:19:40Z +- Dirty: false + +GKE Cluster: + +- Node count: 15 +- k8s version: v1.33.4-gke.1134000 +- vCPUs per node: 2 +- RAM per node: 4015668Ki +- Max pods per node: 110 +- Zone: us-east1-b +- Instance Type: e2-medium + +## Test 1: Resources exist before startup - NumResources 30 + +### Time to Ready + +Time To Ready Description: From when NGF starts to when the NGINX configuration is fully configured +- TimeToReadyTotal: 23s + +### Event Batch Processing + +- Event Batch Total: 10 +- Event Batch Processing Average Time: 12ms +- Event Batch Processing distribution: + - 500.0ms: 10 + - 1000.0ms: 10 + - 5000.0ms: 10 + - 10000.0ms: 10 + - 30000.0ms: 10 + - +Infms: 10 + +### NGINX Error Logs + +## Test 1: Resources exist before startup - NumResources 150 + +### Time to Ready + +Time To Ready Description: From when NGF starts to when the NGINX configuration is fully configured +- TimeToReadyTotal: 25s + +### Event Batch Processing + +- Event Batch Total: 9 +- Event Batch Processing Average Time: 37ms +- Event Batch Processing distribution: + - 500.0ms: 9 + - 1000.0ms: 9 + - 5000.0ms: 9 + - 10000.0ms: 9 + - 30000.0ms: 9 + - +Infms: 9 + +### NGINX Error Logs + +## Test 2: Start NGF, deploy Gateway, wait until NGINX agent instance connects to NGF, create many resources attached to GW - NumResources 30 + +### Time to Ready + +Time To Ready Description: From when NGINX receives the first configuration created by NGF to when the NGINX configuration is fully configured +- TimeToReadyTotal: 24s + +### Event Batch Processing + +- Event Batch Total: 272 +- Event Batch Processing Average Time: 28ms +- Event Batch Processing distribution: + - 500.0ms: 266 + - 1000.0ms: 272 + - 5000.0ms: 272 + - 10000.0ms: 272 + - 30000.0ms: 272 + - +Infms: 272 + +### NGINX Error Logs +2025/09/25 03:10:51 [emerg] 8#8: unexpected end of file, expecting "}" in /etc/nginx/conf.d/http.conf:459 +2025/09/25 03:10:56 [emerg] 8#8: unexpected end of file, expecting "}" in /etc/nginx/conf.d/http.conf:2433 + +## Test 2: Start NGF, deploy Gateway, wait until NGINX agent instance connects to NGF, create many resources attached to GW - NumResources 150 + +### Time to Ready + +Time To Ready Description: From when NGINX receives the first configuration created by NGF to when the NGINX configuration is fully configured +- TimeToReadyTotal: 123s + +### Event Batch Processing + +- Event Batch Total: 1315 +- Event Batch Processing Average Time: 23ms +- Event Batch Processing distribution: + - 500.0ms: 1277 + - 1000.0ms: 1314 + - 5000.0ms: 1315 + - 10000.0ms: 1315 + - 30000.0ms: 1315 + - +Infms: 1315 + +### NGINX Error Logs +2025/09/25 03:15:10 [emerg] 8#8: unexpected end of file, expecting "}" in /etc/nginx/conf.d/http.conf:1466 +2025/09/25 03:15:14 [emerg] 8#8: unexpected end of file, expecting ";" or "}" in /etc/nginx/conf.d/http.conf:3065 +2025/09/25 03:15:15 [emerg] 8#8: unexpected end of file, expecting "}" in /etc/nginx/conf.d/http.conf:3560 +2025/09/25 03:15:23 [emerg] 8#8: directive "upstream" has no opening "{" in /etc/nginx/conf.d/http.conf:7773 diff --git a/tests/results/reconfig/release-2.1.2/release-2.1.2-plus.md b/tests/results/reconfig/release-2.1.2/release-2.1.2-plus.md new file mode 100644 index 0000000000..ffda419fd4 --- /dev/null +++ b/tests/results/reconfig/release-2.1.2/release-2.1.2-plus.md @@ -0,0 +1,105 @@ +# Results + +## Test environment + +NGINX Plus: true + +NGINX Gateway Fabric: + +- Commit: 8241478604f782eca497329ae47507b978d117b1 +- Date: 2025-09-25T01:19:35Z +- Dirty: false + +GKE Cluster: + +- Node count: 15 +- k8s version: v1.33.4-gke.1134000 +- vCPUs per node: 2 +- RAM per node: 4015672Ki +- Max pods per node: 110 +- Zone: us-south1-a +- Instance Type: e2-medium + +## Test 1: Resources exist before startup - NumResources 30 + +### Time to Ready + +Time To Ready Description: From when NGF starts to when the NGINX configuration is fully configured +- TimeToReadyTotal: 18s + +### Event Batch Processing + +- Event Batch Total: 8 +- Event Batch Processing Average Time: 22ms +- Event Batch Processing distribution: + - 500.0ms: 8 + - 1000.0ms: 8 + - 5000.0ms: 8 + - 10000.0ms: 8 + - 30000.0ms: 8 + - +Infms: 8 + +### NGINX Error Logs + +## Test 1: Resources exist before startup - NumResources 150 + +### Time to Ready + +Time To Ready Description: From when NGF starts to when the NGINX configuration is fully configured +- TimeToReadyTotal: 28s + +### Event Batch Processing + +- Event Batch Total: 8 +- Event Batch Processing Average Time: 39ms +- Event Batch Processing distribution: + - 500.0ms: 8 + - 1000.0ms: 8 + - 5000.0ms: 8 + - 10000.0ms: 8 + - 30000.0ms: 8 + - +Infms: 8 + +### NGINX Error Logs + +## Test 2: Start NGF, deploy Gateway, wait until NGINX agent instance connects to NGF, create many resources attached to GW - NumResources 30 + +### Time to Ready + +Time To Ready Description: From when NGINX receives the first configuration created by NGF to when the NGINX configuration is fully configured +- TimeToReadyTotal: 21s + +### Event Batch Processing + +- Event Batch Total: 206 +- Event Batch Processing Average Time: 41ms +- Event Batch Processing distribution: + - 500.0ms: 199 + - 1000.0ms: 203 + - 5000.0ms: 206 + - 10000.0ms: 206 + - 30000.0ms: 206 + - +Infms: 206 + +### NGINX Error Logs + +## Test 2: Start NGF, deploy Gateway, wait until NGINX agent instance connects to NGF, create many resources attached to GW - NumResources 150 + +### Time to Ready + +Time To Ready Description: From when NGINX receives the first configuration created by NGF to when the NGINX configuration is fully configured +- TimeToReadyTotal: 113s + +### Event Batch Processing + +- Event Batch Total: 1021 +- Event Batch Processing Average Time: 33ms +- Event Batch Processing distribution: + - 500.0ms: 1000 + - 1000.0ms: 1008 + - 5000.0ms: 1021 + - 10000.0ms: 1021 + - 30000.0ms: 1021 + - +Infms: 1021 + +### NGINX Error Logs diff --git a/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/cpu-oss.png b/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/cpu-oss.png new file mode 100644 index 0000000000..30074d6371 Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/cpu-oss.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/cpu-plus.png b/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/cpu-plus.png new file mode 100644 index 0000000000..9db69c224a Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/cpu-plus.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/memory-oss.png b/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/memory-oss.png new file mode 100644 index 0000000000..dfbb0aa388 Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/memory-oss.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/memory-plus.png b/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/memory-plus.png new file mode 100644 index 0000000000..cbd1eba2da Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/memory-plus.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/ttr-oss.png b/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/ttr-oss.png new file mode 100644 index 0000000000..7a1d6fa7bf Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/ttr-oss.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/ttr-plus.png b/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/ttr-plus.png new file mode 100644 index 0000000000..8faa35b2a0 Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_HTTPRoutes/ttr-plus.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/cpu-oss.png b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/cpu-oss.png new file mode 100644 index 0000000000..6b4c5dea9d Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/cpu-oss.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/cpu-plus.png b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/cpu-plus.png new file mode 100644 index 0000000000..8186e3c232 Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/cpu-plus.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/memory-oss.png b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/memory-oss.png new file mode 100644 index 0000000000..2c03bd4670 Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/memory-oss.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/memory-plus.png b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/memory-plus.png new file mode 100644 index 0000000000..10b31c5558 Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/memory-plus.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/ngf-oss.log b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/ngf-oss.log new file mode 100644 index 0000000000..a9efe75757 --- /dev/null +++ b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/ngf-oss.log @@ -0,0 +1,2 @@ +{"level":"debug","ts":"2025-09-25T03:29:24Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"} +{"level":"debug","ts":"2025-09-25T03:29:51Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"} diff --git a/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/ngf-plus.log b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/ngf-plus.log new file mode 100644 index 0000000000..ae7130a152 --- /dev/null +++ b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/ngf-plus.log @@ -0,0 +1,4 @@ +{"level":"debug","ts":"2025-09-25T04:32:43Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"} +{"level":"debug","ts":"2025-09-25T04:33:32Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"} +{"level":"debug","ts":"2025-09-25T04:33:44Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"} +{"level":"debug","ts":"2025-09-25T04:34:02Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"} diff --git a/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/nginx-plus.log b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/nginx-plus.log new file mode 100644 index 0000000000..813b3eea1f --- /dev/null +++ b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/nginx-plus.log @@ -0,0 +1,174 @@ +2025/09/25 04:33:23 [error] 66#66: *51 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 1.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-1_80/", host: "1.example.com" +2025/09/25 04:33:23 [error] 67#67: *52 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 1.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-1_80/", host: "1.example.com" +2025/09/25 04:33:23 [error] 66#66: *53 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 1.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-1_80/", host: "1.example.com" +2025/09/25 04:33:23 [error] 66#66: *54 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 1.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-1_80/", host: "1.example.com" +2025/09/25 04:33:24 [error] 74#74: *68 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 2.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-2_80/", host: "2.example.com" +2025/09/25 04:33:24 [error] 75#75: *69 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 2.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-2_80/", host: "2.example.com" +2025/09/25 04:33:24 [error] 74#74: *70 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 2.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-2_80/", host: "2.example.com" +2025/09/25 04:33:24 [error] 74#74: *71 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 2.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-2_80/", host: "2.example.com" +2025/09/25 04:33:25 [error] 83#83: *90 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 3.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-3_80/", host: "3.example.com" +2025/09/25 04:33:25 [error] 84#84: *91 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 3.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-3_80/", host: "3.example.com" +2025/09/25 04:33:25 [error] 83#83: *92 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 3.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-3_80/", host: "3.example.com" +2025/09/25 04:33:25 [error] 83#83: *93 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 3.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-3_80/", host: "3.example.com" +2025/09/25 04:33:26 [error] 91#91: *109 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 4.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-4_80/", host: "4.example.com" +2025/09/25 04:33:26 [error] 92#92: *110 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 4.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-4_80/", host: "4.example.com" +2025/09/25 04:33:26 [error] 91#91: *111 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 4.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-4_80/", host: "4.example.com" +2025/09/25 04:33:26 [error] 91#91: *112 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 4.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-4_80/", host: "4.example.com" +2025/09/25 04:33:27 [error] 99#99: *129 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 5.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-5_80/", host: "5.example.com" +2025/09/25 04:33:27 [error] 100#100: *130 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 5.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-5_80/", host: "5.example.com" +2025/09/25 04:33:27 [error] 99#99: *131 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 5.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-5_80/", host: "5.example.com" +2025/09/25 04:33:27 [error] 99#99: *132 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 5.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-5_80/", host: "5.example.com" +2025/09/25 04:33:28 [error] 107#107: *151 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 6.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-6_80/", host: "6.example.com" +2025/09/25 04:33:28 [error] 108#108: *152 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 6.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-6_80/", host: "6.example.com" +2025/09/25 04:33:28 [error] 107#107: *153 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 6.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-6_80/", host: "6.example.com" +2025/09/25 04:33:28 [error] 107#107: *154 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 6.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-6_80/", host: "6.example.com" +2025/09/25 04:33:28 [error] 107#107: *155 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 6.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-6_80/", host: "6.example.com" +2025/09/25 04:33:29 [error] 115#115: *174 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 7.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-7_80/", host: "7.example.com" +2025/09/25 04:33:29 [error] 116#116: *175 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 7.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-7_80/", host: "7.example.com" +2025/09/25 04:33:29 [error] 115#115: *176 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 7.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-7_80/", host: "7.example.com" +2025/09/25 04:33:29 [error] 115#115: *177 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 7.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-7_80/", host: "7.example.com" +2025/09/25 04:33:29 [error] 115#115: *179 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 7.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-7_80/", host: "7.example.com" +2025/09/25 04:33:30 [error] 124#124: *199 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 8.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-8_80/", host: "8.example.com" +2025/09/25 04:33:30 [error] 125#125: *200 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 8.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-8_80/", host: "8.example.com" +2025/09/25 04:33:30 [error] 124#124: *201 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 8.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-8_80/", host: "8.example.com" +2025/09/25 04:33:30 [error] 124#124: *202 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 8.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-8_80/", host: "8.example.com" +2025/09/25 04:33:30 [error] 124#124: *203 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 8.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-8_80/", host: "8.example.com" +2025/09/25 04:33:31 [error] 132#132: *225 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 9.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-9_80/", host: "9.example.com" +2025/09/25 04:33:31 [error] 133#133: *227 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 9.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-9_80/", host: "9.example.com" +2025/09/25 04:33:31 [error] 132#132: *228 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 9.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-9_80/", host: "9.example.com" +2025/09/25 04:33:31 [error] 132#132: *229 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 9.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-9_80/", host: "9.example.com" +2025/09/25 04:33:31 [error] 132#132: *230 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 9.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-9_80/", host: "9.example.com" +2025/09/25 04:33:32 [error] 140#140: *244 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 10.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-10_80/", host: "10.example.com" +2025/09/25 04:33:32 [error] 141#141: *245 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 10.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-10_80/", host: "10.example.com" +2025/09/25 04:33:32 [error] 140#140: *246 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 10.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-10_80/", host: "10.example.com" +2025/09/25 04:33:33 [error] 148#148: *270 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 11.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-11_80/", host: "11.example.com" +2025/09/25 04:33:33 [error] 149#149: *271 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 11.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-11_80/", host: "11.example.com" +2025/09/25 04:33:33 [error] 148#148: *272 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 11.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-11_80/", host: "11.example.com" +2025/09/25 04:33:33 [error] 148#148: *273 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 11.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-11_80/", host: "11.example.com" +2025/09/25 04:33:34 [error] 156#156: *298 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 12.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-12_80/", host: "12.example.com" +2025/09/25 04:33:34 [error] 157#157: *299 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 12.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-12_80/", host: "12.example.com" +2025/09/25 04:33:34 [error] 156#156: *301 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 12.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-12_80/", host: "12.example.com" +2025/09/25 04:33:34 [error] 156#156: *302 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 12.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-12_80/", host: "12.example.com" +2025/09/25 04:33:35 [error] 167#167: *328 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 13.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-13_80/", host: "13.example.com" +2025/09/25 04:33:35 [error] 166#166: *329 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 13.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-13_80/", host: "13.example.com" +2025/09/25 04:33:35 [error] 167#167: *330 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 13.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-13_80/", host: "13.example.com" +2025/09/25 04:33:36 [error] 175#175: *357 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 14.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-14_80/", host: "14.example.com" +2025/09/25 04:33:36 [error] 174#174: *358 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 14.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-14_80/", host: "14.example.com" +2025/09/25 04:33:36 [error] 175#175: *359 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 14.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-14_80/", host: "14.example.com" +2025/09/25 04:33:36 [error] 175#175: *360 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 14.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-14_80/", host: "14.example.com" +2025/09/25 04:33:37 [error] 182#182: *388 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 15.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-15_80/", host: "15.example.com" +2025/09/25 04:33:37 [error] 183#183: *389 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 15.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-15_80/", host: "15.example.com" +2025/09/25 04:33:37 [error] 182#182: *390 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 15.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-15_80/", host: "15.example.com" +2025/09/25 04:33:38 [error] 182#182: *391 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 15.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-15_80/", host: "15.example.com" +2025/09/25 04:33:39 [error] 190#190: *420 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 16.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-16_80/", host: "16.example.com" +2025/09/25 04:33:39 [error] 191#191: *421 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 16.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-16_80/", host: "16.example.com" +2025/09/25 04:33:39 [error] 190#190: *422 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 16.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-16_80/", host: "16.example.com" +2025/09/25 04:33:39 [error] 190#190: *423 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 16.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-16_80/", host: "16.example.com" +2025/09/25 04:33:40 [error] 199#199: *455 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 17.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-17_80/", host: "17.example.com" +2025/09/25 04:33:40 [error] 200#200: *456 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 17.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-17_80/", host: "17.example.com" +2025/09/25 04:33:40 [error] 199#199: *457 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 17.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-17_80/", host: "17.example.com" +2025/09/25 04:33:40 [error] 199#199: *458 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 17.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-17_80/", host: "17.example.com" +2025/09/25 04:33:41 [error] 207#207: *490 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 18.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-18_80/", host: "18.example.com" +2025/09/25 04:33:41 [error] 208#208: *491 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 18.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-18_80/", host: "18.example.com" +2025/09/25 04:33:41 [error] 207#207: *492 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 18.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-18_80/", host: "18.example.com" +2025/09/25 04:33:41 [error] 207#207: *493 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 18.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-18_80/", host: "18.example.com" +2025/09/25 04:33:42 [error] 215#215: *525 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 19.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-19_80/", host: "19.example.com" +2025/09/25 04:33:42 [error] 216#216: *526 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 19.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-19_80/", host: "19.example.com" +2025/09/25 04:33:42 [error] 215#215: *527 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 19.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-19_80/", host: "19.example.com" +2025/09/25 04:33:42 [error] 215#215: *528 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 19.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-19_80/", host: "19.example.com" +2025/09/25 04:33:42 [error] 215#215: *529 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 19.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-19_80/", host: "19.example.com" +2025/09/25 04:33:43 [error] 223#223: *561 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 20.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-20_80/", host: "20.example.com" +2025/09/25 04:33:45 [error] 240#240: *627 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 22.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-22_80/", host: "22.example.com" +2025/09/25 04:33:46 [error] 256#256: *698 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 24.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-24_80/", host: "24.example.com" +2025/09/25 04:33:47 [error] 264#264: *735 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 25.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-25_80/", host: "25.example.com" +2025/09/25 04:33:48 [error] 272#272: *770 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 26.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-26_80/", host: "26.example.com" +2025/09/25 04:33:49 [error] 281#281: *808 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 27.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-27_80/", host: "27.example.com" +2025/09/25 04:33:50 [error] 289#289: *847 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 28.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-28_80/", host: "28.example.com" +2025/09/25 04:33:51 [error] 297#297: *888 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 29.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-29_80/", host: "29.example.com" +2025/09/25 04:33:52 [error] 305#305: *928 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 30.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-30_80/", host: "30.example.com" +2025/09/25 04:33:53 [error] 313#313: *970 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 31.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-31_80/", host: "31.example.com" +2025/09/25 04:33:53 [error] 314#314: *982 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 31.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-31_80/", host: "31.example.com" +2025/09/25 04:33:54 [error] 321#321: *1022 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 32.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-32_80/", host: "32.example.com" +2025/09/25 04:33:56 [error] 329#329: *1059 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 33.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-33_80/", host: "33.example.com" +2025/09/25 04:33:56 [error] 330#330: *1071 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 33.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-33_80/", host: "33.example.com" +2025/09/25 04:33:57 [error] 337#337: *1107 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 34.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-34_80/", host: "34.example.com" +2025/09/25 04:33:57 [error] 338#338: *1118 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 34.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-34_80/", host: "34.example.com" +2025/09/25 04:33:58 [error] 345#345: *1162 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 35.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-35_80/", host: "35.example.com" +2025/09/25 04:33:59 [error] 354#354: *1220 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 36.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-36_80/", host: "36.example.com" +2025/09/25 04:33:59 [error] 355#355: *1230 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 36.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-36_80/", host: "36.example.com" +2025/09/25 04:34:01 [error] 363#363: *1280 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 37.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-37_80/", host: "37.example.com" +2025/09/25 04:34:02 [error] 371#371: *1332 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 38.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-38_80/", host: "38.example.com" +2025/09/25 04:34:03 [error] 379#379: *1384 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 39.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-39_80/", host: "39.example.com" +2025/09/25 04:34:04 [error] 387#387: *1427 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 40.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-40_80/", host: "40.example.com" +2025/09/25 04:34:04 [error] 388#388: *1438 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 40.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-40_80/", host: "40.example.com" +2025/09/25 04:34:04 [error] 387#387: *1450 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 40.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-40_80/", host: "40.example.com" +2025/09/25 04:34:06 [error] 396#396: *1492 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 41.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-41_80/", host: "41.example.com" +2025/09/25 04:34:06 [error] 397#397: *1504 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 41.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-41_80/", host: "41.example.com" +2025/09/25 04:34:07 [error] 404#404: *1546 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 42.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-42_80/", host: "42.example.com" +2025/09/25 04:34:07 [error] 405#405: *1556 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 42.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-42_80/", host: "42.example.com" +2025/09/25 04:34:08 [error] 413#413: *1601 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 43.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-43_80/", host: "43.example.com" +2025/09/25 04:34:09 [error] 412#412: *1612 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 43.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-43_80/", host: "43.example.com" +2025/09/25 04:34:10 [error] 420#420: *1655 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 44.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-44_80/", host: "44.example.com" +2025/09/25 04:34:10 [error] 421#421: *1667 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 44.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-44_80/", host: "44.example.com" +2025/09/25 04:34:12 [error] 428#428: *1715 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 45.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-45_80/", host: "45.example.com" +2025/09/25 04:34:12 [error] 429#429: *1727 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 45.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-45_80/", host: "45.example.com" +2025/09/25 04:34:13 [error] 436#436: *1775 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 46.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-46_80/", host: "46.example.com" +2025/09/25 04:34:13 [error] 437#437: *1787 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 46.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-46_80/", host: "46.example.com" +2025/09/25 04:34:15 [error] 445#445: *1835 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 47.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-47_80/", host: "47.example.com" +2025/09/25 04:34:15 [error] 446#446: *1848 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 47.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-47_80/", host: "47.example.com" +2025/09/25 04:34:17 [error] 453#453: *1888 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 48.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-48_80/", host: "48.example.com" +2025/09/25 04:34:17 [error] 454#454: *1900 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 48.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-48_80/", host: "48.example.com" +2025/09/25 04:34:17 [error] 453#453: *1912 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 48.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-48_80/", host: "48.example.com" +2025/09/25 04:34:18 [error] 461#461: *1958 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 49.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-49_80/", host: "49.example.com" +2025/09/25 04:34:19 [error] 462#462: *1969 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 49.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-49_80/", host: "49.example.com" +2025/09/25 04:34:19 [error] 461#461: *1981 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 49.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-49_80/", host: "49.example.com" +2025/09/25 04:34:20 [error] 470#470: *2021 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 50.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-50_80/", host: "50.example.com" +2025/09/25 04:34:20 [error] 471#471: *2033 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 50.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-50_80/", host: "50.example.com" +2025/09/25 04:34:21 [error] 470#470: *2046 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 50.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-50_80/", host: "50.example.com" +2025/09/25 04:34:22 [error] 478#478: *2094 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 51.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-51_80/", host: "51.example.com" +2025/09/25 04:34:22 [error] 479#479: *2107 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 51.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-51_80/", host: "51.example.com" +2025/09/25 04:34:22 [error] 478#478: *2120 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 51.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-51_80/", host: "51.example.com" +2025/09/25 04:34:24 [error] 486#486: *2150 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 52.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-52_80/", host: "52.example.com" +2025/09/25 04:34:24 [error] 487#487: *2161 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 52.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-52_80/", host: "52.example.com" +2025/09/25 04:34:24 [error] 486#486: *2175 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 52.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-52_80/", host: "52.example.com" +2025/09/25 04:34:24 [error] 486#486: *2186 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 52.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-52_80/", host: "52.example.com" +2025/09/25 04:34:27 [error] 495#495: *2224 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 53.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-53_80/", host: "53.example.com" +2025/09/25 04:34:27 [error] 496#496: *2236 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 53.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-53_80/", host: "53.example.com" +2025/09/25 04:34:27 [error] 495#495: *2248 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 53.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-53_80/", host: "53.example.com" +2025/09/25 04:34:28 [error] 503#503: *2291 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 54.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-54_80/", host: "54.example.com" +2025/09/25 04:34:28 [error] 504#504: *2303 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 54.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-54_80/", host: "54.example.com" +2025/09/25 04:34:28 [error] 503#503: *2316 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 54.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-54_80/", host: "54.example.com" +2025/09/25 04:34:29 [error] 511#511: *2358 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 55.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-55_80/", host: "55.example.com" +2025/09/25 04:34:29 [error] 512#512: *2370 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 55.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-55_80/", host: "55.example.com" +2025/09/25 04:34:29 [error] 511#511: *2382 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 55.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-55_80/", host: "55.example.com" +2025/09/25 04:34:30 [error] 511#511: *2394 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 55.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-55_80/", host: "55.example.com" +2025/09/25 04:34:31 [error] 520#520: *2434 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 56.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-56_80/", host: "56.example.com" +2025/09/25 04:34:31 [error] 521#521: *2445 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 56.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-56_80/", host: "56.example.com" +2025/09/25 04:34:31 [error] 520#520: *2460 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 56.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-56_80/", host: "56.example.com" +2025/09/25 04:34:32 [error] 528#528: *2505 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 57.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-57_80/", host: "57.example.com" +2025/09/25 04:34:32 [error] 529#529: *2517 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 57.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-57_80/", host: "57.example.com" +2025/09/25 04:34:32 [error] 528#528: *2528 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 57.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-57_80/", host: "57.example.com" +2025/09/25 04:34:32 [error] 528#528: *2540 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 57.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-57_80/", host: "57.example.com" +2025/09/25 04:34:34 [error] 536#536: *2578 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 58.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-58_80/", host: "58.example.com" +2025/09/25 04:34:34 [error] 537#537: *2591 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 58.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-58_80/", host: "58.example.com" +2025/09/25 04:34:34 [error] 536#536: *2604 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 58.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-58_80/", host: "58.example.com" +2025/09/25 04:34:34 [error] 536#536: *2616 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 58.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-58_80/", host: "58.example.com" +2025/09/25 04:34:36 [error] 545#545: *2655 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 59.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-59_80/", host: "59.example.com" +2025/09/25 04:34:37 [error] 546#546: *2668 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 59.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-59_80/", host: "59.example.com" +2025/09/25 04:34:37 [error] 545#545: *2680 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 59.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-59_80/", host: "59.example.com" +2025/09/25 04:34:37 [error] 545#545: *2693 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 59.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-59_80/", host: "59.example.com" +2025/09/25 04:34:38 [error] 553#553: *2739 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 60.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-60_80/", host: "60.example.com" +2025/09/25 04:34:38 [error] 554#554: *2751 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 60.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-60_80/", host: "60.example.com" +2025/09/25 04:34:38 [error] 553#553: *2763 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 60.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-60_80/", host: "60.example.com" +2025/09/25 04:34:40 [error] 561#561: *2804 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 61.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-61_80/", host: "61.example.com" +2025/09/25 04:34:40 [error] 562#562: *2816 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 61.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-61_80/", host: "61.example.com" +2025/09/25 04:34:40 [error] 561#561: *2829 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 61.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-61_80/", host: "61.example.com" +2025/09/25 04:34:40 [error] 561#561: *2841 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 61.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-61_80/", host: "61.example.com" +2025/09/25 04:34:42 [error] 569#569: *2882 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 62.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-62_80/", host: "62.example.com" +2025/09/25 04:34:42 [error] 570#570: *2895 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 62.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-62_80/", host: "62.example.com" +2025/09/25 04:34:42 [error] 569#569: *2907 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 62.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-62_80/", host: "62.example.com" +2025/09/25 04:34:42 [error] 569#569: *2919 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 62.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-62_80/", host: "62.example.com" +2025/09/25 04:34:44 [error] 577#577: *2963 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 63.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-63_80/", host: "63.example.com" +2025/09/25 04:34:44 [error] 578#578: *2976 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 63.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-63_80/", host: "63.example.com" +2025/09/25 04:34:44 [error] 577#577: *2989 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 63.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-63_80/", host: "63.example.com" +2025/09/25 04:34:44 [error] 577#577: *2999 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 63.example.com, request: "GET / HTTP/2.0", upstream: "http://scale_backend-63_80/", host: "63.example.com" diff --git a/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/ttr-oss.png b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/ttr-oss.png new file mode 100644 index 0000000000..6d0d3346a5 Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/ttr-oss.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/ttr-plus.png b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/ttr-plus.png new file mode 100644 index 0000000000..1c9737db9a Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_HTTPSListeners/ttr-plus.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_Listeners/cpu-oss.png b/tests/results/scale/release-2.1.2/TestScale_Listeners/cpu-oss.png new file mode 100644 index 0000000000..edcb9681dd Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_Listeners/cpu-oss.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_Listeners/cpu-plus.png b/tests/results/scale/release-2.1.2/TestScale_Listeners/cpu-plus.png new file mode 100644 index 0000000000..fa8ab25754 Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_Listeners/cpu-plus.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_Listeners/memory-oss.png b/tests/results/scale/release-2.1.2/TestScale_Listeners/memory-oss.png new file mode 100644 index 0000000000..9ec851f531 Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_Listeners/memory-oss.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_Listeners/memory-plus.png b/tests/results/scale/release-2.1.2/TestScale_Listeners/memory-plus.png new file mode 100644 index 0000000000..63883a2966 Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_Listeners/memory-plus.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_Listeners/ngf-oss.log b/tests/results/scale/release-2.1.2/TestScale_Listeners/ngf-oss.log new file mode 100644 index 0000000000..bd4c80853f --- /dev/null +++ b/tests/results/scale/release-2.1.2/TestScale_Listeners/ngf-oss.log @@ -0,0 +1,2 @@ +{"level":"debug","ts":"2025-09-25T03:26:15Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"} +{"level":"debug","ts":"2025-09-25T03:26:37Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"} diff --git a/tests/results/scale/release-2.1.2/TestScale_Listeners/ngf-plus.log b/tests/results/scale/release-2.1.2/TestScale_Listeners/ngf-plus.log new file mode 100644 index 0000000000..857eaf1616 --- /dev/null +++ b/tests/results/scale/release-2.1.2/TestScale_Listeners/ngf-plus.log @@ -0,0 +1,5 @@ +{"level":"debug","ts":"2025-09-25T04:28:05Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"} +{"level":"debug","ts":"2025-09-25T04:28:53Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"} +{"level":"debug","ts":"2025-09-25T04:28:55Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"} +{"level":"debug","ts":"2025-09-25T04:29:09Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"} +{"level":"debug","ts":"2025-09-25T04:29:19Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"} diff --git a/tests/results/scale/release-2.1.2/TestScale_Listeners/nginx-plus.log b/tests/results/scale/release-2.1.2/TestScale_Listeners/nginx-plus.log new file mode 100644 index 0000000000..d8a1ee95e5 --- /dev/null +++ b/tests/results/scale/release-2.1.2/TestScale_Listeners/nginx-plus.log @@ -0,0 +1,401 @@ +2025/09/25 04:28:44 [error] 57#57: *41 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 1.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-1_80/", host: "1.example.com" +2025/09/25 04:28:44 [error] 56#56: *42 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 1.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-1_80/", host: "1.example.com" +2025/09/25 04:28:44 [error] 60#60: *53 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 2.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-2_80/", host: "2.example.com" +2025/09/25 04:28:45 [error] 61#61: *54 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 2.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-2_80/", host: "2.example.com" +2025/09/25 04:28:45 [error] 60#60: *55 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 2.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-2_80/", host: "2.example.com" +2025/09/25 04:28:45 [error] 60#60: *56 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 2.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-2_80/", host: "2.example.com" +2025/09/25 04:28:45 [error] 60#60: *57 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 2.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-2_80/", host: "2.example.com" +2025/09/25 04:28:45 [error] 65#65: *68 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 3.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-3_80/", host: "3.example.com" +2025/09/25 04:28:45 [error] 64#64: *69 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 3.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-3_80/", host: "3.example.com" +2025/09/25 04:28:46 [error] 65#65: *70 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 3.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-3_80/", host: "3.example.com" +2025/09/25 04:28:46 [error] 65#65: *71 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 3.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-3_80/", host: "3.example.com" +2025/09/25 04:28:46 [error] 68#68: *83 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 4.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-4_80/", host: "4.example.com" +2025/09/25 04:28:46 [error] 69#69: *84 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 4.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-4_80/", host: "4.example.com" +2025/09/25 04:28:46 [error] 68#68: *85 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 4.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-4_80/", host: "4.example.com" +2025/09/25 04:28:47 [error] 72#72: *98 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 5.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-5_80/", host: "5.example.com" +2025/09/25 04:28:47 [error] 73#73: *99 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 5.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-5_80/", host: "5.example.com" +2025/09/25 04:28:47 [error] 72#72: *100 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 5.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-5_80/", host: "5.example.com" +2025/09/25 04:28:47 [error] 72#72: *101 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 5.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-5_80/", host: "5.example.com" +2025/09/25 04:28:47 [error] 72#72: *102 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 5.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-5_80/", host: "5.example.com" +2025/09/25 04:28:47 [error] 72#72: *103 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 5.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-5_80/", host: "5.example.com" +2025/09/25 04:28:48 [error] 77#77: *117 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 6.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-6_80/", host: "6.example.com" +2025/09/25 04:28:48 [error] 76#76: *118 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 6.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-6_80/", host: "6.example.com" +2025/09/25 04:28:48 [error] 77#77: *121 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 6.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-6_80/", host: "6.example.com" +2025/09/25 04:28:49 [error] 80#80: *134 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 7.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-7_80/", host: "7.example.com" +2025/09/25 04:28:49 [error] 81#81: *135 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 7.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-7_80/", host: "7.example.com" +2025/09/25 04:28:49 [error] 80#80: *136 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 7.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-7_80/", host: "7.example.com" +2025/09/25 04:28:49 [error] 80#80: *137 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 7.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-7_80/", host: "7.example.com" +2025/09/25 04:28:49 [error] 80#80: *138 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 7.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-7_80/", host: "7.example.com" +2025/09/25 04:28:49 [error] 80#80: *139 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 7.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-7_80/", host: "7.example.com" +2025/09/25 04:28:49 [error] 80#80: *143 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 7.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-7_80/", host: "7.example.com" +2025/09/25 04:28:50 [error] 85#85: *156 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 8.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-8_80/", host: "8.example.com" +2025/09/25 04:28:50 [error] 84#84: *157 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 8.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-8_80/", host: "8.example.com" +2025/09/25 04:28:50 [error] 85#85: *158 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 8.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-8_80/", host: "8.example.com" +2025/09/25 04:28:50 [error] 85#85: *162 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 8.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-8_80/", host: "8.example.com" +2025/09/25 04:28:51 [error] 88#88: *176 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 9.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-9_80/", host: "9.example.com" +2025/09/25 04:28:51 [error] 89#89: *177 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 9.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-9_80/", host: "9.example.com" +2025/09/25 04:28:51 [error] 88#88: *178 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 9.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-9_80/", host: "9.example.com" +2025/09/25 04:28:51 [error] 88#88: *185 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 9.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-9_80/", host: "9.example.com" +2025/09/25 04:28:52 [error] 92#92: *197 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 10.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-10_80/", host: "10.example.com" +2025/09/25 04:28:52 [error] 93#93: *198 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 10.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-10_80/", host: "10.example.com" +2025/09/25 04:28:52 [error] 92#92: *201 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 10.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-10_80/", host: "10.example.com" +2025/09/25 04:28:52 [error] 96#96: *218 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 11.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-11_80/", host: "11.example.com" +2025/09/25 04:28:53 [error] 97#97: *219 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 11.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-11_80/", host: "11.example.com" +2025/09/25 04:28:53 [error] 96#96: *220 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 11.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-11_80/", host: "11.example.com" +2025/09/25 04:28:53 [error] 96#96: *221 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 11.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-11_80/", host: "11.example.com" +2025/09/25 04:28:53 [error] 100#100: *246 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 12.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-12_80/", host: "12.example.com" +2025/09/25 04:28:54 [error] 101#101: *247 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 12.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-12_80/", host: "12.example.com" +2025/09/25 04:28:54 [error] 100#100: *248 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 12.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-12_80/", host: "12.example.com" +2025/09/25 04:28:54 [error] 100#100: *249 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 12.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-12_80/", host: "12.example.com" +2025/09/25 04:28:54 [error] 104#104: *266 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 13.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-13_80/", host: "13.example.com" +2025/09/25 04:28:54 [error] 105#105: *267 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 13.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-13_80/", host: "13.example.com" +2025/09/25 04:28:54 [error] 104#104: *269 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 13.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-13_80/", host: "13.example.com" +2025/09/25 04:28:55 [error] 104#104: *270 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 13.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-13_80/", host: "13.example.com" +2025/09/25 04:28:55 [error] 104#104: *271 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 13.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-13_80/", host: "13.example.com" +2025/09/25 04:28:55 [error] 108#108: *293 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 14.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-14_80/", host: "14.example.com" +2025/09/25 04:28:55 [error] 109#109: *294 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 14.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-14_80/", host: "14.example.com" +2025/09/25 04:28:56 [error] 108#108: *295 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 14.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-14_80/", host: "14.example.com" +2025/09/25 04:28:56 [error] 108#108: *296 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 14.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-14_80/", host: "14.example.com" +2025/09/25 04:28:56 [error] 108#108: *297 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 14.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-14_80/", host: "14.example.com" +2025/09/25 04:28:56 [error] 108#108: *298 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 14.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-14_80/", host: "14.example.com" +2025/09/25 04:28:56 [error] 108#108: *302 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 14.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-14_80/", host: "14.example.com" +2025/09/25 04:28:57 [error] 112#112: *322 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 15.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-15_80/", host: "15.example.com" +2025/09/25 04:28:57 [error] 113#113: *323 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 15.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-15_80/", host: "15.example.com" +2025/09/25 04:28:57 [error] 112#112: *324 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 15.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-15_80/", host: "15.example.com" +2025/09/25 04:28:57 [error] 112#112: *325 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 15.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-15_80/", host: "15.example.com" +2025/09/25 04:28:57 [error] 112#112: *330 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 15.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-15_80/", host: "15.example.com" +2025/09/25 04:28:58 [error] 117#117: *350 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 16.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-16_80/", host: "16.example.com" +2025/09/25 04:28:58 [error] 116#116: *351 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 16.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-16_80/", host: "16.example.com" +2025/09/25 04:28:58 [error] 117#117: *352 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 16.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-16_80/", host: "16.example.com" +2025/09/25 04:28:58 [error] 117#117: *353 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 16.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-16_80/", host: "16.example.com" +2025/09/25 04:28:58 [error] 117#117: *354 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 16.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-16_80/", host: "16.example.com" +2025/09/25 04:28:58 [error] 117#117: *355 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 16.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-16_80/", host: "16.example.com" +2025/09/25 04:28:58 [error] 117#117: *361 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 16.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-16_80/", host: "16.example.com" +2025/09/25 04:28:59 [error] 120#120: *381 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 17.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-17_80/", host: "17.example.com" +2025/09/25 04:28:59 [error] 121#121: *382 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 17.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-17_80/", host: "17.example.com" +2025/09/25 04:28:59 [error] 120#120: *383 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 17.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-17_80/", host: "17.example.com" +2025/09/25 04:28:59 [error] 120#120: *384 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 17.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-17_80/", host: "17.example.com" +2025/09/25 04:28:59 [error] 120#120: *385 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 17.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-17_80/", host: "17.example.com" +2025/09/25 04:29:00 [error] 120#120: *386 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 17.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-17_80/", host: "17.example.com" +2025/09/25 04:29:00 [error] 120#120: *392 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 17.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-17_80/", host: "17.example.com" +2025/09/25 04:29:00 [error] 124#124: *413 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 18.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-18_80/", host: "18.example.com" +2025/09/25 04:29:00 [error] 125#125: *414 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 18.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-18_80/", host: "18.example.com" +2025/09/25 04:29:01 [error] 124#124: *415 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 18.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-18_80/", host: "18.example.com" +2025/09/25 04:29:01 [error] 124#124: *416 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 18.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-18_80/", host: "18.example.com" +2025/09/25 04:29:01 [error] 124#124: *417 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 18.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-18_80/", host: "18.example.com" +2025/09/25 04:29:01 [error] 124#124: *424 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 18.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-18_80/", host: "18.example.com" +2025/09/25 04:29:02 [error] 128#128: *445 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 19.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-19_80/", host: "19.example.com" +2025/09/25 04:29:02 [error] 129#129: *446 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 19.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-19_80/", host: "19.example.com" +2025/09/25 04:29:02 [error] 128#128: *447 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 19.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-19_80/", host: "19.example.com" +2025/09/25 04:29:02 [error] 128#128: *454 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 19.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-19_80/", host: "19.example.com" +2025/09/25 04:29:03 [error] 132#132: *476 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 20.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-20_80/", host: "20.example.com" +2025/09/25 04:29:03 [error] 133#133: *477 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 20.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-20_80/", host: "20.example.com" +2025/09/25 04:29:03 [error] 132#132: *478 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 20.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-20_80/", host: "20.example.com" +2025/09/25 04:29:03 [error] 132#132: *479 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 20.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-20_80/", host: "20.example.com" +2025/09/25 04:29:03 [error] 132#132: *480 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 20.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-20_80/", host: "20.example.com" +2025/09/25 04:29:03 [error] 132#132: *481 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 20.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-20_80/", host: "20.example.com" +2025/09/25 04:29:03 [error] 132#132: *492 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 20.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-20_80/", host: "20.example.com" +2025/09/25 04:29:04 [error] 136#136: *511 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 21.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-21_80/", host: "21.example.com" +2025/09/25 04:29:04 [error] 137#137: *512 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 21.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-21_80/", host: "21.example.com" +2025/09/25 04:29:04 [error] 136#136: *513 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 21.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-21_80/", host: "21.example.com" +2025/09/25 04:29:04 [error] 136#136: *514 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 21.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-21_80/", host: "21.example.com" +2025/09/25 04:29:04 [error] 136#136: *516 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 21.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-21_80/", host: "21.example.com" +2025/09/25 04:29:05 [error] 136#136: *517 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 21.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-21_80/", host: "21.example.com" +2025/09/25 04:29:05 [error] 136#136: *523 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 21.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-21_80/", host: "21.example.com" +2025/09/25 04:29:05 [error] 136#136: *533 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 21.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-21_80/", host: "21.example.com" +2025/09/25 04:29:05 [error] 140#140: *549 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 22.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-22_80/", host: "22.example.com" +2025/09/25 04:29:05 [error] 141#141: *550 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 22.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-22_80/", host: "22.example.com" +2025/09/25 04:29:06 [error] 140#140: *555 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 22.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-22_80/", host: "22.example.com" +2025/09/25 04:29:06 [error] 140#140: *566 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 22.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-22_80/", host: "22.example.com" +2025/09/25 04:29:06 [error] 144#144: *583 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 23.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-23_80/", host: "23.example.com" +2025/09/25 04:29:06 [error] 145#145: *584 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 23.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-23_80/", host: "23.example.com" +2025/09/25 04:29:07 [error] 144#144: *585 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 23.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-23_80/", host: "23.example.com" +2025/09/25 04:29:07 [error] 144#144: *592 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 23.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-23_80/", host: "23.example.com" +2025/09/25 04:29:07 [error] 144#144: *602 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 23.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-23_80/", host: "23.example.com" +2025/09/25 04:29:08 [error] 149#149: *620 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 24.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-24_80/", host: "24.example.com" +2025/09/25 04:29:08 [error] 150#150: *621 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 24.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-24_80/", host: "24.example.com" +2025/09/25 04:29:08 [error] 149#149: *622 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 24.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-24_80/", host: "24.example.com" +2025/09/25 04:29:08 [error] 149#149: *623 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 24.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-24_80/", host: "24.example.com" +2025/09/25 04:29:08 [error] 149#149: *624 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 24.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-24_80/", host: "24.example.com" +2025/09/25 04:29:08 [error] 149#149: *634 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 24.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-24_80/", host: "24.example.com" +2025/09/25 04:29:09 [error] 154#154: *658 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 25.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-25_80/", host: "25.example.com" +2025/09/25 04:29:09 [error] 153#153: *659 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 25.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-25_80/", host: "25.example.com" +2025/09/25 04:29:09 [error] 154#154: *660 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 25.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-25_80/", host: "25.example.com" +2025/09/25 04:29:09 [error] 154#154: *661 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 25.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-25_80/", host: "25.example.com" +2025/09/25 04:29:09 [error] 154#154: *670 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 25.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-25_80/", host: "25.example.com" +2025/09/25 04:29:10 [error] 157#157: *697 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 26.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-26_80/", host: "26.example.com" +2025/09/25 04:29:10 [error] 158#158: *698 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 26.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-26_80/", host: "26.example.com" +2025/09/25 04:29:10 [error] 157#157: *699 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 26.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-26_80/", host: "26.example.com" +2025/09/25 04:29:11 [error] 157#157: *704 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 26.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-26_80/", host: "26.example.com" +2025/09/25 04:29:11 [error] 157#157: *715 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 26.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-26_80/", host: "26.example.com" +2025/09/25 04:29:11 [error] 161#161: *736 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 27.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-27_80/", host: "27.example.com" +2025/09/25 04:29:11 [error] 162#162: *737 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 27.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-27_80/", host: "27.example.com" +2025/09/25 04:29:11 [error] 161#161: *742 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 27.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-27_80/", host: "27.example.com" +2025/09/25 04:29:12 [error] 161#161: *753 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 27.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-27_80/", host: "27.example.com" +2025/09/25 04:29:12 [error] 166#166: *776 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 28.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-28_80/", host: "28.example.com" +2025/09/25 04:29:12 [error] 167#167: *777 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 28.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-28_80/", host: "28.example.com" +2025/09/25 04:29:13 [error] 166#166: *778 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 28.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-28_80/", host: "28.example.com" +2025/09/25 04:29:13 [error] 166#166: *783 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 28.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-28_80/", host: "28.example.com" +2025/09/25 04:29:13 [error] 166#166: *795 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 28.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-28_80/", host: "28.example.com" +2025/09/25 04:29:14 [error] 170#170: *817 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 29.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-29_80/", host: "29.example.com" +2025/09/25 04:29:14 [error] 171#171: *818 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 29.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-29_80/", host: "29.example.com" +2025/09/25 04:29:14 [error] 170#170: *819 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 29.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-29_80/", host: "29.example.com" +2025/09/25 04:29:14 [error] 170#170: *820 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 29.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-29_80/", host: "29.example.com" +2025/09/25 04:29:14 [error] 170#170: *821 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 29.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-29_80/", host: "29.example.com" +2025/09/25 04:29:14 [error] 170#170: *823 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 29.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-29_80/", host: "29.example.com" +2025/09/25 04:29:14 [error] 170#170: *833 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 29.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-29_80/", host: "29.example.com" +2025/09/25 04:29:14 [error] 170#170: *845 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 29.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-29_80/", host: "29.example.com" +2025/09/25 04:29:15 [error] 174#174: *863 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 30.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-30_80/", host: "30.example.com" +2025/09/25 04:29:16 [error] 175#175: *864 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 30.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-30_80/", host: "30.example.com" +2025/09/25 04:29:16 [error] 174#174: *866 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 30.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-30_80/", host: "30.example.com" +2025/09/25 04:29:16 [error] 174#174: *874 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 30.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-30_80/", host: "30.example.com" +2025/09/25 04:29:16 [error] 174#174: *885 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 30.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-30_80/", host: "30.example.com" +2025/09/25 04:29:17 [error] 178#178: *906 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 31.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-31_80/", host: "31.example.com" +2025/09/25 04:29:17 [error] 179#179: *907 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 31.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-31_80/", host: "31.example.com" +2025/09/25 04:29:17 [error] 178#178: *908 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 31.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-31_80/", host: "31.example.com" +2025/09/25 04:29:17 [error] 178#178: *911 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 31.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-31_80/", host: "31.example.com" +2025/09/25 04:29:17 [error] 178#178: *921 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 31.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-31_80/", host: "31.example.com" +2025/09/25 04:29:17 [error] 178#178: *932 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 31.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-31_80/", host: "31.example.com" +2025/09/25 04:29:18 [error] 182#182: *967 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 32.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-32_80/", host: "32.example.com" +2025/09/25 04:29:18 [error] 183#183: *978 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 32.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-32_80/", host: "32.example.com" +2025/09/25 04:29:19 [error] 186#186: *1011 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 33.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-33_80/", host: "33.example.com" +2025/09/25 04:29:20 [error] 190#190: *1035 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 34.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-34_80/", host: "34.example.com" +2025/09/25 04:29:20 [error] 191#191: *1036 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 34.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-34_80/", host: "34.example.com" +2025/09/25 04:29:20 [error] 190#190: *1037 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 34.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-34_80/", host: "34.example.com" +2025/09/25 04:29:20 [error] 190#190: *1046 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 34.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-34_80/", host: "34.example.com" +2025/09/25 04:29:20 [error] 190#190: *1058 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 34.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-34_80/", host: "34.example.com" +2025/09/25 04:29:21 [error] 194#194: *1082 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 35.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-35_80/", host: "35.example.com" +2025/09/25 04:29:21 [error] 195#195: *1099 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 35.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-35_80/", host: "35.example.com" +2025/09/25 04:29:21 [error] 194#194: *1100 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 35.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-35_80/", host: "35.example.com" +2025/09/25 04:29:21 [error] 194#194: *1101 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 35.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-35_80/", host: "35.example.com" +2025/09/25 04:29:21 [error] 194#194: *1102 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 35.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-35_80/", host: "35.example.com" +2025/09/25 04:29:21 [error] 194#194: *1107 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 35.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-35_80/", host: "35.example.com" +2025/09/25 04:29:22 [error] 194#194: *1118 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 35.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-35_80/", host: "35.example.com" +2025/09/25 04:29:22 [error] 194#194: *1129 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 35.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-35_80/", host: "35.example.com" +2025/09/25 04:29:23 [error] 200#200: *1150 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 36.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-36_80/", host: "36.example.com" +2025/09/25 04:29:23 [error] 201#201: *1151 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 36.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-36_80/", host: "36.example.com" +2025/09/25 04:29:23 [error] 200#200: *1160 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 36.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-36_80/", host: "36.example.com" +2025/09/25 04:29:23 [error] 200#200: *1171 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 36.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-36_80/", host: "36.example.com" +2025/09/25 04:29:23 [error] 200#200: *1182 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 36.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-36_80/", host: "36.example.com" +2025/09/25 04:29:24 [error] 204#204: *1199 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 37.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-37_80/", host: "37.example.com" +2025/09/25 04:29:24 [error] 205#205: *1200 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 37.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-37_80/", host: "37.example.com" +2025/09/25 04:29:24 [error] 204#204: *1201 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 37.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-37_80/", host: "37.example.com" +2025/09/25 04:29:24 [error] 204#204: *1206 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 37.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-37_80/", host: "37.example.com" +2025/09/25 04:29:24 [error] 204#204: *1217 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 37.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-37_80/", host: "37.example.com" +2025/09/25 04:29:24 [error] 204#204: *1230 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 37.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-37_80/", host: "37.example.com" +2025/09/25 04:29:26 [error] 208#208: *1251 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 38.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-38_80/", host: "38.example.com" +2025/09/25 04:29:26 [error] 209#209: *1252 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 38.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-38_80/", host: "38.example.com" +2025/09/25 04:29:26 [error] 208#208: *1253 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 38.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-38_80/", host: "38.example.com" +2025/09/25 04:29:26 [error] 208#208: *1254 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 38.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-38_80/", host: "38.example.com" +2025/09/25 04:29:26 [error] 208#208: *1259 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 38.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-38_80/", host: "38.example.com" +2025/09/25 04:29:26 [error] 208#208: *1269 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 38.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-38_80/", host: "38.example.com" +2025/09/25 04:29:26 [error] 208#208: *1280 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 38.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-38_80/", host: "38.example.com" +2025/09/25 04:29:27 [error] 213#213: *1305 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 39.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-39_80/", host: "39.example.com" +2025/09/25 04:29:27 [error] 214#214: *1306 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 39.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-39_80/", host: "39.example.com" +2025/09/25 04:29:27 [error] 213#213: *1307 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 39.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-39_80/", host: "39.example.com" +2025/09/25 04:29:28 [error] 213#213: *1314 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 39.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-39_80/", host: "39.example.com" +2025/09/25 04:29:28 [error] 213#213: *1325 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 39.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-39_80/", host: "39.example.com" +2025/09/25 04:29:28 [error] 213#213: *1337 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 39.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-39_80/", host: "39.example.com" +2025/09/25 04:29:29 [error] 217#217: *1359 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 40.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-40_80/", host: "40.example.com" +2025/09/25 04:29:29 [error] 218#218: *1360 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 40.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-40_80/", host: "40.example.com" +2025/09/25 04:29:29 [error] 217#217: *1361 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 40.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-40_80/", host: "40.example.com" +2025/09/25 04:29:29 [error] 217#217: *1362 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 40.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-40_80/", host: "40.example.com" +2025/09/25 04:29:29 [error] 217#217: *1366 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 40.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-40_80/", host: "40.example.com" +2025/09/25 04:29:29 [error] 217#217: *1378 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 40.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-40_80/", host: "40.example.com" +2025/09/25 04:29:29 [error] 217#217: *1390 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 40.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-40_80/", host: "40.example.com" +2025/09/25 04:29:30 [error] 221#221: *1414 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 41.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-41_80/", host: "41.example.com" +2025/09/25 04:29:31 [error] 222#222: *1415 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 41.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-41_80/", host: "41.example.com" +2025/09/25 04:29:31 [error] 221#221: *1419 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 41.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-41_80/", host: "41.example.com" +2025/09/25 04:29:31 [error] 221#221: *1431 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 41.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-41_80/", host: "41.example.com" +2025/09/25 04:29:31 [error] 221#221: *1441 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 41.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-41_80/", host: "41.example.com" +2025/09/25 04:29:31 [error] 221#221: *1452 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 41.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-41_80/", host: "41.example.com" +2025/09/25 04:29:32 [error] 225#225: *1469 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 42.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-42_80/", host: "42.example.com" +2025/09/25 04:29:32 [error] 226#226: *1470 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 42.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-42_80/", host: "42.example.com" +2025/09/25 04:29:32 [error] 225#225: *1471 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 42.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-42_80/", host: "42.example.com" +2025/09/25 04:29:32 [error] 225#225: *1472 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 42.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-42_80/", host: "42.example.com" +2025/09/25 04:29:32 [error] 225#225: *1477 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 42.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-42_80/", host: "42.example.com" +2025/09/25 04:29:33 [error] 225#225: *1488 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 42.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-42_80/", host: "42.example.com" +2025/09/25 04:29:33 [error] 225#225: *1500 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 42.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-42_80/", host: "42.example.com" +2025/09/25 04:29:33 [error] 225#225: *1511 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 42.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-42_80/", host: "42.example.com" +2025/09/25 04:29:34 [error] 229#229: *1528 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 43.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-43_80/", host: "43.example.com" +2025/09/25 04:29:34 [error] 230#230: *1529 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 43.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-43_80/", host: "43.example.com" +2025/09/25 04:29:34 [error] 229#229: *1530 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 43.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-43_80/", host: "43.example.com" +2025/09/25 04:29:34 [error] 229#229: *1531 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 43.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-43_80/", host: "43.example.com" +2025/09/25 04:29:34 [error] 229#229: *1539 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 43.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-43_80/", host: "43.example.com" +2025/09/25 04:29:34 [error] 229#229: *1551 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 43.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-43_80/", host: "43.example.com" +2025/09/25 04:29:34 [error] 229#229: *1563 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 43.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-43_80/", host: "43.example.com" +2025/09/25 04:29:36 [error] 234#234: *1588 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 44.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-44_80/", host: "44.example.com" +2025/09/25 04:29:36 [error] 233#233: *1589 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 44.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-44_80/", host: "44.example.com" +2025/09/25 04:29:36 [error] 234#234: *1590 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 44.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-44_80/", host: "44.example.com" +2025/09/25 04:29:36 [error] 234#234: *1591 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 44.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-44_80/", host: "44.example.com" +2025/09/25 04:29:36 [error] 234#234: *1592 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 44.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-44_80/", host: "44.example.com" +2025/09/25 04:29:36 [error] 234#234: *1600 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 44.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-44_80/", host: "44.example.com" +2025/09/25 04:29:36 [error] 234#234: *1612 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 44.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-44_80/", host: "44.example.com" +2025/09/25 04:29:36 [error] 234#234: *1623 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 44.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-44_80/", host: "44.example.com" +2025/09/25 04:29:36 [error] 234#234: *1635 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 44.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-44_80/", host: "44.example.com" +2025/09/25 04:29:38 [error] 238#238: *1650 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 45.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-45_80/", host: "45.example.com" +2025/09/25 04:29:38 [error] 239#239: *1651 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 45.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-45_80/", host: "45.example.com" +2025/09/25 04:29:38 [error] 238#238: *1652 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 45.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-45_80/", host: "45.example.com" +2025/09/25 04:29:38 [error] 238#238: *1653 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 45.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-45_80/", host: "45.example.com" +2025/09/25 04:29:38 [error] 238#238: *1654 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 45.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-45_80/", host: "45.example.com" +2025/09/25 04:29:38 [error] 238#238: *1658 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 45.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-45_80/", host: "45.example.com" +2025/09/25 04:29:38 [error] 238#238: *1670 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 45.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-45_80/", host: "45.example.com" +2025/09/25 04:29:38 [error] 238#238: *1682 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 45.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-45_80/", host: "45.example.com" +2025/09/25 04:29:38 [error] 238#238: *1693 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 45.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-45_80/", host: "45.example.com" +2025/09/25 04:29:40 [error] 242#242: *1713 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 46.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-46_80/", host: "46.example.com" +2025/09/25 04:29:40 [error] 243#243: *1714 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 46.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-46_80/", host: "46.example.com" +2025/09/25 04:29:40 [error] 242#242: *1715 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 46.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-46_80/", host: "46.example.com" +2025/09/25 04:29:40 [error] 242#242: *1716 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 46.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-46_80/", host: "46.example.com" +2025/09/25 04:29:40 [error] 242#242: *1717 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 46.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-46_80/", host: "46.example.com" +2025/09/25 04:29:40 [error] 242#242: *1728 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 46.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-46_80/", host: "46.example.com" +2025/09/25 04:29:41 [error] 242#242: *1738 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 46.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-46_80/", host: "46.example.com" +2025/09/25 04:29:41 [error] 242#242: *1748 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 46.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-46_80/", host: "46.example.com" +2025/09/25 04:29:41 [error] 242#242: *1760 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 46.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-46_80/", host: "46.example.com" +2025/09/25 04:29:42 [error] 246#246: *1776 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 47.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-47_80/", host: "47.example.com" +2025/09/25 04:29:42 [error] 247#247: *1777 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 47.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-47_80/", host: "47.example.com" +2025/09/25 04:29:42 [error] 246#246: *1778 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 47.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-47_80/", host: "47.example.com" +2025/09/25 04:29:42 [error] 246#246: *1786 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 47.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-47_80/", host: "47.example.com" +2025/09/25 04:29:42 [error] 246#246: *1797 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 47.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-47_80/", host: "47.example.com" +2025/09/25 04:29:42 [error] 246#246: *1809 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 47.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-47_80/", host: "47.example.com" +2025/09/25 04:29:42 [error] 246#246: *1821 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 47.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-47_80/", host: "47.example.com" +2025/09/25 04:29:44 [error] 250#250: *1838 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 48.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-48_80/", host: "48.example.com" +2025/09/25 04:29:44 [error] 251#251: *1839 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 48.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-48_80/", host: "48.example.com" +2025/09/25 04:29:44 [error] 250#250: *1840 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 48.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-48_80/", host: "48.example.com" +2025/09/25 04:29:44 [error] 250#250: *1849 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 48.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-48_80/", host: "48.example.com" +2025/09/25 04:29:44 [error] 250#250: *1861 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 48.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-48_80/", host: "48.example.com" +2025/09/25 04:29:44 [error] 250#250: *1874 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 48.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-48_80/", host: "48.example.com" +2025/09/25 04:29:44 [error] 250#250: *1886 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 48.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-48_80/", host: "48.example.com" +2025/09/25 04:29:46 [error] 254#254: *1902 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 49.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-49_80/", host: "49.example.com" +2025/09/25 04:29:46 [error] 255#255: *1903 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 49.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-49_80/", host: "49.example.com" +2025/09/25 04:29:46 [error] 254#254: *1904 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 49.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-49_80/", host: "49.example.com" +2025/09/25 04:29:46 [error] 254#254: *1905 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 49.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-49_80/", host: "49.example.com" +2025/09/25 04:29:46 [error] 254#254: *1906 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 49.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-49_80/", host: "49.example.com" +2025/09/25 04:29:46 [error] 254#254: *1915 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 49.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-49_80/", host: "49.example.com" +2025/09/25 04:29:46 [error] 254#254: *1927 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 49.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-49_80/", host: "49.example.com" +2025/09/25 04:29:46 [error] 254#254: *1938 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 49.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-49_80/", host: "49.example.com" +2025/09/25 04:29:46 [error] 254#254: *1950 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 49.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-49_80/", host: "49.example.com" +2025/09/25 04:29:48 [error] 259#259: *1969 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 50.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-50_80/", host: "50.example.com" +2025/09/25 04:29:48 [error] 260#260: *1970 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 50.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-50_80/", host: "50.example.com" +2025/09/25 04:29:48 [error] 259#259: *1971 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 50.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-50_80/", host: "50.example.com" +2025/09/25 04:29:48 [error] 259#259: *1972 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 50.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-50_80/", host: "50.example.com" +2025/09/25 04:29:49 [error] 259#259: *1973 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 50.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-50_80/", host: "50.example.com" +2025/09/25 04:29:49 [error] 259#259: *1979 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 50.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-50_80/", host: "50.example.com" +2025/09/25 04:29:49 [error] 259#259: *1991 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 50.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-50_80/", host: "50.example.com" +2025/09/25 04:29:49 [error] 259#259: *2003 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 50.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-50_80/", host: "50.example.com" +2025/09/25 04:29:49 [error] 259#259: *2014 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 50.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-50_80/", host: "50.example.com" +2025/09/25 04:29:50 [error] 263#263: *2036 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 51.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-51_80/", host: "51.example.com" +2025/09/25 04:29:51 [error] 264#264: *2037 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 51.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-51_80/", host: "51.example.com" +2025/09/25 04:29:51 [error] 263#263: *2038 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 51.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-51_80/", host: "51.example.com" +2025/09/25 04:29:51 [error] 263#263: *2039 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 51.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-51_80/", host: "51.example.com" +2025/09/25 04:29:51 [error] 263#263: *2042 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 51.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-51_80/", host: "51.example.com" +2025/09/25 04:29:51 [error] 263#263: *2052 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 51.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-51_80/", host: "51.example.com" +2025/09/25 04:29:51 [error] 263#263: *2062 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 51.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-51_80/", host: "51.example.com" +2025/09/25 04:29:51 [error] 263#263: *2074 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 51.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-51_80/", host: "51.example.com" +2025/09/25 04:29:51 [error] 263#263: *2086 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 51.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-51_80/", host: "51.example.com" +2025/09/25 04:29:53 [error] 268#268: *2105 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 52.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-52_80/", host: "52.example.com" +2025/09/25 04:29:53 [error] 269#269: *2106 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 52.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-52_80/", host: "52.example.com" +2025/09/25 04:29:53 [error] 268#268: *2116 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 52.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-52_80/", host: "52.example.com" +2025/09/25 04:29:53 [error] 268#268: *2128 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 52.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-52_80/", host: "52.example.com" +2025/09/25 04:29:53 [error] 268#268: *2139 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 52.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-52_80/", host: "52.example.com" +2025/09/25 04:29:53 [error] 268#268: *2151 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 52.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-52_80/", host: "52.example.com" +2025/09/25 04:29:55 [error] 272#272: *2174 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 53.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-53_80/", host: "53.example.com" +2025/09/25 04:29:55 [error] 273#273: *2175 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 53.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-53_80/", host: "53.example.com" +2025/09/25 04:29:55 [error] 272#272: *2176 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 53.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-53_80/", host: "53.example.com" +2025/09/25 04:29:55 [error] 272#272: *2177 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 53.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-53_80/", host: "53.example.com" +2025/09/25 04:29:55 [error] 272#272: *2181 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 53.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-53_80/", host: "53.example.com" +2025/09/25 04:29:55 [error] 272#272: *2192 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 53.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-53_80/", host: "53.example.com" +2025/09/25 04:29:56 [error] 272#272: *2203 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 53.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-53_80/", host: "53.example.com" +2025/09/25 04:29:56 [error] 272#272: *2214 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 53.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-53_80/", host: "53.example.com" +2025/09/25 04:29:56 [error] 272#272: *2225 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 53.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-53_80/", host: "53.example.com" +2025/09/25 04:29:57 [error] 277#277: *2245 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 54.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-54_80/", host: "54.example.com" +2025/09/25 04:29:57 [error] 278#278: *2246 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 54.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-54_80/", host: "54.example.com" +2025/09/25 04:29:58 [error] 277#277: *2247 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 54.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-54_80/", host: "54.example.com" +2025/09/25 04:29:58 [error] 277#277: *2248 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 54.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-54_80/", host: "54.example.com" +2025/09/25 04:29:58 [error] 277#277: *2249 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 54.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-54_80/", host: "54.example.com" +2025/09/25 04:29:58 [error] 277#277: *2257 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 54.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-54_80/", host: "54.example.com" +2025/09/25 04:29:58 [error] 277#277: *2269 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 54.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-54_80/", host: "54.example.com" +2025/09/25 04:29:58 [error] 277#277: *2280 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 54.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-54_80/", host: "54.example.com" +2025/09/25 04:29:58 [error] 277#277: *2292 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 54.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-54_80/", host: "54.example.com" +2025/09/25 04:29:58 [error] 277#277: *2304 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 54.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-54_80/", host: "54.example.com" +2025/09/25 04:30:00 [error] 281#281: *2317 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 55.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-55_80/", host: "55.example.com" +2025/09/25 04:30:00 [error] 282#282: *2318 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 55.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-55_80/", host: "55.example.com" +2025/09/25 04:30:00 [error] 281#281: *2319 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 55.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-55_80/", host: "55.example.com" +2025/09/25 04:30:00 [error] 281#281: *2320 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 55.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-55_80/", host: "55.example.com" +2025/09/25 04:30:00 [error] 281#281: *2321 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 55.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-55_80/", host: "55.example.com" +2025/09/25 04:30:00 [error] 281#281: *2322 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 55.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-55_80/", host: "55.example.com" +2025/09/25 04:30:00 [error] 281#281: *2327 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 55.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-55_80/", host: "55.example.com" +2025/09/25 04:30:00 [error] 281#281: *2338 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 55.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-55_80/", host: "55.example.com" +2025/09/25 04:30:01 [error] 281#281: *2349 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 55.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-55_80/", host: "55.example.com" +2025/09/25 04:30:01 [error] 281#281: *2359 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 55.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-55_80/", host: "55.example.com" +2025/09/25 04:30:01 [error] 281#281: *2370 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 55.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-55_80/", host: "55.example.com" +2025/09/25 04:30:02 [error] 286#286: *2392 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 56.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-56_80/", host: "56.example.com" +2025/09/25 04:30:02 [error] 287#287: *2393 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 56.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-56_80/", host: "56.example.com" +2025/09/25 04:30:02 [error] 286#286: *2394 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 56.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-56_80/", host: "56.example.com" +2025/09/25 04:30:03 [error] 286#286: *2395 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 56.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-56_80/", host: "56.example.com" +2025/09/25 04:30:03 [error] 286#286: *2397 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 56.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-56_80/", host: "56.example.com" +2025/09/25 04:30:03 [error] 286#286: *2407 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 56.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-56_80/", host: "56.example.com" +2025/09/25 04:30:03 [error] 286#286: *2418 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 56.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-56_80/", host: "56.example.com" +2025/09/25 04:30:03 [error] 286#286: *2430 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 56.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-56_80/", host: "56.example.com" +2025/09/25 04:30:03 [error] 286#286: *2441 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 56.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-56_80/", host: "56.example.com" +2025/09/25 04:30:03 [error] 286#286: *2453 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 56.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-56_80/", host: "56.example.com" +2025/09/25 04:30:05 [error] 290#290: *2467 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 57.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-57_80/", host: "57.example.com" +2025/09/25 04:30:05 [error] 291#291: *2468 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 57.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-57_80/", host: "57.example.com" +2025/09/25 04:30:05 [error] 290#290: *2470 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 57.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-57_80/", host: "57.example.com" +2025/09/25 04:30:05 [error] 290#290: *2480 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 57.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-57_80/", host: "57.example.com" +2025/09/25 04:30:05 [error] 290#290: *2492 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 57.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-57_80/", host: "57.example.com" +2025/09/25 04:30:05 [error] 290#290: *2504 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 57.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-57_80/", host: "57.example.com" +2025/09/25 04:30:05 [error] 290#290: *2515 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 57.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-57_80/", host: "57.example.com" +2025/09/25 04:30:05 [error] 290#290: *2526 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 57.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-57_80/", host: "57.example.com" +2025/09/25 04:30:07 [error] 296#296: *2542 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 58.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-58_80/", host: "58.example.com" +2025/09/25 04:30:07 [error] 295#295: *2544 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 58.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-58_80/", host: "58.example.com" +2025/09/25 04:30:07 [error] 296#296: *2554 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 58.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-58_80/", host: "58.example.com" +2025/09/25 04:30:07 [error] 296#296: *2565 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 58.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-58_80/", host: "58.example.com" +2025/09/25 04:30:08 [error] 296#296: *2576 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 58.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-58_80/", host: "58.example.com" +2025/09/25 04:30:08 [error] 296#296: *2588 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 58.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-58_80/", host: "58.example.com" +2025/09/25 04:30:08 [error] 296#296: *2598 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 58.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-58_80/", host: "58.example.com" +2025/09/25 04:30:09 [error] 299#299: *2615 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 59.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-59_80/", host: "59.example.com" +2025/09/25 04:30:10 [error] 300#300: *2616 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 59.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-59_80/", host: "59.example.com" +2025/09/25 04:30:10 [error] 299#299: *2617 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 59.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-59_80/", host: "59.example.com" +2025/09/25 04:30:10 [error] 299#299: *2618 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 59.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-59_80/", host: "59.example.com" +2025/09/25 04:30:10 [error] 299#299: *2619 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 59.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-59_80/", host: "59.example.com" +2025/09/25 04:30:10 [error] 299#299: *2622 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 59.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-59_80/", host: "59.example.com" +2025/09/25 04:30:10 [error] 299#299: *2632 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 59.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-59_80/", host: "59.example.com" +2025/09/25 04:30:10 [error] 299#299: *2644 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 59.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-59_80/", host: "59.example.com" +2025/09/25 04:30:10 [error] 299#299: *2655 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 59.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-59_80/", host: "59.example.com" +2025/09/25 04:30:10 [error] 299#299: *2666 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 59.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-59_80/", host: "59.example.com" +2025/09/25 04:30:10 [error] 299#299: *2678 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 59.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-59_80/", host: "59.example.com" +2025/09/25 04:30:12 [error] 303#303: *2694 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 60.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-60_80/", host: "60.example.com" +2025/09/25 04:30:12 [error] 304#304: *2695 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 60.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-60_80/", host: "60.example.com" +2025/09/25 04:30:12 [error] 303#303: *2696 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 60.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-60_80/", host: "60.example.com" +2025/09/25 04:30:12 [error] 303#303: *2697 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 60.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-60_80/", host: "60.example.com" +2025/09/25 04:30:13 [error] 303#303: *2705 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 60.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-60_80/", host: "60.example.com" +2025/09/25 04:30:13 [error] 303#303: *2716 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 60.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-60_80/", host: "60.example.com" +2025/09/25 04:30:13 [error] 303#303: *2727 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 60.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-60_80/", host: "60.example.com" +2025/09/25 04:30:13 [error] 303#303: *2738 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 60.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-60_80/", host: "60.example.com" +2025/09/25 04:30:13 [error] 303#303: *2750 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 60.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-60_80/", host: "60.example.com" +2025/09/25 04:30:13 [error] 303#303: *2760 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 60.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-60_80/", host: "60.example.com" +2025/09/25 04:30:15 [error] 307#307: *2773 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 61.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-61_80/", host: "61.example.com" +2025/09/25 04:30:15 [error] 308#308: *2775 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 61.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-61_80/", host: "61.example.com" +2025/09/25 04:30:15 [error] 307#307: *2786 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 61.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-61_80/", host: "61.example.com" +2025/09/25 04:30:15 [error] 307#307: *2797 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 61.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-61_80/", host: "61.example.com" +2025/09/25 04:30:15 [error] 307#307: *2809 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 61.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-61_80/", host: "61.example.com" +2025/09/25 04:30:15 [error] 307#307: *2820 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 61.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-61_80/", host: "61.example.com" +2025/09/25 04:30:15 [error] 307#307: *2832 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 61.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-61_80/", host: "61.example.com" +2025/09/25 04:30:17 [error] 311#311: *2849 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 62.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-62_80/", host: "62.example.com" +2025/09/25 04:30:17 [error] 312#312: *2850 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 62.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-62_80/", host: "62.example.com" +2025/09/25 04:30:17 [error] 311#311: *2851 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 62.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-62_80/", host: "62.example.com" +2025/09/25 04:30:17 [error] 311#311: *2852 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 62.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-62_80/", host: "62.example.com" +2025/09/25 04:30:17 [error] 311#311: *2857 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 62.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-62_80/", host: "62.example.com" +2025/09/25 04:30:18 [error] 311#311: *2868 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 62.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-62_80/", host: "62.example.com" +2025/09/25 04:30:18 [error] 311#311: *2879 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 62.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-62_80/", host: "62.example.com" +2025/09/25 04:30:18 [error] 311#311: *2891 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 62.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-62_80/", host: "62.example.com" +2025/09/25 04:30:18 [error] 311#311: *2901 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 62.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-62_80/", host: "62.example.com" +2025/09/25 04:30:18 [error] 311#311: *2912 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 62.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-62_80/", host: "62.example.com" +2025/09/25 04:30:20 [error] 315#315: *2929 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 63.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-63_80/", host: "63.example.com" +2025/09/25 04:30:20 [error] 316#316: *2930 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 63.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-63_80/", host: "63.example.com" +2025/09/25 04:30:20 [error] 315#315: *2940 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 63.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-63_80/", host: "63.example.com" +2025/09/25 04:30:20 [error] 315#315: *2951 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 63.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-63_80/", host: "63.example.com" +2025/09/25 04:30:20 [error] 315#315: *2963 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 63.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-63_80/", host: "63.example.com" +2025/09/25 04:30:20 [error] 315#315: *2975 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 63.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-63_80/", host: "63.example.com" +2025/09/25 04:30:20 [error] 315#315: *2985 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 63.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-63_80/", host: "63.example.com" +2025/09/25 04:30:20 [error] 315#315: *2996 no live upstreams while connecting to upstream, client: 34.174.37.91, server: 63.example.com, request: "GET / HTTP/1.1", upstream: "http://scale_backend-63_80/", host: "63.example.com" diff --git a/tests/results/scale/release-2.1.2/TestScale_Listeners/ttr-oss.png b/tests/results/scale/release-2.1.2/TestScale_Listeners/ttr-oss.png new file mode 100644 index 0000000000..62676d3cdb Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_Listeners/ttr-oss.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_Listeners/ttr-plus.png b/tests/results/scale/release-2.1.2/TestScale_Listeners/ttr-plus.png new file mode 100644 index 0000000000..7433d343f3 Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_Listeners/ttr-plus.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/cpu-oss.png b/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/cpu-oss.png new file mode 100644 index 0000000000..db141348b8 Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/cpu-oss.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/cpu-plus.png b/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/cpu-plus.png new file mode 100644 index 0000000000..e4ee4b3fb5 Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/cpu-plus.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/memory-oss.png b/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/memory-oss.png new file mode 100644 index 0000000000..89c22ffe73 Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/memory-oss.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/memory-plus.png b/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/memory-plus.png new file mode 100644 index 0000000000..c470237a66 Binary files /dev/null and b/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/memory-plus.png differ diff --git a/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/ngf-oss.log b/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/ngf-oss.log new file mode 100644 index 0000000000..b1f7fc7701 --- /dev/null +++ b/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/ngf-oss.log @@ -0,0 +1 @@ +{"level":"debug","ts":"2025-09-25T03:46:45Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"} diff --git a/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/ngf-plus.log b/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/ngf-plus.log new file mode 100644 index 0000000000..36155aaafc --- /dev/null +++ b/tests/results/scale/release-2.1.2/TestScale_UpstreamServers/ngf-plus.log @@ -0,0 +1,3 @@ +{"level":"debug","ts":"2025-09-25T04:50:47Z","logger":"eventLoop.eventHandler","msg":"failed to resolve endpoints, endpoints may not be ready","batchID":13,"error":"no endpoints found for Service scale/backend","service":{"name":"backend","namespace":"scale"}} +{"level":"debug","ts":"2025-09-25T04:50:48Z","logger":"eventLoop.eventHandler","msg":"failed to resolve endpoints, endpoints may not be ready","batchID":14,"error":"no valid endpoints found for Service scale/backend and port 80","service":{"name":"backend","namespace":"scale"}} +{"level":"debug","ts":"2025-09-25T04:50:48Z","logger":"statusUpdater","msg":"Encountered error updating status","error":"Operation cannot be fulfilled on gateways.gateway.networking.k8s.io \"gateway\": the object has been modified; please apply your changes to the latest version and try again","namespace":"scale","name":"gateway","kind":"Gateway"} diff --git a/tests/results/scale/release-2.1.2/release-2.1.2-oss.md b/tests/results/scale/release-2.1.2/release-2.1.2-oss.md new file mode 100644 index 0000000000..16dcceb2bf --- /dev/null +++ b/tests/results/scale/release-2.1.2/release-2.1.2-oss.md @@ -0,0 +1,148 @@ +# Results + +## Test environment + +NGINX Plus: false + +NGINX Gateway Fabric: + +- Commit: 8241478604f782eca497329ae47507b978d117b1 +- Date: 2025-09-24T18:19:40Z +- Dirty: false + +GKE Cluster: + +- Node count: 15 +- k8s version: v1.33.4-gke.1134000 +- vCPUs per node: 2 +- RAM per node: 4015668Ki +- Max pods per node: 110 +- Zone: us-east1-b +- Instance Type: e2-medium + +## Test TestScale_Listeners + +### Event Batch Processing + +- Total: 206 +- Average Time: 21ms +- Event Batch Processing distribution: + - 500.0ms: 201 + - 1000.0ms: 206 + - 5000.0ms: 206 + - 10000.0ms: 206 + - 30000.0ms: 206 + - +Infms: 206 + +### Errors + +- NGF errors: 2 +- NGF container restarts: 0 +- NGINX errors: 0 +- NGINX container restarts: 0 + +### Graphs and Logs + +See [output directory](./TestScale_Listeners) for more details. +The logs are attached only if there are errors. + +## Test TestScale_HTTPSListeners + +### Event Batch Processing + +- Total: 270 +- Average Time: 18ms +- Event Batch Processing distribution: + - 500.0ms: 265 + - 1000.0ms: 270 + - 5000.0ms: 270 + - 10000.0ms: 270 + - 30000.0ms: 270 + - +Infms: 270 + +### Errors + +- NGF errors: 2 +- NGF container restarts: 0 +- NGINX errors: 0 +- NGINX container restarts: 0 + +### Graphs and Logs + +See [output directory](./TestScale_HTTPSListeners) for more details. +The logs are attached only if there are errors. + +## Test TestScale_HTTPRoutes + +### Event Batch Processing + +- Total: 1011 +- Average Time: 642ms +- Event Batch Processing distribution: + - 500.0ms: 275 + - 1000.0ms: 952 + - 5000.0ms: 1011 + - 10000.0ms: 1011 + - 30000.0ms: 1011 + - +Infms: 1011 + +### Errors + +- NGF errors: 0 +- NGF container restarts: 0 +- NGINX errors: 0 +- NGINX container restarts: 0 + +### Graphs and Logs + +See [output directory](./TestScale_HTTPRoutes) for more details. +The logs are attached only if there are errors. + +## Test TestScale_UpstreamServers + +### Event Batch Processing + +- Total: 56 +- Average Time: 485ms +- Event Batch Processing distribution: + - 500.0ms: 25 + - 1000.0ms: 55 + - 5000.0ms: 56 + - 10000.0ms: 56 + - 30000.0ms: 56 + - +Infms: 56 + +### Errors + +- NGF errors: 1 +- NGF container restarts: 0 +- NGINX errors: 0 +- NGINX container restarts: 0 + +### Graphs and Logs + +See [output directory](./TestScale_UpstreamServers) for more details. +The logs are attached only if there are errors. + +## Test TestScale_HTTPMatches + +```text +Requests [total, rate, throughput] 30000, 1000.01, 999.93 +Duration [total, attack, wait] 30.002s, 30s, 2.345ms +Latencies [min, mean, 50, 90, 95, 99, max] 881.212µs, 1.578ms, 1.241ms, 1.674ms, 2.31ms, 8.31ms, 77.09ms +Bytes In [total, mean] 4830000, 161.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` +```text +Requests [total, rate, throughput] 30000, 1000.03, 999.47 +Duration [total, attack, wait] 30.016s, 29.999s, 16.883ms +Latencies [min, mean, 50, 90, 95, 99, max] 1.013ms, 2.205ms, 1.589ms, 2.295ms, 4.089ms, 18.773ms, 65.367ms +Bytes In [total, mean] 4830000, 161.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` diff --git a/tests/results/scale/release-2.1.2/release-2.1.2-plus.md b/tests/results/scale/release-2.1.2/release-2.1.2-plus.md new file mode 100644 index 0000000000..4a27ca1557 --- /dev/null +++ b/tests/results/scale/release-2.1.2/release-2.1.2-plus.md @@ -0,0 +1,148 @@ +# Results + +## Test environment + +NGINX Plus: true + +NGINX Gateway Fabric: + +- Commit: 8241478604f782eca497329ae47507b978d117b1 +- Date: 2025-09-25T01:19:35Z +- Dirty: false + +GKE Cluster: + +- Node count: 15 +- k8s version: v1.33.4-gke.1134000 +- vCPUs per node: 2 +- RAM per node: 4015672Ki +- Max pods per node: 110 +- Zone: us-south1-a +- Instance Type: e2-medium + +## Test TestScale_Listeners + +### Event Batch Processing + +- Total: 325 +- Average Time: 199ms +- Event Batch Processing distribution: + - 500.0ms: 265 + - 1000.0ms: 297 + - 5000.0ms: 325 + - 10000.0ms: 325 + - 30000.0ms: 325 + - +Infms: 325 + +### Errors + +- NGF errors: 5 +- NGF container restarts: 0 +- NGINX errors: 401 +- NGINX container restarts: 0 + +### Graphs and Logs + +See [output directory](./TestScale_Listeners) for more details. +The logs are attached only if there are errors. + +## Test TestScale_HTTPSListeners + +### Event Batch Processing + +- Total: 389 +- Average Time: 141ms +- Event Batch Processing distribution: + - 500.0ms: 335 + - 1000.0ms: 389 + - 5000.0ms: 389 + - 10000.0ms: 389 + - 30000.0ms: 389 + - +Infms: 389 + +### Errors + +- NGF errors: 4 +- NGF container restarts: 0 +- NGINX errors: 174 +- NGINX container restarts: 0 + +### Graphs and Logs + +See [output directory](./TestScale_HTTPSListeners) for more details. +The logs are attached only if there are errors. + +## Test TestScale_HTTPRoutes + +### Event Batch Processing + +- Total: 1011 +- Average Time: 523ms +- Event Batch Processing distribution: + - 500.0ms: 466 + - 1000.0ms: 948 + - 5000.0ms: 1011 + - 10000.0ms: 1011 + - 30000.0ms: 1011 + - +Infms: 1011 + +### Errors + +- NGF errors: 0 +- NGF container restarts: 0 +- NGINX errors: 0 +- NGINX container restarts: 1 + +### Graphs and Logs + +See [output directory](./TestScale_HTTPRoutes) for more details. +The logs are attached only if there are errors. + +## Test TestScale_UpstreamServers + +### Event Batch Processing + +- Total: 59 +- Average Time: 463ms +- Event Batch Processing distribution: + - 500.0ms: 33 + - 1000.0ms: 56 + - 5000.0ms: 59 + - 10000.0ms: 59 + - 30000.0ms: 59 + - +Infms: 59 + +### Errors + +- NGF errors: 3 +- NGF container restarts: 0 +- NGINX errors: 0 +- NGINX container restarts: 0 + +### Graphs and Logs + +See [output directory](./TestScale_UpstreamServers) for more details. +The logs are attached only if there are errors. + +## Test TestScale_HTTPMatches + +```text +Requests [total, rate, throughput] 30000, 1000.03, 1000.00 +Duration [total, attack, wait] 30s, 29.999s, 1.078ms +Latencies [min, mean, 50, 90, 95, 99, max] 790.398µs, 1.136ms, 1.038ms, 1.248ms, 1.446ms, 3.534ms, 19.472ms +Bytes In [total, mean] 4800000, 160.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` +```text +Requests [total, rate, throughput] 30000, 1000.04, 1000.00 +Duration [total, attack, wait] 30s, 29.999s, 1.107ms +Latencies [min, mean, 50, 90, 95, 99, max] 908.588µs, 1.735ms, 1.237ms, 1.606ms, 2.518ms, 13.79ms, 132.196ms +Bytes In [total, mean] 4800000, 160.00 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` diff --git a/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-affinity-http-oss.png b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-affinity-http-oss.png new file mode 100644 index 0000000000..c308a72beb Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-affinity-http-oss.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-affinity-http-plus.png b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-affinity-http-plus.png new file mode 100644 index 0000000000..012b254881 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-affinity-http-plus.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-affinity-https-oss.png b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-affinity-https-oss.png new file mode 100644 index 0000000000..c308a72beb Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-affinity-https-oss.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-affinity-https-plus.png b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-affinity-https-plus.png new file mode 100644 index 0000000000..012b254881 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-affinity-https-plus.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-http-oss.png b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-http-oss.png new file mode 100644 index 0000000000..593a4e3a14 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-http-oss.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-http-plus.png b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-http-plus.png new file mode 100644 index 0000000000..cd4aa2c1c2 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-http-plus.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-https-oss.png b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-https-oss.png new file mode 100644 index 0000000000..593a4e3a14 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-https-oss.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-https-plus.png b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-https-plus.png new file mode 100644 index 0000000000..cd4aa2c1c2 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-down-https-plus.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-affinity-http-oss.png b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-affinity-http-oss.png new file mode 100644 index 0000000000..0c71d19e59 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-affinity-http-oss.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-affinity-http-plus.png b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-affinity-http-plus.png new file mode 100644 index 0000000000..c673934961 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-affinity-http-plus.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-affinity-https-oss.png b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-affinity-https-oss.png new file mode 100644 index 0000000000..0c71d19e59 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-affinity-https-oss.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-affinity-https-plus.png b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-affinity-https-plus.png new file mode 100644 index 0000000000..c673934961 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-affinity-https-plus.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-http-oss.png b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-http-oss.png new file mode 100644 index 0000000000..e4420715e2 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-http-oss.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-http-plus.png b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-http-plus.png new file mode 100644 index 0000000000..b305baf667 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-http-plus.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-https-oss.png b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-https-oss.png new file mode 100644 index 0000000000..e4420715e2 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-https-oss.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-https-plus.png b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-https-plus.png new file mode 100644 index 0000000000..b305baf667 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/abrupt-scale-up-https-plus.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-affinity-http-oss.png b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-affinity-http-oss.png new file mode 100644 index 0000000000..38c890a1ff Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-affinity-http-oss.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-affinity-http-plus.png b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-affinity-http-plus.png new file mode 100644 index 0000000000..75a1c5cd78 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-affinity-http-plus.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-affinity-https-oss.png b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-affinity-https-oss.png new file mode 100644 index 0000000000..38c890a1ff Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-affinity-https-oss.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-affinity-https-plus.png b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-affinity-https-plus.png new file mode 100644 index 0000000000..75a1c5cd78 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-affinity-https-plus.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-http-oss.png b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-http-oss.png new file mode 100644 index 0000000000..8b85c88ac0 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-http-oss.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-http-plus.png b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-http-plus.png new file mode 100644 index 0000000000..54765c3808 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-http-plus.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-https-oss.png b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-https-oss.png new file mode 100644 index 0000000000..8b85c88ac0 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-https-oss.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-https-plus.png b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-https-plus.png new file mode 100644 index 0000000000..54765c3808 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-down-https-plus.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-affinity-http-oss.png b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-affinity-http-oss.png new file mode 100644 index 0000000000..61f116ace7 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-affinity-http-oss.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-affinity-http-plus.png b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-affinity-http-plus.png new file mode 100644 index 0000000000..df358aeee4 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-affinity-http-plus.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-affinity-https-oss.png b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-affinity-https-oss.png new file mode 100644 index 0000000000..61f116ace7 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-affinity-https-oss.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-affinity-https-plus.png b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-affinity-https-plus.png new file mode 100644 index 0000000000..df358aeee4 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-affinity-https-plus.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-http-oss.png b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-http-oss.png new file mode 100644 index 0000000000..6fbf4a6775 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-http-oss.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-http-plus.png b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-http-plus.png new file mode 100644 index 0000000000..a78a6d8e57 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-http-plus.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-https-oss.png b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-https-oss.png new file mode 100644 index 0000000000..6fbf4a6775 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-https-oss.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-https-plus.png b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-https-plus.png new file mode 100644 index 0000000000..a78a6d8e57 Binary files /dev/null and b/tests/results/zero-downtime-scale/release-2.1.2/gradual-scale-up-https-plus.png differ diff --git a/tests/results/zero-downtime-scale/release-2.1.2/release-2.1.2-oss.md b/tests/results/zero-downtime-scale/release-2.1.2/release-2.1.2-oss.md new file mode 100644 index 0000000000..07c7be04cc --- /dev/null +++ b/tests/results/zero-downtime-scale/release-2.1.2/release-2.1.2-oss.md @@ -0,0 +1,281 @@ +# Results + +## Test environment + +NGINX Plus: false + +NGINX Gateway Fabric: + +- Commit: 8241478604f782eca497329ae47507b978d117b1 +- Date: 2025-09-24T18:19:40Z +- Dirty: false + +GKE Cluster: + +- Node count: 15 +- k8s version: v1.33.4-gke.1134000 +- vCPUs per node: 2 +- RAM per node: 4015668Ki +- Max pods per node: 110 +- Zone: us-east1-b +- Instance Type: e2-medium + +## One NGINX Pod runs per node Test Results + +### Scale Up Gradually + +#### Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 30000, 100.00, 100.00 +Duration [total, attack, wait] 5m0s, 5m0s, 2.432ms +Latencies [min, mean, 50, 90, 95, 99, max] 1.024ms, 2.146ms, 1.996ms, 2.344ms, 2.599ms, 4.647ms, 1.026s +Bytes In [total, mean] 4655918, 155.20 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +![gradual-scale-up-affinity-https-oss.png](gradual-scale-up-affinity-https-oss.png) + +#### Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 30000, 100.00, 100.00 +Duration [total, attack, wait] 5m0s, 5m0s, 1.827ms +Latencies [min, mean, 50, 90, 95, 99, max] 957.55µs, 2.005ms, 1.923ms, 2.27ms, 2.508ms, 4.039ms, 41.988ms +Bytes In [total, mean] 4839173, 161.31 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +![gradual-scale-up-affinity-http-oss.png](gradual-scale-up-affinity-http-oss.png) + +### Scale Down Gradually + +#### Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 48000, 100.00, 100.00 +Duration [total, attack, wait] 8m0s, 8m0s, 1.626ms +Latencies [min, mean, 50, 90, 95, 99, max] 964.779µs, 2.007ms, 1.879ms, 2.253ms, 2.495ms, 4.251ms, 1.056s +Bytes In [total, mean] 7742250, 161.30 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:48000 +Error Set: +``` + +![gradual-scale-down-affinity-http-oss.png](gradual-scale-down-affinity-http-oss.png) + +#### Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 48000, 100.00, 100.00 +Duration [total, attack, wait] 8m0s, 8m0s, 1.727ms +Latencies [min, mean, 50, 90, 95, 99, max] 1.007ms, 2.072ms, 1.964ms, 2.327ms, 2.57ms, 4.296ms, 53.284ms +Bytes In [total, mean] 7449456, 155.20 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:48000 +Error Set: +``` + +![gradual-scale-down-affinity-https-oss.png](gradual-scale-down-affinity-https-oss.png) + +### Scale Up Abruptly + +#### Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 12000, 100.01, 100.01 +Duration [total, attack, wait] 2m0s, 2m0s, 1.686ms +Latencies [min, mean, 50, 90, 95, 99, max] 987.822µs, 2.021ms, 1.908ms, 2.225ms, 2.408ms, 4.053ms, 56.349ms +Bytes In [total, mean] 1862480, 155.21 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:12000 +Error Set: +``` + +![abrupt-scale-up-affinity-https-oss.png](abrupt-scale-up-affinity-https-oss.png) + +#### Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 12000, 100.01, 100.01 +Duration [total, attack, wait] 2m0s, 2m0s, 2.051ms +Latencies [min, mean, 50, 90, 95, 99, max] 970.719µs, 1.967ms, 1.86ms, 2.187ms, 2.371ms, 4.066ms, 58.449ms +Bytes In [total, mean] 1935652, 161.30 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:12000 +Error Set: +``` + +![abrupt-scale-up-affinity-http-oss.png](abrupt-scale-up-affinity-http-oss.png) + +### Scale Down Abruptly + +#### Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 12000, 100.01, 100.01 +Duration [total, attack, wait] 2m0s, 2m0s, 1.967ms +Latencies [min, mean, 50, 90, 95, 99, max] 931.537µs, 1.92ms, 1.855ms, 2.173ms, 2.318ms, 3.6ms, 40.02ms +Bytes In [total, mean] 1935630, 161.30 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:12000 +Error Set: +``` + +![abrupt-scale-down-affinity-http-oss.png](abrupt-scale-down-affinity-http-oss.png) + +#### Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 12000, 100.01, 100.01 +Duration [total, attack, wait] 2m0s, 2m0s, 1.875ms +Latencies [min, mean, 50, 90, 95, 99, max] 920.083µs, 1.975ms, 1.895ms, 2.218ms, 2.4ms, 4.104ms, 55.925ms +Bytes In [total, mean] 1862361, 155.20 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:12000 +Error Set: +``` + +![abrupt-scale-down-affinity-https-oss.png](abrupt-scale-down-affinity-https-oss.png) + +## Multiple NGINX Pods run per node Test Results + +### Scale Up Gradually + +#### Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 30000, 100.00, 100.00 +Duration [total, attack, wait] 5m0s, 5m0s, 1.655ms +Latencies [min, mean, 50, 90, 95, 99, max] 1.051ms, 2.055ms, 1.952ms, 2.312ms, 2.602ms, 4.581ms, 45.781ms +Bytes In [total, mean] 4659013, 155.30 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +![gradual-scale-up-https-oss.png](gradual-scale-up-https-oss.png) + +#### Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 30000, 100.00, 100.00 +Duration [total, attack, wait] 5m0s, 5m0s, 1.586ms +Latencies [min, mean, 50, 90, 95, 99, max] 909.69µs, 1.913ms, 1.835ms, 2.174ms, 2.426ms, 4.029ms, 46.219ms +Bytes In [total, mean] 4835977, 161.20 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +![gradual-scale-up-http-oss.png](gradual-scale-up-http-oss.png) + +### Scale Down Gradually + +#### Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 96000, 100.00, 100.00 +Duration [total, attack, wait] 16m0s, 16m0s, 1.245ms +Latencies [min, mean, 50, 90, 95, 99, max] 859.648µs, 1.953ms, 1.854ms, 2.218ms, 2.45ms, 4.152ms, 46.252ms +Bytes In [total, mean] 15475301, 161.20 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:96000 +Error Set: +``` + +![gradual-scale-down-http-oss.png](gradual-scale-down-http-oss.png) + +#### Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 96000, 100.00, 100.00 +Duration [total, attack, wait] 16m0s, 16m0s, 2.122ms +Latencies [min, mean, 50, 90, 95, 99, max] 1.009ms, 2.081ms, 1.961ms, 2.34ms, 2.607ms, 4.62ms, 206.706ms +Bytes In [total, mean] 14908701, 155.30 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:96000 +Error Set: +``` + +![gradual-scale-down-https-oss.png](gradual-scale-down-https-oss.png) + +### Scale Up Abruptly + +#### Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 12000, 100.01, 100.01 +Duration [total, attack, wait] 2m0s, 2m0s, 1.839ms +Latencies [min, mean, 50, 90, 95, 99, max] 1.051ms, 1.979ms, 1.916ms, 2.218ms, 2.417ms, 3.922ms, 45.363ms +Bytes In [total, mean] 1863713, 155.31 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:12000 +Error Set: +``` + +![abrupt-scale-up-https-oss.png](abrupt-scale-up-https-oss.png) + +#### Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 12000, 100.01, 100.01 +Duration [total, attack, wait] 2m0s, 2m0s, 1.069ms +Latencies [min, mean, 50, 90, 95, 99, max] 909.917µs, 1.943ms, 1.862ms, 2.199ms, 2.395ms, 3.911ms, 48.928ms +Bytes In [total, mean] 1934377, 161.20 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:12000 +Error Set: +``` + +![abrupt-scale-up-http-oss.png](abrupt-scale-up-http-oss.png) + +### Scale Down Abruptly + +#### Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 12000, 100.01, 100.01 +Duration [total, attack, wait] 2m0s, 2m0s, 1.745ms +Latencies [min, mean, 50, 90, 95, 99, max] 1.051ms, 2.098ms, 1.96ms, 2.32ms, 2.532ms, 4.892ms, 95.572ms +Bytes In [total, mean] 1863569, 155.30 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:12000 +Error Set: +``` + +![abrupt-scale-down-https-oss.png](abrupt-scale-down-https-oss.png) + +#### Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 12000, 100.01, 100.01 +Duration [total, attack, wait] 2m0s, 2m0s, 1.726ms +Latencies [min, mean, 50, 90, 95, 99, max] 1.021ms, 2.026ms, 1.895ms, 2.278ms, 2.514ms, 4.462ms, 95.275ms +Bytes In [total, mean] 1934466, 161.21 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:12000 +Error Set: +``` + +![abrupt-scale-down-http-oss.png](abrupt-scale-down-http-oss.png) diff --git a/tests/results/zero-downtime-scale/release-2.1.2/release-2.1.2-plus.md b/tests/results/zero-downtime-scale/release-2.1.2/release-2.1.2-plus.md new file mode 100644 index 0000000000..b41aab9189 --- /dev/null +++ b/tests/results/zero-downtime-scale/release-2.1.2/release-2.1.2-plus.md @@ -0,0 +1,281 @@ +# Results + +## Test environment + +NGINX Plus: true + +NGINX Gateway Fabric: + +- Commit: 8241478604f782eca497329ae47507b978d117b1 +- Date: 2025-09-25T01:19:35Z +- Dirty: false + +GKE Cluster: + +- Node count: 15 +- k8s version: v1.33.4-gke.1134000 +- vCPUs per node: 2 +- RAM per node: 4015672Ki +- Max pods per node: 110 +- Zone: us-south1-a +- Instance Type: e2-medium + +## One NGINX Pod runs per node Test Results + +### Scale Up Gradually + +#### Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 30000, 100.00, 100.00 +Duration [total, attack, wait] 5m0s, 5m0s, 1.536ms +Latencies [min, mean, 50, 90, 95, 99, max] 808.062µs, 1.414ms, 1.353ms, 1.638ms, 1.758ms, 2.595ms, 29.438ms +Bytes In [total, mean] 4653003, 155.10 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +![gradual-scale-up-affinity-https-plus.png](gradual-scale-up-affinity-https-plus.png) + +#### Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 30000, 100.00, 100.00 +Duration [total, attack, wait] 5m0s, 5m0s, 1.401ms +Latencies [min, mean, 50, 90, 95, 99, max] 686.137µs, 1.296ms, 1.264ms, 1.536ms, 1.635ms, 2.197ms, 16.222ms +Bytes In [total, mean] 4836170, 161.21 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +![gradual-scale-up-affinity-http-plus.png](gradual-scale-up-affinity-http-plus.png) + +### Scale Down Gradually + +#### Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 48000, 100.00, 100.00 +Duration [total, attack, wait] 8m0s, 8m0s, 1.391ms +Latencies [min, mean, 50, 90, 95, 99, max] 861.676µs, 1.364ms, 1.298ms, 1.567ms, 1.697ms, 2.48ms, 36.922ms +Bytes In [total, mean] 7444867, 155.10 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:48000 +Error Set: +``` + +![gradual-scale-down-affinity-https-plus.png](gradual-scale-down-affinity-https-plus.png) + +#### Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 48000, 100.00, 100.00 +Duration [total, attack, wait] 8m0s, 8m0s, 1.143ms +Latencies [min, mean, 50, 90, 95, 99, max] 733.65µs, 1.273ms, 1.221ms, 1.497ms, 1.601ms, 2.282ms, 36.436ms +Bytes In [total, mean] 7737614, 161.20 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:48000 +Error Set: +``` + +![gradual-scale-down-affinity-http-plus.png](gradual-scale-down-affinity-http-plus.png) + +### Scale Up Abruptly + +#### Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 12000, 100.01, 100.01 +Duration [total, attack, wait] 2m0s, 2m0s, 1.379ms +Latencies [min, mean, 50, 90, 95, 99, max] 832.098µs, 1.377ms, 1.318ms, 1.55ms, 1.659ms, 2.454ms, 68.23ms +Bytes In [total, mean] 1861078, 155.09 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:12000 +Error Set: +``` + +![abrupt-scale-up-affinity-https-plus.png](abrupt-scale-up-affinity-https-plus.png) + +#### Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 12000, 100.01, 100.01 +Duration [total, attack, wait] 2m0s, 2m0s, 1.475ms +Latencies [min, mean, 50, 90, 95, 99, max] 737.493µs, 1.236ms, 1.191ms, 1.428ms, 1.524ms, 2.084ms, 74.984ms +Bytes In [total, mean] 1934451, 161.20 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:12000 +Error Set: +``` + +![abrupt-scale-up-affinity-http-plus.png](abrupt-scale-up-affinity-http-plus.png) + +### Scale Down Abruptly + +#### Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 12000, 100.01, 100.01 +Duration [total, attack, wait] 2m0s, 2m0s, 1.21ms +Latencies [min, mean, 50, 90, 95, 99, max] 922.161µs, 1.321ms, 1.265ms, 1.502ms, 1.616ms, 2.37ms, 19.797ms +Bytes In [total, mean] 1861377, 155.11 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:12000 +Error Set: +``` + +![abrupt-scale-down-affinity-https-plus.png](abrupt-scale-down-affinity-https-plus.png) + +#### Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 12000, 100.01, 100.01 +Duration [total, attack, wait] 2m0s, 2m0s, 1.195ms +Latencies [min, mean, 50, 90, 95, 99, max] 730.317µs, 1.209ms, 1.162ms, 1.396ms, 1.503ms, 2.324ms, 30.978ms +Bytes In [total, mean] 1934393, 161.20 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:12000 +Error Set: +``` + +![abrupt-scale-down-affinity-http-plus.png](abrupt-scale-down-affinity-http-plus.png) + +## Multiple NGINX Pods run per node Test Results + +### Scale Up Gradually + +#### Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 30000, 100.00, 100.00 +Duration [total, attack, wait] 5m0s, 5m0s, 1.308ms +Latencies [min, mean, 50, 90, 95, 99, max] 792.33µs, 1.285ms, 1.241ms, 1.477ms, 1.583ms, 2.394ms, 31.062ms +Bytes In [total, mean] 4844936, 161.50 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +![gradual-scale-up-http-plus.png](gradual-scale-up-http-plus.png) + +#### Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 30000, 100.00, 100.00 +Duration [total, attack, wait] 5m0s, 5m0s, 1.653ms +Latencies [min, mean, 50, 90, 95, 99, max] 774.219µs, 1.398ms, 1.328ms, 1.641ms, 1.758ms, 2.728ms, 28.094ms +Bytes In [total, mean] 4655833, 155.19 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:30000 +Error Set: +``` + +![gradual-scale-up-https-plus.png](gradual-scale-up-https-plus.png) + +### Scale Down Gradually + +#### Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 96000, 100.00, 100.00 +Duration [total, attack, wait] 16m0s, 16m0s, 1.39ms +Latencies [min, mean, 50, 90, 95, 99, max] 724.976µs, 1.316ms, 1.268ms, 1.53ms, 1.636ms, 2.309ms, 90.802ms +Bytes In [total, mean] 15503925, 161.50 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:96000 +Error Set: +``` + +![gradual-scale-down-http-plus.png](gradual-scale-down-http-plus.png) + +#### Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 96000, 100.00, 100.00 +Duration [total, attack, wait] 16m0s, 16m0s, 1.399ms +Latencies [min, mean, 50, 90, 95, 99, max] 792.185µs, 1.39ms, 1.338ms, 1.599ms, 1.708ms, 2.374ms, 106.327ms +Bytes In [total, mean] 14899086, 155.20 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:96000 +Error Set: +``` + +![gradual-scale-down-https-plus.png](gradual-scale-down-https-plus.png) + +### Scale Up Abruptly + +#### Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 12000, 100.01, 100.01 +Duration [total, attack, wait] 2m0s, 2m0s, 1.293ms +Latencies [min, mean, 50, 90, 95, 99, max] 767.325µs, 1.317ms, 1.249ms, 1.479ms, 1.582ms, 2.38ms, 122.474ms +Bytes In [total, mean] 1938000, 161.50 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:12000 +Error Set: +``` + +![abrupt-scale-up-http-plus.png](abrupt-scale-up-http-plus.png) + +#### Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 12000, 100.01, 100.01 +Duration [total, attack, wait] 2m0s, 2m0s, 1.48ms +Latencies [min, mean, 50, 90, 95, 99, max] 821.479µs, 1.401ms, 1.323ms, 1.576ms, 1.686ms, 2.52ms, 122.667ms +Bytes In [total, mean] 1862357, 155.20 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:12000 +Error Set: +``` + +![abrupt-scale-up-https-plus.png](abrupt-scale-up-https-plus.png) + +### Scale Down Abruptly + +#### Test: Send http /coffee traffic + +```text +Requests [total, rate, throughput] 12000, 100.01, 100.01 +Duration [total, attack, wait] 2m0s, 2m0s, 1.274ms +Latencies [min, mean, 50, 90, 95, 99, max] 755.024µs, 1.279ms, 1.235ms, 1.453ms, 1.538ms, 2.317ms, 28.779ms +Bytes In [total, mean] 1938033, 161.50 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:12000 +Error Set: +``` + +![abrupt-scale-down-http-plus.png](abrupt-scale-down-http-plus.png) + +#### Test: Send https /tea traffic + +```text +Requests [total, rate, throughput] 12000, 100.01, 100.01 +Duration [total, attack, wait] 2m0s, 2m0s, 1.266ms +Latencies [min, mean, 50, 90, 95, 99, max] 857.219µs, 1.369ms, 1.311ms, 1.532ms, 1.65ms, 2.562ms, 37.336ms +Bytes In [total, mean] 1862363, 155.20 +Bytes Out [total, mean] 0, 0.00 +Success [ratio] 100.00% +Status Codes [code:count] 200:12000 +Error Set: +``` + +![abrupt-scale-down-https-plus.png](abrupt-scale-down-https-plus.png)