Skip to content

NFR Test Results for NGF version edge #3991

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Oct 1, 2025
Merged

NFR Test Results for NGF version edge #3991

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
5b1675d
NFR Test Results for NGF version edge
nginx-bot Oct 1, 2025
839bd5e
Merge branch 'main' into tests/nfr-tests-edge
bjee19 Oct 1, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
34 changes: 17 additions & 17 deletions tests/results/dp-perf/edge/edge-oss.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,26 +6,26 @@ NGINX Plus: false

NGINX Gateway Fabric:

- Commit: 635b3fcd6e643f4bd24ebbd4c901619a030c4bc0
- Date: 2025-09-15T17:56:13Z
- Commit: 9010072ecd34a8fa99bfdd3d7580c9d725fb063e
- Date: 2025-10-01T09:39:27Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.33.4-gke.1036000
- k8s version: v1.33.4-gke.1172000
- vCPUs per node: 16
- RAM per node: 65851528Ki
- RAM per node: 65851524Ki
- Max pods per node: 110
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Test1: Running latte path based routing

```text
Requests [total, rate, throughput] 30000, 1000.02, 999.99
Duration [total, attack, wait] 30s, 29.999s, 823.134µs
Latencies [min, mean, 50, 90, 95, 99, max] 701.612µs, 944.922µs, 913.567µs, 1.064ms, 1.127ms, 1.318ms, 19.252ms
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 916.575µs
Latencies [min, mean, 50, 90, 95, 99, max] 691.405µs, 906.279µs, 883.274µs, 995.919µs, 1.041ms, 1.217ms, 26.291ms
Bytes In [total, mean] 4770000, 159.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -36,9 +36,9 @@ Error Set:
## Test2: Running coffee header based routing

```text
Requests [total, rate, throughput] 30000, 1000.02, 999.98
Duration [total, attack, wait] 30s, 29.999s, 1.086ms
Latencies [min, mean, 50, 90, 95, 99, max] 709.701µs, 978.507µs, 947.668µs, 1.092ms, 1.16ms, 1.369ms, 18.067ms
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 893.576µs
Latencies [min, mean, 50, 90, 95, 99, max] 716.153µs, 951.76µs, 928.081µs, 1.044ms, 1.094ms, 1.271ms, 24.711ms
Bytes In [total, mean] 4800000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -50,8 +50,8 @@ Error Set:

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 907.607µs
Latencies [min, mean, 50, 90, 95, 99, max] 754.461µs, 1.003ms, 978.075µs, 1.155ms, 1.226ms, 1.387ms, 10.062ms
Duration [total, attack, wait] 30.001s, 30s, 923.767µs
Latencies [min, mean, 50, 90, 95, 99, max] 734.163µs, 968.693µs, 939.083µs, 1.072ms, 1.134ms, 1.299ms, 31.453ms
Bytes In [total, mean] 5040000, 168.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -63,8 +63,8 @@ Error Set:

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 832.592µs
Latencies [min, mean, 50, 90, 95, 99, max] 709.117µs, 967.336µs, 940.759µs, 1.083ms, 1.15ms, 1.346ms, 16.037ms
Duration [total, attack, wait] 30s, 29.999s, 928.615µs
Latencies [min, mean, 50, 90, 95, 99, max] 705.267µs, 953.188µs, 924.739µs, 1.053ms, 1.112ms, 1.313ms, 23.944ms
Bytes In [total, mean] 4710000, 157.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand All @@ -75,9 +75,9 @@ Error Set:
## Test5: Running tea POST method based routing

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 1.005ms
Latencies [min, mean, 50, 90, 95, 99, max] 733.008µs, 1.005ms, 975.492µs, 1.137ms, 1.201ms, 1.382ms, 21.294ms
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 903.068µs
Latencies [min, mean, 50, 90, 95, 99, max] 709.536µs, 932.359µs, 902.638µs, 1.019ms, 1.066ms, 1.234ms, 23.801ms
Bytes In [total, mean] 4710000, 157.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand Down
42 changes: 21 additions & 21 deletions tests/results/dp-perf/edge/edge-plus.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,16 +6,16 @@ NGINX Plus: true

NGINX Gateway Fabric:

- Commit: 635b3fcd6e643f4bd24ebbd4c901619a030c4bc0
- Date: 2025-09-15T17:56:13Z
- Commit: 9010072ecd34a8fa99bfdd3d7580c9d725fb063e
- Date: 2025-10-01T09:39:27Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.33.4-gke.1036000
- k8s version: v1.33.4-gke.1172000
- vCPUs per node: 16
- RAM per node: 65851528Ki
- RAM per node: 65851524Ki
- Max pods per node: 110
- Zone: us-west1-b
- Instance Type: n2d-standard-16
Expand All @@ -24,9 +24,9 @@ GKE Cluster:

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 900.89µs
Latencies [min, mean, 50, 90, 95, 99, max] 714.789µs, 966.238µs, 944.115µs, 1.062ms, 1.112ms, 1.285ms, 37.418ms
Bytes In [total, mean] 4740000, 158.00
Duration [total, attack, wait] 30s, 30s, 769.987µs
Latencies [min, mean, 50, 90, 95, 99, max] 691.14µs, 914.506µs, 888.598µs, 989.685µs, 1.034ms, 1.195ms, 18.527ms
Bytes In [total, mean] 4800000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -36,10 +36,10 @@ Error Set:
## Test2: Running coffee header based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 860.973µs
Latencies [min, mean, 50, 90, 95, 99, max] 753.171µs, 970.828µs, 948.946µs, 1.067ms, 1.118ms, 1.295ms, 20.518ms
Bytes In [total, mean] 4770000, 159.00
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 913.262µs
Latencies [min, mean, 50, 90, 95, 99, max] 711.213µs, 928.346µs, 905.02µs, 1.008ms, 1.053ms, 1.232ms, 16.99ms
Bytes In [total, mean] 4830000, 161.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -50,9 +50,9 @@ Error Set:

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 967.396µs
Latencies [min, mean, 50, 90, 95, 99, max] 770.147µs, 988.786µs, 968.93µs, 1.085ms, 1.137ms, 1.289ms, 22.817ms
Bytes In [total, mean] 5010000, 167.00
Duration [total, attack, wait] 30s, 29.999s, 873.184µs
Latencies [min, mean, 50, 90, 95, 99, max] 731.388µs, 928.643µs, 910.353µs, 1.008ms, 1.048ms, 1.23ms, 14.086ms
Bytes In [total, mean] 5070000, 169.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -62,10 +62,10 @@ Error Set:
## Test4: Running tea GET method based routing

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 1.021ms
Latencies [min, mean, 50, 90, 95, 99, max] 725.58µs, 975.886µs, 954.237µs, 1.07ms, 1.121ms, 1.291ms, 21.906ms
Bytes In [total, mean] 4680000, 156.00
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 841.047µs
Latencies [min, mean, 50, 90, 95, 99, max] 702.755µs, 905.032µs, 886.534µs, 985.325µs, 1.026ms, 1.169ms, 17.74ms
Bytes In [total, mean] 4740000, 158.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -76,9 +76,9 @@ Error Set:

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 881.157µs
Latencies [min, mean, 50, 90, 95, 99, max] 740.614µs, 958.919µs, 938.262µs, 1.054ms, 1.105ms, 1.28ms, 19.591ms
Bytes In [total, mean] 4680000, 156.00
Duration [total, attack, wait] 30s, 29.999s, 831.053µs
Latencies [min, mean, 50, 90, 95, 99, max] 713.279µs, 909.011µs, 888.977µs, 983.397µs, 1.023ms, 1.172ms, 15.22ms
Bytes In [total, mean] 4740000, 158.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand Down
20 changes: 10 additions & 10 deletions tests/results/ngf-upgrade/edge/edge-oss.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,27 +6,27 @@ NGINX Plus: false

NGINX Gateway Fabric:

- Commit: 635b3fcd6e643f4bd24ebbd4c901619a030c4bc0
- Date: 2025-09-15T17:56:13Z
- Commit: 9010072ecd34a8fa99bfdd3d7580c9d725fb063e
- Date: 2025-10-01T09:39:27Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.33.4-gke.1036000
- k8s version: v1.33.4-gke.1172000
- vCPUs per node: 16
- RAM per node: 65851528Ki
- RAM per node: 65851524Ki
- Max pods per node: 110
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Test: Send https /tea traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.02
Duration [total, attack, wait] 59.991s, 59.99s, 1.188ms
Latencies [min, mean, 50, 90, 95, 99, max] 897.354µs, 1.237ms, 1.21ms, 1.357ms, 1.41ms, 1.536ms, 14.359ms
Bytes In [total, mean] 924000, 154.00
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.992s, 59.99s, 1.359ms
Latencies [min, mean, 50, 90, 95, 99, max] 905.822µs, 1.251ms, 1.226ms, 1.407ms, 1.468ms, 1.64ms, 16.559ms
Bytes In [total, mean] 926023, 154.34
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Expand All @@ -39,8 +39,8 @@ Error Set:

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 1.398ms
Latencies [min, mean, 50, 90, 95, 99, max] 897.295µs, 1.211ms, 1.204ms, 1.356ms, 1.401ms, 1.541ms, 9.367ms
Duration [total, attack, wait] 59.991s, 59.99s, 1.078ms
Latencies [min, mean, 50, 90, 95, 99, max] 842.735µs, 1.162ms, 1.139ms, 1.31ms, 1.361ms, 1.52ms, 14.201ms
Bytes In [total, mean] 960000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Expand Down
28 changes: 14 additions & 14 deletions tests/results/ngf-upgrade/edge/edge-plus.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,46 +6,46 @@ NGINX Plus: true

NGINX Gateway Fabric:

- Commit: 635b3fcd6e643f4bd24ebbd4c901619a030c4bc0
- Date: 2025-09-15T17:56:13Z
- Commit: 9010072ecd34a8fa99bfdd3d7580c9d725fb063e
- Date: 2025-10-01T09:39:27Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.33.4-gke.1036000
- k8s version: v1.33.4-gke.1172000
- vCPUs per node: 16
- RAM per node: 65851528Ki
- RAM per node: 65851524Ki
- Max pods per node: 110
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Test: Send https /tea traffic
## Test: Send http /coffee traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 1.072ms
Latencies [min, mean, 50, 90, 95, 99, max] 893.778µs, 1.174ms, 1.148ms, 1.28ms, 1.33ms, 1.457ms, 12.871ms
Bytes In [total, mean] 912000, 152.00
Duration [total, attack, wait] 59.992s, 59.99s, 1.325ms
Latencies [min, mean, 50, 90, 95, 99, max] 900.599µs, 1.202ms, 1.188ms, 1.36ms, 1.422ms, 1.548ms, 3.993ms
Bytes In [total, mean] 966000, 161.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Error Set:
```

![https-plus.png](https-plus.png)
![http-plus.png](http-plus.png)

## Test: Send http /coffee traffic
## Test: Send https /tea traffic

```text
Requests [total, rate, throughput] 6000, 100.02, 100.01
Duration [total, attack, wait] 59.991s, 59.99s, 812.181µs
Latencies [min, mean, 50, 90, 95, 99, max] 595.829µs, 1.048ms, 1.069ms, 1.268ms, 1.322ms, 1.429ms, 15.22ms
Bytes In [total, mean] 949964, 158.33
Duration [total, attack, wait] 59.992s, 59.99s, 1.44ms
Latencies [min, mean, 50, 90, 95, 99, max] 995.471µs, 1.342ms, 1.327ms, 1.494ms, 1.552ms, 1.677ms, 10.796ms
Bytes In [total, mean] 932050, 155.34
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:6000
Error Set:
```

![http-plus.png](http-plus.png)
![https-plus.png](https-plus.png)
Binary file modified tests/results/ngf-upgrade/edge/http-oss.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/http-plus.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/https-oss.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/https-plus.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Loading