Skip to content

NFR Test Results for NGF version edge #4467

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
sjberman merged 2 commits into from
Dec 15, 2025
Merged

NFR Test Results for NGF version edge #4467

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
3fc2961
NFR Test Results for NGF version edge
nginx-bot Dec 15, 2025
080f225
Merge branch 'main' into tests/nfr-tests-edge
sjberman Dec 15, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
42 changes: 21 additions & 21 deletions tests/results/dp-perf/edge/edge-oss.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,14 +6,14 @@ NGINX Plus: false

NGINX Gateway Fabric:

- Commit: 76a2cea7c19f4aeb19d6610048db93fe3545dedc
- Date: 2025-12-03T19:53:07Z
- Commit: 89aee48bf6e660a828ffd32ca35fc7f52e358e00
- Date: 2025-12-12T20:04:38Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.33.5-gke.1201000
- k8s version: v1.33.5-gke.1308000
- vCPUs per node: 16
- RAM per node: 65851520Ki
- Max pods per node: 110
Expand All @@ -23,10 +23,10 @@ GKE Cluster:
## Test1: Running latte path based routing

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 838.332µs
Latencies [min, mean, 50, 90, 95, 99, max] 692.485µs, 865.674µs, 849.247µs, 942.06µs, 980.287µs, 1.102ms, 12.585ms
Bytes In [total, mean] 4800000, 160.00
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 849.26µs
Latencies [min, mean, 50, 90, 95, 99, max] 707.535µs, 974.383µs, 944.757µs, 1.088ms, 1.146ms, 1.328ms, 32.605ms
Bytes In [total, mean] 4740000, 158.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -37,9 +37,9 @@ Error Set:

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 930.164µs
Latencies [min, mean, 50, 90, 95, 99, max] 715.081µs, 933.802µs, 901.019µs, 1.005ms, 1.048ms, 1.246ms, 24.929ms
Bytes In [total, mean] 4830000, 161.00
Duration [total, attack, wait] 30s, 29.999s, 895.473µs
Latencies [min, mean, 50, 90, 95, 99, max] 742.098µs, 1.008ms, 974.685µs, 1.123ms, 1.183ms, 1.363ms, 29.682ms
Bytes In [total, mean] 4770000, 159.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -49,10 +49,10 @@ Error Set:
## Test3: Running coffee query based routing

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 973.811µs
Latencies [min, mean, 50, 90, 95, 99, max] 714.576µs, 928.334µs, 900.33µs, 1.003ms, 1.045ms, 1.265ms, 23.419ms
Bytes In [total, mean] 5070000, 169.00
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 904.485µs
Latencies [min, mean, 50, 90, 95, 99, max] 748.977µs, 1.001ms, 967.994µs, 1.109ms, 1.17ms, 1.355ms, 27.87ms
Bytes In [total, mean] 5010000, 167.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -62,10 +62,10 @@ Error Set:
## Test4: Running tea GET method based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 868.411µs
Latencies [min, mean, 50, 90, 95, 99, max] 724.995µs, 935.31µs, 907.468µs, 1.019ms, 1.064ms, 1.254ms, 24.206ms
Bytes In [total, mean] 4740000, 158.00
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 904.828µs
Latencies [min, mean, 50, 90, 95, 99, max] 719.444µs, 962.781µs, 937.317µs, 1.073ms, 1.129ms, 1.287ms, 21.054ms
Bytes In [total, mean] 4680000, 156.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -76,9 +76,9 @@ Error Set:

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 796.165µs
Latencies [min, mean, 50, 90, 95, 99, max] 709.716µs, 908.982µs, 888.17µs, 990.493µs, 1.033ms, 1.183ms, 25.115ms
Bytes In [total, mean] 4740000, 158.00
Duration [total, attack, wait] 30s, 29.999s, 964.802µs
Latencies [min, mean, 50, 90, 95, 99, max] 722.108µs, 975.241µs, 948.454µs, 1.083ms, 1.138ms, 1.309ms, 23.547ms
Bytes In [total, mean] 4680000, 156.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand Down
48 changes: 24 additions & 24 deletions tests/results/dp-perf/edge/edge-plus.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,27 +6,27 @@ NGINX Plus: true

NGINX Gateway Fabric:

- Commit: 76a2cea7c19f4aeb19d6610048db93fe3545dedc
- Date: 2025-12-03T19:53:07Z
- Commit: 89aee48bf6e660a828ffd32ca35fc7f52e358e00
- Date: 2025-12-12T20:04:38Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.33.5-gke.1201000
- k8s version: v1.33.5-gke.1308000
- vCPUs per node: 16
- RAM per node: 65851512Ki
- RAM per node: 65851520Ki
- Max pods per node: 110
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Test1: Running latte path based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 959.135µs
Latencies [min, mean, 50, 90, 95, 99, max] 663.558µs, 875.826µs, 845.323µs, 958.333µs, 1.007ms, 1.194ms, 23.064ms
Bytes In [total, mean] 4800000, 160.00
Requests [total, rate, throughput] 30000, 1000.03, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 845.184µs
Latencies [min, mean, 50, 90, 95, 99, max] 693.423µs, 920.807µs, 895.018µs, 1.02ms, 1.074ms, 1.244ms, 31.952ms
Bytes In [total, mean] 4860000, 162.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -36,23 +36,23 @@ Error Set:
## Test2: Running coffee header based routing

```text
Requests [total, rate, throughput] 29999, 1000.01, 999.98
Duration [total, attack, wait] 30s, 29.999s, 860.551µs
Latencies [min, mean, 50, 90, 95, 99, max] 712.205µs, 923.729µs, 901.1µs, 1.02ms, 1.069ms, 1.227ms, 21.375ms
Bytes In [total, mean] 4829839, 161.00
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 868.585µs
Latencies [min, mean, 50, 90, 95, 99, max] 734.673µs, 969.426µs, 944.002µs, 1.078ms, 1.132ms, 1.32ms, 18.236ms
Bytes In [total, mean] 4890000, 163.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:29999
Status Codes [code:count] 200:30000
Error Set:
```

## Test3: Running coffee query based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 968.736µs
Latencies [min, mean, 50, 90, 95, 99, max] 737.91µs, 952.257µs, 928.142µs, 1.05ms, 1.105ms, 1.292ms, 21.593ms
Bytes In [total, mean] 5070000, 169.00
Requests [total, rate, throughput] 30000, 1000.03, 1000.00
Duration [total, attack, wait] 30s, 29.999s, 963.831µs
Latencies [min, mean, 50, 90, 95, 99, max] 714.486µs, 967.797µs, 942.965µs, 1.085ms, 1.14ms, 1.315ms, 18.507ms
Bytes In [total, mean] 5130000, 171.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -62,10 +62,10 @@ Error Set:
## Test4: Running tea GET method based routing

```text
Requests [total, rate, throughput] 30000, 1000.01, 999.98
Duration [total, attack, wait] 30.001s, 30s, 870.48µs
Latencies [min, mean, 50, 90, 95, 99, max] 699.503µs, 896.1µs, 872.493µs, 987.672µs, 1.041ms, 1.214ms, 23.127ms
Bytes In [total, mean] 4740000, 158.00
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 890.472µs
Latencies [min, mean, 50, 90, 95, 99, max] 711.296µs, 913.484µs, 890.957µs, 1.007ms, 1.054ms, 1.249ms, 22.525ms
Bytes In [total, mean] 4800000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand All @@ -76,9 +76,9 @@ Error Set:

```text
Requests [total, rate, throughput] 30000, 1000.04, 1000.01
Duration [total, attack, wait] 30s, 29.999s, 943.532µs
Latencies [min, mean, 50, 90, 95, 99, max] 681.741µs, 906.971µs, 887.005µs, 998.855µs, 1.046ms, 1.198ms, 11.182ms
Bytes In [total, mean] 4740000, 158.00
Duration [total, attack, wait] 30s, 29.999s, 865.442µs
Latencies [min, mean, 50, 90, 95, 99, max] 708.989µs, 926.09µs, 903.755µs, 1.009ms, 1.052ms, 1.206ms, 17.261ms
Bytes In [total, mean] 4800000, 160.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:30000
Expand Down
34 changes: 17 additions & 17 deletions tests/results/ngf-upgrade/edge/edge-oss.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,14 +6,14 @@ NGINX Plus: false

NGINX Gateway Fabric:

- Commit: 76a2cea7c19f4aeb19d6610048db93fe3545dedc
- Date: 2025-12-03T19:53:07Z
- Commit: 89aee48bf6e660a828ffd32ca35fc7f52e358e00
- Date: 2025-12-12T20:04:38Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.33.5-gke.1201000
- k8s version: v1.33.5-gke.1308000
- vCPUs per node: 16
- RAM per node: 65851520Ki
- Max pods per node: 110
Expand All @@ -23,31 +23,31 @@ GKE Cluster:
## Test: Send https /tea traffic

```text
Requests [total, rate, throughput] 6000, 100.01, 99.80
Duration [total, attack, wait] 59.997s, 59.993s, 4.183ms
Latencies [min, mean, 50, 90, 95, 99, max] 519.547µs, 1.833s, 1.186ms, 8.79s, 11.649s, 13.963s, 14.52s
Bytes In [total, mean] 922152, 153.69
Requests [total, rate, throughput] 6000, 100.01, 99.74
Duration [total, attack, wait] 59.996s, 59.992s, 4.093ms
Latencies [min, mean, 50, 90, 95, 99, max] 533.611µs, 1.584s, 1.102ms, 7.659s, 10.645s, 12.968s, 13.51s
Bytes In [total, mean] 915552, 152.59
Bytes Out [total, mean] 0, 0.00
Success [ratio] 99.80%
Status Codes [code:count] 0:12 200:5988
Success [ratio] 99.73%
Status Codes [code:count] 0:16 200:5984
Error Set:
Get "https://cafe.example.com/tea": dial tcp 0.0.0.0:0->10.138.0.56:443: connect: connection refused
Get "https://cafe.example.com/tea": dial tcp 0.0.0.0:0->10.138.0.58:443: connect: connection refused
```

![https-oss.png](https-oss.png)

## Test: Send http /coffee traffic

```text
Requests [total, rate, throughput] 6000, 100.01, 99.80
Duration [total, attack, wait] 59.997s, 59.993s, 4.518ms
Latencies [min, mean, 50, 90, 95, 99, max] 437.037µs, 1.822s, 1.135ms, 8.517s, 11.638s, 13.967s, 14.524s
Bytes In [total, mean] 958080, 159.68
Requests [total, rate, throughput] 6000, 100.01, 99.74
Duration [total, attack, wait] 59.996s, 59.993s, 3.335ms
Latencies [min, mean, 50, 90, 95, 99, max] 445.697µs, 1.571s, 1.121ms, 7.597s, 10.625s, 12.95s, 13.505s
Bytes In [total, mean] 951456, 158.58
Bytes Out [total, mean] 0, 0.00
Success [ratio] 99.80%
Status Codes [code:count] 0:12 200:5988
Success [ratio] 99.73%
Status Codes [code:count] 0:16 200:5984
Error Set:
Get "http://cafe.example.com/coffee": dial tcp 0.0.0.0:0->10.138.0.56:80: connect: connection refused
Get "http://cafe.example.com/coffee": dial tcp 0.0.0.0:0->10.138.0.58:80: connect: connection refused
```

![http-oss.png](http-oss.png)
50 changes: 24 additions & 26 deletions tests/results/ngf-upgrade/edge/edge-plus.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,56 +6,54 @@ NGINX Plus: true

NGINX Gateway Fabric:

- Commit: 76a2cea7c19f4aeb19d6610048db93fe3545dedc
- Date: 2025-12-03T19:53:07Z
- Commit: 89aee48bf6e660a828ffd32ca35fc7f52e358e00
- Date: 2025-12-12T20:04:38Z
- Dirty: false

GKE Cluster:

- Node count: 12
- k8s version: v1.33.5-gke.1201000
- k8s version: v1.33.5-gke.1308000
- vCPUs per node: 16
- RAM per node: 65851512Ki
- RAM per node: 65851520Ki
- Max pods per node: 110
- Zone: us-west1-b
- Instance Type: n2d-standard-16

## Test: Send http /coffee traffic
## Test: Send https /tea traffic

```text
Requests [total, rate, throughput] 6000, 100.01, 99.78
Duration [total, attack, wait] 59.994s, 59.992s, 2.101ms
Latencies [min, mean, 50, 90, 95, 99, max] 507.107µs, 414.573ms, 1.114ms, 1.103s, 4.036s, 6.367s, 6.934s
Bytes In [total, mean] 961744, 160.29
Requests [total, rate, throughput] 6000, 100.01, 99.77
Duration [total, attack, wait] 59.998s, 59.993s, 4.464ms
Latencies [min, mean, 50, 90, 95, 99, max] 590.027µs, 1.383s, 1.185ms, 6.759s, 9.775s, 12.105s, 12.67s
Bytes In [total, mean] 935761, 155.96
Bytes Out [total, mean] 0, 0.00
Success [ratio] 99.77%
Status Codes [code:count] 0:14 200:5986
Error Set:
Get "http://cafe.example.com/coffee": read tcp 10.138.0.103:53013->10.138.0.114:80: read: connection reset by peer
Get "http://cafe.example.com/coffee": read tcp 10.138.0.103:46203->10.138.0.114:80: read: connection reset by peer
Get "http://cafe.example.com/coffee": read tcp 10.138.0.103:47717->10.138.0.114:80: read: connection reset by peer
Get "http://cafe.example.com/coffee": read tcp 10.138.0.103:53217->10.138.0.114:80: read: connection reset by peer
Get "http://cafe.example.com/coffee": dial tcp 0.0.0.0:0->10.138.0.114:80: connect: connection refused
Get "https://cafe.example.com/tea": read tcp 10.138.0.107:40661->10.138.0.64:443: read: connection reset by peer
Get "https://cafe.example.com/tea": read tcp 10.138.0.107:42645->10.138.0.64:443: read: connection reset by peer
Get "https://cafe.example.com/tea": read tcp 10.138.0.107:50887->10.138.0.64:443: read: connection reset by peer
Get "https://cafe.example.com/tea": dial tcp 0.0.0.0:0->10.138.0.64:443: connect: connection refused
```

![http-plus.png](http-plus.png)
![https-plus.png](https-plus.png)

## Test: Send https /tea traffic
## Test: Send http /coffee traffic

```text
Requests [total, rate, throughput] 6000, 100.01, 99.78
Duration [total, attack, wait] 59.994s, 59.993s, 1.947ms
Latencies [min, mean, 50, 90, 95, 99, max] 600.657µs, 421.024ms, 1.175ms, 1.162s, 4.089s, 6.405s, 6.961s
Bytes In [total, mean] 923930, 153.99
Requests [total, rate, throughput] 6000, 100.01, 99.77
Duration [total, attack, wait] 59.998s, 59.993s, 4.591ms
Latencies [min, mean, 50, 90, 95, 99, max] 586.766µs, 1.397s, 1.124ms, 6.722s, 9.832s, 12.106s, 12.667s
Bytes In [total, mean] 971808, 161.97
Bytes Out [total, mean] 0, 0.00
Success [ratio] 99.77%
Status Codes [code:count] 0:14 200:5986
Error Set:
Get "https://cafe.example.com/tea": read tcp 10.138.0.103:57081->10.138.0.114:443: read: connection reset by peer
Get "https://cafe.example.com/tea": read tcp 10.138.0.103:35237->10.138.0.114:443: read: connection reset by peer
Get "https://cafe.example.com/tea": read tcp 10.138.0.103:40395->10.138.0.114:443: read: connection reset by peer
Get "https://cafe.example.com/tea": write tcp 10.138.0.103:50087->10.138.0.114:443: write: connection reset by peer
Get "https://cafe.example.com/tea": dial tcp 0.0.0.0:0->10.138.0.114:443: connect: connection refused
Get "http://cafe.example.com/coffee": read tcp 10.138.0.107:37659->10.138.0.64:80: read: connection reset by peer
Get "http://cafe.example.com/coffee": read tcp 10.138.0.107:40625->10.138.0.64:80: read: connection reset by peer
Get "http://cafe.example.com/coffee": read tcp 10.138.0.107:51165->10.138.0.64:80: read: connection reset by peer
Get "http://cafe.example.com/coffee": dial tcp 0.0.0.0:0->10.138.0.64:80: connect: connection refused
```

![https-plus.png](https-plus.png)
![http-plus.png](http-plus.png)
Binary file modified tests/results/ngf-upgrade/edge/http-oss.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/http-plus.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/https-oss.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified tests/results/ngf-upgrade/edge/https-plus.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Loading