Repository navigation
Performance
Titanium targets low-overhead MITM proxying: connection pooling, HTTP/2 multiplexing, and buffer reuse. Numbers below are Release measurements with RpsLoadProbe (and BenchmarkDotNet / Basic example where noted). Publishable tables cite GitHub Actions medians on matched 4 vCPU / 16 GiB runners. Absolute RPS still varies by OS kernel, TLS, and MsQuic packaging — compare within a table, not across Windows vs Linux.
Control arms: nginx (native C reverse-proxy ceiling; Linux is authoritative) and YARP (Yarp.ReverseProxy, managed .NET reverse proxy). Neither can MITM (no CONNECT / forged certs). FiddlerCore is not compared (commercial debugger license; not a throughput peer).
For pooling knobs and certificate first-visit tuning, see Performance and pooling. For the local cool A/B lab, laptop tables, and the techniques used to find each hotspot, see Performance Profiling.
- Measurement environment
- Windows — Titanium vs nginx vs YARP
- Linux — Titanium vs nginx vs YARP
-
Heavier reverse workloads
- Windows — heavier reverse GET (64 KiB / 256 KiB)
- Linux — heavier reverse GET (64 KiB / 256 KiB)
- Windows — POST 64 KiB request + 64 KiB response
- Linux — POST 64 KiB request + 64 KiB response
- Windows — lossy / high-RTT (H2 HOL / H3 loss)
- Linux — lossy / high-RTT (H2 HOL / H3 loss)
- Architecture-sensitive
- TLS termination cost (H1 TLS → cleartext origin)
- Other measurements
- Raising limits on large hosts
Both OS use the standard public-repo GitHub-hosted runner class (4 vCPU / 16 GiB / 14 GB SSD). Same harness knobs (workflow_dispatch RPS saturation: warmup 2s / measure 8s; concurrency 8, 16, 32, 64; median of 3 repeats). Prefer TWP÷YARP / TWP÷nginx ratios over absolute RPS.
Laptop High-perf / cool-paired Windows numbers live on Performance Profiling — Local Windows lab. Do not mix those absolutes into the tables below.
| OS | Windows Server (GitHub-hosted windows-latest) |
| CPU | 4 logical processors |
| RAM | 16 GiB |
| Runtime | .NET 10.0.x |
| nginx | nginx/Windows 1.31.3 (same-OS only; no QUIC) |
| YARP | Yarp.ReverseProxy 2.3.0 |
| Harness | RpsLoadProbe Release; median of 3 repeats |
| OS | Ubuntu 24.04.x LTS |
| CPU | 4 logical processors (AMD EPYC; runners this pass were 7763 / 9V74) |
| RAM | 16 GiB |
| Runtime | .NET 10.0.11 |
| nginx | nginx/1.31.4 (nginx.org mainline, --with-http_v3_module) |
| YARP | Yarp.ReverseProxy 2.3.0 |
| Harness | RpsLoadProbe Release; median of 3 repeats where noted |
How to read the tables
- Mode: Reverse = transparent fixed-forward (may TLS-terminate to a cleartext origin, or re-encrypt to a configured HTTPS/QUIC origin). MITM = both legs are visible in the clear inside TWP — either by decrypting client TLS/QUIC (forged cert / CONNECT) or by accepting an already-cleartext client (explicit HTTP proxy / inspectable transparent reverse) while still speaking plain or TLS to the origin. nginx and YARP cannot do MITM. HTTP/3 has no cleartext client (QUIC always encrypted).
- Sustainable = last concurrency that still met error/latency SLOs. Peak = highest RPS in that ramp.
- 🟢 = highest sustainable RPS among products that have a number on that row. Omitted when only TWP can run the path (no fair multi-product comparison).
- Not possible = product cannot do that path. Not measured = path exists but no published number yet for that OS.
pwsh tools/RpsLoadProbe/run-rps.ps1 -Mode compare-same
pwsh tools/RpsLoadProbe/run-rps.ps1 -Mode compare-terminate
pwsh tools/RpsLoadProbe/run-rps.ps1 -Mode compare-bridges
pwsh tools/RpsLoadProbe/run-rps.ps1 -Mode compare-mitm
pwsh tools/RpsLoadProbe/run-rps.ps1 -Mode compare-bodies
pwsh tools/RpsLoadProbe/run-rps.ps1 -Mode compare-post
pwsh tools/RpsLoadProbe/run-rps.ps1 -Mode compare-lossy
pwsh tools/RpsLoadProbe/run-rps.ps1 -Mode compare-tls-cost
pwsh tools/RpsLoadProbe/run-rps.ps1 -Mode compare-archClient / origin: HTTP version and whether TLS is used (plain = cleartext, TLS = encrypted, QUIC = HTTP/3).
Median of 3 repeats on windows-latest (4 vCPU / 16 GiB) @ 02dcbdbf / MITM @ 1b5ca9f9. Sources: 32570355206 (compare-same), 32570356532 (compare-bridges), 32588707712 (compare-mitm). Warmup 2s / measure 8s; concurrency 8, 16, 32, 64. Laptop High-perf / cool-paired numbers stay on the local lab.
Load generators: Reverse inbound H3 arms use dotnet-httpclient (http_version=3.0, RequestVersionExact) after dual-listen reverse H3. nginx/Windows is same-OS only (no QUIC).
| Mode | Client | Origin | TWP sustain | TWP peak | nginx sustain | nginx peak | YARP sustain | YARP peak |
|---|---|---|---|---|---|---|---|---|
| Reverse | HTTP/1 · plain | HTTP/1 · plain | 🟢 32,170 | 32,170 | 24,617 | 25,428 | 31,360 | 31,360 |
| Reverse | HTTP/1 · plain | HTTP/1 · TLS | 🟢 30,070 | 30,070 | Not possible | Not possible | 29,242 | 29,242 |
| Reverse | HTTP/1 · TLS | HTTP/1 · plain | 🟢 28,032 | 28,032 | 16,654 | 17,439 | 27,463 | 27,463 |
| Reverse | HTTP/1 · TLS | HTTP/2 · TLS | 🟢 24,968 | 24,968 | Not possible | Not possible | 24,171 | 24,171 |
| Reverse | HTTP/1 · TLS | HTTP/3 · QUIC | 13,586 | 13,586 | Not possible (no QUIC) | Not possible (no QUIC) | 🟢 14,795 | 14,795 |
| Reverse | HTTP/2 · plain | HTTP/1 · plain | 33,008 | 33,008 | Not possible | Not possible | 🟢 34,758 | 34,758 |
| Reverse | HTTP/2 · plain | HTTP/2 · plain | 🟢 94,991 | 94,991 | Not possible | Not possible | 72,308 | 72,308 |
| Reverse | HTTP/2 · plain | HTTP/2 · TLS | 🟢 84,741 | 84,741 | Not possible | Not possible | 66,051 | 66,051 |
| Reverse | HTTP/2 · plain | HTTP/3 · QUIC | 🟢 32,670 | 32,670 | Not possible (no QUIC) | Not possible (no QUIC) | 30,650 | 30,650 |
| Reverse | HTTP/2 · TLS | HTTP/1 · plain | 🟢 32,280 | 32,280 | 20,312 | 20,312 | 31,298 | 31,298 |
| Reverse | HTTP/2 · TLS | HTTP/2 · plain | 🟢 85,816 | 85,816 | Not possible | Not possible | 56,741 | 56,741 |
| Reverse | HTTP/2 · TLS | HTTP/3 · QUIC | 🟢 32,009 | 32,009 | Not possible (no QUIC) | Not possible (no QUIC) | 27,823 | 27,823 |
| Reverse | HTTP/3 · QUIC | HTTP/1 · plain | 13,881 | 13,881 | Not possible (no QUIC) | Not possible (no QUIC) | 🟢 15,313 | 15,702 |
| Reverse | HTTP/3 · QUIC | HTTP/2 · TLS | 🟢 24,047 | 24,047 | Not possible (no QUIC) | Not possible (no QUIC) | 20,996 | 20,996 |
| Reverse | HTTP/3 · QUIC | HTTP/3 · QUIC | 🟢 23,543 | 23,543 | Not possible (no QUIC) | Not possible (no QUIC) | 17,316 | 17,316 |
| MITM | HTTP/1 · plain | HTTP/1 · plain | 24,782 | 24,782 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/1 · plain | HTTP/1 · TLS | 25,503 | 25,503 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/1 · TLS | HTTP/1 · plain | 24,089 | 24,089 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/1 · TLS | HTTP/2 · TLS | 30,918 | 30,918 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/1 · TLS | HTTP/3 · QUIC | 16,345 | 16,345 | Not possible (no QUIC) | Not possible (no QUIC) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · plain | HTTP/1 · plain | 37,432 | 37,432 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · plain | HTTP/2 · plain | 92,679 | 92,679 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · plain | HTTP/2 · TLS | 80,616 | 80,616 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · plain | HTTP/3 · QUIC | 34,415 | 34,415 | Not possible (no QUIC) | Not possible (no QUIC) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · TLS | HTTP/1 · plain | 36,313 | 36,313 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · TLS | HTTP/2 · plain | 86,878 | 86,878 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · TLS | HTTP/3 · QUIC | 33,304 | 33,304 | Not possible (no QUIC) | Not possible (no QUIC) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/3 · QUIC | HTTP/1 · plain | 17,578 | 17,578 | Not possible (no QUIC) | Not possible (no QUIC) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/3 · QUIC | HTTP/2 · TLS | 26,686 | 26,686 | Not possible (no QUIC) | Not possible (no QUIC) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/3 · QUIC | HTTP/3 · QUIC | 23,095 | 23,095 | Not possible (no QUIC) | Not possible (no QUIC) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/1 · plain (CONNECT) | HTTP/1 · TLS | 19,990 | 19,990 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/1 · TLS | HTTP/1 · TLS | 22,308 | 22,308 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · TLS | HTTP/2 · TLS | 79,620 | 79,620 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · TLS | HTTP/1 · TLS | 28,034 | 28,034 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/3 · QUIC | HTTP/1 · TLS | 15,082 | 15,082 | Not possible (no QUIC) | Not possible (no QUIC) | Not possible (no MITM) | Not possible (no MITM) |
TWP÷YARP H1 plain ≈ 1.03× (32,170 / 31,360); H1 TLS terminate ≈ 1.02× (28,032 / 27,463). H3→H1 ≈ 0.91×, H3→H2 ≈ 1.15×, H3→H3 ≈ 1.36×. Prefer ratios over absolute RPS on GHA VMs. MITM publishes the same 15 Client×Origin pairs as Reverse (inspectable/decrypt), then dual-crypto extras (CONNECT, TLS↔TLS). nginx/YARP cannot MITM.
Median of 3 repeats on ubuntu-latest (4 vCPU / 16 GiB) @ 02dcbdbf / MITM @ 1b5ca9f9 (same matrix as Windows): 32570355206 (compare-same), 32570356532 (compare-bridges), 32588707712 (compare-mitm). Warmup 2s / measure 8s; concurrency 8, 16, 32, 64. Linux nginx is the authoritative nginx baseline. The RPS workflow installs nginx.org mainline (http_v3_module) and libmsquic (QuicListener.IsSupported=true on ubuntu-latest).
TWP÷nginx H1 plain reverse ≈ 0.69 (30,709 / 44,687); TWP÷YARP H1 plain ≈ 0.96 (30,709 / 32,033). Prefer ratios over absolute RPS on GHA VMs.
| Mode | Client | Origin | TWP sustain | TWP peak | nginx sustain | nginx peak | YARP sustain | YARP peak |
|---|---|---|---|---|---|---|---|---|
| Reverse | HTTP/1 · plain | HTTP/1 · plain | 30,709 | 30,709 | 🟢 44,687 | 44,687 | 32,033 | 32,033 |
| Reverse | HTTP/1 · plain | HTTP/1 · TLS | 28,140 | 28,140 | Not possible | Not possible | 🟢 28,293 | 28,293 |
| Reverse | HTTP/1 · TLS | HTTP/1 · plain | 23,822 | 23,822 | 🟢 31,910 | 31,910 | 25,352 | 25,352 |
| Reverse | HTTP/1 · TLS | HTTP/2 · TLS | 🟢 25,603 | 25,603 | Not possible | Not possible | 23,757 | 23,757 |
| Reverse | HTTP/1 · TLS | HTTP/3 · QUIC | 17,633 | 17,633 | Not possible (no H3 origin) | Not possible (no H3 origin) | 🟢 17,891 | 17,891 |
| Reverse | HTTP/2 · plain | HTTP/1 · plain | 🟢 38,982 | 38,982 | Not possible | Not possible | 35,889 | 35,889 |
| Reverse | HTTP/2 · plain | HTTP/2 · plain | 🟢 74,287 | 74,287 | Not possible | Not possible | 55,026 | 55,026 |
| Reverse | HTTP/2 · plain | HTTP/2 · TLS | 🟢 60,696 | 60,696 | Not possible | Not possible | 46,989 | 46,989 |
| Reverse | HTTP/2 · plain | HTTP/3 · QUIC | 🟢 29,797 | 29,797 | Not possible (no H3 origin) | Not possible (no H3 origin) | 28,061 | 28,061 |
| Reverse | HTTP/2 · TLS | HTTP/1 · plain | 🟢 35,960 | 35,960 | 16,364 | 22,840 | 30,206 | 30,206 |
| Reverse | HTTP/2 · TLS | HTTP/2 · plain | 🟢 62,192 | 62,192 | Not possible | Not possible | 40,803 | 40,803 |
| Reverse | HTTP/2 · TLS | HTTP/3 · QUIC | 🟢 28,636 | 28,636 | Not possible (no H3 origin) | Not possible (no H3 origin) | 24,268 | 24,268 |
| Reverse | HTTP/3 · QUIC | HTTP/1 · plain | 🟢 19,551 | 19,551 | 0 | 14,848 | 19,332 | 19,332 |
| Reverse | HTTP/3 · QUIC | HTTP/2 · TLS | 🟢 27,350 | 27,350 | Not possible (no H3→H2) | Not possible (no H3→H2) | 22,019 | 22,019 |
| Reverse | HTTP/3 · QUIC | HTTP/3 · QUIC | 🟢 21,703 | 21,703 | Not possible (no H3 origin) | Not possible (no H3 origin) | 18,574 | 18,574 |
| MITM | HTTP/1 · plain | HTTP/1 · plain | 29,982 | 29,982 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/1 · plain | HTTP/1 · TLS | 27,856 | 27,856 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/1 · TLS | HTTP/1 · plain | 23,869 | 23,869 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/1 · TLS | HTTP/2 · TLS | 29,829 | 29,829 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/1 · TLS | HTTP/3 · QUIC | 20,195 | 20,195 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · plain | HTTP/1 · plain | 40,923 | 40,923 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · plain | HTTP/2 · plain | 73,146 | 73,146 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · plain | HTTP/2 · TLS | 60,131 | 60,131 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · plain | HTTP/3 · QUIC | 30,523 | 30,523 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · TLS | HTTP/1 · plain | 37,691 | 37,691 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · TLS | HTTP/2 · plain | 64,854 | 64,854 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · TLS | HTTP/3 · QUIC | 29,689 | 29,689 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/3 · QUIC | HTTP/1 · plain | 22,443 | 22,443 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/3 · QUIC | HTTP/2 · TLS | 28,182 | 28,182 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/3 · QUIC | HTTP/3 · QUIC | 21,668 | 21,668 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/1 · plain (CONNECT) | HTTP/1 · TLS | 20,981 | 20,981 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/1 · TLS | HTTP/1 · TLS | 22,112 | 22,112 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · TLS | HTTP/2 · TLS | 57,725 | 57,725 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/2 · TLS | HTTP/1 · TLS | 31,697 | 31,697 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
| MITM | HTTP/3 · QUIC | HTTP/1 · TLS | 21,573 | 21,573 | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) | Not possible (no MITM) |
On this GHA shape, TWP H1 plain ÷ nginx H1 plain ≈ 0.69 (30,709 / 44,687). H1 TLS terminate ≈ 0.75 (23,822 / 31,910). TWP÷YARP H1 plain ≈ 0.96; H1 TLS terminate ≈ 0.94. Absolute RPS swings by VM; prefer the ratio and median across repeats. MITM publishes the same 15 Client×Origin pairs as Reverse (inspectable/decrypt), then dual-crypto extras (CONNECT, TLS↔TLS). nginx/YARP cannot MITM.
nginx HTTP/3: inbound QUIC terminate → cleartext H1 (nginx-reverse-http3-cleartext) is in compare-bridges as of 32577474009 @ 629fb878. Sustain 0 (did not hold the SLO); peak 14,848. TWP/YARP H3→H1 cells on this row stay from the 02dcbdbf matrix above. nginx still cannot speak HTTP/3 to an origin (no H3 upstream in this conf).
YARP HTTP/3 (this matrix): TWP leads H3→H1 ≈ 1.01× (19,551 / 19,332), H3→H2 ≈ 1.24× (27,350 / 22,019), H3→H3 ≈ 1.17× (21,703 / 18,574). H1→H2 ≈ 1.08× (25,603 / 23,757). Near-ties: H1→H3 ≈ 0.99×, h2c→H3 ≈ 1.06×.
Windows vs Linux: both CI envs are 4 vCPU / 16 GiB, but do not compare absolute RPS across OS. Linux still has nginx leading H1 plain/TLS terminate; vs YARP, H3 bridges and same-protocol H2 are TWP-led, with H1 plain still ~0.96× YARP. Windows reverse tiny-GET is at parity or better vs YARP on most arms (see Windows section). Cool laptop notes remain on Performance Profiling.
The tables above use ~64 B keep-alive GET on loopback. On Linux H1 reverse, nginx leads; YARP sits near TWP. Heavier bodies, POSTs, TLS handshake cost, and lossy/HOL workloads (below) change the picture. MITM rows remain TWP-only. nginx HTTP/3 is inbound-terminate only (see note above).
For tiny JSON responses (~64 B) on loopback, that ordering is not expected: topology (TLS hop count, terminate vs MITM) dominates; HTTP/2 and HTTP/3 help multiplexing, not single-origin tiny-GET RPS. See the lossy tables below for a workload where protocol design matters.
Separate from the tiny-GET matrix. Same measurement environments. Modes: compare-bodies, compare-post, compare-lossy, compare-tls-cost, compare-arch in RpsLoadProbe. PUT with the same body is the same proxy work as POST; DELETE with no body matches GET — only POST is published. Bodies/POST/lossy stay half-duplex. compare-arch is the slow-consumer / early-response / duplex set. Laptop numbers are on Performance-Profiling; CI medians go in the tables below.
Lossy link = userspace shim (not kernel netem): TCP gets per-buffer delay + occasional whole-connection stalls (honest HOL for multiplexed H2); UDP gets per-datagram delay + drops (QUIC). compare-lossy publishes H1/H2/H3; H3 is where the protocol design is supposed to matter.
Median of 3 repeats on windows-latest @ 106e73b9. Source: Actions 32614286032 (compare-bodies). Warmup 2s / measure 8s.
| Body | Client | Origin | TWP sustain | TWP peak | nginx sustain | nginx peak | YARP sustain | YARP peak |
|---|---|---|---|---|---|---|---|---|
| 64 KiB | HTTP/1 · TLS | HTTP/1 · plain | 🟢 9,069 | 9,147 | 867 | 956 | 8,047 | 8,053 |
| 64 KiB | HTTP/2 · TLS | HTTP/1 · plain | 🟢 8,328 | 8,328 | 753 | 794 | 6,653 | 6,891 |
| 64 KiB | HTTP/3 · QUIC | HTTP/1 · plain | 3,720 | 3,933 | Not possible (no QUIC) | Not possible (no QUIC) | 🟢 3,836 | 3,836 |
| 256 KiB | HTTP/1 · TLS | HTTP/1 · plain | 🟢 2,617 | 2,946 | 236 | 250 | 2,347 | 2,501 |
| 256 KiB | HTTP/2 · TLS | HTTP/1 · plain | 🟢 2,497 | 2,559 | 174 | 175 | 1,738 | 1,827 |
| 256 KiB | HTTP/3 · QUIC | HTTP/1 · plain | 🟢 1,084 | 1,163 | Not possible (no QUIC) | Not possible (no QUIC) | 1,073 | 1,078 |
nginx/Windows collapses on large reverse bodies in this harness; treat as same-OS only. H1 TLS 256 KiB after 64 KiB CopyBytesToStream grain (106e73b9): TWP÷YARP ≈ 1.12× (was ~0.85×). H3→H1 64 KiB ≈ 0.97× (within ≥0.95× gate).
Median of 3 repeats @ 106e73b9. Source: Actions 32614286032 (compare-bodies). Warmup 2s / measure 8s.
| Body | Client | Origin | TWP sustain | TWP peak | nginx sustain | nginx peak | YARP sustain | YARP peak |
|---|---|---|---|---|---|---|---|---|
| 64 KiB | HTTP/1 · TLS | HTTP/1 · plain | 7,314 | 7,565 | 🟢 7,601 | 7,601 | 5,914 | 6,018 |
| 64 KiB | HTTP/2 · TLS | HTTP/1 · plain | 🟢 5,542 | 5,542 | 3,340 | 3,340 | 4,605 | 4,605 |
| 64 KiB | HTTP/3 · QUIC | HTTP/1 · plain | 🟢 4,751 | 4,751 | 1,408 | 1,471 | 3,848 | 3,848 |
| 256 KiB | HTTP/1 · TLS | HTTP/1 · plain | 2,346 | 2,346 | 🟢 2,357 | 2,357 | 1,856 | 1,889 |
| 256 KiB | HTTP/2 · TLS | HTTP/1 · plain | 🟢 1,387 | 1,387 | 852 | 860 | 1,240 | 1,240 |
| 256 KiB | HTTP/3 · QUIC | HTTP/1 · plain | 🟢 1,266 | 1,270 | 356 | 371 | 1,111 | 1,126 |
On this GHA pass TWP÷YARP H1 TLS ≈ 1.24× (64 KiB) / 1.26× (256 KiB); H2→H1 ≈ 1.20× / 1.12×; H3→H1 ≈ 1.23× / 1.14×. TWP÷nginx H1 TLS ≈ 0.96 / 1.00. Absolute RPS swings by VM; prefer ratios.
Median of 3 repeats on windows-latest @ 21396a4d. Source: Actions 32608567396 (compare-post).
| Client | Origin | TWP sustain | TWP peak | nginx sustain | nginx peak | YARP sustain | YARP peak |
|---|---|---|---|---|---|---|---|
| HTTP/1 · TLS | HTTP/1 · plain | 🟢 7,594 | 7,819 | 425 | 433 | 5,921 | 5,927 |
| HTTP/2 · TLS | HTTP/1 · plain | 🟢 6,006 | 6,006 | 423 | 444 | 4,880 | 4,880 |
| HTTP/3 · QUIC | HTTP/1 · plain | 🟢 2,772 | 2,816 | Not possible | Not possible | 2,769 | 2,861 |
TWP leads H1 POST (1.28× YARP), H2 POST (1.23× YARP), and H3 POST (~1.00× YARP) after the streamed-CL fix (ab16a871) and CI dual-listen / origin-release hardening (21396a4d).
Median of 3 repeats @ 21396a4d. Source: Actions 32608567396 (compare-post).
| Client | Origin | TWP sustain | TWP peak | nginx sustain | nginx peak | YARP sustain | YARP peak |
|---|---|---|---|---|---|---|---|
| HTTP/1 · TLS | HTTP/1 · plain | 🟢 4,415 | 4,415 | 4,277 | 4,292 | 3,406 | 3,406 |
| HTTP/2 · TLS | HTTP/1 · plain | 🟢 3,350 | 3,350 | 2,071 | 2,147 | 2,776 | 2,776 |
| HTTP/3 · QUIC | HTTP/1 · plain | 🟢 2,919 | 2,919 | 799 | 802 | 2,771 | 2,771 |
Linux nginx H1/H2/H3 POST completed (nginx.org mainline). TWP÷YARP H3 POST ≈ 1.05×; TWP÷nginx H3 ≈ 3.65×.
Userspace 5 ms one-way delay + 1% TCP connection stall (H1/H2) or UDP datagram drop (H3); 64 KiB GET. Median of 3 repeats on windows-latest @ bc768069 (known-CL header+body coalesce). Source: 32620889168 (compare-lossy). H3 on GHA Windows collapses through the userspace UDP shim (sustain ≈ 0); use the laptop lab for the Windows H3 signal.
| Client | Origin | TWP sustain | TWP peak | nginx sustain | nginx peak | YARP sustain | YARP peak |
|---|---|---|---|---|---|---|---|
| HTTP/1 · TLS | HTTP/1 · plain | 663 | 663 | 650 | 650 | 🟢 664 | 664 |
| HTTP/2 · TLS | HTTP/1 · plain | 16 | 18 | 16 | 18 | 🟢 18 | 18 |
| HTTP/3 · QUIC | HTTP/1 · plain | Not measured (GHA UDP-shim) | Not measured | Not possible (no QUIC) | Not possible | Not measured (GHA UDP-shim) | Not measured |
H1: TWP÷YARP ≈ 1.00× (was 0.86× before coalesce); nginx second. H2 collapses under connection stalls (HOL). Laptop Windows (same shim, 112×). Absolute RPS is low because the shim delays every buffer/datagram — the point is the protocol shape.quic-http3): TWP H3 ≈ 1,572 sustain vs H2 ≈ 14 (
Median of 3 repeats @ bc768069. Source: 32620889168 (compare-lossy; lossy H3 uses quic-http3).
| Client | Origin | TWP sustain | TWP peak | nginx sustain | nginx peak | YARP sustain | YARP peak |
|---|---|---|---|---|---|---|---|
| HTTP/1 · TLS | HTTP/1 · plain | 1,199 | 1,199 | 🟢 1,208 | 1,208 | 1,196 | 1,196 |
| HTTP/2 · TLS | HTTP/1 · plain | 🟢 41 | 45 | 40 | 44 | 40 | 44 |
| HTTP/3 · QUIC | HTTP/1 · plain | 🟢 333 | 333 | 89 | 89 | 322 | 322 |
Same H1/H2 story as Windows (H1 TWP÷YARP ≈ 1.00×, second behind nginx). H3 is where the protocol design shows: TWP H3 sustain ≈ 8× H2 on this runner; nginx H3 terminate stays far below under the same UDP loss.
compare-arch isolates slow app readers, origin-early response, H2 duplex, and WebSocket echo. See TWP vs YARP IO model. Laptop 1-rep numbers are on Performance-Profiling.
Median of 3 repeats on matched 4 vCPU / 16 GiB runners @ 21396a4d. Source: 32608568872 (compare-arch). Slow consumer = 256 KiB GET, 16 KiB read + 8 ms sleep. Early response = 64 KiB POST, origin writes after 8 KiB. Duplex H2 = overlapping 64 KiB POST on H2 TLS↔H2 TLS. WebSocket = echo round-trips/sec.
compare-lossy (slow network) is already published above; it is not a slow app reader.
| Scenario | Client | Origin | TWP sustain | TWP peak | nginx sustain | nginx peak | YARP sustain | YARP peak |
|---|---|---|---|---|---|---|---|---|
| Slow consumer (256 KiB GET, throttled client read) | HTTP/1 · TLS | HTTP/1 · plain | 🟢 256 | 256 | 243 | 243 | 🟢 256 | 256 |
| Slow consumer (256 KiB GET, throttled client read) | HTTP/2 · TLS | HTTP/1 · plain | 🟢 256 | 256 | 248 | 248 | 🟢 256 | 256 |
| Slow consumer (256 KiB GET, throttled client read) | HTTP/3 · QUIC | HTTP/1 · plain | 🟢 272 | 272 | Not possible (no QUIC) | Not possible | 🟢 272 | 272 |
| Early response (origin writes after first request chunk) | HTTP/1 · TLS | HTTP/1 · plain | 🟢 11,243 | 12,400 | 584 | 637 | 6,868 | 9,421 |
| Early response (origin writes after first request chunk) | HTTP/2 · TLS | HTTP/1 · plain | 🟢 8,770 | 9,163 | 0 | 622 | 6,867 | 6,867 |
| Early response (origin writes after first request chunk) | HTTP/3 · QUIC | HTTP/1 · plain | 🟢 4,041 | 4,256 | Not possible (no QUIC) | Not possible | 3,656 | 3,955 |
| Duplex (both directions live) | HTTP/2 · TLS | HTTP/2 · TLS | 🟢 35 | 1,102 | Not possible | Not possible | 0 | 2,235 |
| Duplex (WebSocket / extended CONNECT) | HTTP/1 · TLS | HTTP/1 · plain | 65,885 | 65,885 | 38,329 | 38,329 | 🟢 66,934 | 66,934 |
| Scenario | Client | Origin | TWP sustain | TWP peak | nginx sustain | nginx peak | YARP sustain | YARP peak |
|---|---|---|---|---|---|---|---|---|
| Slow consumer (256 KiB GET, throttled client read) | HTTP/1 · TLS | HTTP/1 · plain | 447 | 447 | 🟢 472 | 472 | 419 | 419 |
| Slow consumer (256 KiB GET, throttled client read) | HTTP/2 · TLS | HTTP/1 · plain | 472 | 472 | 🟢 479 | 479 | 472 | 472 |
| Slow consumer (256 KiB GET, throttled client read) | HTTP/3 · QUIC | HTTP/1 · plain | 🟢 473 | 473 | 120 | 427 | 472 | 472 |
| Early response (origin writes after first request chunk) | HTTP/1 · TLS | HTTP/1 · plain | 🟢 4,334 | 4,334 | 4,305 | 4,305 | 3,336 | 3,336 |
| Early response (origin writes after first request chunk) | HTTP/2 · TLS | HTTP/1 · plain | 🟢 3,695 | 3,695 | 0 | 2,128 | 2,402 | 2,555 |
| Early response (origin writes after first request chunk) | HTTP/3 · QUIC | HTTP/1 · plain | 🟢 2,861 | 2,861 | 0 | 784 | 2,227 | 2,227 |
| Duplex (both directions live) | HTTP/2 · TLS | HTTP/2 · TLS | 🟢 16 | 210 | Not possible | Not possible | 13 | 1,884 |
| Duplex (WebSocket / extended CONNECT) | HTTP/1 · TLS | HTTP/1 · plain | 35,119 | 35,119 | 🟢 39,090 | 39,090 | 32,230 | 32,230 |
Slow consumer is sleep-bound; H1/H2/H3 sit in the same band once bodies stream. H3 slow-consumer sustain 0 on older GHA (fast path dropped CL>16 KiB — fixed in 36d21f67 / cffd9f09; incomplete-copy pool poison fixed in 21396a4d). Early-response H3: TWP leads on both OS after duplex upload/ReceiveResponse overlap. Duplex H2: TWP holds a higher sustain than YARP on this pass (YARP peaks higher). WebSocket: YARP leads on Windows; Linux nginx leads.
Isolates keep-alive tiny GET vs new connection per request (handshake-dominated) vs keep-alive 256 KiB. Product comparison uses RPS and end-to-end latency; TWP can also capture ClientTlsTiming when TWP_RPS_CAPTURE_TLS=1 (child process) — nginx/YARP have no equivalent hook.
Median of 3 repeats on windows-latest @ b8e7afce (abortive SO_LINGER(0) restored). Source: Actions 32620298807 (compare-tls-cost). Absolute RPS on GHA swings hard; prefer TWP÷YARP.
| Workload | TWP sustain | TWP peak | nginx sustain | nginx peak | YARP sustain | YARP peak |
|---|---|---|---|---|---|---|
| Keep-alive · tiny GET | 17,009 | 19,201 | 8,870 | 8,982 | 🟢 18,667 | 18,667 |
| New-connection · tiny GET | 647 | 660 | 254 | 257 | 🟢 732 | 738 |
| Keep-alive · 256 KiB GET | 🟢 2,913 | 3,091 | 236 | 260 | 2,690 | 2,789 |
Median of 3 repeats @ b8e7afce. Source: Actions 32620298807 (compare-tls-cost).
| Workload | TWP sustain | TWP peak | nginx sustain | nginx peak | YARP sustain | YARP peak |
|---|---|---|---|---|---|---|
| Keep-alive · tiny GET | 20,544 | 20,544 | 🟢 28,790 | 28,790 | 20,754 | 20,754 |
| New-connection · tiny GET | 926 | 926 | 🟢 1,024 | 1,024 | 974 | 974 |
| Keep-alive · 256 KiB GET | 🟢 2,759 | 2,759 | 2,715 | 2,715 | 2,196 | 2,196 |
Verdict: Keep-alive 256 KiB: TWP leads YARP on both OS. Keep-alive tiny: Linux ≈ 0.99× YARP (nginx still leads); Win GHA noisy this pass (~0.91×). New-connection: Linux ≈ 0.95× YARP (gate); Win ≈ 0.88× — cool laptop still shows c=1 TWP leads, c=32 ~0.89× (parallel handshake/session tax; CTS pool landed, SessionEventArgs-lite next).
| What | Result |
|---|---|
| HTTPS TTFB vs direct (median, 14 hosts) | Cold ≈ parity (−1 ms); warm −25 ms (proxy faster) |
| HTTP/1 loopback GET (no body intercept) | ~186 µs, ~17.5 KB allocated / request |
| Basic example footprint (Release, after load) | ~74 MB working set · ~24–29 MB private bytes |
dotnet run -c Release --project benchmarks/Titanium.Web.Proxy.Benchmarks -- --filter '*Throughput*'| Benchmark | Setup | Mean | Allocated / op |
|---|---|---|---|
| HTTP/1 GET through proxy | Passthrough | 186 µs | 17.5 KB |
| HTTP/2 multiplexed GETs | 10 concurrent streams | 3.0 ms / batch | ~14 KB / request |
There is no artificial upper clamp on server defaults. Per-endpoint overrides:
| Knob | Scope | Default | Override |
|---|---|---|---|
ProxyServer.MaxCachedConnections |
process, per upstream host | 128 | any ≥ 1 |
ProxyEndPoint.MaxCachedConnections |
endpoint → pool depth for that EP’s sessions | null (use server) | e.g. 256 on reverse EP |
ProxyEndPoint.MaxConcurrentClients |
endpoint admission | null (off) | any ≥ 1 |
ResourceLimits.MaxConcurrentStreamsPerConnection |
H2 streams | 256 | ProxyResourceLimits.Create(...) |
TransparentQuicProxyEndPoint.MaxInboundBidirectionalStreams |
H3 | 100 (probe uses 256) | property on EP |
ForwardCleartext |
transparent TLS terminate | false |
true + decrypt |
proxy.MaxCachedConnections = 512;
proxy.ResourceLimits = ProxyResourceLimits.Create(
/* … */,
maxConcurrentStreamsPerConnection: 1000,
maxCachedConnectionsPerHost: 512,
/* … */);
var ep = new TransparentProxyEndPoint(IPAddress.Any, 443, decryptSsl: true)
{
ForwardHost = "127.0.0.1",
ForwardPort = 8080,
ForwardCleartext = true,
MaxCachedConnections = 256,
GenericCertificateName = "example.com"
};
ep.BeforeSslAuthenticate += (_, a) =>
{
a.UpstreamHttpProtocol = UpstreamHttpProtocol.Http11;
a.AllowHttpProtocolTranslation = true; // HTTP/2 client → HTTP/1 origin
return Task.CompletedTask;
};