Skip to content
github-actions[bot] edited this page Aug 19, 2026 · 210 revisions

Performance

Titanium targets low-overhead MITM proxying: connection pooling, HTTP/2 multiplexing, and buffer reuse. Numbers below are Release measurements with RpsLoadProbe (and BenchmarkDotNet / Basic example where noted). Absolute RPS varies by hardware, OS, and background load — compare within a table, not across Windows vs Linux.

Control arms: nginx (native C reverse-proxy ceiling; Linux is authoritative) and YARP (Yarp.ReverseProxy, managed .NET reverse proxy). Neither can MITM (no CONNECT / forged certs). FiddlerCore is not compared (commercial debugger license; not a throughput peer).

For pooling knobs and certificate first-visit tuning, see Performance and pooling. For the methodology behind these numbers — the harness, noise control, and the profiling techniques used to find each hotspot — see Performance Profiling.

Measurement environment

Windows (developer laptop)

OS Windows 11 (10.0.26200)
CPU 11th Gen Intel Core i7-1185G7 @ 3.00 GHz (8 logical processors)
RAM 31.8 GiB
Runtime .NET 10.0.10
nginx nginx/Windows 1.31.3
YARP Yarp.ReverseProxy 2.3.0
Harness RpsLoadProbe Release; arms run sequentially

Linux (GitHub-hosted ubuntu-latest)

OS Ubuntu 24.04.4 LTS
CPU AMD EPYC 7763 (4 logical processors on the VM)
RAM 15.6 GiB
Runtime .NET 10.0.11
nginx nginx/1.24.0 (Ubuntu)
YARP Yarp.ReverseProxy 2.3.0
Harness RpsLoadProbe Release; median of 3 repeats where noted

How to read the tables

  • Mode: Reverse = transparent fixed-forward (may TLS-terminate to a cleartext origin, or re-encrypt to a configured HTTPS/QUIC origin). MITM = proxy decrypts the client crypto and speaks TLS/QUIC to the origin (or explicit decrypt proxy), so both legs are visible in the clear inside TWP. nginx and YARP cannot do MITM.
  • Sustainable = last concurrency that still met error/latency SLOs. Peak = highest RPS in that ramp.
  • Winner = highest sustainable RPS among products that have a number on that row. Left blank when only TWP can run the path (no fair multi-product comparison).
  • Not possible = product cannot do that path. Not measured = path exists but no published number yet for that OS.
pwsh tools/RpsLoadProbe/run-rps.ps1 -Mode compare-same
pwsh tools/RpsLoadProbe/run-rps.ps1 -Mode compare-terminate
pwsh tools/RpsLoadProbe/run-rps.ps1 -Mode compare-bridges
pwsh tools/RpsLoadProbe/run-rps.ps1 -Mode compare-mitm
pwsh tools/RpsLoadProbe/run-rps.ps1 -Mode compare-bodies
pwsh tools/RpsLoadProbe/run-rps.ps1 -Mode compare-post
pwsh tools/RpsLoadProbe/run-rps.ps1 -Mode compare-lossy
pwsh tools/RpsLoadProbe/run-rps.ps1 -Mode compare-tls-cost

Windows — Titanium vs nginx vs YARP

Client / origin: HTTP version and whether TLS is used (plain = cleartext, TLS = encrypted, QUIC = HTTP/3).

Mode Client Origin TWP sustain TWP peak nginx sustain nginx peak YARP sustain YARP peak Winner
Reverse HTTP/1 · plain HTTP/1 · plain 24,153 34,576 14,882 14,882 29,939 29,939 YARP
Reverse HTTP/1 · TLS HTTP/1 · plain 22,985 22,985 11,173 11,173 25,822 25,822 YARP
MITM HTTP/1 · TLS HTTP/1 · TLS 31,479 31,479 Not possible (no MITM) Not possible Not possible (no MITM) Not possible
Reverse HTTP/2 · TLS HTTP/1 · plain 29,134 29,134 4,755 10,796 27,669 27,669 TWP
MITM HTTP/2 · TLS HTTP/1 · TLS 35,673 35,823 Not possible (no MITM) Not possible Not possible (no MITM) Not possible
MITM HTTP/2 · TLS HTTP/2 · TLS 51,455 51,455 Not possible (no MITM) Not possible Not possible (no MITM) Not possible
Reverse HTTP/2 · TLS HTTP/2 · plain 88,742 88,742 Not possible Not possible 68,761 68,761 TWP
Reverse HTTP/2 · plain HTTP/1 · plain 23,228 23,228 Not possible Not possible 27,697 27,697 YARP
Reverse HTTP/2 · plain HTTP/2 · plain 102,819 102,819 Not possible Not possible 85,909 85,909 TWP
Reverse HTTP/2 · plain HTTP/2 · TLS 27,943 27,943 Not possible Not possible 49,202 49,202 YARP
Reverse HTTP/2 · plain HTTP/3 · QUIC 12,036 12,036 Not possible (no QUIC) Not possible 14,817 14,817 YARP
Reverse HTTP/3 · QUIC HTTP/1 · plain 12,392 12,850 Not possible (no QUIC) Not possible 14,181 17,238 YARP
Reverse HTTP/3 · QUIC HTTP/2 · TLS 33,198 33,198 Not possible (no QUIC) Not possible 39,963 39,963 YARP
MITM HTTP/3 · QUIC HTTP/1 · TLS 9,732 10,334 Not possible (no QUIC) Not possible Not possible (no MITM) Not possible
MITM HTTP/3 · QUIC HTTP/2 · TLS 3,527 3,527 Not possible (no QUIC) Not possible Not possible (no MITM) Not possible
MITM HTTP/3 · QUIC HTTP/3 · QUIC 10,810 10,810 Not possible (no QUIC) Not possible Not possible (no MITM) Not possible
Reverse HTTP/1 · TLS HTTP/2 · TLS 38,540 38,540 Not possible Not possible 45,227 45,227 YARP
Reverse HTTP/1 · TLS HTTP/3 · QUIC 14,053 14,053 Not possible (no QUIC) Not possible 17,350 17,350 YARP
Reverse HTTP/2 · TLS HTTP/3 · QUIC 17,141 17,141 Not possible (no QUIC) Not possible 13,473 13,473 TWP

Windows sources: matched-client cool pairs under tools/RpsLoadProbe/results/matched-baseline/ and matched-post-fix/ / matched-post-headers-writer/ (2026-08-18), HttpClient H3 cool pairs under matched-httpclient-h3/ (2026-08-18), plus 2026-08-19 High-perf cool pairs under residual-sub08/quiet-remeasure/ (h3-lite-only/, h2c-iocp-min/, h2c-wu-batch-confirm/). Warmup 2–8s; measure 5–30s; concurrency 8–64. Absolute RPS swings with sequential-arm heat; prefer TWP÷YARP ratios over absolutes.

Load generators: Reverse inbound H3 arms (H3→H1, H3→H2) use dotnet-httpclient (http_version=3.0, RequestVersionExact) on both TWP and YARP after dual-listen reverse H3. UDP-only MITM H3 still uses quic-http3. Older reverse-H3 ratios that used matched quic-http3 are not comparable to these HttpClient numbers.

Matched HttpClient TWP÷YARP (cool): H3→H1 ≈ 0.87 sustain (12,392 / 14,181). H3→H2 ≈ 0.83 (33,198 / 39,963; ≥0.80) — session-less H3→H2 reverse (h3-lite-only/). H1→H2 ≈ 0.85 (38,540 / 45,227; ≥0.80). H2 TLS→h2c ≈ 1.29× (88,742 / 68,761; TWP leads) — post-wu-batch-arms/. h2c→h2c ≈ 1.20× (102,819 / 85,909; TWP leads) — h2c-wu-batch-confirm/.

nginx/Windows is a limited port — use it for same-OS comparison only, not as the industry nginx baseline.

H2 TLS → H1 plain on Windows: fair terminate — TWP leads sustain (~1.05× YARP) in the current table. Absolute RPS swings with background load; treat as same-OS only.

Linux — Titanium vs nginx vs YARP

Median of 3 repeats from Actions runs 32057531323 (compare-same), 32057536434 (compare-terminate), 32057541322 (compare-bridges). Warmup 2s / measure 8s; concurrency 8, 16, 32, 64. Linux nginx is the authoritative nginx baseline. The RPS workflow installs libmsquic (QuicListener.IsSupported=true on ubuntu-latest).

TWP÷nginx H1 plain reverse ≈ 0.67; TWP÷YARP H1 plain ≈ 0.95. Prefer ratios over absolute RPS on GHA VMs.

Mode Client Origin TWP sustain TWP peak nginx sustain nginx peak YARP sustain YARP peak Winner
Reverse HTTP/1 · plain HTTP/1 · plain 26,499 26,499 39,440 39,440 27,784 27,784 nginx
Reverse HTTP/1 · TLS HTTP/1 · plain 18,863 18,863 27,696 27,696 20,270 20,270 nginx
MITM HTTP/1 · TLS HTTP/1 · TLS 15,631 15,631 Not possible (no MITM) Not possible Not possible (no MITM) Not possible
Reverse HTTP/2 · TLS HTTP/1 · plain 11,420 11,489 13,543 19,093 29,784 29,784 YARP
MITM HTTP/2 · TLS HTTP/1 · TLS 10,787 10,787 Not possible (no MITM) Not possible Not possible (no MITM) Not possible
MITM HTTP/2 · TLS HTTP/2 · TLS 5,189 5,189 Not possible (no MITM) Not possible Not possible (no MITM) Not possible
Reverse HTTP/2 · TLS HTTP/2 · plain 7,487 7,487 Not possible Not possible 45,479 45,479 YARP
Reverse HTTP/2 · plain HTTP/1 · plain 16,791 16,791 Not possible Not possible 35,502 35,502 YARP
Reverse HTTP/2 · plain HTTP/2 · plain 7,861 7,917 Not possible Not possible 48,560 48,560 YARP
Reverse HTTP/2 · plain HTTP/2 · TLS 5,731 5,731 Not possible Not possible 40,314 40,314 YARP
Reverse HTTP/2 · plain HTTP/3 · QUIC 13,587 13,587 Not possible (no QUIC) Not possible 20,553 20,553 YARP
Reverse HTTP/3 · QUIC HTTP/1 · plain 13,545 13,545 Not possible (no QUIC) Not possible 19,686 19,686 YARP
MITM HTTP/3 · QUIC HTTP/1 · TLS 12,076 12,076 Not possible (no QUIC) Not possible Not possible (no MITM) Not possible
MITM HTTP/3 · QUIC HTTP/2 · TLS 2,187 6,265 Not possible (no QUIC) Not possible Not possible (no MITM) Not possible
MITM HTTP/3 · QUIC HTTP/3 · QUIC 9,884 9,884 Not possible (no QUIC) Not possible Not possible (no MITM) Not possible
Reverse HTTP/1 · TLS HTTP/2 · TLS 12,681 12,681 Not possible Not possible 28,423 28,423 YARP
Reverse HTTP/1 · TLS HTTP/3 · QUIC 15,104 15,104 Not possible (no QUIC) Not possible 16,151 16,151 YARP
Reverse HTTP/2 · TLS HTTP/3 · QUIC 10,593 10,593 Not possible (no QUIC) Not possible 21,171 21,171 YARP

On this GHA shape, TWP H1 plain ÷ nginx H1 plain ≈ 0.67 (26,499 / 39,440). H1 TLS terminate ≈ 0.68 (18,863 / 27,696). TWP÷YARP H1 plain ≈ 0.95. Absolute RPS swings by VM; prefer the ratio and median across repeats. MITM H2→H1 / H3→H1 dual-crypto cells reuse prior compare-mitm numbers (not re-run this pass).

Tiny JSON reverse is nginx’s best case on Linux

The tables above use ~64 B keep-alive GET on loopback. On Linux H1 reverse, nginx leads; YARP sits near TWP. Heavier bodies, POSTs, TLS handshake cost, and lossy/HOL workloads (below) change the picture. MITM and many H3/h2c/bridge rows remain TWP-only or TWP+YARP (nginx cannot MITM or speak QUIC in this harness).

Why isn’t HTTP/3 > HTTP/2 > HTTP/1 in raw RPS?

For tiny JSON responses (~64 B) on loopback, that ordering is not expected: topology (TLS hop count, terminate vs MITM) dominates; HTTP/2 and HTTP/3 help multiplexing, not single-origin tiny-GET RPS. See the lossy tables below for a workload where protocol design matters.

Heavier reverse workloads

Separate from the tiny-GET matrix. Same measurement environments. Modes: compare-bodies, compare-post, compare-lossy, compare-tls-cost in RpsLoadProbe. PUT with the same body is the same proxy work as POST; DELETE with no body matches GET — only POST is published.

Lossy link = userspace shim (not kernel netem): TCP gets per-buffer delay + occasional whole-connection stalls (honest HOL for multiplexed H2); UDP datagram drop exists in the harness but H3 lossy is not published — rechecked at concurrency 8 after H2/H3 streaming work (rps-ramp-20260817-212421): TWP H3 through the UDP shim stayed at 0 sustain (multi-second p99); YARP H3 via the TCP shim also failed to establish. Treat as a measurement limitation (MsQuic + lossy shim), not a capability claim.

Windows — heavier reverse GET (64 KiB / 256 KiB)

Warmup 1s / measure 3s; concurrency 8–64. Source: local compare-bodies (rps-ramp-20260817-190233).

Body Client Origin TWP sustain TWP peak nginx sustain nginx peak YARP sustain YARP peak Winner
64 KiB HTTP/1 · TLS HTTP/1 · plain 6,146 6,146 447 630 5,623 5,623 TWP
64 KiB HTTP/2 · TLS HTTP/1 · plain 1,974 2,152 299 387 2,597 3,982 YARP
64 KiB HTTP/3 · QUIC HTTP/1 · plain 866 1,950 Not possible (no QUIC) Not possible 1,451 1,451 YARP
256 KiB HTTP/1 · TLS HTTP/1 · plain 2,100 2,100 214 214 2,318 2,318 YARP
256 KiB HTTP/2 · TLS HTTP/1 · plain 688 688 177 177 1,380 1,380 YARP
256 KiB HTTP/3 · QUIC HTTP/1 · plain 656 748 Not possible (no QUIC) Not possible 402 544 TWP

nginx/Windows collapses on large reverse bodies in this harness; treat as same-OS only.

Linux — heavier reverse GET (64 KiB / 256 KiB)

Median of 3 repeats. Source: Actions 32057545720 (compare-bodies). Warmup 2s / measure 8s.

Body Client Origin TWP sustain TWP peak nginx sustain nginx peak YARP sustain YARP peak Winner
64 KiB HTTP/1 · TLS HTTP/1 · plain 7,016 7,016 8,791 8,862 7,000 7,120 nginx
64 KiB HTTP/2 · TLS HTTP/1 · plain 4,074 4,074 3,937 3,937 5,262 5,262 YARP
64 KiB HTTP/3 · QUIC HTTP/1 · plain 3,648 3,648 Not possible (no QUIC) Not possible 4,616 4,616 YARP
256 KiB HTTP/1 · TLS HTTP/1 · plain 2,178 2,178 2,764 2,764 2,255 2,255 nginx
256 KiB HTTP/2 · TLS HTTP/1 · plain 1,062 1,062 0 3 1,454 1,472 YARP
256 KiB HTTP/3 · QUIC HTTP/1 · plain 1,106 1,106 Not possible (no QUIC) Not possible 1,304 1,326 YARP

On Linux H1 TLS, TWP÷nginx ≈ 0.80 at 64 KiB and ≈ 0.79 at 256 KiB — better than the tiny-GET ≈0.67 ratio, but nginx still leads sustain when both stay healthy. nginx H2 at 256 KiB failed this harness (~100% errors); TWP and YARP H2/H3 completed.

Windows — POST 64 KiB request + 64 KiB response

Source: local compare-post (rps-ramp-20260818-064426; warmup 2s; measure 5s; concurrency 8–64).

Client Origin TWP sustain TWP peak nginx sustain nginx peak YARP sustain YARP peak Winner
HTTP/1 · TLS HTTP/1 · plain 3,348 3,583 259 296 3,100 3,100 TWP
HTTP/2 · TLS HTTP/1 · plain 2,062 2,062 255 281 2,384 2,439 YARP
HTTP/3 · QUIC HTTP/1 · plain 1,346 1,346 Not possible Not possible 1,024 1,058 TWP

TWP wins the H1 and H3 POST arms and sits at ~0.87 of YARP sustain on H2 POST.

Linux — POST 64 KiB request + 64 KiB response

Median of 3 repeats. Source: Actions 32059387716 (compare-post).

Client Origin TWP sustain TWP peak nginx sustain nginx peak YARP sustain YARP peak Winner
HTTP/1 · TLS HTTP/1 · plain 3,733 3,733 0 0 3,082 3,082 TWP
HTTP/2 · TLS HTTP/1 · plain 95 275 0 0 2,526 2,526 YARP
HTTP/3 · QUIC HTTP/1 · plain 0 0 Not possible Not possible 2,550 2,550 YARP

Linux nginx returned 100% errors on 64 KiB POST in this harness (Windows nginx did complete). Prefer TWP/YARP H1 POST as working reverse paths; do not read the nginx zero as a fair peak contest until the nginx POST arm is healthy on Ubuntu.

Windows — lossy / high-RTT (H2 HOL)

Userspace 5 ms one-way delay + 1% connection stall; 64 KiB GET. Source: local compare-lossy (rps-ramp-20260817-190954).

Client Origin TWP sustain TWP peak nginx sustain nginx peak YARP sustain YARP peak Winner
HTTP/1 · TLS HTTP/1 · plain 637 637 375 375 634 634 TWP
HTTP/2 · TLS HTTP/1 · plain 14 14 11 13 12 13 TWP

H1 scales with concurrency; H2 collapses under connection stalls (HOL). Absolute RPS is low because the shim delays every buffer — the point is the protocol shape, not competing with the tiny-GET table.

Linux — lossy / high-RTT (H2 HOL)

Median of 3 repeats. Source: Actions 32057553398 (compare-lossy).

Client Origin TWP sustain TWP peak nginx sustain nginx peak YARP sustain YARP peak Winner
HTTP/1 · TLS HTTP/1 · plain 1,114 1,114 1,211 1,211 1,195 1,195 nginx
HTTP/2 · TLS HTTP/1 · plain 40 45 44 45 40 42 nginx

Same story as Windows: H1 stays usable; H2 falls to tens of RPS for all three products. Tiny-GET H1 leadership does not carry over.

TLS termination cost (H1 TLS → cleartext origin)

Isolates keep-alive tiny GET vs new connection per request (handshake-dominated) vs keep-alive 256 KiB. Product comparison uses RPS and end-to-end latency; TWP can also capture ClientTlsTiming when TWP_RPS_CAPTURE_TLS=1 (child process) — nginx/YARP have no equivalent hook.

Windows

Source: local compare-tls-cost (rps-ramp-20260817-191143).

Workload TWP sustain TWP peak nginx sustain nginx peak YARP sustain YARP peak Winner
Keep-alive · tiny GET 13,007 14,868 4,863 7,286 17,105 17,105 YARP
New-connection · tiny GET 484 484 380 409 555 555 YARP
Keep-alive · 256 KiB GET 1,651 1,772 171 171 2,038 2,038 YARP

Linux

Median of 3 repeats. Source: Actions 32057558279 (compare-tls-cost).

Workload TWP sustain TWP peak nginx sustain nginx peak YARP sustain YARP peak Winner
Keep-alive · tiny GET 19,682 19,682 27,711 27,711 21,165 21,165 nginx
New-connection · tiny GET 1,150 1,161 1,020 1,020 981 981 TWP
Keep-alive · 256 KiB GET 2,155 2,155 2,674 2,674 2,197 2,197 nginx

Verdict (Linux, authoritative nginx): On keep-alive tiny terminate, TWP is ~0.71× nginx and ~0.93× YARP. On new-connection terminate, TWP is ahead of both (~1.13× nginx, ~1.17× YARP). With 256 KiB bodies, nginx still leads sustain when all three are healthy.

Other measurements

What Result
HTTPS TTFB vs direct (median, 14 hosts) Cold ≈ parity (−1 ms); warm −25 ms (proxy faster)
HTTP/1 loopback GET (no body intercept) ~186 µs, ~17.5 KB allocated / request
Basic example footprint (Release, after load) ~74 MB working set · ~24–29 MB private bytes
dotnet run -c Release --project benchmarks/Titanium.Web.Proxy.Benchmarks -- --filter '*Throughput*'
Benchmark Setup Mean Allocated / op
HTTP/1 GET through proxy Passthrough 186 µs 17.5 KB
HTTP/2 multiplexed GETs 10 concurrent streams 3.0 ms / batch ~14 KB / request

Raising limits on large hosts

There is no artificial upper clamp on server defaults. Per-endpoint overrides:

Knob Scope Default Override
ProxyServer.MaxCachedConnections process, per upstream host 128 any ≥ 1
ProxyEndPoint.MaxCachedConnections endpoint → pool depth for that EP’s sessions null (use server) e.g. 256 on reverse EP
ProxyEndPoint.MaxConcurrentClients endpoint admission null (off) any ≥ 1
ResourceLimits.MaxConcurrentStreamsPerConnection H2 streams 256 ProxyResourceLimits.Create(...)
TransparentQuicProxyEndPoint.MaxInboundBidirectionalStreams H3 100 (probe uses 256) property on EP
ForwardCleartext transparent TLS terminate false true + decrypt
proxy.MaxCachedConnections = 512;
proxy.ResourceLimits = ProxyResourceLimits.Create(
    /* … */,
    maxConcurrentStreamsPerConnection: 1000,
    maxCachedConnectionsPerHost: 512,
    /* … */);

var ep = new TransparentProxyEndPoint(IPAddress.Any, 443, decryptSsl: true)
{
    ForwardHost = "127.0.0.1",
    ForwardPort = 8080,
    ForwardCleartext = true,
    MaxCachedConnections = 256,
    GenericCertificateName = "example.com"
};
ep.BeforeSslAuthenticate += (_, a) =>
{
    a.UpstreamHttpProtocol = UpstreamHttpProtocol.Http11;
    a.AllowHttpProtocolTranslation = true; // HTTP/2 client → HTTP/1 origin
    return Task.CompletedTask;
};

Clone this wiki locally