[rails] Upgrade Puma to 8 by p8 · Pull Request #685 · MDA2AV/HttpArena

p8 · 2026-05-03T08:37:46Z

Use Puma 8's new 'mark_as_io_bound' option to allow more threads on the IO heavy calls.
It seems only the baseline call benefits from this.

p8 · 2026-05-05T18:23:26Z

/benchmark -f rails

github-actions · 2026-05-05T18:23:40Z

👋 /benchmark request received. A collaborator will review and approve the run.

github-actions · 2026-05-05T18:36:14Z

Benchmark Results

Framework: rails | Test: all tests

Test	Conn	RPS	CPU	Mem	Δ RPS	Δ Mem
baseline	512	60,845	5513.5%	7.1GiB	+2.0%	+9.2%
baseline	4096	31,304	4906.8%	6.1GiB	+0.4%	-1.6%
pipelined	512	308,599	6517.7%	2.5GiB	-1.9%	~0%
pipelined	4096	310,150	6514.1%	2.7GiB	-1.1%	+3.8%
limited-conn	512	27,596	4545.2%	5.9GiB	-0.5%	-1.7%
limited-conn	4096	27,427	4627.6%	6.1GiB	-1.0%	~0%
json	4096	120,568	6403.2%	4.2GiB	-1.7%	-4.5%
json-comp	512	80,852	6400.0%	4.1GiB	-4.5%	+2.5%
json-comp	4096	83,633	6455.8%	4.1GiB	-0.6%	~0%
json-comp	16384	82,941	6499.8%	4.3GiB	+0.3%	~0%
json-tls	4096	112,654	6489.4%	5.4GiB	-4.0%	~0%
upload	32	931	3066.3%	11.2GiB	-0.2%	+2.8%
upload	256	883	6351.0%	8.1GiB	-1.6%	+12.5%
api-4	256	10,138	392.7%	387MiB	~0%	+1.6%
api-16	1024	26,149	1679.3%	1.1GiB	+0.8%	~0%
static	1024	122,696	6512.8%	9.0GiB	+2.9%	+26.8%
static	4096	123,339	6449.9%	9.1GiB	+2.8%	+1.1%
static	6800	119,695	6513.7%	8.7GiB	-1.7%	-7.4%
async-db	1024	69,889	6406.3%	3.7GiB	+2.6%	+23.3%

Full log

[run 2/3]
Running 5s test @ http://localhost:8080
  64 threads and 4096 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    32.51ms    8.86ms 261.13ms   83.00%
    Req/Sec     1.90k   474.30     9.80k    89.04%
  615598 requests in 5.10s, 9.44GB read
Requests/sec: 120708.45
Transfer/sec:      1.85GB
[info] CPU 6522.2% | Mem 9.0GiB

[run 3/3]
Running 5s test @ http://localhost:8080
  64 threads and 4096 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    31.61ms    7.78ms 258.77ms   79.19%
    Req/Sec     1.94k   467.29    13.56k    84.97%
  629042 requests in 5.10s, 9.65GB read
Requests/sec: 123339.97
Transfer/sec:      1.89GB
[info] CPU 6449.9% | Mem 9.1GiB

=== Best: 123339 req/s (CPU: 6449.9%, Mem: 9.1GiB) ===
[info] saved results/static/4096/rails.json
httparena-bench-rails
httparena-bench-rails

==============================================
=== rails / static / 6800c (tool=wrk) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
Running 5s test @ http://localhost:8080
  64 threads and 6800 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    55.64ms   29.05ms 566.92ms   85.83%
    Req/Sec     1.72k   783.70     4.87k    78.69%
  547399 requests in 5.10s, 8.39GB read
Requests/sec: 107251.88
Transfer/sec:      1.64GB
[info] CPU 6409.2% | Mem 8.8GiB

[run 2/3]
Running 5s test @ http://localhost:8080
  64 threads and 6800 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    53.99ms   34.13ms 590.03ms   96.33%
    Req/Sec     1.88k   677.80     8.84k    79.61%
  610788 requests in 5.10s, 9.37GB read
Requests/sec: 119695.02
Transfer/sec:      1.84GB
[info] CPU 6513.7% | Mem 8.7GiB

[run 3/3]
Running 5s test @ http://localhost:8080
  64 threads and 6800 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    55.06ms   34.36ms 628.63ms   94.93%
    Req/Sec     1.85k   698.56    12.44k    79.93%
  600982 requests in 5.10s, 9.22GB read
Requests/sec: 117822.51
Transfer/sec:      1.81GB
[info] CPU 6458.7% | Mem 8.8GiB

=== Best: 119695 req/s (CPU: 6513.7%, Mem: 8.7GiB) ===
[info] saved results/static/6800/rails.json
httparena-bench-rails
httparena-bench-rails

==============================================
=== rails / async-db / 1024c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   14.67ms   13.80ms   21.30ms   37.20ms   206.00ms

  676004 requests in 10.00s, 676005 responses
  Throughput: 67.58K req/s
  Bandwidth:  282.01MB/s
  Status codes: 2xx=676005, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 676005 / 676005 responses (100.0%)
  Reconnects: 26543
  Per-template: 134778,135117,135638,135561,134911
  Per-template-ok: 134778,135117,135638,135561,134911
[info] CPU 6299.7% | Mem 3.8GiB

[run 2/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   14.01ms   13.90ms   21.20ms   29.30ms   38.50ms

  698891 requests in 10.00s, 698891 responses
  Throughput: 69.87K req/s
  Bandwidth:  291.57MB/s
  Status codes: 2xx=698891, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 698890 / 698891 responses (100.0%)
  Reconnects: 27661
  Per-template: 139375,139658,140183,140175,139499
  Per-template-ok: 139375,139658,140183,140175,139499
[info] CPU 6406.3% | Mem 3.7GiB

[run 3/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   14.05ms   13.90ms   20.90ms   28.50ms   36.10ms

  697358 requests in 10.00s, 697359 responses
  Throughput: 69.72K req/s
  Bandwidth:  291.00MB/s
  Status codes: 2xx=697359, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 697357 / 697359 responses (100.0%)
  Reconnects: 27595
  Per-template: 138941,139420,139775,139999,139222
  Per-template-ok: 138941,139420,139775,139999,139222
[info] CPU 6412.8% | Mem 3.8GiB

=== Best: 69889 req/s (CPU: 6406.3%, Mem: 3.7GiB) ===
[info] input BW: 4.67MB/s (avg template: 70 bytes)
[info] saved results/async-db/1024/rails.json
httparena-bench-rails
httparena-bench-rails
[info] skip: rails does not subscribe to crud
[info] skip: rails does not subscribe to fortunes
[info] skip: rails does not subscribe to baseline-h2
[info] skip: rails does not subscribe to static-h2
[info] skip: rails does not subscribe to baseline-h2c
[info] skip: rails does not subscribe to json-h2c
[info] skip: rails does not subscribe to baseline-h3
[info] skip: rails does not subscribe to static-h3
[info] skip: rails does not subscribe to gateway-64
[info] skip: rails does not subscribe to gateway-h3
[info] skip: rails does not subscribe to production-stack
[info] skip: rails does not subscribe to unary-grpc
[info] skip: rails does not subscribe to unary-grpc-tls
[info] skip: rails does not subscribe to stream-grpc
[info] skip: rails does not subscribe to stream-grpc-tls
[info] skip: rails does not subscribe to echo-ws
[info] skip: rails does not subscribe to echo-ws-pipeline
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/api-16-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/api-4-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/async-db-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-16384.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-tls-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-6800.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-32.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
httparena-postgres
[info] restoring loopback MTU to 65536
[info] restoring CPU governor → powersave

p8 · 2026-05-05T18:46:46Z

/benchmark -f rails -t baseline

github-actions · 2026-05-05T18:46:56Z

👋 /benchmark request received. A collaborator will review and approve the run.

github-actions · 2026-05-05T19:08:15Z

Benchmark Results

Framework: rails | Test: baseline

Test	Conn	RPS	CPU	Mem	Δ RPS	Δ Mem
baseline	512	79,691	5649.5%	8.2GiB	+33.6%	+26.2%
baseline	4096	34,297	5127.9%	7.8GiB	+9.9%	+25.8%

Full log


#12 exporting to image
#12 exporting layers done
#12 exporting manifest sha256:243a67289d524f82b69a72e11cea0575e6d63b9162b6e45d5eaad7438843b44d done
#12 exporting config sha256:4cc091bf6095079cdf418438199c5f27e02361dc5fb8557c42293355e9705f3f done
#12 exporting attestation manifest sha256:26204e9296a3e67dd0fd21d6863efd8c12f8921b6ba5fbdca0213f1f7aeaaf7d 0.0s done
#12 exporting manifest list sha256:b5f6462164eb9a9c599dabb4bcf86f962e1eb6732f95d54e32feba74a5f4c6a9
#12 exporting manifest list sha256:b5f6462164eb9a9c599dabb4bcf86f962e1eb6732f95d54e32feba74a5f4c6a9 0.0s done
#12 naming to docker.io/library/httparena-rails:latest done
#12 unpacking to docker.io/library/httparena-rails:latest 0.0s done
#12 DONE 0.1s
[info] tuning host for benchmark runs
[info] CPU governor → performance
[info] setting kernel socket limits
[info] setting UDP buffer sizes for QUIC
[info] setting loopback MTU to 1500 (realistic Ethernet)
[info] restarting docker daemon
[info] dropping kernel caches
[info] starting postgres sidecar
[info] postgres ready (seeded)

==============================================
=== rails / baseline / 512c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     512 (8/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Templates: 3
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   6.43ms   2.09ms   9.91ms   86.00ms   178.40ms

  398753 requests in 5.00s, 398455 responses
  Throughput: 79.66K req/s
  Bandwidth:  17.93MB/s
  Status codes: 2xx=398455, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 398453 / 398455 responses (100.0%)
  Reconnects: 298
  Per-template: 149313,216358,32782
  Per-template-ok: 149313,216358,32782
[info] CPU 5649.5% | Mem 8.2GiB

[run 2/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     512 (8/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Templates: 3
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   8.46ms   4.47ms   23.00ms   53.80ms   78.80ms

  302851 requests in 5.00s, 302697 responses
  Throughput: 60.52K req/s
  Bandwidth:  13.62MB/s
  Status codes: 2xx=302697, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 302695 / 302697 responses (100.0%)
  Reconnects: 154
  Per-template: 114514,144699,43482
  Per-template-ok: 114514,144699,43482
[info] CPU 5584.1% | Mem 6.8GiB

[run 3/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     512 (8/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Templates: 3
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   9.08ms   4.73ms   24.70ms   52.20ms   77.30ms

  281882 requests in 5.00s, 281746 responses
  Throughput: 56.33K req/s
  Bandwidth:  12.68MB/s
  Status codes: 2xx=281746, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 281743 / 281746 responses (100.0%)
  Reconnects: 136
  Per-template: 101452,135874,44417
  Per-template-ok: 101452,135874,44417
[info] CPU 5398.7% | Mem 6.9GiB

=== Best: 79691 req/s (CPU: 5649.5%, Mem: 8.2GiB) ===
[info] input BW: 6.16MB/s (avg template: 81 bytes)
[info] saved results/baseline/512/rails.json
httparena-bench-rails
httparena-bench-rails

==============================================
=== rails / baseline / 4096c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Templates: 3
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   100.05ms   92.80ms   187.80ms   364.10ms   600.80ms

  175453 requests in 5.00s, 171485 responses
  Throughput: 34.28K req/s
  Bandwidth:  7.72MB/s
  Status codes: 2xx=171485, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 171485 / 171485 responses (100.0%)
  Per-template: 62613,68053,40819
  Per-template-ok: 62613,68053,40819
[info] CPU 5127.9% | Mem 7.8GiB

[run 2/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Templates: 3
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   116.99ms   118.30ms   172.50ms   230.20ms   398.60ms

  158994 requests in 5.00s, 156422 responses
  Throughput: 31.27K req/s
  Bandwidth:  7.04MB/s
  Status codes: 2xx=156422, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 156422 / 156422 responses (100.0%)
  Per-template: 55144,55695,45583
  Per-template-ok: 55144,55695,45583
[info] CPU 4989.8% | Mem 7.0GiB

[run 3/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Templates: 3
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   112.19ms   114.80ms   171.60ms   251.70ms   556.10ms

  160592 requests in 5.00s, 158068 responses
  Throughput: 31.60K req/s
  Bandwidth:  7.11MB/s
  Status codes: 2xx=158068, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 158067 / 158068 responses (100.0%)
  Per-template: 55737,56521,45809
  Per-template-ok: 55737,56521,45809
[info] CPU 4984.8% | Mem 7.0GiB

=== Best: 34297 req/s (CPU: 5127.9%, Mem: 7.8GiB) ===
[info] input BW: 2.65MB/s (avg template: 81 bytes)
[info] saved results/baseline/4096/rails.json
httparena-bench-rails
httparena-bench-rails
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
httparena-postgres
[info] restoring loopback MTU to 65536
[info] restoring CPU governor → powersave

Use Puma 8's new 'mark_as_io_bound' option to allow more threads on the IO heavy calls. It seems only the baseline call benefits from this.

p8 · 2026-05-05T19:55:09Z

Tried enabling mark_as_io_bound for all tests.

p8 · 2026-05-05T19:55:22Z

/benchmark -f rails

github-actions · 2026-05-05T19:55:38Z

👋 /benchmark request received. A collaborator will review and approve the run.

github-actions · 2026-05-05T20:46:19Z

Benchmark Results

Framework: rails | Test: all tests

Test	Conn	RPS	CPU	Mem	Δ RPS	Δ Mem
baseline	512	79,606	5729.5%	8.3GiB	+33.4%	+27.7%
baseline	4096	34,505	5114.3%	7.8GiB	+10.6%	+25.8%
pipelined	512	302,763	6451.4%	2.6GiB	-3.8%	+4.0%
pipelined	4096	301,508	6505.4%	2.6GiB	-3.9%	~0%
limited-conn	512	27,716	4619.1%	6.1GiB	-0.1%	+1.7%
limited-conn	4096	27,274	4700.1%	6.6GiB	-1.6%	+8.2%
json	4096	119,863	6375.7%	4.3GiB	-2.3%	-2.3%
json-comp	512	82,514	6417.7%	3.9GiB	-2.5%	-2.5%
json-comp	4096	83,582	6499.0%	4.1GiB	-0.7%	~0%
json-comp	16384	81,588	6475.2%	4.3GiB	-1.3%	~0%
json-tls	4096	113,305	6518.6%	5.2GiB	-3.5%	-3.7%
upload	32	910	3057.4%	9.1GiB	-2.5%	-16.5%
upload	256	893	6329.4%	8.9GiB	-0.4%	+23.6%
api-4	256	10,020	392.1%	397MiB	-1.3%	+4.2%
api-16	1024	26,027	1676.1%	1.1GiB	+0.3%	~0%
static	1024	122,557	6513.0%	8.8GiB	+2.8%	+23.9%
static	4096	120,980	6487.2%	9.6GiB	+0.8%	+6.7%
static	6800	118,665	6462.2%	9.5GiB	-2.6%	+1.1%
async-db	1024	70,624	6398.8%	3.7GiB	+3.7%	+23.3%

Full log

[run 2/3]
Running 5s test @ http://localhost:8080
  64 threads and 4096 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    32.47ms    9.72ms 254.71ms   83.59%
    Req/Sec     1.88k   492.22     8.70k    85.33%
  609952 requests in 5.10s, 9.35GB read
Requests/sec: 119545.95
Transfer/sec:      1.83GB
[info] CPU 6515.5% | Mem 9.5GiB

[run 3/3]
Running 5s test @ http://localhost:8080
  64 threads and 4096 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    32.09ms    8.69ms 267.76ms   80.66%
    Req/Sec     1.91k   481.41     7.80k    85.26%
  617596 requests in 5.10s, 9.47GB read
Requests/sec: 120980.00
Transfer/sec:      1.86GB
[info] CPU 6487.2% | Mem 9.6GiB

=== Best: 120980 req/s (CPU: 6487.2%, Mem: 9.6GiB) ===
[info] saved results/static/4096/rails.json
httparena-bench-rails
httparena-bench-rails

==============================================
=== rails / static / 6800c (tool=wrk) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
Running 5s test @ http://localhost:8080
  64 threads and 6800 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    60.54ms   44.32ms 621.11ms   94.05%
    Req/Sec     1.66k   834.67     5.26k    78.76%
  524862 requests in 5.11s, 8.05GB read
Requests/sec: 102773.48
Transfer/sec:      1.58GB
[info] CPU 6448.2% | Mem 9.9GiB

[run 2/3]
Running 5s test @ http://localhost:8080
  64 threads and 6800 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    52.18ms   25.36ms 530.99ms   89.29%
    Req/Sec     1.87k   709.11     8.30k    80.01%
  607495 requests in 5.12s, 9.32GB read
Requests/sec: 118593.67
Transfer/sec:      1.82GB
[info] CPU 6520.6% | Mem 9.2GiB

[run 3/3]
Running 5s test @ http://localhost:8080
  64 threads and 6800 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    54.93ms   40.65ms 616.57ms   97.02%
    Req/Sec     1.87k   724.82    11.09k    77.67%
  605363 requests in 5.10s, 9.28GB read
Requests/sec: 118665.01
Transfer/sec:      1.82GB
[info] CPU 6462.2% | Mem 9.5GiB

=== Best: 118665 req/s (CPU: 6462.2%, Mem: 9.5GiB) ===
[info] saved results/static/6800/rails.json
httparena-bench-rails
httparena-bench-rails

==============================================
=== rails / async-db / 1024c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   14.51ms   13.10ms   21.40ms   36.00ms   184.30ms

  684667 requests in 10.00s, 684669 responses
  Throughput: 68.45K req/s
  Bandwidth:  285.35MB/s
  Status codes: 2xx=684669, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 684669 / 684669 responses (100.0%)
  Reconnects: 26911
  Per-template: 136526,137302,137503,136864,136474
  Per-template-ok: 136526,137302,137503,136864,136474
[info] CPU 6368.9% | Mem 3.8GiB

[run 2/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   13.91ms   13.10ms   21.10ms   29.60ms   37.00ms

  706244 requests in 10.00s, 706245 responses
  Throughput: 70.61K req/s
  Bandwidth:  294.41MB/s
  Status codes: 2xx=706245, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 706245 / 706245 responses (100.0%)
  Reconnects: 27958
  Per-template: 141045,141513,141522,141191,140974
  Per-template-ok: 141045,141513,141522,141191,140974
[info] CPU 6398.8% | Mem 3.7GiB

[run 3/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   14.00ms   13.10ms   21.30ms   31.00ms   41.30ms

  700633 requests in 10.00s, 700633 responses
  Throughput: 70.04K req/s
  Bandwidth:  292.43MB/s
  Status codes: 2xx=700633, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 700632 / 700633 responses (100.0%)
  Reconnects: 27717
  Per-template: 139510,139929,140665,140468,140060
  Per-template-ok: 139510,139929,140665,140468,140060
[info] CPU 6407.4% | Mem 3.7GiB

=== Best: 70624 req/s (CPU: 6398.8%, Mem: 3.7GiB) ===
[info] input BW: 4.71MB/s (avg template: 70 bytes)
[info] saved results/async-db/1024/rails.json
httparena-bench-rails
httparena-bench-rails
[info] skip: rails does not subscribe to crud
[info] skip: rails does not subscribe to fortunes
[info] skip: rails does not subscribe to baseline-h2
[info] skip: rails does not subscribe to static-h2
[info] skip: rails does not subscribe to baseline-h2c
[info] skip: rails does not subscribe to json-h2c
[info] skip: rails does not subscribe to baseline-h3
[info] skip: rails does not subscribe to static-h3
[info] skip: rails does not subscribe to gateway-64
[info] skip: rails does not subscribe to gateway-h3
[info] skip: rails does not subscribe to production-stack
[info] skip: rails does not subscribe to unary-grpc
[info] skip: rails does not subscribe to unary-grpc-tls
[info] skip: rails does not subscribe to stream-grpc
[info] skip: rails does not subscribe to stream-grpc-tls
[info] skip: rails does not subscribe to echo-ws
[info] skip: rails does not subscribe to echo-ws-pipeline
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/api-16-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/api-4-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/async-db-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-16384.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-tls-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-6800.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-32.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
httparena-postgres
[info] restoring loopback MTU to 65536
[info] restoring CPU governor → powersave

p8 · 2026-05-05T20:59:25Z

/benchmark -f rails —save

github-actions · 2026-05-05T20:59:34Z

👋 /benchmark request received. A collaborator will review and approve the run.

github-actions · 2026-05-05T21:23:36Z

Benchmark Results

Framework: rails | Test: all tests

Test	Conn	RPS	CPU	Mem	Δ RPS	Δ Mem
baseline	512	80,682	5770.1%	8.1GiB	+35.2%	+24.6%
baseline	4096	34,690	5231.1%	7.7GiB	+11.2%	+24.2%
pipelined	512	310,296	6498.0%	2.6GiB	-1.4%	+4.0%
pipelined	4096	312,196	6534.6%	2.6GiB	-0.5%	~0%
limited-conn	512	27,592	4613.5%	6.2GiB	-0.5%	+3.3%
limited-conn	4096	27,448	4683.3%	6.9GiB	-0.9%	+13.1%
json	4096	123,898	6465.5%	4.2GiB	+1.0%	-4.5%
json-comp	512	83,297	6436.3%	4.1GiB	-1.6%	+2.5%
json-comp	4096	82,770	6459.8%	3.9GiB	-1.7%	-4.9%
json-comp	16384	82,499	6253.8%	4.4GiB	-0.2%	+2.3%
json-tls	4096	115,310	6541.7%	5.4GiB	-1.8%	~0%
upload	32	929	3054.5%	10.2GiB	-0.4%	-6.4%
upload	256	893	6330.0%	9.3GiB	-0.4%	+29.2%
api-4	256	10,139	395.1%	388MiB	~0%	+1.8%
api-16	1024	26,118	1734.2%	1.1GiB	+0.6%	~0%
static	1024	118,056	6483.9%	8.4GiB	-0.9%	+18.3%
static	4096	120,679	6473.9%	8.7GiB	+0.6%	-3.3%
static	6800	119,726	6505.7%	8.7GiB	-1.7%	-7.4%
async-db	1024	70,137	6382.1%	3.7GiB	+3.0%	+23.3%

Full log

[run 2/3]
Running 5s test @ http://localhost:8080
  64 threads and 4096 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    33.14ms   10.08ms 261.82ms   83.76%
    Req/Sec     1.86k   447.26     8.06k    87.11%
  604153 requests in 5.11s, 9.26GB read
Requests/sec: 118305.14
Transfer/sec:      1.81GB
[info] CPU 6504.3% | Mem 8.5GiB

[run 3/3]
Running 5s test @ http://localhost:8080
  64 threads and 4096 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    32.12ms    8.65ms 250.59ms   80.47%
    Req/Sec     1.90k   499.17    13.69k    84.66%
  616306 requests in 5.11s, 9.45GB read
Requests/sec: 120679.08
Transfer/sec:      1.85GB
[info] CPU 6473.9% | Mem 8.7GiB

=== Best: 120679 req/s (CPU: 6473.9%, Mem: 8.7GiB) ===
[info] saved results/static/4096/rails.json
httparena-bench-rails
httparena-bench-rails

==============================================
=== rails / static / 6800c (tool=wrk) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
Running 5s test @ http://localhost:8080
  64 threads and 6800 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    55.31ms   27.34ms 417.27ms   83.58%
    Req/Sec     1.70k   770.00     5.09k    77.83%
  543231 requests in 5.10s, 8.33GB read
Requests/sec: 106453.43
Transfer/sec:      1.63GB
[info] CPU 6379.8% | Mem 8.8GiB

[run 2/3]
Running 5s test @ http://localhost:8080
  64 threads and 6800 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    50.64ms   18.57ms 363.00ms   81.95%
    Req/Sec     1.89k   742.30    10.09k    79.30%
  611517 requests in 5.11s, 9.38GB read
Requests/sec: 119726.03
Transfer/sec:      1.84GB
[info] CPU 6505.7% | Mem 8.7GiB

[run 3/3]
Running 5s test @ http://localhost:8080
  64 threads and 6800 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    55.35ms   34.72ms 658.07ms   94.58%
    Req/Sec     1.84k   700.27    11.29k    79.37%
  597189 requests in 5.10s, 9.16GB read
Requests/sec: 117035.12
Transfer/sec:      1.79GB
[info] CPU 6446.6% | Mem 8.7GiB

=== Best: 119726 req/s (CPU: 6505.7%, Mem: 8.7GiB) ===
[info] saved results/static/6800/rails.json
httparena-bench-rails
httparena-bench-rails

==============================================
=== rails / async-db / 1024c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   14.45ms   13.60ms   21.10ms   35.00ms   195.70ms

  680843 requests in 10.00s, 680844 responses
  Throughput: 68.06K req/s
  Bandwidth:  283.97MB/s
  Status codes: 2xx=680844, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 680844 / 680844 responses (100.0%)
  Reconnects: 26734
  Per-template: 135649,136327,136593,136256,136019
  Per-template-ok: 135649,136327,136593,136256,136019
[info] CPU 6314.5% | Mem 3.7GiB

[run 2/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   13.94ms   13.70ms   21.60ms   30.40ms   40.00ms

  701378 requests in 10.00s, 701379 responses
  Throughput: 70.11K req/s
  Bandwidth:  292.30MB/s
  Status codes: 2xx=701379, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 701379 / 701379 responses (100.0%)
  Reconnects: 27757
  Per-template: 139736,140525,141100,140416,139602
  Per-template-ok: 139736,140525,141100,140416,139602
[info] CPU 6382.1% | Mem 3.7GiB

[run 3/3]
gcannon v0.5.3
  Target:    localhost:8080/
  Threads:   64
  Conns:     1024 (16/thread)
  Pipeline:  1
  Req/conn:  25
  Templates: 5
  Expected:  200
  Duration:  10s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   14.08ms   13.80ms   21.40ms   29.90ms   38.00ms

  697643 requests in 10.00s, 697643 responses
  Throughput: 69.75K req/s
  Bandwidth:  291.23MB/s
  Status codes: 2xx=697643, 3xx=0, 4xx=0, 5xx=0
  Latency samples: 697642 / 697643 responses (100.0%)
  Reconnects: 27612
  Per-template: 139008,139377,139768,139926,139563
  Per-template-ok: 139008,139377,139768,139926,139563
[info] CPU 6400.7% | Mem 3.7GiB

=== Best: 70137 req/s (CPU: 6382.1%, Mem: 3.7GiB) ===
[info] input BW: 4.68MB/s (avg template: 70 bytes)
[info] saved results/async-db/1024/rails.json
httparena-bench-rails
httparena-bench-rails
[info] skip: rails does not subscribe to crud
[info] skip: rails does not subscribe to fortunes
[info] skip: rails does not subscribe to baseline-h2
[info] skip: rails does not subscribe to static-h2
[info] skip: rails does not subscribe to baseline-h2c
[info] skip: rails does not subscribe to json-h2c
[info] skip: rails does not subscribe to baseline-h3
[info] skip: rails does not subscribe to static-h3
[info] skip: rails does not subscribe to gateway-64
[info] skip: rails does not subscribe to gateway-h3
[info] skip: rails does not subscribe to production-stack
[info] skip: rails does not subscribe to unary-grpc
[info] skip: rails does not subscribe to unary-grpc-tls
[info] skip: rails does not subscribe to stream-grpc
[info] skip: rails does not subscribe to stream-grpc-tls
[info] skip: rails does not subscribe to echo-ws
[info] skip: rails does not subscribe to echo-ws-pipeline
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/api-16-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/api-4-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/async-db-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-16384.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-tls-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-6800.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-32.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
httparena-postgres
[info] restoring loopback MTU to 65536
[info] restoring CPU governor → powersave

MDA2AV · 2026-05-11T18:47:32Z

/benchmark -f rails --save

github-actions · 2026-05-11T18:47:42Z

👋 /benchmark request received. A collaborator will review and approve the run.

github-actions · 2026-05-11T18:48:56Z

⚠️ /benchmark --save aborted: main has diverged and cannot be auto-merged into this branch. Please merge or rebase main manually, push, and re-run /benchmark --save.

p8 requested review from Kaliumhexacyanoferrat and MDA2AV as code owners May 3, 2026 08:37

p8 force-pushed the rails/puma-8 branch 4 times, most recently from 2c893f7 to 09d3376 Compare May 5, 2026 18:20

p8 force-pushed the rails/puma-8 branch from 09d3376 to 5658039 Compare May 5, 2026 18:33

p8 force-pushed the rails/puma-8 branch from 5658039 to 61e2b51 Compare May 5, 2026 18:46

[rails] Upgrade Puma to 8

66cfa53

Use Puma 8's new 'mark_as_io_bound' option to allow more threads on the IO heavy calls. It seems only the baseline call benefits from this.

p8 force-pushed the rails/puma-8 branch from 61e2b51 to 66cfa53 Compare May 5, 2026 19:54

Update application.rb

1e12234

MDA2AV approved these changes May 11, 2026

View reviewed changes

MDA2AV merged commit 33626d0 into MDA2AV:main May 11, 2026
4 checks passed

p8 deleted the rails/puma-8 branch May 12, 2026 06:34

Conversation

p8 commented May 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

p8 commented May 5, 2026

Uh oh!

github-actions Bot commented May 5, 2026

Uh oh!

github-actions Bot commented May 5, 2026

Benchmark Results

Uh oh!

p8 commented May 5, 2026

Uh oh!

github-actions Bot commented May 5, 2026

Uh oh!

github-actions Bot commented May 5, 2026

Benchmark Results

Uh oh!

p8 commented May 5, 2026

Uh oh!

p8 commented May 5, 2026

Uh oh!

github-actions Bot commented May 5, 2026

Uh oh!

github-actions Bot commented May 5, 2026

Benchmark Results

Uh oh!

p8 commented May 5, 2026

Uh oh!

github-actions Bot commented May 5, 2026

Uh oh!

github-actions Bot commented May 5, 2026

Benchmark Results

Uh oh!

MDA2AV commented May 11, 2026

Uh oh!

github-actions Bot commented May 11, 2026

Uh oh!

github-actions Bot commented May 11, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

p8 commented May 3, 2026 •

edited

Loading