2021 05 10 bench results
Andrea edited this page May 11, 2021
·
3 revisions
Benchmarked on: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz, 32G RAM
Benchmark duration per suite: 300s
Commit: e52aca9
Config:
GRPC_BENCHMARK_DURATION=300s
GRPC_SERVER_CPUS=<1-3>
GRPC_SERVER_RAM=512m
GRPC_CLIENT_CONNECTIONS=50
GRPC_CLIENT_CONCURRENCY=1000
GRPC_CLIENT_QPS=0
GRPC_CLIENT_CPUS=9
GRPC_REQUEST_PAYLOAD=100B
1 CPU Server
--------------------------------------------------------------------------------------------------------------------------------
| name | req/s | avg. latency | 90 % in | 95 % in | 99 % in | avg. cpu | avg. memory |
--------------------------------------------------------------------------------------------------------------------------------
| rust_tonic_st | 49116 | 20.30 ms | 24.56 ms | 25.66 ms | 28.59 ms | 101.55% | 13.74 MiB |
| rust_thruster_st | 41777 | 23.88 ms | 29.33 ms | 30.54 ms | 33.41 ms | 101.22% | 11.77 MiB |
| rust_tonic_mt | 41305 | 24.15 ms | 10.30 ms | 12.21 ms | 602.42 ms | 102.1% | 14.75 MiB |
| dotnet_grpc | 37846 | 26.33 ms | 45.59 ms | 52.56 ms | 81.29 ms | 100.54% | 88.06 MiB |
| rust_grpcio | 37016 | 26.96 ms | 29.65 ms | 30.81 ms | 33.80 ms | 102.38% | 24.7 MiB |
| rust_thruster_mt | 34436 | 28.98 ms | 12.48 ms | 14.06 ms | 737.12 ms | 101.76% | 12.9 MiB |
| java_grpc_pgc | 33388 | 29.88 ms | 88.17 ms | 99.94 ms | 202.49 ms | 101.45% | 187.67 MiB |
| cpp_grpc_st | 30324 | 32.92 ms | 36.81 ms | 38.00 ms | 40.49 ms | 102.28% | 8.12 MiB |
| java_grpc_g1gc | 29743 | 33.55 ms | 91.88 ms | 106.43 ms | 203.43 ms | 101.17% | 153.16 MiB |
| cpp_grpc_mt | 28856 | 34.60 ms | 38.68 ms | 40.07 ms | 41.98 ms | 102.33% | 8.22 MiB |
| java_grpc_zgc | 28548 | 34.96 ms | 86.26 ms | 105.39 ms | 203.73 ms | 101.25% | 111.86 MiB |
| java_grpc_she | 28451 | 35.07 ms | 101.83 ms | 172.08 ms | 289.23 ms | 101.69% | 371.11 MiB |
| java_grpc_sgc | 24280 | 41.11 ms | 94.41 ms | 112.59 ms | 207.09 ms | 101.45% | 82.57 MiB |
| crystal_grpc | 22490 | 44.37 ms | 52.25 ms | 53.75 ms | 57.64 ms | 115.26% | 24.64 MiB |
| go_grpc | 13476 | 74.05 ms | 111.85 ms | 186.71 ms | 204.89 ms | 101.38% | 34.28 MiB |
| java_micronaut | 12218 | 81.74 ms | 110.67 ms | 187.82 ms | 397.94 ms | 100.24% | 426.74 MiB |
| node_grpc_st | 11582 | 86.20 ms | 97.26 ms | 101.25 ms | 108.99 ms | 100.12% | 49.17 MiB |
| swift_grpc | 11496 | 86.86 ms | 88.71 ms | 89.49 ms | 91.21 ms | 101.8% | 6.23 MiB |
| haskell_mu | 11319 | 88.25 ms | 105.74 ms | 111.29 ms | 126.30 ms | 101.69% | 121.15 MiB |
| dart_grpc | 9537 | 104.75 ms | 19.41 ms | 1.12 s | 1.30 s | 101.77% | 26.87 MiB |
| kotlin_grpc | 8263 | 120.88 ms | 198.02 ms | 288.06 ms | 498.36 ms | 102.14% | 238.75 MiB |
| node_grpcjs_st | 5400 | 184.97 ms | 201.45 ms | 206.30 ms | 220.39 ms | 100.51% | 42.12 MiB |
| csharp_grpc | 5199 | 192.12 ms | 211.89 ms | 219.83 ms | 276.30 ms | 101.9% | 99.35 MiB |
| elixir_grpc | 4358 | 229.19 ms | 260.39 ms | 270.34 ms | 292.04 ms | 101.1% | 79.53 MiB |
| python_grpc | 2184 | 457.06 ms | 485.93 ms | 490.69 ms | 499.12 ms | 101.93% | 33.83 MiB |
| ruby_grpc | 1974 | 505.41 ms | 551.98 ms | 568.07 ms | 633.25 ms | 102.07% | 30.75 MiB |
| php_grpc | 1549 | 644.13 ms | 697.19 ms | 698.73 ms | 701.47 ms | 100.92% | 63.4 MiB |
| scala_akka | 1381 | 438.06 ms | 1.27 s | 1.59 s | 2.60 s | 100.09% | 162.33 MiB |
| java_aot | 1111 | 897.56 ms | 1.55 s | 1.80 s | 2.29 s | 100.87% | 209.1 MiB |
--------------------------------------------------------------------------------------------------------------------------------
2 CPU Server
--------------------------------------------------------------------------------------------------------------------------------
| name | req/s | avg. latency | 90 % in | 95 % in | 99 % in | avg. cpu | avg. memory |
--------------------------------------------------------------------------------------------------------------------------------
| dotnet_grpc | 65677 | 15.11 ms | 21.67 ms | 25.89 ms | 42.95 ms | 200.05% | 132.36 MiB |
| cpp_grpc_mt | 64724 | 15.37 ms | 27.99 ms | 32.52 ms | 38.64 ms | 204.79% | 22.25 MiB |
| java_grpc_pgc | 63075 | 15.75 ms | 62.48 ms | 77.01 ms | 106.26 ms | 203.31% | 196.53 MiB |
| rust_tonic_mt | 59731 | 16.67 ms | 42.54 ms | 75.00 ms | 119.87 ms | 200.9% | 16.25 MiB |
| rust_grpcio | 58300 | 17.06 ms | 22.96 ms | 24.96 ms | 31.05 ms | 202.68% | 41.52 MiB |
| java_grpc_g1gc | 57033 | 17.41 ms | 69.22 ms | 84.24 ms | 119.44 ms | 203.82% | 180.86 MiB |
| java_grpc_she | 52780 | 18.80 ms | 78.27 ms | 93.63 ms | 180.37 ms | 203.7% | 393.13 MiB |
| rust_thruster_mt | 51649 | 19.29 ms | 49.43 ms | 87.63 ms | 143.30 ms | 201.4% | 14.16 MiB |
| java_grpc_zgc | 51474 | 19.27 ms | 60.72 ms | 79.17 ms | 110.06 ms | 202.8% | 116.39 MiB |
| rust_tonic_st | 49574 | 20.11 ms | 23.92 ms | 25.40 ms | 28.06 ms | 101.18% | 13.18 MiB |
| java_grpc_sgc | 49324 | 20.17 ms | 57.72 ms | 78.48 ms | 131.01 ms | 200.47% | 93.66 MiB |
| rust_thruster_st | 41674 | 23.93 ms | 28.16 ms | 29.68 ms | 32.11 ms | 101.56% | 12.12 MiB |
| go_grpc | 38695 | 25.66 ms | 68.03 ms | 74.96 ms | 87.05 ms | 204.04% | 33.38 MiB |
| cpp_grpc_st | 30219 | 33.03 ms | 36.36 ms | 37.55 ms | 39.64 ms | 102.39% | 8.19 MiB |
| crystal_grpc | 22481 | 44.38 ms | 52.35 ms | 54.27 ms | 58.07 ms | 114.7% | 24.57 MiB |
| swift_grpc | 21660 | 46.08 ms | 48.32 ms | 49.06 ms | 50.96 ms | 201.84% | 6.46 MiB |
| kotlin_grpc | 19368 | 51.52 ms | 102.26 ms | 113.38 ms | 214.15 ms | 204.09% | 273.08 MiB |
| csharp_grpc | 18904 | 52.79 ms | 85.25 ms | 90.65 ms | 100.93 ms | 204.73% | 109.46 MiB |
| haskell_mu | 18269 | 54.66 ms | 71.75 ms | 75.82 ms | 84.42 ms | 203.44% | 171.33 MiB |
| java_micronaut | 18057 | 54.75 ms | 88.67 ms | 98.57 ms | 182.88 ms | 177.53% | 481.44 MiB |
| node_grpc_st | 12066 | 82.75 ms | 92.36 ms | 95.99 ms | 101.94 ms | 103.61% | 48.32 MiB |
| dart_grpc | 10351 | 96.51 ms | 16.13 ms | 1.07 s | 1.19 s | 106.98% | 26.68 MiB |
| elixir_grpc | 8298 | 120.39 ms | 140.64 ms | 147.27 ms | 160.95 ms | 203.76% | 82.73 MiB |
| node_grpcjs_st | 7177 | 139.18 ms | 150.26 ms | 153.91 ms | 161.80 ms | 115.98% | 41.33 MiB |
| scala_akka | 4776 | 209.10 ms | 381.94 ms | 495.42 ms | 798.40 ms | 200.29% | 174.23 MiB |
| java_aot | 4688 | 213.02 ms | 438.45 ms | 509.42 ms | 713.40 ms | 174.08% | 264.58 MiB |
| python_grpc | 4058 | 246.11 ms | 275.74 ms | 280.78 ms | 288.40 ms | 150.15% | 33.7 MiB |
| php_grpc | 3922 | 254.66 ms | 289.79 ms | 290.94 ms | 293.23 ms | 205.12% | 65.4 MiB |
| ruby_grpc | 2629 | 379.64 ms | 404.55 ms | 411.17 ms | 429.52 ms | 131.9% | 30.81 MiB |
--------------------------------------------------------------------------------------------------------------------------------
3 CPU Server
--------------------------------------------------------------------------------------------------------------------------------
| name | req/s | avg. latency | 90 % in | 95 % in | 99 % in | avg. cpu | avg. memory |
--------------------------------------------------------------------------------------------------------------------------------
| cpp_grpc_mt | 86641 | 11.25 ms | 19.91 ms | 25.34 ms | 43.66 ms | 263.25% | 39.39 MiB |
| java_grpc_pgc | 85985 | 11.29 ms | 46.48 ms | 61.04 ms | 89.31 ms | 258.97% | 206.06 MiB |
| java_grpc_g1gc | 83142 | 11.71 ms | 52.42 ms | 67.52 ms | 95.02 ms | 273.39% | 192.72 MiB |
| java_grpc_zgc | 82240 | 11.82 ms | 43.12 ms | 62.25 ms | 95.57 ms | 288.41% | 118.79 MiB |
| dotnet_grpc | 80847 | 12.23 ms | 20.01 ms | 24.00 ms | 34.65 ms | 257.9% | 116.52 MiB |
| rust_grpcio | 80541 | 12.05 ms | 20.26 ms | 26.22 ms | 47.39 ms | 269.13% | 38.68 MiB |
| java_grpc_she | 80263 | 12.12 ms | 63.59 ms | 74.34 ms | 99.72 ms | 283.43% | 408.19 MiB |
| rust_tonic_mt | 79969 | 12.27 ms | 23.57 ms | 31.53 ms | 49.77 ms | 278.14% | 15.89 MiB |
| go_grpc | 78745 | 12.51 ms | 23.61 ms | 28.49 ms | 38.21 ms | 307.37% | 32.91 MiB |
| rust_thruster_mt | 70841 | 13.92 ms | 26.71 ms | 36.15 ms | 56.03 ms | 290.39% | 14.2 MiB |
| java_grpc_sgc | 68530 | 14.43 ms | 44.05 ms | 59.98 ms | 94.81 ms | 246.81% | 101.23 MiB |
| rust_tonic_st | 49124 | 20.30 ms | 23.35 ms | 25.70 ms | 28.78 ms | 101.55% | 13.32 MiB |
| rust_thruster_st | 41717 | 23.91 ms | 29.40 ms | 30.58 ms | 33.54 ms | 101.64% | 11.88 MiB |
| java_micronaut | 34514 | 28.53 ms | 68.08 ms | 79.03 ms | 113.44 ms | 249.03% | 490.3 MiB |
| csharp_grpc | 34196 | 29.10 ms | 53.09 ms | 58.59 ms | 68.70 ms | 306.74% | 110.67 MiB |
| kotlin_grpc | 32645 | 30.46 ms | 94.29 ms | 103.71 ms | 185.80 ms | 306.52% | 292.9 MiB |
| swift_grpc | 30365 | 32.86 ms | 35.59 ms | 36.46 ms | 37.97 ms | 302.29% | 6.79 MiB |
| cpp_grpc_st | 30060 | 33.21 ms | 35.54 ms | 36.98 ms | 39.32 ms | 102.41% | 8.56 MiB |
| haskell_mu | 23758 | 42.02 ms | 57.51 ms | 61.93 ms | 69.39 ms | 302.21% | 211.45 MiB |
| crystal_grpc | 22478 | 44.39 ms | 52.29 ms | 53.92 ms | 57.82 ms | 115.67% | 24.62 MiB |
| node_grpc_st | 12405 | 80.48 ms | 87.87 ms | 92.34 ms | 97.80 ms | 103.48% | 46.65 MiB |
| elixir_grpc | 11982 | 83.37 ms | 99.09 ms | 105.03 ms | 118.39 ms | 304.81% | 97.9 MiB |
| dart_grpc | 10220 | 97.75 ms | 17.92 ms | 1.07 s | 1.18 s | 106.64% | 26.57 MiB |
| java_aot | 9107 | 109.66 ms | 260.98 ms | 323.00 ms | 414.14 ms | 242.03% | 259.79 MiB |
| scala_akka | 8532 | 117.06 ms | 218.99 ms | 286.15 ms | 502.96 ms | 290.92% | 172.44 MiB |
| node_grpcjs_st | 7155 | 139.58 ms | 151.06 ms | 154.63 ms | 163.08 ms | 116.26% | 41.98 MiB |
| php_grpc | 6566 | 152.13 ms | 182.15 ms | 183.36 ms | 186.08 ms | 308.6% | 65.1 MiB |
| python_grpc | 4096 | 243.84 ms | 272.72 ms | 276.89 ms | 284.52 ms | 150.26% | 34.13 MiB |
| ruby_grpc | 2614 | 381.94 ms | 405.86 ms | 411.26 ms | 431.37 ms | 132.08% | 30.93 MiB |
--------------------------------------------------------------------------------------------------------------------------------