Skip to content

2020 08 03 bench results

LesnyRumcajs edited this page Aug 3, 2020 · 2 revisions

Benchmarked on: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz, 32G RAM

Benchmark duration per suite: 120s

1 CPU Server

----------------------------------------------------------------------------
| name               |   req/s |   avg. latency | avg. cpu |   avg. memory |
----------------------------------------------------------------------------
| rust_tonic_st      |   47981 |        0.99 ms |  100.99% |       4.9 MiB |
| rust_tonic_mt      |   33699 |        1.43 ms |  101.66% |      4.82 MiB |
| cpp_grpc_st        |   28369 |        1.72 ms |  102.27% |      3.33 MiB |
| dotnet_grpc        |   22384 |        2.16 ms |   101.2% |     71.82 MiB |
| lua_grpc_st        |   18680 |        2.63 ms |  101.76% |      9.36 MiB |
| node_grpc_st       |   12015 |        4.07 ms |   99.34% |     42.86 MiB |
| java_grpc          |   11852 |        4.15 ms |  101.89% |    236.19 MiB |
| go_grpc            |   11688 |        4.20 ms |  101.37% |     13.71 MiB |
| java_micronaut     |   11058 |        4.45 ms |  102.17% |    296.41 MiB |
| cpp_grpc_mt        |   10745 |        4.58 ms |  101.76% |      8.94 MiB |
| rust_thruster      |    7228 |        6.85 ms |   35.05% |      1.71 MiB |
| node_grpcjs_st     |    7102 |        6.94 ms |  101.13% |     61.58 MiB |
| kotlin_grpc        |    7007 |        7.06 ms |  102.21% |    211.31 MiB |
| dart_grpc          |    6666 |        7.44 ms |  102.36% |     29.47 MiB |
| csharp_grpc        |    5600 |        8.85 ms |  101.71% |     71.89 MiB |
| swift_grpc_st      |    4640 |       10.68 ms |  101.31% |       3.9 MiB |
| java_aot           |    3398 |       14.62 ms |   102.1% |    324.05 MiB |
| ruby_grpc          |    1984 |       25.10 ms |  102.13% |     17.46 MiB |
| php_grpc           |    1979 |       25.18 ms |  101.38% |     38.96 MiB |
| crystal_grpc       |    1914 |       26.01 ms |   15.33% |       6.0 MiB |
| elixir_grpc        |    1335 |       37.32 ms |  101.03% |     73.91 MiB |
| python_grpc        |    1254 |       39.77 ms |   102.0% |     18.89 MiB |
| scala_akka         |     759 |       65.70 ms |  101.07% |    257.45 MiB |
----------------------------------------------------------------------------

3 CPU Server (it's the best we could do with our resources, still it was not enough to properly stress all implementations)

----------------------------------------------------------------------------
| name               |   req/s |   avg. latency | avg. cpu |   avg. memory |
----------------------------------------------------------------------------
| rust_tonic_mt      |   50655 |        0.94 ms |  270.35% |      5.36 MiB |
| cpp_grpc_mt        |   48987 |        0.97 ms |  297.47% |      8.75 MiB |
| dotnet_grpc        |   48377 |        0.98 ms |  278.85% |     99.34 MiB |
| rust_tonic_st      |   48218 |        0.98 ms |  100.98% |      4.35 MiB |
| go_grpc            |   47621 |        0.99 ms |  307.83% |      13.6 MiB |
| java_grpc          |   33617 |        1.43 ms |   307.8% |    212.91 MiB |
| java_micronaut     |   33284 |        1.44 ms |  308.27% |     666.7 MiB |
| cpp_grpc_st        |   28085 |        1.73 ms |  102.46% |      3.29 MiB |
| csharp_grpc        |   27306 |        1.77 ms |  307.77% |     75.86 MiB |
| kotlin_grpc        |   23885 |        2.03 ms |  305.68% |    202.18 MiB |
| lua_grpc_st        |   18815 |        2.61 ms |  101.86% |     13.63 MiB |
| java_aot           |   14390 |        3.40 ms |  306.22% |    336.24 MiB |
| node_grpc_st       |   11960 |        4.09 ms |   102.8% |     43.14 MiB |
| node_grpcjs_st     |    9264 |        5.31 ms |  118.37% |     62.65 MiB |
| dart_grpc          |    8046 |        6.16 ms |  110.45% |     29.92 MiB |
| php_grpc           |    7951 |        6.22 ms |   310.5% |     38.36 MiB |
| scala_akka         |    7020 |        7.05 ms |   306.1% |    442.39 MiB |
| rust_thruster      |    6656 |        7.44 ms |    74.5% |       2.1 MiB |
| elixir_grpc        |    5736 |        8.64 ms |  305.17% |     77.28 MiB |
| swift_grpc_st      |    4602 |       10.77 ms |  101.64% |      3.79 MiB |
| ruby_grpc          |    2676 |       18.59 ms |  135.66% |     17.74 MiB |
| crystal_grpc       |    1917 |       25.97 ms |   14.78% |      6.14 MiB |
| python_grpc        |    1868 |       26.66 ms |  147.97% |     18.77 MiB |
----------------------------------------------------------------------------