Skip to content

Commit

Permalink
rerun benchmarks
Browse files Browse the repository at this point in the history
  • Loading branch information
icebob committed Feb 27, 2018
1 parent ff6db64 commit e1eb947
Show file tree
Hide file tree
Showing 7 changed files with 183 additions and 283 deletions.
20 changes: 10 additions & 10 deletions benchmark/suites/cachers.js
Expand Up @@ -57,24 +57,24 @@ benchmark.run([bench1, bench2]).then(() => {
Platform info:
==============
Windows_NT 6.1.7601 x64
Node.JS: 6.11.4
V8: 5.1.281.108
Node.JS: 8.9.4
V8: 6.1.534.50
Intel(R) Core(TM) i7-4770K CPU @ 3.50GHz × 8
Suite: Set & get 1k data with cacher
√ Memory* 1,434,441 rps
√ Redis* 11,464 rps
√ Memory* 2,066,824 rps
√ Redis* 10,915 rps
Memory* 0% (1,434,441 rps) (avg: 697ns)
Redis* -99.2% (11,464 rps) (avg: 87μs)
Memory* 0% (2,066,824 rps) (avg: 483ns)
Redis* -99.47% (10,915 rps) (avg: 91μs)
-----------------------------------------------------------------------
Suite: Test getCacheKey
√ Dynamic 535,623 rps
√ Static 4,159,573 rps
√ Dynamic 679,228 rps
√ Static 5,981,643 rps
Dynamic -87.12% (535,623 rps) (avg: 1μs)
Static 0% (4,159,573 rps) (avg: 240ns)
Dynamic -88.64% (679,228 rps) (avg: 1μs)
Static 0% (5,981,643 rps) (avg: 167ns)
-----------------------------------------------------------------------
Expand Down
70 changes: 35 additions & 35 deletions benchmark/suites/call.js
Expand Up @@ -161,58 +161,58 @@ benchmark.run([bench1, bench2, bench3, bench4, bench5]);
Platform info:
==============
Windows_NT 6.1.7601 x64
Node.JS: 6.10.0
V8: 5.1.281.93
Node.JS: 8.9.4
V8: 6.1.534.50
Intel(R) Core(TM) i7-4770K CPU @ 3.50GHz × 8
Suite: Call methods
√ broker.call (normal)* 1,239,453 rps
√ broker.call (with params)* 1,181,153 rps
√ broker.call (normal)* 1,738,486 rps
√ broker.call (with params)* 1,807,759 rps
broker.call (normal)* (#) 0% (1,239,453 rps) (avg: 806ns)
broker.call (with params)* -4.7% (1,181,153 rps) (avg: 846ns)
broker.call (normal)* (#) 0% (1,738,486 rps) (avg: 575ns)
broker.call (with params)* +3.98% (1,807,759 rps) (avg: 553ns)
-----------------------------------------------------------------------
Suite: Call with middlewares
√ Call without middlewares* 1,200,847 rps
√ Call with 1 middleware* 1,195,808 rps
√ Call with 5 middlewares* 1,195,328 rps
√ Call without middlewares* 1,716,913 rps
√ Call with 1 middleware* 1,662,845 rps
√ Call with 5 middlewares* 1,666,777 rps
Call without middlewares* (#) 0% (1,200,847 rps) (avg: 832ns)
Call with 1 middleware* -0.42% (1,195,808 rps) (avg: 836ns)
Call with 5 middlewares* -0.46% (1,195,328 rps) (avg: 836ns)
Call without middlewares* (#) 0% (1,716,913 rps) (avg: 582ns)
Call with 1 middleware* -3.15% (1,662,845 rps) (avg: 601ns)
Call with 5 middlewares* -2.92% (1,666,777 rps) (avg: 599ns)
-----------------------------------------------------------------------
Suite: Call with cachers
√ No cacher* 1,054,783 rps
√ Built-in cacher* 226,415 rps
√ Built-in cacher (keys filter)* 794,494 rps
No cacher* (#) 0% (1,054,783 rps) (avg: 948ns)
Built-in cacher* -78.53% (226,415 rps) (avg: 4μs)
Built-in cacher (keys filter)* -24.68% (794,494 rps) (avg: 1μs)
√ No cacher* 1,344,920 rps
√ Built-in cacher* 315,524 rps
√ Built-in cacher (keys filter)* 964,395 rps
√ With statistics* 811,574 rps
No cacher* (#) 0% (1,344,920 rps) (avg: 743ns)
Built-in cacher* -76.54% (315,524 rps) (avg: 3μs)
Built-in cacher (keys filter)* -28.29% (964,395 rps) (avg: 1μs)
With statistics* -39.66% (811,574 rps) (avg: 1μs)
-----------------------------------------------------------------------
Suite: Call with param validator
√ No validator* 975,769 rps
√ With validator passes* 858,968 rps
√ With validator fail* 56,250 rps
√ No validator* 1,055,690 rps
√ With validator passes* 1,082,886 rps
√ With validator fail* 6,994 rps
No validator* (#) 0% (975,769 rps) (avg: 1μs)
With validator passes* -11.97% (858,968 rps) (avg: 1μs)
With validator fail* -94.24% (56,250 rps) (avg: 17μs)
No validator* (#) 0% (1,055,690 rps) (avg: 947ns)
With validator passes* +2.58% (1,082,886 rps) (avg: 923ns)
With validator fail* -99.34% (6,994 rps) (avg: 142μs)
-----------------------------------------------------------------------
Suite: Call with statistics & metrics
√ No statistics* 1,170,614 rps
√ With metrics* 337,038 rps
√ With statistics* 1,190,222 rps
√ With metrics & statistics* 306,707 rps
No statistics* (#) 0% (1,170,614 rps) (avg: 854ns)
With metrics* -71.21% (337,038 rps) (avg: 2μs)
With statistics* +1.68% (1,190,222 rps) (avg: 840ns)
With metrics & statistics* -73.8% (306,707 rps) (avg: 3μs)
√ No statistics* 1,311,912 rps
√ With metrics* 453,033 rps
√ With metrics & statistics* 396,287 rps
No statistics* (#) 0% (1,311,912 rps) (avg: 762ns)
With metrics* -65.47% (453,033 rps) (avg: 2μs)
With metrics & statistics* -69.79% (396,287 rps) (avg: 2μs)
-----------------------------------------------------------------------
*/
*/
42 changes: 21 additions & 21 deletions benchmark/suites/common.js
Expand Up @@ -136,42 +136,42 @@ module.exports = benchmark.run([bench1, bench2, bench3, bench4]);
Platform info:
==============
Windows_NT 6.1.7601 x64
Node.JS: 6.10.0
V8: 5.1.281.93
Node.JS: 8.9.4
V8: 6.1.534.50
Intel(R) Core(TM) i7-4770K CPU @ 3.50GHz × 8
Suite: Local call
√ broker.call (normal)* 1,329,946 rps
√ broker.call (with params)* 1,242,043 rps
√ broker.call (normal)* 1,654,091 rps
√ broker.call (with params)* 1,846,689 rps
broker.call (normal)* (#) 0% (1,329,946 rps) (avg: 751ns)
broker.call (with params)* -6.61% (1,242,043 rps) (avg: 805ns)
broker.call (normal)* (#) 0% (1,654,091 rps) (avg: 604ns)
broker.call (with params)* +11.64% (1,846,689 rps) (avg: 541ns)
-----------------------------------------------------------------------
Suite: Call with middlewares
√ No middlewares* 1,212,999 rps
√ 5 middlewares* 1,234,193 rps
√ No middlewares* 1,660,456 rps
√ 5 middlewares* 1,588,124 rps
No middlewares* (#) 0% (1,212,999 rps) (avg: 824ns)
5 middlewares* +1.75% (1,234,193 rps) (avg: 810ns)
No middlewares* (#) 0% (1,660,456 rps) (avg: 602ns)
5 middlewares* -4.36% (1,588,124 rps) (avg: 629ns)
-----------------------------------------------------------------------
Suite: Call with statistics & metrics
√ No statistics* 1,234,234 rps
√ With metrics* 384,631 rps
√ With statistics* 549,852 rps
√ With metrics & statistics* 272,172 rps
No statistics* (#) 0% (1,234,234 rps) (avg: 810ns)
With metrics* -68.84% (384,631 rps) (avg: 2μs)
With statistics* -55.45% (549,852 rps) (avg: 1μs)
With metrics & statistics* -77.95% (272,172 rps) (avg: 3μs)
√ No statistics* 1,616,265 rps
√ With metrics* 549,124 rps
√ With statistics* 768,617 rps
√ With metrics & statistics* 408,013 rps
No statistics* (#) 0% (1,616,265 rps) (avg: 618ns)
With metrics* -66.03% (549,124 rps) (avg: 1μs)
With statistics* -52.44% (768,617 rps) (avg: 1μs)
With metrics & statistics* -74.76% (408,013 rps) (avg: 2μs)
-----------------------------------------------------------------------
Suite: Remote call with FakeTransporter
√ Remote call echo.reply* 44,055 rps
√ Remote call echo.reply* 45,987 rps
Remote call echo.reply* 0% (44,055 rps) (avg: 22μs)
Remote call echo.reply* 0% (45,987 rps) (avg: 21μs)
-----------------------------------------------------------------------
*/
30 changes: 15 additions & 15 deletions benchmark/suites/events.js
Expand Up @@ -127,24 +127,24 @@ bench.run();
Platform info:
==============
Windows_NT 6.1.7601 x64
Node.JS: 6.10.0
V8: 5.1.281.93
Node.JS: 8.9.4
V8: 6.1.534.50
Intel(R) Core(TM) i7-4770K CPU @ 3.50GHz × 8
Suite: Emit event
√ Emit event without subscribers 2,161,567 rps
√ Emit simple event to 1 subscribers 1,785,380 rps
√ Emit simple event to 20 subscribers 1,076,511 rps
√ Emit wildcard event to 20 subscribers 977,945 rps
√ Emit multi-wildcard event to 20 subscribers without params 894,379 rps
√ Emit multi-wildcard event to 20 subscribers with params 880,544 rps
Emit event without subscribers (#) 0% (2,161,567 rps) (avg: 462ns)
Emit simple event to 1 subscribers -17.4% (1,785,380 rps) (avg: 560ns)
Emit simple event to 20 subscribers -50.2% (1,076,511 rps) (avg: 928ns)
Emit wildcard event to 20 subscribers -54.76% (977,945 rps) (avg: 1μs)
Emit multi-wildcard event to 20 subscribers without params -58.62% (894,379 rps) (avg: 1μs)
Emit multi-wildcard event to 20 subscribers with params -59.26% (880,544 rps) (avg: 1μs)
√ Emit event without subscribers 7,450,694 rps
√ Emit simple event to 1 subscribers 663,669 rps
√ Emit simple event to 20 subscribers 41,231 rps
√ Emit wildcard event to 20 subscribers 30,902 rps
√ Emit multi-wildcard event to 20 subscribers without params 30,608 rps
√ Emit multi-wildcard event to 20 subscribers with params 30,355 rps
Emit event without subscribers (#) 0% (7,450,694 rps) (avg: 134ns)
Emit simple event to 1 subscribers -91.09% (663,669 rps) (avg: 1μs)
Emit simple event to 20 subscribers -99.45% (41,231 rps) (avg: 24μs)
Emit wildcard event to 20 subscribers -99.59% (30,902 rps) (avg: 32μs)
Emit multi-wildcard event to 20 subscribers without params -99.59% (30,608 rps) (avg: 32μs)
Emit multi-wildcard event to 20 subscribers with params -99.59% (30,355 rps) (avg: 32μs)
-----------------------------------------------------------------------
*/
18 changes: 9 additions & 9 deletions benchmark/suites/middlewares.js
Expand Up @@ -61,19 +61,19 @@ bench.run();
Platform info:
==============
Windows_NT 6.1.7601 x64
Node.JS: 6.10.0
V8: 5.1.281.93
Node.JS: 8.9.4
V8: 6.1.534.50
Intel(R) Core(TM) i7-4770K CPU @ 3.50GHz × 8
Suite: Middleware test
√ Without middlewares* 1,368,899 rps
√ With 1 middlewares* 1,007,793 rps
√ With 10 middlewares* 1,343,916 rps
√ Without middlewares* 1,725,594 rps
√ With 1 middlewares* 1,395,079 rps
√ With 10 middlewares* 1,841,953 rps
Without middlewares* (#) 0% (1,368,899 rps) (avg: 730ns)
With 1 middlewares* -26.38% (1,007,793 rps) (avg: 992ns)
With 10 middlewares* -1.83% (1,343,916 rps) (avg: 744ns)
Without middlewares* (#) 0% (1,725,594 rps) (avg: 579ns)
With 1 middlewares* -19.15% (1,395,079 rps) (avg: 716ns)
With 10 middlewares* +6.74% (1,841,953 rps) (avg: 542ns)
-----------------------------------------------------------------------
*/
*/

0 comments on commit e1eb947

Please sign in to comment.