Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: provide benchmarks #41

Open
iapicca opened this issue May 25, 2022 · 4 comments
Open

docs: provide benchmarks #41

iapicca opened this issue May 25, 2022 · 4 comments
Labels
documentation Improvements or additions to documentation feature A new feature or request

Comments

@iapicca
Copy link

iapicca commented May 25, 2022

As for the title,
it would be nice to have some benchmark as reference
possibly via FrameworkBenchmarks [site]

@felangel felangel changed the title [feature request?] Provide benchmarks (possibly via TechEmpower's FrameworkBenchmarks) perf: provide benchmarks May 25, 2022
@felangel felangel added feature A new feature or request documentation Improvements or additions to documentation labels May 25, 2022
@felangel felangel changed the title perf: provide benchmarks docs: provide benchmarks May 25, 2022
@felangel
Copy link
Contributor

Hey @iapicca 👋

Thanks for opening an issue!

We can try to gather some benchmarks in the near future but in the meantime I'm fairly confident that Dart Frog's benchmarks will be quite comparable to shelf since it's built on top of the existing shelf package.

@iapicca
Copy link
Author

iapicca commented May 26, 2022

@felangel
I think at the moment the most relevant benchmark submitted is a pure dart,
but seems to be incomplete (no fortunes, no postgres...!!!)
shelf is "missing" from dart benchmarks, but on the other hand isn't really a framework

anyway the date for round 21 is in 5 days so maybe this could be more doable for 2023

@felangel
Copy link
Contributor

Benchmark from Apache Benchmark on my 2019 MacBook Pro (from #58)

  Model Name:	MacBook Pro
  Model Identifier:	MacBookPro16,1
  Processor Name:	8-Core Intel Core i9
  Processor Speed:	2.3 GHz
  Number of Processors:	1
  Total Number of Cores:	8
  L2 Cache (per Core):	256 KB
  L3 Cache:	16 MB
  Hyper-Threading Technology:	Enabled
  Memory:	16 GB
$ ab -n 20000 -c 10 http://127.0.0.1:8080/   
This is ApacheBench, Version 2.3 <$Revision: 1879490 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking 127.0.0.1 (be patient)
Completed 2000 requests
Completed 4000 requests
Completed 6000 requests
Completed 8000 requests
Completed 10000 requests
Completed 12000 requests
Completed 14000 requests
Completed 16000 requests
Completed 18000 requests
Completed 20000 requests
Finished 20000 requests


Server Software:        dart:io
Server Hostname:        127.0.0.1
Server Port:            8080

Document Path:          /
Document Length:        21 bytes

Concurrency Level:      10
Time taken for tests:   5.592 seconds
Complete requests:      20000
Failed requests:        0
Total transferred:      5220000 bytes
HTML transferred:       420000 bytes
Requests per second:    3576.53 [#/sec] (mean)
Time per request:       2.796 [ms] (mean)
Time per request:       0.280 [ms] (mean, across all concurrent requests)
Transfer rate:          911.60 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.0      0       1
Processing:     0    3  62.2      1    2762
Waiting:        0    3  59.0      1    2762
Total:          1    3  62.2      1    2762

Percentage of the requests served within a certain time (ms)
  50%      1
  66%      1
  75%      1
  80%      1
  90%      1
  95%      2
  98%      2
  99%      3
 100%   2762 (longest request)

@felangel felangel self-assigned this May 27, 2022
@felangel felangel mentioned this issue May 27, 2022
@iapicca
Copy link
Author

iapicca commented Jul 20, 2022

@felangel
given this comment from FrameworkBenchmarks about Round 22

[...] We'd like to have a quicker turnaround for Round 22. We're hoping between Oct - Nov.

do you think will be possible to participate?
I'd be happy to help if required

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation feature A new feature or request
Projects
Status: Backlog
Development

No branches or pull requests

2 participants