Skip to content
This repository has been archived by the owner on Feb 25, 2022. It is now read-only.

Add to TechEmpower benchmarks #18

Closed
tomchristie opened this issue Mar 30, 2017 · 7 comments
Closed

Add to TechEmpower benchmarks #18

tomchristie opened this issue Mar 30, 2017 · 7 comments

Comments

@tomchristie
Copy link
Member

See TechEmpower/FrameworkBenchmarks#2633

@ddorian
Copy link

ddorian commented Apr 6, 2017

Can you also include wheezy.web in your benchmark on the readme, please?

@tomchristie
Copy link
Member Author

Yeah, tho I'd need to re-run from scratch to make the comparison fair.
Also I must include the wrk command this time.

This should do:

 wrk -t 10 -c 100 -d 10 http://localhost:5000/

We'll probably change the section in favor of whatever TechEmpower publish if and when that becomes possible.

@tomchristie
Copy link
Member Author

Very positive...

"API Star was already merged in, so it'll be in the Round 14 final"

It wasn't merged in time for us to be in any of the preliminary testing that they run prior to running the final round, so we can't see if they're getting similar results to my testing, or be able to fix any issues that crop up, so just have to cross fingers that all is setup smoothly.

We'll plan to expand the test cases in adequate time for round 15.

Will update the docs once they publish the final round, and close this off. (Should also be able to include wheezy.web then as per @ddorian's suggestion, or simply point to the TechEmpower site)

@ddorian
Copy link

ddorian commented Apr 14, 2017

@tomchristie I only asked for wheezy to be included cause it's been fastest in ~all benchmarks that I've seen it.

@tomchristie
Copy link
Member Author

Might also be useful in the future: http://klen.github.io/py-frameworks-bench/

(The remote request case is particular interesting for comparison of async vs sync frameworks)

@tomchristie
Copy link
Member Author

Round 14 preliminary results. 👍

I've filtered to only JS, Py, Go, and Rby results here...

screen shot 2017-04-20 at 08 59 06

@tomchristie
Copy link
Member Author

Round 14 has now been released. Added to the docs

---> https://github.com/tomchristie/apistar#performance

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants