Implement a benchmark suite

[rafalp]

It would be great if Ariadne implemented benchmark suite that would measure query execution times for following scenarios:

• Simple query returning one item
• Simple query returning list of 500 items
• Complex query returning one item
• Complex query returning list of 500 items

We could then easily add extra performance tests to Ariadne by running those tests with different features enabled or disabled.

I'm not expecting that many test cases for start, so we could begin with benchmark.py script in main repo with CLI interface that setups example GraphQL app, runs GraphQL query against given ASGI server (this is easy to do with HTTPX) few hundred times, then displays min/max/avg times for query. We could also explore adding WSGI server to the benchmarks.

[nilansaha]

@rafalp What do you mean by a complex query ? Are you just talking about a few levels deep nested queries with a more than one entity maybe ?

[rafalp]

@nilansaha yup, thats what I mean here. Preferably one that goes three or four levels deep.

But hold your horses here, we would like to handle this one on our side.

[nilansaha]

@rafalp Okay sounds good. Probably not the best place to write but can you guys look at including this with the 0.14 version itself ? It's a relatively small change. Once that is merged in we might also be very keen to do this on our side and try to get that approved. I didn't see any release date for 0.14 so speaking from that context. Obviously this probably does not make sense if 0.14 is going to come out real soon.