Skip to content

Commit

Permalink
Jitter graphs
Browse files Browse the repository at this point in the history
  • Loading branch information
felixge committed Sep 26, 2012
1 parent 86685bd commit f4bb49f
Show file tree
Hide file tree
Showing 3 changed files with 11 additions and 4 deletions.
15 changes: 11 additions & 4 deletions README.md
Expand Up @@ -66,8 +66,8 @@ raw data, and that's a problem.
I'll show you why. Here is a graph comparing my current node-mysql parser
with another experimental version:

<a href="https://github.com/felixge/faster-than-c/raw/master/figures/mysql2-vs-poc-bar.pdf">
<img src="https://github.com/felixge/faster-than-c/raw/master/figures/mysql2-vs-poc-bar.png">
<a href="./faster-than-c/raw/master/figures/mysql2-vs-poc-bar.pdf">
<img src="./faster-than-c/raw/master/figures/mysql2-vs-poc-bar.png">
</a>

Great! It looks like my new parser is 2x as fast as the current one. But
Expand All @@ -76,8 +76,15 @@ will see. It's the usual, here look, A is better than B, so you should use that.
But it's completely lacking the raw data and any analysis whatsoever.

If this kind of results is all your benchmarking library can do, you should
throw it away. Because if it was producing the raw data set, you could look
at it:
throw it away. Because if it was producing the raw data set, it could be
analysed much further:

* [mysql2.tsv](./faster-than-c/raw/master/figures/mysql2.tsv)
* [poc.tsv](./faster-than-c/raw/master/figures/poc.tsv)

For example, when plotting the same data on a jitter graph, it would look
like this:

<a href="./faster-than-c/raw/master/figures/mysql2-vs-poc-jitter.pdf">
<img src="./faster-than-c/raw/master/figures/mysql2-vs-poc-jitter.png">
</a>
Binary file added figures/mysql2-vs-poc-jitter.pdf
Binary file not shown.
Binary file added figures/mysql2-vs-poc-jitter.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit f4bb49f

Please sign in to comment.