[Python] Simple script for running all current ASV benchmarks at a commit or tag

[asfimport]

The objective of this is to be able to get a graph for performance at each release tag for the currently-defined benchmarks (including benchmarks that did not exist in older tags)

Reporter: Wes McKinney / @wesm
Assignee: Antoine Pitrou / @pitrou

Related issues:

• [Python] ASV benchmark setup does not account for C++ library changing (is superceded by)

_{Note: This issue was originally created as ARROW-2241. Please see the migration documentation for further details.}

[asfimport]

Uwe Korn / @xhochy:
Isn't this what asv run is for?

[asfimport]

Wes McKinney / @wesm:
asv run does not build the C++ dependencies

[asfimport]

Uwe Korn / @xhochy:
Ah, got it!

[asfimport]

Antoine Pitrou / @pitrou:
In ARROW-2182 we made it so ASV is able to build the C++ Arrow libs for each changeset. Since parquet-cpp is in another repository, though, it's not handled through that mechanism.