We have a number of tools for running queries today that we can use when benchmarking and profiling.
-
We can create tests in google test but then it is often difficult to pass in extra arguments like switching between queries and dynamically changing the number of iterations.
-
We can simply create a quick executable but there is some project creation overhead and queries end up being hard-coded to something rather specific.
-
We can use arrowbench but that adds an R dependency which is a burden for C++ testers that don't work with R much and it also adds some R overhead or complications for debugging.
This JIRA proposes we create a new query testing tool, inspired by arrowbench, but written in C++, which will initially allow us to run builtin TPC-H queries against the TPC-H data generator but will eventually allow for downloading datasets from remote sources, running custom queries via SQL or Substrait, etc.
Reporter: Weston Pace / @westonpace
PRs and other links:
Note: This issue was originally created as ARROW-15877. Please see the migration documentation for further details.
We have a number of tools for running queries today that we can use when benchmarking and profiling.
We can create tests in google test but then it is often difficult to pass in extra arguments like switching between queries and dynamically changing the number of iterations.
We can simply create a quick executable but there is some project creation overhead and queries end up being hard-coded to something rather specific.
We can use arrowbench but that adds an R dependency which is a burden for C++ testers that don't work with R much and it also adds some R overhead or complications for debugging.
This JIRA proposes we create a new query testing tool, inspired by arrowbench, but written in C++, which will initially allow us to run builtin TPC-H queries against the TPC-H data generator but will eventually allow for downloading datasets from remote sources, running custom queries via SQL or Substrait, etc.
Reporter: Weston Pace / @westonpace
PRs and other links:
Note: This issue was originally created as ARROW-15877. Please see the migration documentation for further details.