13 setup benchviper to create tests for astroviper#15
Conversation
| # benchviper organizes each external project in its own subdir | ||
| cd astroviper | ||
| asv machine --machine gh-runner --yes | ||
| asv run "--merges v0.0.30..main" --machine gh-runner --parallel --interleave-rounds --skip-existing |
There was a problem hiding this comment.
Should check if 0.0.30 is the correct starting version
There was a problem hiding this comment.
We can leave it at 0.0.30 for now as I don't know either which would be the best version. It will probably depend on which tests we will write first. I need to talk to the dev team about this.
There was a problem hiding this comment.
Sample File to store as a placeholder until other tests are written
| // Customizable commands for installing and uninstalling the project. | ||
| // See asv.conf.json documentation. | ||
| //"install_command": ["in-dir={env_dir} python -m pip install {build_dir}/dist/*.whl"], | ||
| "install_command": ["in-dir={env_dir} python -m pip install {wheel_file}[all]"], |
There was a problem hiding this comment.
Check If installing all is correct option
There was a problem hiding this comment.
it is the correct option.
| "build_command": [ | ||
| "python -m pip install build", | ||
| "python -m build --wheel", | ||
| "python -m pip install scikit_build_core pybind11", |
There was a problem hiding this comment.
scikit_build_core and pybind11 need to be installed as prerequisites before building from pyproject toml, so this line possible can be moved to a more appropriate place
There was a problem hiding this comment.
We only need these lines:
`python -m pip install build",
"python -m build --wheel",
"python -m pip wheel --no-deps -w {build_cache_dir} {build_dir}"
| Benchmark that times various operations, including custom summation of | ||
| lists. | ||
| """ | ||
|
|
There was a problem hiding this comment.
It is not important for this mock example, but it is important for the real benchmark tests. We need to add a line giving the version of the tests, basically matching the 0.0.30 of the asv run command. This is so that the tests do not use a unique hash for every run. This will allow us to update the tests if we need due to expected changes to the astroviper code. The line to add is:
version = "astroviper 0.0.30"
| "build_command": [ | ||
| "python -m pip install build", | ||
| "python -m build --wheel", | ||
| "python -m pip install scikit_build_core pybind11", |
There was a problem hiding this comment.
We only need these lines:
`python -m pip install build",
"python -m build --wheel",
"python -m pip wheel --no-deps -w {build_cache_dir} {build_dir}"
2 participants
No description provided.