Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmarks pages blank #78

Closed
Alex-Monahan opened this issue Oct 12, 2021 · 4 comments
Closed

Benchmarks pages blank #78

Alex-Monahan opened this issue Oct 12, 2021 · 4 comments
Labels
enhancement New feature or request performance benchmarking and performance

Comments

@Alex-Monahan
Copy link
Collaborator

The benchmark pages are showing as blank for me. I am getting a 503 (Service Temporarily Unavailable) from the duckdbdemo.project.cwi.nl calls.

@Mytherin
Copy link
Collaborator

Thanks for the report!

In general I think we should probably rethink the continuous benchmarking pages - the benchmarks haven't been running for some time, and their purpose has been largely superseded by the regression tests integrated in the CI.

Perhaps we should replace the continuous benchmarking with a page that has benchmarks e.g. per release, as a bigger benchmark run that we only run once per month instead?

@Alex-Monahan
Copy link
Collaborator Author

I think that would be great! We may want to just add a release date in addition to the release number so the charts can still be plotted on a time axis (to show how fast DuckDB is speeding up!).

@crazyboycjr
Copy link

Hi, where could we find the latest benchmark results or the past results? I saw the continuous benchmark page several years ago and it was amazing!

@Mytherin
Copy link
Collaborator

We have moved away from the benchmark pages to regression tests running in the CI, see e.g. here. There are plans to do per-release benchmarks for the benchmark pages with comparisons to other systems but these have not materialized yet.

@szarnyasg szarnyasg added enhancement New feature or request performance benchmarking and performance labels Aug 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request performance benchmarking and performance
Projects
None yet
Development

No branches or pull requests

4 participants