Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[backend-comparison] Upload benchmarks results to server #1381

Merged
merged 1 commit into from
Mar 2, 2024

Conversation

syl20bnr
Copy link
Member

@syl20bnr syl20bnr commented Feb 28, 2024

Pull Request Template

Checklist

  • Confirmed that run-checks all script has been executed.
  • Made sure the book is up to date with changes in this PR.

Related Issues/PRs

#1072

Changes

Uploading is enabled with already implemented --share argument of the burnbench command line tool.

The burnbench binary passes the URL of the server and the auth token to the cargo bench process using the additional arguments --sharing-url and --sharing-token respectively.

The persistence module then upload the results when a --sharing-url is provided.

The URL is for now hardcoded. The endpoint is production when compiling in release mode and it is localhost otherwise.

Tests

cargo run --bin burnbench --release -- auth
cargo run --bin burnbench --release -- run --benches unary --backends ndarray --share

@syl20bnr syl20bnr force-pushed the feature/benchmark-results-uploading branch from 9e6c65c to f2416e5 Compare February 28, 2024 21:30
@syl20bnr syl20bnr changed the title [backend-comparison] Upload benchmarks to server [backend-comparison] Upload benchmarks results to server Feb 28, 2024
@syl20bnr syl20bnr force-pushed the feature/benchmark-results-uploading branch 7 times, most recently from 77b341a to a1e3c9c Compare February 28, 2024 22:23
Uploading is enabled with already implemented --share argument
of the burnbench command line tool.

The burnbench binary passes the URL of the server and the auth
token to the cargo bench process using the additional arguments
--sharing-url and --sharing-token respectively.

The persistence module then upload the results when a --sharing-url
is provided.

The URL is for now hardcoded. The endpoint is production when
compiling in release mode and it is localhost otherwise.
@syl20bnr syl20bnr force-pushed the feature/benchmark-results-uploading branch from a1e3c9c to 403a635 Compare February 28, 2024 22:25
Copy link

codecov bot commented Feb 28, 2024

Codecov Report

Attention: Patch coverage is 19.58763% with 78 lines in your changes are missing coverage. Please review.

Project coverage is 85.48%. Comparing base (57887e7) to head (403a635).
Report is 2 commits behind head on main.

Files Patch % Lines
backend-comparison/src/burnbenchapp/base.rs 0.00% 40 Missing ⚠️
backend-comparison/src/persistence/base.rs 0.00% 31 Missing ⚠️
backend-comparison/src/burnbenchapp/term/base.rs 0.00% 7 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1381      +/-   ##
==========================================
+ Coverage   85.34%   85.48%   +0.14%     
==========================================
  Files         591      594       +3     
  Lines       67497    68042     +545     
==========================================
+ Hits        57604    58168     +564     
+ Misses       9893     9874      -19     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

"http://localhost:8000/benchmarks"
} else {
// production
"https://user-benchmark-server-gvtbw64teq-nn.a.run.app/benchmarks"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess this URL will change right?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It will not change as long as we keep the same service in Cloud Run.
Anyway this is temporary we will change this to use our domain at some point.

@syl20bnr syl20bnr merged commit 1117757 into main Mar 2, 2024
14 of 15 checks passed
@syl20bnr syl20bnr deleted the feature/benchmark-results-uploading branch March 2, 2024 16:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants