Skip to content

Benchmark Script #173

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 11 commits into
base: main
Choose a base branch
from

Conversation

raneamri
Copy link
Contributor

Description

Adds the benchmarking script and files. Sister PR to #168.

@raneamri
Copy link
Contributor Author

I can confirm through my fork that pointing to this branch as the 'main' branch yields correct behaviour. The benchmarks run and the comment is posted (this part is already merged).

@raneamri raneamri mentioned this pull request May 13, 2025
@coveralls
Copy link
Collaborator

coveralls commented May 13, 2025

Pull Request Test Coverage Report for Build 15045083592

Details

  • 0 of 0 changed or added relevant lines in 0 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage remained the same at 98.966%

Totals Coverage Status
Change from base Build 14982337424: 0.0%
Covered Lines: 2775
Relevant Lines: 2804

💛 - Coveralls

Copy link

github-actions bot commented May 13, 2025

Test Results

     99 files  ±0       99 suites  ±0   1h 59m 51s ⏱️ + 6m 1s
  1 464 tests ±0    1 464 ✅ ±0  0 💤 ±0  0 ❌ ±0 
132 436 runs  ±0  132 436 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 418790a. ± Comparison against base commit b052049.

♻️ This comment has been updated with latest results.

cmake_policy(SET CMP0092 NEW)
project(xad_benchmarks LANGUAGES CXX)

set(CMAKE_CXX_STANDARD 17) # TEMPORARY
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why temporary? Is this needed strictly?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I had this temporarily for my local build. It has been safely removed.

Comment on lines 30 to 32
#ifdef _WIN32
#define _USE_MATH_DEFINES
#endif
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we add that to the compile flags in windows for the benchmarks only? target_compile_options

Comment on lines 52 to 53
DIR="/__w/xad/xad/main/build/benchmarks"
MAIN_DIR="/__w/xad/xad/main/build/benchmarks"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Any chance to get these dirs from CI environment variables?

echo ""
FULL_DATE=$(jq -r '.[0].context.date' "$DIR/benchmark.json")
RUN_DATE=$(echo "$FULL_DATE" | cut -d'T' -f1)
echo "**Run Date:** $RUN_DATE"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please also add some info on platform, CPU, compiler, and etc. Important to reproduce results.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll do this in the other PR.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is done in the other PR, but this one'll need to be merged before I can check it works as intended.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants