Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dataclasses for summarizing benchmarking results #2261

Merged
merged 9 commits into from
Jul 15, 2022
Merged

Conversation

abidwael
Copy link
Contributor

Defines dataclasses for summarizing and easily accessing a benchmarking experiment results.

@github-actions
Copy link

github-actions bot commented Jul 12, 2022

Unit Test Results

       6 files  +    1         6 suites  +1   2h 29m 54s ⏱️ + 29m 28s
2 912 tests  -   17  2 867 ✔️  -   16    45 💤  -   1  0 ±0 
8 736 runs  +120  8 597 ✔️ +100  139 💤 +20  0 ±0 

Results for commit 888c34e. ± Comparison against base commit 9c58d5e.

♻️ This comment has been updated with latest results.

metrics: List[MetricDiff]


def build_experiment_summary(experiment_local_directory: str) -> ExperimentSummary:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks a lot cleaner to me!

ludwig/benchmarking/summary_dataclasses.py Show resolved Hide resolved
@abidwael abidwael merged commit f1d1c98 into master Jul 15, 2022
@abidwael abidwael deleted the summary-dataclasses branch July 15, 2022 14:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants