-
Notifications
You must be signed in to change notification settings - Fork 58
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
synthesizers=None
for benchmark_single_table
runs default synthesizers
#237
Conversation
Codecov ReportPatch coverage:
❗ Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more. Additional details and impacted files@@ Coverage Diff @@
## master #237 +/- ##
===========================================
+ Coverage 43.74% 56.56% +12.82%
===========================================
Files 19 19
Lines 1159 1172 +13
===========================================
+ Hits 507 663 +156
+ Misses 652 509 -143
☔ View full report in Codecov by Sentry. |
sdgym/benchmark.py
Outdated
@@ -80,6 +80,7 @@ def _generate_job_args_list(limit_dataset_size, sdv_datasets, additional_dataset | |||
run_id = os.getenv('RUN_ID') or str(uuid.uuid4())[:10] | |||
|
|||
# Get list of synthesizer objects | |||
synthesizers = DEFAULT_SYNTHESIZERS if synthesizers is None else synthesizers |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Based on the issue, I think we actually want to treat None
as not running any synthesizers instead of using the defaults.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah, this is right
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🚢
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for updating!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
sdgym/benchmark.py
Outdated
@@ -418,6 +420,29 @@ def _run_jobs(multi_processing_config, job_args_list, show_progress): | |||
return scores | |||
|
|||
|
|||
def _empty_dataframe(compute_quality_score, sdmetrics): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nitpick: would prefer _get_empty_dataframe
Resolve #233.