Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/save cv folds #262

Merged
merged 7 commits into from
Dec 11, 2015
Merged

Feature/save cv folds #262

merged 7 commits into from
Dec 11, 2015

Conversation

aoifecahill
Copy link
Collaborator

Add a new config option that saves information about which example was in which test fold during cross validation experiments. The name of the file is fixed for each experiment.

config_dir = join(_my_dir, 'configs')

cfg_file = join(config_dir, 'test_save_cv_folds.cfg')
os.unlink(cfg_file)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just wondering: Is there some specific reason we're using unlink here as opposed to remove or is it just because that's what has been used in the past? The docs say that it's identical to remove and it seems like the naming is clearer there.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's just a consistency thing. We have been using unlink in the past.

@@ -363,6 +365,9 @@ def _parse_config_file(config_path):
# default number of cross-validation folds
cv_folds = 10

# whether or not to save the cv fold ids
save_cv_folds = config.get("Input", "save_cv_folds")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this belongs in Output, since this an option that relates to what we're outputting, and not to what we're given.

@landscape-bot
Copy link

Code Health
Code quality remained the same when pulling 4093ad3 on EducationalTestingService:feature/save_cv_folds into f98712e on EducationalTestingService:master.

@desilinguist
Copy link
Member

This looks pretty good to me. I am going to merge it tomorrow unless anyone else has an objection.

desilinguist added a commit that referenced this pull request Dec 11, 2015
@desilinguist desilinguist merged commit 3562ded into master Dec 11, 2015
@desilinguist desilinguist deleted the feature/save_cv_folds branch October 18, 2017 18:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants