Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Explaining train-validation-test split in M3 #439

Open
ArturoAmorQ opened this issue Aug 18, 2021 · 0 comments
Open

Explaining train-validation-test split in M3 #439

ArturoAmorQ opened this issue Aug 18, 2021 · 0 comments
Labels
Milestone

Comments

@ArturoAmorQ
Copy link
Collaborator

ArturoAmorQ commented Aug 18, 2021

The first time we use a train-validation-test split for parameter tuning is at the beginning of M3 in this exercise, as we (silently) use CV within the training set and then we score the model in a fixed test set (as in this figure).

Nowadays we explain this concept, as well as nested cross-validation, in the Evaluation and hyperparameter tuning notebook. But it would be better if we had a video to dynamically show the swapping folds in the train-validation set, similar to the Validation of a model video.

See also #755.

@ArturoAmorQ ArturoAmorQ changed the title Explaining special case of nested-CV in M3 Explaining train-validation-test split in M3 Aug 26, 2021
@lesteve lesteve added this to the MOOC 3.0 milestone Jan 6, 2022
@lesteve lesteve modified the milestones: MOOC 3.0, MOOC 4.0 Oct 18, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants