Added new CLOS train test split tutorial notebook #1071
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## master #1071 +/- ##
==========================================
- Coverage 96.20% 95.96% -0.24%
==========================================
Files 76 82 +6
Lines 6005 6097 +92
Branches 1070 1069 -1
==========================================
+ Hits 5777 5851 +74
- Misses 135 147 +12
- Partials 93 99 +6 ☔ View full report in Codecov by Sentry. |
… iid issues and filtered training data based on exact duplicates between training and test sets
…revious version following the model eval on clean training + test data. Fixed section on using Datalab on training data to clean the data
…up notebook and added more on hyperparameter optimization section. This section still needs to be improved.
… and cleaned up some of the code, put data used into s3 bucket
…ar before DCAI workflow tutorial, and renamed it to improving_ml_performance, also removed datalab tabular tutorial since this tutorial is replacing that one
mturk24
changed the title
|
Also adding @sanjanag as reviewer (since she was very helpful/involved in this) |
jwmueller
reviewed
Apr 4, 2024
|
I was able to get a workaround for this issue using this approach so was able to build the docs successfully. I'm not sure what the expected runtime is to build but going to try comparing build time with and without the new notebook more thoroughly. |
|
can you resolve merge conflicts, thanks! |
…als and adjusted intro section as well
Co-authored-by: Elías Snorrason <eliassno@gmail.com>
jwmueller
reviewed
Jun 20, 2024
nelsonauner
reviewed
Jun 20, 2024
Co-authored-by: Jonas Mueller <1390638+jwmueller@users.noreply.github.com>
Co-authored-by: Nelson Auner <nelson@auner.org>
…at were outdated with newest version of cleanlab package, and some wording in markdown
jwmueller
approved these changes
Jul 7, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Added new tutorial that shows how to improve ML performance using train-test splits on your data with CLOS.
There is currently an issue preventing me from fully building the docs to see how quickly (and if successfully) the new tutorial builds.
Also modified the index files necessary to include this in the main sidebar of the CLOS tutorials. This is replacing the tabular datalab tutorial as well.
Latest Update: Bug in tutorial has been fixed and index files have been updated appropriately. Latest commits show fix/improvements to tutorial and data in S3 has been updated