Support training set only #361

gabegma · 2023-01-05T23:21:01Z

Resolve #362

Description:

Support only a training set (no eval) for further flexibility. Look at the commits for the details of what was done.

Checklist:

You should check all boxes before the PR is ready. If a box does not apply, check it to acknowledge it.

ISSUE NUMBER. You linked the issue number (Ex: Resolve #XXX).
PRE-COMMIT. You ran pre-commit on all commits, or else, you
ran pre-commit run --all-files at the end.
USER CHANGES. The changes are added to CHANGELOG.md and the documentation, if they impact
our users.
DEV CHANGES.
- Update the documentation if this PR changes how to develop/launch on the app.
- Update the README files and our wiki for any big design decisions, if relevant.
- Add unit tests, docstrings, typing and comments for complex sections.

christyler3030

Frontend stuff looks fine.

azimuth/modules/dataset_analysis/similarity_analysis.py

azimuth/routers/v1/app.py

azimuth/utils/project.py

tests/test_loading_resources.py

tests/test_modules/test_perturbation_testing/test_perturbation_testing_summary.py

tests/test_startup.py

* Better manage loading `datasetInfo` to remove the need for countless `?`s. * Select available dataset by default for behavioral testing preview * Select available dataset by default for exploration space * Add dataset split in URL for smart tag analysis page * Add dataset split in URL for pipeline performance page * Polish error messages * Add dataset split in URL for class overlap page to be consistent with the back end and the other pages.

…/azimuth into ggm/support-training-set-only

tests/test_startup.py

Co-authored-by: Joseph Marinier <joseph.marinier@servicenow.com>

azimuth/modules/dataset_analysis/similarity_analysis.py

JosephMarinier

Let's gooo! 💪

gabegma added 7 commits January 6, 2023 12:53

Add new config with eval only

ce37a72

Fix start-up

3136a3a

Adapt similarity analysis module so it can work with train only

63c810b

Test perturbation testing with train only

e0812bf

Fix generic routes

b82f54c

Hide threshold comparison when no eval

1fb7aa4

Fix class overlap routes and front end

b37cb01

gabegma force-pushed the ggm/support-training-set-only branch from 0c5150a to b37cb01 Compare January 6, 2023 17:57

gabegma and others added 3 commits January 6, 2023 12:59

Adapt start up test

74fb6e6

Fix router tests

12ff974

Fix class overlap

12e7cd5

JosephMarinier force-pushed the ggm/support-training-set-only branch from 836dbf0 to 12e7cd5 Compare January 6, 2023 23:46

JosephMarinier mentioned this pull request Jan 7, 2023

Support no evaluation set #365

Merged

4 tasks

gabegma requested a review from JosephMarinier January 9, 2023 21:50

gabegma marked this pull request as ready for review January 9, 2023 21:50

gabegma requested a review from lindsaydbrin January 9, 2023 21:50

christyler3030 reviewed Jan 10, 2023

View reviewed changes