Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add validations for model predictions #2008

Merged
merged 11 commits into from
Mar 23, 2023
Merged

Conversation

gaugup
Copy link
Contributor

@gaugup gaugup commented Mar 15, 2023

This validation prevents the downstream failure when trying to serialize the RAIInsights object or computing explanations if the predicted set of values aren't passed as valid classes to RAIInsights.

Description

Checklist

  • I have added screenshots above for all UI changes.
  • I have added e2e tests for all UI changes.
  • Documentation was updated if it was needed.

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
tongyu-microsoft and others added 5 commits March 23, 2023 11:58
…data (#2011)

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-census-classification-model-debugging.ipynb

* Update responsibleaidashboard-census-classification-model-debugging.ipynb

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-diabetes-regression-model-debugging.ipynb

* Update responsibleaidashboard-census-classification-model-debugging.ipynb

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-housing-classification-model-debugging.ipynb

* Update responsibleaidashboard-housing-classification-model-debugging.ipynb

* Update responsibleaidashboard-census-classification-model-debugging.ipynb

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-diabetes-regression-model-debugging.ipynb

* Update responsibleaidashboard-housing-decision-making.ipynb

* Update responsibleaidashboard-multiclass-dnn-model-debugging.ipynb

* Update responsibleaidashboard-diabetes-decision-making.ipynb

* Update responsibleaidashboard-diabetes-regression-model-debugging.ipynb

* Update responsibleaidashboard-housing-classification-model-debugging.ipynb

* Update responsibleaidashboard-housing-decision-making.ipynb
…rgs (#2002)

* OD label support ckpt

* Surfaced OD metrics

* numLabels update

* lint fixes

* main fetch

* line end changes

* var fix

* ts lint fix

* lint autofixes
* flask endpoint infra template

* docstring and lint fixes

* lint fixes

* lint fixes

* lint autofixes

* error statement fix
… selection, & IoU Threshold (#1997)

* agg method & iou thresh widgets ckpt

* class selection widget

* widget option format fix

* comment fixes

* widget size & lint fixes

* semiclon lint fix

* od widget options refactor

* lint complexity fixes

* lint complexity fixes

* comment fixes

* refactor to reduce complexity

* complexity refactor

* lint fixes

* autolint fixes
Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
@gaugup gaugup requested a review from romanlutz as a code owner March 23, 2023 18:59
@gaugup gaugup enabled auto-merge (squash) March 23, 2023 19:00
@codecov-commenter
Copy link

codecov-commenter commented Mar 23, 2023

Codecov Report

Merging #2008 (71228b1) into main (52ec38e) will increase coverage by 1.49%.
The diff coverage is n/a.

❗ Current head 71228b1 differs from pull request most recent head 97501b9. Consider uploading reports for the commit 97501b9 to get more accurate results

@@            Coverage Diff             @@
##             main    #2008      +/-   ##
==========================================
+ Coverage   91.58%   93.07%   +1.49%     
==========================================
  Files         105       48      -57     
  Lines        5143     1963    -3180     
==========================================
- Hits         4710     1827    -2883     
+ Misses        433      136     -297     
Flag Coverage Δ
unittests 93.07% <ø> (+1.49%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

see 57 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

Signed-off-by: Gaurav Gupta <gaugup@microsoft.com>
@gaugup gaugup merged commit f87f229 into main Mar 23, 2023
@gaugup gaugup deleted the gaugup/AddPredictedValueValidation branch March 23, 2023 22:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants