Better error message when custom objective specified as string without required args in pipeline score #1941
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Codecov Report
@@ Coverage Diff @@
## main #1941 +/- ##
=========================================
+ Coverage 100.0% 100.0% +0.1%
=========================================
Files 265 265
Lines 21712 21737 +25
=========================================
+ Hits 21706 21731 +25
Misses 6 6
Continue to review full report at Codecov.
|
freddyaboulton
requested review from
dsherry,
chukarsten,
angela97lin,
bchen1116,
jeremyliweishih and
ParthivNaresh
angela97lin
approved these changes
Mar 8, 2021
| with pytest.raises(ObjectiveNotFoundError, match="cost benefit is not a valid Objective!"): | ||
| pipeline.score(X, y, objectives=["cost benefit", "F1"]) | ||
|
|
||
| # Verify no exception when objective properly specified |
There was a problem hiding this comment.
Curious, what's the behavior if CostBenefitMatrix is not properly instantiated, like CostBenefitMatrix(1)? :o
There was a problem hiding this comment.
You'd get a TypeError but before the code gets into the score method!
… and no default arguments specified.
freddyaboulton
force-pushed
the
1603-improve-error-message-with-custom-objectives-in-pipeline-score
branch
from
3a3a2bc
to
5660e8c
Compare
freddyaboulton
deleted the
1603-improve-error-message-with-custom-objectives-in-pipeline-score
branch
Merged
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Pull Request Description
Fixes #1603
After creating the pull request: in order to pass the release_notes_updated check you will need to update the "Future Release" section of
docs/source/release_notes.rstto include this pull request by adding :pr:123.