Skip to content

Add check_distribution function - #4184

Merged
eccabay merged 5 commits into
mainfrom
4170_check_dist_func
May 26, 2023
Merged

eccabay merged 5 commits into
mainfrom
4170_check_dist_func

Conversation

@eccabay

@eccabay eccabay commented May 11, 2023

Copy link
Copy Markdown
Contributor

Closes #4170

@codecov

codecov Bot commented May 11, 2023 •

Copy link
Copy Markdown

Codecov Report

Merging #4184 (a510c27) into main (c60f712) will increase coverage by 0.1%.
The diff coverage is 100.0%.

@@           Coverage Diff           @@
##            main   #4184     +/-   ##
=======================================
+ Coverage   99.7%   99.7%   +0.1%     
=======================================
  Files        349     349             
  Lines      38128   38154     +26     
=======================================
+ Hits       38011   38037     +26     
  Misses       117     117             
Impacted Files Coverage Δ
evalml/model_understanding/metrics.py 100.0% <100.0%> (ø)
...ml/tests/model_understanding_tests/test_metrics.py 100.0% <100.0%> (ø)

@eccabay
eccabay marked this pull request as ready for review May 23, 2023 20:03

@jeremyliweishih jeremyliweishih left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM once we add the baseline case for coverage

def test_check_distribution(problem_type, expected_distribution):
y_true = pd.Series(np.random.normal(size=500))
if expected_distribution == "matching":
y_pred = pd.Series(np.random.normal(size=500))

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

would we want to test non-normal distributions?

Comment thread evalml/tests/model_understanding_tests/test_metrics.py

@chukarsten chukarsten left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great! Well done.

@eccabay
eccabay enabled auto-merge (squash) May 26, 2023 14:08
@eccabay
eccabay merged commit 437a17a into main May 26, 2023
@eccabay
eccabay deleted the 4170_check_dist_func branch May 26, 2023 14:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Implement check_distribution function for pipelines

3 participants