Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Report confidence interval for permutation feature importance #326

Merged
merged 37 commits into from Feb 15, 2023

Conversation

kelly-sovacool
Copy link
Member

@kelly-sovacool kelly-sovacool commented Jan 25, 2023

Issues

Change(s) made

  • Report lower and upper bounds for 95% CI for each feature.
  • In feature importance dataframe, renamed column names to feat for clarity and to avoid clashing with the base names() function.

Checklist

(Strikethrough any points that are not applicable.)

  • Write unit tests for any new functionality or bug fixes.
  • Update docs if there are any API changes:
    • roxygen comments
    • vignettes
  • Update NEWS.md if this includes any user-facing changes.
  • The check workflow succeeds on your most recent commit. This is always required before the PR can be merged.

@codecov-commenter
Copy link

codecov-commenter commented Jan 27, 2023

Codecov Report

Base: 98.18% // Head: 98.19% // Increases project coverage by +0.00% 🎉

Coverage data is based on head (02fddc3) compared to base (f73f8a8).
Patch coverage: 100.00% of modified lines in pull request are covered.

📣 This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #326   +/-   ##
=======================================
  Coverage   98.18%   98.19%           
=======================================
  Files          13       13           
  Lines        1103     1109    +6     
=======================================
+ Hits         1083     1089    +6     
  Misses         20       20           
Impacted Files Coverage Δ
R/feature_importance.R 100.00% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

github-actions bot and others added 11 commits January 27, 2023 17:54
To fix this warning:

Use of .data in tidyselect expressions was deprecated in tidyselect 1.2.0.
i Please use `all_of(var)` (or `any_of(var)`) instead of `.data[[var]]`
Because `names()` is a base R function already,
and it's not obvious that `names` referred to the
feature or group of correlated features.
- `names` renamed to `feat`
- `lower` and `upper` for bounds of 95% CI
@kelly-sovacool kelly-sovacool marked this pull request as ready for review January 27, 2023 20:04
@courtneyarmour courtneyarmour merged commit 6bcc6d2 into main Feb 15, 2023
@courtneyarmour courtneyarmour deleted the iss-324 branch February 15, 2023 22:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Report confidence interval for permutation feature importance
3 participants