add logic to speed up permutation feature importance

[ozzieD]

• Checks input features with features in the DFS transform component. If features are the same then it will bypass the has_dfs check in _supports_fast_permutation_importance
• Fixes _fast_permutation_importance doesn't run if DFS Transformer present, even when dfs feature pre-exist. #4036

[CLAassistant]

All committers have signed the CLA.

[codecov]

Codecov Report

Merging #4037 (62b1bf1) into main (a322411) will increase coverage by 31.0%.
The diff coverage is 100.0%.

@@           Coverage Diff            @@
##            main   #4037      +/-   ##
========================================
+ Coverage   68.8%   99.7%   +31.0%     
========================================
  Files        349     349              
  Lines      37489   37523      +34     
========================================
+ Hits       25763   37405   +11642     
+ Misses     11726     118   -11608     

Impacted Files	Coverage Δ
...ponents/transformers/preprocessing/featuretools.py	100.0% <100.0%> (+1.5%)	⬆️
evalml/pipelines/pipeline_base.py	98.5% <100.0%> (+0.1%)	⬆️
evalml/tests/component_tests/test_featuretools.py	100.0% <100.0%> (+100.0%)	⬆️
...understanding_tests/test_permutation_importance.py	100.0% <100.0%> (ø)
evalml/automl/automl_search.py	99.6% <0.0%> (+0.2%)	⬆️
...elines/components/transformers/column_selectors.py	92.9% <0.0%> (+1.5%)	⬆️
evalml/utils/gen_utils.py	99.3% <0.0%> (+1.5%)	⬆️
evalml/objectives/standard_metrics.py	100.0% <0.0%> (+1.7%)	⬆️
...onents/estimators/regressors/catboost_regressor.py	100.0% <0.0%> (+2.3%)	⬆️
... and 177 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

[jeremyliweishih]

Just requesting one additional coverage but looks great otherwise!

[jeremyliweishih]

LGTM once tests pass! great work 🦾

[tamargrey]

lgtm! Nice work!