Skip to content

Refactors build_features to improve performance#2224

Merged
gsheni merged 30 commits into
mainfrom
TML-4492_build-features-perf
Aug 24, 2022
Merged

Refactors build_features to improve performance#2224
gsheni merged 30 commits into
mainfrom
TML-4492_build-features-perf

Conversation

@cp2boston

@cp2boston cp2boston commented Aug 5, 2022

Copy link
Copy Markdown
Contributor

Pull Request Description

This PR contains refactors within the build_features code path that are focused on improving the performance. There are some new files:

  • Dockerfile.arm is included for reference. It was used to create a testing/debugging environment on a Mac M1
  • .dockerignore filters out unwanted context
  • tests/profiling/dfs_profile.py is a helper module to run cProfile against DFS

@CLAassistant

CLAassistant commented Aug 5, 2022

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

@cp2boston
cp2boston marked this pull request as draft August 5, 2022 13:05
@gsheni
gsheni requested review from ozzieD and sbadithe and removed request for dvreed77 August 5, 2022 14:52
Comment thread Dockerfile.arm Outdated
Comment thread featuretools/tests/profiling/dfs_profile.py
Comment thread docs/source/release_notes.rst Outdated
Christopher Park added 3 commits August 5, 2022 15:59
- removed Dockerfile.arm and .dockerignore
- created feature_base/cache.py
- modified cache to be enabld for DFS only
- reverted test modifications
@gsheni gsheni changed the title Tml 4492 build features perf Refactors build_features to improve performance Aug 8, 2022
Comment thread docs/source/release_notes.rst Outdated
Comment thread featuretools/feature_base/feature_base.py Outdated
Comment thread featuretools/feature_base/feature_base.py Outdated
Comment thread featuretools/feature_base/feature_base.py Outdated
@codecov

codecov Bot commented Aug 9, 2022

Copy link
Copy Markdown

Codecov Report

Merging #2224 (76365c0) into main (45a06f1) will increase coverage by 0.02%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main    #2224      +/-   ##
==========================================
+ Coverage   99.29%   99.32%   +0.02%     
==========================================
  Files         146      148       +2     
  Lines       17585    17657      +72     
==========================================
+ Hits        17461    17537      +76     
+ Misses        124      120       -4     
Impacted Files Coverage Δ
featuretools/primitives/options_utils.py 100.00% <ø> (ø)
featuretools/feature_base/cache.py 100.00% <100.00%> (ø)
featuretools/feature_base/utils.py 100.00% <100.00%> (ø)
featuretools/synthesis/deep_feature_synthesis.py 99.77% <100.00%> (+0.69%) ⬆️
...aturetools/tests/primitive_tests/test_agg_feats.py 99.52% <100.00%> (+0.01%) ⬆️
...ools/tests/primitive_tests/test_dask_primitives.py 65.11% <100.00%> (+4.58%) ⬆️
...ests/primitive_tests/test_feature_serialization.py 99.61% <100.00%> (+<0.01%) ⬆️
featuretools/tests/profiling/dfs_profile.py 100.00% <100.00%> (ø)
...ols/tests/synthesis/test_deep_feature_synthesis.py 99.34% <100.00%> (+<0.01%) ⬆️
featuretools/feature_base/feature_base.py 98.13% <0.00%> (+0.20%) ⬆️
... and 1 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@gsheni
gsheni requested a review from sbadithe August 10, 2022 19:49
Comment thread featuretools/synthesis/deep_feature_synthesis.py
Comment thread docs/source/release_notes.rst
Comment thread docs/source/release_notes.rst Outdated
Comment thread featuretools/synthesis/deep_feature_synthesis.py Outdated

@thehomebrewnerd thehomebrewnerd left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems fine to me, but not sure I completely followed all the refactors. Might be good to get a second opinion before merging.

Comment thread docs/source/release_notes.rst Outdated

Thanks to the following people for contributing to this release:
:user:`cp2boston`, :user:`gsheni`
:user:`cpark`, :user:`gsheni`

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Correct user name?
image

Thanks to the following people for contributing to this release:
:user:`cp2boston`, :user:`gsheni`
:user:`cpark`, :user:`gsheni`

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change

Comment thread docs/source/release_notes.rst Outdated
Comment thread docs/source/release_notes.rst Outdated
@gsheni
gsheni enabled auto-merge (squash) August 24, 2022 20:31
@gsheni
gsheni merged commit 0da8936 into main Aug 24, 2022
@gsheni
gsheni deleted the TML-4492_build-features-perf branch August 24, 2022 20:48
@stefaniesmith stefaniesmith mentioned this pull request Sep 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants