Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Abnormally long run time? #3

Open
xiaodaigh opened this issue Aug 26, 2019 · 2 comments
Open

Abnormally long run time? #3

xiaodaigh opened this issue Aug 26, 2019 · 2 comments

Comments

@xiaodaigh
Copy link

Bug/Feature Request Title

Abnormally long expected run time. The estimate keep climbing! And progress remains 0.

I ran on Windows 10 and featuretools 0.10.1

I was just following along this tutorial https://github.com/Featuretools/predict-loan-repayment/blob/master/Automated%20Loan%20Repayment.ipynb

except I couldn't get this line to run

#default_trans_primitives =  ["day", "year", "month", "weekday", "haversine", "numwords", "characters"]

so I dropped two primitives

#default_trans_primitives =  ["day", "year", "month", "weekday", "haversine"]

Bug/Feature Request Description

I was just following along this tutorial https://github.com/Featuretools/predict-loan-repayment/blob/master/Automated%20Loan%20Repayment.ipynb

Expected Output

Within the hour

Output of featuretools.show_info()

Elapsed: 19:46 | Progress: 0%| | Remaining: 899:20:03

@xiaodaigh
Copy link
Author

FWIW, this is what I see just before the Elapsed: ...

uilt 2188 features
Total size of entityset: 11.28767 gb.
Total number of cpus detected: 12.
Total size of system memory: 68.67001 gb.
Built 2188 features
Elapsed: 02:33 | Progress:   0%|          

@kmax12
Copy link
Contributor

kmax12 commented Sep 22, 2019

This is a large dataset where you are calculating many features. The best approach for speeding it up would be to follow the instructions in this article about using Dask + Featuretools. We have an example notebook for using dask with this exact dataset here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants