Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

It is taking too much time for dataset of size 100000 rows × 2395 columns. It is not scallable for large dataset. #261

Closed
surajrajbhar opened this issue Sep 20, 2019 · 7 comments
Labels
feature request 💬 Requests for new features

Comments

@surajrajbhar
Copy link

surajrajbhar commented Sep 20, 2019

It is worderfull tool. But it is not scallable for for larger dataset. I am running it on 8gb ram and intel i3 processor. It is stilling running from last one hour

@surajrajbhar surajrajbhar added the feature request 💬 Requests for new features label Sep 20, 2019
@sbrugman
Copy link
Collaborator

We are working on higher performance for larger datasets. I'll put out an announcement when we are close to release.

@sbrugman sbrugman reopened this Sep 20, 2019
@alfonsomhc
Copy link

I'm working with a dataset with shape (975084, 70), and it's been running for 5 hours (using all CPUs that are available). Great that you're improving performance for large datasets in a new release, but is there anything I can do as a workaround (e.g. disable any part of the analysis)?

@sbrugman
Copy link
Collaborator

See #222

@zach-king-analytics
Copy link

I just want to say that I am attempting to run my first report on a 92k X 80 dataframe and the report has been spinning at 100% cpu & memory usage for a while. Would this be considered "Standard performance," or should I be tweaking some settings?

I have just used the basic command outlined in the instructions:

df.profile_report(style={'full_width':True})

Where would I add the line referenced in #222 ?

@miguelfdag
Copy link

Will there also be a feature to merge outputs of two different DataFrames into one?

@neomatrix369
Copy link

I have a similar question as in #76 (comment)

@github-actions
Copy link

Stale issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request 💬 Requests for new features
Projects
None yet
Development

No branches or pull requests

6 participants