Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Potential sparse memory leak #663

wesm opened this issue Jan 21, 2012 · 1 comment


Copy link

commented Jan 21, 2012

from SO:

# In [4]: type(pd)
# Out[4]: pandas.sparse.frame.SparseDataFrame
memid = unique(pd.Member)
pan = {}
for mem in memid:
    pan[mem] = pd[pd.Member==mem]
goal = pandas.Panel(pan)


What are the dimensions (pd.shape) and density (pd.density) of the SparseDataFrame? Any change you can e-mail me a pickle of the object ( for me to have a look to try to diagnose what's up? BTW these questions would be better posed on the mailing list than SO. – wesm 29 mins ago 

pd.shape = (2668990, 232) – user1162837 23 mins ago

pd.density = 0.12814551216649045 The file is too large to send through email. – user1162837 22 mins ago

Also, pandas is a great library. :) – user1162837 14 mins ago
wesm added a commit that referenced this issue Jan 21, 2012

This comment has been minimized.

Copy link
Member Author

commented Jan 23, 2012

After some memory profiling this appears to be fine

@wesm wesm closed this Jan 23, 2012

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
None yet
1 participant
You can’t perform that action at this time.