Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] estimate_pandas_size results in a big error for MultiIndex #2706

Closed
hekaisheng opened this issue Feb 11, 2022 · 0 comments · Fixed by #2707
Closed

[BUG] estimate_pandas_size results in a big error for MultiIndex #2706

hekaisheng opened this issue Feb 11, 2022 · 0 comments · Fixed by #2707
Labels
mod: dataframe type: bug Something isn't working
Projects
DataFrame v0.9 Release
Milestone
v0.9.0b1

Comments

@hekaisheng
Copy link
Contributor

Describe the bug
estimate_pandas_size results a big error for MultiIndex.

To Reproduce

In [43]: idx1 = pd.MultiIndex.from_arrays(
    ...:         [np.arange(0, 1000), np.random.choice(["abcd", "def", "gh"], size=(1000,))]
    ...:     )

In [44]: sys.getsizeof(idx1)
Out[44]: 44400

In [45]: estimate_pandas_size(idx1)
Out[45]: 4143000
@hekaisheng hekaisheng added type: bug Something isn't working mod: dataframe labels Feb 11, 2022
@hekaisheng hekaisheng added this to the v0.9.0b1 milestone Feb 11, 2022
@hekaisheng hekaisheng added this to To do in DataFrame via automation Feb 11, 2022
@hekaisheng hekaisheng added this to Issue-Needs prioritizing in v0.9 Release via automation Feb 11, 2022
@hekaisheng hekaisheng changed the title [BUG] estimate_pandas_size results a big error for MultiIndex [BUG] estimate_pandas_size results in a big error for MultiIndex Feb 11, 2022
@qinxuye qinxuye moved this from Issue-Needs prioritizing to Issue-P0 in v0.9 Release Feb 11, 2022
@hekaisheng hekaisheng mentioned this issue Feb 11, 2022
Merged
2 tasks
DataFrame automation moved this from To do to Done Feb 11, 2022
v0.9 Release automation moved this from Issue-P0 to PR-Done Feb 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
mod: dataframe type: bug Something isn't working
Projects
DataFrame
  
Done
v0.9 Release
PR-Done
Milestone
v0.9.0b1
Development

Successfully merging a pull request may close this issue.

Fix estimate_pandas_size for pd.MultiIndex hekaisheng/mars
1 participant
@hekaisheng