Join GitHub today
GitHub is home to over 20 million developers working together to host and review code, manage projects, and build software together.
PERF: Slowness in multi-level indexes with datetime levels #8543
Comments
miketkelly
referenced
this issue
Oct 12, 2014
Merged
PERF: Performance improvement for MultiIndexes with a DatetimeIndex levels #8544
jreback
added MultiIndex Performance
labels
Oct 13, 2014
jreback
added this to the
0.15.0
milestone
Oct 13, 2014
|
closed by #8544 |
jreback
closed this
Oct 13, 2014
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
miketkelly commentedOct 12, 2014
A MultiIndex with a DatetimeIndex level is slower than a similar index with numeric levels:
CPU times: user 571 ms, sys: 41 ms, total: 612 ms
Wall time: 612 ms
CPU times: user 2.51 s, sys: 68 ms, total: 2.58 s
Wall time: 2.58 s
The overhead is in boxing the level values when generating the tuples for the
valuesproperty. The overhead can be minimized if we do the boxing once for each distinct value rather than for each occurrence of that value in the tuples.I can send in a PR shortly.