Doc: Adds example of exploding lists into columns instead of storing in dataframe cells #19215
Conversation
pdpark
commented
Jan 12, 2018
pdpark
commented
- closes DOC: section on caveats of storing lists inside DataFrame/Series #17027
Codecov Report
@@ Coverage Diff @@
## master #19215 +/- ##
==========================================
+ Coverage 91.53% 91.55% +0.02%
==========================================
Files 147 147
Lines 48797 48797
==========================================
+ Hits 44664 44676 +12
+ Misses 4133 4121 -12
Continue to review full report at Codecov.
|
|
|
||
|
|
||
| Alternative to storing lists in DataFrame Cells | ||
| ------------------------------------------------------ |
There was a problem hiding this comment.
needs to be the same length as the title
|
|
||
| nearest_neighbors = [['Zach LaVine', 'Jeremy Lin', 'Nate Robinson', 'Isaia']]*3 | ||
| nearest_neighbors | ||
|
|
There was a problem hiding this comment.
make things into separate ipython:: python blocks, rather than using comments (you can simply write text and not use the #)
| nearest_neighbors | ||
|
|
||
| #. Create an index with the "parent" columns to be included in the final Dataframe | ||
| df2 = pd.concat([df[['name','opponent']], pd.DataFrame(nearest_neighbors)], axis=1) |
There was a problem hiding this comment.
you don't need to keep naming the dataframes, just use
df = ..... or whatever
| ------------------------------------------------------ | ||
| Storing nested lists/arrays inside a pandas object should be avoided for performance and memory use reasons. Instead they should be "exploded" into a flat ``DataFrame`` structure. | ||
|
|
||
| Example of exploding nested lists into a DataFrame: |
There was a problem hiding this comment.
since you have 2 examples you can use another level of sub-section
|
can you update |
|
can you rebase and update |
|
Will do - have been absent due to starting new job, but plan to spend some time on this. |
|
Closing as discontinued. Superseded by #23041 |
