BUG: fix HDFStore.append with all empty strings error (GH12242) #23435
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Hello @josham! Thanks for submitting the PR.
|
gfyoung
reviewed
Oct 31, 2018
doc/source/whatsnew/v0.24.0.txt
Outdated
| @@ -1216,6 +1216,7 @@ Notice how we now instead output ``np.nan`` itself instead of a stringified form | |||
| - :func:`read_sas()` will correctly parse sas7bdat files with data page types having also bit 7 set (so page type is 128 + 256 = 384) (:issue:`16615`) | |||
| - Bug in :meth:`detect_client_encoding` where potential ``IOError`` goes unhandled when importing in a mod_wsgi process due to restricted access to stdout. (:issue:`21552`) | |||
| - Bug in :func:`to_string()` that broke column alignment when ``index=False`` and width of first column's values is greater than the width of first column's header (:issue:`16839`, :issue:`13032`) | |||
| - Bug in :meth:`HDFStore.append` when appending a :class:`DataFrame` with an empty string column and min_itemsize < 8 (:issue:`12242`) | |||
There was a problem hiding this comment.
Double backticks around min_itemsize
gfyoung
reviewed
Oct 31, 2018
pandas/tests/io/test_pytables.py
Outdated
| store.append('df', df1, min_itemsize={'x': 1}) | ||
| store.append('df', df2, min_itemsize={'x': 1}) | ||
| tm.assert_frame_equal(store.select('df'), | ||
| pd.concat([df1, df2])) |
There was a problem hiding this comment.
Instead of comparing to pd.concat. Can you explicitly construct the DataFrame?
There was a problem hiding this comment.
can you push this to a new test, the existing ones are really long already
Codecov Report
@@ Coverage Diff @@
## master #23435 +/- ##
==========================================
- Coverage 92.21% 92.21% -0.01%
==========================================
Files 161 161
Lines 51189 51187 -2
==========================================
- Hits 47204 47202 -2
Misses 3985 3985
Continue to review full report at Codecov.
|
jreback
requested changes
Oct 31, 2018
pandas/tests/io/test_pytables.py
Outdated
| store.append('df', df1, min_itemsize={'x': 1}) | ||
| store.append('df', df2, min_itemsize={'x': 1}) | ||
| tm.assert_frame_equal(store.select('df'), | ||
| pd.concat([df1, df2])) |
There was a problem hiding this comment.
can you push this to a new test, the existing ones are really long already
|
can you rebase again, the whatsnew is conflicted. ping on green. |
jreback
approved these changes
Nov 1, 2018
|
lgtm. ping on green. |
|
@jreback green |
|
thanks @josham |
thoo
added a commit
to thoo/pandas
that referenced
this pull request
Nov 3, 2018
…xamples * repo_org/master: (66 commits) CLN: doc string (pandas-dev#23469) DOC: Add cookbook entry for triangular correlation matrix (GH22840) (pandas-dev#23032) add number of Errors, Warnings to scripts/validate_docstrings.py (pandas-dev#23150) BUG: Allow freq conversion from dt64 to period (pandas-dev#23460) ENH: Add FrozenList.union and .difference (pandas-dev#23394) REF: cython cleanup, typing, optimizations (pandas-dev#23464) strictness and checks for Timedelta _simple_new (pandas-dev#23433) Fixing flake8 problems new to flake8 3.6.0 (pandas-dev#23472) DOC: Updating the docstring of Series.dot (pandas-dev#22890) TST: Fixturize series/test_analytics.py (pandas-dev#22755) BUG/ENH: Handle NonexistentTimeError in date rounding (pandas-dev#23406) PERF: speed up concat on Series by making _get_axis_number() a classmethod (pandas-dev#23404) REF: Remove DatetimelikeArrayMixin._shallow_copy (pandas-dev#23430) REF: strictness/simplification in DatetimeArray/Index _simple_new (pandas-dev#23431) REF: cython cleanup, typing, optimizations (pandas-dev#23456) TST: tweak Hypothesis configuration and idioms (pandas-dev#23441) BUG: fix HDFStore.append with all empty strings error (GH12242) (pandas-dev#23435) TST: Skip 32bit failing IntervalTree tests (pandas-dev#23442) BUG: Deprecate nthreads argument (pandas-dev#23112) style: fix import format at pandas/core/reshape (pandas-dev#23387) ...
tm9k1
pushed a commit
to tm9k1/pandas
that referenced
this pull request
Nov 19, 2018
Pingviinituutti
pushed a commit
to Pingviinituutti/pandas
that referenced
this pull request
Feb 28, 2019
Pingviinituutti
pushed a commit
to Pingviinituutti/pandas
that referenced
this pull request
Feb 28, 2019
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
git diff upstream/master -u -- "*.py" | flake8 --diff