BUG: read_json broken for S3 URL with non-null chunksize #47659
Labels
Bug
IO JSON
read_json, to_json, json_normalize
Needs Triage
Issue that has not been reviewed by a pandas team member
Pandas version checks
I have checked that this issue has not already been reported.
I have confirmed this bug exists on the latest version of pandas.
I have confirmed this bug exists on the main branch of pandas.
Reproducible Example
Issue Description
This issue happens when using Pandas read_json with s3fs, with a non-null chunksize. There's a similar report for the null chunksize case.
Using the code above will results in this error:
I found out it's due to this method
I found the fix is simple, just the change the above line to:
Will put together a PR
Expected Behavior
Using pandas read_json with S3 url and non-null chunksize should work
Installed Versions
If happens with current versions (1.4.3)
The text was updated successfully, but these errors were encountered: