Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

hdfs: don't read the whole file into memory #6498

Merged
merged 2 commits into from
Aug 27, 2021
Merged

hdfs: don't read the whole file into memory #6498

merged 2 commits into from
Aug 27, 2021

Conversation

efiop
Copy link
Member

@efiop efiop commented Aug 27, 2021

Reported by our ODS user.

Temporary fix until fsspec migration.

Oversight from #4973 馃う

@efiop efiop requested a review from a team as a code owner August 27, 2021 15:03
@efiop efiop requested a review from skshetry August 27, 2021 15:03
@efiop efiop changed the title hdfs: don't read the whole file into memory [WIP] hdfs: don't read the whole file into memory Aug 27, 2021
@efiop efiop force-pushed the efiop-patch-1 branch 5 times, most recently from ebb2d26 to 4858ea2 Compare August 27, 2021 19:36
@efiop efiop changed the title [WIP] hdfs: don't read the whole file into memory hdfs: don't read the whole file into memory Aug 27, 2021
@efiop efiop added fs: hdfs Related to the HDFS filesystem bugfix fixes bug labels Aug 27, 2021
@efiop efiop added this to In progress in DVC 24 Aug - 07 Sep 2021 via automation Aug 27, 2021
@efiop efiop self-assigned this Aug 27, 2021
@efiop efiop merged commit 37717a7 into master Aug 27, 2021
@efiop efiop deleted the efiop-patch-1 branch August 27, 2021 20:19
DVC 24 Aug - 07 Sep 2021 automation moved this from In progress to Done Aug 27, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bugfix fixes bug fs: hdfs Related to the HDFS filesystem
Projects
No open projects
Development

Successfully merging this pull request may close these issues.

None yet

1 participant