Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Document a tip on shutil.copyfileobj() #262

Closed
kuenishi opened this issue Jan 29, 2022 · 0 comments
Closed

Document a tip on shutil.copyfileobj() #262

kuenishi opened this issue Jan 29, 2022 · 0 comments
Labels
cat:document Documentation such as function documentations, comments and tutorials.
Milestone
2.2.0

Comments

@kuenishi
Copy link
Member

As of PFIO 2.1 and Python 3, copying from non-local file object to local file may be very slow. This is due to too small buffer size for non-local file object. shutil.COPY_BUFSIZE is 64KB while we often want to copy a large file. By default, non-local file objects in PFIO reads with 16MB buffer size in #247 .
@kuenishi kuenishi added the cat:document Documentation such as function documentations, comments and tutorials. label Jan 29, 2022
@kuenishi kuenishi added this to the 2.2.0 milestone Jan 29, 2022
@kuenishi kuenishi mentioned this issue Feb 2, 2022
Merged
@kuenishi kuenishi closed this as completed Feb 2, 2022
@kuenishi kuenishi mentioned this issue Feb 24, 2022
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
cat:document Documentation such as function documentations, comments and tutorials.
Projects
None yet
Milestone
2.2.0
Development

No branches or pull requests
1 participant
@kuenishi