Skip to content

Update Local Storage documentation#5165

Merged
mrocklin merged 1 commit intodask:masterfrom
mrocklin:nfs-local-docs
Jul 31, 2019
Merged

Update Local Storage documentation#5165
mrocklin merged 1 commit intodask:masterfrom
mrocklin:nfs-local-docs

Conversation

@mrocklin
Copy link
Copy Markdown
Member

network file system (NFS) mount which can cause problems as Dask tries to read
and write many small files. *Beware, reading and writing many tiny files from
many distributed processes is a good way to shut down a national
supercomputer*.
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Definitely not from experience

@mrocklin mrocklin merged commit 63f474b into dask:master Jul 31, 2019
@mrocklin mrocklin deleted the nfs-local-docs branch July 31, 2019 00:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants