Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

guide: using NFS as a remote storage #103

Closed
Tracked by #2866
efiop opened this issue Oct 30, 2018 · 10 comments
Closed
Tracked by #2866

guide: using NFS as a remote storage #103

efiop opened this issue Oct 30, 2018 · 10 comments
Labels
C: guide Content of /doc/user-guide p2-nice-to-have Less of a priority at the moment. We don't usually deal with this immediately. type: enhancement Something is not clear, small updates, improvement suggestions

Comments

@efiop
Copy link
Contributor

efiop commented Oct 30, 2018

I.e. mount it to some dir and specify it as a local dir repository for dvc.

Related to #4303

@shcheklein shcheklein added command-reference A: docs Area: user documentation (gatsby-theme-iterative) type: enhancement Something is not clear, small updates, improvement suggestions labels Mar 25, 2019
@shcheklein shcheklein changed the title docs: add "How to use NFS as a dvc remote" add "How to use NFS as a dvc remote" Mar 25, 2019
@dashohoxha dashohoxha mentioned this issue Oct 25, 2019
10 tasks
@dashohoxha
Copy link
Contributor

I have generalized this as "Mounted DVC Storage", which includes not only NFS, but also SSHFS, Samba, or any other data storage that can be network-mounted on a local directory.

I have also built an interactive example that explains how to do it for SSHFS (since this is easier to set up for an interactive example): https://katacoda.com/dvc/courses/examples/mounted-storage

@jorgeorpinel
Copy link
Contributor

@efiop did you mean in https://dvc.org/doc/command-reference/remote/add though? Or somewhere else.

@efiop
Copy link
Contributor Author

efiop commented Nov 15, 2019

@jorgeorpinel I guess a note there would also be pretty nice as a way of using any storage that you can mount to your local fs.

@jorgeorpinel

This comment was marked as resolved.

@jorgeorpinel jorgeorpinel changed the title add "How to use NFS as a dvc remote" how to: use NFS as a DVC remote Jan 20, 2020
@iesahin
Copy link
Contributor

iesahin commented Mar 14, 2021

I read the comments in #784. Is there anything that should be done here?

@shcheklein
Copy link
Member

It feels that we don't have a perfect place at the moment to put this note. I think there should be something about remotes in the User Guide in the first place. Starting from basic concepts, expanding into a proper section, where we can put a note in the introductory part about "Unsupported directly remotes" with a solutions like sshfs, mounted NFS, etc. For now, we can probably create a section and a note in the existing remote add, remote modify, remote index with the same meaning.

@jorgeorpinel jorgeorpinel added C: guide Content of /doc/user-guide and removed A: docs Area: user documentation (gatsby-theme-iterative) labels Oct 12, 2021
@jorgeorpinel jorgeorpinel changed the title how to: use NFS as a DVC remote how-to: use NFS as a DVC remote Oct 12, 2021
@jorgeorpinel
Copy link
Contributor

there should be something about remotes in the User Guide in the first place

Added this to #2866.

@jorgeorpinel jorgeorpinel changed the title how-to: use NFS as a DVC remote guide: using NFS as a remote storage Oct 12, 2021
@dberenbaum dberenbaum added the p1-important Active priorities to deal within next sprints label Feb 10, 2023
@dberenbaum dberenbaum added p2-nice-to-have Less of a priority at the moment. We don't usually deal with this immediately. and removed p1-important Active priorities to deal within next sprints labels Feb 27, 2023
@jorgeorpinel
Copy link
Contributor

jorgeorpinel commented Mar 11, 2023

QQ @dberenbaum: This has a low priority now but #4303 (part of this one) a high priority. 🤔 Does that mean you want to focus on the latter without addressing the former (this one) ?

@dberenbaum
Copy link
Contributor

@jorgeorpinel In https://dvc.org/doc/user-guide/data-management/remote-storage#file-systems-local-remotes, you added:

You can also use system directories, mounted drives, network resources e.g. network-attached storage (NAS), and other external devices as storage.

Is that enough to close this one? Do we need anything else for this issue specifically?

@jorgeorpinel
Copy link
Contributor

Maybe just add "mounted drives (e.g. NFS)" (link to https://nfs.sourceforge.net/ ?) unless the intention here was specifically about NFS for some reason, and not in general any mounted drives. Note that there are NFS-specific notes in the config options state.dir and index.dir.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C: guide Content of /doc/user-guide p2-nice-to-have Less of a priority at the moment. We don't usually deal with this immediately. type: enhancement Something is not clear, small updates, improvement suggestions
Projects
None yet
Development

Successfully merging a pull request may close this issue.

6 participants