DataStore Upload
You can add folders and files directly into the DataStore using the browse local option from the drop-down menu from within the DataStore. This method is quick and easy to upload existing files from your local machine, although is not recommended for large file transfers.
You can add large files and folders stored on Github through the use of CyVerse iCommands and command line transfer. iCommands is a collection of tools developed by the iRODS project. iRODS is the technology that supports the CyVerse Data Store. Using iCommands is the most flexible way to interact with the Data Store.
-
Login to CyVerse DE https://de.cyverse.org/
-
Launch a cloud shell analysis using the icon in the DE left navigation bar
-
Clone Github repo
git clone <github_repo_name>.git
-
Move the data into the datastore using iCommands through the cloud shell analysis terminal
iinit
At the prompt, enter your CyVerse username and password
-
Check that you are connected to your Datastore and that you see all folders
ils
-
Check the exact name of your folder to add (*Case-sensitive)
ls
-
Add your new folder to your Data store
iput -rP metabarcoding-docker ./
NOTE: this will place your folder under your main username directory in the datastore, if you have created a new folder (i.e., github_directories) and want to place it within that subfolder, you would use this command instead
iput -rP metabarcoding-docker ./github_directories
*When uploading a repository from Github, you will notice the upload includes many extra files. These are Github specific commit and settings files that are hidden within the folder.
- Check that your new folder is now in the datastore using the list command
ils