Skip to content

DataStore Upload

Laura Jackson edited this page Nov 22, 2021 · 2 revisions

Local File Upload

You can add folders and files directly into the DataStore using the browse local option from the drop-down menu from within the DataStore. This method is quick and easy to upload existing files from your local machine, although is not recommended for large file transfers.

iCommands File Transfer

You can add large files and folders stored on Github through the use of CyVerse iCommands and command line transfer. iCommands is a collection of tools developed by the iRODS project. iRODS is the technology that supports the CyVerse Data Store. Using iCommands is the most flexible way to interact with the Data Store.

Upload to DataStore

  1. Login to CyVerse DE https://de.cyverse.org/

  2. Launch a cloud shell analysis using the icon in the DE left navigation bar

  3. Clone Github repo git clone <github_repo_name>.git

  4. Move the data into the datastore using iCommands through the cloud shell analysis terminal iinit

At the prompt, enter your CyVerse username and password

  1. Check that you are connected to your Datastore and that you see all folders ils

  2. Check the exact name of your folder to add (*Case-sensitive) ls

  3. Add your new folder to your Data store iput -rP metabarcoding-docker ./

NOTE: this will place your folder under your main username directory in the datastore, if you have created a new folder (i.e., github_directories) and want to place it within that subfolder, you would use this command instead iput -rP metabarcoding-docker ./github_directories

*When uploading a repository from Github, you will notice the upload includes many extra files. These are Github specific commit and settings files that are hidden within the folder.

  1. Check that your new folder is now in the datastore using the list command ils