Skip to content

cern-it-efp/cloud-exporter

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Cloud Data Exporter

Upload data from the public cloud you are running on to your Zenodo space.
This tool does not publish content but just uploads it.

Follow these steps to export data:

1. Create a Zenodo account

Go to Zenodo to open an account to which your data will be exported.
For more testing purposes you can also use sandbox.zenodo.
[Note that an account on one of the options doesn't give access to the other. Same thing applies to access tokens]

2. Create an access token

Once logged in to Zenodo, go to Account / Applications to create an access token that will be used to upload files.

3. Download and prepare

On the VM from which you want to export the data, clone this repo and cd into it:

git clone https://github.com/ignpelloz/cloud-exporter.git
cd cloud-exporter

Modify the file configs.yaml according to your upload.

Property Explanation / Values
access_token The access token previously created
path_to_data Path to the file or dir you desire to export, including the name of such file or dir
title Title you want to give your upload
sandbox Boolean. True: use sandbox.zenodo / False: use zenodo. Default is False

4. Run the tool

#python2 (default)
pip install requests pyyaml
./cloud-exporter.py
#python3
pip install requests pyyaml
python3 cloud-exporter.py

Log messages will be printed to the console informing the steps being carried out. At the end of it your content will be available at Zenodo.


This tool has been tested on:
Python: 2 and 3
OS: Ubuntu, Centos, OpenBSD, Debian, Red Hat, Windows


License

Copyright (c) CERN

You should have received a copy of the GNU Affero General Public License along with this program. If not, see https://www.gnu.org/licenses/.

About

Data repatriation: from public cloud to Zenodo.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages