Skip to content

Add Data Import/Export #31

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
May 26, 2025
Merged

Add Data Import/Export #31

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
a9f8378
Add schedule tasks
SebastianPrehn May 23, 2025
af685e0
Add initial data import / export
SebastianPrehn May 26, 2025
5087c20
Merge branch 'main' into addition/dataimpexp
SebastianPrehn May 26, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions docs/index.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,7 @@ ERDA/SIF: User Guides
sections/erda/seafile/index
sections/erda/archiving/index
sections/erda/scheduletask/index
sections/erda/dataimportexport/index

.. toctree::
:maxdepth: 2
Expand Down
35 changes: 35 additions & 0 deletions docs/sections/erda/dataimportexport/index.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
.. _erda-dataimpexp-start:

Data Import/Export
==================

We offer the ability to import and export data from ERDA in an efficient way.
Typical scenarios include fetching big data sets from dedicated Linux/UNIX servers or from imaging sites, where data are recorded on-site with remote access afterwards.
This is probably mostly relevant for users with a certain experience in handling big data sets.

ERDA comes with low-level background import and export of data through different efficient transfer protocols like SFTP/FTPS/RSYNC/HTTPS and WebDAVS.

From the **Files** page you can right-click in the file manager and in the menu under *Data Transfers* you can find *Import* and *Export*.

There is also the dedicated page. The corresponding navigation menu entry is not shown by default to keep it simple, but you can **Add** it to your home page, which you can read more about on <erda-homepage-start>`_.

On the **Data Transfers** page you can create an external data transfer and either import or export data via a handy form.


.. _erda-dataimpexp-transfer:

External Data Transfer
----------------------

Select whether you want to import or export data via **Action**, and (optionally) give it a transfer ID / name to recognize it by.

Select **Protocol**, and specify **Host and port**.

Choose your **Login method** and specify the **Source path(s)**, clicking on the button *Add another source field* in case you have several **source paths**.

Add **Destination path** and **Exclude path(s)**.

If you transfer from a slow site, you should set **Enable compression**, and otherwise make sure it is unset.

You can specify your mail for a notification on completion, and then click **Request transfer**.

Loading