Skip to content
This repository has been archived by the owner on Apr 11, 2024. It is now read-only.

Latest commit

 

History

History
21 lines (14 loc) · 1.26 KB

File metadata and controls

21 lines (14 loc) · 1.26 KB

Getting Started

The Universal Transfer Operator allows data transfers between any supported source and target Datasets. It offers a consistent agnostic interface, simplifying the users' experience, so they do not need to use specific providers or operators for transfers.

This ensures a consistent set of :pyData Providers <universal_transfer_operator.data_providers> that can read from and write to dataset. The Universal Transfer Operator can use the respective :pyData Providers <universal_transfer_operator.data_providers> to transfer between as a source and a destination. It also takes advantage of any existing fast and direct high-speed endpoints, such as Snowflake’s built-in COPY INTO command to load S3 files efficiently into Snowflake.

Universal transfer operator also supports the transfers using third-party platforms like Fivetran.

There are three modes to transfer data using of the universal_transfer_operator.

  1. non_native
  2. native
  3. third_party

More details on how transfer works can be found at transfer_working.