Skip to content

Latest commit

 

History

History
16 lines (12 loc) · 1.22 KB

transform_file.rst

File metadata and controls

16 lines (12 loc) · 1.22 KB

:pytransform_file operator <astro.sql.operators.transform.transform_file>

When to use the transform_file operator

The transform_file operator allows you to implement the T of an ELT system by running a SQL query from specified SQL file. Each step of the transform pipeline creates a new table from the SELECT statement and enables tasks to pass those tables as if they were native Python objects.

The transform_file functions return a Table object that can be passed to future tasks. This table will be either an auto-generated temporary table, or will overwrite a table given in the output_table parameter. The transform_file operator treats values in the double brackets as Airflow jinja templates. You can find more details on templating at templating.

../../../../example_dags/example_transform_file.py