Skip to content

0.9.0
Compare
Choose a tag to compare
@tatiana tatiana released this 26 May 00:47
· 833 commits to main since this release
0.9.0
f4d1f7e

Enhancements:

  • Introduction of the user-facing Table, Metadata, and File classes

Breaking changes:

  • The operator save_file became export_file.
  • The tasks load_file, export_file (previously save_file) and run_raw_sql should be used with use Table, Metadata and File instances
  • The decorators dataframe, run_raw_sql and transform should be used with Table and Metadata instances.
  • Temporary removal of the operators aggregate_check, boolean_check, render, and stats_check.
  • Removal of the class TempTable. It is possible to declare temporary tables using Table(temp=True). All the temporary table names are prefixed with _tmp_. If the user decides to name a Table, it is no longer temporary.
  • The only mandatory property of a Table instance is conn_id. If the user gives no metadata to Table, the library will try to extract schema and other information from the connection object. If undefined and the database supports schema, the SDK defaults the schema to the value in AIRFLOW__ASTRO__SQL_SCHEMA.

Internals:

  • Major refactor introducing Database, File, FileType and FileLocation concepts.
Assets 2