Skip to content

ea_airflow_util v0.3.6

Choose a tag to compare

@jayckaiser jayckaiser released this 03 Apr 21:24
· 9 commits to main since this release
bff3c8d

New Features

  • Add recursive flag to sharefile_to_disk() callable (default True). When set to False, only top-level files are copied using an alternative API method (by @jayckaiser in #64).

Under the hood

  • Add pagination to SharefileHook._find_items() and downstream-dependent methods.
  • Use SharefileHook helper method in sharefile_to_disk() callable to reduce API calls to map filepaths to internal API IDs.

Fixes

  • Fix bug where full-refresh DAG config is always set to true in RunDbtDag (by @rlittle08 in #63).
  • Fix bug in S3ToSnowflakeOperator where optional arguments being undefined resulted in malformed SQL statements (by @mberrien-fitzsimons in #66).

Full Changelog: v0.3.5...v0.3.6