Skip to content

1.5.0

Compare
Choose a tag to compare
@utkarsharma2 utkarsharma2 released this 08 Feb 19:16
· 16 commits to release-1.5 since this release

Feature:

  • Add support for Microsoft SQL server. #1538
  • Add support for DuckDB. #1695
  • Add result_format and fail_on_empty params to run_raw_sql operator #1584
  • Add support validation_mode as part of the COPY INTO command for snowflake. #1689
  • Add support for native transfers for Azure Blob Storage to Snowflake in LoadFileOperator. #1675

Improvements

  • Use cache to reduce redundant database calls #1488
  • Remove default copy_options as part of SnowflakeLoadOptions. All copy_options are now supported as part of SnowflakeLoadOptions as per documentation. #1689
  • Remove load_options from File object. #1721
  • Consolidated PandasCsvLoadOptions, PandasJsonLoadOptions, PandasNdjsonLoadOptions and PandasParquetLoadOptions to single PandasLoadOptions. #1722
  • Render SQL code with parameters in BaseSQLDecoratedOperator. #897

Bug fixes

  • Fix handling of multiple dataframes in the run_raw_sql operator. #1700

Docs

  • Add documentation around Microsoft SQL support with example DAG. #1538
  • Add documentation around DuckDB support with example DAG. #1695
  • Add documentation for validation_mode as part of the COPY INTO command for snowflake. #1689
  • Add documentation and example DAGs for snowflake SnowflakeLoadOptions for various available options around copy_options and file_options. #1689
  • Fix the documentation to run the quickstart example described in the Python SDK README. #1716

Misc

  • Add cleanup DAG to clean snowflake tables created as part of CI when the runners fail as part of GitHub actions. #1663
  • Run example DAGs on astro-cloud and collect the results. #1499