1.8.0

Check CHANGELOG.rst for summary of the changes included in this release.

What's Changed

• Fix hardcoded poll interval by @bharanidharan14 in #552
• Add poll_interval in HttpSensorAsync by @rajaths010494 in #554
• Fix Extractor Import Path by @pankajastro in #549
• Update sql_alchemy_conn in docker compose by @pankajastro in #548
• Fix see also link mentioned in Document by @bharanidharan14 in #562
• Nuke GCP resources. by @pankajkoti in #563
• Update Doc string for SnowflakeOperatorAsync by @bharanidharan14 in #556
• Remove EMR Conn from example by @pankajastro in #525
• Update base url for API docs to fix broken links by @pankajkoti in #567
• Unit Test Cleanup by @pankajastro in #368
• Generate class def link dynamically based on document version by @pankajkoti in #569
• Fix error in docstring by @BasPH in #571
• Replace execution_timeout with timeout in sensor by @rajaths010494 in #555
• Update run-mypy command by @rajaths010494 in #579
• Update to new pre-commit hooks by @kaxil in #580
• Add temporary logs to debug intermittent failures of the Dataproc DAG by @pankajkoti in #583
• Fix async databricks job failure due to new airflow provider release by @rajaths010494 in #582
• Deprecate S3PrefixSensorAsync and S3KeySizeSensorAsync by @bharanidharan14 in #577
• Use docker compose instead of docker-compose by @phanikumv in #585
• Exclude files containing dead links by @feluelle in #587
• Fix dead links in repo by @rajaths010494 in #586
• Get default 'resource_group_name' and 'factory_name' for AzureDataFactoryPipelineRunStatusSensorAsync by @bharanidharan14 in #589
• Fix GCP Dataproc DAG failed with timeout error by @rajaths010494 in #594
• Upgrade astro runtime image to latest release 5.0.7 by @pankajkoti in #592
• Add markdown-link-check config with retry & other options by @pankajkoti in #593
• Add support for Python3.10 for Databricks by @rajaths010494 in #599
• Release 1.8.0 by @rajaths010494 in #600

New Contributors

• @BasPH made their first contribution in #571
• @feluelle made their first contribution in #587

Full Changelog: 1.7.1...1.8.0

1.7.1

Check CHANGELOG.rst for summary of the changes included in this release.

What's Changed

• Bump to 1.8.0.dev1 by @phanikumv in #538
• Fix example DAG for failing bigquery integration test by @pankajkoti in #541
• Bump markupsafe version by @phanikumv in #542
• Change EMR EKS instance type by @phanikumv in #543
• Werkzeug version downgrade by @phanikumv in #551
• Release 1.7.1 by @phanikumv in #550

Full Changelog: 1.7.0...1.7.1

1.7.0

Check CHANGELOG.rst for summary of the changes included in this release.

What's Changed

• Bump version to 1.7.0.dev1 by @phanikumv in #481
• Implement Azure WasbBlobSensorAsync and WasbPrefixSensorAsync by @pankajkoti in #482
• Document Async Example DAG by @pankajastro in #473
• Implement BatchSensorAsync by @rajaths010494 in #483
• List installed pip packages used for running master DAG in Integration Tests deployment by @pankajkoti in #486
• Fix Hadoop and Create Bucket Task Dependency by @pankajastro in #487
• Update FileSensorAsync Example to Defer by @pankajastro in #489
• Add EMR Container Base Trigger by @pankajastro in #488
• Add missing example DAG in documentation by @pankajastro in #492
• Upgrade astro runtime image to 5.0.5 by @phanikumv in #494
• Fix example_async_bigquery_queries dependency by @pankajkoti in #496
• Fix example_batch DAG to check for job queue status. by @rajaths010494 in #500
• Revert "Update FileSensorAsync Example to Defer" by @pankajastro in #501
• Add make target to use pinned provider depedencies for testing an RC by @pankajkoti in #502
• Add copy button to Code Blocks in docs by @kaxil in #505
• Fix mypy errors by @kaxil in #506
• Add custom Sphinx extension to list available operators & sensors by @pankajkoti in #504
• Upgrade base Airflow image to use latest release by @pankajkoti in #509
• Implement Async Snowflake SQL API Operator by @bharanidharan14 in #478
• Fix mypy issue for token variable of sql_api_generate_jwt.py module by @pankajkoti in #519
• Add Airflow version in the Slack report for master DAG run by @pankajkoti in #521
• Add 15 mins sleep between deploying image & triggering master DAG by @pankajkoti in #517
• Fix async HTTP sensor failing with http: 4.0.0 by @pankajkoti in #515
• Fix RedshiftSQL Operator DAG failure by @bharanidharan14 in #522
• Add pre-commit hook to check for dead links in markdown files by @pankajkoti in #524
• Fix mypy issue occuring with release 1.7.0 by @pankajkoti in #531
• Create context object to fix failing test by @pankajkoti in #533
• Fix KPO unitest by @rajaths010494 in #535
• Release 1.7.0 by @phanikumv in #529

Full Changelog: 1.6.0...1.7.0

1.6.0

Check CHANGELOG.rst for summary of the changes included in this release.

What's Changed

• Bump version to 1.6.0.dev1 by @phanikumv in #445
• Add DataprocCreateClusterOperatorAsync by @pankajastro in #436
• Add DataprocDeleteClusterOperatorAsync by @pankajastro in #446
• Add async implementation for Redshift cluster deletion by @pankajkoti in #447
• Implement OL custom extractor for BigQuery Async operators by @pankajkoti in #429
• Fix module for livy test by @pankajastro in #455
• Update astro cloud image by @phanikumv in #457
• Add DataprocUpdateClusterOperatorAsync by @pankajastro in #449
• Add Snowflake query tag by @bharanidharan14 in #437
• Use async lib for DataprocSubmitJobOperatorAsync by @rajaths010494 in #453
• Handle dataproc create cluster error gracefully by @pankajastro in #448
• Implement RedshiftDataOperatorAsync by @pankajkoti in #467
• Fix BigQueryInsertJobOperatorAsync failure after the google provider upgrade by @rajaths010494 in #471
• Disable GKEStartPod Integration Test by @pankajastro in #475
• Fix: Keep the Python Filename Consistent by @pankajastro in #464
• Release 1.6.0 by @phanikumv in #480

Full Changelog: 1.5.0...1.6.0

1.5.0

Check CHANGELOG.rst for summary of the changes included in this release.

What's Changed

• Bump version to 1.5.0.dev1 by @phanikumv in #384
• GKEStartPodOperatorAsync by @raphaelauv in #347
• Enable perioding resuming to fetch logs for KPOA by @dstandish in #139
• Bump image tags to latest Airflow releases by @pankajkoti in #386
• Replace parameter for operator post removal of deprecated param by @pankajkoti in #387
• Fix Base Image Tag by @pankajastro in #389
• Add limitations for the AwsBaseHookAsync in doc-strings by @sunank200 in #388
• Fix unclosed client session error for KPOA by @pankajastro in #394
• Add retries arg in the default params for example DAGs by @pankajkoti in #398
• [Dataproc] Optimize Example DAG And Push Job ID in XCOM by @pankajastro in #399
• Reorder sequence for execution of tasks - example_adf_run_pipeline DAG by @pankajkoti in #405
• Remove location from DataprocSubmitJobOperatorAsync docstring by @pankajastro in #407
• Add missing docstrings by @kaxil in #409
• Implement BatchOperatorAsync by @phanikumv in #404
• GKEStartPodOperatorAsync POC by @pankajastro in #425
• Fix CI: Update CNCF.Kubernetes and Bigquery Test by @pankajastro in #439
• Fix location for GKE Integration Test by @pankajastro in #442
• Release 1.5.0 by @phanikumv in #444

New Contributors

• @raphaelauv made their first contribution in #347

Full Changelog: 1.4.0...1.5.0

1.4.0

Check CHANGELOG.rst for summary of the changes included in this release.

What's Changed

• Bump version to 1.4.0.dev1 by @phanikumv in #333
• Follow similar naming convention across EMR clusters by @phanikumv in #336
• Automate list of Extras in README.rst by @pankajastro in #329
• Reraise exceptions caught in except block by @pankajkoti in #338
• Fixup schedule for aws nuke DAG by @phanikumv in #340
• Update CONTRIBUTING.rst for integration test by @pankajastro in #334
• Update base Astronomer images to latest release tags by @pankajkoti in #341
• Nuke CloudFormation resource before EKSCluster by @phanikumv in #343
• Remove IMAGE_NAME args from docker-compose build target by @pankajkoti in #344
• Fix ingress port authorizations for Livy & Hive example DAGs by @pankajkoti in #342
• Loosen Airflow version pin to >=2.2.0 by @pankajkoti in #345
• Enhance command to be run inside KubernetesPodOperator by @pankajkoti in #349
• Fix Redshift DAGs to catch appropriate exceptions by @pankajkoti in #348
• Delay import of libraries to task scope by @pankajkoti in #354
• Reconstruct hook using connection ID in the extractor by @pankajkoti in #352
• Push dummy commit to test CI by @pankajkoti in #359
• Correct module name for DagStateTrigger by @tanelk in #361
• Remove unused logging.getLogger call by @pankajastro in #364
• Add template_fields to S3KeySensorAsync by @kaxil in #373
• Update ExternalTaskSensorAsync example dag to defer by @pankajastro in #370
• Add changelog for 1.3.1 by @kaxil in #374
• Remove nocast branching from bigquery hook get_records method by @pankajastro in #377
• Remove test_external_task_async_waits_for_me from master DAG by @pankajastro in #378
• Enable Kerberos Authentication in Async Hive Sensors by @rajaths010494 in #357
• Fix Example ExternalTaskSensorAsync DAG name mismatch by @pankajastro in #380
• Remove xcom push from execute_complete method by @pankajastro in #371
• Release 1.4.0 by @phanikumv in #383

New Contributors

• @tanelk made their first contribution in #361

Full Changelog: 1.3.0...1.4.0

1.3.1

Check CHANGELOG.rst for a summary of the changes included in this release.

What's Changed

• Update ExternalTaskSensorAsync example dag to defer by @pankajastro in #370
• Add template_fields to S3KeySensorAsync by @kaxil in #373
• Correct module name for DagStateTrigger by @tanelk in #361
• Fix Redshift DAGs to catch appropriate exceptions by @pankajkotiin #348
• Enhance command to be run inside KubernetesPodOperator by @pankajkoti in #349
• Fix ingress port authorizations for Livy & Hive example DAGs by @pankajkoti in #342
• Update contributing.rst for integration test by @pankajastro in #334
• Follow similar naming convention across EMR clusters by @phanikumv in #336
• Reraise exceptions caught in except block by @pankajkoti in #338
• Automate list of Extras in README.rst by @pankajastro in #329

Full Changelog: 1.3.0...1.3.1

1.3.0

What's Changed

• Bump version to 1.3.0.dev1 by @phanikumv in #225
• Fix bigquery hook skipping test by @pankajastro in #227
• Automate inventory list for all providers by @kaxil in #228
• Docs: Include docstrings from inherit class's __init__ by @kaxil in #229
• Add example_emr_sensor in integration test by @pankajastro in #230
• Capitalise module level constants by @pankajkoti in #233
• Livy operator async example dag by @sunank200 in #235
• Add pre-commit hooks for detecting private key & AWS Creds by @kaxil in #236
• Update Airflow Docker Image by @pankajastro in #245
• EMR container self sufficient example DAG by @bharanidharan14 in #242
• Remove Apache License from repo by @rajaths010494 in #250
• Update execution timeout for example DAG by @pankajastro in #249
• Move integration tests to astro cloud by @pankajastro in #244
• Add EmrContainerOperatorAsync by @pankajastro in #234
• Change default AWS region to us-east-2 across example DAGs by @pankajkoti in #256
• Fix LivyOperatorAsync example DAG by @pankajkoti in #252
• Check event status for DatabricksRunNowOperatorAsync by @shr3kst3r in #251
• Implement Async Azure data factory pipeline run status sensor by @bharanidharan14 in #253
• Add Microsoft ADF DAG in master for integration test by @bharanidharan14 in #260
• Implement HivePartitionSensorAsync by @rajaths010494 in #247
• Add AzureDataFactoryRunPipelineOperatorAsync by @pankajastro in #258
• Update hive table data path in HivePartitionSensorAsync by @rajaths010494 in #261
• Update docstring in HivePartitionSensorAsync by @rajaths010494 in #262
• Update CODEOWNERS by @rajaths010494 in #263
• Update Integration Dockerfile by @rajaths010494 in #264
• Update example DAG for AzureDataFactoryPipelineRunStatusSensorAsync by @pankajastro in #268
• Use Exception sub class in azure datafactory example DAG by @pankajastro in #269
• Make HivePartitionSensorAsync example dag self-sufficient. by @rajaths010494 in #278
• Update hive dag name in Integration Master dag by @rajaths010494 in #280
• Optimize resource usage in Databricks example DAG by @phanikumv in #287
• Fix example docs tag by @pankajastro in #285
• Enable aws-nuke to delete specified AWS resources by @phanikumv in #283
• Add note on closing GitHub milestone when releasing by @kaxil in #293
• Fix failing Databricks tests by @pankajkoti in #292
• Fixes for deploying integration tests on Astro Cloud by @pankajkoti in #297
• Upgrade base Airflow images to latest version by @pankajkoti in #301
• Add missing await on aysncio.sleep coroutine in Hive hook by @pankajkoti in #296
• Fix some of the docstrings by @kaxil in #305
• Add libsasl to ReadTheDocs build by @kaxil in #306
• Remove return stmt after yield from trigger by @pankajastro in #273
• Fix mypy type annotation issues by @pankajkoti in #303
• Replace os.environ.get to os.getenv by @pankajastro in #308
• Update staging image to ap-airflow:2.3.0-3 by @pankajkoti in #309
• Add implementation for OpenLineage custom extractor for BigQueryInsertJobOperatorAsync by @pankajkoti in #290
• Fix EMR EKS example DAG by @pankajkoti in #259
• Add NamedHivePartitionSensorAsync by @pankajastro in #288
• Fix S3 trigger unit tests by @phanikumv in #319
• Add missing docstring by @pankajastro in #316
• Include timeout on EmrContainerSensorTrigger by @pankajastro in #313
• Remove Flask from requirements by @kaxil in #325
• Officially Support Python 3.10 by @kaxil in #324
• Enable aws-nuke on astro cloud deployment by @phanikumv in #323
• Publish 1.3.0b1 by @kaxil in #326
• CI: Show installed deps before running tests by @kaxil in #327
• Add run step to deploy latest image to Astro Cloud nightly by @pankajkoti in #311
• Revert BigQueryAsyncExtractor to release 1.3.0 by @kaxil in #332
• Release 1.3.0 by @phanikumv in #317

New Contributors

• @pankajkoti made their first contribution in #233
• @shr3kst3r made their first contribution in #251

Full Changelog: 1.2.0...1.3.0

1.2.0

Check CHANGELOG.rst for summary of the changes included in this release.

What's Changed

• Bump version to 1.2.0.dev1 by @phanikumv in #152
• RedshiftClusterSensorAsync timeout fix and S3 conn name change by @pankajastro in #154
• Add top-level make command for building docs by @kaxil in #155
• Implement DataprocSubmitJobOperatorAsync by @rajaths010494 in #141
• Document limitations of some async operators by @kaxil in #158
• Run Example DAGs on Cloud envs by @pankajastro in #136
• Add timeout for all DAGs and dataproc and bigquery_sensors by @pankajastro in #168
• Automate releasing artifacts to PyPI by @kaxil in #156
• Update Docstrings for redshift cluster operators by @bharanidharan14 in #172
• Store databricks job_id in xcom for DatabricksSubmitRunOperatorAsync operator by @pankajastro in #161
• Fix Doc string for Operators by @bharanidharan14 in #169
• Remove kaxil from CODEOWNER by @kaxil in #174
• Automate redshift cluster creation by @pankajastro in #166
• Persist Databricks xcom value by @pankajastro in #175
• Update pre-commits hooks by @kaxil in #181
• Implement Async EMR container sensor async by @bharanidharan14 in #179
• Add EmrStepSensorAsync by @pankajastro in #184
• Implement Async EMR Job flow sensor by @bharanidharan14 in #193
• Update guidelines in CONTRIBUTING.rst by @rajaths010494 in #195
• bump up astro-runtime image version by @rajaths010494 in #200
• Fix Sphinx docs to have correct module paths by @kaxil in #205
• Docs: Sort API reference by Module Name by @kaxil in #206
• Implement LivyOperatorAsync by @sunank200 in #178
• Optimize example DAG for EmrJobFlowSensorAsync and EmrStepSensorAsync by @pankajastro in #203
• CircleCI job for automatic deployment and execution of Integration Suite by @pankajastro in #207
• Add flake8 check for logging in Pre-commit Hooks by @kaxil in #212
• Add flake8-bugbear in pre-commit hooks by @kaxil in #213
• Add pankajkoti as CODEOWNER by @phanikumv in #216
• Add trigger rule on last task of bigquery example DAG by @phanikumv in #217
• Fix the pre-commit dependency check by @phanikumv in #220
• Add Livy extra to README.rst by @phanikumv in #222
• Update default redshift db user in example DAG by @pankajastro in #211
• Releasing 1.2.0 by @phanikumv in #224

Full Changelog: 1.1.0...1.2.0

1.1.0

Check CHANGELOG.rst for summary of the changes included in this release.

What's Changed

• Use CodeCov for Code Coverage by @kaxil in #83
• Format Changelog by @kaxil in #84
• HotFix: Fix path from astronomer_operators to astronomer_providers by @sunank200 in #88
• Allow CodeCoverage toleration by @kaxil in #95
• Reorganize S3KeySensor and implement remaining S3 Sensors / Operators by @sunank200 in #86
• Implement GCSObjectsWithPrefixExistenceSensorAsync and GCSUploadSessionCompleteSensor by @rajaths010494 in #90
• Enable MyPy in strict mode by @kaxil in #60
• Implement Async S3PrefixSensor by @phanikumv in #91
• Add pydocstyle for docstring checks by @kaxil in #105
• Add more flake8 checks by @kaxil in #106
• Fix Code coverage by @bharanidharan14 in #107
• Fix bug in S3KeysUnchangedTrigger and is_key_unchanged in hook by @sunank200 in #109
• Fix example DAG to run standalone by @sunank200 in #110
• Implement Async GCS object update sensor by @bharanidharan14 in #93
• Add Apache Airflow classifiers by @kaxil in #111
• Split the dependencies into multiple extras by @kaxil in #113
• Add Delay to GCS sensors DAG by @bharanidharan14 in #117
• Add CODEOWNERS by @kaxil in #112
• Update the contributing guide by @sunank200 in #115
• Add Delay to GCS sensor by @bharanidharan14 in #118
• Fix file paths in CHANGELOG.rst by @kaxil in #121
• Dev: Add make command to rebuild Docker image by @kaxil in #123
• Add Sphinx to autogenerate user-facing docs by @sunank200 in #114
• Add pre-commit to keep package version in sync by @kaxil in #125
• Docs: Ignore Example DAGs from API reference by @kaxil in #131
• Remove path import for USER_AGENT_HEADER and declare it by @sunank200 in #133
• Parameterize example DAGs for integration tests by @pankajastro in #102
• Bug fix for gcs operator example by @pankajastro in #137
• Unpin Kubernetes Provider dependency by @kaxil in #138
• Implement Async Big Query Table Existence Sensor by @bharanidharan14 in #135
• Fix broken dependency of redshift sql example by @pankajastro in #144
• Fix Databricks triggerer fails to check databricks job state by @sunank200 in #147
• Bug fix on example_bigquery_sensors.py dag by @rajaths010494 in #151
• Fix docstrings for BigQueryTableExistenceSensorAsync by @kaxil in #150
• Add bandit pre-commit for Security scanning by @kaxil in #142
• Bump to Release 1.1.0 by @phanikumv in #149

Full Changelog: 1.0.0...1.1.0