Skip to content

Go with the FlowRunTask

Compare
Choose a tag to compare
@lauralorenz lauralorenz released this 21 Jul 20:31
0c6e874

Changelog

Released on July 21, 2020.

Features

  • Add resource_manager api for cleaner setup/cleanup of temporary resources - #2913

Enhancements

  • Add new_flow_context to FlowRunTask for configurable context - #2941
  • All storage types now support file-based storage - #2944
  • Turn work stealing ON by default on Dask K8s environment - #2973
  • Send regular heartbeats while waiting to retry / dequeue - #2977
  • Cached states now validate based on hashed_inputs for more efficient storage - #2984
  • Simplify creation of optional parameters with default of None - #2995

Task Library

  • Implement AWSSecretsManager task - #2069
  • Update return value and config for DbtShellTask - #2980

Fixes

  • Don't send idempotency key when running against a local backend - #3001
  • Fix bug in DaskExecutor when running with external cluster where dask clients could potentially be leaked - #3009

Deprecations

  • All states have deprecated the usage of cached_inputs - #2984

Breaking Changes

  • Remove password from Postgres tasks' initialization methods for security - #1345

Contributors