No release too small

Changelog

0.14.10

Released on February 23, 2021.

Fixes

• Dynamically import compression libraries for CompressedSerializer - #4150
• Support passing environment variables containing = through agent CLI --env flag - #4160

Compressed client timeouts that filter sync tasks to reduce deprecated client sessions

Changelog

0.14.9

Released on February 16, 2021.

Enhancements

• Add CompressedSerializer class - #4063
• Allow Client timeout seconds to be configurable through configuration - #4118

Task Library

• Update FilterTask to allow logging the filtered output via a function - #4121
• Add FivetranSyncTask, to manage your Fivetran connector sync process - #4116

Fixes

• Reduce the number of boto3 clients created across Prefect when interacting with AWS services - #4115

Deprecations

• Deprecate the use_session argument in all AWS-related components - #4115

Contributors

• Amanda Wee
• Andrew Hannigan
• Craig Wright
• Nick Acosta
• Timo S.

0.14.7++

Changelog

0.14.8

Released on February 11, 2021.

Enhancements

• Add option to provide version group ID to prefect run flow CLI command - #4100

Fixes

• Fix bug in agent healthcheck route that was introduced in 0.14.7 - #4109

I'm prepared to go forward with it

Changelog

0.14.7

Released on February 10, 2021.

Enhancements

• Support multiple docker networks with Docker Agent - #3986
• Add healthchecks to prefect server - #4041
• Raise custom TimeoutError for task timeouts to allow for more granular user control - #4091
• Add access_token_secret to GitHub, GitLab, and Bitbucket storage, making the Prefect secret containing an access token to these services configurable - #4059
• Add --skip-if-flow-metadata-unchanged to prefect register flow CLI command that avoids bumping flow version if flow metadata has not changed - #4061
• Add --skip-if-exists to prefect create project CLI command that safely skips if the project has already been created - #4061
• Add new Module storage class, for referencing flows importable from a Python module - #4073
• Drop resource limits from manifest generated using prefect agent kubernetes install - #4077

Task Library

• Add new tasks for communication with an Exasol database - #4044

Fixes

• Fix task decorator chaining by using inspect.unwrap instead of __wrap__ - #4053
• Forward Prefect backend type to deployed flow runs, ensuring backend-specific logic functions properly - #4076
• Patch around bug in dask's multiprocessing scheduler introduced in Dask 2021.02.0 - #4089

Deprecations

• Docker agent network kwarg deprecated in favor of networks - #3986

Breaking Changes

• Remove unused Storage.get_env_runner method - #4059
• Remove private utilities in prefect.utilities.git - #4059

Contributors

• Alex P.
• Marwan S.
• Peter Roelants
• Timo S.

Yet Another Tuesday Release

Changelog

0.14.6

Released on February 2, 2021.

Enhancements

• Add option to provide flow ID to run flow CLI command - #4021
• Flow name and project are no longer required options when calling run flow CLI command - #4021

Task Library

• Add GCSBlobExists which checks for the existence of an object in a given GCS bucket - #4025
• Use boto3 session in S3Upload and S3Download tasks, to ensure thread-safe execution - #3981

Fixes

• Fix issue with fixed duration Paused states not resuming properly - #4031

Contributors

• Gregory Roche

Logs and Warnings and Errors, Oh My!

Changelog

0.14.5

Released on January 26, 2021.

Enhancements

• S3 storage now logs ETag, LastModified timestamp, and VersionId (if present) when loading a flow - #3995
• GitHub storage now logs the commit sha used when loading a flow - #3998
• GitHub storage now loads from a repo's default branch, allowing default branch names other than 'master' - #3998
• Improve error message when Secrets are missing with Server - #4003
• Better error message when passing parameters to StartFlowRun constructor - #4008
• Add warning if user-defined class shadows an attribute used by the base class - #4011
• Add support for EXTRA_PIP_PACKAGES environment variable in prefecthq/prefect images, simplifying installation of dependencies during development - #4013
• Add execution role arn parameter to ecs run config and agent - #4015

Task Library

• Add ConnectGetNamespacedPodExec task which runs an exec command in provided pod container - #3991
• Ensure connection secrets can be passed to Databricks tasks at runtime - #4001

Fixes

• Fix Agent registration possibly skipping on server connection issues - #3972
• GCSUpload task now explicitely fails when ran on non-supported types - #3978
• Make logging to Prefect cloud more robust in the presence of errors or process shutdown - #3989
• Handle setting state for missing flow runs in Kubernetes agent resource management - #4006

Contributors

• Loïc Macherel
• Thomas Baldwin

0.0.2 more than 0.14.2

Changelog

0.14.4

Released on January 19, 2021.

Enhancements

• Retry on additional status codes - #3959
• Rerun secret tasks on flow-run restart - #3977

Task Library

• Stream log output from Kubernetes RunNamespacedJob - #3715
• Add ReadNamespacedPodLogs which reads or streams logs from Kubernetes pod - #3715
• Add SQL Server task to query SQL Server databases - #3958
• Add chunking to GCP storage tasks - #3968

Fixes

• Properly handle NotImplementedError exceptions raised by a result's serializer - #3964
• Fix support for storing multiple flows in a single script in storage - #3969
• Fix regression in apply_map which prevented use in case/resource_manager blocks - #3975

Contributors

• Joël Luijmes
• Peyton Runyan
• wangjoshuah

0.0.1 more than 0.14.2

Changelog

0.14.3

Released on January 13, 2021.

Enhancements

• Better errors/warnings when flow fails to load in execution environment - #3940

Task Library

• Add an Asana task to add tasks to an asana project - #3935

Fixes

• Fix prefect server start failure when given a custom graphql host port - #3933
• Fix Kubernetes Agent attempting to report container info for failed pods when no container statuses are found - #3941
• Avoid race condition when creating task run artifacts for mapped tasks - #3953
• Propogate agent labels info to k8s flow runs, to match other agent behavior - #3954

2021: Friend or Foe?

Changelog

Released on January 6, 2021.

Features

• Support for specifying run_config for an individual flow run - #3903

Enhancements

• Allow the usage of a profile_name on get_boto_client - #3916
• Support executing Prefect agents/flows without having the prefect CLI on path - #3918

Task Library

• Add support for specifying a run_config in StartFlowRun - #3903
• Task to add Trello card for task library - #3910

Fixes

• Remove unused description field on Task serializer - #3917
• Fix edge case in apply_map that resulted in cycles in the Flow graph - #3920
• Support storing multiple local flows with the same name when using Local storage - #3923
• Fix bug in prefect.context contextmanager that resulted in context fields reverting to their initially configured values - #3924

Contributors

• Albert Franzi
• Allyson Lubimir

Last Release of 2020! (hopefully)

Changelog

0.14.1

Released on December 29, 2020.

Enhancements

• Make setup method optional for resource_manager tasks - #3869
• Add labels to all containers managed by the docker agent - #3893
• Add prefect server stop command for stopping the server - #3899
• Add --detach to prefect server start for running the server in the background - #3899

Fixes

• Add support for google-cloud-storage < 1.31.0 - #3875
• Fix use of imagePullSecrets/serviceAccountName in k8s agent - #3884
• Fix read_bytes_from_path to work properly with S3 - #3885
• Change default idempotency_key in StartFlowRun to use task_run_id instead of flow_run_id - #3892