Release 0.14.21

Features

• Add interface for backend key-value metadata store - #4499

Enhancements

• Keep intermediate docker layers when using Docker Storage to improve caching - #4584

Fixes

• Fix possible race condition in LocalResult directory creation - #4587
• Use absolute paths when registering flows in prefect register - #4593
• Propagate storage labels (e.g. hostname label on Local storage) when registering flows with prefect register - #4593
• Fix small-flow parallelism issues with multiprocess LocalDaskExecutor - #4602
• Cleanly handle unpicklable exceptions in tasks - #4605

Contributors

• Tom Forbes

Release 0.14.20

Changelog

0.14.20

Released on May 25, 2021.

Enhancements

• Refactor Agent base class for readability - #4341
• Display the agent config id on agent startup if set - #4524
• Add debug logs during agent auth verification - #4547
• Sending logs to Cloud can be globally disabled via config in addition to the agent flag - #4487

Task Library

• Enable sending attachments with emails in the EmailTask - #4457
• Add Google Cloud Platform GCPSecret task - #4561

Fixes

• Fix import_object handling of submodules that are not attributes - #4513
• Fix DockerStorage building with python slim image - #4523
• Gracefully handle events with missing timestamps in K8s agent - #4544
• Fix bug where agent uses originally scheduled start time instead of latest state time - #4568

Deprecations

• logging.log_to_cloud has been deprecated in favor of cloud.send_flow_run_logs - #4487

Contributors

• Stéphan Taljaard
• Thomas Heyenbrock

Version 0.14.19

Changelog

0.14.19

Released on May 11, 2021 as a hotfix for 0.14.18

Fixes

• Fix docker container name error while using docker agents - #4511

Version 0.14.18

Changelog

0.14.18

Released on May 11, 2021.

Enhancements

• Add an image_pull_policy kwarg to KubernetesRun - #4462
• Allow prefect build/register --module to accept full import path to flow - #4468
• Add hello world flow to prefect module - #4470
• Set docker container names to flow run names when running with the docker agent - #4485

Task Library

• Add basic implementation of SendGrid to Task Library - #4450
• Log link to flow run in StartFlowRun - #4458
• Allow passing in io.BytesIO to GCSUpload - #4482

Fixes

• Fix logging errors within BigQuery task - #4419
• Remove unnecessary docker interface detection in Docker agent - #4446
• Upgrade kubernetes package requirement upper limit - #4452
• Fix Prefect server startup check for custom server port - #4501

Contributors

• Brett Naul
• Joël Luijmes
• Stéphan Taljaard
• Zach Schumacher

0.14.17

Features

• Add git storage - #4418

Enhancements

• Add test coverage for threaded LocalDaskExecutor timeouts - #4217
• Add environment variable support to UniversalRunConfig - #4383
• Adds column name fetching to PostgresFetch task - #4414
• Allow external Postgres with prefect server start command - #4424

Fixes

• Pass reference tasks states instead of task states to terminal_state_handler - #4409
• Check for AWS_RETRY_MODE variable before setting default in ECSAgent - #4417
• Fixed bug from Flow.copy() not copying the slugs dictionary - #4435
• Fix compatibility with PyGithub >= 1.55 - #4440

Contributors

• Ben Fogelson
• Gabriel Montañola

0.14.16: Helpful on failure!

Changelog

April 14, 2021

Released on April 14, 2021.

Enhancements

• Added support for Bitbucket cloud into Bitbucket storage class #4318
• Update docs for API keys - #4313
• Add option to disable the deletion of finished Prefect jobs in the Kubernetes agent - #4351
• Improve messaging when a flow is skipped during registration - #4373
• Display a more helpful error when calling a task outside a flow context - #4374
• Lower required docker-compose version and add note to docs - #4396
• Increase healthcheck intervals for Prefect Server - #4396
• Allow the ShellTask to be used on win32 - #4397

Fixes

• Fix ShellTask docstring - #4360
• Fix incorrect unused task tracking - #4368
• Add error handling to timeouts that fail during result pickling or passing - #4384

Contributors

• Jonathan Wright

Michael's first release

Names are hard and stressful.

Changelog

April 05, 2021

Released on April 5, 2021.

Enhancements

• Add terminal flow state handler override - #4198
• When manually set, prefect.context.date will be used to determine dependent values - #4295
• prefect.context.date will be cast to a DateTime object if given a parsable string - #4295
• Expand logging for DaskExecutor, including the cluster dashboard address (if available) - #4321
• Add ability to stream ShellTask logs with level INFO - #4322
• Add architecture diagram to docs - #4187
• Speed up flow validation logic - #4347
• Pin dask upper package versions - #4350

Task Library

• Add first basic implementation of Soda SQL Scan task to run DQ tests using soda-sql library
• Add new task KubernetesSecret - #4307

Fixes

• Fix DatabricksRunNow task attribute override behavior - #4309
• Use default flow labels when triggering flow runs from CLI - #4316
• Improve ECS agent error messages, and fix bug that prevented using ECS agent on Fargate with ECR - #4325
• Support imports from local directory when registering/building flows via CLI - #4332
• Speedup flushing of logs to cloud/server on flow run shutdown, avoiding lost logs on platforms that SIGKILL the process after a short period - #4334

Contributors

• Alessandro Lollo
• David Zucker
• Greg Lu
• James Lamb
• Sean Talia

0.14.13 + 0.0.1

Changelog

Released on March 25, 2021.

Task Library

• Ensures Snowflake Query Task output is serializable [#3744] (#3744)

Fixes

• Always load task run info prior to running a task - #4296

Version 0.14.13

Changelog

Released on March 24, 2021.

Features

• Add new improved prefect register CLI command. This command supports registering multiple flows at once (through multiple file paths or directories), and also includes a new --watch flag for watching files and automatically re-registering upon changes. - #4256
• New prefect build CLI command for building flows. Artifacts produced by this command can then be used by prefect register to register flows without requiring the source. - #4282

Enhancements

• Use explicit exception chaining #3306
• Add as_bytes option to S3Download task - #4238
• Improve error message when a loaded flow doesn't match the version stored in Prefect Cloud/Server - #4259
• Support setting flow run labels from cli - #4266
• Support setting default image in --job-template/--task-definition in Kubernetes/ECS agents - #4270

Task Library

• Adds logging of cell outputs to Jupyter task - [#4265] (#4265)
• Add user and password as runtime parameters to Exasol tasks - #4268

Fixes

• Fix bug where sometimes the global prefect.context wouldn't be respected during a flow run - #4287

Deprecations

• Deprecate the old prefect register flow CLI command in favor of prefect register - #4256
• Deprecate user and password arguments to Exasol task constructors in favor of runtime parameters - #4268

Contributors

• Abid Ahmad
• Alexandr N. Zamaraev
• Jacob Hayes
• Timo S.

Version 0.14.12

Changelog

0.14.12

Released on March 10, 2021.

Enhancements

• Upgrade hasura to 1.3.3 in Prefect Server - #4126
• Add --docker-client-timeout flag to docker agent, for configuring the timeout for all docker API requests - #4232
• Make --slug flag optional in prefect server create-tenant - #4240
• Move command, environment, cpu, memory, execution_role_arn, and task_role_arn configuration for ECS tasks from definition time to run time in the ECS agent - #4211
• Register (and deregister) a new task definition for every flow run in ECS agent - #4211

Task Library

• Adds new filesystem Copy and Remove tasks - #4202

Fixes

• Don't forward nout to mapped tasks - #4206
• Fix Task signature generation in the presence of with variadic kwargs - #4235
• Ensure Flow is serializable using pickle - #4209

Contributors

• Ben Fogelson
• Marwan S.
• Timo S.