Skip to content

Releases: PrefectHQ/prefect

Release 0.14.21

02 Jun 18:10
1867f20
Compare
Choose a tag to compare

Features

  • Add interface for backend key-value metadata store - #4499

Enhancements

  • Keep intermediate docker layers when using Docker Storage to improve caching - #4584

Fixes

  • Fix possible race condition in LocalResult directory creation - #4587
  • Use absolute paths when registering flows in prefect register - #4593
  • Propagate storage labels (e.g. hostname label on Local storage) when registering flows with prefect register - #4593
  • Fix small-flow parallelism issues with multiprocess LocalDaskExecutor - #4602
  • Cleanly handle unpicklable exceptions in tasks - #4605

Contributors

Release 0.14.20

25 May 23:04
62934b9
Compare
Choose a tag to compare

Changelog

0.14.20

Released on May 25, 2021.

Enhancements

  • Refactor Agent base class for readability - #4341
  • Display the agent config id on agent startup if set - #4524
  • Add debug logs during agent auth verification - #4547
  • Sending logs to Cloud can be globally disabled via config in addition to the agent flag - #4487

Task Library

  • Enable sending attachments with emails in the EmailTask - #4457
  • Add Google Cloud Platform GCPSecret task - #4561

Fixes

  • Fix import_object handling of submodules that are not attributes - #4513
  • Fix DockerStorage building with python slim image - #4523
  • Gracefully handle events with missing timestamps in K8s agent - #4544
  • Fix bug where agent uses originally scheduled start time instead of latest state time - #4568

Deprecations

  • logging.log_to_cloud has been deprecated in favor of cloud.send_flow_run_logs - #4487

Contributors

Version 0.14.19

12 May 01:09
ffa9e89
Compare
Choose a tag to compare

Changelog

0.14.19

Released on May 11, 2021 as a hotfix for 0.14.18

Fixes

  • Fix docker container name error while using docker agents - #4511

Version 0.14.18

11 May 20:41
7e4db55
Compare
Choose a tag to compare

Changelog

0.14.18

Released on May 11, 2021.

Enhancements

  • Add an image_pull_policy kwarg to KubernetesRun - #4462
  • Allow prefect build/register --module to accept full import path to flow - #4468
  • Add hello world flow to prefect module - #4470
  • Set docker container names to flow run names when running with the docker agent - #4485

Task Library

  • Add basic implementation of SendGrid to Task Library - #4450
  • Log link to flow run in StartFlowRun - #4458
  • Allow passing in io.BytesIO to GCSUpload - #4482

Fixes

  • Fix logging errors within BigQuery task - #4419
  • Remove unnecessary docker interface detection in Docker agent - #4446
  • Upgrade kubernetes package requirement upper limit - #4452
  • Fix Prefect server startup check for custom server port - #4501

Contributors

0.14.17

27 Apr 20:59
1e63886
Compare
Choose a tag to compare

Features

  • Add git storage - #4418

Enhancements

  • Add test coverage for threaded LocalDaskExecutor timeouts - #4217
  • Add environment variable support to UniversalRunConfig - #4383
  • Adds column name fetching to PostgresFetch task - #4414
  • Allow external Postgres with prefect server start command - #4424

Fixes

  • Pass reference tasks states instead of task states to terminal_state_handler - #4409
  • Check for AWS_RETRY_MODE variable before setting default in ECSAgent - #4417
  • Fixed bug from Flow.copy() not copying the slugs dictionary - #4435
  • Fix compatibility with PyGithub >= 1.55 - #4440

Contributors

0.14.16: Helpful on failure!

14 Apr 16:58
33724b9
Compare
Choose a tag to compare

Changelog

April 14, 2021

Released on April 14, 2021.

Enhancements

  • Added support for Bitbucket cloud into Bitbucket storage class #4318
  • Update docs for API keys - #4313
  • Add option to disable the deletion of finished Prefect jobs in the Kubernetes agent - #4351
  • Improve messaging when a flow is skipped during registration - #4373
  • Display a more helpful error when calling a task outside a flow context - #4374
  • Lower required docker-compose version and add note to docs - #4396
  • Increase healthcheck intervals for Prefect Server - #4396
  • Allow the ShellTask to be used on win32 - #4397

Fixes

  • Fix ShellTask docstring - #4360
  • Fix incorrect unused task tracking - #4368
  • Add error handling to timeouts that fail during result pickling or passing - #4384

Contributors

Michael's first release

05 Apr 23:40
9499eba
Compare
Choose a tag to compare

Names are hard and stressful.

Changelog

April 05, 2021

Released on April 5, 2021.

Enhancements

  • Add terminal flow state handler override - #4198
  • When manually set, prefect.context.date will be used to determine dependent values - #4295
  • prefect.context.date will be cast to a DateTime object if given a parsable string - #4295
  • Expand logging for DaskExecutor, including the cluster dashboard address (if available) - #4321
  • Add ability to stream ShellTask logs with level INFO - #4322
  • Add architecture diagram to docs - #4187
  • Speed up flow validation logic - #4347
  • Pin dask upper package versions - #4350

Task Library

  • Add first basic implementation of Soda SQL Scan task to run DQ tests using soda-sql library
  • Add new task KubernetesSecret - #4307

Fixes

  • Fix DatabricksRunNow task attribute override behavior - #4309
  • Use default flow labels when triggering flow runs from CLI - #4316
  • Improve ECS agent error messages, and fix bug that prevented using ECS agent on Fargate with ECR - #4325
  • Support imports from local directory when registering/building flows via CLI - #4332
  • Speedup flushing of logs to cloud/server on flow run shutdown, avoiding lost logs on platforms that SIGKILL the process after a short period - #4334

Contributors

0.14.13 + 0.0.1

26 Mar 00:26
e4533bd
Compare
Choose a tag to compare

Changelog

Released on March 25, 2021.

Task Library

  • Ensures Snowflake Query Task output is serializable [#3744] (#3744)

Fixes

  • Always load task run info prior to running a task - #4296

Version 0.14.13

24 Mar 22:41
05cac23
Compare
Choose a tag to compare

Changelog

Released on March 24, 2021.

Features

  • Add new improved prefect register CLI command. This command supports registering multiple flows at once (through multiple file paths or directories), and also includes a new --watch flag for watching files and automatically re-registering upon changes. - #4256
  • New prefect build CLI command for building flows. Artifacts produced by this command can then be used by prefect register to register flows without requiring the source. - #4282

Enhancements

  • Use explicit exception chaining #3306
  • Add as_bytes option to S3Download task - #4238
  • Improve error message when a loaded flow doesn't match the version stored in Prefect Cloud/Server - #4259
  • Support setting flow run labels from cli - #4266
  • Support setting default image in --job-template/--task-definition in Kubernetes/ECS agents - #4270

Task Library

  • Adds logging of cell outputs to Jupyter task - [#4265] (#4265)
  • Add user and password as runtime parameters to Exasol tasks - #4268

Fixes

  • Fix bug where sometimes the global prefect.context wouldn't be respected during a flow run - #4287

Deprecations

  • Deprecate the old prefect register flow CLI command in favor of prefect register - #4256
  • Deprecate user and password arguments to Exasol task constructors in favor of runtime parameters - #4268

Contributors

Version 0.14.12

10 Mar 23:06
dea6358
Compare
Choose a tag to compare

Changelog

0.14.12

Released on March 10, 2021.

Enhancements

  • Upgrade hasura to 1.3.3 in Prefect Server - #4126
  • Add --docker-client-timeout flag to docker agent, for configuring the timeout for all docker API requests - #4232
  • Make --slug flag optional in prefect server create-tenant - #4240
  • Move command, environment, cpu, memory, execution_role_arn, and task_role_arn configuration for ECS tasks from definition time to run time in the ECS agent - #4211
  • Register (and deregister) a new task definition for every flow run in ECS agent - #4211

Task Library

  • Adds new filesystem Copy and Remove tasks - #4202

Fixes

  • Don't forward nout to mapped tasks - #4206
  • Fix Task signature generation in the presence of with variadic kwargs - #4235
  • Ensure Flow is serializable using pickle - #4209

Contributors