What's in a name?

Changelog

0.13.10

Released on October 6, 2020.

Enhancements

• Add option to template task run name at runtime when using backend API - #2100
• Add set_task_run_name Client function - #2100
• Use from to explicitly chain exceptions - #3306
• Update error message when registering flow to non-existant project - #3418
• Add flow.run_config, an experimental design for configuring deployed flows - #3333
• Allow python path in Local storage - #3351
• Enable agent registration for server users - #3385

Task Library

• Add keypair auth for snowflake - #3404
• Add new RenameFlowRunTask for renaming a currently running flow - #3285.

Fixes

• Fix mypy typing for target kwarg on base Task class - #2100
• Fix Fargate Agent not parsing cpu and memory provided as integers - #3423
• Fix MySQL Tasks breaking on opening a context - #3426

Contributors

• Ian Fridge
• Jack D. Sundberg
• Juan Calderon-Perez
• Max Del Giudice
• Paras Luthra
• Tenzin Choedak

Small But Mighty

Changelog

0.13.9

Released on September 29, 2020.

Features

• Allow for scheduling the same flow at the same time with multiple parameter values - #2510

Enhancements

• Adopt explicit exception chaining in more places - #3306
• Add DateTimeParameter - #3327

Task Library

• New task for the task library to create an item in Monday - #3387
• Add option to specify run_name for FlowRunTask - #3393

Contributors

• Nejc Vesel
• Sumit Datta

Practice makes prefect

0.13.8

Released on September 22, 2020.

Enhancements

• Allow passing context values as JSON string from CLI - #3347
• Allow copying of directories into Docker image - #3299
• Adds schedule filters for month end or month start and specific day - #3330
• Support configuring executor on flow, not on environment - #3338
• Support configuring additional docker build commands on Docker storage - #3342
• Support submission retries within the k8s agent - #3344
• Expose flow_run_name to flow.run() for local runs - #3364

Task Library

• Add contributing documentation for task library - #3360
• Remove duplicate task library documentation in favor of API reference docs - #3360

Fixes

• Fix issue with constants when copying Flows - #3319
• Fix DockerAgent with --show-flow-logs to work on windows/osx (with python >= 3.8) - #3339
• Fix mypy type checking for tasks created with prefect.task - #3346
• Fix bug in flow.visualize() where no output would be generated when running with PYTHONOPTIMIZE=1 - #3352
• Fix typo in DaskCloudProviderEnvironment logs - #3354

Deprecations

• Deprecate the use of the /contrib directory - #3360
• Deprecate importing Databricks and MySQL tasks from prefect.contrib.tasks, should use prefect.tasks instead - #3360

Contributors

• David Severin Ryberg
• James Lamb
• Nejc Vesel

How many devs does it take to fix some bugs?

0.13.7

Released on September 16, 2020.

Enhancements

• Use explicit exception chaining #3306
• Quiet Hasura logs with prefect server start - #3296

Fixes

• Fix issue with result configuration not being respected by autogenerated tasks - #2989
• Fix issue with result templating that failed on task arguments named 'value' - #3034
• Fix issue restarting Mapped pipelines with no result- #3246
• Fix handling of Prefect Signals when Task state handlers are called - #3258
• Allow using apply_map under a case or resource_manager block - #3293
• Fix bug with interaction between case blocks and Constant tasks which resulted in some tasks never skipping - #3293
• Fix bug in DaskExecutor where not all client timeouts could be configured via setting distributed.comm.timeouts.connect - #3317

Task Library

• Adds a compression argument to both S3Upload and S3Download, allowing for compression of data upon upload and decompression of data upon download - #3259

Contributors

• Eric Lundy
• James Lamb
• Max Del Giudice

I <3 Contributors

Changelog

0.13.6

Released on September 9, 2020.

Enhancements

• Adds logger to global context to remove friction on running task unit tests - #3256
• Expand FunctionTask AttributeError Message - #3248
• Add backend info to diagnostics - #3265
• Ellipsis Support for GraphQL DSL - #3268

Task Library

• Add DatabricksRunNow task for running Spark jobs on Databricks - #3247
• Add GitHub CreateIssueComment task - #3269
• Add S3List task for listing keys in an S3 bucket - #3282
• Add boto_kwargs to AWS tasks - #3275

Fixes

• Make identifier optional in KubernetesAgent.replace_job_spec_yaml() - #3251
• Change https://localhost to http://localhost in the welcome message - #3271

Contributors

• Ashmeet Lamba
• Ashton Sidhu
• Bas Nijholt
• Harutaka Kawamura
• James Lamb
• Max Del Giudice
• Robin Beer
• Rowan Molony
• Shunwen

Incrementally better than 0.13.4

Changelog

0.13.5

Released on September 1, 2020.

Enhancements

• Begin storing the width of mapped pipelines on the parent Mapped state - #3233
• Kubernetes agent now manages lifecycle of prefect jobs in its namespace - #3158
• Move agent heartbeat to background thread - #3158
• Handles ModuleNotFound errors in the storage healthcheck - #3225
• Raises the warnings.warn stack level to 2 to reduce duplicate warning messages - #3225
• Add some extra output to the client.register print output for visibility - #3225
• CLI help text docstrings are now auto documented using the API documentation parser - #3225
• DaskExecutor now logs dask worker add/removal events - #3227

Fixes

• Fix issue with passing --env-vars flag to K8s Agent Install manifest - #3239
• Fix edge case with add_edge method - #3230

Deprecations

• Kubernetes resource manager is now deprecated and the functionality is moved into the Kubernetes agent - #3158

Contributors

• shaunc

5 Enhancements, 1 new Task, 3 Bug Fixes

Changelog

0.13.4

Released on August 25, 2020.

Enhancements

• Allow for setting path to a custom job YAML spec on the Kubernetes Agent - #3046
• Use better coupled versioning scheme for Core / Server / UI images - #3204
• Added option to mount volumes with KubernetesAgent - #1234
• Add more kwargs to State.children and State.parents for common access patterns - #3212
• Reduce size of prefecthq/prefect Docker image - #3215

Task Library

• Add DatabricksSubmitRun task for submitting Spark jobs on Databricks - #3166

Fixes

• Fix Apollo service error output while waiting for GraphQL service with prefect server start - #3150
• Fix --api CLI option not being respected by agent Client - #3186
• Fix state message when using targets - #3216

Contributors

• Ashton Sidhu
• Chris Martin
• Juan Calderon-Perez
• Thomas Frederik Hoeck
• VincentTNR
• emcake

A Log Log Time Ago

Changelog

0.13.3

Released on August 18, 2020.

Enhancements

• Make use of kubernetes extra logger in the DaskKubernetesEnvironment optional - #2988
• Make Client robust to simplejson - #3151
• Raise Warning instead of Exception during storage healthcheck when Result type is not provided - #3146
• Add server create-tenant for creating a tenant on the server - #3147
• Cloud logger now responds to logging level - #3179

Task Library

• Add support for host_config and arbitrary keyword arguments in Docker tasks - #3173

Fixes

• Fix empty string imagePullSecrets issue on AKS by removing if not set - #3142
• Fix querying for cached states with no cache_key - #3168
• Fix access to core_version in Agent's get_flow_run_command() - #3177

Breaking Changes

• DaskKubernetesEnvironment no longer logs Kubernetes errors by default - #2988
• Logging level in Cloud now defaults to INFO - #3179

Contributors

• James Lamb
• Nelson Cornet
• Zach Angell

Pandas don't even eat cereal

Changelog

0.13.2

Released on August 11, 2020.

Features

• Pandas DataFrame Serializer - #3020, #2963, #2917

Enhancements

• Agents set flow run execution command based on flow's core version - #3113
• Clean up extra labels on jobs created by Kubernetes agent - #3129

Task Library

• Return LoadJob object in BigQueryLoad tasks - #3086

Fixes

• Fix bug with LocalDaskExecutor('processes') that allowed tasks to be run multiple times in certain cases - #3127
• Add toggle to bypass bug in slack_notifier that attempted to connect to backend even if the backend didn't exist - #3136

Contributors

• Andrew Schechtman-Rook
• Franklin Winokur
• Fraznist
• Jackson Maxfield Brown

Fix Default Agent Execute Command

Changelog

0.13.1

Released on August 6, 2020.

Fixes

• Fix issue with 0.13.0 agents not able to run Flows registered with older Core versions - #3111