Releases: PrefectHQ/prefect
Releases · PrefectHQ/prefect
What's in a name?
Changelog
0.13.10
Released on October 6, 2020.
Enhancements
- Add option to template task run name at runtime when using backend API - #2100
- Add
set_task_run_name
Client function - #2100 - Use
from
to explicitly chain exceptions - #3306 - Update error message when registering flow to non-existant project - #3418
- Add
flow.run_config
, an experimental design for configuring deployed flows - #3333 - Allow python path in Local storage - #3351
- Enable agent registration for server users - #3385
Task Library
- Add keypair auth for snowflake - #3404
- Add new
RenameFlowRunTask
for renaming a currently running flow - #3285.
Fixes
- Fix mypy typing for
target
kwarg on base Task class - #2100 - Fix Fargate Agent not parsing cpu and memory provided as integers - #3423
- Fix MySQL Tasks breaking on opening a context - #3426
Contributors
Small But Mighty
Changelog
0.13.9
Released on September 29, 2020.
Features
- Allow for scheduling the same flow at the same time with multiple parameter values - #2510
Enhancements
Task Library
- New task for the task library to create an item in Monday - #3387
- Add option to specify
run_name
forFlowRunTask
- #3393
Contributors
Practice makes prefect
0.13.8
Released on September 22, 2020.
Enhancements
- Allow passing context values as JSON string from CLI - #3347
- Allow copying of directories into Docker image - #3299
- Adds schedule filters for month end or month start and specific day - #3330
- Support configuring executor on flow, not on environment - #3338
- Support configuring additional docker build commands on
Docker
storage - #3342 - Support submission retries within the k8s agent - #3344
- Expose
flow_run_name
toflow.run()
for local runs - #3364
Task Library
- Add contributing documentation for task library - #3360
- Remove duplicate task library documentation in favor of API reference docs - #3360
Fixes
- Fix issue with constants when copying Flows - #3319
- Fix
DockerAgent
with--show-flow-logs
to work on windows/osx (with python >= 3.8) - #3339 - Fix mypy type checking for tasks created with
prefect.task
- #3346 - Fix bug in
flow.visualize()
where no output would be generated when running withPYTHONOPTIMIZE=1
- #3352 - Fix typo in
DaskCloudProviderEnvironment
logs - #3354
Deprecations
- Deprecate the use of the
/contrib
directory - #3360 - Deprecate importing
Databricks
andMySQL
tasks fromprefect.contrib.tasks
, should useprefect.tasks
instead - #3360
Contributors
How many devs does it take to fix some bugs?
0.13.7
Released on September 16, 2020.
Enhancements
Fixes
- Fix issue with result configuration not being respected by autogenerated tasks - #2989
- Fix issue with result templating that failed on task arguments named 'value' - #3034
- Fix issue restarting Mapped pipelines with no result- #3246
- Fix handling of Prefect Signals when Task state handlers are called - #3258
- Allow using
apply_map
under acase
orresource_manager
block - #3293 - Fix bug with interaction between
case
blocks andConstant
tasks which resulted in some tasks never skipping - #3293 - Fix bug in
DaskExecutor
where not all client timeouts could be configured via settingdistributed.comm.timeouts.connect
- #3317
Task Library
- Adds a compression argument to both S3Upload and S3Download, allowing for compression of data upon upload and decompression of data upon download - #3259
Contributors
I <3 Contributors
Changelog
0.13.6
Released on September 9, 2020.
Enhancements
- Adds logger to global context to remove friction on running task unit tests - #3256
- Expand FunctionTask AttributeError Message - #3248
- Add backend info to diagnostics - #3265
- Ellipsis Support for GraphQL DSL - #3268
Task Library
- Add
DatabricksRunNow
task for running Spark jobs on Databricks - #3247 - Add GitHub
CreateIssueComment
task - #3269 - Add
S3List
task for listing keys in an S3 bucket - #3282 - Add
boto_kwargs
to AWS tasks - #3275
Fixes
- Make identifier optional in
KubernetesAgent.replace_job_spec_yaml()
- #3251 - Change
https://localhost
tohttp://localhost
in the welcome message - #3271
Contributors
Incrementally better than 0.13.4
Changelog
0.13.5
Released on September 1, 2020.
Enhancements
- Begin storing the width of mapped pipelines on the parent Mapped state - #3233
- Kubernetes agent now manages lifecycle of prefect jobs in its namespace - #3158
- Move agent heartbeat to background thread - #3158
- Handles
ModuleNotFound
errors in the storage healthcheck - #3225 - Raises the
warnings.warn
stack level to 2 to reduce duplicate warning messages - #3225 - Add some extra output to the
client.register
print output for visibility - #3225 - CLI help text docstrings are now auto documented using the API documentation parser - #3225
DaskExecutor
now logs dask worker add/removal events - #3227
Fixes
- Fix issue with passing --env-vars flag to K8s Agent Install manifest - #3239
- Fix edge case with
add_edge
method - #3230
Deprecations
- Kubernetes resource manager is now deprecated and the functionality is moved into the Kubernetes agent - #3158
Contributors
5 Enhancements, 1 new Task, 3 Bug Fixes
Changelog
0.13.4
Released on August 25, 2020.
Enhancements
- Allow for setting path to a custom job YAML spec on the Kubernetes Agent - #3046
- Use better coupled versioning scheme for Core / Server / UI images - #3204
- Added option to mount volumes with KubernetesAgent - #1234
- Add more kwargs to State.children and State.parents for common access patterns - #3212
- Reduce size of
prefecthq/prefect
Docker image - #3215
Task Library
- Add
DatabricksSubmitRun
task for submitting Spark jobs on Databricks - #3166
Fixes
- Fix Apollo service error output while waiting for GraphQL service with
prefect server start
- #3150 - Fix
--api
CLI option not being respected by agent Client - #3186 - Fix state message when using targets - #3216
Contributors
A Log Log Time Ago
Changelog
0.13.3
Released on August 18, 2020.
Enhancements
- Make use of
kubernetes
extra logger in theDaskKubernetesEnvironment
optional - #2988 - Make Client robust to simplejson - #3151
- Raise Warning instead of Exception during storage healthcheck when Result type is not provided - #3146
- Add
server create-tenant
for creating a tenant on the server - #3147 - Cloud logger now responds to logging level - #3179
Task Library
- Add support for
host_config
and arbitrary keyword arguments inDocker
tasks - #3173
Fixes
- Fix empty string
imagePullSecrets
issue on AKS by removing if not set - #3142 - Fix querying for cached states with no
cache_key
- #3168 - Fix access to
core_version
in Agent'sget_flow_run_command()
- #3177
Breaking Changes
- DaskKubernetesEnvironment no longer logs Kubernetes errors by default - #2988
- Logging level in Cloud now defaults to INFO - #3179
Contributors
Pandas don't even eat cereal
Changelog
0.13.2
Released on August 11, 2020.
Features
Enhancements
- Agents set flow run execution command based on flow's core version - #3113
- Clean up extra labels on jobs created by Kubernetes agent - #3129
Task Library
- Return
LoadJob
object inBigQueryLoad
tasks - #3086
Fixes
- Fix bug with
LocalDaskExecutor('processes')
that allowed tasks to be run multiple times in certain cases - #3127 - Add toggle to bypass bug in
slack_notifier
that attempted to connect to backend even if the backend didn't exist - #3136
Contributors
Fix Default Agent Execute Command
Changelog
0.13.1
Released on August 6, 2020.
Fixes
- Fix issue with 0.13.0 agents not able to run Flows registered with older Core versions - #3111