v1.3.0
Flytekit 1.3.0
User Facing Changes
-D/-d
In pyflyte the -d switch was overloaded, used for both domain and the destination-dir that flytekit will extract user code into when using the fast-register feature. The latter has been updated to -D. This may require some users to change commands in CI/CD if the short form of these switches is used.
Protobuf Support
In May of last year Google announced a breaking change to the support for protobuf in python. Starting with this release we moved to this new version of the protobuf tooling, specifically, this affects some of the flytekit dependencies, including grpcio and grpcio-status.
Some flytekit dependencies, namely tensorflow haven't upgraded yet to the new protobuf version yet (more details in tensorflow/tensorflow#53234), so for the time being, flytekit v1.2.x will be maintained for bug fixes (and possibly features as well).
Additional
Please see Flyte 1.3 Release Notes for additional changes (Databricks, Human-in-the-loop Tasks, Dask, and FlyteRemote updates) and usage.
What's Changed
- Sanitize query template input in sqlite task by @eapolinario in #1359
- TypeTransformer for reading and writing from TensorFlowRecord format by @ryankarlos in #1240
- Bump numpy from 1.21.6 to 1.22.0 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in #1170
- Update ray plugin dependency by @pingsutw in #1361
- Bring in buf protobufs by @eapolinario in #1363
- Set default format of structured dataset to empty by @pingsutw in #1159
- Adds CLI reference for pyflyte by @samhita-alla in #1362
- Update plugins requirements files versions by @eapolinario in #1365
- Signaling by @wild-endeavor in #1133
- Adding created and updated at to ExecutionClosure model by @wild-endeavor in #1371
- Restrict numpy due to deprecated aliases by @eapolinario in #1376
- Add Databricks config to Spark Job by @pingsutw in #1358
- Add overwrite_cache option the to calls of remote and local executions by @hfurkanvural in #1375
- Remove project/domain from being overridden with execution values in serialized context by @wild-endeavor in #1378
- Use TaskSpec instead of TaskTemplate for fetch_task and avoid network when loading module by @kumare3 in #1348
- Register Databricks config by @pingsutw in #1379
- PodSpec should not require primary_container name by @kumare3 in #1380
- fix(pyflyte register): change -d to -D for --destination-dir as -d is already used for --domain by @mcloney-ddm in #1381
- [Snyk] Security upgrade torch from 1.12.1 to 1.13.1 by @snyk-bot in #1374
- Handle Optional[FlyteFile] in Dataclass type transformer by @eapolinario in #1393
- Update flyte deck plugin's dependency by @pingsutw in #1395
- add FastSerializationSettings to docs by @cosmicBboy in #1386
- Added more pod tests and an example pod task by @kumare3 in #1382
- Convert default value of dict to json string in pyflyte run by @pingsutw in #1399
- docs: update register help, non-fast version is supported by @pbrogan12 in #1402
- Update log level for structured dataset by @pingsutw in #1394
- Add Niels to code owners by @pingsutw in #1404
- Signal use by @wild-endeavor in #1398
- User Documentation Proposal by @pingsutw in #1200
- Add support MLFlow plugin by @kumare3 in #1274
- fix remote API reference by @cosmicBboy in #1405
- Read structured dataset from a folder by @pingsutw in #1406
- Update default config to work out-of-the-box with flytectl demo by @cosmicBboy in #1384
- Add dask plugin #patch by @bstadlbauer in #1366
New Contributors
- @hfurkanvural made their first contribution in #1375
- @mcloney-ddm made their first contribution in #1381
- @pbrogan12 made their first contribution in #1402
Full Changelog: v1.2.5...v1.3.0
