Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Milestone v0.5.0 #369

Merged
merged 13 commits into from
Jun 30, 2020
14 changes: 14 additions & 0 deletions CHANGELOG/CHANGELOG-v0.5.0.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
# Flyte v0.5.0

## Infrastructure
- Moved CI/CD to Github Actions
- Added end-to-end tests as part of the PR & master merges.
- Enable CI system to run on forks.

EngHabu marked this conversation as resolved.
Show resolved Hide resolved
## Core Platform
- [Single Task Execution](https://flyte.readthedocs.io/en/latest/user/features/single_task_execution.html) to enable registering and launching tasks outside the scope of a workflow to enable faster iteration and a more intuitive development workflow.
- [Run to completion](https://flyte.readthedocs.io/en/latest/user/features/on_failure_policy.html) to enable workflows to continue executing even if one or more branches fail.
EngHabu marked this conversation as resolved.
Show resolved Hide resolved
- Fixed retries for dynamically yielded nodes.

EngHabu marked this conversation as resolved.
Show resolved Hide resolved
## Plugins
- Cleaned up Presto executor to send namespace as user to improve queueing
4 changes: 2 additions & 2 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -24,9 +24,9 @@ generate-local-docs:
# Builds the entire doc tree. Assumes update_ref_docs has run and that all externals rsts are in _rsts/ dir
.PHONY: generate-docs
generate-docs: generate-dependent-repo-docs
@FLYTEKIT_VERSION=0.8.1 ./script/generate_docs.sh
@FLYTEKIT_VERSION=0.10.0 ./script/generate_docs.sh

# updates referenced docs from other repositories (e.g. flyteidl, flytekit)
.PHONY: generate-dependent-repo-docs
generate-dependent-repo-docs:
@FLYTEKIT_VERSION=0.8.1 FLYTEIDL_VERSION=0.17.32 ./script/update_ref_docs.sh
@FLYTEKIT_VERSION=0.10.0 FLYTEIDL_VERSION=0.17.34 ./script/update_ref_docs.sh
8 changes: 4 additions & 4 deletions deployment/eks/flyte_generated.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -647,7 +647,7 @@ spec:
- /etc/flyte/config/flyteadmin_config.yaml
- migrate
- run
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
name: run-migrations
volumeMounts:
Expand All @@ -663,7 +663,7 @@ spec:
- flytesnacks
- flytetester
- flyteexamples
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
name: seed-projects
volumeMounts:
Expand All @@ -676,7 +676,7 @@ spec:
- /etc/flyte/config/flyteadmin_config.yaml
- clusterresource
- sync
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
name: sync-cluster-resources
volumeMounts:
Expand Down Expand Up @@ -874,7 +874,7 @@ spec:
- /etc/flyte/config/flyteadmin_config.yaml
- clusterresource
- sync
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
name: sync-cluster-resources
volumeMounts:
Expand Down
8 changes: 4 additions & 4 deletions deployment/sandbox/flyte_generated.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -1089,7 +1089,7 @@ spec:
- /etc/flyte/config/flyteadmin_config.yaml
- migrate
- run
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
name: run-migrations
volumeMounts:
Expand All @@ -1105,7 +1105,7 @@ spec:
- flytesnacks
- flytetester
- flyteexamples
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
name: seed-projects
volumeMounts:
Expand All @@ -1118,7 +1118,7 @@ spec:
- /etc/flyte/config/flyteadmin_config.yaml
- clusterresource
- sync
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
name: sync-cluster-resources
volumeMounts:
Expand Down Expand Up @@ -1526,7 +1526,7 @@ spec:
- /etc/flyte/config/flyteadmin_config.yaml
- clusterresource
- sync
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
name: sync-cluster-resources
volumeMounts:
Expand Down
8 changes: 4 additions & 4 deletions deployment/test/flyte_generated.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -710,7 +710,7 @@ spec:
- /etc/flyte/config/flyteadmin_config.yaml
- migrate
- run
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
name: run-migrations
volumeMounts:
Expand All @@ -726,7 +726,7 @@ spec:
- flytesnacks
- flytetester
- flyteexamples
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
name: seed-projects
volumeMounts:
Expand All @@ -739,7 +739,7 @@ spec:
- /etc/flyte/config/flyteadmin_config.yaml
- clusterresource
- sync
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
name: sync-cluster-resources
volumeMounts:
Expand Down Expand Up @@ -1037,7 +1037,7 @@ spec:
- /etc/flyte/config/flyteadmin_config.yaml
- clusterresource
- sync
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
name: sync-cluster-resources
volumeMounts:
Expand Down
2 changes: 1 addition & 1 deletion end2end/tests/endtoend.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ spec:
command:
- bash
- -c
image: docker.io/lyft/flytetester:e29ac562f053741213efcead5950b4b8bc28cfcf
image: docker.io/lyft/flytetester:2eed7000b4a46f687883a21368507b3975b44523
imagePullPolicy: IfNotPresent
name: flytetester
resources:
Expand Down
6 changes: 3 additions & 3 deletions kustomize/overlays/eks/admindeployment/admindeployment.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -12,23 +12,23 @@ spec:
name: clusterresource-template
initContainers:
- name: run-migrations
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
command: ["flyteadmin", "--logtostderr", "--config", "/etc/flyte/config/flyteadmin_config.yaml",
"migrate", "run"]
volumeMounts:
- name: config-volume
mountPath: /etc/flyte/config
- name: seed-projects
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
command: ["flyteadmin", "--logtostderr", "--config", "/etc/flyte/config/flyteadmin_config.yaml",
"migrate", "seed-projects", "flytesnacks", "flytetester", "flyteexamples"]
volumeMounts:
- name: config-volume
mountPath: /etc/flyte/config
- name: sync-cluster-resources
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
command: ["flyteadmin", "--logtostderr", "--config", "/etc/flyte/config/flyteadmin_config.yaml", "clusterresource", "sync"]
volumeMounts:
Expand Down
2 changes: 1 addition & 1 deletion kustomize/overlays/eks/admindeployment/cron.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ spec:
serviceAccountName: flyteadmin
containers:
- name: sync-cluster-resources
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
command: ["flyteadmin", "--logtostderr", "--config", "/etc/flyte/config/flyteadmin_config.yaml", "clusterresource", "sync"]
volumeMounts:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -17,23 +17,23 @@ spec:
'until pg_isready -h postgres -p 5432;
do echo waiting for database; sleep 2; done;']
- name: run-migrations
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
command: ["flyteadmin", "--logtostderr", "--config", "/etc/flyte/config/flyteadmin_config.yaml",
"migrate", "run"]
volumeMounts:
- name: config-volume
mountPath: /etc/flyte/config
- name: seed-projects
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
command: ["flyteadmin", "--logtostderr", "--config", "/etc/flyte/config/flyteadmin_config.yaml",
"migrate", "seed-projects", "flytesnacks", "flytetester", "flyteexamples"]
volumeMounts:
- name: config-volume
mountPath: /etc/flyte/config
- name: sync-cluster-resources
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
command: ["flyteadmin", "--logtostderr", "--config", "/etc/flyte/config/flyteadmin_config.yaml", "clusterresource", "sync"]
volumeMounts:
Expand Down
2 changes: 1 addition & 1 deletion kustomize/overlays/sandbox/admindeployment/cron.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ spec:
serviceAccountName: flyteadmin
containers:
- name: sync-cluster-resources
image: docker.io/lyft/flyteadmin:v0.2.8
image: docker.io/lyft/flyteadmin:v0.2.11
imagePullPolicy: IfNotPresent
command: ["flyteadmin", "--logtostderr", "--config", "/etc/flyte/config/flyteadmin_config.yaml", "clusterresource", "sync"]
volumeMounts:
Expand Down
2 changes: 1 addition & 1 deletion rsts/conf.py
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@
# The short X.Y version
version = u''
# The full version, including alpha/beta/rc tags
release = u'0.4.0'
release = u'0.5.0'


# -- General configuration ---------------------------------------------------
Expand Down