Skip to content

Commit

Permalink
Merge pull request #159 from roytman/newKFpVersion
Browse files Browse the repository at this point in the history
update kfp image version
  • Loading branch information
roytman committed May 21, 2024
2 parents b0d6a44 + a1ae678 commit 8e4e641
Show file tree
Hide file tree
Showing 16 changed files with 16 additions and 16 deletions.
2 changes: 1 addition & 1 deletion .make.versions
Original file line number Diff line number Diff line change
Expand Up @@ -23,5 +23,5 @@ CODE_QUALITY_VERSION=0.3.0
DOC_QUALITY_VERSION=0.3.0
INGEST_TO_PARQUET_VERSION=0.3.0

KFP_DOCKER_VERSION=0.1.0
KFP_DOCKER_VERSION=0.2.0

2 changes: 1 addition & 1 deletion kfp/kfp_ray_components/createRayClusterComponent.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ inputs:

implementation:
container:
image: quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.1.0
image: quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.2.0
# command is a list of strings (command-line arguments).
# The YAML language has two syntaxes for lists and you can use either of them.
# Here we use the "flow syntax" - comma-separated strings inside square brackets.
Expand Down
2 changes: 1 addition & 1 deletion kfp/kfp_ray_components/deleteRayClusterComponent.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ inputs:

implementation:
container:
image: quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.1.0
image: quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.2.0
# command is a list of strings (command-line arguments).
# The YAML language has two syntaxes for lists and you can use either of them.
# Here we use the "flow syntax" - comma-separated strings inside square brackets.
Expand Down
2 changes: 1 addition & 1 deletion kfp/kfp_ray_components/executeRayJobComponent.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ inputs:

implementation:
container:
image: quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.1.0
image: quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.2.0
# command is a list of strings (command-line arguments).
# The YAML language has two syntaxes for lists and you can use either of them.
# Here we use the "flow syntax" - comma-separated strings inside square brackets.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ inputs:

implementation:
container:
image: quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.1.0
image: quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.2.0
# command is a list of strings (command-line arguments).
# The YAML language has two syntaxes for lists and you can use either of them.
# Here we use the "flow syntax" - comma-separated strings inside square brackets.
Expand Down
2 changes: 1 addition & 1 deletion kfp/kfp_ray_components/executeSubWorkflowComponent.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ outputs:

implementation:
container:
image: quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.1.0
image: quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.2.0
# command is a list of strings (command-line arguments).
# The YAML language has two syntaxes for lists, and you can use either of them.
# Here we use the "flow syntax" - comma-separated strings inside square brackets.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@
task_image = "quay.io/dataprep1/data-prep-kit/code_quality:0.3.0"

# components
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.1.0"
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.2.0"
# compute execution parameters. Here different tranforms might need different implementations. As
# a result, insted of creating a component we are creating it in place here.
compute_exec_params_op = comp.func_to_container_op(
Expand Down
2 changes: 1 addition & 1 deletion kfp/transform_workflows/code/malware/malware_wf.py
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@
task_image = "quay.io/dataprep1/data-prep-kit/malware:0.4.0"

# components
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.1.0"
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.2.0"

# compute execution parameters. Here different tranforms might need different implementations. As
# a result, insted of creating a component we are creating it in place here.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@
task_image = "quay.io/dataprep1/data-prep-kit/proglang_select:0.3.0"

# components
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.1.0"
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.2.0"

# compute execution parameters. Here different tranforms might need different implementations. As
# a result, insted of creating a component we are creating it in place here.
Expand Down
2 changes: 1 addition & 1 deletion kfp/transform_workflows/universal/doc_id/doc_id_wf.py
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@
EXEC_SCRIPT_NAME: str = "doc_id_transform.py"

# components
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.1.0"
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.2.0"

# compute execution parameters. Here different tranforms might need different implementations. As
# a result, instead of creating a component we are creating it in place here.
Expand Down
2 changes: 1 addition & 1 deletion kfp/transform_workflows/universal/ededup/ededup_wf.py
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@
task_image = "quay.io/dataprep1/data-prep-kit/ededup:0.3.0"

# components
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.1.0"
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.2.0"

# compute execution parameters
compute_exec_params_op = comp.func_to_container_op(func=ededup_compute_execution_params, base_image=base_kfp_image)
Expand Down
2 changes: 1 addition & 1 deletion kfp/transform_workflows/universal/fdedup/fdedup_wf.py
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@
task_image = "quay.io/dataprep1/data-prep-kit/fdedup:0.3.0"

# components
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.1.0"
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.2.0"

# compute execution parameters
compute_exec_params_op = comp.func_to_container_op(func=fdedup_compute_execution_params, base_image=base_kfp_image)
Expand Down
2 changes: 1 addition & 1 deletion kfp/transform_workflows/universal/filter/filter_wf.py
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@
task_image = "quay.io/dataprep1/data-prep-kit/filter:0.3.0"

# components
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.1.0"
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.2.0"
# compute execution parameters. Here different tranforms might need different implementations. As
# a result, insted of creating a component we are creating it in place here.
compute_exec_params_op = comp.func_to_container_op(
Expand Down
2 changes: 1 addition & 1 deletion kfp/transform_workflows/universal/noop/noop_wf.py
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@
EXEC_SCRIPT_NAME: str = "noop_transform.py"

# components
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.1.0"
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.2.0"

# compute execution parameters. Here different tranforms might need different implementations. As
# a result, instead of creating a component we are creating it in place here.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@
EXEC_SCRIPT_NAME: str = "noop_transform.py"

# components
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.1.0"
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.2.0"

# compute execution parameters. Here different tranforms might need different implementations. As
# a result, instead of creating a component we are creating it in place here.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@
task_image = "quay.io/dataprep1/data-prep-kit/tokenization:0.2.0"

# components
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.1.0"
base_kfp_image = "quay.io/dataprep1/data-prep-kit/kfp-data-processing:0.2.0"
# compute execution parameters. Use default one for now.
compute_exec_params_op = comp.func_to_container_op(
func=ComponentUtils.default_compute_execution_params, base_image=base_kfp_image
Expand Down

0 comments on commit 8e4e641

Please sign in to comment.