Support for dynamic node creation #2373
yarnabrina
started this conversation in
Pipeline Editor/ Kubeflow Pipelines + Apache Airflow
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Do Elyra support creating nodes in runtime?
For example, we have a component that splits the data into groups as provided in configuration (passed as input file or environment variable), and do some processing on those independently of one another. The number of splits is not known beforehand.
Earlier we were handling this with
kfp.dsl.ParallelFor
, by iterating over an output file. Does Elyra have any alternative to this?Beta Was this translation helpful? Give feedback.
All reactions