Prefect 2.0: flow deployments using common package between flows #6107
Unanswered
giacomochiarella
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi everyone! I'm trying to get into Prefect 2.0 because we like and we want to use it. Great job first of all!
The point. As many flows share the same flow structure, it makes sense to have this task with some parameters in a common package.
Let's say I have a this tree:
dags
Problem. When I try to deploy:
cd dags/staging
prefect deployment build ./packageA/flowA.py:func -n name -t staging -i process -sb s3/staging
I get:
ModuleNotFoundError: No module named 'staging'
because in flowA I haveimport staging.common
I'm getting crazy to find out how it is supposed to deploy flows. It seems I should install the modules first but I wonder why the flow script is execute during the deployment. Even if I install the modules, not only flowA gets copied to s3, the whole folder where I run the command from gets copied.
Any suggestions?
Beta Was this translation helpful? Give feedback.
All reactions