You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm working on the farday poc (test 4) when I ran across this bug. Chatting w Matt I think we saw this w xumak as well.
Basically I have a pipeline w parallelism set to COEFFICIENT and 1. When I create this pipeline (after the input repo exists w a single commit w a large amount of data), pachyderm goes nuts.
we see the pipeline from pachctl list-pipeline
we don't see any jobs listed from pachctl list-job
kubectl get all shows no job pods
But ... doing pachctl list-commit -a pipelines_output_repo shows ~10 new commits / second. They are all unfinished.
Changing the pipeline spec to CONSTANT fixes this problem.
The text was updated successfully, but these errors were encountered:
I'm working on the farday poc (test 4) when I ran across this bug. Chatting w Matt I think we saw this w xumak as well.
Basically I have a pipeline w parallelism set to
COEFFICIENT
and1
. When I create this pipeline (after the input repo exists w a single commit w a large amount of data), pachyderm goes nuts.pachctl list-pipeline
pachctl list-job
kubectl get all
shows no job podsBut ... doing
pachctl list-commit -a pipelines_output_repo
shows ~10 new commits / second. They are all unfinished.Changing the pipeline spec to
CONSTANT
fixes this problem.The text was updated successfully, but these errors were encountered: