Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kuberun should honour -bg (background) option #1159

Closed
bentsherman opened this issue May 24, 2019 · 3 comments
Closed

Kuberun should honour -bg (background) option #1159

bentsherman opened this issue May 24, 2019 · 3 comments
Milestone

Comments

@bentsherman
Copy link
Member

New feature

nextflow kuberun creates a pod spec, launches it on a k8s cluster, and streams the log output of the pod. It would be convenient in some cases for kuberun to simply launch the pod and then exit. That is, since kuberun creates a "head node" on the k8s cluster which pefrorms the rest of the workflow, it is not necessary to have the local machine tethered to the entire process.

Usage scenario

Maybe I want to start the workflow and then turn off my machine for a week while the workflow proceeds on the k8s cluster.

Suggest implementation

Add an option to kuberun (something like --standalone or --batch) which simply causes kuberun to exit after submitting the pod.

If the user then wants to view the pod output, they can do so with kubectl logs <pod-name>.

@pditommaso
Copy link
Member

Make sense. Actually, there's already a background option. When used on the kuberun command it should behave accordingly.

@pditommaso pditommaso added this to the v19.07.0 milestone May 27, 2019
@bentsherman
Copy link
Member Author

Not quite the same, actually. With this option nextflow is still running on the local machine such that the k8s job would be disrupted if the local machine turns off. The local process must exit after submitting the controller pod, not merely run in the background.

@pditommaso
Copy link
Member

Indeed. What I'm saying is that when -bg is specified on kuberun it should do what you are proposing.

@pditommaso pditommaso changed the title Option to run standalone for kuberun Kuberun should honour -bg (background) option Jun 1, 2019
sivkovic pushed a commit to sivkovic/nextflow that referenced this issue Jun 6, 2019
sivkovic pushed a commit to sivkovic/nextflow that referenced this issue Jun 6, 2019
sivkovic pushed a commit to sivkovic/nextflow that referenced this issue Jun 6, 2019
Signed-off-by: Ivkovic <sinisa.ivkovic@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants