Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make it really easy to debug a single job #378

Open
jtratner opened this issue Mar 2, 2020 · 1 comment
Open

Make it really easy to debug a single job #378

jtratner opened this issue Mar 2, 2020 · 1 comment

Comments

@jtratner
Copy link
Contributor

jtratner commented Mar 2, 2020

Often with dxWDL, I want to be able to easily debug some task, especially by ssh'ing on to box with everything there.

Potentially useful ways to accomplish this:

  1. Be able to specify a different docker image via secret parameter with a default (e.g., -i_image=... -iregistry_login=... or something) - this would make it easy to iterate rapidly on a prebaked image by pushing various things to external registry.
  2. Dump fully templated script to a standard location so it can be edited and rerun. Include a script to run docker with correct commands. Docker image should be fully loaded locally and not deleted afterwards. Respect --debug-on.
  3. Make it easy to do a "dxWDL clone", where you get hopped on to box with cromwell + your docker image + data downloaded + input JSON for cromwell. dxWDL debug-job -j job-123
@jdidion
Copy link
Contributor

jdidion commented Feb 22, 2021

(1) is possible by adding a docker_image input parameter to your task with a default value, e.g.

task foo {
  input {
    String docker_image = "myimage"
  }
  ...
  runtime {
    docker: docker_image
  }
}

(2) is also supported, at least in dxCompiler. The job script is in /home/dnanexus/meta/commandScript.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants