Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Debug information for docker-based run. #678

Closed
hh1985 opened this issue Dec 16, 2023 · 4 comments
Closed

Debug information for docker-based run. #678

hh1985 opened this issue Dec 16, 2023 · 4 comments

Comments

@hh1985
Copy link

hh1985 commented Dec 16, 2023

Hi,

I am curious about checking the debug information of the modules. I use docker instead of local applications for the pipeline, and received error like:

IIME is caching your current deployment for improved performance. This may take a few moments and should only happen once per deployment.
Plugin error from diversity:

  Command '['run_adonis.R', '/tmp/tmpjv373klr/dm.tsv', '/tmp/tmpjv373klr/md.tsv', 'Class*Gender', '999', '2', '/tmp/qiime2-temp-y3jomxzy/adonis.tsv']' returned non-zero exit status 1.

Debug info has been saved to /tmp/qiime2-q2cli-err-r8gqpl5p.log

However, the path /tmp/qiime2-q2cli-err-r8gqpl5p.log was unavailable probably because the use of docker container.

@d4straub
Copy link
Collaborator

d4straub commented Dec 18, 2023

Hi there,
the information you gave is a little scarce, but I assume you run the pipeline on a HPC. In that case, /tmp/ might be on the compute node the job was sent to (if you use a scheduler such as slurm), instead of on the headnode (where you started nextflow), which you might have checked.
This might be a general question about /tmp/ location/accessibility rather than a ampliseq specific question.

@hh1985
Copy link
Author

hh1985 commented Dec 19, 2023

@d4straub I run the pipeline with -profile docker on a ubuntu workstation with 32 threads and 256 GB memory. There're no other nodes. I assume the /tmp/**.log should be on my system but couldn't find them.

As a comparion, I also installed the qiime2 separately and ran the same command successfully. This time I can access the /tmp/**.log file and quickly identified the error. I guess the issue with ampliseq pipeline might be the use of docker container, where the /tmp/**.log file was not moved to a shared drive.

@d4straub
Copy link
Collaborator

d4straub commented Dec 19, 2023

containers in the context of nf-core pipelines cannot be modified, i.e. nothing can be written in them

@hh1985
Copy link
Author

hh1985 commented Dec 21, 2023

I see. Thanks for the information.

@hh1985 hh1985 closed this as completed Dec 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants