Resource monitor files being emitted to output directory

[effigies]

What happened?

Possibly starting in fMRIPrep 22.0, resource monitor files like .proc-14893_time-1660632638.9472053_freq-1.00 are being dumped directly in the output directory. We should look into the behavior with --resource-monitor enabled to verify/correct this behavior.

What command did you use?

Part of the TACC openneuro run (script here):

reproman run -r local --sub slurm --orc datalad-no-remote \
	--bp sub="$sub_list" \
	--jp num_processes="$processes" --jp num_nodes="$nodes" \
	--jp walltime="$walltime" --jp queue="$queue" --jp launcher=true \
	--jp job_name="${raw_ds}-${software}" --jp mail_type=END --jp mail_user="$user_email" \
	--jp "container=code/containers/bids-${software}" --jp \
	killjob_factors="$killjob_factors" sourcedata/raw \
	"$derivatives_scratch_path" participant --participant-label '{p[sub]}' \
	-w "$work_dir/${raw_ds}_sub-{p[sub]}" -vv "${command[@]}"

What version of fMRIPrep are you running?

22.0.0

How are you running fMRIPrep?

Singularity

Is your data BIDS valid?

Yes

Are you reusing any previously computed results?

No

Please copy and paste any relevant log output.

No response

Additional information / screenshots

No response

[oesteban]

This is where the MRIQC resource monitor was added -> nipreps/mriqc#984

The code is here: https://github.com/nipreps/mriqc/blob/master/mriqc/instrumentation/resources.py

and I think I first called MRIQC, visually checked the PID, and then did something like:

python -m mriqc.instrumentation <MRIQC_PID>

there's probably an easy bash pipe to first trigger the command line you want to run and pass the PID to some other command.

Then the mriqc.instrumentation.viz has some code for plotting.