🐛 FileNotFoundError: [Errno 2] No such file or directory: '/output/working/cpac_«sub_ses»/edit_func_2/_scan_rest/func_drop_trs/_0x«…»_unfinished.json'

[shnizzedy]

Describe the bug

I got this error on both of my last 2 tests of fmriprep-options

Node: cpac_sub-A00023510_ses-DS2.edit_func_2.func_drop_trs
Working directory: /output/working/cpac_sub-A00023510_ses-DS2/edit_func_2/_scan_rest/func_drop_trs

Node inputs:

args = <undefined>
environ = {}
expr = a
in_file_a = /bids/sub-A00023510/ses-DS2/func/sub-A00023510_ses-DS2_task-rest_bold.nii.gz
in_file_b = <undefined>
in_file_c = <undefined>
num_threads = 1
other = <undefined>
out_file = <undefined>
outputtype = NIFTI_GZ
overwrite = <undefined>
single_idx = <undefined>
start_idx = 0
stop_idx = 899

Traceback (most recent call last):
  File "/usr/local/miniconda/lib/python3.7/shutil.py", line 566, in move
    os.rename(src, real_dst)
FileNotFoundError: [Errno 2] No such file or directory: '/output/working/cpac_sub-A00023510_ses-DS2/edit_func_2/_scan_rest/func_drop_trs/_0xf9775608bbfe542c0a6c0dbcdf01e23a_unfinished.json' -> '/output/working/cpac_sub-A00023510_ses-DS2/edit_func_2/_scan_rest/func_drop_trs/_0xf9775608bbfe542c0a6c0dbcdf01e23a.json'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/miniconda/lib/python3.7/site-packages/nipype/pipeline/plugins/linear.py", line 46, in run
    node.run(updatehash=updatehash)
  File "/usr/local/miniconda/lib/python3.7/site-packages/nipype/pipeline/engine/nodes.py", line 531, in run
    shutil.move(hashfile_unfinished, hashfile_unfinished.replace("_unfinished", ""))
  File "/usr/local/miniconda/lib/python3.7/shutil.py", line 580, in move
    copy_function(src, real_dst)
  File "/usr/local/miniconda/lib/python3.7/shutil.py", line 266, in copy2
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/local/miniconda/lib/python3.7/shutil.py", line 120, in copyfile
    with open(src, 'rb') as fsrc:
FileNotFoundError: [Errno 2] No such file or directory: '/output/working/cpac_sub-A00023510_ses-DS2/edit_func_2/_scan_rest/func_drop_trs/_0xf9775608bbfe542c0a6c0dbcdf01e23a_unfinished.json'

Node: cpac_sub-A00023510_ses-DS2.edit_func_2.func_drop_trs
Working directory: /output/working/cpac_sub-A00023510_ses-DS2/edit_func_2/_scan_rest/func_drop_trs

Node inputs:

args = <undefined>
environ = {}
expr = a
in_file_a = /bids/sub-A00023510/ses-DS2/func/sub-A00023510_ses-DS2_task-rest_bold.nii.gz
in_file_b = <undefined>
in_file_c = <undefined>
num_threads = 1
other = <undefined>
out_file = <undefined>
outputtype = NIFTI_GZ
overwrite = <undefined>
single_idx = <undefined>
start_idx = 0
stop_idx = 899

Traceback (most recent call last):
  File "/usr/local/miniconda/lib/python3.7/shutil.py", line 566, in move
    os.rename(src, real_dst)
FileNotFoundError: [Errno 2] No such file or directory: '/output/working/cpac_sub-A00023510_ses-DS2/edit_func_2/_scan_rest/func_drop_trs/_0xc4aac573da30c894e124e97ede221ca4_unfinished.json' -> '/output/working/cpac_sub-A00023510_ses-DS2/edit_func_2/_scan_rest/func_drop_trs/_0xc4aac573da30c894e124e97ede221ca4.json'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/miniconda/lib/python3.7/site-packages/nipype/pipeline/plugins/linear.py", line 46, in run
    node.run(updatehash=updatehash)
  File "/usr/local/miniconda/lib/python3.7/site-packages/nipype/pipeline/engine/nodes.py", line 531, in run
    shutil.move(hashfile_unfinished, hashfile_unfinished.replace("_unfinished", ""))
  File "/usr/local/miniconda/lib/python3.7/shutil.py", line 580, in move
    copy_function(src, real_dst)
  File "/usr/local/miniconda/lib/python3.7/shutil.py", line 266, in copy2
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/local/miniconda/lib/python3.7/shutil.py", line 120, in copyfile
    with open(src, 'rb') as fsrc:
FileNotFoundError: [Errno 2] No such file or directory: '/output/working/cpac_sub-A00023510_ses-DS2/edit_func_2/_scan_rest/func_drop_trs/_0xc4aac573da30c894e124e97ede221ca4_unfinished.json'

To reproduce

1. Go to C-PAC brainlife app
2. Run with fmriprep-options on nightly branch
3. Check logs for crashfiles
4. See error

Expected behavior

Success

Acceptance criteria

• C-PAC progresses through edit_func_2.func_drop_trs node without an .unfinished FileNotFoundError

Screenshots

No response

C-PAC version

v1.8.1-dev

Container platform

Singularity

Docker and/or Singularity version(s)

brainlife.io

Additional context

No response