S3 download failed when cache enabled

[staskh]

When run with download_cache enabled , download-aws_s3_cp task failed with a message:

/bin/bash: line 0: cd: /miniwdl_run/_CACHE/download/ops/20230310_184357_aws_s3_cp/work: No such file or directory

configuration snippet:

[download_cache]
dir = miniwdl_run/_CACHE/download
get = true
put = true
flock = false

[mlin]

Just to narrow down what the issue may be, does it help to set dir to an absolute path instead of a relative one?

Can you provide the full workflow.log (ideally with --verbose)?

[mlin]

The cache directory needs to be on the shared filesystem & at the same path on all nodes

[mlin]

@staskh Many months later, I eventually reproduced this issue. Unfortunately the problem was in miniwdl itself, which should be patched in miniwdl v1.11.1. Thanks as always