Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

simplify output project #18

Open
johnbradley opened this issue Mar 13, 2019 · 0 comments
Open

simplify output project #18

johnbradley opened this issue Mar 13, 2019 · 0 comments

Comments

@johnbradley
Copy link
Collaborator

Currently we use the organize project command to add directories and files underneath a results directory:

Directory structure:
results/ # this directory is uploaded in the store output stage (destination_dir in config)
...output files from workflow
docs/
README.md
README.html
scripts/
<workflow name>.cwl
job-<jobid>-input.json
logs/
bespin-workflow-output.json #stdout from cwl-runner - json job results
bespin-workflow-output.log #stderr from cwl-runner
job-data.json # non-cwl job data used to create Bespin-Report.txt

The results directory already contains the output files/directories created by the bioinformatics workflow. By adding the docs directory underneath results we complicate testing reproducibility.
These files and folders will need to be excluded in this process. There is also a possibility that a workflow might create an output directory named docs. This could cause that data to be lost.

Suggested new structure:

README.md 
README.html 
results/
    ...output files from workflow 
scripts/ 
    <workflow name>.cwl 
    job-<jobid>-input.json 
logs/ 
    bespin-workflow-output.json   #stdout from cwl-runner - json job results 
    bespin-workflow-output.log    #stderr from cwl-runner 
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant