Skip to content
This repository has been archived by the owner on Jun 20, 2024. It is now read-only.

I want to know all the inputs and outputs produced by the pipeline, and who made them #317

Open
nh13 opened this issue Nov 30, 2017 · 0 comments

Comments

@nh13
Copy link
Member

nh13 commented Nov 30, 2017

At the end of the execution, I want a report that has the following columns:

  • task name/id/etc.
  • input/output file
  • path to file
  • exists at the end of the pipeline (was intermediate)

I am not sure how to implement it, but perhaps with some annotations (@input, @output, @delete)?When a task is scheduled, inputs are added. When tasks execute successfully, the outputs are added (and checked). When a task deletes an file, the file is marked as deleted. For the tasks that delete files, we could instead use @input(deleted=true).

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant