Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use shared dependency objects. #1894

Open
hjoliver opened this issue Jun 19, 2016 · 5 comments
Open

Use shared dependency objects. #1894

hjoliver opened this issue Jun 19, 2016 · 5 comments
Labels
efficiency For notable efficiency improvements
Milestone

Comments

@hjoliver
Copy link
Member

hjoliver commented Jun 19, 2016

Supercedes #107 - see #107 (comment)

Need to address:

  • run time (shared object in dependency matching)
  • graphing, validation (number of edges generated for familyA => familyB )

[update] also supersedes #1524 and #1636; so this issue should also address family timing and dynamic family sizing.

@hjoliver
Copy link
Member Author

hjoliver commented Jun 22, 2016

(mention use of a "family_done" dummy task in FAQ)

@hjoliver hjoliver added the efficiency For notable efficiency improvements label Jun 23, 2016
@hjoliver
Copy link
Member Author

I think this is closely related to:

@cylc/core - if you agree I'll close those two issues as superseded by this one.

@matthewrmshin
Copy link
Contributor

I agree.

This was referenced Oct 31, 2016
@hjoliver
Copy link
Member Author

This might also be the best way to get to (from #2075 (comment)):

  • cylc suite-state working with FAMILIES
  • Rose Bush (or its cylc replacement) allowing grouping by and displaying of family information
  • Suite analytics tools to be able to work in terms of families rather than individual tasks

(rather than reconstructing family relationships from stored inheritance information #2213)

@hjoliver
Copy link
Member Author

This might also be a route to job arrays: if we can traverse the graph forward, all tasks that depend on the shared dependency object can (depending) be packed into a job array?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
efficiency For notable efficiency improvements
Projects
None yet
Development

No branches or pull requests

2 participants