Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Resource requirements #32

Open
simleo opened this issue Oct 14, 2022 · 3 comments
Open

Resource requirements #32

simleo opened this issue Oct 14, 2022 · 3 comments

Comments

@simleo
Copy link
Collaborator

simleo commented Oct 14, 2022

If available, record the application's resource requirements. This is useful to those who want to reproduce the run. In CWL, this is provided via ResourceRequirement. We could use properties like memoryRequirements or storageRequirements for this.

@simleo
Copy link
Collaborator Author

simleo commented Feb 16, 2023

This would be part of the prospective provenance. SoftwareApplication already has several *Requirements properties that can be used, so profile-wise (if we don't add any extra terms) we can simply add a general recommendation to use them if the corresponding information is available, e.g. if the workflow author added the relevant annotations. Runcrate could add a section where CWL ResourceRequirement is converted, then we can compile a mapping guide and add it to the web site (similar to https://www.researchobject.org/workflow-run-crate/cwl_param_mapping).

@simleo
Copy link
Collaborator Author

simleo commented May 10, 2023

The only actual match I've found in ResourceRequirement is between ramMin and memoryRequirements .

CWL Meaning SoftwareApplication
ResourceRequirement coresMin Minimum number of CPU cores
ResourceRequirement coresMax Maximum number of CPU cores
ResourceRequirement ramMin Minimum RAM memoryRequirements
ResourceRequirement ramMax Maximum RAM
ResourceRequirement tmpdirMin Minimum storage for temporary directory
ResourceRequirement tmpdirMax Maximum storage for temporary directory
ResourceRequirement outdirMin Minimum storage for output directory
ResourceRequirement outdirMax Maximum storage for output directory
Processor architecture processorRequirements
SoftwareRequirement packages Dependencies softwareRequirements
Free space required storageRequirements

@rsirvent
Copy link
Contributor

FYI, this maps with COMPSs constraints definitions, although a different approach is followed (no min-max, exact numbers for some terms, ...).

https://compss-doc.readthedocs.io/en/stable/Sections/02_App_Development/04_Constraints.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants