Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add array input handling #26

Closed
wants to merge 15 commits into from
Closed

Add array input handling #26

wants to merge 15 commits into from

Conversation

agraubert
Copy link
Collaborator

Users can now specify arbitrarily nested arrays as inputs, and use the adapter arrays option to pin the array as an input, instead of splitting it as multiple inputs. A 1-d pinned array will be passed as a bash array to all jobs. Pinned arrays of 2 or more dimensions will function like a regular job input, with one element of the outermost array being passed to each job (nested arrays are flattened)

Replicated non-array behavior on non-NFS backends
It already does implicitly; If an expression evaluates to an array, that will be handled. Adding the arrays: option was just confusing
canine/adapters/base.py Outdated Show resolved Hide resolved
canine/adapters/base.py Outdated Show resolved Hide resolved
canine/localization/nfs.py Outdated Show resolved Hide resolved
pipeline_options.md Outdated Show resolved Hide resolved
canine/adapters/base.py Show resolved Hide resolved
canine/adapters/base.py Outdated Show resolved Hide resolved
canine/adapters/base.py Outdated Show resolved Hide resolved
canine/localization/base.py Outdated Show resolved Hide resolved
canine/localization/base.py Outdated Show resolved Hide resolved
canine/localization/base.py Outdated Show resolved Hide resolved
@agraubert agraubert added this to Testing/In Review in Features via automation Feb 24, 2020
@coveralls
Copy link

Coverage Status

Coverage decreased (-0.1%) to 59.422% when pulling 1bce1f7 on array into 8225b44 on master.

@agraubert agraubert added enhancement New feature or request wolf For issues which are blocking downstream wolf fixes/features labels Apr 23, 2020
@agraubert agraubert added the wontfix This will not be worked on label Nov 26, 2020
@agraubert agraubert closed this Nov 26, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request wolf For issues which are blocking downstream wolf fixes/features wontfix This will not be worked on
Projects
Features
  
Testing/In Review
Development

Successfully merging this pull request may close these issues.

None yet

3 participants