PaSh version 0.11 #647
Merged
PaSh version 0.11 #647
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* WIP: first changes for new annotations * Make parallelization use mapper info from new annotations * Make parallelization use mapper info from new annotations * Delete com_mapper field in dfg_node and use the info from new annotations * Use input info from new annotations * Use output info from new annotations * Make dfg_options use the information from new annotations and completely remove use of old aggregator com_aggregator * Make to_ast work for wf.sh with some hacks, e.g. to_ast for eager to handle special case of intermediate file as last operand and fixed parsing issue for newline * Remove com_mapper and com_aggregator from DFGNode * WIP: incorporating remodelled command invocations * Parsing with new dataflow node model works * WIP: parallelization * Rudimentary parallelization with new annotations works * Add way to specify where to find repository for annotations repository * Do not require flag `r_split` since we do consecutive chunks for now * 1st part of changes due to comments for PR * minor fix * 2nd part of changes due to comments for PR Co-authored-by: Felix Stutz <fstutz@mpi-sws.org>
* Add support for eager-nodes Signed-off-by: Felix Stutz <fstutz@mpi-sws.org> * Remove eager from TODO-list Signed-off-by: Felix Stutz <fstutz@mpi-sws.org> * Addressed comments from PR Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
* Add reduce trees Signed-off-by: Felix Stutz <fstutz@mpi-sws.org> * Remove task in TODO Signed-off-by: Felix Stutz <fstutz@mpi-sws.org> * Remove log statements Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
…mutative commands (#591) Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
…ptions for input and output directly (#595) Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
* Refactor parallelizing transformations in separate choose and apply phases Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
* Fuse cat and subsequent split Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
* Add a proper installation of the annotation lib Signed-off-by: Konstantinos Kallas <konstantinos.kallas@hotmail.com> * Remove unnecessary sys.path Signed-off-by: Konstantinos Kallas <konstantinos.kallas@hotmail.com> * Fix bug in setup Signed-off-by: Konstantinos Kallas <konstantinos.kallas@hotmail.com> * fix setup script Signed-off-by: Konstantinos Kallas <konstantinos.kallas@hotmail.com>
Signed-off-by: Konstantinos Kallas <konstantinos.kallas@hotmail.com>
Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
…612) * Fix bug in parser to switch from flag to operand mode when reading hyphen Signed-off-by: Felix Stutz <fstutz@mpi-sws.org> * Adapt shortest_scripts.sh to work with parser Signed-off-by: Felix Stutz <fstutz@mpi-sws.org> * Cover more test cases from script_microbenchmarks Signed-off-by: Felix Stutz <fstutz@mpi-sws.org> * Parallelize spell-grep as done in `future`, i.e., not RR but CC for `set_diff` Signed-off-by: Felix Stutz <fstutz@mpi-sws.org> * Clean up and clarifying comment in parser Signed-off-by: Felix Stutz <fstutz@mpi-sws.org> * Simplify control flow in parallelization Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
Signed-off-by: Konstantinos Kallas <konstantinos.kallas@hotmail.com>
Signed-off-by: Felix Stutz <fstutz@mpi-sws.org>
Signed-off-by: Konstantinos Kallas <konstantinos.kallas@hotmail.com>
Signed-off-by: Konstantinos Kallas <konstantinos.kallas@hotmail.com>
Signed-off-by: Konstantinos Kallas <konstantinos.kallas@hotmail.com>
Integrate New Annotation Library
Trigger CI on scripts changes
Delete files and references to old annotations
[WIP] Refactor components
Remove more obsolete files in compiler, move tests to the tests directory
Remove the last annotation files
Refactor all Shell ast related code to its own directory (ideally being mostly self contained)
Refactor orchestor runtime
|
OS:ubuntu-20.04 |
|
OS = Debian 10
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Pushes the new annotations to PaSh's main. Also includes a lot of refactoring and cleanup of old code.