The purpose of this project supply the foundation of creating a workflow consisting of these workers (some executed across-machines)
- [TODO] Scheduler - determine on which machine to run a job that is ready
[DONE] Export - responsible for prepping the local files (could create a script to run locally)[DONE] CopyTo - copy files to remote machine that will be required for the job[DONE] Starter - starts the command remotely, once the job started running its job is done[DONE] Monitor - monitors the remote command to determine when it is done[DONE] CopyBack - copies the results of the job back[DONE] PostProcessing - process the results to determine if it succeeded/failed- [TODO] Reporting - will probably be responsible for summarizing the post-processed results
- [TODO] Health - can monitor health of workers and create reports or send emails
- [TODO] Cleanup worker - could be responsible for cleanup up "temp export" and "remote job" folders that are done