Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add a general purpose process runner #1

Open
Jaymon opened this issue Dec 3, 2018 · 1 comment
Open

add a general purpose process runner #1

Jaymon opened this issue Dec 3, 2018 · 1 comment

Comments

@Jaymon
Copy link
Owner

Jaymon commented Dec 3, 2018

Basically I would like a more general purpose manager that has a prepare function that will just load up a queue and then a map function that processes that queue and a reduce function that would aggregate anything if needed.

So the prepare function would be wrapped so whatever it returned was added to a queue, and then the map function would be wrapped so each wrapper would try and read the queue and if it got something it would send it into the passed in map function, and then if it got a return value it would then load it into a return value queue.

So the class would have 2 queues, and input and an output queue. I think the name could be "Miss" so we would have Mister and Miss that perform roughly the same function in different ways. Miss would be more of a general purpose batch task manager that would create a pool of processes that listen on the queue and then anything that is added to the input queue would be processed by one of its pool of processes.

Jaymon added a commit that referenced this issue Feb 3, 2019
…ething before I consider it officially done and I update the readme and clean up the code, so Miss support is basically alpha right now
@Jaymon
Copy link
Owner Author

Jaymon commented Feb 5, 2019

Before I mark this as done I should:

  • Integrate the changes I made for Miss into Mister so they all share the same classes (eg, Queue and Process)
  • update README.md with Miss information.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant