New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make number of simultaneous tasks per process configurable #25

Closed
samuell opened this Issue May 24, 2016 · 4 comments

Comments

Projects
None yet
1 participant
@samuell
Member

samuell commented May 24, 2016

Currently, a process will spawn as many tasks as there are incoming sets of data packets on in-ports. If running stuff locally, this might overbook the CPU.

Probably the best option is to have a global pool of "run leases", that are handed out to processes as they ask for them, and then handed back when they are finished.

@samuell samuell self-assigned this Dec 7, 2016

@samuell

This comment has been minimized.

Show comment
Hide comment
@samuell

samuell Dec 12, 2016

Member

Remember:

trying to keep the number of workers spread out "along" the workflow, will optimize for fast getting the first results!

Member

samuell commented Dec 12, 2016

Remember:

trying to keep the number of workers spread out "along" the workflow, will optimize for fast getting the first results!

@samuell

This comment has been minimized.

Show comment
Hide comment
@samuell

samuell Jun 14, 2017

Member

Probably use semaphores, as suggested at 23:32 in Mat Ryers idiomatic Go tricks talk

Member

samuell commented Jun 14, 2017

Probably use semaphores, as suggested at 23:32 in Mat Ryers idiomatic Go tricks talk

@samuell

This comment has been minimized.

Show comment
Hide comment
@samuell

samuell Oct 11, 2017

Member

Working solution now in develop branch

Member

samuell commented Oct 11, 2017

Working solution now in develop branch

@samuell

This comment has been minimized.

Show comment
Hide comment
@samuell

samuell Mar 16, 2018

Member

Working solution now in develop branch

... which is merged since long, so time to close this.

Member

samuell commented Mar 16, 2018

Working solution now in develop branch

... which is merged since long, so time to close this.

@samuell samuell closed this Mar 16, 2018

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment