Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding Asynchronous Processing Capabilities with Multiple Queue Support #73

Merged
merged 20 commits into from Oct 17, 2020
Merged

Adding Asynchronous Processing Capabilities with Multiple Queue Support #73

merged 20 commits into from Oct 17, 2020

Conversation

axsaucedo
Copy link
Member

Fixes #51

This PR contains:

  • Kompute Manager now can be initialized with multiple queues
  • Sequence can now be created with explicitly provided queue
  • Evaluation commands can be executed asynchonously with Async/Await
  • Contains test that evaluates performance of synchronous vs asynchronous through simple benchmark
  • Adds extra documentation on the topic

@axsaucedo
Updated documentation
2f7fc45
@axsaucedo
Added initial async capability
8ec486b
@axsaucedo
Added evalOpAwait and evalOpAsync into the manager
33df1de
@axsaucedo
Updated to function for async
48805e1
@axsaucedo
Added async test
3e5364f
@axsaucedo
Updated to current multiple queue implementation
4e697bb
@axsaucedo
Updated to implementation of queues but no speedups yet
9e79b9f
@axsaucedo
UPdated to have shorter dispatch size and larger loop size
c69fcb7
@axsaucedo
Removed wait stage mask from submit info
79ca746
@axsaucedo
Added capabilities for multiple queues
6fc0b0b
@axsaucedo
Added test that ensures multiprocessing is working
356a563
@axsaucedo
Updated tests to work with async tests
40fc293
@axsaucedo
Added details on test
872a0bc
@axsaucedo
Reformatted
9a64339
@axsaucedo
Added single include with async
5cfc2ab
@axsaucedo
Simplified test and shortened run time
abe2c41
@axsaucedo
Added basic documentation and examples in readme
10faaab
@axsaucedo
Added evalOpAwaitDefault and evalOpAsyncDefault
8c66b4b
@axsaucedo
Added test just for the await component
f4275e2
@axsaucedo
Added basic documentation on async / parallel
c6695f1
@axsaucedo axsaucedo merged commit fba0a24 into master Oct 17, 2020
axsaucedo added a commit that referenced this pull request Oct 17, 2020
@axsaucedo
publish: Merge pull request #73 from EthicalML/51_async
57fed53 
generated from commit fba0a24
@axsaucedo axsaucedo added this to Done in 0.4.0 Oct 18, 2020
@axsaucedo axsaucedo mentioned this pull request Oct 20, 2020
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
No open projects
0.4.0
  
Done
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Add explicit multi-threading interfaces to ensure correctness when running in parallel
1 participant
@axsaucedo