Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Initial BufferOrganizer infrastructure #211

Merged
merged 26 commits into from
Jul 6, 2021
Merged

Initial BufferOrganizer infrastructure #211

merged 26 commits into from
Jul 6, 2021

Conversation

ChristopherHogan
Copy link
Collaborator

  • Move the MPI-IO adapter's thread pool into the main Hermes library, and give it an extra queue for high priority.
  • Add buffer_organizer_num_threads configuration variable.
  • Commented out MPI-IO test because it's failing intermittently (see Diagnose failing MPI-IO adapter test #209).
  • Add placeholders for BO operations MOVE, COPY, and DELETE.
  • Remove TriggerBufferOrganizer and reuse RpcCall instead of duplicating its code.

@ChristopherHogan
Initial BO infrastructure
7f1ad47
@ChristopherHogan
Basic BO test in progress
be42e0e
@ChristopherHogan
Laying out BO task infrastructure
fd8b39c
@ChristopherHogan
Move TestIsBoFunction to buffer_organizer_test.cc
09859d0
@ChristopherHogan
Get things compiling before adding thread pool
d3e64b3
@ChristopherHogan
Move thread_pool.h to main library
24a7207
@ChristopherHogan
Placeholder BO tasks running in thread pool
3d716fe
@ChristopherHogan
Appease linter
11bac14
@ChristopherHogan
Pool with 2 priorities used by BO
3c49bf1
@ChristopherHogan
Unpack BoArgs before calling BO functions
d41f82a
@ChristopherHogan
Add config variable for num BO threads
d8541f1
@ChristopherHogan
Store a BO in each Hermes core
4fa2195
@ChristopherHogan
Add utility function for initializing MPI
3d21501
@ChristopherHogan
Appease linter
480b216
@ChristopherHogan
Fix client finalization
4dc106d
@ChristopherHogan
Appease linter
f1d9da3
@ChristopherHogan
Disable occasionally failing MPI-IO adapter test
8fa5811
@ChristopherHogan
Add issue number on commented out test
d638c34
@ChristopherHogan
Revert "Add utility function for initializing MPI"
88c2ffe 
This reverts commit 3d21501.
@ChristopherHogan
Remove TriggerBufferOrganizer and set BO RPC threads to 1
b174b5a
@ChristopherHogan
Test BO RPC
b7b3c10
@ChristopherHogan
Fix logging bug in BO and add libjson for latest margo
28c8970
@ChristopherHogan
Add serialization functions for BoArgs and BoTask
18691cc
@ChristopherHogan
Remove temporary test code
337fe06
@ChristopherHogan
Add buffer_organizer_num_threads to all conf files
f0deed9
@ChristopherHogan
Set default config values before parsing conf file
eb17038
@coveralls
Copy link

Coverage Status

Coverage decreased (-0.2%) to 82.777% when pulling eb17038 on chogan/bo into b0dcc75 on master.

@ChristopherHogan ChristopherHogan merged commit 6a0189a into master Jul 6, 2021
@ChristopherHogan ChristopherHogan deleted the chogan/bo branch July 6, 2021 13:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jya-kmu jya-kmu jya-kmu approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@ChristopherHogan @coveralls @jya-kmu