Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consolodate creation of MPI communicators #493

Merged
merged 5 commits into from
Oct 6, 2021
Merged

Consolodate creation of MPI communicators #493

merged 5 commits into from
Oct 6, 2021

Conversation

tskisner
Copy link
Member

@tskisner tskisner commented Oct 4, 2021

  • All split communicators are stored within the toast.Comm class,
    including the world, group, rank, node, world node-rank, group
    node-rank, and a store of row / column communicators that are
    created as needed for different values of process_rows.

  • These communicators are re-used within each observation, including
    passing the node and group node-rank communicators to the
    pshmem.MPIShared constructor.

  • Overall cleanup across the code of the use of these communicators.

* All split communicators are stored within the toast.Comm class,
  including the world, group, rank, node, world node-rank, group
  node-rank, and a store of row / column communicators that are
  created as needed for different values of process_rows.

* These communicators are re-used within each observation, including
  passing the node and group node-rank communicators to the
  pshmem.MPIShared constructor.

* Overall cleanup across the code of the use of these communicators.
Copy link
Member

@keskitalo keskitalo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for your hard work. Prudent use of MPI.Comm_split() will save us of much future frustration.

src/toast/ops/filterbin.py Show resolved Hide resolved
src/toast/ops/groundfilter.py Show resolved Hide resolved
src/toast/ops/sim_tod_atm.py Outdated Show resolved Hide resolved
src/toast/tests/ops_polyfilter.py Show resolved Hide resolved
@tskisner tskisner merged commit 469637c into toast3 Oct 6, 2021
@tskisner tskisner deleted the toast3_reuse branch October 6, 2021 05:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants