Skip to content

Fix communicator issue#512

Merged
matt-frey merged 15 commits into3d-mpi-modelfrom
fix-communicator-issue
Jul 20, 2023
Merged

Fix communicator issue#512
matt-frey merged 15 commits into3d-mpi-modelfrom
fix-communicator-issue

Conversation

@matt-frey
Copy link
Member

For some program instances the MPI_COMM_WORLD MPI rank does not match the Cartesian MPI rank because the reorder flag does not seem to be taken into account by the MPI implementations despite the MPI specifications (see https://www.mpi-forum.org/docs/mpi-1.1/mpi-11-html/node133.html).

@matt-frey matt-frey added 3D Issues and pull requests related to the 3D version MPI MPI related issues and pull requests labels Jul 18, 2023
@matt-frey matt-frey added this to the 0.13.0 milestone Jul 18, 2023
@matt-frey matt-frey self-assigned this Jul 18, 2023
@matt-frey matt-frey requested a review from sjboeing July 19, 2023 11:37
@matt-frey matt-frey marked this pull request as ready for review July 19, 2023 11:37
Fix unit-tests -- register missing timer and fix function call
Copy link
Collaborator

@sjboeing sjboeing left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great work, Matthias! I wasn't always sure whether world (rather than cart) was the right communicator. In these cases, I have put a note, but you may have figured these out already. Not sure if it is easy/necessary to run all the comm unit tests across 2 nodes to double-check all is OK.

@matt-frey
Copy link
Member Author

Indeed, I had to fix 3 unit-tests with respect to world%rank and cart%rank. Also, I forgot to initialise cart%size. This has now all been fixed. I ran the unit-tests with 6 cores distributed over 2 nodes (3 cores / node), 5 cores distributed over 2 nodes [layout 2-3], and 5 cores distributed over 3 nodes [layout 1-2-2].

@matt-frey matt-frey merged commit 0064877 into 3d-mpi-model Jul 20, 2023
@matt-frey matt-frey deleted the fix-communicator-issue branch July 20, 2023 08:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

3D Issues and pull requests related to the 3D version MPI MPI related issues and pull requests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants