Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The mpi-test_communication test requires excessive resources #1396

Closed
yurivict opened this issue Sep 4, 2022 · 6 comments
Closed

The mpi-test_communication test requires excessive resources #1396

yurivict opened this issue Sep 4, 2022 · 6 comments
Labels
bug Something isn't working stale There has been no activity on this for some time.

Comments

@yurivict
Copy link
Contributor

yurivict commented Sep 4, 2022

Description

On a computer with 24GB of memory this test causes heavy swapping.

Versions:

  • Python version: 3.9
  • mpich-3.4.3
  • HOOMD-blue version: 3.4.0
  • FreeBSD 13.1
@yurivict yurivict added the bug Something isn't working label Sep 4, 2022
@joaander
Copy link
Member

joaander commented Sep 6, 2022

Thanks for reporting this behavior. I am not able to reproduce it:

$ /usr/bin/time -v mpirun -n 8 test_communication
        Command being timed: "mpirun -n 8 test_communication"
        User time (seconds): 148.17
        System time (seconds): 3.51
        Percent of CPU this job got: 727%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 0:20.83
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 279088
...

279088 kiB * 8 = 2.12 GiB. Actual usage will be less than 2.12 GB as ranks 1-7 do not use as much memory as rank 0.

@yurivict
Copy link
Contributor Author

yurivict commented Sep 6, 2022

Apparently all of them run in 2+GB.

@joaander
Copy link
Member

joaander commented Sep 6, 2022

Apparently all of them run in 2+GB.

No, not on my test system (Ubuntu 22.04, CUDA 11.7, gcc 11.2). free -m reports 979 MiB more memory available after the test completes compared to when it was running.

@github-actions
Copy link

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

@github-actions github-actions bot added the stale There has been no activity on this for some time. label May 24, 2023
@yurivict
Copy link
Contributor Author

not stale

@joaander
Copy link
Member

I was unable to reproduce the issue as described. Regardless, HOOMD-blue is a simulation software and should be expected to use large amounts of memory. The unit tests cover a wide range of parameters users may choose which may lead to high memory utilization.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working stale There has been no activity on this for some time.
Projects
None yet
Development

No branches or pull requests

2 participants