Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NUMA-aware memory allocation and computation #30

Open
mratsim opened this issue Jul 12, 2019 · 0 comments
Open

NUMA-aware memory allocation and computation #30

mratsim opened this issue Jul 12, 2019 · 0 comments

Comments

@mratsim
Copy link
Owner

mratsim commented Jul 12, 2019

Most HPC system have more than 1 socket which poses quite a problem to many parallel libraries.

Even in OpenMP 4, distributing parallel compute to socket proc_bind(spread) and within sockets to actual core (so no hyperthreading before all core are used) was quite an ordeal:
DeepinScreenshot_select-area_20190713005519

OpenMP 5.0 brings Numa aware allocator, see https://techdecoded.intel.io/essentials/openmp-5-0-a-story-about-threads-and-tasks/ (35min in)
DeepinScreenshot_select-area_20190713005653

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant