Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

do not filter caches when loading hwloc topology #5945

Merged
merged 1 commit into from
May 6, 2024

Conversation

grondo
Copy link
Contributor

@grondo grondo commented May 6, 2024

As discussed in #5934, this PR removes the lines from librlist that are currently filtering out L2/L3/etc caches in the hwloc topology loaded by flux, thus making this information unavailable to components and processes that use this topology, since it is shared from parent to child instance and shell to shell plugin.

Problem: When loading hwloc topology, librlist applies the following
filter:

 hwloc_topology_set_cache_types_filter(topo,
                                       HWLOC_TYPE_FILTER_KEEP_STRUCTURE)

but this seems to remove L2/L3 caches on some systems. Removal of
these structures may have been useful in the past when the topology
wasn being gathered from every node into the KVS, but since this
is no longer done, this filter seems unnecessary and may reduce the
usefulness of some features like the job shell's `-o hwloc.xmlfile`
option.

Remove the hwloc cache types filter in librlist.
Copy link

codecov bot commented May 6, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 83.32%. Comparing base (cc277a2) to head (fa1e825).

Additional details and impacted files
@@           Coverage Diff           @@
##           master    #5945   +/-   ##
=======================================
  Coverage   83.31%   83.32%           
=======================================
  Files         515      515           
  Lines       83344    83343    -1     
=======================================
+ Hits        69441    69446    +5     
+ Misses      13903    13897    -6     
Files Coverage Δ
src/common/librlist/rhwloc.c 87.14% <ø> (-0.10%) ⬇️

... and 17 files with indirect coverage changes

Copy link
Member

@wihobbs wihobbs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All my simple tests on corona with ompi5 passed off this branch.

@grondo
Copy link
Contributor Author

grondo commented May 6, 2024

Thanks I'll set MWP on this one since we implicitly have @trws's ACK as well.

@mergify mergify bot merged commit 49680c0 into flux-framework:master May 6, 2024
35 checks passed
@grondo grondo deleted the hwloc-keep-caches branch May 6, 2024 23:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants