Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Default policy changes #843

Merged
merged 4 commits into from May 20, 2021
Merged

Default policy changes #843

merged 4 commits into from May 20, 2021

Conversation

dongahn
Copy link
Member

@dongahn dongahn commented May 19, 2021

This PR changes the default match policy to "first match" and the default queue-depth to 32. Given that many of the current users require high throughput scheduling and it would make sense the default values are tuned for them. For system-instance, the policies will be configured and set differently through configuration and rc files.

Fixes #827, #830.

Add an one-line default match policy change
in the fluxion module code.

Adjust those test cases that use
sched-fluxion-resource without an explict
match policy set. The baseline testing results
were established with policy=high so we add
that policy explicitly.
Change the default policy for resource-query
to be "first match".

Adjust the test cases.
Set the default queue-depth to be 32 (from 8K),
given that many of the current users require
high throughput scheduling and the new default
can significantly improve the scheduler
performance.
Problem: the valgrind test runs longer on focal
with the first match policy default.

Increase the timeout value by 100 more seconds.
@codecov
Copy link

codecov bot commented May 19, 2021

Codecov Report

Merging #843 (074f1d2) into master (adda90f) will decrease coverage by 0.0%.
The diff coverage is 100.0%.

@@           Coverage Diff            @@
##           master    #843     +/-   ##
========================================
- Coverage    73.7%   73.7%   -0.1%     
========================================
  Files          82      82             
  Lines        9332    9332             
========================================
- Hits         6879    6878      -1     
- Misses       2453    2454      +1     
Impacted Files Coverage Δ
resource/modules/resource_match.cpp 75.0% <100.0%> (ø)
resource/utilities/resource-query.cpp 48.0% <100.0%> (ø)
qmanager/policies/base/queue_policy_base_impl.hpp 77.0% <0.0%> (-0.3%) ⬇️

@dongahn dongahn requested a review from SteVwonder May 19, 2021 06:19
@dongahn
Copy link
Member Author

dongahn commented May 19, 2021

This should be ready for a review.

Copy link
Member

@SteVwonder SteVwonder left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Weird that the valgrind test takes longer under first, but a bump in timeout is good by me.

@SteVwonder SteVwonder added the merge-when-passing mergify.io - merge PR automatically once CI passes label May 20, 2021
@mergify mergify bot merged commit f95cecf into flux-framework:master May 20, 2021
@dongahn
Copy link
Member Author

dongahn commented May 20, 2021

Thanks @SteVwonder.

Weird that the valgrind test takes longer under first, but a bump in timeout is good by me.

Probably this can be attributed to more extensive use of C++ containers.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
merge-when-passing mergify.io - merge PR automatically once CI passes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Change the default match policy to "first match"?
2 participants