Control high priority block num when pick recover blocks #212
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Closed
|
这个解决的是所有hi都扔到一台cs上的问题么？直接平均分配有什么问题么？ |
|
如果直接将剩余的hi平均分配，那么有可能某个cs上的hi过多（因为其正在进行的hi可能就比较多），然而单个cs的能力是有限的，不见得能体现出hi的重要程度，如果将所有的hi（剩余+正在进行的）平均分配，在hi较多时，每台cs pick的数目平均下来较少，则不能尽快的将其处理完。于是搞了两个watermark |
|
分别控制hi low的个数还有必要么。。 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
#201
设置两个不同的watermark以及一个threshold
当所有high priority的block数超threshold时，对每个cs，让其尽量多的选择high priority block，但是不能超过high watermark
当所有high priority的block数低于threshold时，尽量让这些block分散，不过，仍保持每个cs上的数目不低于low watermark
当确定了high priority的数目后，剩余的quota分配给low priority的block