Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
pnfsmanager: make list scheduling behavior optional (selectable)
Motivation: Commit d7653b9 has introduced sequential listing and folding of list requests of the same directories. This works very well in the environment where there are mutliple listing requests to the same directories simultaneously. But we discovered an edge case. A site has a directory with 15M entries that is listed periodically. Since it takes a lot of time to serve 15M listing, the list requests to other directories that are dispatched to the same queue (due to modulo of hashCode clash) are backing up even though the other threads are idle. Modification: Added dCache property variable: pnfsmanager.enable.parallel-listing that allows to restore previous behavior - listing requests are dispatched to a single queue that is prrocessed by multiple parallel workers. Result: dCache admin can change behavior of listing scheduler. Target: trunk Request: 8.2, 9.2, 9.1, 9.0 Patch: https://rb.dcache.org/r/14048/ Acked-by: Tigran, Lea Require-book: yes Require-notes: yes
- Loading branch information
1 parent
a848b94
commit dab3637
Showing
4 changed files
with
100 additions
and
32 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters