Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add sharded apply_rule function to rule_grouping #3461

Closed
lgoossen opened this issue Apr 9, 2020 · 0 comments · Fixed by #3527
Closed

add sharded apply_rule function to rule_grouping #3461

lgoossen opened this issue Apr 9, 2020 · 0 comments · Fixed by #3527
Assignees
@lgoossen
Labels
enhancement Rules
Milestone
1.22.6

Comments

@lgoossen
Copy link
Contributor

lgoossen commented Apr 9, 2020

Motivation

to address memory scaling problems in add_rule and inject_rule create equivalent of current double call of __resolve_did_to_locks_and_replicas and __create_locks_replicas_transfers
that will process the dataset in multiple bunches of fixed max size

Modification
lgoossen added a commit to lgoossen/rucio that referenced this issue Apr 23, 2020
@lgoossen
Core: add apply_rule to rule_grouping, closes rucio#3461
48056e0
This was referenced Apr 23, 2020
Merged
Merged
lgoossen added a commit to lgoossen/rucio that referenced this issue Apr 23, 2020
@lgoossen
Core: add apply_rule to rule_grouping, closes rucio#3461
b8404f9
lgoossen added a commit to lgoossen/rucio that referenced this issue May 1, 2020
@lgoossen
Core: add apply_rule to rule_grouping, closes rucio#3461
4516375
bari12 added a commit that referenced this issue May 8, 2020
@bari12
Merge pull request #3527 from lgoossen/patch-3461-core-add_sharded_ap…
f11ad15 
…ply_rule

Core: add apply_rule to rule_grouping, closes #3461
bari12 added a commit that referenced this issue May 8, 2020
@bari12
Merge pull request #3528 from lgoossen/patch-3461-core-add_sharded_ap…
c38dd0f 
…ply_rule

Core: add apply_rule to rule_grouping, closes #3461
@bari12 bari12 added this to the 1.22.5 milestone May 8, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@lgoossen lgoossen

Labels
enhancement Rules
Projects
None yet
Milestone
1.22.6
Development

Successfully merging a pull request may close this issue.

Core: add apply_rule to rule_grouping, closes #3461 lgoossen/rucio
2 participants
@bari12 @lgoossen