Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve performance of abacus duplicate deletion query #4100

Closed
bari12 opened this issue Nov 2, 2020 · 0 comments
Closed

Improve performance of abacus duplicate deletion query #4100

bari12 opened this issue Nov 2, 2020 · 0 comments
Assignees
@bari12
Labels
enhancement Replicas
Milestone
1.23.10

Comments

@bari12
Copy link
Member

bari12 commented Nov 2, 2020

Motivation

Currently the abacus duplicate deletion query is done in a very resource intensive way. This works fine for smaller Rucio instances using abacus, but it doesn't scale well for larger instance. In comparison to that, the oracle procedure used for oracle-based Rucio instances scales very well. Motivation of this issue is to apply that logic to the more generic abacus query so all Rucio instances can profit from that.
@bari12 bari12 self-assigned this Nov 2, 2020
bari12 added a commit to bari12/rucio that referenced this issue Nov 2, 2020
@bari12
WIP Replicas: Improve performance for abacus duplicate detection; Fix r…
52efe4b 
…ucio#4100
bari12 added a commit to bari12/rucio that referenced this issue Nov 2, 2020
@bari12
WIP Replicas: Improve performance for abacus duplicate detection; Fix r…
e4263d8 
…ucio#4100
bari12 added a commit to bari12/rucio that referenced this issue Nov 4, 2020
@bari12
WIP Replicas: Improve performance for abacus duplicate detection; Fix r…
bb7a43e 
…ucio#4100
bari12 added a commit to bari12/rucio that referenced this issue Nov 4, 2020
@bari12
WIP Replicas: Improve performance for abacus duplicate detection; Fix r…
e89b658 
…ucio#4100
bari12 added a commit to bari12/rucio that referenced this issue Nov 4, 2020
@bari12
WIP Replicas: Improve performance for abacus duplicate detection; Fix r…
5a9337a 
…ucio#4100
bari12 added a commit to bari12/rucio that referenced this issue Nov 6, 2020
@bari12
WIP Replicas: Improve performance for abacus duplicate detection; Fix r…
ba3a9c7 
…ucio#4100
bari12 added a commit to bari12/rucio that referenced this issue Nov 6, 2020
@bari12
WIP Replicas: Improve performance for abacus duplicate detection; Fix r…
c842ea5 
…ucio#4100
bari12 added a commit to bari12/rucio that referenced this issue Nov 6, 2020
@bari12
WIP Replicas: Improve performance for abacus duplicate detection; Fix r…
abd6db8 
…ucio#4100
bari12 added a commit to bari12/rucio that referenced this issue Nov 6, 2020
@bari12
WIP Replicas: Improve performance for abacus duplicate detection; Fix r…
5554d6d 
…ucio#4100
bari12 added a commit to bari12/rucio that referenced this issue Nov 6, 2020
@bari12
WIP Replicas: Improve performance for abacus duplicate detection; Fix r…
99665f6 
…ucio#4100
bari12 added a commit to bari12/rucio that referenced this issue Nov 6, 2020
@bari12
WIP Replicas: Improve performance for abacus duplicate detection; Fix r…
e0b7948 
…ucio#4100
bari12 added a commit to bari12/rucio that referenced this issue Nov 6, 2020
@bari12
WIP Replicas: Improve performance for abacus duplicate detection; Fix r…
2dfa469 
…ucio#4100
bari12 added a commit to bari12/rucio that referenced this issue Nov 9, 2020
@bari12
Replicas: Improve performance for abacus duplicate detection; Fix ruc…
08e0dcd 
…io#4100
bari12 added a commit to bari12/rucio that referenced this issue Nov 9, 2020
@bari12
Replicas: Improve performance for abacus duplicate detection; Fix ruc…
b55f591 
…io#4100
bari12 added a commit to bari12/rucio that referenced this issue Nov 9, 2020
@bari12
Replicas: Improve performance for abacus duplicate detection; Fix ruc…
07794fd 
…io#4100
bari12 added a commit to bari12/rucio that referenced this issue Nov 9, 2020
@bari12
Replicas: Improve performance for abacus duplicate detection; Fix ruc…
c207873 
…io#4100
bari12 added a commit to bari12/rucio that referenced this issue Nov 9, 2020
@bari12
Replicas: Improve performance for abacus duplicate detection; Fix ruc…
2659ab3 
…io#4100
bari12 added a commit to bari12/rucio that referenced this issue Nov 9, 2020
@bari12
Replicas: Improve performance for abacus duplicate detection; Fix ruc…
e28dbec 
…io#4100
@bari12 bari12 closed this as completed in 17f378a Nov 10, 2020
bari12 added a commit that referenced this issue Nov 10, 2020
@bari12
Merge pull request #4117 from bari12/patch-4100-Replicas__Improve_aba…
24033db 
…cus_duplicate_deletion_query

Replicas: Improve performance for abacus duplicate detection; Fix #4100
bari12 added a commit that referenced this issue Nov 10, 2020
@bari12
Replicas: Improve performance for abacus duplicate detection; Fix #4100
bba234a
@bari12 bari12 added this to the 1.23.10 milestone Nov 10, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@bari12 bari12

Labels
enhancement Replicas
Projects
None yet
Milestone
1.23.10
Development

No branches or pull requests
1 participant
@bari12