Removing last replica which is a constituent #2213
Comments
rcarpa
added a commit
to rcarpa/rucio
that referenced
this issue
Mar 23, 2021
Ensure that replicas are removed from datasets only if they don't exists in an archive. When removing an archive, handle the removal of its constituents. Only if: - they don't exist in another archive - they don't have replicas outside any archive This is achieved by recursively calling the cleanup function after removing the archive (and thus the constituent replicas).
rcarpa
added a commit
to rcarpa/rucio
that referenced
this issue
Mar 23, 2021
Ensure that replicas are removed from datasets only if they don't exists in an archive. When removing an archive, handle the removal of its constituents. Only if: - they don't exist in another archive - they don't have replicas outside any archive This is achieved by recursively calling the cleanup function after removing the archive (and thus the constituent replicas).
rcarpa
added a commit
to rcarpa/rucio
that referenced
this issue
Mar 23, 2021
Ensure that replicas are removed from datasets only if they don't exists in an archive. When removing an archive, handle the removal of its constituents. Only if: - they don't exist in another archive - they don't have replicas outside any archive This is achieved by recursively calling the cleanup function after removing the archive (and thus the constituent replicas).
rcarpa
added a commit
to rcarpa/rucio
that referenced
this issue
Mar 23, 2021
Ensure that replicas are removed from datasets only if they don't exists in an archive. When removing an archive, handle the removal of its constituents. Only if: - they don't exist in another archive - they don't have replicas outside any archive This is achieved by recursively calling the cleanup function after removing the archive (and thus the constituent replicas).
rcarpa
added a commit
to rcarpa/rucio
that referenced
this issue
Mar 23, 2021
Ensure that replicas are removed from datasets only if they don't exists in an archive. When removing an archive, handle the removal of its constituents. Only if: - they don't exist in another archive - they don't have replicas outside any archive This is achieved by recursively calling the cleanup function after removing the archive (and thus the constituent replicas).
rcarpa
added a commit
to rcarpa/rucio
that referenced
this issue
Mar 24, 2021
Ensure that replicas are removed from datasets only if they don't exists in an archive. When removing an archive, handle the removal of its constituents. Only if: - they don't exist in another archive - they don't have replicas outside any archive This is achieved by recursively calling the cleanup function after removing the archive (and thus the constituent replicas).
rcarpa
added a commit
to rcarpa/rucio
that referenced
this issue
Mar 24, 2021
Ensure that replicas are removed from datasets only if they don't exists in an archive. When removing an archive, handle the removal of its constituents. Only if: - they don't exist in another archive - they don't have replicas outside any archive This is achieved by recursively calling the cleanup function after removing the archive (and thus the constituent replicas).
rcarpa
added a commit
to rcarpa/rucio
that referenced
this issue
Mar 30, 2021
Ensure that replicas are removed from datasets only if they don't exists in an archive. When removing an archive, handle the removal of its constituents. Only if: - they don't exist in another archive - they don't have replicas outside any archive This is achieved by recursively calling the cleanup function after removing the archive (and thus the constituent replicas).
bari12
pushed a commit
that referenced
this issue
Apr 22, 2021
* Deletion: handle archives in reaper. #1431 #2213 Ensure that replicas are removed from datasets only if they don't exists in an archive. When removing an archive, handle the removal of its constituents. Only if: - they don't exist in another archive - they don't have replicas outside any archive This is achieved by recursively calling the cleanup function after removing the archive (and thus the constituent replicas). * Deletion: tolerate RSEs removal during rse-to-hostname mapping #1431 The case happens in tests now that we have concurrent tests which create and remove RSEs. There is probably no harm to simply ignore the RSEs which were removed between the list_rses call and the get_rse_protocols call.
bari12
pushed a commit
that referenced
this issue
Apr 22, 2021
* Deletion: handle archives in reaper. #1431 #2213 Ensure that replicas are removed from datasets only if they don't exists in an archive. When removing an archive, handle the removal of its constituents. Only if: - they don't exist in another archive - they don't have replicas outside any archive This is achieved by recursively calling the cleanup function after removing the archive (and thus the constituent replicas). * Deletion: tolerate RSEs removal during rse-to-hostname mapping #1431 The case happens in tests now that we have concurrent tests which create and remove RSEs. There is probably no harm to simply ignore the RSEs which were removed between the list_rses call and the get_rse_protocols call.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Motivation
When the last replica of a file is removed in the reaper, it should only be removed from the dataset if it is not a constituent of an existing archive replica. This also implies, if a archive replica is removed and there are no replicas on the constituents, the constituents need to be removed from their parent datasets.
The text was updated successfully, but these errors were encountered: