Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add dirac_add_files method for the Rucio/Dirac integration #3692

Closed
cserf opened this issue Jun 3, 2020 · 2 comments
Closed

Add dirac_add_files method for the Rucio/Dirac integration #3692

cserf opened this issue Jun 3, 2020 · 2 comments

Comments

@cserf
Copy link
Contributor

cserf commented Jun 3, 2020

Motivation

The goal of the method is to have a atomic way to create files for Dirac. Use case : I would like to create a file named /belle//user/serfon/dir/mytest.root. This should be part of dataset /belle/user/serfon/dir. The method needs to :

  • Check if /belle/user/serfon/dir and all it's ascendants /belle/user/serfon, /belle/user, etc. exist. If not it creates and attachs them.
  • Create the file+replicas and a rule on the dataset.

Modification

Create a new client, REST, API, core for dirac methods

@mlassnig
Copy link
Contributor

mlassnig commented Jun 3, 2020

Don't we have something like this for ATLAS Tier-0 already?

@cserf
Copy link
Contributor Author

cserf commented Jun 4, 2020

Nope. T0 just does a only add_replicas + attach and it's not atomic. What we want here is different, because we need to reconstruct the hierarchical namespace :
Container /belle containing container /belle/user (and so on) containing dataset /belle/user/serfon/dir containing file /belle//user/serfon/dir/mytest.root . The method should be able to create any of the non existing directories in an atomic way.

cserf added a commit to cserf/rucio that referenced this issue Jun 9, 2020
…: Adding permission file + Define extract_scope based on policy : Closes rucio#3679, rucio#3690, rucio#3692
bari12 added a commit that referenced this issue Jun 16, 2020
…thod_for_the_Rucio_Dirac_integration

Add dirac_add_files method for the Rucio/Dirac integration + Belleii : Adding permission file + Define extract_scope based on policy : Closes #3679, #3690, #3692
bari12 added a commit that referenced this issue Jun 16, 2020
…thod_for_the_Rucio_Dirac_integration

Add dirac_add_files method for the Rucio/Dirac integration + Belleii : Adding permission file + Define extract_scope based on policy : Closes #3679, #3690, #3692
@bari12 bari12 added this to the 1.22.8-clients milestone Jun 16, 2020
@bari12 bari12 closed this as completed Jun 16, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants