fix: Do not add trailing slash in xrootd urls

[valsdav]

Now the sites map cache file is invalidated after 10 mins to avoid stale information.

Fixes #1053

[lgray]

@nsmith- can you give this a try?

[nsmith-]

I should point out that rather than parsing the SITECONF you can also ask rucio to give you the PFNs, e.g. on the commandline

rucio list-file-replicas cms:/SingleMuon/Run2018A-UL2018_MiniAODv2_NanoAODv9_GT36-v1/NANOAOD --rse 'rse_type=DISK&country=US' --protocol root

gives xrootd urls for files in that dataset

[nsmith-]

To be sure you could use rules + "/" + path.removeprefix("/")

[valsdav]

I should point out that rather than parsing the SITECONF you can also ask rucio to give you the PFNs, e.g. on the commandline

rucio list-file-replicas cms:/SingleMuon/Run2018A-UL2018_MiniAODv2_NanoAODv9_GT36-v1/NANOAOD --rse 'rse_type=DISK&country=US' --protocol root

gives xrootd urls for files in that dataset

I agree, but the SITCONF hack was done to overcome the issue that not all the sites are returning root endpoints, sometimes only davs. Maybe the problem has been fixed in the meanwhile?

[nsmith-]

I should point out that rather than parsing the SITECONF you can also ask rucio to give you the PFNs, e.g. on the commandline

rucio list-file-replicas cms:/SingleMuon/Run2018A-UL2018_MiniAODv2_NanoAODv9_GT36-v1/NANOAOD --rse 'rse_type=DISK&country=US' --protocol root

gives xrootd urls for files in that dataset

I agree, but the SITCONF hack was done to overcome the issue that not all the sites are returning root endpoints, sometimes only davs. Maybe the problem has been fixed in the meanwhile?

Is there a ticket/thread with CMS DM ops / site support on the subject? If not, we should make one.

[valsdav]

I should point out that rather than parsing the SITECONF you can also ask rucio to give you the PFNs, e.g. on the commandline

rucio list-file-replicas cms:/SingleMuon/Run2018A-UL2018_MiniAODv2_NanoAODv9_GT36-v1/NANOAOD --rse 'rse_type=DISK&country=US' --protocol root

gives xrootd urls for files in that dataset

I agree, but the SITCONF hack was done to overcome the issue that not all the sites are returning root endpoints, sometimes only davs. Maybe the problem has been fixed in the meanwhile?

Is there a ticket/thread with CMS DM ops / site support on the subject? If not, we should make one.

I will give it another try, it was more than 1 year ago and I haven't test it since then..