automatically appending local rucio path

[FaroutYLq]

What does the code in this PR do / what does it improve?

Liberate users from manually adding midway rucio RSE by specifying

st_midway = cutax.xenonnt_online(_rucio_local_path='/project/lgrandi/rucio', include_rucio_local = True)

Can you briefly describe how it works?

Introduced a new parameter in xenonnt_online called _auto_append_rucio_local. If True (by default it is True), it will make include_rucio_local = True and append the midway rucio path in _rucio_local_path.

Can you give a minimal working example (or illustrate with a figure)?

After modification, st = cutax.xenonnt_online() will have access to data in midway rucio if you are not on dali compute nodes.

Please include the following if applicable:

• Update the docstring(s)
• Update the documentation
• Tests to check the (new) code is working as desired.
• Does it solve one of the open issues on github?

[FaroutYLq]

This is just a dirty workaround. The proper way to do it will require decoupling hardcoding in straxen.RunDB. For example: here.

[FaroutYLq]

Meanwhile, we should probably also refactor _rucio_local_path. It has been marked "Only use for testing!" for a while...

[coveralls]

coverage: 93.459% (+0.04%) from 93.417% when pulling 00d4048 on which_rucio into f39d8ea on master.

[dachengx]

Whether we want to merge it like this depends on whether we want to postpone the complete decoupling of dali in straxen's hardcode.

[dachengx]

Thanks @FaroutYLq .

st = straxen.contexts.xenonnt_online()

On dali computing node, storages are:

[straxen.storage.rundb.RunDB, readonly: True,
 strax.storage.files.DataDirectory, readonly: True, path: /dali/lgrandi/xenonnt/raw, take_only: ('raw_records', 'raw_records_he', 'raw_records_aqmon', 'raw_records_nv', 'raw_records_aqmon_nv', 'raw_records_aux_mv', 'raw_records_mv'),
 strax.storage.files.DataDirectory, readonly: True, path: /dali/lgrandi/xenonnt/processed,
 strax.storage.files.DataDirectory, readonly: True, path: /project2/lgrandi/xenonnt/processed,
 strax.storage.files.DataDirectory, readonly: True, path: /project/lgrandi/xenonnt/processed,
 strax.storage.files.DataDirectory, path: ./strax_data]

On xenon1t computing node, storages are:

[straxen.storage.rundb.RunDB, readonly: True,
 strax.storage.files.DataDirectory, readonly: True, path: /dali/lgrandi/xenonnt/raw, take_only: ('raw_records', 'raw_records_he', 'raw_records_aqmon', 'raw_records_nv', 'raw_records_aqmon_nv', 'raw_records_aux_mv', 'raw_records_mv'),
 strax.storage.files.DataDirectory, readonly: True, path: /dali/lgrandi/xenonnt/processed,
 strax.storage.files.DataDirectory, readonly: True, path: /project2/lgrandi/xenonnt/processed,
 strax.storage.files.DataDirectory, readonly: True, path: /project/lgrandi/xenonnt/processed,
 strax.storage.files.DataDirectory, path: ./strax_data,
 straxen.storage.rucio_local.RucioLocalFrontend, readonly: True, path: /project/lgrandi/rucio/]

Looks good to me.

[FaroutYLq]

Since we are having tutorial for users to load data now, I feel less urgency to do this dirty workaround. Personally I suggest in straxen we do things technically better rather than quick dirty tricks like what I did. I would close it for now and let's pick up once we have more elegant solution (and time : )). Thanks @dachengx

[FaroutYLq]

@dachengx . I discussed with @jingqiangye yesterday and we think for now the user experience might be more important than software logic elegancy. Let's reconsider merging this for the coming environment release.

[dachengx]

@dachengx . I discussed with @jingqiangye yesterday and we think for now the user experience might be more important than software logic elegancy. Let's reconsider merging this for the coming environment release.

No objection. Just keep in mind that this will anyway take effect after the new release of nT base_environment.

[FaroutYLq]

Yes I am aware. Thanks for the head up Lanqing Yuan On Jun 10, 2023, at 1:24 PM, Dacheng Xu ***@***.***> wrote:  @dachengx<https://github.com/dachengx> . I discussed with @jingqiangye<https://github.com/jingqiangye> yesterday and we think for now the user experience might be more important than software logic elegancy. Let's reconsider merging this for the coming environment release. No objection. Just keep in mind that this will anyway take effect after the new release of nT base_environment. — Reply to this email directly, view it on GitHub<#1182 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ALG57AXIFC3OTBQSTK377LLXKS3VPANCNFSM6AAAAAAYCYY4PE>. You are receiving this because you modified the open/close state.Message ID: ***@***.***>