Fixed access to local FS for input files + minor refactoring of AnalysisTools.h#242
Fixed access to local FS for input files + minor refactoring of AnalysisTools.h#242kandrosov merged 12 commits intocms-flaf:mainfrom
Conversation
|
@cms-flaf-bot please test
|
|
pipeline#14651062 started |
|
pipeline#14651062 failed |
|
@cms-flaf-bot please test
|
|
pipeline#14651504 started |
|
@cms-flaf-bot please test
|
|
pipeline#14651971 started |
|
pipeline#14651504 failed |
|
pipeline#14651971 failed |
|
@cms-flaf-bot please test
|
|
pipeline#14652961 started |
|
pipeline#14652961 failed |
|
@cms-flaf-bot please test
|
|
pipeline#14653993 started |
|
pipeline#14653993 passed |
|
@cms-flaf-bot please test
|
|
pipeline#14669128 started |
|
pipeline#14669128 failed |
|
@cms-flaf-bot please test
|
|
pipeline#14669473 started |
|
pipeline#14669473 failed |
|
pipeline#14669473 passed |
There was a problem hiding this comment.
Pull request overview
This PR updates FLAF’s workflow and utilities to better support running with input/output on the local filesystem, while also refactoring vector-ops helpers and updating a few environment/config defaults.
Changes:
- Add local filesystem handling in LAW filesystem/target construction and update tasks to use absolute paths for localized I/O.
- Refactor
v_opsp4 component extractors and add a newTakeAndCasthelper inAnalysisTools.h. - Update defaults/configs (CMSSW version/compiler defaults, integration task target, and a few dataset NanoAOD dataset paths).
Reviewed changes
Copilot reviewed 12 out of 12 changed files in this pull request and generated 2 comments.
Show a summary per file
| File | Description |
|---|---|
| run_tools/law_customizations.py | Extend remote_target logic for local FS targets. |
| include/AnalysisTools.h | Refactor v_ops extractors and introduce ROOT::VecOps::TakeAndCast. |
| env.sh | Switch default CMSSW version/compiler. |
| config/Run3_2023/datasets.yaml | Update DY NanoAOD v12 dataset path revision. |
| config/Run3_2022EE/datasets.yaml | Update DY NanoAOD v12 dataset path revision. |
| config/Run3_2022/datasets.yaml | Update DY NanoAOD v12 dataset path revision. |
| Common/Setup.py | Return a law.LocalFileSystem for absolute local paths. |
| Common/BaselineSelection.py | Allow selecting a specific MET collection when defining reco p4s. |
| Analysis/tasks.py | Use absolute paths for inputs/outputs when running producers and moving localized outputs. |
| AnaProd/tasks.py | Use absolute paths for localized I/O and guard file_interface access. |
| AnaProd/anaTupleProducer.py | Pass met_type through to reco p4 selection. |
| .github/integration_cfg.yaml | Switch HH_bbWW integration task to FLAF.Analysis.tasks.HistPlotTask. |
Comments suppressed due to low confidence (1)
run_tools/law_customizations.py:140
remote_dir_targetstill only special-casesfswhen it is astr. WithCommon/Setup.pynow potentially returning alaw.LocalFileSystemfor local paths, passing such an FS intoremote_dir_targetwill currently fall through toWLCGDirectoryTarget(path, fs), which is incompatible. Consider adding the sameLocalFileSystemhandling here as inremote_target(returninglaw.LocalDirectoryTarget(path, fs=fs)).
def remote_dir_target(self, *path, fs=None):
fs = fs or self.fs_default
path = os.path.join(*path)
if type(fs) == str:
path = os.path.join(fs, path)
return law.LocalDirectoryTarget(path)
return WLCGDirectoryTarget(path, fs)
|
@cms-flaf-bot please test
|
|
pipeline#14669977 started |
|
pipeline#14669977 passed |
Uh oh!
There was an error while loading. Please reload this page.