Skip to content

Fixed access to local FS for input files + minor refactoring of AnalysisTools.h#242

Merged
kandrosov merged 12 commits intocms-flaf:mainfrom
kandrosov:fixLocalFS
May 1, 2026
Merged

Fixed access to local FS for input files + minor refactoring of AnalysisTools.h#242
kandrosov merged 12 commits intocms-flaf:mainfrom
kandrosov:fixLocalFS

Conversation

@kandrosov
Copy link
Copy Markdown
Contributor

@kandrosov kandrosov commented Apr 29, 2026

  • Fixed access issues when input or output files are located in the local FS
  • refactored v_ops definitions
  • added TakeAndCast function
  • switched to CMSSW_16_0_6 as default

@kandrosov
Copy link
Copy Markdown
Contributor Author

@cms-flaf-bot please test

  • Corrections_version=main

@cms-flaf-bot
Copy link
Copy Markdown
Collaborator

pipeline#14651062 started

@cms-flaf-bot
Copy link
Copy Markdown
Collaborator

pipeline#14651062 failed

@kandrosov
Copy link
Copy Markdown
Contributor Author

@cms-flaf-bot please test

  • Corrections_version=main

@cms-flaf-bot
Copy link
Copy Markdown
Collaborator

pipeline#14651504 started

@kandrosov
Copy link
Copy Markdown
Contributor Author

@cms-flaf-bot please test

  • Corrections_version=main
  • HH_bbtautau_version=PR_55

@cms-flaf-bot
Copy link
Copy Markdown
Collaborator

pipeline#14651971 started

@cms-flaf-bot
Copy link
Copy Markdown
Collaborator

pipeline#14651504 failed

@cms-flaf-bot
Copy link
Copy Markdown
Collaborator

pipeline#14651971 failed

@kandrosov
Copy link
Copy Markdown
Contributor Author

@cms-flaf-bot please test

  • Corrections_version=PR_109
  • HH_bbtautau_version=PR_55
  • StatInference_version=main

@cms-flaf-bot
Copy link
Copy Markdown
Collaborator

pipeline#14652961 started

@cms-flaf-bot
Copy link
Copy Markdown
Collaborator

pipeline#14652961 failed

@kandrosov
Copy link
Copy Markdown
Contributor Author

@cms-flaf-bot please test

  • Corrections_version=PR_109
  • HH_bbtautau_version=PR_55
  • StatInference_version=main

@cms-flaf-bot
Copy link
Copy Markdown
Collaborator

pipeline#14653993 started

@cms-flaf-bot
Copy link
Copy Markdown
Collaborator

pipeline#14653993 passed

@kandrosov
Copy link
Copy Markdown
Contributor Author

@cms-flaf-bot please test

  • Corrections_version=PR_109
  • HH_bbtautau_version=PR_55
  • HH_bbWW_version=PR_73
  • StatInference_version=main

@cms-flaf-bot
Copy link
Copy Markdown
Collaborator

pipeline#14669128 started

@cms-flaf-bot
Copy link
Copy Markdown
Collaborator

pipeline#14669128 failed

@kandrosov
Copy link
Copy Markdown
Contributor Author

@cms-flaf-bot please test

  • Corrections_version=PR_109
  • HH_bbtautau_version=PR_55
  • HH_bbWW_version=PR_73
  • H_mumu_version=PR_52
  • StatInference_version=main

@cms-flaf-bot
Copy link
Copy Markdown
Collaborator

pipeline#14669473 started

@cms-flaf-bot
Copy link
Copy Markdown
Collaborator

pipeline#14669473 failed

@cms-flaf-bot
Copy link
Copy Markdown
Collaborator

pipeline#14669473 passed

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates FLAF’s workflow and utilities to better support running with input/output on the local filesystem, while also refactoring vector-ops helpers and updating a few environment/config defaults.

Changes:

  • Add local filesystem handling in LAW filesystem/target construction and update tasks to use absolute paths for localized I/O.
  • Refactor v_ops p4 component extractors and add a new TakeAndCast helper in AnalysisTools.h.
  • Update defaults/configs (CMSSW version/compiler defaults, integration task target, and a few dataset NanoAOD dataset paths).

Reviewed changes

Copilot reviewed 12 out of 12 changed files in this pull request and generated 2 comments.

Show a summary per file
File Description
run_tools/law_customizations.py Extend remote_target logic for local FS targets.
include/AnalysisTools.h Refactor v_ops extractors and introduce ROOT::VecOps::TakeAndCast.
env.sh Switch default CMSSW version/compiler.
config/Run3_2023/datasets.yaml Update DY NanoAOD v12 dataset path revision.
config/Run3_2022EE/datasets.yaml Update DY NanoAOD v12 dataset path revision.
config/Run3_2022/datasets.yaml Update DY NanoAOD v12 dataset path revision.
Common/Setup.py Return a law.LocalFileSystem for absolute local paths.
Common/BaselineSelection.py Allow selecting a specific MET collection when defining reco p4s.
Analysis/tasks.py Use absolute paths for inputs/outputs when running producers and moving localized outputs.
AnaProd/tasks.py Use absolute paths for localized I/O and guard file_interface access.
AnaProd/anaTupleProducer.py Pass met_type through to reco p4 selection.
.github/integration_cfg.yaml Switch HH_bbWW integration task to FLAF.Analysis.tasks.HistPlotTask.
Comments suppressed due to low confidence (1)

run_tools/law_customizations.py:140

  • remote_dir_target still only special-cases fs when it is a str. With Common/Setup.py now potentially returning a law.LocalFileSystem for local paths, passing such an FS into remote_dir_target will currently fall through to WLCGDirectoryTarget(path, fs), which is incompatible. Consider adding the same LocalFileSystem handling here as in remote_target (returning law.LocalDirectoryTarget(path, fs=fs)).
    def remote_dir_target(self, *path, fs=None):
        fs = fs or self.fs_default
        path = os.path.join(*path)
        if type(fs) == str:
            path = os.path.join(fs, path)
            return law.LocalDirectoryTarget(path)
        return WLCGDirectoryTarget(path, fs)

Comment thread include/AnalysisTools.h Outdated
Comment thread run_tools/law_customizations.py Outdated
@kandrosov
Copy link
Copy Markdown
Contributor Author

@cms-flaf-bot please test

  • Corrections_version=PR_109
  • HH_bbtautau_version=PR_55
  • HH_bbWW_version=PR_73
  • H_mumu_version=PR_52
  • StatInference_version=main

@cms-flaf-bot
Copy link
Copy Markdown
Collaborator

pipeline#14669977 started

@cms-flaf-bot
Copy link
Copy Markdown
Collaborator

pipeline#14669977 passed

@kandrosov kandrosov merged commit 4909731 into cms-flaf:main May 1, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants