DM-41203: Add pipeline subsetting control option. #389

natelust · 2023-11-30T14:45:28Z

Add an option to pipeline subsetting which controls how named subsets are handled when they contain a task label which is not contained in the new subsetted pipeline.

Checklist

ran Jenkins
added a release note for user-visible changes to doc/changes

codecov · 2023-11-30T14:48:00Z

Codecov Report

Attention: 1 lines in your changes are missing coverage. Please review.

Comparison is base (cdd3437) 82.39% compared to head (7b4487e) 82.47%.

Files	Patch %	Lines
python/lsst/pipe/base/pipelineIR.py	95.83%	0 Missing and 1 partial ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #389      +/-   ##
==========================================
+ Coverage   82.39%   82.47%   +0.08%     
==========================================
  Files          92       92              
  Lines       10375    10431      +56     
  Branches     1956     1971      +15     
==========================================
+ Hits         8548     8603      +55     
  Misses       1484     1484              
- Partials      343      344       +1

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

tests/test_pipelineIR.py

python/lsst/pipe/base/pipeline.py

python/lsst/pipe/base/pipelineIR.py

python/lsst/pipe/base/pipeline.py

python/lsst/pipe/base/pipelineIR.py

Add an option to pipeline subsetting which controls how named subsets are handled when they contain a task label which is not contained in the new subsetted pipeline.

Adds a new property which returns a mapping of subset label to sets of task labels. Also added are addLabeledSubset and removeLabeledSubset which add a new labeled subset and remove an existing labeled subset respectively.

natelust force-pushed the tickets/DM-41203 branch 3 times, most recently from 294211f to a0ac9e6 Compare November 30, 2023 16:23