Skip to content

Commit

Permalink
Update LATISS DRP.yaml pipeline
Browse files Browse the repository at this point in the history
This add tasks to the DRP.yaml file through coaddition and multiband
measurement.  These have all been tested on LATISS data, so are safe
(and desirable) to add to the pipeline used for regular processing of
LATISS runs.
  • Loading branch information
laurenam committed Jan 31, 2023
1 parent b906b4b commit 1dbf867
Showing 1 changed file with 82 additions and 2 deletions.
84 changes: 82 additions & 2 deletions pipelines/LATISS/DRP.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -3,13 +3,93 @@ instrument: lsst.obs.lsst.Latiss
imports:
- location: $DRP_PIPE_DIR/ingredients/DRP-minimal-calibration.yaml
include:
- processCcd
- isr
- characterizeImage
- calibrate
- writeSourceTable
- transformSourceTable
- consolidateSourceTable
- consolidateVisitSummary
- isolatedStarAssociation
- finalizeCharacterization
- updateVisitSummary
- makeCcdVisitTable
- makeVisitTable
- makeWarp
- assembleCoadd
- detection
- mergeDetections
- deblend
- measure
- mergeMeasurements
- writeObjectTable
- transformObjectTable
- consolidateObjectTable
- forcedPhotCoadd

subsets:
sourceTable:
step1:
subset:
- isr
- characterizeImage
- calibrate
- writeSourceTable
- transformSourceTable
description: |
Per-detector tasks that can be run together to start the DRP pipeline.
These should never be run with 'tract' or 'patch' as part of the data ID
expression if any later steps will also be run, because downstream steps
require full visits and 'tract' and 'patch' constraints will always
select partial visits that overlap that region (also noting that while
this may be moot for a single-detector camera, we would still like to
follow best practices envisioned for the full LSST survey).
step2:
subset:
- consolidateSourceTable
- consolidateVisitSummary
- isolatedStarAssociation
- finalizeCharacterization
- updateVisitSummary
- makeCcdVisitTable
- makeVisitTable
description: |
This is a mix of visit-level and tract-level tasks that must not be run
with data query constraints other than instrument. These are tasks that
can be run together, but only after the 'step1' subset.
Visit-level: consolidateSourceTable, consolidateVisitSummary,
finalizeCharacterization, updateVisitSummary,
makeCcdVisitTable, makVisitTable
Tract-level: isolatedStarAssociation
step3a:
subset:
- makeWarp
- assembleCoadd
- detection
- mergeDetections
- deblend
- measure
- mergeMeasurements
- forcedPhotCoadd
- writeObjectTable
- transformObjectTable
description: |
Tract-level coaddition tasks. Allowed data query constraints: tract
Tasks that can be run together, but only after the 'step1' and 'step2'
subsets. If you do not include tract in the data query, you will get
tracts with only partial coverage.
This subset is considered a workaround for missing middleware and task
functionality. It may be removed in the future.
step3b:
subset:
- consolidateObjectTable
description: |
Tract-level tasks. Allowed data query constraints: tract
Tasks that can be run together, but only after the 'step1', 'step2', and
'step3a' subsets (seperation into step3a and step3b is necessary for now
as otherwise failues in upstream tasks will cause these to fail. This is
hoped to be a temporary limitation).

0 comments on commit 1dbf867

Please sign in to comment.