DM-43347: Add a Fast Summit Support and a Slower Validation Pipelines to be run on Rapid Analysis #114
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
yalsayyad
force-pushed
the
tickets/DM-43347
branch
7 times, most recently
from
6b8b62b
to
6cc2b78
Compare
ctslater
approved these changes
Mar 21, 2024
| isr: | ||
| class: lsst.ip.isr.IsrTask | ||
| config: | ||
| # Turn off all slow steps in ISR for |
| can be run together, but only after the 'step1' and 'step2d' | ||
| subsets. | ||
|
|
||
| These should be run with explicit 'tract' constraints essentially all the |
There was a problem hiding this comment.
Is this true? Seems like it'll be a pain if we have to select tracts for each night.
There was a problem hiding this comment.
While I totally agree, in case it helps, the log from the preliminaryVisitCoverageAnalysis task spits out this helpful message:
INFO 2024-03-20T14:49:25.907-07:00 lsst.analysis.tools.actions.plot.multiVisitCoveragePlot (preliminaryVisitCoverageAnalysis:{instrument: 'LSSTComCamSim', skymap: 'DC2'})(multiVisitCoveragePlot.py:363) - List of tracts overlapping data: [6914, 6915, 9347, 9348, 3345, 3346, 7445, 7446, 9880, 9638, 3384, 3385, 2494, 2495, 3533, 9813, 2661, 2662, 7149, 9590, 9591]
There was a problem hiding this comment.
Not true for this pipeline. That was copied and pasted from HSC-style. This pipeline we're embracing ragged style.
| @@ -0,0 +1,87 @@ | |||
| description: | | |||
| DRP-flavored pipeline to support validation | |||
| commissiong validation pipeline that will help inform | |||
There was a problem hiding this comment.
Suggested change
| commissiong validation pipeline that will help inform | |
| during commissioning, and will help inform |
yalsayyad
force-pushed
the
tickets/DM-43347
branch
from
6cc2b78
to
34cca92
Compare
- A fast observer-support pipeline matching what the single frame runner in the summit rapid analysis runs now. Working title = Quick Look - A commissiong validation pipeline that will help inform what changes to make the following night. Detector and Visit level tasks can be run in real time by e.g. Rapid Analysis. The rest of the pipeline is expected to be run as part of the 10am processing. Working title = Nightly Validation
yalsayyad
force-pushed
the
tickets/DM-43347
branch
from
34cca92
to
f687845
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Come to pair coding tomorrow to yell at me about how this doesn't look how you were expecting. 3/20 11am PT!