New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DM-27117: Add dummy pipeline to ap_verify testing #151
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good, few minor comments.
|
||
def runQuantum(self, butlerQC, inputRefs, outputRefs): | ||
inputs = butlerQC.get(inputRefs) | ||
if 'exposureIdInfo' not in inputs.keys(): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Double quotes for strings?
inputs['exposureIdInfo'] = obsBase.ExposureIdInfo.fromDataId( | ||
butlerQC.quantum.dataId, "visit_detector") | ||
|
||
if self.config.doAstrometry: | ||
inputs.pop('astromRefCat') | ||
if self.config.doPhotoCal: | ||
inputs.pop('photoRefCat') |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Double quotes for all string literals?
da855c5
to
e460982
Compare
This PR adds a dummy pipeline that mirrors the form, configuration, and connections of
${AP_PIPE_DIR}/pipelines/ApPipe.yaml
, but is specialized forap_verify_testdata
and does no processing besides dataset handling. It then rewrites the tests intest_driver.py
to make use of the new pipeline.This change pushes the total unit test run time up to a minute (30 s per individual test), but I don't see any way to reduce this time at present. Because the repository setup for
ap_verify
is fairly complex and doesn't allow for customization hooks, creating an in-memory repository is not practical. I did try to factor the repository setup intosetUpClass
, but this actually increased test run time.In any case, 20 s of each test's 30 s run time is from running the pipeline itself; this will be addressed on DM-33734 since it has implications for Production.