New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DM-18739: Generate defects from standardized format #66
Conversation
Since pipe_tasks depends on this repository, we can't depend on the ingestDefect.py script to ingest. We need to ingest and persist the ingested version in this repository
Note that defects in standard form now reside in obs_test_data. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
One bug to fix and an associated test to write. Otherwise it looks great.
data/utils/defectsFromBias.py
Outdated
assert len(bboxList) == len(test2BBoxList) | ||
for boxA, boxB in zip(bboxList, test2BBoxList): | ||
assert boxA == boxB | ||
test2defectList = Defects.readText(DefectsPath+".ecsv") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Would it work to include the ".ecsv" suffix on DefectsPath itself -- would the correct file get written? If so, I think it would make the code a bit simpler and easier to understand. Also the description string would give the correct path for the output file (right now it is missing the ".ecsv" suffix).
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think you want to get the return value from writeText
and use that directly in readText
(writeText forces the file extension based on the type of text file it is writing). The debug print message should also use the actual name used as returned by writeText.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That sounds reasonable, though it means that the full name of the file cannot be included in the help string for the command line parser is produced. I suppose one could always print a message when saving the data.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I believe I have addressed this.
896aa4a
to
a238aa8
Compare
a238aa8
to
e0c72cc
Compare
This means the tickets/DM-18739 ticket will need to be merged with the tickets/DM-19857 branch of ap_verify
@@ -0,0 +1,14 @@ | |||
# Config override for lsst.pipe.tasks.IngestCalibsTask |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Did you mean IngestDefectsTask
?
No description provided.