Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DM-33710: Update to update footprints with scarlet lite models #210

Merged
merged 1 commit into from Jun 8, 2022

Conversation

fred3m
Copy link
Contributor

@fred3m fred3m commented May 26, 2022

No description provided.

Copy link
Member

@TallJimbo TallJimbo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some minor comments.

Changes here reminded me what bad shape this task was already in, largely due to Gen2-Gen3 coexistence (which we can now clean up), but also the unfortunately-named refCatInBand=deepCoadd_meas connection and the almost-as-bad measCat=deepCoadd_forced_src local variable. Time to write an RFC, because fixing some of that is an API change.

python/lsst/meas/base/forcedPhotCoadd.py Outdated Show resolved Hide resolved
default=True,
doc="Whether to strip footprints from the output catalog before "
"saving to disk. "
"This is usually done when using scarlet models to save disk space.")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If you keep the current behavior:

Suggested change
"This is usually done when using scarlet models to save disk space.")
"This is usually done when using scarlet models to save disk space. "
"If footprintDatasetName != 'scarletDeblendModels' then this field is ignored.")

But I actually think this is a good option to have even when not using Scarlet models, and in fact it should be the default (though that might cause too much trouble downstream to do on this ticket) - these HeavyFootprints are always exactly the same as those stored in deepCoadd_meas, right?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes. I checked out a meas and forced_src catalogs for the same patch and every heavy footprint was the same, which are the same as the ones in the deblendedFlux catalog when using either scarlet or the SDSS-like deblender catalog. So we shouldn't be storing them in meas or forced_src regardless of the deblender used, and I can make that change in this ticket for coadds.

"IDs are compatible with reference source IDs" %
(srcRecord.getId(), self.config.coaddName,
self.config.footprintDatasetName))
srcRecord.setFootprint(fpRecord.getFootprint())
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You had a comment above that said that attachFootprints was Gen2-specific and wasn't worth modifying (which sounds plausible, but isn't something I can confirm or deny off the top of my head). Did that turn out not to be true?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That wasn't my comment, but one that has been in the repo since Nate updated this task 3 years ago. I think his point is that this method loads the footprint file from the data ref, which is not the way that gen3 works. So I think he was saying that when we officially deprecate gen2 we can remove this method, but in the meantime I wanted it to work with the scarlet outputs for consistency.

@fred3m fred3m merged commit f28afc6 into main Jun 8, 2022
@fred3m fred3m deleted the tickets/DM-33710 branch June 8, 2022 17:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants