Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluator use cases to guide comprehensive flagging system #8

Closed
aimalz opened this issue Apr 18, 2023 · 1 comment
Closed

Evaluator use cases to guide comprehensive flagging system #8

aimalz opened this issue Apr 18, 2023 · 1 comment
Labels
help wanted Extra attention is needed question Further information is requested

Comments

@aimalz
Copy link
Collaborator

aimalz commented Apr 18, 2023

We've sort of been using #5 and LSSTDESC/rail_bpz#28 to discuss flags, but I think it's worth making a new issue to collect information on use cases that would inform an actual system for per-galaxy flags within RAIL, i.e. where RAIL provides shortcuts to generate entries to certain flag fields that we know other DESC pipelines want to use, given that the qp.Ensemble.ancil attribute makes it a solved problem infrastructure-wise. For example, based on this LSSTC Slack discussion, we should make sure an estimator's confidence measure (e.g. ODDS) is retained as ancil information in the output PDFs, and there ought to be an evaluator to calculate something like IQR over S/N; to tie it all together for the CL use case, we could provide a flexible flagger stage that applies user-specified cuts on those ancil fields to assign integer flags. tl;dr let's try to gather use cases here to see if we can identify commonalities between what we know how to make and what people need for downstream pipelines that can guide upcoming development within rail.evaluation.

@aimalz aimalz added help wanted Extra attention is needed question Further information is requested labels Apr 18, 2023
@aimalz aimalz added enhancement New feature or request and removed enhancement New feature or request labels Jun 7, 2023
@eacharles eacharles transferred this issue from LSSTDESC/rail_attic Jun 13, 2023
@aimalz
Copy link
Collaborator Author

aimalz commented Aug 2, 2023

This isn't really actionable, so we'll continue discussing this informally on Slack.

@aimalz aimalz closed this as completed Aug 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed question Further information is requested
Projects
None yet
Development

No branches or pull requests

1 participant