Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DM-42301: Make calibration-lookup logic less restrictive. #398

Merged
merged 1 commit into from Jan 9, 2024

Conversation

TallJimbo
Copy link
Member

@TallJimbo TallJimbo commented Jan 8, 2024

Logic in the prerequisite finders that was expecting a regular calibration lookup was not correctly handling cases where the task did not have temporal dimensions even though the dataset was a calibration; it was raising exceptions even though falling through to findDataset or queryDatasets calls would have worked just fine.

Checklist

  • ran Jenkins
  • added a release note for user-visible changes to doc/changes

@TallJimbo TallJimbo force-pushed the tickets/DM-42301 branch 2 times, most recently from b7c9a15 to dbf04c1 Compare January 8, 2024 21:49
Copy link

codecov bot commented Jan 8, 2024

Codecov Report

Attention: 9 lines in your changes are missing coverage. Please review.

Comparison is base (572f9e4) 82.45% compared to head (dbf04c1) 82.43%.

❗ Current head dbf04c1 differs from pull request most recent head e880417. Consider uploading reports for the commit e880417 to get more accurate results

Files Patch % Lines
python/lsst/pipe/base/prerequisite_helpers.py 0.00% 9 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #398      +/-   ##
==========================================
- Coverage   82.45%   82.43%   -0.02%     
==========================================
  Files          91       91              
  Lines       10414    10414              
  Branches     1964     1964              
==========================================
- Hits         8587     8585       -2     
- Misses       1485     1486       +1     
- Partials      342      343       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Member

@timj timj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks okay. Do we know that ci_middleware exercises this code?

python/lsst/pipe/base/prerequisite_helpers.py Outdated Show resolved Hide resolved
@TallJimbo
Copy link
Member Author

TallJimbo commented Jan 9, 2024

ci_middleware exercises most of the logic branches in PrerequisiteFinders, but not all of them, and I know for a fact that it doesn't exercise the bug that spawned this ticket, though ci_cpp might. I just can't prioritize adding CPP-like data and tasks to ci_middleware right now.

Some of the other branches cannot actually be exercised since we only have one concrete QuantumGraphBuilder implementation class and that does optimized versions of some of those branches before they ever have a chance to fire. I figure currently-unreachable code that's probably correct is better than raising or asserting, but 🤷‍♂️?

Logic in the prerequisite finders that was expecting a regular
calibration lookup was not correctly handling cases where the task did
not have temporal dimensions even though the dataset was a
calibration; it was raising exceptions even though falling through to
findDataset or queryDatasets calls would have worked just fine.
@TallJimbo TallJimbo merged commit 4e68ae3 into main Jan 9, 2024
13 checks passed
@TallJimbo TallJimbo deleted the tickets/DM-42301 branch January 9, 2024 16:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants