Skip to content

Test whether provided error bound is satisfied#20

Merged
treigerm merged 8 commits into
mainfrom
redo_tests
Apr 11, 2025
Merged

Test whether provided error bound is satisfied#20
treigerm merged 8 commits into
mainfrom
redo_tests

Conversation

@treigerm
Copy link
Copy Markdown
Member

This is adding a new test which verifies that the pointwise error is not exceeded. A while back I discussed with @milankl and this could be the only test, we actually need. In the end, all the other tests also have thresholds which are set seemingly arbitrarily. So just having one pass/fail test which depends on the ERA5 derived error bounds seems sensible enough.

I haven't deleted any of the other tests yet though because it might be nice to keep them around until we make a definite decision to drop them.

@treigerm treigerm requested a review from juntyr April 10, 2025 14:09
Comment thread src/climatebenchpress/compressor/tests/error_bound.py
Copy link
Copy Markdown
Collaborator

@juntyr juntyr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks great! There are just some minor fixes needed to the error bound check (I now have too much experience with its edge cases)

Comment thread src/climatebenchpress/compressor/tests/error_bound.py Outdated
Comment thread src/climatebenchpress/compressor/tests/error_bound.py
Comment thread scripts/collect_metrics.py Outdated
Comment thread src/climatebenchpress/compressor/tests/error_bound.py
Comment thread src/climatebenchpress/compressor/tests/error_bound.py Outdated
Comment thread src/climatebenchpress/compressor/tests/error_bound.py
Comment thread src/climatebenchpress/compressor/tests/error_bound.py Outdated
Copy link
Copy Markdown
Collaborator

@juntyr juntyr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks @treigerm!

@treigerm
Copy link
Copy Markdown
Member Author

Thanks for the review! I don't want to know how you learnt about all of these edge cases 😅

@treigerm treigerm merged commit b304f8f into main Apr 11, 2025
3 checks passed
@juntyr juntyr deleted the redo_tests branch April 14, 2025 13:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants