Pipeline robustness when reading ETC values from raw data header #1309
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR fixes a corner case where ACTTEFF is defined in the raw data header but is set to an empty (non-numeric) value. This caused the pipeline to crash. Now we test that it can be transformed into a float within a
try
statement.This was part of a larger discussion that led to the choice of deprecating
ACTTEFF
in favor ofETCTEFF
, which is also in the raw data header. For future dates on or after 20210614, onlyETCTEFF
will be checked. The old keyword is kept for compatibility with old data (under an assertion thatnight<20210614
).I tested this on nights in Dec 2020, Jan 2021, Feb 2021, April 2021, May 2021, and June 14 2021. No issues on any date.