Skip to content

Glows imap start time#3091

Merged
laspsandoval merged 4 commits intoIMAP-Science-Operations-Center:devfrom
laspsandoval:glows_imap_start_time
Apr 30, 2026
Merged

Glows imap start time#3091
laspsandoval merged 4 commits intoIMAP-Science-Operations-Center:devfrom
laspsandoval:glows_imap_start_time

Conversation

@laspsandoval
Copy link
Copy Markdown
Contributor

This pull request improves the robustness of the GLOWS L1A processing pipeline by filtering out histogram data with invalid timing information and enhances test coverage to ensure this behavior. The most important changes are grouped below:

Data Validation Improvements:

  • The generate_histogram_dataset function in glows_l1a.py now filters out histograms where imap_start_time.seconds == 0, logging a warning when such entries are found. This prevents invalid timing data from being included in downstream processing.

Testing Enhancements:

  • Added new pytest fixtures (in_flight_packet_path, in_flight_decom_test_data) in conftest.py to support testing with in-flight packet data containing edge cases. [1] [2]
  • Introduced test_generate_histogram_dataset_filters_zero_imap_start_time to verify that histograms with zero imap_start_time are correctly excluded from the dataset.
  • Added test_glows_l1a_no_zero_imap_start_time to confirm that the full L1A processing pipeline produces datasets without any zero imap_start_time values, and to check the number of excluded histograms.

Test Setup and Imports:

  • Updated imports in test_glows_l1a_cdf.py to include necessary modules and classes for the new tests.

@laspsandoval laspsandoval requested a review from maxinelasp April 28, 2026 17:57
@laspsandoval laspsandoval self-assigned this Apr 28, 2026
@laspsandoval laspsandoval added the Ins: GLOWS Related to the GLOWS instrument label Apr 28, 2026
@laspsandoval laspsandoval linked an issue Apr 28, 2026 that may be closed by this pull request
Copy link
Copy Markdown
Contributor

@maxinelasp maxinelasp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome! Thanks Laura!

# Conflicts:
#	imap_processing/tests/glows/conftest.py
@laspsandoval laspsandoval force-pushed the glows_imap_start_time branch from 5beeda0 to 1b25dd4 Compare April 29, 2026 20:31
@laspsandoval laspsandoval merged commit de57e30 into IMAP-Science-Operations-Center:dev Apr 30, 2026
14 checks passed
@github-project-automation github-project-automation Bot moved this to Done in IMAP Apr 30, 2026
@laspsandoval laspsandoval deleted the glows_imap_start_time branch April 30, 2026 22:05
maxinelasp pushed a commit to maxinelasp/imap_processing that referenced this pull request May 1, 2026
lacoak21 pushed a commit to lacoak21/imap_processing that referenced this pull request May 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Ins: GLOWS Related to the GLOWS instrument

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

BUG - GLOWS L1a: imap_start_time = 0 for some CDFs

2 participants