Skip to content

[CHORE] - NRIS etl logging#3902

Merged
matbusby-fw merged 1 commit into
developfrom
chore-nris-etl-logging
May 8, 2026
Merged

[CHORE] - NRIS etl logging#3902
matbusby-fw merged 1 commit into
developfrom
chore-nris-etl-logging

Conversation

@matbusby-fw
Copy link
Copy Markdown
Collaborator

Track memory usage, improve logging, and enhance error handling in etl_nris_data

Adding some extra detailed logging to the system to get a better scope of dropped records.
Also introduced a try/catch to individual record commits in case it's erroring out invisibly somewhere.

@matbusby-fw matbusby-fw merged commit 8e76743 into develop May 8, 2026
7 checks passed
@matbusby-fw matbusby-fw deleted the chore-nris-etl-logging branch May 8, 2026 23:24
matbusby-fw pushed a commit that referenced this pull request May 12, 2026
Cherry-picks #3902, #3903, and #3904 from develop — NRIS ETL memory
tracking/logging improvements, setuptools pin, and PIP_CONSTRAINT in
Dockerfiles — which were dropped when the now-search branch was rebased.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants