Skip to content

update_obsdb: remove auto-update of bad_books_list#1369

Merged
mhasself merged 5 commits intomasterfrom
mhasself/track-bad-books
Mar 6, 2026
Merged

update_obsdb: remove auto-update of bad_books_list#1369
mhasself merged 5 commits intomasterfrom
mhasself/track-bad-books

Conversation

@mhasself
Copy link
Copy Markdown
Member

@mhasself mhasself commented Sep 9, 2025

This reflects how we want to run, in practice, which is to fail until the bad_books file has been manually updated.

Also adds --limit option, and speeds up directory scanning by using glob instead of walk.

@mhasself mhasself requested a review from AERAdler September 9, 2025 18:40
Copy link
Copy Markdown
Contributor

@AERAdler AERAdler left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there a prefect alert that tells us when update_obsdb has failed?

@mhasself mhasself force-pushed the mhasself/track-bad-books branch from 3a8a3ad to f2b7681 Compare September 11, 2025 02:34
@mhasself mhasself marked this pull request as ready for review September 11, 2025 14:00
@mhasself
Copy link
Copy Markdown
Member Author

Is there a prefect alert that tells us when update_obsdb has failed?

Yup.

@mhasself
Copy link
Copy Markdown
Member Author

I notice now that my switch from os.walk to glob.glob breaks the system, unless fastwalk is used.

Let me find a better solution to that ... converting back to draft for now.

@mhasself mhasself marked this pull request as draft September 19, 2025 19:04
mhasself added 4 commits March 5, 2026 11:41
This reflects how we want to run, in practice, which is to fail until
the bad_books file has been manually updated.

Also adds --limit option, and speeds up directory scanning by using
glob instead of walk.
This especially makes standard processing results a little less
verbose when all is going well.
@mhasself mhasself force-pushed the mhasself/track-bad-books branch from f2b7681 to 0720f4c Compare March 5, 2026 15:21
@mhasself mhasself marked this pull request as ready for review March 5, 2026 15:22
@mhasself mhasself requested a review from AERAdler March 5, 2026 15:22
@mhasself
Copy link
Copy Markdown
Member Author

mhasself commented Mar 5, 2026

@AERAdler -- I tweaked a few more things in here to make it a little easier to test, in the AdvLAT era. Logging is less verbose, in way that should help when trying to find failures in the logs.

@mhasself mhasself merged commit 9ccc5d8 into master Mar 6, 2026
5 checks passed
@mhasself mhasself deleted the mhasself/track-bad-books branch March 6, 2026 14:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants