Nightly build quality of life improvements

[jdangerx]

• adding logs to each function to know that we executed them
• add build-ref to uploaded file name so file downloads are disambiguated
• send a 'skipped' message to Slack when build was skipped

Overview

Doesn't close any issues - but these are some tiny quality of life improvements that make debugging nightly builds easier:

• pudl-etl.log now has a prefix to indicate date, hash, and short-ref! no more of this:

  $ ls ~/Downloads/pudl-etl*
  pudl-etl.log
  pudl-etl (1).log
  ...
  pudl-etl (1000).log

• 'skipped' message in slack when we skip a build
• slightly more logs

What did you change?

Testing

How did you make sure this worked? How can a reviewer verify this?

I added an early return 1 to all the time-consuming functions & also echo "some message" > $LOGFILE. Then I ran the build via workflow, saw the various messages in the logfile, and saw that the logfile was uploaded with a nice, unambiguous name.

I couldn't verify that the skip logic is working, I think we're good to wait on that until we see a skip occur in the wild.

To-do list

Edit tasklist title

Beta Give feedback Tasklist To-do list, more options

• Rename
• Copy markdown
• Delete tasklist

Delete tasklist

Delete tasklist block?

Are you sure? All relationships in this tasklist will be removed.

Cancel Delete

1. Review the PR yourself and call out any questions or issues you have

   Review the PR yourself and call out any questions or issues you have
   Options

   • Convert to issue
   • Toggle completion
   • Rename
   • Remove
2. Short-circuit all functions, run a build process, and see that LOGFILE stuff works

   Short-circuit all functions, run a build process, and see that LOGFILE stuff works
   Options

   • Convert to issue
   • Toggle completion
   • Rename
   • Remove

Add item to To-do list

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (dc6e16c) 92.7% compared to head (5c6ea43) 92.7%.
Report is 2 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##            main   #3287     +/-   ##
=======================================
- Coverage   92.7%   92.7%   -0.0%     
=======================================
  Files        145     145             
  Lines      13100   13100             
=======================================
- Hits       12144   12142      -2     
- Misses       956     958      +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.