Skip to content

log files are now uploaded regardless of mu2e exit status

Choose a tag to compare

@oksuzian oksuzian released this 23 Nov 06:04
· 667 commits to main since this release
3e5bdb1

Key Changes

Production Monitor Enhancements

  • Support for .root files: Modified db_builder.py to track both .art and .root files in the database, enabling monitoring of event ntuple datasets
  • Setup script display: Added extraction and display of setup scripts from job definition tarballs in the web interface
  • Famtree improvements: Fixed Mermaid diagram extraction for .root datasets and improved regex matching

Bug Fixes

  • fcldump error handling: Fixed ValueError when processing /dev/null and other non-standard filenames in jobfcl.py
  • Log upload on failure: Ensured log files are uploaded even when jobs fail (from previous commit)
  • Mermaid diagram display: Fixed filename matching logic for famtree-generated diagrams

Performance Improvements

  • mkrecovery optimization: Optimized find_missing_indices() to build filename-to-job mapping once instead of iterating multiple times

Configuration Updates

  • MDC2025: Added event ntuple and mixing configurations; updated digitization and reconstruction configs
  • MDC2020: Updated event ntuple configuration with new datasets
  • Fermigrid: Reduced job lifetime and timeout from 48h/47h to 24h/23h

New Tools

  • jobquery wrapper: Added shell wrapper script for the Python jobquery tool

Files Changed

  • bin/pomsMonitorWeb - Setup script extraction and famtree fixes
  • web/static/monitor.html - Setup script display and Mermaid improvements
  • utils/db_builder.py - Root file support
  • utils/jobfcl.py - /dev/null handling fix
  • utils/mkrecovery.py - Performance optimization
  • data/mdc2025/*.json - New and updated configurations
  • data/mdc2020/evntuple.json - Configuration updates
  • poms/fermigrid.cfg - Timeout adjustments
  • bin/jobquery - New wrapper script