v1.5.6

What's Changed

• Cleanup version info by @oksuzian in #19
• Cleanup version info by @oksuzian in #20
• Cleanup version info by @oksuzian in #21

Full Changelog: v1.5.5...v1.5.6

log files are now uploaded regardless of mu2e exit status

Key Changes

Production Monitor Enhancements

• Support for .root files: Modified db_builder.py to track both .art and .root files in the database, enabling monitoring of event ntuple datasets
• Setup script display: Added extraction and display of setup scripts from job definition tarballs in the web interface
• Famtree improvements: Fixed Mermaid diagram extraction for .root datasets and improved regex matching

Bug Fixes

• fcldump error handling: Fixed ValueError when processing /dev/null and other non-standard filenames in jobfcl.py
• Log upload on failure: Ensured log files are uploaded even when jobs fail (from previous commit)
• Mermaid diagram display: Fixed filename matching logic for famtree-generated diagrams

Performance Improvements

• mkrecovery optimization: Optimized find_missing_indices() to build filename-to-job mapping once instead of iterating multiple times

Configuration Updates

• MDC2025: Added event ntuple and mixing configurations; updated digitization and reconstruction configs
• MDC2020: Updated event ntuple configuration with new datasets
• Fermigrid: Reduced job lifetime and timeout from 48h/47h to 24h/23h

New Tools

• jobquery wrapper: Added shell wrapper script for the Python jobquery tool

Files Changed

• bin/pomsMonitorWeb - Setup script extraction and famtree fixes
• web/static/monitor.html - Setup script display and Mermaid improvements
• utils/db_builder.py - Root file support
• utils/jobfcl.py - /dev/null handling fix
• utils/mkrecovery.py - Performance optimization
• data/mdc2025/*.json - New and updated configurations
• data/mdc2020/evntuple.json - Configuration updates
• poms/fermigrid.cfg - Timeout adjustments
• bin/jobquery - New wrapper script

Simplified sequencer logic

Simplified sequencer logic: Uses the parent run number from input files instead of a hash of the jobname
Code cleanup: Removed nested conditionals and duplicated logic
Removed unused import: Removed hashlib import
Backward compatibility: All job types still work correctly

Bug fix for xroot path

Merge pull request #16 from oksuzian/cleanup-version-info

Fix xroot URL conversion and njobs calculation

Use SQL in pomsMonitor. Add sequencer_from_index option

Use SQL in pomsMonitor. Add sequencer_from_index option

Add web interface for POMS monitoring and job generation

Merge pull request #14 from oksuzian/cleanup-version-info

Add web interface for POMS monitoring

Consolidated runjobdef and runfcl into runmu2e

Merge pull request #13 from oksuzian/cleanup-version-info

Consolidate runjobdef and runfcl into runmu2e

new tools: pomsMapAnalyzer, mkrecovery

Merge pull request #12 from oksuzian/cleanup-version-info

Enhanced SAMWeb Integration & Production Monitoring Tools

v1.4.1: Merge pull request #11 from oksuzian/cleanup-version-info

• SAMWeb location detection: Files now queried individually for actual location (disk/tape/dcache) instead of using single default location
• New utilities: Added POMS map analyzer, dataset monitor (listNewDatasets), and log visualization tools
• Enhanced logging: CSV export capability with job timestamps and plotting support
• Configuration updates: Updated job definitions for MDC2020/MDC2025 campaigns with proper I/O locations
• Code quality: Refactored utilities for better error handling, removed unnecessary fallbacks, cleaner imports

v1.4.0: Merge pull request #10 from oksuzian/cleanup-version-info

• Added genFilterEff.py: Python implementation of mu2eGenFilterEff
• Added bin/genFilterEff: Shell wrapper for genFilterEff tool
• Enhanced famtree.py with --stats and --max-files options to show efficiency statistics
• Updated samweb_wrapper.py to support anylocation in list_definition_files

Enhancements:

• famtree now displays efficiency stats (passed/generated events, efficiency, file count)
• Integrated genFilterEff functionality into famtree for consistent efficiency calculations
• Added support for dataset names in addition to individual filenames
• Updated EXAMPLES.md with comprehensive documentation for new tools

Configuration updates:

• Updated data/mdc2025_nersc.cfg and data/merge_filter.json
• Enhanced famtree examples with statistics options"