What's New
Stability Analysis
- New
runwise stability command for analyzing training stability using rolling standard deviation
- Configurable window size (
-w/--window, default: 100 steps)
- CSV output option (
--csv) for further analysis
- Support for local JSONL files (
runwise local <file> --stability)
Improved Error Messages
- Missing history data: Clear explanation when
wandb-history.jsonl is missing, with guidance on wandb.finish() and wandb sync
- W&B API auth: Detects authentication errors and guides users to run
wandb login
- Project not found: Helpful troubleshooting for 404 errors
Documentation
- Added W&B Best Practices section to README (context managers, proper cleanup)
- Updated examples with stability command output
- Added error message examples to expected_outputs.md
Installation
pip install --upgrade runwise
Usage
# Analyze training stability
runwise stability -k loss,val_loss
# Custom window size
runwise stability -k loss -w 50
# CSV output for analysis
runwise stability -k loss --csv
# Local JSONL files
runwise local metrics.jsonl --stability -k loss
