v0.4.0: Step-matched Comparison & Usability

Highlights

Step-matched comparison - Essential for curriculum learning where comparing final metrics is misleading:

runwise compare run1@50000 run2@50000      # Compare at same training step
runwise compare run1@10000 run2@20000      # Compare at different steps

Custom keys for summaries - Show only the metrics you care about:

runwise latest -k loss,val_loss,accuracy
runwise run abc123 -k train/loss,val/loss

Comparison filtering - Handle 100+ metric comparisons:

runwise compare A B -t 5        # Only show >5% changes
runwise compare A B -g          # Group by prefix (train/, val/)
runwise compare A B -f val      # Filter to validation metrics

New Features

CLI

• Step-matched comparison with @step syntax
• Custom keys for summaries (-k/--keys)
• Comparison filtering (-g, -t, -f)
• Dynamic column widths (no more truncated metric names)
• Step mismatch warnings

W&B API

• --history -k: Get metric trajectories from cloud
• --best metric --max: Find best run by any metric
• Project auto-detection from wandb/ directory
• Comparison filtering for API comparisons

MCP Server

• New health_check tool: Quick "how's training going?" check
• Fixed JSON-RPC response format
• Improved tool descriptions (list_keys first pattern)
• Step-matched comparison support

Installation

pip install runwise --upgrade

Full Changelog

See CHANGELOG.md