v0.3.7
New Features
- Performance Metrics Logging: Added logging for prefill and decode throughput metrics to help monitor model's performance
- Quiet Mode: Added
--quietflag for clean output redirection, ideal for scripting and automation workflows
Bug Fixes
- Fixed incorrect global view processing when crop_mode is disabled - now properly uses image_size parameter
Usage Tips
The crop_mode parameter allows you to balance between accuracy and speed:
- Enable crop_mode for better accuracy (default behavior)
- Disable crop_mode for faster processing