Repository navigation
📢 Major Changes
🚩 New Metrics
• Add qrealign, a Qwen3.5-VL based quality assessment metric for alignment-aware evaluation. f9e32c5
• Add MetaIQA architecture and default metric configuration, including score range and metric options for evaluation and benchmarking. 2fc5468 532b86c
• Add FGResQ metric integration to the toolbox. 7b58170
🛠️ Enhancements
• Improve compatibility of qalign with the latest transformers releases. f312393
• Improve compatibility of compare2score with the latest transformers releases. 8c9c65b
• Introduce a centralized clip_imports module and streamline CLIP-related loading paths for more robust dependency handling. dc89f8d 845a8fc
• Improve InferenceModel robustness with better input validation, stronger error handling, and safer cuDNN context management. 2940b10 e7171ec b0459af
• Improve lazy loading for datasets and models to reduce unnecessary imports and simplify plugin-style extensions. 207b51a
🐛 Bug Fixes
• Fix MetaIQA model loading logic to better distinguish training and inference environments. 258d097
• Fix benchmark options for MetaIQA calibration and evaluation workflows. b1be474
• Refine calibration summary formatting and improve warning handling in model loading and test execution. 18dd7a1
📚 Documentation
• Refresh the README with a new logo, improved layout, clearer Markdown structure, and direct pip installation instructions. 3226840 7cdd345 69527ac 41f7012
• Expand contribution instructions for adding new IQA models and add an experimental plugin authoring section. c12f282 207b51a
• Update project documentation and changelog entries for the newly integrated metrics. 5066499 7c63558
📦 Packaging & Code Cleanup
• Update project licensing metadata to the PolyForm Noncommercial License 1.0.0. e5c3e4f ccac804
• Remove deprecated FileClient usage and clean redundant MetaIQA module files. 64891c1 436e53a 203ead8
👥 Contributors
Thank you to the contributors who made this release possible:
• 🌟 Add FGResQ metric integration by @pxf0429
• 🌟 Add MetaIQA architecture and related refactors by @cicixuxy
• 🌟 Add qrealign metric by @Frank-Y-Zheng
📝 For complete details, see the Full Changelog