HERA
HERA is a MATLAB based scientific ranking framework for paired benchmarking. It provides a hierarchical-compensatory logic that integrates effect-size statistics, and automated reporting capabilities.
For more information please refer to the Readme and Project Documentation.
Note
HERA is currently under review. The associated preprint is available at SSRN: doi:10.2139/ssrn.7227474.
What's New in v1.4.5?
Note: This release encompasses preparations and refinements for the submission of the associated HERA manuscript (available as SSRN Pre-Print DOI: https://doi.org/10.2139/ssrn.7227474).
⚙️ Enhancements
- Bootstrap Defaults: Updated the default bootstrap iteration
B_endparameter. - CSV Export Formatting: Standardized all CSV data exports to use comma delimiters instead of semicolons for better compatibility.
- Toolbox Package: Excluded the deploy folder from the toolbox package and included additional example data.
🐛 Bug Fixes
- Example Dataset: Fixed a local alignment bug and updated the underlying raw data. The previous version inadvertently relied on an outdated JSON dataset from the original source that contained a known evaluation bug, which caused a score discrepancy. The example now uses the fully corrected data, aligning the HERA evaluation with the official corrected scores.
- Enhanced Reporting Logic: This update enhances and fixes the detailed pairwise log output table. These refinements include new descriptive messages for cycle detection, refined categorization for tie-breaks, and ensure that previously omitted neutral Metric 3 comparisons are now fully reported.
🖥️ Platform Support
- MATLAB Toolbox & Python Package: Windows, macOS (Intel & Apple Silicon), Linux
- Standalone Runtime Application: macOS (Apple Silicon ONLY)
📦 Compatibility
- MATLAB: Compatible with R2020a and newer.
- Python: Compatible with Python 3.9 through 3.12 and Matlab Runtime R2025b (25.2).
Full Changelog: v1.4.4...v1.4.5