Repository navigation
v1.1.0: SOTA Baselines, Training Dynamics, and Scalability Optimizations
Overview
This major release incorporates extensive new experiments, baselines, and scalability optimizations, developed in response to rigorous peer-review feedback. The HyNN-PermGrad framework has been substantially expanded to include modern deep tabular baselines and detailed training dynamics analyses.
🚀 New Features & Experiments
- SOTA Deep Tabular Baselines: Added training and evaluation scripts for modern architectures, specifically FT-Transformer and TabNet, allowing for direct comparison against the HyNN architecture.
- Training Dynamics & Gradient Tracking: Introduced new logging mechanisms to extract and visualize MSE loss curves and Gradient L2 Norms during training. This allows for the empirical demonstration of the MLP branch acting as a "symbolic anchor" to stabilize gradient flow.
- Resolution Ablation (TINTOlib): Added scripts to generate and evaluate synthetic images at multiple resolutions (
10x10,20x20,30x30) to analyze topological balance, pixel collisions, and spatial sparsity. - Adaptive Permutation Sampling: Implemented a highly scalable, two-stage permutation sampling strategy for high-dimensional datasets (e.g., GAS). This optimization reduces the computational overhead by >50% while preserving exact feature rankings.
- Class Imbalance Analysis: Added evaluation modules to assess PermGrad's robustness and spatial attention entropy under severe class imbalance scenarios.
🛠️ Code Improvements & Refactoring
- Enforced unblurred configurations by default in TINTOlib generation scripts to guarantee exact 1-to-1 feature-pixel mapping for interpretability.
- Cleaned up the static late-fusion architecture code for better reproducibility and isolation of branch-wise contributions.
- Updated
requirements.txtto include new dependencies required for the SOTA baselines.
📊 Reproducibility
All metrics, weights, and logs associated with the revised manuscript's benchmark (HELOC, Dengue, Covertype, GAS, Puma) can be reproduced using the updated benchmark scripts included in this release.