Skip to content

v1.1.0: SOTA Baselines, Training Dynamics, and Scalability Optimizations

Choose a tag to compare

@manwestc manwestc released this 16 Mar 20:03
· 1 commit to main since this release

Overview

This major release incorporates extensive new experiments, baselines, and scalability optimizations, developed in response to rigorous peer-review feedback. The HyNN-PermGrad framework has been substantially expanded to include modern deep tabular baselines and detailed training dynamics analyses.

🚀 New Features & Experiments

  • SOTA Deep Tabular Baselines: Added training and evaluation scripts for modern architectures, specifically FT-Transformer and TabNet, allowing for direct comparison against the HyNN architecture.
  • Training Dynamics & Gradient Tracking: Introduced new logging mechanisms to extract and visualize MSE loss curves and Gradient L2 Norms during training. This allows for the empirical demonstration of the MLP branch acting as a "symbolic anchor" to stabilize gradient flow.
  • Resolution Ablation (TINTOlib): Added scripts to generate and evaluate synthetic images at multiple resolutions (10x10, 20x20, 30x30) to analyze topological balance, pixel collisions, and spatial sparsity.
  • Adaptive Permutation Sampling: Implemented a highly scalable, two-stage permutation sampling strategy for high-dimensional datasets (e.g., GAS). This optimization reduces the computational overhead by >50% while preserving exact feature rankings.
  • Class Imbalance Analysis: Added evaluation modules to assess PermGrad's robustness and spatial attention entropy under severe class imbalance scenarios.

🛠️ Code Improvements & Refactoring

  • Enforced unblurred configurations by default in TINTOlib generation scripts to guarantee exact 1-to-1 feature-pixel mapping for interpretability.
  • Cleaned up the static late-fusion architecture code for better reproducibility and isolation of branch-wise contributions.
  • Updated requirements.txt to include new dependencies required for the SOTA baselines.

📊 Reproducibility

All metrics, weights, and logs associated with the revised manuscript's benchmark (HELOC, Dengue, Covertype, GAS, Puma) can be reproduced using the updated benchmark scripts included in this release.