Skip to content

AION Plugin v0.4.0

Choose a tag to compare

View all tags
@ztxtech ztxtech released this 14 Jun 04:08
v0.4.0
78de9e2

AION Plugin v0.4.0

Mandatory Statistical Analysis

All statistical analysis is now mandatory, not optional:

  • Multi-seed (≥3 seeds) with variance reporting — no single-seed conclusions accepted
  • Significance tests (paired t-test or Wilcoxon signed-rank) with p-value and effect size
  • Confidence intervals (bootstrap, ≥1000 resamples) for the main metric
  • SHAP / feature attribution, residual diagnosis, failure cases, AND statistical tests — all required, not substitutable

Multi-Hypothesis Statistical Comparison

When ≥2 method routes survive to evaluation, they MUST be compared as a battery:

  • Same eval split, same seeds
  • Pairwise significance tests with multiple-comparison correction (Holm-Bonferroni or Benjamini-Hochberg)
  • Aggregated result table with mean ± CI per method

Pareto-Optimal Delivery

When methods are non-dominated (e.g., accuracy vs. latency vs. cost), ALL non-dominated methods must be delivered — not just one "recommended". Includes a Pareto front plot and per-method trade-off cards.

Language Selection

Session start now asks a second question about language:

Option Behavior
English English everywhere (default)
Chinese reasoning + English delivery Chinese interaction/reasoning, English code/reports
Chinese delivery Chinese throughout
Bilingual Both Chinese and English delivery

TUI notifications (I AM AION toasts) always stay in English regardless of language mode.

Coder Two-Phase Development

Phase Style Requirements
Phase 1: Rapid Prototyping Quick-and-dirty, speed-first No unit tests, no SHAP, scratch/ OK
Phase 2: Engineering Hardening Production quality Clean rewrite, comments, unit tests, docs, ztxexp boundaries, SHAP, statistical analysis

The main agent or ts-critic triggers the phase transition. The coder does not decide alone.

ts-critic allow-stop checklist (expanded)

5 new mandatory items:
7. Multi-seed (≥3) variance reported
8. Significance test with p-value and effect size
9. Bootstrap CI reported
10. Pairwise significance battery (if ≥2 routes survived)
11. Pareto delivery (if methods are non-dominated)

Install / Upgrade

curl -fsSL https://raw.githubusercontent.com/ztxtech/aion/dev/scripts/install.sh | bash -s -- --force

Then in your project:

aion-ts init . --force
Assets 3
Loading