Skip to content

v3.5.0 — Experiment Archaeology

Choose a tag to compare

@ThePyProgrammer ThePyProgrammer released this 01 Apr 07:44
· 183 commits to main since this release

What's new in v3.5.0

Manage a research project that spans months, not just sessions.

Phase 24 is the largest release yet — seven commands that transform Turing from a single-session tool into a long-term research companion. It adds strategic trend analysis for 100+ experiment projects, instant context restoration after time away, disk space management, human annotations, natural language search, reusable templates, and experiment replay to test if old ideas work better now.

/turing:trend — Long-Term Trend Analysis

Strategic view over your full experiment history: improvement velocity per time window, family ROI ranking (which experiment families are productive vs exhausted), diminishing returns detection via log-curve fitting, and phase transition detection. The "state of the research" report that's invisible in individual experiment logs.

/turing:flashback — Session Context Restoration

Come back after a week and start working in 10 seconds. Shows current best, last session's experiments with outcomes, pending hypotheses, annotations, budget status, and suggested next action. Eliminates the 30-minute log-reading ritual.

/turing:archive — Experiment Lifecycle Cleanup

After 200+ experiments, reclaim gigabytes by compressing old artifacts while preserving a queryable summary index. Protects Pareto-optimal, best, and recent experiments. Supports --dry-run to preview before committing.

/turing:annotate — Retrospective Annotations

Add human notes to any experiment: "This only worked because the data was pre-sorted." Tags for categorization, search by content or tag. The knowledge that automated metrics can't capture.

/turing:search — Natural Language Experiment Search

Query 200+ experiments with natural language plus structured filters: "LightGBM high accuracy" --filter "accuracy>0.85". Combines keyword ranking with metric/status/family/date filters.

/turing:template — Experiment Template Library

Save winning configs as reusable templates that persist across projects at ~/.turing/templates/. Strip project-specific paths automatically. Apply to new projects with one command.

/turing:replay — Experiment Replay

Re-run a historical experiment with current infrastructure. Different from /turing:reproduce (which verifies the same result) — replay tests whether an old approach does better now because data, preprocessing, or libraries have improved.

Numbers

Metric v3.4.0 v3.5.0 Delta
Tests 1494 1547 +53
Commands 53 60 +7
Scripts 72 79 +7
Commits — 26 —

Full changelog

  • feat: 7 new scripts: trend_analysis, session_flashback, experiment_archive, experiment_annotations, experiment_search, experiment_templates, experiment_replay
  • feat: 7 new command skills: /turing:trend, /turing:flashback, /turing:archive, /turing:annotate, /turing:search, /turing:template, /turing:replay
  • test: 53 new tests across 7 test files
  • docs: ROADMAP Phase 24 (items 63-69) marked DONE, README updated

One phase remaining: Phase 25 (Research Communication, v4.0.0).