Skip to content

dsh-cot-profile v0.2.0

Latest

Choose a tag to compare

@Chloride233 Chloride233 released this 16 Aug 06:21
· 21 commits to main since this release

v0.2.0 — verified judgment, working records, controlled probes

Judgment (verified against real data)

  • Transition-band detection — low confidence or we/letMe mixing reports ambiguous instead of a possibly-wrong hard label
  • Strong-signal override — runaway indicators (e.g. letMe100 ≈ 1700 from a tool-heavy session) now judge as confident react/spec instead of being swallowed into "uncertain" (found by real probe data, golden regression passes)
  • Judgment threshold lowered to 3 blocks (golden data: single-block direction is reliable; confidence + transition guard cover short tasks)

Record mode (actually works now)

  • Records were written only at session disposal — but DSH sessions rarely dispose, so nothing ever landed. Now writes a per-turn cumulative snapshot (turn/final fields) plus a final record at disposal. Verified on live sessions.

Calibration

  • Settings panel: per-group judgment distribution, nearest-baseline diff, one-click apply as profile family
  • baselineDiff strong directional override (aggregation no longer mis-matches to gray-like on runaway indicators)
  • Panel Live / Records tabs

Controlled probes & experiments

  • scripts/probe-verify.mjs — replay session logs under an expected trajectory side, fail on direction errors
  • Probe workspace system (isolated a/b workspaces, git hard-reset, two-bug task)
  • Experiment archive: probe-1 (feasibility) and probe-2 (n=3 assembly contrast: standard→react, minimal→spec, confirmed post-fix)
  • Methodology note: session-header agentPreset is unreliable; actual assembly = agent-preset/selected event + tool-call surface

UI

  • Two-layer panel: community classification label up front (minimal-like / standard-like / ambiguous), professional details (fault-line axis, indicators, baseline distances) behind a fold
  • i18n fix: correct DSH locale id zh

Honest limits (unchanged)

  • Wording is a fault-line fingerprint, not model identity; built-in baselines are estimates — calibrate with record data
  • Web settings needs the temporary apiproxy patch on DSH 0.1.0-rc.6; track panel mode is experimental