Skip to content

dsh-cot-profile v0.1.0

Choose a tag to compare

View all tags
@Chloride233 Chloride233 released this 16 Aug 03:23
· 36 commits to main since this release
v0.1.0
7e525c9

Real-time chain-of-thought trajectory profiling for DeepSeek Harness

v0.1.0 — first release candidate. Monitors the reasoning stream live, tallies signature wording indicators (let me / we / let's / I, first-line patterns, block length, interim replies), and judges the session's trajectory side (spec-like / react-like / gray-like) against built-in baselines — with an explicit transition-band state instead of forcing a possibly-wrong label.

Features

  • Live UI: session-header badge + floating panel (default) or experimental layout-track right column, driven by session-projection push frames — no polling, no custom RPC
  • Judgment: weighted-distance match + confidence; transition-band detection (low confidence or We/The/Let mixing, per router-standard's measured fault line)
  • Settings UI: thresholds, weights, profile families, panel mode, record mode, and one-click semi-automatic calibration
  • Record mode: per-session aggregate JSON records (event + optional JSONL) — aggregates only, never raw reasoning text
  • Bilingual UI: zh-CN + en, follows the DSH locale
  • Persistence for free: stats survive restarts via the projection cache subsystem

Verification (four layers)

  • 34 unit tests (zero-dependency)
  • Golden verification against 119 real V4 Pro / V4 Flash probe runs: spec-side 83/83 (100%), zero direction errors, react-side never misjudged spec-side, ambiguous → transition band ≥55%
  • End-to-end replay verification against real session logs: all blocks, counts, first-line patterns, and block-length medians match an independent ground truth exactly
  • Record-mode calibration for long-term baseline measurement

Honest limits

  • Wording is a fault-line fingerprint, not model identity — the plugin reports trajectory side, never "this is model X"
  • Built-in baselines are estimates; calibrate with record-mode data
  • Web settings section needs the optional temporary apiproxy patch on DSH 0.1.0-rc.6 (see README)
  • track panel mode is experimental (direct DOM grid manipulation)

Install

dsh plugin --profile web add github:Chloride233/dsh-cot-profile
Assets 2
Loading