Skip to content

freshdocs 0.6.0 — automatic model identity

Latest

Choose a tag to compare

@Supersynergy Supersynergy released this 04 Sep 13:57
· 10 commits to main since this release

Freshdocs now identifies the active model once and automatically applies its measured per-library knowledge profile. Agents no longer repeat --model, and fresh installations no longer import benchmark data manually.

Automatic, without guessing

Identity is resolved from the strongest exact evidence available:

  1. explicit override (still available for debugging),
  2. hook or MCP metadata (model, model_id, modelId),
  3. provider model environment,
  4. a positively identified parent agent's model argv/configuration.

MCP clients may expose params._meta.model or negotiate capabilities.experimental.freshdocs.model. Older clients can identify on one tool call; the server retains the id for the connection. freshdocs_identity reports the selected id, profile, cutoff, and mode.

There is intentionally no model-name guess from a client brand. MCP does not standardize active LLM identity, and a client called “Claude” may use another model through a gateway. Missing, malformed, unknown, or contradictory evidence selects full documentation. A conflicting later MCP identity permanently locks that connection into safe/full mode.

Profiles now work on a clean install

The registry-verified benchmark evidence is packaged in the wheel and merged per model on upgrade. Local probes override only the exact same model id. No freshdocs models --import setup step is required.

freshdocs gap --project .
freshdocs context "the task" --project . --sync-stale

Both commands use the detected model automatically. freshdocs models --record '<answer JSON>' does too.

GPT-5.6-sol measured

The same blind 20-library recall probe used for the prior model was answered before registry lookup:

  • 20/20 verified versions
  • 0 hallucinations
  • measured median cutoff: 2025-08-16
  • 20 per-library dates, from ratatui 2024-10-21 to tauri 2025-09-01

Against claude-fable-5-1 in its main-session probe (2025-06-11), GPT-5.6-sol's median is 66 days newer. It was newer on 16 libraries, equal on four, and older on none. This does not establish general model superiority; it specifically refutes the claim of a two-year coding-library knowledge deficit on this panel.

Retrieval safety

  • Exact dependency versions remain authoritative.
  • ahead, behind, and unknown libraries receive full prose.
  • covered libraries receive one source pointer without redundant prose.
  • Gap libraries retain guaranteed slots and appear before covered libraries.
  • Model profile matching now requires an exact or descendant id; arbitrary substring matches cannot suppress docs.

Validation

  • 115 local tests pass.
  • Clean Python 3.11 wheel install automatically loaded the GPT profile without import.
  • MCP handshake, one-time identity reuse, conflict locking, hook metadata, environment detection, and unknown-model fallback were exercised end-to-end.
  • GitHub CI passes on Ubuntu and macOS with Python 3.11–3.13.