-
-
Notifications
You must be signed in to change notification settings - Fork 0
Troubleshooting
Check the configured TOKEN_TERMINATOR_DB_PATH, parent-directory permissions, local filesystem availability, and whether another process is holding/migrating the database abnormally.
Token Terminator should fail open while storage is unavailable.
That can be correct. Check:
- active mode;
- tool name is eligible;
- result exceeds the relevant minimum size;
- backend is allowed;
- exact vault write/read-back succeeded;
- candidate including the recovery note is actually smaller;
- exact tokenizer did not show token expansion.
A non-reduction is preferable to a misleading or larger reduction.
Check:
- mode is
balancedoraggressive; - temporal delta is enabled;
- result size exceeds
TOKEN_TERMINATOR_TEMPORAL_MIN_CHARS; - the same temporal identity has a previous baseline;
- the second diff/no-change receipt is actually smaller than the raw current result.
The first observation usually creates the baseline.
That is expected when RTK rewrite decisions depend on repository/workspace context. v0.5.1 includes canonical working directory in rewrite-cache identity.
v0.5.1 uses Python casefold() through SQLite for Unicode-correct case-insensitive substring matching. Confirm you are actually running v0.5.1 and not an older installed package.
Check:
TOKEN_TERMINATOR_CONTEXT_COLLAPSE_AFTER_TURNS
TOKEN_TERMINATOR_CONTEXT_INLINE_RECENT_TURNS
The collapse setting must be 0 or at least the inline-recent value. The default is 6 and 5.
Remember: compaction changes the provider-bound copy, not the persisted host transcript.
Inspect status/usage telemetry and watermarks. v0.5.1 prunes only eligible unprotected evidence. If protected evidence consumes the available budget, new vault writes may still fail open rather than break recovery guarantees.
Set TOKEN_TERMINATOR_RTK_PATH to the exact trusted executable and verify the parent directory is not writable by untrusted users.
Do not compare a mode to itself. Use fresh stable sessions with the same model/settings. Inspect paired/unpaired counts and bootstrap intervals rather than relying on a single mean.
Token Terminator v0.6.0 · Repository · Releases · crates.io · MIT
Documentation is source-controlled from the repository wiki/ directory.
Token Terminator
Core mechanics
- Vault & Exact Recovery
- Temporal Delta Compression
- Request Compiler & Context Compaction
- Async & Adapter Integration
Operations
Development