Skip to content

v0.0.3 L1 Head+Tail Elision, Loop-Stall Breaker, KV-Cache Pooling, MkDocs & PyPI (tether-sdk)

Choose a tag to compare

@igormcsouza igormcsouza released this 17 Oct 12:17
· 25 commits to main since this release

Tether v0.0.3

馃殌 Architectural & Performance Upgrades

  • Head + Tail L1 Active Observation Elision (tether/context.py): Oversized active observations (> 2,400 chars) are deterministically elided in L1 working memory to their first 900 chars (headers/command summary) + last 900 chars (stack trace/exit code) with a pointer to mem recall / mem search, preserving full outputs in SQLite FTS5.
  • Deterministic Loop-Stall Breaker (tether/harness.py): Consecutive identical (cmd, stdin) calls from small 8B/9B models are intercepted before tool execution and answered with a deterministic [LOOP DETECTED] recovery nudge.
  • 100% KV-Cache Prefix Immutability Across Pins (tether/context.py, tether/providers/anthropic.py): [PINNED MEMORY] is attached to the tail message after window trimming so earlier turn messages remain 100% byte-identical when pins change; added Anthropic ephemeral cache_control breakpoints.
  • Persistent Connection Pooling & Thread-Local SQLite WAL (tether/providers/*, tether/store.py): Reuses persistent httpx.AsyncClient instances across turns and caches thread-local SQLite WAL connections with PRAGMA temp_store=MEMORY; and 128 MB mmap_size.

馃摝 Packaging, Documentation & CI

  • Published on PyPI (tether-sdk): Install via pip install tether-sdk, uv add tether-sdk, or uv tool install tether-sdk (https://pypi.org/project/tether-sdk/).
  • Flattened Package Layout: Moved tether/ to the repository root (removed src/).
  • MkDocs Documentation Site: Full tutorials, architecture & literature review, and auto-generated API reference live at https://igormcsouza.github.io/tether/.
  • Per-Module Test Suite & 100% Coverage CI Gate: Split unit tests into 20 per-module test files under tests/ and enforced ruff, mypy, mkdocs build --strict, and pytest --cov=tether --cov-fail-under=100 in CI.