🌮 Nacho Flow v1.2.0: Zero-Alloc Token Saver (NTS), Agent Registry & Wire-Aligned Stream Supervisors

[dixieflatline76]

🌮 Nacho Flow v1.2.0: Zero-Alloc Token Saver (NTS), Agent Registry & Wire-Aligned Stream Supervisors

Nacho Flow is an open-source, high-performance agent supervisor and model dispatcher written in pure Go. It sits between autonomous coding agents (Cline, Zoo Code, Cursor, OpenCode, Aider, Continue) and LLM providers to monitor token streams in real time, terminate runaway loops, unstuck frozen agents, and dynamically route prompts across local GPU models ($0.00) and cloud reasoning APIs.

---

🚀 What's New in v1.2.0

🗜️ 1. Nacho Token Saver (NTS): In-Flight Context Compaction (30%–60% Context Bloat Eliminated)

• The Problem: As multi-turn agent conversations lengthen, prompts rapidly accumulate thousands of wasted tokens: raw ANSI terminal spinner garbage, repetitive test runner outputs, superseded file reads that were edited ten turns ago, and IDE boilerplate notice search blocks. Resending this dead weight burns hundreds of thousands of billable tokens on frontier APIs ($3.00/M tokens), degrades small model attention accuracy, and inflates cloud invoices.
• The Solution: Nacho Flow introduces the Nacho Token Saver (NTS) in-flight compaction engine (pkg/nts), reducing multi-turn payload volume by 30%–60% with sub-millisecond wire-speed Go latency:
  • 🧹 Terminal Sanitizer (ansi.go, cr.go): In-place purge of raw ANSI escape sequences, colors, and terminal spinner animations (|/-\). In-place carriage return (\r) collapse folds overwritten terminal progress lines with zero heap allocations.
  • 📑 Stale Read Compactor (stale_reads.go): When an agent inspects the same 1,000-line file across 20 turns, older reads become dead weight. NTS detects superseded file-reads and compacts them into structural notices ([Superseded read: 1,200 lines compacted]) while preserving the active turn fresh. Features configurable retention depth, offset/limit range support, and small-file eviction safeguards.
  • 🛡️ Harness Shield (boilerplate.go): Automatically prunes repetitive extension notices (Cline <notice> hints and runaway diff search <error_details> blocks) before they hit the upstream model.
  • 📐 Stream Normalizer (dedup.go, whitespace.go): Collapses runaway blank lines and identical log bursts using alphanumeric protection guards to keep ASCII tables, boxes, and diagrams intact.
  • Dual-Lane Immunity Guard: Prevents tool error responses and supervisor-injected system overrides from ever being pruned or muted.
  • Trace Replay Test Harness: Validated and benchmarked against 8,700+ lines of real agent turn traces (testdata/real_tool_samples.json).

---

⚡ 2. Zero-Allocation Systems Core (pkg/zeroalloc)

• The Problem: High-throughput streaming proxies often suffer from heap fragmentation and garbage collection pauses when running deep inspection on large multi-megabyte payloads.
• The Solution: Created the pkg/zeroalloc engine:
  • Low-level mutable byte slice transformers and stack/pool-allocated streaming buffers (sync.Pool).
  • SIMD-accelerated string and byte scanners.
  • Achieves 0 B/op heap churn across in-flight transformation passes, preserving wire-speed throughput under heavy agent workloads.

---

🤖 3. Dynamic Agent Registry & Multi-Agent Protocol Adaptation (pkg/agentregistry, data/agents/)

• The Problem: Modern coding agents vary wildly in their protocols, control tokens, delimiters, and tool invocation formats (e.g. Hermes <tool_call>, Mistral [TOOL_CALLS], Claude XML <invoke>, ReAct Action:, or bare JSON). Hard-coded router logic struggled to differentiate between agent harnesses.
• The Solution: Nacho Flow now features an extensible Agent Registry:
  • Built-in curated profiles for Zoo Code, Cline, Cursor, Aider, Anthropic, and Standard OpenAI.
  • Capability Flags (HasWriteCapability, ToolFamily): Distinguishes active file-writing turns from passive exploration turns so runtime supervisors (like Kickstart) never trigger false-positive stall overrides during legitimate planning.
  • Unified Tool Format Adapter: Translates between 8 distinct tool-call format families in real time.

---

🌊 4. Stream Normalization & Reasoning Preservation (pkg/server)

• Reasoning Stream Normalization (<think>): Intercepts SSE chunks from DeepSeek-R1, QwQ, Qwen 2.5, and Anthropic, cleanly normalizing thoughts into standard <think>...</think> tags for IDE UI accordions in real time.
• Stream-End Context Healing: Fixed reasoning context drops when upstream streams emit immediate [DONE] events without trailing whitespace.
• Delayed Header Peeking: Peeks initial SSE chunks before committing HTTP 200 headers, enabling transparent failover if an upstream local model crashes or produces an empty stream.
• HotSauce In-Chat Directives: Steer model dispatching on the fly directly from prompt text (@nacho:local, @nacho:cloud, @nacho:reasoning, @nacho:kickstart-off, @nacho:reset).

---

🛡️ 5. 3-Lane Wire-Aligned Cycle Killer & Supervisor Upgrades (pkg/router/shield)

• 3-Lane Wire-Aligned Cycle Killer: Stream loop breaker refactored for parallel byte-aligned inspection with agent registry awareness.
• Fairy Dust Model Upgrades: Upgraded background milestone audit checkpoints to gemini-3.8-flash with cooperative quality review formatting.
• Dual-Lane Supervisor Immunity: Guarantees supervisor system prompts and failover headers bypass sliding-window loop detection.

---

📊 6. VS Code Extension & Flight Instruments Revamp (extension/)

• Live NTS Telemetry Panel: Real-time webview dashboard panel tracking: Total Tokens Saved (1.4M+), Payload Reduced (5.4 MB+), and Compacted Turns.
• Status Bar HUD Revamp: Rich Markdown hover tooltip displaying active profile, server URL, dollar savings, NTS tokens saved, and loop breaker statistics.
• Webview Layout Polish: Right-aligned status chips, responsive flex header, minimalist version badge (v1.2.0), single-row supervisor brackets, and removed ambiguous + prefixes from savings values.
• Rolling 1-Hour Window: Added Past 1 Hour rolling window to telemetry aggregator alongside Today, This Week, and All Time.

---

🏛️ 7. Landing Page Architecture Symmetry & Specifications Ribbon (site/, index.html)

• Two-Tier Symmetrical Containers: Section A (Active Runtime Supervisors) and Section B (Nacho Token Saver) styled with amber and emerald radar indicators.
• Modernized Specifications Ribbon: Concrete empirical metrics: ⚡ < 0.18ms Go Core Latency, 🚀 30,284+ Peak Req / Sec, 🗜️ 30%-60% In-Flight NTS Compactor, 🛠️ 8 Formats Tool Normalizer, ⏱️ < 3s Loop Interception, 📦 Zero Deps Single Go Binary.
• Developer Control Plane 4-Card 2x2 Grid: Balanced layout showcasing Extension runtime, Live Dashboard, Agent Pairing Gateway, and HotSauce Directives.
• 100% CI Smart Tags & Origin Story Preserved: All benchmark replacement tags and authentic developer origin narrative remain intact.

---

🧪 Verification Matrix

Check / Metric	Scope	Result	Status
Go Test Coverage (test-cover)	All 18 Go packages	96.7% statement coverage (all ≥ 95.1%)	✅ Passed
Go Static Analysis (vet)	Full repository	0 warnings, 0 errors (go vet ./...)	✅ Passed
Go Race Detector (test-race)	Full test suite	0 data races (go test -race ./...)	✅ Passed
VS Code Extension Suite	Extension core & webview	14 / 14 suites, 274 / 274 tests passed (100%)	✅ Passed
Security Audit (sec)	Static AST analysis	72 files, 20,000+ lines: 0 issues (gosec)	✅ Passed
Benchmark Stress Test	350k live requests @ 1k workers	30,284 req/s peak, 0 dropped connections	✅ Passed
Documentation Link Audit	All Markdown documents & SPA links	0 broken links, 0 errors	✅ Passed
Windows PE Metadata Audit	cmd/nacho-flow Win32 resources	Publisher: Spicebox, Version: 1.2.0.0	✅ Passed

---

📦 Installation & Quickstart

VS Code Companion Extension (Recommended)

Install directly from the VS Code Marketplace or via CLI:

code --install-extension dixieflatline76.nacho-flow

• Select your desired profile (Profile 1, Profile 2, or Profile 3) directly from the status bar chip (🌮).
• Point your autonomous coding agent (Cline, Zoo Code, Cursor, OpenCode, Aider) to http://127.0.0.1:8000/v1.

Universal Shell Installer (Linux & macOS)

curl -fsSL https://raw.githubusercontent.com/dixieflatline76/nacho-flow/main/scripts/install.sh | bash

Windows (Winget)

winget install dixieflatline76.NachoFlow

Homebrew (macOS)

brew install dixieflatline76/tap/nacho-flow

Standalone Go Daemon (Build from Source)

go build -o nacho-flow ./cmd/nacho-flow
./nacho-flow --config ./extension/resources/profiles/profile1.yaml

---

This discussion was created from the release 🌮 Nacho Flow v1.2.0: Zero-Alloc Token Saver (NTS), Agent Registry & Wire-Aligned Stream Supervisors.