Peridot - Changelog

Engineered by uncoalesced

Name: Peridot v1.5.3 STABLE - Zero-Overhead Active Telemetry and Speculative Context Streaming

High-Frequency Telemetry Daemon: Shipped a multi-threaded sensory loop running at 10Hz to continuously calculate real-time user interaction probability P(I_t).
Asynchronous Keystroke Monitor: Integrated an isolated pynput global hook using a sliding-window array (max capacity 10) to map typing interval acceleration f(C).
Non-Blocking Acoustic Envelope Tracker: Leveraged a sounddevice InputStream capturing raw acoustic buffers to track root-mean-square (RMS) ambient density g(A).
State Decay-Acceleration Model: Engineered the dynamic temporal decay equation: P(I_t) = min(1.0, P(I_{t-1}) * e^(-lambda * dt) + w_key * f(C) + w_aud * g(A)), triggering speculative preemption at the critical theta threshold of 0.65.

CUDA MPS Dynamic Slicing: Implemented an active hardware governor that programmatically throttles background volunteer compute (Folding@Home) to 10% SM occupancy when P(I_t) reaches threshold, and suspends it to 0% SM during inference.
Platform-Agnostic Process Spawning: Implemented fallback mocking on Windows NT environments, while securely managing Linux pipeline subprocess allocation via shell=False and CREATE_NO_WINDOW suppression.
UVM Memory Weight Pre-mapping: Exported GGML_CUDA_ENABLE_UNIFIED_MEMORY=1 during speculative states to pre-map active LLM weights into the physical GPU page tables during typing, eliminating model load spikes.

Asynchronous Context Prefetcher: Built a thread-wrapped loopback REST engine targeting local llama-server slots to pre-load pre-computed KV cache contexts via requests.post to /slots/0/restore.
Loopback IO Block Exemption: Wrapped REST handshakes in robust ConnectionError and Timeout handlers, ensuring loopback socket failures never freeze the high-frequency sensory loop.
Prefill-Phase Bypass: Patched the main server /ask Flask routing to detect KernelState.SPECULATIVE_PREPARED. Bypasses the VRAM purge latency path entirely and triggers immediate generation from the staged KV cache, dropping Time-to-First-Token (TTFT) to token generation limits.

Telemetry Modularization: Segmented core_system/telemetry.py into a fully typed core_system/telemetry/ package containing config, orchestration, and client subdirectories.
Stability Ledger Preservation: Ported the legacy StabilityLedger class into the new package constructor (init.py), preserving the global namespace for external module imports.

What's Changed

chore(deps): bump the pip group across 1 directory with 3 updates by @dependabot[bot] in #5
chore(deps): bump torch from 2.8.0 to 2.12.0 in the pip group across 1 directory by @dependabot[bot] in #6
chore(deps): bump idna from 3.15 to 3.18 by @dependabot[bot] in #7
chore(deps): bump msgpack from 1.1.2 to 1.2.0 by @dependabot[bot] in #8
chore(deps): bump flask-cors from 6.0.2 to 6.0.5 by @dependabot[bot] in #9
chore(deps): bump pyspellchecker from 0.8.1 to 0.9.0 by @dependabot[bot] in #10
chore(deps): bump safetensors from 0.7.0 to 0.8.0 by @dependabot[bot] in #15
chore(deps): bump msgpack from 1.2.0 to 1.2.1 in the pip group across 1 directory by @dependabot[bot] in #16
chore(deps): bump click from 8.4.0 to 8.4.2 by @dependabot[bot] in #18
chore(deps): bump faiss-cpu from 1.8.0 to 1.14.3 by @dependabot[bot] in #17
chore(deps): bump fsspec from 2026.4.0 to 2026.6.0 by @dependabot[bot] in #14
chore(deps): bump pip-audit from 2.10.0 to 2.10.1 by @dependabot[bot] in #12
chore(deps): bump torchaudio from 2.6.0 to 2.11.0 by @dependabot[bot] in #11

Full Changelog: v1.5.2...v1.5.3

chore(deps): bump the pip group across 1 directory with 3 updates by @dependabot[bot] in #5
chore(deps): bump torch from 2.8.0 to 2.12.0 in the pip group across 1 directory by @dependabot[bot] in #6
chore(deps): bump idna from 3.15 to 3.18 by @dependabot[bot] in #7
chore(deps): bump msgpack from 1.1.2 to 1.2.0 by @dependabot[bot] in #8
chore(deps): bump flask-cors from 6.0.2 to 6.0.5 by @dependabot[bot] in #9
chore(deps): bump pyspellchecker from 0.8.1 to 0.9.0 by @dependabot[bot] in #10
chore(deps): bump safetensors from 0.7.0 to 0.8.0 by @dependabot[bot] in #15
chore(deps): bump msgpack from 1.2.0 to 1.2.1 in the pip group across 1 directory by @dependabot[bot] in #16
chore(deps): bump click from 8.4.0 to 8.4.2 by @dependabot[bot] in #18
chore(deps): bump faiss-cpu from 1.8.0 to 1.14.3 by @dependabot[bot] in #17
chore(deps): bump fsspec from 2026.4.0 to 2026.6.0 by @dependabot[bot] in #14
chore(deps): bump pip-audit from 2.10.0 to 2.10.1 by @dependabot[bot] in #12
chore(deps): bump torchaudio from 2.6.0 to 2.11.0 by @dependabot[bot] in #11

Full Changelog: v1.5.2...v1.5.3