Skip to content

Releases: nash-software/cache-assembler

Release list

v0.2.0

v0.2.0 Latest
Latest

Choose a tag to compare

View all tags
@93michaelnash 93michaelnash released this 11 Aug 15:46
v0.2.0
a5fd361
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Highlights since v0.1.0

Security & correctness

  • Fixed a ReDoS bypass in the regex-safety guard
  • Fixed an info-disclosure bug: /stats was leaking raw request content over the network (redacted now; library callers via TelemetryStore.stats() still get full data)
  • Fixed a write-barrier concurrency bug
  • Fixed upstream-path handling
  • Fixed a deferral regex lastIndex bug that caused silent partial extraction

Features

  • Divergence tracking (previously dead code) is now working
  • New --upstream-timeout CLI flag

Breaking change

  • assemble() dropped its third parameter

Packaging

  • Fixed a bug where the published package shipped no .d.ts files despite package.json declaring types - TypeScript consumers now get real type information
  • Added test/e2e/package/ - verifies the actual packed npm artifact (library import + type-check, CLI via npx, standalone proxy) rather than just source

Docs

  • Added a "Using with Claude Code" section (ANTHROPIC_BASE_URL), with an explicit note that Claude Desktop is not supported
  • Clarified that the validation report's production numbers came from real Claude Code subscription traffic routed through the proxy, not metered API billing
  • Added TL;DR sections to the README and validation report

See the validation report for the full methodology and numbers.

Assets 2
Loading

v0.1.0 — initial public release

v0.1.0 — initial public release

Choose a tag to compare

View all tags
@93michaelnash 93michaelnash released this 19 Jul 18:26
v0.1.0
eeb6cc6
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

cache-assembler rewrites Anthropic Messages API requests to maximize prompt-cache reuse — a small, dependency-free library and standalone HTTP proxy. MIT licensed.

Headline result: an identical 100-turn conversation sent to the real Anthropic API twice — once directly, once through the proxy — cost $1.33 direct vs $0.16 proxied (Claude Haiku 4.5, real API, zero errors in either arm). An 8.2x cost reduction, evidenced with raw data and a reproduction script anyone can run against their own Claude subscription.

Full validation report, mechanism study, and known limitations: docs/validation-report.md

Features (each individually toggleable)

  • F1 Canonicalization — deterministic key ordering for tool definitions
  • F2 Breakpoint placement — places up to 4 cache_control breakpoints at the highest-value boundaries
  • F3 Volatile-byte deferral (opt-in, off by default) — relocates session-unique spans out of the stable prefix
  • F4 Write barrier — coordinates concurrent requests so only one pays the cache-write cost
  • F5 Telemetry — tracks cache reads/writes/tokens and estimates dollars saved

Install

npm i cache-assembler
# or run as a standalone proxy:
npx cache-assembler --upstream https://api.anthropic.com

See README for the three ways to use it (library, proxy-manager chain hop, standalone binary).

Loading