Skip to content

v1.0.0 — session cache, effort-controlled thinking, connect reliability

Choose a tag to compare

View all tags
@testAccountDeltas testAccountDeltas released this 10 Oct 00:04
· 47 commits to main since this release
v1.0.0
3524580

Highlights

  • Session-sticky account routing — a conversation stays pinned to one upstream account, so Gemini's server-side prefix cache stays warm instead of going cold every time traffic round-robins to a different account.
  • /effort now actually controls thinking — Claude Code/Desktop send the reasoning effort in output_config.effort, which the Gemini gateway path was ignoring. The proxy now reads it and maps it to a thinking budget: low=1000, medium=4000, high=24576 (capped, not unbounded — avoids runaway "still thinking" stalls).
  • Short connect-timeout (4s) + more retries for dead-SYN connection blips — a blip now costs ~4s instead of the ~21s OS default, with 5 retries at 0.5s backoff.
  • Claude Desktop import file — the installer now writes claude-desktop-import.json (gateway URL, key, 1m context, claude-* model names) ready to paste into Desktop's third-party gateway settings.
  • Model picker switched from fake per-tier model names to real model versions (now that /effort handles depth).

Verified

Live-tested on a real session: 605 turns, avg 4.1s per turn, 0 unrecovered errors, worst case ~30s (down from 1.5h+ stalls before this release).

Upgrading

python setup-agent.py

Safe to re-run on an existing install — it only rewrites the managed proxy/config files.

Assets 2
Loading