Skip to content

agent-runtime 1.6.0

Choose a tag to compare

@chelemen-razvan chelemen-razvan released this 18 Jul 10:18
· 88 commits to main since this release

New: api driver — high-throughput single-call tasks

  • One direct LLM API call per task: no tools, no subprocesses, no workspace writes. Built for pure-inference workloads (classify, extract, rewrite) at high parallelism.
  • Structured output enforced against the task's JSON schema with a bounded retry loop (validation errors are fed back to the model; at most 3 calls).
  • api-driver containers default to 32 concurrent tasks (new tenant limit api_driver_max_workers); other drivers keep their existing cap of 4.
  • Works with every API-routable model (Anthropic + OpenAI-compatible gateways); codex-family Responses-only models are correctly excluded.
  • Also fixed for all drivers along the way: rehydrated/recovered containers previously came back with a worker cap of 1 regardless of configuration.

Web tools: reliable search and a new hosted reader

  • web_search now uses Exa as its primary provider when a deployment sets EXA_API_KEY, falling back to the local SearXNG and, as a last resort, the keyless Wikipedia search API. Every degradation is labeled in the tool result so the model knows which tier answered.
  • New web_read tool: fetches a URL as clean text via Exa's hosted reader (handles JS-heavy pages, works in slim containers with no chromium), degrading to local text extraction when unkeyed.
  • SearXNG configuration overhauled: the engine set is now actually restricted (the previous config silently left every default engine active, including permanently CAPTCHA'd ones), engine suspensions recover in 60s instead of minutes, and per-engine timeouts tolerate slow container DNS. Result: searches return usable results instead of guaranteed-empty degraded responses after the first burst.

Configured system prompts now reach CLI drivers

  • The container config's system_prompt was silently ignored by the codex, claude-code, and opencode drivers (vanilla was unaffected). Each now delivers it through the CLI's native mechanism:
    • claude-code: --append-system-prompt (augment) or --system-prompt (replace) — a true system-prompt equivalent.
    • opencode: wired into the config's instructions list, which opencode merges into its system prompt.
    • codex: materialized as $CODEX_HOME/AGENTS.md and reinforced as a standing-instructions block above every task prompt (codex has no system-prompt flag; its harness prompt cannot be replaced, so both prompt modes behave as augment).
  • Verified live end-to-end on opencode (a French-only configured prompt produced French answers to English questions through the full stack).

Agent loop and prompt efficiency (vanilla)

  • Loop breakers: byte-identical duplicate tool calls and consecutive-failure streaks now stop or redirect a stuck task instead of burning the budget.
  • Tool input schemas are no longer duplicated into the system prompt (they already travel in the API tools parameter). With MCP servers attached this had inflated the per-call baseline ~10× (18.6k → ~1.8k tokens plus one schema copy), resent on every iteration.