Skip to content

Released version 1.2.0

Latest

Choose a tag to compare

@dg dg released this 10 Nov 14:04
· 5 commits to master since this release
  • Gemini context caching – a long prompt shared by many requests (a document, a codebase, a manual) can now be stored on the server with createCachedContent() and used by any chat through setCachedContent(). Unlike Gemini's automatic cache, which promises no hit, every request then reads that prefix at the price of cached input. The system instruction and tools go into the cache too; deleteCachedContent() drops it before its TTL runs out
  • RetryClient – repeats a request only when the server cannot have worked on it yet, so a generation is not run twice: a timeout or a dropped connection after sending, an unreadable response or a 502/504 is retried only for a GET. A failure before anything was sent is retried as before and is now reported as RequestNotSentException, a subclass of CommunicationException