Skip to content

StateFrame 0.4.34

Choose a tag to compare

@FarsideResearch FarsideResearch released this 06 Nov 02:14
6a6082f

StateFrame 0.4.34: automatic retry when a provider rejects a request as too long.

Changes

  • When a provider rejects a request for exceeding its context limit (a recognized HTTP 400 from OpenAI, DeepInfra, vLLM, llama.cpp and other common providers), StateFrame now refits the request to the limit the provider reported and retries once.
  • If the request still cannot fit, the run stops and the summary says why, instead of showing only "HTTP 400".
  • Other HTTP 400 errors (for example a malformed response format) are not retried.

Known issues (fixes planned)

  • In-place runs and exported patches can change the line endings or byte-order mark of untouched text files in the edit scope (see KNOWN_LIMITATIONS). A fix is being tested now.
  • Linux: checks that run Go or Node programs fail under StateFrame's check memory limit. macOS is not affected.
  • The first request of a run can differ between runs in one optional orientation section, depending on local cache state.
  • On endpoints without an exact tokenizer, very dense content can be underestimated and push a request past the context limit; the new retry recovers many of these cases.