Skip to content

v2.0.2 — Fix cache_control_sticky 4-marker limit

Choose a tag to compare

@cnighswonger cnighswonger released this 17 Apr 17:52
· 241 commits to main since this release

Hotfix: cache_control_sticky from v2.0.1 could place 5 cache_control markers (3 historical + 1 canonical + 1 system), exceeding Anthropic's hard limit of 4. Caused 400 invalid_request_error on sessions with enough history. Reduced MAX_POSITIONS from 3 to 2. 160 tests.