Skip to content

BFEv1.8.8.2

Choose a tag to compare

@mileszhang2016 mileszhang2016 released this 09 Oct 15:24
· 107 commits to develop since this release

BFE v1.8.8.2

Fixed (issue #1401):

  • parse the final usage embedded in the streaming finish chunk's choice
    (choices[N].usage, cache field cached_tokens) used by kimi-for-coding
    and other upstreams ignoring the injected stream_options.include_usage
  • default EstimateToken/InjectStreamUsage as program defaults so the
    fixes survive binary upgrades without new conf keys
  • clamp the negative completion-tokens sentinel at the access log
    boundary (no more negative output token counts)

Based on bfenetworks/bfe v1.8.8.