Repository navigation
BFEv1.8.8.2
·
107 commits
to develop
since this release
BFE v1.8.8.2
Fixed (issue #1401):
- parse the final usage embedded in the streaming finish chunk's choice
(choices[N].usage, cache field cached_tokens) used by kimi-for-coding
and other upstreams ignoring the injected stream_options.include_usage - default EstimateToken/InjectStreamUsage as program defaults so the
fixes survive binary upgrades without new conf keys - clamp the negative completion-tokens sentinel at the access log
boundary (no more negative output token counts)
Based on bfenetworks/bfe v1.8.8.