Skip to content

BFE v1.8.8.1

Choose a tag to compare

@mileszhang2016 mileszhang2016 released this 09 Oct 06:22
· 172 commits to develop since this release

BFE v1.8.8.1

Fixed (issue #1398):

  • zeroed token usage in access logs and billing for requests without a
    final usage event (billing/log view isolation, estimate mirror)
  • final usage events with zero output tokens not recognized
  • inject stream_options.include_usage for OpenAI streaming chat
    completions (Server.InjectStreamUsage, default on)
  • default EstimateToken to true (approved ContentLength/4 fallback)

Based on bfenetworks/bfe v1.8.8.