Skip to content

LLMeter v0.1.8

Choose a tag to compare

View all tags
@athewsey athewsey released this 24 Mar 09:27
v0.1.8
971e814
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

New Features

  • Add Endpoint connector for Bedrock InvokeModel API by @athewsey in #24
  • Add option to load Results without parsing full responses.jsonl file up-front by @acere in #32

Bug Fixes

  • Respect endpoint_name parameter in BedrockBase constructor by @acere in #30
  • Avoid divide-by-zero in time_per_output_token calculation when num_output_tokens=1 by @acere in #31
  • Avoid IndexError on OpenAICompletionStreamEndpoint chunks with no choices (for Bedrock Mantle) by @athewsey in #34

Other Changes

  • Expand test coverage (and add integration tests) by @acere in #15 and #27
  • Remove duplication of time_per_output_token calculation by @acere in #29
  • Upgrade default Bedrock integration test model to Nova 2 Lite by @athewsey in #36

Full Changelog: v0.1.7...v0.1.8

Contributors

acere and athewsey
Assets 2
Loading