Skip to content

1.0.0 - First non-beta release, eval latency and tokens

Latest

Choose a tag to compare

@statsig-kong statsig-kong released this 13 Nov 17:08
4b0246e

The first non-beta release of @statsig/statsig-ai. It has everything in 0.0.1-beta.34, plus the change below.

Breaking changes

  • EvalHooks gains a required reportTokens member. Code that builds an EvalHooks object by hand, for example to unit-test a task, has to pass it.

Improvements

  • Eval() times each record's task and sends the result as latencyMs. Tasks can call reportTokens({ inputTokens, outputTokens }) from their hooks to send token totals; each call adds to the record's totals. A record whose task throws sends neither. Eval() also returns latencyMs, inputTokens and outputTokens on each result, and EvalTokenUsage is exported.

Docs

  • The README no longer has a beta notice, and it has a new "Latency and tokens" section.

Included In This Release

  • maggiepizzo - feat: send latency and tokens with eval results (SSLABS-930) (#124)

Full Changelog: 0.0.1-beta.34...1.0.0