Skip to content

Commit

Permalink
Add LogProbs capability to HuggingFaceSUT (#439)
Browse files Browse the repository at this point in the history 
* Move prompt tokenization from evaluate() into translate_request()

* stop_sequences does not affect eos_token_id

* Store tokenized tensors in HuggingFaceRequest

* Put tokenization back in evaluate

* Add logprobs capability

* make mypy happy
  • Loading branch information
@bkorycki
bkorycki committed May 18, 2024
1 parent f271046 commit 3e04edb
Show file tree
Hide file tree
Showing 3 changed files with 483 additions and 267 deletions.
Loading

0 comments on commit 3e04edb

Please sign in to comment.