-
Notifications
You must be signed in to change notification settings - Fork 37
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Update TranslationModel to boost speed
Towards #77. This updates TranslationModel to use the new Service::translateMultiple(...) API to efficiently pack batches by compiling multiple Requests and using only using one translate-dispatch call for all Requests. Due to changes in batching/ordering and consequently difference in approximations after quantization, the outputs are now different from those earlier (breaking bergamot-translator-app regression-tests) but correct nonetheless (regression-tests output now need updating).
- Loading branch information
Jerin Philip
committed
Apr 3, 2021
1 parent
487bfe7
commit 32285aa
Showing
1 changed file
with
10 additions
and
15 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters