Skip to content
 
 

Latest commit

 

History

126 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Bertalign

This fork make sentence splitting language agnostic by introducing wtpsplit and 500M (for onnx) runtime download size. googletrans and sentence-splitter is removed. This project has full language agnostic now since LaBSE is already language agnostic.

This fork is willing to support more embedding models, such as harrier-oss, which is current bitext SOTA on MMTEB. However LaBSE is still very high ranked on MMTEB though.

About

Multilingual sentence alignment using sentence embeddings

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages