-
Notifications
You must be signed in to change notification settings - Fork 0
add Multilingual E5 models #4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: base-sha/77439ea5a87ef0ba082009226a521011873f7dfc
Are you sure you want to change the base?
add Multilingual E5 models #4
Conversation
|
This is a benchmark review for experiment This pull request was cloned from Experiment configuration |
brendanator
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We have skipped reviewing this pull request. It seems to have been created by a bot (hey, sourcery-ai-bot!). We assume it knows what it's doing!
This PR adds intfloat/multilingual-e5-base, -small models.
these models have no "token_type_ids" inputs, so I introduce check logic.
curiously, intfloat/multilingual-e5-large onnx model is only 546kB(small is 470MB, base is 1.11GB). and it can't run inference. so, I commented out for large model definition.