You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thanks for the great work on Pyserini! I had a naive question that I can't seem to find the answer to.
I'd like to use E5 (https://huggingface.co/intfloat/e5-large but other models are similar) and they recommend normalizing the embeddings. I can't find an option for that in Pyserini to do that, when it's not a dense/sparse combination. I'd like to do just dense encodings, but make sure the embeddings are normalized to properly use E5.
I've been using pyserini.encode so far but don't see any options in there for it. Does Pyserini support this?
The text was updated successfully, but these errors were encountered:
Hi there!
Thanks for the great work on Pyserini! I had a naive question that I can't seem to find the answer to.
I'd like to use E5 (https://huggingface.co/intfloat/e5-large but other models are similar) and they recommend normalizing the embeddings. I can't find an option for that in Pyserini to do that, when it's not a dense/sparse combination. I'd like to do just dense encodings, but make sure the embeddings are normalized to properly use E5.
I've been using
pyserini.encode
so far but don't see any options in there for it. Does Pyserini support this?The text was updated successfully, but these errors were encountered: