Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Including bi-grams in the corpora #1

Closed
sanketjoshi2012 opened this issue Nov 11, 2021 · 3 comments
Closed

Including bi-grams in the corpora #1

sanketjoshi2012 opened this issue Nov 11, 2021 · 3 comments

Comments

@sanketjoshi2012
Copy link

How to include bi-grams using Gensim in the corpora for training?

@vinid
Copy link
Owner

vinid commented Nov 11, 2021

Hi!

I think your best option is to create the bigrams (https://radimrehurek.com/gensim/models/phrases.html) from your documents and then save them into a file!

For example, look at this

@sanketjoshi2012
Copy link
Author

Okay, thanks!
Did you not consider the bi-grams or tri-grams when you ran the model?

@vinid
Copy link
Owner

vinid commented Nov 11, 2021

That was not our use case at the time, we just aligned standard word embeddings :)

@vinid vinid closed this as completed Feb 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants