Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is it meaningful to put both input vectors and output vectors on the same plot #3

Open
dreamgonfly opened this issue Jul 26, 2017 · 1 comment

Comments

@dreamgonfly
Copy link

While playing and learning with your visualization, I noticed input vectors and output vectors are placed in the same space, and plotted on the same plot (after applying PCA). Input vectors and output vectors have the same dimensionality, but I'm wondering if you can interpret them in the same way. From my understanding, input vectors and output vectors pull and push each other but I can't think of any relations they might preserve. Can you make it more clear if you can extract any meaning from the relative positions of input and output vectors?

And thanks for making a great tool for understanding Word2vec. I really appreciate your work!

@enfeizhan
Copy link

@dreamgonfly Seems he won't be able to answer your questions any more. Google his name and see what happened to him. Hope he shows up again alive.

About your question, he had some comments on that in his youtube video.

Output vectors carry equivalent information just representing the words differently. Think about it in a different way: Is there particular reason input vectors are preferred over the output vectors?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants