Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

sentence and word ecnoder. #13

Closed
saxenarohit opened this issue Oct 29, 2018 · 2 comments
Closed

sentence and word ecnoder. #13

saxenarohit opened this issue Oct 29, 2018 · 2 comments

Comments

@saxenarohit
Copy link

I can only see the word level encoder. Am I missing something? There should be two Bi-GRU layers right?

@ilivans
Copy link
Owner

ilivans commented Oct 29, 2018

Hi @saxenarohit ,
There is just one layer in the example, but multiple layers can be used with ease.
The encoder is word-level, indeed. What's wrong with that? The overall idea is to apply attention to specific words, so it makes sense to work on word level rather than character or sentence level (the last one is possible though for large texts)

@ilivans
Copy link
Owner

ilivans commented Oct 29, 2018

I see what you mean, it's not an exact implementation of an algorithm from "Hierarchical Attention Network". It's more simple example of attention use.

@ilivans ilivans closed this as completed Nov 8, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants