Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to change code when each sequence length is different #17

Closed
REDXXXX opened this issue Jan 22, 2019 · 1 comment
Closed

How to change code when each sequence length is different #17

REDXXXX opened this issue Jan 22, 2019 · 1 comment

Comments

@REDXXXX
Copy link

REDXXXX commented Jan 22, 2019

Dear sir:
Sorry for my rude words.But I do really want to know how to change the code if the sequence length is different.It seems that ntm need sequence length to be the same.
I tried to fill short sequence with zero but the ntm use attention and if filled with zero the predict rate down.
I want to know how could I do to overcome the problem.Please help me.
Best wishes to you.

@loudinthecloud
Copy link
Owner

The sequence length doesn't have to be the same, you can end each sequence with a special delimiter. The input sequence length is also randomized between 10 to 20 in the copy task and you can even see an example of variable length output in the repeat-copy task where the NTM learns to output a sequence multiple times and end it with a delimiter.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants