Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement variable-sized sequence sampling #71

Open
HEmile opened this issue May 15, 2020 · 0 comments
Open

Implement variable-sized sequence sampling #71

HEmile opened this issue May 15, 2020 · 0 comments
Labels
enhancement New feature or request

Comments

@HEmile
Copy link
Owner

HEmile commented May 15, 2020

Implement variable-sized sequence sampling, both with and without replacement. Sampling from eg LSTMs creates a sequence of random samples, but the amount of random variables sampled varies depending on eg when the EOS token is sampled.

Using the AncestralPlate, we should be able to keep track of exactly what sequences are sampled. When a sequence reaches EOS, we can remove it from the samples in the future to not do double computation. Should be possible both with and without replacement: When doing without replacement, we should only sample the k-1.

@HEmile HEmile added the enhancement New feature or request label May 15, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Stochastic computation graphs
  
Awaiting triage
Development

No branches or pull requests

1 participant