-
Notifications
You must be signed in to change notification settings - Fork 1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
using mamba as an headless "vanilla RNN" #38
Comments
Ok, I was looking at the wrong place |
I am also looking to use Mamba as a vanilla RNN, but I think I've been looking in the wrong places too for the decoding/hidden state logic. Where did you find it? |
@JVP15 |
utils.generation, that is what I was missing, thank you! |
Thank you for your amazing work,
I'm trying to use Mamba as an drop-in replacement of some RNN in a encoder/decoder architecture, for that I've turned off the logits head. How should I properly get the hidden state during inference ? I'm a bit lost in the decoding logic.
The text was updated successfully, but these errors were encountered: