-
Notifications
You must be signed in to change notification settings - Fork 75
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Time series prediction usage #21
Comments
If your doing time series of continuous numbers, you should remove the embedding layer. embedding layers are meant to take discrete numbers (like a token lets say 3345) and convert them to a floating point tensor with n_features. |
Hello! |
Have you solved this problem? |
The embedding_dim should be seen as synonym for hidden_dim, when you are not using embeddings. The xLSTMBlockStack does not contain embedding/un-embedding layers. |
Hello!
I have read in your README.md file the next point: "For non language applications or for integrating in other architectures you can use the xLSTMBlockStack". I have an issue now: I want to use your xlstm implementation for time series data prediction, however, I have met problems with "embeddings" while using "xLSTMBlockStack". Based on what should I define "embedding_dim" variable in config? Can you please elaborate on this topic?
Thank you in advance.
The text was updated successfully, but these errors were encountered: