Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Time series prediction usage #21

Closed
SokolOFFF opened this issue Jun 13, 2024 · 4 comments
Closed

Time series prediction usage #21

SokolOFFF opened this issue Jun 13, 2024 · 4 comments

Comments

@SokolOFFF
Copy link

Hello!
I have read in your README.md file the next point: "For non language applications or for integrating in other architectures you can use the xLSTMBlockStack". I have an issue now: I want to use your xlstm implementation for time series data prediction, however, I have met problems with "embeddings" while using "xLSTMBlockStack". Based on what should I define "embedding_dim" variable in config? Can you please elaborate on this topic?
Thank you in advance.

@SummerSigh
Copy link

If your doing time series of continuous numbers, you should remove the embedding layer. embedding layers are meant to take discrete numbers (like a token lets say 3345) and convert them to a floating point tensor with n_features.

@only1choice
Copy link

Hello!
Have you solved this problem?

@zhuwei321
Copy link

Have you solved this problem?

@kpoeppel kpoeppel closed this as completed Aug 4, 2024
@kpoeppel
Copy link
Collaborator

kpoeppel commented Aug 4, 2024

The embedding_dim should be seen as synonym for hidden_dim, when you are not using embeddings. The xLSTMBlockStack does not contain embedding/un-embedding layers.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants