Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about data_loader.py #72

Closed
Shi-Yuhong opened this issue May 1, 2024 · 3 comments
Closed

Question about data_loader.py #72

Shi-Yuhong opened this issue May 1, 2024 · 3 comments

Comments

@Shi-Yuhong
Copy link

Dear author, thank you for your excellent work!
I have some questions about getitem(self, index) in data_loader.py
image
It seems that seq_x only contains data for one feature. And I don't quite understand this kind of handling.
Is this related to the handling of Channel Independence
But I checked the code of PatchTST and his DataLoader is not like this.
Could you please provide a specific explanation of the data processing in getitem(self, index),thanks a lot!!

@ztb-35
Copy link

ztb-35 commented May 1, 2024

I'm also interested in this question.

@Shi-Yuhong
Copy link
Author

I think maybe I have found the answer. The Dataloader of this code is the same as GPT4TS. Someone has raised a similar question and has already received an answer, please refer to NeurIPS2023-One-Fits-All/issues/15 for details.This operation does seem to be related to channel independence

@kwuking
Copy link
Collaborator

kwuking commented May 15, 2024

I think maybe I have found the answer. The Dataloader of this code is the same as GPT4TS. Someone has raised a similar question and has already received an answer, please refer to NeurIPS2023-One-Fits-All/issues/15 for details.This operation does seem to be related to channel independence

Yes, your understanding is completely correct. This is the data processing method that implements the channel-independent operation, and it reduces the amount of data entering the GPU at the same time, avoiding the OOM problem caused by too much data.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants