-
Notifications
You must be signed in to change notification settings - Fork 206
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Question about data_loader.py #72
Comments
I'm also interested in this question. |
I think maybe I have found the answer. The Dataloader of this code is the same as GPT4TS. Someone has raised a similar question and has already received an answer, please refer to NeurIPS2023-One-Fits-All/issues/15 for details.This operation does seem to be related to channel independence |
Yes, your understanding is completely correct. This is the data processing method that implements the channel-independent operation, and it reduces the amount of data entering the GPU at the same time, avoiding the OOM problem caused by too much data. |
Dear author, thank you for your excellent work!
![image](https://private-user-images.githubusercontent.com/104192959/327076872-eb3de206-b01c-467c-8d3e-d27fb7df60b7.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjU2ODY2NzIsIm5iZiI6MTcyNTY4NjM3MiwicGF0aCI6Ii8xMDQxOTI5NTkvMzI3MDc2ODcyLWViM2RlMjA2LWIwMWMtNDY3Yy04ZDNlLWQyN2ZiN2RmNjBiNy5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwOTA3JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDkwN1QwNTE5MzJaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT03ZGRlOWMxYjU5ZDczZWUxZTUzZThhMzk0ODgyOTI5ZDAxMzZjNzM3N2ZiYmZiNmM3MzExZjgyMGE4NzI0OTQ2JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.HK49BPcCAqruwWUKMGn9GTCCUYS4IzMJCTiMVpRRFow)
I have some questions about getitem(self, index) in data_loader.py
It seems that seq_x only contains data for one feature. And I don't quite understand this kind of handling.
Is this related to the handling of Channel Independence?
But I checked the code of PatchTST and his DataLoader is not like this.
Could you please provide a specific explanation of the data processing in getitem(self, index),thanks a lot!!
The text was updated successfully, but these errors were encountered: