Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Size of the test set of the Informer datasets #20

Open
itdevwu opened this issue Jan 15, 2024 · 1 comment
Open

Size of the test set of the Informer datasets #20

itdevwu opened this issue Jan 15, 2024 · 1 comment

Comments

@itdevwu
Copy link

itdevwu commented Jan 15, 2024

Hi Nate!

Just scanned through you marvelous work. I found that the precomputed output of Autoformer on the Informer datasets are substantially smaller than the original test set. As you mentioned in your paper that the test set has been narrowed, but what is the actual size of the test set?

@ngruver
Copy link
Owner

ngruver commented Jan 15, 2024

HI Astor,

Our test set has one chunk per covariate and they are predicted independently. For the datasets with a small number of covariates, you could probably run evaluation with the original test set, but with many covariates it is intractable, as the number of series to predict will be (number of covariates) x (number of temporal chunks).

Nate

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants