Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ANP-RNN 'use_deterministic_path'= False? #2

Open
xuesongwang opened this issue Oct 26, 2020 · 1 comment
Open

ANP-RNN 'use_deterministic_path'= False? #2

xuesongwang opened this issue Oct 26, 2020 · 1 comment

Comments

@xuesongwang
Copy link

xuesongwang commented Oct 26, 2020

Hi there,

I am just wondering if you forgot to set 'use_deterministic_path'= True for ANP-RNN, since in the paper the authors indicate so, and you obviously have already set cross-validations.

https://github.com/3springs/attentive-neural-processes/blob/af431a267bad309b2d5698f25551986e2c4e7815/neural_processes/models/neural_process/lightning.py#L189-L195

BTW, I was trying to replicate the experiment on GP dataset, and I have already implemented an ANP. Although the architecture of mine is slightly different from yours, I assume I will just need to replace all the MLPs with LSTMs plus sequential encodings of the input, output, right? However, mine result was really bad, when I sorted my x_context, x_target, the model only seems to be able to predict a few points and predicts flat curves afterwards. Could you please share with me any hints regarding this?

Your help is very much appreciated

@wassname
Copy link
Owner

wassname commented Oct 26, 2020

Your right it probably should be true, although I'm not sure the Deterministic Path helps much.

Could you please share with me any hints regarding this?

Sure, I may need to see you code first though

plus sequential encodings

What do you mean by that? I put "time since now' as a feature in order to encode times.

wassname added a commit that referenced this issue Oct 26, 2020
for #2
Repository owner deleted a comment from mr-robot77 Feb 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants
@wassname @xuesongwang and others