Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What version of Fourier Neural Operator is used in the MWT paper? #1

Closed
scaomath opened this issue Oct 5, 2021 · 2 comments
Closed

Comments

@scaomath
Copy link

scaomath commented Oct 5, 2021

Hi, thanks for the sharing the nicely written code on the wavelet neural operator.

I wonder what version of FNO is used in the comparison? for example in Table 2 of https://arxiv.org/abs/2109.13459v1

Because in Table 2, FNO1d still has only 1e-2 evaluation relative error for the Burgers' benchmark.

In the new implementation, if BatchNorm is removed, and change the ReLU activation to GeLU or SiLU, 500 epochs of MultiStepLR scheduling will yield about 2.5e-3 to 2.7e-3 evaluation relative error: see neuraloperator/neuraloperator#30 , even with a 1cycleLR + 100 epochs, the evaluation error is around 4.1e-3.

@gaurav71531
Copy link
Owner

For Burgers' eqn the results are in Table-7 where after using 3 seeds we get average error ~3.33e-3. We have used Pytorch 1.8 cu 11.0

@scaomath
Copy link
Author

scaomath commented Oct 5, 2021

Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants