Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

wgan-gp getting different rmse and prediction not accurate #4

Closed
makovez opened this issue Dec 17, 2022 · 4 comments
Closed

wgan-gp getting different rmse and prediction not accurate #4

makovez opened this issue Dec 17, 2022 · 4 comments

Comments

@makovez
Copy link

makovez commented Dec 17, 2022

I followed (copy/paste) the exact same code of wgan-gp_demo.ipynb with the same dataset as well, but I am getting worst result. Are you sure the code is updated? I'm getting RMSE:7.945424793070616 on testing dataset

Also, As you can see the trend of the prediction/actual seems much more similar to GAN or LSTM

image

@makovez makovez changed the title wgan-gp getting wgan-gp getting different rmse Dec 17, 2022
@makovez makovez changed the title wgan-gp getting different rmse wgan-gp getting different rmse and prediction not accurate Dec 17, 2022
@makovez
Copy link
Author

makovez commented Dec 17, 2022

Running it multiple times changes the score. Is this normal?
It doesen't seem to be much stable. RMSE in testing ranges from 2.5 to 10

@ChickenBenny
Copy link
Owner

ChickenBenny commented Dec 18, 2022

Hi makovez,
Because GAN in a non-steady model, so the RMSE and the result will be different.
In other words, GAN is depend on the interaction between G and D, just like reinforcement learning.
Therefore, the result might be different.
If you are interesting in this topic try to use MHGAN or use Bayesian optimization, it might help to improve the training.

@makovez
Copy link
Author

makovez commented Feb 2, 2023

Hi, it would be nice if we could have a chat regarding the topic? In particular I would like to exchange some ideas about feature selection and labels generation with RL.

My telegram is: @sbongown

@ChickenBenny
Copy link
Owner

Hi, just feel free to ask me~
I have already added your telegram.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants