Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implementation details #31

Open
bryanyzhu opened this issue Mar 27, 2019 · 1 comment
Open

Implementation details #31

bryanyzhu opened this issue Mar 27, 2019 · 1 comment

Comments

@bryanyzhu
Copy link

@WaqasSultani Hi, thank you for the awesome code base. I'm trying to train the model, but notice some minor differences between your code and the paper.

  1. Learning rate: You mentioned in your paper that you use a lr=0.001, but in here, you set lr to 0.01.

  2. Model weight L2 regularization. In your paper, you specified lambda3=0.01, but in here, you set it to 0.001.

  3. Did you use learning rate decay? Or you just use constant learning rate during all 20K iterations? Thanks.

  4. Is there a possibility to share your training log with me? I can get a AUC score of 74.4 really quick, like within 2K iterations, and then the accuracy remains the same. I couldn't get to 75.41 as you report in your paper. It would be really helpful if you can share your training log.

Thank you very much, looking forward to your reply.

@abdkumar
Copy link

abdkumar commented Apr 7, 2019

@bryanyzhu i couldn't understand this repository code, could you share your code?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants