Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CTR prediction Result #1

Open
franktseng0718 opened this issue Dec 3, 2022 · 2 comments
Open

CTR prediction Result #1

franktseng0718 opened this issue Dec 3, 2022 · 2 comments

Comments

@franktseng0718
Copy link

I've tried ctr prediction with LR in this repo.
I also refered to some paper seeing their AUROC results on 1458, 3358, 3427, 3476 can easily surpass 90 even 95, but I only reached 8X. I also haved tuned many parameters but can't get better results.
image

Is anyone know how to get better results?

@hzn666
Copy link
Owner

hzn666 commented Dec 6, 2022

This repo intends to study bidding strategies so the performance requirements of the click-through rate prediction model are not high. Regarding your question, I will answer you from the following aspects:

  • The LR model in RLBid_EA/ctr/model.py is implemented using PyTorch. Strictly speaking, it is different from other LRs.
  • The features used to construct the dataset may differ from other papers. For details, you can check RLBid_EA/ctr/ctr_data.py.

@franktseng0718
Copy link
Author

Thanks for yor answer. I'm now trying run drlb's code, but I found that cannot converge after even 1000 episodes. The results of each episode fluctuate greatly, and most of them are even worse than LIN. The result I got is like this:
image
But the LIN's method's result is like:
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants