Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

线上线下分数不同问题 #19

Closed
alacic opened this issue Mar 5, 2021 · 2 comments
Closed

线上线下分数不同问题 #19

alacic opened this issue Mar 5, 2021 · 2 comments

Comments

@alacic
Copy link

alacic commented Mar 5, 2021 •
edited
Loading

全球人工智能技术创新大赛【赛道一】线上线下分数的差别可能不来自于计算方式；可能是举办方故意按比例选了更难分辨的样本集，不知道大佬对这种情况可有解题思路呀？

image
@DLLXW
Copy link
Owner

DLLXW commented Mar 6, 2021

全球人工智能技术创新大赛【赛道一】线上线下分数的差别可能不来自于计算方式；可能是举办方故意按比例选了更难分辨的样本集，不知道大佬对这种情况可有解题思路呀？

image

我代码里面的logloss计算有误，需要再除以一个类别数，不过这样算下来线上线下还是差了很多。究其原因，就是你说的分布不一致的问题。这种情况，你只能靠线上验证了，但是不建议这样搞，如果b榜分布又变化了肯定血崩。。我也没有很好的解决思路

@alacic
Copy link
Author

alacic commented Mar 7, 2021

soga，谢谢讲解

@alacic alacic closed this as completed Mar 11, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@alacic @DLLXW