Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

negative samplings #24

Open
Wangchuan0 opened this issue Jun 3, 2023 · 5 comments
Open

negative samplings #24

Wangchuan0 opened this issue Jun 3, 2023 · 5 comments

Comments

@Wangchuan0
Copy link

Hello, if you train directly according to your steps, which one of IB, PB, SN will it turn out? If I want to test the results of different negative samples, how can I change the code
57444c4a0f1d42c6e8c1ade7097c58d
0f11625312930971ff42bf7b08777fc

@intfloat
Copy link
Owner

intfloat commented Jun 5, 2023

--pre-batch 0 means it does not use pre-batch negatives.

Remove --use-self-negative if you do not want to use self-negatives.

In batch negatives are always used since they are almost free anyway.

@Wangchuan0
Copy link
Author

PB 0改成1是使用的意思吗

@Wangchuan0
Copy link
Author

那我跑的结果应该是IB +SN,结果跟你的差的好大。我只改了batch size。求解答

@intfloat
Copy link
Owner

intfloat commented Jun 5, 2023

batch size 就是对结果影响最大的参数,batch size小了,对比学习的效果就会下降

@Wangchuan0
Copy link
Author

okok,谢谢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants