New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Is it correct? Manual prompt is better than KPT ? #11

Closed

znsoftm opened this issue Jun 21, 2022 · 1 comment

znsoftm commented Jun 21, 2022

for the up-to-date code of KPT, I get the bellow result on dataset Agnews for Zeroshot:

KPT: Acc: 0.5125
Manual: Acc: 0.6589473684210526

Is it correct ?

Author

znsoftm commented Jun 22, 2022

sorry, after calibration, the acc is : Acc: 0.8505263157894737

ShengdingHu closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment