Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PET's final classifier for RAFT benchmark B77 task #71

Open
LiweiPeng opened this issue Dec 9, 2021 · 0 comments
Open

PET's final classifier for RAFT benchmark B77 task #71

LiweiPeng opened this issue Dec 9, 2021 · 0 comments

Comments

@LiweiPeng
Copy link

Hi, Thanks for publishing PET's excellent results on RAFT benchmark in your recent "True Few-Shot Learning with Prompts – A Real-World Perspective" paper. The best practices in the paper are very useful for real-world examples.

In the paper section 5 "PET for Real-World Tasks" -> "Handling Many Labels", you mentioned ".... We thus train the final model as a regular classifier with 77 different output classes; for training this classifier on an input x, we set the target probability of each output y proportional to the probability of True being the correct output for (x, y) according to our ensemble of binary classifiers.".

Can you provide more details on how the above is implemented in PET framework? Can you share your code on this? Thanks,

Liwei

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant