New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Question on the optimization process #4

Closed

Robinysh opened this issue Mar 23, 2021 · 1 comment

Robinysh commented Mar 23, 2021

Is the language model finetuned together with the prompt generator during p-tuning? Have there been experiments done on the alternative?

tonyswoo commented Mar 23, 2021 •

edited

I believe for knowledge probing, the pre-trained language model parameters are fixed and for SuperGLUE, P-tuning and fine-tuning are applied jointly.

In LAMA knowledge probing where model parameters are fixed, ...

In another NLU benchmark, SuperGlue, we jointly apply the P-tuning and fine-tuning ...

Xiao9905 closed this as completed

Xiao9905 reopened this

Xiao9905 mentioned this issue

关于论文的一些疑惑 #5

Closed

Xiao9905 closed this as completed

qiuwenbogdut mentioned this issue

P-tuning中模型参数冷冻的问题 #42

Open

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment