Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to apply this methods to a new LMs without fine-tune, like a bert? #28

Open
sev777 opened this issue Nov 21, 2022 · 1 comment
Open

Comments

@sev777
Copy link

sev777 commented Nov 21, 2022

Hi,
In your paper, does the model edited in ROME or MEND methods must be fine-tuned?
How to apply the ROME to the model without fine-tuning ?
For example, the bert model is not just the GPTs series.

Thanks.

@huu4ontocord
Copy link

Same question. How to apply to t5. I see that the MEND algorithm can be applied to t5, but not ROME.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants