-
Notifications
You must be signed in to change notification settings - Fork 30
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Can you provide a more detailed guide to fine-tuning operations? #23
Comments
Hey, do you have your dataset on HuggingFace?
…On Wed, 8 May 2024 at 13:37, 小陈 ***@***.***> wrote:
@asahi417 <https://github.com/asahi417>
—
Reply to this email directly, view it on GitHub
<#23 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AEEXCDHOM3DPB3MD224BJZLZBGTYBAVCNFSM6AAAAABHLM45SSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOJZG4ZDKMRVGQ>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
hello! thanks your reply! |
Cool. Are you gonna load the dataset locally via HuggingFace dataset? If it
uses the HuggingFace dataset, it should be pretty straightforward, but
otherwise can be a bit tricky.
…On Wed, 8 May 2024 at 14:08, 小陈 ***@***.***> wrote:
hello! thanks your reply!
I have the dataset organized ~ not uploaded to huggingface at the moment,
would like to load the dataset locally for mT5 fine-tuning
—
Reply to this email directly, view it on GitHub
<#23 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AEEXCDAQRSUHA4UC5YXDZ4TZBGXMZAVCNFSM6AAAAABHLM45SSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOJZG42TANBSGM>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
|
Very excited to see your feedback! I will upload the dataset to huggingface, how do I need to fine tune it after that? |
Try the following command.
That will launch the fine-tuning with hyperparameter gridsearch. you might need to play around with the parameter. See the full description at |
For example, following command is used to train https://huggingface.co/lmqg/mt5-base-zhquad-qag.
|
Very excited to see your feedback! THANKS |
I want to fine-tune a mt5 Chinese model on my own dataset!
Extremely grateful.
The text was updated successfully, but these errors were encountered: