【开源实习】Barthez模型微调 #2032

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merged

lvyufeng merged 1 commit into mindspore-lab:master from SeasonMay:master

May 23, 2025

Contributor

SeasonMay commented May 4, 2025

barthez 模型微调

任务

任务编号：IAUOXG
任务链接：https://gitee.com/mindspore/community/issues/IAUOXG
模型：moussaKam/barthez
数据集: Allocine 法语情感分类数据集

结果对比：

mindnlp+910b
·mindnlp==0.4.1
·mindspore==2.5.0

Epoch	train_loss	eval_loss	f1_score
1	0.2217	0.1630	0.9432
2	0.1782	0.1563	0.9453
3	0.1661	0.1582	0.9469
4	0.1582	0.1542	0.9503
5	0.1522	0.1499	0.9509

pytorch+3090

Epoch	train_loss	eval_loss	f1_score
1	0.2468	0.1690	0.9427
2	0.1833	0.1586	0.9450
3	0.1685	0.1611	0.9443
4	0.1605	0.1559	0.9471
5	0.1543	0.1522	0.9499


          【开源实习】Barthez模型微调

514c521

lvyufeng merged commit 30b1947 into mindspore-lab:master

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet