-
Notifications
You must be signed in to change notification settings - Fork 234
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature]Add Deepseekcoder config #253
Conversation
@xiaohangguo |
sry,混在一起了,我改一下。 |
...onfigs/deepseek/deeepseekcoder_6.7b_base/deepseekcoder_6.7b_instruct_qlora_code_alpaca_e3.py
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
文件名有小typo
xtuner/configs/deepseek/deeepseekcoder_6.7b_base/deepseekcoder_6.7b_instruct_qlora_code_alpaca_e3.py
-->
xtuner/configs/deepseek/deepseekcoder_6.7b_base/deepseekcoder_6.7b_base_qlora_code_alpaca_e3.py
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
文件名有小typo
xtuner/configs/deepseek/deeepseekcoder_6.7b_base/deepseekcoder_6.7b_instruct_qlora_code_alpaca_e3.py -->
xtuner/configs/deepseek/deepseekcoder_6.7b_base/deepseekcoder_6.7b_base_qlora_code_alpaca_e3.py
typo 修正后,建议将6.7b
统一修正为6_7b
,避免.
在文件名中的使用
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
妥了
I.测试了两个模型:
lora训练完毕,合并对话均无报错。
II.添加了对话模板
参考官方训练脚本中对话模板
https://github.com/deepseek-ai/DeepSeek-Coder/blob/main/finetune/finetune_deepseekcoder.py