-
Notifications
You must be signed in to change notification settings - Fork 232
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Doc] Add internlm dataset doc #242
Conversation
Co-authored-by: Zhihao Lin <36994684+LZHgrla@users.noreply.github.com>
Co-authored-by: Zhihao Lin <36994684+LZHgrla@users.noreply.github.com>
Co-authored-by: Zhihao Lin <36994684+LZHgrla@users.noreply.github.com>
Co-authored-by: Zhihao Lin <36994684+LZHgrla@users.noreply.github.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- docs/en/user_guides/internlm_dataset.md > docs/en/user_guides/intern_repo_dataset.md
- docs/zh/user_guides/internlm_dataset.md > docs/zh/user_guides/intern_repo_dataset.md
- xtuner/configs/internlm/internlm_7b/internlm_7b_full_internlm_dataset_template.py > xtuner/configs/internlm/internlm_7b/internlm_7b_full_intern_repo_dataset_template.py
### Step 3, Start training | ||
|
||
``` | ||
srun ${SRUN_ARGS} xtuner train internlm_7b_full_internlm_dataset_template --launcher slurm --deepspeed deepspeed_zero3 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
internlm_dataset > intern_repo_dataset
|
||
### Step 1, 导出模板 config 文件 | ||
|
||
可以通过下列命令将名为 internlm_7b_full_internlm_dataset_template 的 config 导出至当前目录下: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
internlm_dataset > intern_repo_dataset
可以通过下列命令将名为 internlm_7b_full_internlm_dataset_template 的 config 导出至当前目录下: | ||
|
||
``` | ||
xtuner copy-cfg internlm_7b_full_internlm_dataset_template . |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
internlm_dataset > intern_repo_dataset
### Step 3, 启动训练 | ||
|
||
``` | ||
srun ${SRUN_ARGS} xtuner train internlm_7b_full_internlm_dataset_template --launcher slurm --deepspeed deepspeed_zero3 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
internlm_dataset > intern_repo_dataset
No description provided.