Skip to content

Commit

Permalink
commit
Browse files Browse the repository at this point in the history
  • Loading branch information
taishan1994 committed May 29, 2023
1 parent 533e19f commit 73555c5
Showing 1 changed file with 16 additions and 0 deletions.
16 changes: 16 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -86,6 +86,22 @@ python qlora.py --model_name="chinese_bloom" --model_name_or_path="./model_hub/B
python chat.py --model_name "chatglm" --base_model "./model_hub/chatglm-6b" --tokenizer_path "./model_hub/chatglm-6b" --lora_model "./output/chatglm/adapter_model" --with_prompt --interactive
```

# 补充

- **怎么训练自己的数据?** 数据格式为:

```python
{
"data": [
{"instruction":"", "input":"", "output":""},
{"instruction":"", "input":"", "output":""},
...
]
}
```

然后在qlora.py里面定义数据的地方加上自己的数据集即可。最后运行指令的时候自己定义相关的参数。

# 参考

> [liucongg/ChatGLM-Finetuning: 基于ChatGLM-6B模型,进行下游具体任务微调,涉及Freeze、Lora、P-tuning等 (github.com)](https://github.com/liucongg/ChatGLM-Finetuning)
Expand Down

0 comments on commit 73555c5

Please sign in to comment.