Skip to content

Commit

Permalink
docs: update for samples
Browse files Browse the repository at this point in the history
  • Loading branch information
phodal committed Dec 31, 2023
1 parent ec9b3d7 commit 66cf6d5
Showing 1 changed file with 16 additions and 1 deletion.
17 changes: 16 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -851,7 +851,7 @@ if __name__ == "__main__":
![Finetune Model Choice](images/finetune-model-choice.jpg)
#### 数据集信息
#### 数据集示例 1
由 Unit Eval + OSS Instruct 数据集构建而来:
Expand All @@ -863,6 +863,21 @@ if __name__ == "__main__":
测试视频:[开源 AI 辅助编程方案:Unit Mesh 端到端打通 v0.0.1 版本](https://www.bilibili.com/video/BV1si4y1h7Vw/)
在 Unit Eval [0.3.2](https://github.com/unit-mesh/unit-eval/releases/tag/v0.3.2) 版本里
组成如下:
```python
# Merge and shuffle records from different files
merge_jsonl(
output_file=merged_file,
input_files=[oss_instruction, 'code_bugfix_cleaned_5K.json', 'codeGPT_CN_cleaned_20K.json',
'code_summarization_CN_cleaned_10K.json', 'java-code-completion.jsonl', 'java-test-gen.jsonl',
'kotlin-completion-11929.jsonl', 'kotlin-java-comments-3715.jsonl'],
lines_per_file=[4000, 4000, 15000, 8000, 5000, 3000, 3000, 2000 ]
)
```
#### 参数示例:
```bash
Expand Down

0 comments on commit 66cf6d5

Please sign in to comment.