10-24 initial asr seq2seq
- pip install -U -r requirements.txt
- 如果无法安装, 可以切换官方源 pip install -i https://pypi.org/simple -U -r requirements.txt
支持且不限于以下权重
- open_data https://github.com/ssbuild/open_data
- common_voice_11_0 https://huggingface.co/datasets/mozilla-foundation/common_voice_11_0
- common_voice https://huggingface.co/datasets/common_voice
单条数据示例
{
"path": "../zh-CN_train_0/common_voice_zh-CN_33211332.mp3",
"sentence": "性喜温暖润湿气候且耐寒。",
"locale": "zh-CN"
}
# infer_finetuning.py 推理微调模型
# infer_lora_finetuning.py 推理微调模型
python infer_finetuning.py
# 制作数据
cd scripts
bash train_full.sh -m dataset
or
bash train_lora.sh -m dataset
or
bash train_ptv2.sh -m dataset
注: num_process_worker 为多进程制作数据 , 如果数据量较大 , 适当调大至cpu数量
dataHelper.make_dataset_with_args(data_args.train_file,mixed_data=False, shuffle=True,mode='train',num_process_worker=0)
# 全参数训练
bash train_full.sh -m train
# lora adalora ia3
bash train_lora.sh -m train
# ptv2
bash train_ptv2.sh -m train
- pytorch-task-example
- tf-task-example
- chatmoss_finetuning
- chatglm_finetuning
- t5_finetuning
- llm_finetuning
- llm_rlhf
- chatglm_rlhf
- t5_rlhf
- rwkv_finetuning
- baichuan_finetuning
纯粹而干净的代码