Skip to content

BUAA-SMART/SMART_LLM

Repository files navigation

SMART_LLM

the repo for building SMART_LLM

Vicuna Training

done

  • 目前完成了 LoRA 版的 Vicuna 7B Fine-Tuning, 可以在Deepspeed Stage 2和Stage 3上进行ft,具体配置可以参考vicuna_ds_config_2n8u.yaml