Mini-Qwen1.4B

Forked from MINI_LLM -Lil2J , 复现Qwen1.4B 的训练过程并训练xx垂直领域模型！

Name		Name	Last commit message	Last commit date
Latest commit History 97 Commits
accelerate_yaml		accelerate_yaml
dataset_dpotrain		dataset_dpotrain
dataset_pretrain		dataset_pretrain
dataset_sfttrain		dataset_sfttrain
dataset_utils		dataset_utils
datasets_Processed		datasets_Processed
model_save		model_save
qwen		qwen
README.md		README.md
minillm2_DpoTrain.py		minillm2_DpoTrain.py
minillm2_PreTrain.py		minillm2_PreTrain.py
minillm2_SftTrain.py		minillm2_SftTrain.py
minillm_DpoTrain.py		minillm_DpoTrain.py
minillm_PreTrain.py		minillm_PreTrain.py
minillm_SftTrain.py		minillm_SftTrain.py
requirements.txt		requirements.txt

Provide feedback