Skip to content

Commit

Permalink
fix training steps
Browse files Browse the repository at this point in the history
  • Loading branch information
iMountTai committed Jun 26, 2023
1 parent cc7d18e commit c031387
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion scripts/training/run_sft.sh
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ torchrun --nnodes 1 --nproc_per_node 1 run_clm_sft_with_peft.py \
--do_eval \
--seed $RANDOM \
--fp16 \
--num_train_epochs 3 \
--num_train_epochs 1 \
--lr_scheduler_type cosine \
--learning_rate ${lr} \
--warmup_ratio 0.03 \
Expand Down

0 comments on commit c031387

Please sign in to comment.