Skip to content

Commit

Permalink
Fix comment
Browse files Browse the repository at this point in the history
  • Loading branch information
lscheinkman committed Jun 7, 2021
1 parent cc0b930 commit a0c3689
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions projects/transformers/experiments/ablations.py
Original file line number Diff line number Diff line change
Expand Up @@ -290,9 +290,9 @@ def pct_start_hp_space(trial):
model_name_or_path="/mnt/efs/results/pretrained-models/transformers-local/bert_sparse_80%_kd_onecycle_lr_100k", # noqa: E501
)

#############
# Deepspeed #
#############
# ---------
# Deepspeed
# ---------

# This lr-range test is based on `bert_sparse_100k_kd_lr_range_test` and adapted
# for deepspeed training.
Expand Down

0 comments on commit a0c3689

Please sign in to comment.