Skip to content

Commit

Permalink
misc changes to neox_args
Browse files Browse the repository at this point in the history
  • Loading branch information
jahatef committed May 15, 2024
1 parent 4bc6670 commit 8d175ed
Showing 1 changed file with 0 additions and 11 deletions.
11 changes: 0 additions & 11 deletions configs/neox_arguments.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,17 +9,6 @@ LR Scheduler Arguments

- **lr_decay_style**: typing.Literal['constant', 'linear', 'cosine', 'exponential']

Default = linear

Learning rate decay function. Choose from 'constant', 'linear', 'cosine', 'exponential'.



- **lr_decay_iters**: int

Default = None

Number of iterations to decay learning rate over, If None defaults to --train-iters



Expand Down

0 comments on commit 8d175ed

Please sign in to comment.