Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
hnyu committed Jun 5, 2024
1 parent 13ea5ae commit 3e32558
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion alf/algorithms/config.py
Original file line number Diff line number Diff line change
Expand Up @@ -119,7 +119,10 @@ def __init__(self,
If a specific random seed is set, DDP rank>0 (if multi-gpu training
used) will have a random seed set to a value that is deterministically
"randomized" from this random seed. In this case, all ranks will
have a deterministic torch behavior.
have a deterministic torch behavior. NOTE: By the current design,
you won't be able to reproduce a training job if its random seed
was set as None. For reproducible training jobs, always set the
random seed in the first place.
num_iterations (int): For RL trainer, indicates number of update
iterations (ignored if 0). Note that for off-policy algorithms, if
``initial_collect_steps>0``, then the first
Expand Down

0 comments on commit 3e32558

Please sign in to comment.