Skip to content

Commit

Permalink
Update docs
Browse files Browse the repository at this point in the history
  • Loading branch information
zuoxingdong committed Sep 4, 2018
1 parent cc8a34a commit b556ea8
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions lagom/runner/transition.py
Original file line number Diff line number Diff line change
Expand Up @@ -52,12 +52,12 @@ def V_s(self):
def V_s_next(self):
r"""Return the state value for the next state, i.e. :attr:`s_next`
Note that we do not set zero value for terminal state, because this function
often returns the Tensor dtype, used for backprop.
.. note::
Please be careful when using returned values in later phase !
Often it returns as Tensor dtype, it can be useful for backprop to train
value function. However, be cautious of handling the raw value e.g. zero
value should be replaced when the next state is terminal state.
"""
# TODO: it might be memory costly to have V_s_next in each transition.
return self.info['V_s_next']

def __repr__(self):
Expand Down

0 comments on commit b556ea8

Please sign in to comment.