Skip to content

Commit

Permalink
Fix equation of IQL docstring
Browse files Browse the repository at this point in the history
  • Loading branch information
takuseno committed Jun 17, 2023
1 parent 09ade95 commit b11edfa
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion d3rlpy/algos/qlearning/iql.py
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ class IQLConfig(LearnableConfig):
.. math::
L_Q(\theta) = \mathbb{E}_{(s, a, r, a') \sim D}
L_Q(\theta) = \mathbb{E}_{(s, a, r, s') \sim D}
[(r + \gamma V_\psi(s') - Q_\theta(s, a))^2]
Finally, the policy function is trained by using advantage weighted
Expand Down

0 comments on commit b11edfa

Please sign in to comment.