Nit: fix logarithm operation

[agentydragon]

Currently "log pi_theta" is rendered as if "log" was a multiplication of l * o * g:

[github-actions]

Preview

Preview and run these notebook edits with Google Colab:

• site/en/tutorials/reinforcement_learning/actor_critic.ipynb

Rendered notebook diffs available on ReviewNB.com.

Format and style

Use the TensorFlow docs notebook tools to format for consistent source diffs and lint for style:

$ python3 -m pip install -U --user git+https://github.com/tensorflow/docs

$ python3 -m tensorflow_docs.tools.nbfmt notebook.ipynb

$ python3 -m tensorflow_docs.tools.nblint --arg=repo:tensorflow/docs notebook.ipynb

If commits are added to the pull request, synchronize your local branch: git pull origin patch-1

[8bitmp3]

Thanks @agentydragon

In Markdown, this would be:

$$L_{actor} = -\sum^{T}_{t=1} \log\pi_{\theta}(a_{t} | s_{t})[G(s_{t}, a_{t})  - V^{\pi}_{\theta}(s_{t})]$$

which should render as:

LGTM

[8bitmp3]

The notation remains similar to steps 3-4 on slide 13 http://rail.eecs.berkeley.edu/deeprlcourse-fa17/f17docs/lecture_5_actor_critic_pdf