Skip to content

Commit

Permalink
Merge pull request #12603 from jbushago:patch-1
Browse files Browse the repository at this point in the history
PiperOrigin-RevId: 478068347
  • Loading branch information
jax authors committed Sep 30, 2022
2 parents ea77c45 + 2038988 commit ec41de2
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/faq.rst
Original file line number Diff line number Diff line change
Expand Up @@ -733,7 +733,7 @@ Similarly, for all values of ``x`` less than zero, the output is zero.
Perturbing ``x`` does not change this output, so the gradient is zero.
That leaves us with the tricky case of ``x=0``. Surely, if you perturb ``x`` upward,
it will change the output, but this is problematic: an infinitesimal change in ``x``
produces a finite change inthe function value, which implies the gradient is
produces a finite change in the function value, which implies the gradient is
undefined.
Fortunately, there's another way for us to measure the gradient in this case: we
perturb the function downward, in which case the output does not change, and so the
Expand Down

0 comments on commit ec41de2

Please sign in to comment.