New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

7.4 DQN 算法反向传播有没有进行求导？？ #64

Open

anranyicheng opened this issue Oct 31, 2023 · 1 comment

anranyicheng commented Oct 31, 2023

在这个章节的代码中，

dqn_loss.backward()  # 反向传播更新参数

我想知道，这里会不会进行对隐藏层使用ReLU激活函数进行求导？

anranyicheng changed the title ~~7.4 DQN 算法反向传播是有没有求导？？~~ 7.4 DQN 算法反向传播有没有进行求导？？

yingxiaolu commented Nov 28, 2023

在这个章节的代码中，
dqn_loss.backward()  # 反向传播更新参数
我想知道，这里会不会进行对隐藏层使用ReLU激活函数进行求导？

我记得网络是有计算图的, backward过程每个节点都会被求导。激活函数不参与求导过程

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment