fix demo fit_a_line #410
fix demo fit_a_line #410
Conversation
| input=x, | ||
| size=1, | ||
| act=paddle.activation.Linear(), | ||
| param_attr=paddle.attr.Param(learning_rate=1e-3)) |
There was a problem hiding this comment.
bias_attr also need to set. Anyway, this is due to the incorrect convertion from old optimizer configuration to new optimizer configuration of paddle.
There was a problem hiding this comment.
got it, thanks @typhoonzero. will check and update later.
There was a problem hiding this comment.
this is due to the incorrect convertion from old optimizer configuration to new optimizer configuration of paddle.
@typhoonzero Can you create a issue with a link indicating the line number which have the problem? This could provide better documentation so that in case in the future we run into it again, we can look at the issue and know what happened. Thanks!
There was a problem hiding this comment.
@helinwang Sure! I added: PaddlePaddle/Paddle#5005 .
fixing #409
with original fc config, the default learning rate will lead to gradient explosion. fixed by adding learning_rate=1e-3