Why don't you use two networks for stabilization?

[Fjoelsak]

Hi,

I thought DQN would be tricky regarding convergence and that you more or less need the fixed q-targets and experience replay as workaround. However, looking at your code I see a replay buffer but you use the same network for action choice online and adjusting the one-step lookahead update of your q-values. Is there any reason for that?