[RLlib] Issue 13132: DQN does not update target net after restore #14838

sven1977 · 2021-03-22T13:16:28Z

Issue 13132: DQN does not update target net after restore

Why are these changes needed?

Closes #13132

I've run scripts/format.sh to lint the changes in this PR.
I've included any doc changes needed for https://docs.ray.io/en/master/.
I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
Testing Strategy
- Unit tests
- Release tests
- This PR is not tested :(

sven1977 added 9 commits March 12, 2021 15:27

wip and LINT.

2232968

Merge branch 'master' of https://github.com/ray-project/ray

e9054c5

Merge branch 'master' of https://github.com/ray-project/ray

9e3094b

Merge branch 'master' of https://github.com/ray-project/ray

cee174e

Merge branch 'master' of https://github.com/ray-project/ray

19a56cd

Merge branch 'master' of https://github.com/ray-project/ray

1dd5637

Merge branch 'master' of https://github.com/ray-project/ray

eacb5e6

Merge branch 'master' of https://github.com/ray-project/ray

7fdf222

wip and LINT

c685d94

sven1977 requested a review from michaelzhiluo March 22, 2021 13:16

sven1977 assigned michaelzhiluo Mar 22, 2021

sven1977 mentioned this pull request Mar 22, 2021

[rllib] high temporal difference error after restoring checkpoint - APEX-DQN/Torch #13132

Closed

sven1977 added the tests-ok The tagger certifies test failures are unrelated and assumes personal liability. label Mar 22, 2021

michaelzhiluo approved these changes Mar 23, 2021

View reviewed changes

sven1977 merged commit e7557ae into ray-project:master Mar 23, 2021