Backport #1791

[ahtsan]

No description provided.

[ahtsan]

Close #1831

[codecov]

Codecov Report

Merging #1847 into release-2019.10 will decrease coverage by 0.14%.
The diff coverage is 50.00%.

@@                 Coverage Diff                 @@
##           release-2019.10    #1847      +/-   ##
===================================================
- Coverage            85.63%   85.48%   -0.15%     
===================================================
  Files                  155      155              
  Lines                 7489     7503      +14     
  Branches               928      928              
===================================================
+ Hits                  6413     6414       +1     
- Misses                 896      907      +11     
- Partials               180      182       +2     

Impacted Files	Coverage Δ
...c/garage/tf/policies/discrete_qf_derived_policy.py	81.81% <50.00%> (-14.85%)	⬇️
src/garage/envs/grid_world_env.py	84.12% <0.00%> (-4.77%)	⬇️
src/garage/misc/tensor_utils.py	88.23% <0.00%> (-2.36%)	⬇️
src/garage/experiment/experiment_wrapper.py	84.73% <0.00%> (-0.77%)	⬇️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 411f657...4efdb92. Read the comment docs.