Skip to content

Latest commit

 

History

History
59 lines (58 loc) · 4.8 KB

File metadata and controls

59 lines (58 loc) · 4.8 KB

Gradient-Free-Reinforcement-Learning-solving-Openai-gym-LunarLanderV2-by-Evolution-Strategy

Gradient Free Reinforcement Learning solving Openai gym LunarLanderV2 by Evolution Strategy (Genetic Algorithm)
Pytorch implementation of paper: Evolution Strategies as a Scalable Alternative to Reinforcement Learning https://arxiv.org/abs/1703.03864
required libraries: Pytorch , Numpy , Gym

  • to do: add extra mechanism for radical explorations (not implemented in the original paper)

results:

generation: 0 Average Reward: -538.583251953125 Best reward:-156.47698974609375
generation: 1 Average Reward: -316.5377197265625 Best reward:-63.06631851196289
generation: 2 Average Reward: -215.0087432861328 Best reward:-75.97962188720703
generation: 3 Average Reward: -155.26268005371094 Best reward:-83.45104217529297
generation: 4 Average Reward: -134.10035705566406 Best reward:-23.528057098388672
generation: 5 Average Reward: -146.13290405273438 Best reward:-63.603675842285156
generation: 6 Average Reward: -118.82445526123047 Best reward:-56.470787048339844
generation: 7 Average Reward: -120.94194030761719 Best reward:0.8265160918235779
generation: 8 Average Reward: -124.09735107421875 Best reward:-58.74011993408203
generation: 9 Average Reward: -108.97384643554688 Best reward:-42.318382263183594
generation: 10 Average Reward: -121.54873657226562 Best reward:9.485918998718262
generation: 11 Average Reward: -100.96890258789062 Best reward:-43.67923355102539
generation: 12 Average Reward: -96.7850112915039 Best reward:-8.623652458190918
generation: 13 Average Reward: -91.60845947265625 Best reward:-0.09553898125886917
generation: 14 Average Reward: -90.27456665039062 Best reward:-35.526153564453125
generation: 15 Average Reward: -84.70771789550781 Best reward:-9.827710151672363
generation: 16 Average Reward: -73.10737609863281 Best reward:49.21298599243164
generation: 17 Average Reward: -90.42571258544922 Best reward:2.838597297668457
generation: 18 Average Reward: -66.53604125976562 Best reward:-5.204407691955566
generation: 19 Average Reward: -39.746524810791016 Best reward:78.11090850830078
generation: 20 Average Reward: -15.870380401611328 Best reward:99.40658569335938
generation: 21 Average Reward: 2.8039019107818604 Best reward:188.47122192382812
generation: 22 Average Reward: 37.92600631713867 Best reward:254.58567810058594
generation: 23 Average Reward: 28.925466537475586 Best reward:197.09890747070312
generation: 24 Average Reward: 48.34407043457031 Best reward:247.353515625
generation: 25 Average Reward: 79.406982421875 Best reward:273.5567932128906
generation: 26 Average Reward: 96.988525390625 Best reward:246.77540588378906
generation: 27 Average Reward: 115.12902069091797 Best reward:272.916748046875
generation: 28 Average Reward: 89.48794555664062 Best reward:257.3977355957031
generation: 29 Average Reward: 112.94854736328125 Best reward:272.1145324707031
generation: 30 Average Reward: 120.39783477783203 Best reward:261.2518005371094
generation: 31 Average Reward: 128.7265625 Best reward:272.9747619628906
generation: 32 Average Reward: 119.7573471069336 Best reward:263.0072937011719
generation: 33 Average Reward: 141.4206085205078 Best reward:257.6456604003906
generation: 34 Average Reward: 142.52574157714844 Best reward:256.87066650390625
generation: 35 Average Reward: 154.31227111816406 Best reward:259.0538635253906
generation: 36 Average Reward: 157.88743591308594 Best reward:265.25201416015625
generation: 37 Average Reward: 155.42425537109375 Best reward:270.1329345703125
generation: 38 Average Reward: 179.43057250976562 Best reward:284.30987548828125
generation: 39 Average Reward: 162.57015991210938 Best reward:287.66607666015625
generation: 40 Average Reward: 144.10289001464844 Best reward:268.65216064453125
generation: 41 Average Reward: 184.30714416503906 Best reward:272.1533508300781
generation: 42 Average Reward: 185.44000244140625 Best reward:275.0975036621094
generation: 43 Average Reward: 182.36648559570312 Best reward:267.7082824707031
generation: 44 Average Reward: 174.31451416015625 Best reward:276.5592041015625
generation: 45 Average Reward: 194.7252960205078 Best reward:275.2507629394531
generation: 46 Average Reward: 187.82977294921875 Best reward:279.0582275390625
generation: 47 Average Reward: 183.6601104736328 Best reward:266.5592346191406
generation: 48 Average Reward: 217.5045166015625 Best reward:271.5887145996094
generation: 49 Average Reward: 193.0800018310547 Best reward:277.8978576660156
Average Reward Gym LunarLanderV2