Skip to content
Permalink
Browse files

Version 3.0.6

  • Loading branch information
smsong committed Aug 9, 2019
1 parent 560cfd3 commit 55db058307cb60ffdc9852350f912e4bb317c411
Showing with 4 additions and 3 deletions.
  1. +3 −2 osim/env/osim.py
  2. +1 −1 setup.py
@@ -794,8 +794,9 @@ def get_reward_1(self):
# success bonus
if not self.is_done() and (self.osim_model.istep >= self.spec.timestep_limit): #and self.failure_mode is 'success':
# retrieve reward (i.e. do not penalize for the simulation terminating in a middle of a step)
reward_footstep_0 = self.d_reward['weight']['footstep']*self.d_reward['footstep']['del_t']
reward += reward_footstep_0 + 100
#reward_footstep_0 = self.d_reward['weight']['footstep']*self.d_reward['footstep']['del_t']
#reward += reward_footstep_0 + 100
reward += 10

return reward

@@ -7,7 +7,7 @@

# This provides the variable `__version__`.
# execfile('opensim/version.py')
__version__ = "3.0.5"
__version__ = "3.0.6"

setup(name='osim-rl',
version=__version__,

1 comment on commit 55db058

@smsong

This comment has been minimized.

Copy link
Collaborator Author

@smsong smsong commented on 55db058 Aug 9, 2019

Quick fix of a bug in success bonus. One could have a large reward by not taking a step.

  • there may be a better way to handle the last (incompleted) step of the simulation...
Please sign in to comment.
You can’t perform that action at this time.