Skip to content

Conversation

@ervteng
Copy link
Contributor

@ervteng ervteng commented Jul 26, 2019

  • Change to reward signals
  • Step count for multiple environments

@ervteng ervteng requested review from harperj and xiaomaogy July 26, 2019 20:51
#### Steps to Migrate
* If you were overriding any of these following parameters in your config file, remove them
from the top-level config and follow the steps below:
* `gamma` - Define a new `extrinsic` reward signal and set it's `gamma` to your new gamma.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* `gamma` - Define a new `extrinsic` reward signal and set it's `gamma` to your new gamma.
* `gamma` - Define a new `extrinsic` reward signal and set its `gamma` to your new gamma.


### Important Changes
* We have changed the way reward signals (including Curiosity) are defined in the
`trainer_config.yaml`.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe instead of saying "it has changed in the trainer_config.yaml" (which is one of the yaml file that doesn't have any gail configured), say something like "we have changed the way reward signals (..) are defined in the configuration file, you can refer to gail_config.yaml as an example".

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please ignore my previous comment. I just realized that this isn't explaining anything regarding the new features, just how to migrate from using the old features.

@ervteng ervteng merged commit 4279620 into release-0.9.0 Jul 29, 2019
@ervteng ervteng deleted the release-0.9.0-migrating branch July 30, 2019 20:37
@github-actions github-actions bot locked as resolved and limited conversation to collaborators May 18, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants