Implement supervised behavioral cloning training loop #8
Comments
Merged
Merged
cswinter
added a commit
that referenced
this issue
Feb 22, 2022
Adds a new `supervised.py` script to enn-ppo which trains a model from samples recorded by another policy. Also makes various improvements to the sample recorder: - add `--eval-capture-samples`/`--eval-capture-logits` options to record samples/logits during eval to a file - add `--eval-on-step-0` arg to enable/disable running eval on the first step - add `--codecraft-only-opponent` to run an eval with only a loaded eval policy against itself (this is slightly hacky, I'm planning to remove all the CodeCraft-specific options later) - include action and observation spaces when recording samples - fix `RaggedBufferBool` getting deserialized to `None` - misc fixes to the `SampleRecorder` and `Trace` Resolves #5, #6, and #8.
cswinter
added a commit
to entity-neural-network/entity-gym
that referenced
this issue
May 11, 2022
Adds a new `supervised.py` script to enn-ppo which trains a model from samples recorded by another policy. Also makes various improvements to the sample recorder: - add `--eval-capture-samples`/`--eval-capture-logits` options to record samples/logits during eval to a file - add `--eval-on-step-0` arg to enable/disable running eval on the first step - add `--codecraft-only-opponent` to run an eval with only a loaded eval policy against itself (this is slightly hacky, I'm planning to remove all the CodeCraft-specific options later) - include action and observation spaces when recording samples - fix `RaggedBufferBool` getting deserialized to `None` - misc fixes to the `SampleRecorder` and `Trace` Resolves entity-neural-network/incubator#5, entity-neural-network/incubator#6, and entity-neural-network/incubator#8.
cswinter
added a commit
to entity-neural-network/rogue-net
that referenced
this issue
May 11, 2022
Adds a new `supervised.py` script to enn-ppo which trains a model from samples recorded by another policy. Also makes various improvements to the sample recorder: - add `--eval-capture-samples`/`--eval-capture-logits` options to record samples/logits during eval to a file - add `--eval-on-step-0` arg to enable/disable running eval on the first step - add `--codecraft-only-opponent` to run an eval with only a loaded eval policy against itself (this is slightly hacky, I'm planning to remove all the CodeCraft-specific options later) - include action and observation spaces when recording samples - fix `RaggedBufferBool` getting deserialized to `None` - misc fixes to the `SampleRecorder` and `Trace` Resolves entity-neural-network/incubator#5, entity-neural-network/incubator#6, and entity-neural-network/incubator#8.
cswinter
added a commit
to entity-neural-network/enn-trainer
that referenced
this issue
May 12, 2022
Adds a new `supervised.py` script to enn-ppo which trains a model from samples recorded by another policy. Also makes various improvements to the sample recorder: - add `--eval-capture-samples`/`--eval-capture-logits` options to record samples/logits during eval to a file - add `--eval-on-step-0` arg to enable/disable running eval on the first step - add `--codecraft-only-opponent` to run an eval with only a loaded eval policy against itself (this is slightly hacky, I'm planning to remove all the CodeCraft-specific options later) - include action and observation spaces when recording samples - fix `RaggedBufferBool` getting deserialized to `None` - misc fixes to the `SampleRecorder` and `Trace` Resolves entity-neural-network/incubator#5, entity-neural-network/incubator#6, and entity-neural-network/incubator#8.
cswinter
added a commit
to entity-neural-network/enn-zoo
that referenced
this issue
May 14, 2022
Adds a new `supervised.py` script to enn-ppo which trains a model from samples recorded by another policy. Also makes various improvements to the sample recorder: - add `--eval-capture-samples`/`--eval-capture-logits` options to record samples/logits during eval to a file - add `--eval-on-step-0` arg to enable/disable running eval on the first step - add `--codecraft-only-opponent` to run an eval with only a loaded eval policy against itself (this is slightly hacky, I'm planning to remove all the CodeCraft-specific options later) - include action and observation spaces when recording samples - fix `RaggedBufferBool` getting deserialized to `None` - misc fixes to the `SampleRecorder` and `Trace` Resolves entity-neural-network/incubator#5, entity-neural-network/incubator#6, and entity-neural-network/incubator#8.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
No description provided.
The text was updated successfully, but these errors were encountered: