Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AWAC implementation #115

Merged
merged 17 commits into from
Aug 10, 2020
Merged

Conversation

anair13
Copy link
Contributor

@anair13 anair13 commented Aug 8, 2020

Everything is running now, but still testing AWAC and skewfit as a regression test.

Copy link
Collaborator

@vitchyr vitchyr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Just some minor comments (e.g. it'd also be nice to delete some of the commented-out code)

rlkit/envs/wrappers/proxy_env.py Outdated Show resolved Hide resolved
rlkit/demos/spacemouse/input_server.py Outdated Show resolved Hide resolved
rlkit/samplers/util.py Outdated Show resolved Hide resolved
rlkit/torch/networks/ae_tanh_policy.py Outdated Show resolved Hide resolved
from rlkit.torch.pytorch_util import activation_from_string


class CNN(PyTorchModule):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

btw, are you still using this? it could be nice to only use BasicCNN

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's in a few imports but I am not really using this in recent code. The only file that does seem to use that might be a bit annoying to address is ConvVAE (because a lot of other code uses it). So I think deleting this is best deferred to later?

rlkit/torch/networks/deprecated_feedforward.py Outdated Show resolved Hide resolved
rlkit/torch/networks/experimental.py Outdated Show resolved Hide resolved
@vitchyr
Copy link
Collaborator

vitchyr commented Aug 9, 2020

Also, there's a bunch of files here that we could probably delete since we never use

@anair13
Copy link
Contributor Author

anair13 commented Aug 9, 2020

Here are the results of this branch on AWAC, SkewFit, and SAC: https://drive.google.com/file/d/1Qy5SYIGNwdeTHAGNjbRfuP5pSiRw8JzJ/view?usp=sharing

I went through and did some more cleanup as well. I think this is ready to merge now.

@vitchyr vitchyr merged commit 1bfe7d9 into rail-berkeley:master Aug 10, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants