Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The observation in the env #2

Closed
13350068164 opened this issue May 12, 2020 · 2 comments
Closed

The observation in the env #2

13350068164 opened this issue May 12, 2020 · 2 comments
Labels
question Further information is requested

Comments

@13350068164
Copy link

Hello,
I have a question of fetchreach_env.
In fetchreach_env,i don't konw the gripper_vel and gripper_state really mean,because the gripper doesn't need to open or close.Mabye those obs are useful in pickandplace_env.

And I try change obs in fetchreach_env.
Like this :obs = grip_pos.
Just the coordinates of the grip,and exclude the gripper_vel and gripper_state, then I use HER to train a model ,the success rate after 10 epochs is 1.

So, in fetchreach_env do I really need the gripper_vel or gripper_state.
Thank you.

@13350068164
Copy link
Author

I exclude the grip_velp as well,the success rate are the same.
So,how the velocity actually work in the env.

@alirezakazemipour alirezakazemipour added the question Further information is requested label May 12, 2020
@alirezakazemipour
Copy link
Owner

Hello 😃
First of all, since your question is about the physical property of the environment I strongly recommend you to ask it from the mujoco developers here:
https://github.com/openai/mujoco-py
Secondly, take a look at this issue. It's been discussed here:
openai/gym#1503
But at last, if you want my opinion:
I believe since these approaches (such as DDPG) have been innovated in Model-free RL field, so any non-applicable input feature would be ignored by weights of its related neural network.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants