Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How should I get the expert data? #2

Open
nishizawa7276 opened this issue Jul 2, 2020 · 1 comment
Open

How should I get the expert data? #2

nishizawa7276 opened this issue Jul 2, 2020 · 1 comment

Comments

@nishizawa7276
Copy link

I think I can't start learning because there is no expert data.
However, I do not know how to create expert data.
Please teach me how to create expert data.

@zbzhu99
Copy link

zbzhu99 commented Aug 14, 2020

The path to putting the expert data and the format of expert data are mentioned in README:

Expert trajectories
Please update the path to expert trajectories in the file "code/conf/envParams.yaml". Also see the storage requirements in "code/expert_envs.py" and modify as per convenience.

I think you can write some rule policy or train an expert policy with forward RL algos and use these policies to roll out in the envs and store the observations and actions with pickle. Maybe you can refer to expert data generation part in stable-baselines GAIL.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants