Running the code

[atgambardella]

For anyone struggling to run the code:

1. Set floatX=float64 in your Theano Flags
2. The code as it is right now only works on a cluster. If you want to run individual experiments instead of doing phase1_train, do something like:

for x, y in zip(cmd_templates, argdicts):
    print(x.format(**y))

and then pick the commands you want and run them individually. In step2_eval, write something like:

if not os.path.exists(checkptfile):
    nonexistent_checkptfiles.append(checkptfile)
else:
    evals_to_do.append((task, alg, num_trajs, run, checkptfile))

instead of the assertion that would prevent you from running only some of the experiments.
3) I had to disable multithreading. If you run into these issues you can set the number of threads to 1 where you find it.
4) Some things are set up only for the humanoid environment in mujoco. For instance, if you are using a different environment, in environments/rlgymenv.py, track_body_name should be set to None and there is no sim.env.viewer -- use other methods like sim.env.render() if you want to view things.

[DanielTakeshi]

Thanks @atgambardella
I expanded upon your comments in this blog post. Hopefully this clarifies to people how to use the code.

[atgambardella]

@DanielTakeshi Just read your blogpost -- for me I think I had to disable multithreading because I was running it on a mac. And as for the pytables thing, that pull request would break python2 support, so it might not make sense to merge it