Fourroom environment not working

[ruikunl]

When running fourroom environment, there is a bug in the policy_network.py that makes the code crash. The observation returned for the four room environment is an integer, however, for the movement bandit, the return is a vector of current location and two goal locations. In line 49 in the policy_network.py, ob[None] will crash if ob is an integer.

[kvfrans]

Hi, Fourrooms environment wasn't part of the original gym envs, so the observation space is structured differently.

To fix it, change line 30 of master.py to:
ob = U.get_placeholder(name="ob", dtype=tf.float32, shape=[None, 104])