Does this implementation work with real-time environments that lag such as VNC environments from universe?

[ethancaballero]

Have you tested this implementation on any Universe environments that lag due to the VNC?
The original one had a separate thread used for collecting experience that runs in parallel to optimization (I guess to make up for the lag?):
openai/universe-starter-agent#36 (comment)

Does this one have a separate thread used for collecting experience that runs in parallel to optimization?

[ikostrikov]

No, I tested only on the standard environments. And the moment it doesn't collect experience in a separate thread.