VirtualHome-AIST

This is an extended VirtualHome based on VirtualHome v2.2 with some additional functions.

For more information about original VirtualHome v2.2, please see here.

What is New

• We added actions that can be executed in the Unity simulator. That is, many motions not supported by the original VirtualHome can now be executed.
• Several new cameras and three new camera modes have been added.
• It is now possible to output JSON data in frame-by-frame.
• The 2D bounding boxes of objects can now be output.
• A convenient jupyter notebook is provided to run a large number of simulations based on the script data and save the results.

How to use

Download Unity Simulator

Download the VirtualHome UnitySimulator executable and move it under simulation/unity_simulator.

• Download

Test simulator

To test the simulator in a local machine, double click the executable.

Generating Videos and JSON data

To use the functions added by VirtualHome-AIST, please see here.

• VH Execution Notebooks

VirtualHome2KG

A framework to convert VirtualHome execution results into knowledge graphs.

For more information, please visit here.

Datasets

Datasets created using VirtualHome-AIST and VirtualHome2KG are available here.

Visualization

A visualization tool was developed to simultaneously check the generated videos and corresponding knowledge graphs.

• https://github.com/aistairc/virtualhome2kg_visualization

VirtualHome-AIST Unity Source Code

Please visit here.