Skip to content
VRKitchen: an Interactive 3D Environment for Learning Real Life Cooking Tasks. Visit the project site for more information:
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Type Name Latest commit message Commit time
Failed to load latest commit information.
Binaries initial commit May 31, 2019
data a Jun 1, 2019
log a Jun 1, 2019
.gitignore update dependency Jun 1, 2019 Update Jun 10, 2019
requirements.txt update Jun 1, 2019


VRKitchen is an interactive 3D virtual kitchen environment which provides a platform for training and evaluating various learning and planning algorithms in a variety of cooking tasks. Two kinds of tasks are available:

  1. Tool Use: requires an agent to continuously control its hands to make use of a tool.

    E.g. cutting a carrot into pieces, peeling a kiwi, pouring water from one cup to another.

  2. Preparing dishes: agents must perform a series of atomic actions in the right order to achieve a compositional goal.

    E.g. making fruit juice, beef stew and sandwiches.


  • OS: Ubuntu 16.04
  • Python 2.7.12

Getting Started

  1. Clone the repo and install the requirements.
git clone
pip install -r requirements.txt
  1. Download the zip file and unzip it into the /Binaries folder.
  1. To reproduce the experiment results, run the Script/ (for preparing dishes) and Script/ (for tool use).
python Script/
python Script/

Have fun!


  author    = {Xiaofeng Gao and
               Ran Gong and
               Tianmin Shu and
               Xu Xie and
               Shu Wang and
               Song{-}Chun Zhu},
  title     = {VRKitchen: an Interactive 3D Virtual Environment for Task-oriented
  journal   = {arXiv},
  volume    = {abs/1903.05757},
  year      = {2019},
You can’t perform that action at this time.