Skip to content
simasan1017 edited this page Sep 16, 2016 · 14 revisions

LIS (Life in Silico) ver2

============= LIS (Life In Silico) is a framework that makes intelligent agents live in a virtual environment.
LIS version 2 uses Unity Game Engine for the virtual environment and OpenAI Gym for the learning agent framework.




Algorithm Reference


  • python 2.7



Install Unity experimental-build version:

sudo sh

# run Unity

# if background is pink, install:
sudo apt-get install lib32stdc++6 -y

install python modules:

pip install -r python-agent/requirements.txt


Install Unity.

install python modules:

pip install -r python-agent/requirements.txt


Building simulator on Windows10 (Japanese)

Quick Start

download data:


Open unity-sample-environment with Unity and load Scenes/Sample.

2016-09-13 10 27 53

Press Start Button.

2016-09-13 10 28 14

Next, run python module as a client.This will take a few minutes for loading caffe model.

cd gym_client/examples/agents
PYTHONPATH=../../ python

You can watch reward history:

cd gym_client/examples/agents

This graph is a "sample" scene result. It takes about 6 hours on GPU Machine.

Sample scene result movie

SampleLikesAndDislikes scene result movie


See the examples directory

  • Run examples/agents/ to run an simple random agent
  • Run examples/agents/ to run an Deep Q-Network agent

System Configuration

  • Client: python module(gym)
  • Server: Unity
  • Communication: Socket (WebSocket over TCP) using MessagePack
2016-04-09 4 14 49


Simulate faster

Select "SceneController" in Hierarchy tab and change "Time Scale".

2016-04-23 15 52 03

This will make simulation more faster, but it will be slow gui response.

Module Reference

  • MessagePack for Unity

  • Copyright (C) 2011-2012 Kazuki Oikawa, Kazunari Kida

  • Apache License, Version 2.0

  • Assets/Packages/msgpack-unity

  • websocket-sharp

  • Copyright (c) 2010-2016 sta.blockhead

  • The MIT License (MIT)

  • Assets/Packages/websocket-sharp

  • websocket-client

  • Copyright (C) 2010 Hiroki Ohtani(liris)

  • LGPL License

  • gym

  • Copyright (c) 2016 OpenAI (

  • The MIT License (MIT)

  • LIS-ver2/gym_client/gym



If you created intelligent agents, please let me know about it to "". We will make showcase varied intelligent agents.

You can’t perform that action at this time.