simasan1017 edited this page Sep 16, 2016 · 14 revisions

LIS (Life in Silico) ver2

============= LIS (Life In Silico) is a framework that makes intelligent agents live in a virtual environment.
LIS version 2 uses Unity Game Engine for the virtual environment and OpenAI Gym for the learning agent framework.




Algorithm Reference


  • python 2.7



Install Unity experimental-build version:

sudo sh

# run Unity

# if background is pink, install:
sudo apt-get install lib32stdc++6 -y

install python modules:

pip install -r python-agent/requirements.txt


Install Unity.

install python modules:

pip install -r python-agent/requirements.txt


Building simulator on Windows10 (Japanese)

Quick Start

download data:


Open unity-sample-environment with Unity and load Scenes/Sample.

2016-09-13 10 27 53

Press Start Button.

2016-09-13 10 28 14

Next, run python module as a client.This will take a few minutes for loading caffe model.

cd gym_client/examples/agents
PYTHONPATH=../../ python

You can watch reward history:

cd gym_client/examples/agents

This graph is a "sample" scene result. It takes about 6 hours on GPU Machine.

Sample scene result movie

SampleLikesAndDislikes scene result movie


See the examples directory

  • Run examples/agents/ to run an simple random agent
  • Run examples/agents/ to run an Deep Q-Network agent

System Configuration

  • Client: python module(gym)
  • Server: Unity
  • Communication: Socket (WebSocket over TCP) using MessagePack
2016-04-09 4 14 49


Simulate faster

Select "SceneController" in Hierarchy tab and change "Time Scale".

2016-04-23 15 52 03

This will make simulation more faster, but it will be slow gui response.

Module Reference

  • MessagePack for Unity

  • Copyright (C) 2011-2012 Kazuki Oikawa, Kazunari Kida

  • Apache License, Version 2.0

  • Assets/Packages/msgpack-unity

  • websocket-sharp

  • Copyright (c) 2010-2016 sta.blockhead

  • The MIT License (MIT)

  • Assets/Packages/websocket-sharp

  • websocket-client

  • Copyright (C) 2010 Hiroki Ohtani(liris)

  • LGPL License

  • gym

  • Copyright (c) 2016 OpenAI (

  • The MIT License (MIT)

  • LIS-ver2/gym_client/gym



If you created intelligent agents, please let me know about it to "". We will make showcase varied intelligent agents.

You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.
Press h to open a hovercard with more details.