Skip to content
lis version 1 for private
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
images
python-agent
unity-sample-environment
.gitignore
LICENSE.txt
README.md
fetch.sh

README.md

Deep AI(s) in Cute Virtual World

It's output of hack-a-thon of whole brain architecture initiaive(http://wba-initiative.org/).

Participants

  • Takatoshi Nao
  • Masaru Kanai
  • Shogo Naka
  • Keiichiro Miyamoto

ScreenShot and Movie of 3 Agents in the world with Live Viewing System.

screenshot

<iframe width="560" height="315" src="https://www.youtube.com/embed/pJ6V5KZPgLA" frameborder="0" allowfullscreen></iframe> [![HackAIVR](http://img.youtube.com/vi/pJ6V5KZPgLA/0.jpg)](http://www.youtube.com/watch?v=pJ6V5KZPgLA)

Algorithm

screenshot

screenshot

Algorithm Reference

Requirements

  • python 2.7

Install

Ubuntu

Install Unity experimental-build version:

wget http://download.unity3d.com/download_unity/linux/unity-editor-installer-5.3.4f1+20160317.sh
sudo sh unity-editor-installer-5.3.4f1+20160317.sh

# run Unity
./unity-editor-5.3.4f1/Editor/Unity

# if background is pink, install:
sudo apt-get install lib32stdc++6 -y

install python modules:

pip install -r python-agent/requirements.txt

Mac

Install Unity.

install python modules:

pip install -r python-agent/requirements.txt

Windows

Building simulator on Windows10 (Japanese)

Quick Start

download data:

./fetch.sh

Next, run python module as a server.

cd python-agent
python server.py

Open unity-sample-environment with Unity and load Scenes/Sample.

screenshot from 2016-04-06 18 08 31

Press Start Buttn. This will take a few minuts for loading caffe model.

screenshot from 2016-04-06 18 09 36

You can watch reward history:

cd python-agent
python plot_reward_log.py

screenshot

This graph is a "sample" scene result with 1 Agent. It takes about 6 hours on GPU Machine.

Multi Agent

This is supported only SYNC mode. ASYNC mode is not supprted.

Start multi agent server:

cd python-agent
python multi_agent.py --agent-count=2

Next, open unity-sample-environment and load Scenes/SampleMultiAgent.

You can watch reward history:

python plot_reward_log.py --log-file=reward_0.log

System Configuration

  • Client: Unity
  • Server: python module
  • Communication: Socket (WebSocket over TCP) using MessagePack

2016-04-09 4 14 49

Tips

Simulate faster

Select "SceneController" in Hierarchy tab and change "Time Scale".

2016-04-23 15 52 03

This will make simulation more faster, but it will be slow gui response.

Module Reference

  • MessagePack for Unity

  • Copyright (C) 2011-2012 Kazuki Oikawa, Kazunari Kida

  • Apache License, Version 2.0

  • Assets/Packages/msgpack-unity

  • websocket-sharp

  • Copyright (c) 2010-2016 sta.blockhead

  • The MIT License (MIT)

  • Assets/Packages/websocket-sharp

You can’t perform that action at this time.