lis version 1 for private
C# Python Other
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
images
python-agent
unity-sample-environment
.gitignore
LICENSE.txt
README.md
fetch.sh

README.md

Deep AI(s) in Cute Virtual World

It's output of hack-a-thon of whole brain architecture initiaive(http://wba-initiative.org/).

Participants

  • Takatoshi Nao
  • Masaru Kanai
  • Shogo Naka
  • Keiichiro Miyamoto

ScreenShot and Movie of 3 Agents in the world with Live Viewing System.

screenshot

HackAIVR

Algorithm

screenshot

screenshot

Algorithm Reference

Requirements

  • python 2.7

Install

Ubuntu

Install Unity experimental-build version:

wget http://download.unity3d.com/download_unity/linux/unity-editor-installer-5.3.4f1+20160317.sh
sudo sh unity-editor-installer-5.3.4f1+20160317.sh

# run Unity
./unity-editor-5.3.4f1/Editor/Unity

# if background is pink, install:
sudo apt-get install lib32stdc++6 -y

install python modules:

pip install -r python-agent/requirements.txt

Mac

Install Unity.

install python modules:

pip install -r python-agent/requirements.txt

Windows

Building simulator on Windows10 (Japanese)

Quick Start

download data:

./fetch.sh

Next, run python module as a server.

cd python-agent
python server.py

Open unity-sample-environment with Unity and load Scenes/Sample.

screenshot from 2016-04-06 18 08 31

Press Start Buttn. This will take a few minuts for loading caffe model.

screenshot from 2016-04-06 18 09 36

You can watch reward history:

cd python-agent
python plot_reward_log.py

screenshot

This graph is a "sample" scene result with 1 Agent. It takes about 6 hours on GPU Machine.

Multi Agent

This is supported only SYNC mode. ASYNC mode is not supprted.

Start multi agent server:

cd python-agent
python multi_agent.py --agent-count=2

Next, open unity-sample-environment and load Scenes/SampleMultiAgent.

You can watch reward history:

python plot_reward_log.py --log-file=reward_0.log

System Configuration

  • Client: Unity
  • Server: python module
  • Communication: Socket (WebSocket over TCP) using MessagePack

2016-04-09 4 14 49

Tips

Simulate faster

Select "SceneController" in Hierarchy tab and change "Time Scale".

2016-04-23 15 52 03

This will make simulation more faster, but it will be slow gui response.

Module Reference

  • MessagePack for Unity

    • Copyright (C) 2011-2012 Kazuki Oikawa, Kazunari Kida
    • Apache License, Version 2.0
    • Assets/Packages/msgpack-unity
  • websocket-sharp

    • Copyright (c) 2010-2016 sta.blockhead
    • The MIT License (MIT)
    • Assets/Packages/websocket-sharp