Skip to content
Tensorflow is not only an well designed deep learning toolbox, but also a standard symbolic programming framework. In this repository, we show how to use tensorflow to do classical planning task on deterministic, continous action, continous space problems.
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.ipynb_checkpoints
DATA
DEEP_LEARNED_PLANNING
HARD_CODED_DOMAINS Adding plots Feb 19, 2017
HISTORICAL_EXPERIMENT_RECORDS
HVAC_PLOT_SOURCE
PDDL+ AND ENSHP
PLOTS
PURE_PYTHON_CODE
VIZ
WEIGHTS_FOLDER
POSTER.pdf
Readme.md

Readme.md

Tensorflow Coding Examples

Author

GA WU, PhD candidate, University of Toronto.

Tensorflow Version

This code was written in Tensorflow beta version 0.12c. If you need to run it in Tensorflow 1.3 or later version. Please see the PURE_PYTHON_CODE

Introduction

Tensorflow is not only an well designed deep learning toolbox, but also a standard symbolic programming framework. In this repository, we show how to use tensorflow to do classical planning task on deterministic, continous action, continous space problems. Our investigation has two phrases.

  1. We first parse domains that descripted by standard domain description language into Tensorflow, and directly do planning on the hard coded domains. The domain description language can be: PDDL, PDDL2 and RDDL. We think RDDL has much powerful expressive ability, so in the code, if there is no specific description, we use RDDL.
  2. Because of the ability of learning arbitrary function, neural network can learn the transition function and reward function directly from observed data. We then investigate the ability to learn the model and do planning on learned, approximated model to solve real problem

What is in the repository

This repository contains following implementations

  1. Hard coded domains: There are three hard coded domains in the HARD_CODED_DOMAINS folder.
  2. Deep learned model: We provide a framework DEEP_LEARNED_PLANNING based on Tensorflow rnn cell that allows to learn and plan through sampled data. (This code is re-wroten in another repository, see below)
  3. Visualization functions:VIZ Show the behavious of result from planner.

Planning With Neural Network Trained Transition Function

Because the tensorflow upgrade recent days, the old method to customize RNN cell has been deprecated. We re-wrote the tensorflow planner for trained transition function in the following repository. Please please directly copy the command in repository to test its functionality.

TensorFlow Planner for Trained Transition Function

You can’t perform that action at this time.