Skip to content

Tools for replaying sequences of actions on an MDP

License

Notifications You must be signed in to change notification settings

sisl/POMDPPlayback.jl

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

POMDPPlayback.jl

Build Status Coverage Status codecov

This package defines a policy for rolling out a pre-defined sequence of actions to an MDP or POMDP defined with the POMDPs.jl package.

Usage

A PlaybackPolicy can be constructed in two ways:

  1. PlaybackPolicy(actions, backup_policy::Policy) - where actions is a sequence of actions to output and backup_policy is the policy used if the MDP has not terminated by the time all the prescribed actions have been used.
  2. PlaybackPolicy(actions, logpdfs::Vector{Float64}, backup_policy::Policy) - The only difference for this constructor is the ability to specify the log-probability of the prescribed actions as logpdfs. Use this in combination with algorithms that require the probability of actions.

Once defined, get an action using POMDPs.action(p::PlaybackPolicy, s)

Maintained by Anthony Corso (acorso@stanford.edu)

About

Tools for replaying sequences of actions on an MDP

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages