Domains

The toolbox has several built-in problem domains which can be obtained using a CMDPInstanceGenerator or CPOMDPInstanceGenerator in the domains package. Each domain provides a function getInstance(int numAgents, int numDecisions) which returns a CMDPInstance or CPOMDPInstance with the given number of agents and decisions. This instance also defines the resource limits which impose constraints on the behavior of the agents.

Problem instances

describe notion of problem instance in the code

Domain descriptions

Several domains have been integrated in the toolbox already. A brief description of the domains is provided below, including references to the literature which either uses or describes the domain.

Online advertising

todo

Grid world

todo

Thermostatically Controlled Loads (TCL)

todo

WebAd

todo

Condition-based maintenance

todo

Define your own domain

explain how new domain can be used