Skip to content
Browse files

Merge pull request #83 from DavoudTaghawiNejad/master

Improved on the documentation of explorers
  • Loading branch information...
2 parents c96e46c + b8c06cf commit a8ae0db137bc05d881b9bca0ef6af9eae3afba45 @rueckstiess rueckstiess committed Aug 4, 2012
Showing with 23 additions and 1 deletion.
  1. +23 −1 pybrain/rl/explorers/explorer.py
View
24 pybrain/rl/explorers/explorer.py
@@ -8,6 +8,28 @@ class Explorer(Module):
""" An Explorer object is used in Agents, receives the current state
and action (from the controller Module) and returns an explorative
action that is executed instead the given action.
+
+ Continous explorer will produce continous action states, discrete
+ once discrete actions accordingly.
+
+ Explorer action episodic?
+ =============================== ========= =========
+ NormalExplorer continous no
+ StateDependentExplorer continous yes
+ BoltzmannExplorer discrete no
+ EpsilonGreedyExplorer discrete no
+ DiscreteStateDependentExplorer discrete yes
+
+
+ Explorer has to be added to the learner before adding the learner
+ to the LearningAgent.
+
+ For Example::
+
+ controller = ActionValueNetwork(2, 100)
+ learner = SARSA()
+ learner.explorer = NormalExplorer(1, 0.1)
+ self.learning_agent = LearningAgent(controller, learner)
"""
def activate(self, state, action):
@@ -20,4 +42,4 @@ def activate(self, state, action):
def newEpisode(self):
""" Inform the explorer about the start of a new episode. """
- pass
+ pass

0 comments on commit a8ae0db

Please sign in to comment.
Something went wrong with that request. Please try again.