Skip to content

Commit

Permalink
first yadll commit
Browse files Browse the repository at this point in the history
  • Loading branch information
pchavanne committed Jun 20, 2016
1 parent a8717e1 commit 6571cc0
Show file tree
Hide file tree
Showing 2 changed files with 14 additions and 5 deletions.
7 changes: 4 additions & 3 deletions yadll/activation.py
Original file line number Diff line number Diff line change
Expand Up @@ -131,9 +131,10 @@ def relu(x, alpha=0):
References
----------
.. [1] Xavier Glorot, Antoine Bordes and Yoshua Bengio (2011).
Deep sparse rectifier neural networks. AISTATS.
http://jmlr.org/proceedings/papers/v15/glorot11a/glorot11a.pdf
.. [1] Xavier Glorot, Antoine Bordes and Yoshua Bengio (2011):
Deep sparse rectifier neural networks. AISTATS.
http://jmlr.org/proceedings/papers/v15/glorot11a/glorot11a.pdf
"""
return T.nnet.relu(x, alpha)

Expand Down
12 changes: 10 additions & 2 deletions yadll/hyperparameters.py
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,11 @@

class Hyperparameters(object):
"""
Define hyperparameters with a default value
and optionaly a list of possible values.
Container class for the hyperparameters.
Define each parameters with a name and a default value and optionally
a list of values that will be iterated over during a grid search.
It create an iterable of all the different parameters values combination.
Parameters
----------
Expand All @@ -16,6 +19,11 @@ class Hyperparameters(object):
range : `list` of `float`
A list of values iterated over during the gris search
Methods
-------
reset
reset all hyperparameters to default values.
Examples
--------
Define the hyperparameters of the model:
Expand Down

0 comments on commit 6571cc0

Please sign in to comment.