Skip to content

Commit

Permalink
THeory section added to tuts
Browse files Browse the repository at this point in the history
  • Loading branch information
jan authored and jan committed Apr 22, 2017
1 parent 6297f44 commit af7dd26
Show file tree
Hide file tree
Showing 4 changed files with 42 additions and 4 deletions.
7 changes: 6 additions & 1 deletion docs/tutorials/Binary_RBM_MNIST_small.rst
Original file line number Diff line number Diff line change
Expand Up @@ -4,9 +4,14 @@ Small centered/normal binary RBM on MNIST
Example for training a centered and normal Binary Restricted Boltzmann machine on the MNIST handwritten digit dataset and the flipped version.
The model is small enough to calculate the exact Log-Likelihood and annealed importance sampling and reverse annealed importance sampling are evaluated.

Theory
***********

For an analysis of advantage of centering in RBMs see `How to Center Deep Boltzmann Machines. Melchior, J., Fischer, A., & Wiskott, L.. (2016). Journal of Machine Learning Research, 17(99), 1–61. <http://jmlr.org/papers/v17/14-237.html>`_

If you are new on RBMs, a good theoretical introduction is given by `Course Material ICA <https://www.ini.rub.de/PEOPLE/wiskott/Teaching/Material/index.html>`_ and in the following video.
If you are new on RBMs, have a look into my `master's theses <https://www.ini.rub.de/PEOPLE/wiskott/Reprints/Melchior-2012-MasterThesis-RBMs.pdf>`_

A good theoretical introduction is also given by `Course Material RBMs <https://www.ini.rub.de/PEOPLE/wiskott/Teaching/Material/index.html>`_ and in the following video.

.. raw:: html

Expand Down
21 changes: 20 additions & 1 deletion docs/tutorials/ICA_natural_images.rst
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,26 @@ Independent Component Analysis on a natural image patches
Example for Independent Component Analysis (`ICA <https://en.wikipedia.org/wiki/Principal_component_analysis>`_)
on natural image patches. The independent components (columns of the ICA projection matrix) of natural image patches are edge detector filters.

See `ICA_2D_example <ICA_2D_example.html#ICA_2D_example>`__ for a theoretical introduction.
Theory
***********

If you are new on ICA and blind source separation, a good theoretical introduction is given by `Course Material ICA <https://www.ini.rub.de/PEOPLE/wiskott/Teaching/Material/index.html>`_ and in the following videos.

.. raw:: html

<div style="margin-top:10px;">
<iframe width="560" height="315" src="http://www.youtube.com/embed/3eWuUWODE4o" frameborder="0" allowfullscreen></iframe>
</div>

and the follow up video introduces to ICA.

.. raw:: html

<div style="margin-top:10px;">
<iframe width="560" height="315" src="http://www.youtube.com/embed/ugiMhRbFnTo" frameborder="0" allowfullscreen></iframe>
</div>

See also `ICA_2D_example <ICA_2D_example.html#ICA_2D_example>`__ first.

Results
***********
Expand Down
5 changes: 4 additions & 1 deletion docs/tutorials/PCA_2D_example.rst
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,10 @@ Principal Component Analysis 2D example.
Example for Principal Component Analysis (`PCA <https://en.wikipedia.org/wiki/Principal_component_analysis>`_) on a linear 2D mixture.


If you are new on PCA, a good theoretical introduction is given by `Course Material ICA <https://www.ini.rub.de/PEOPLE/wiskott/Teaching/Material/index.html>`_ and in the following videos.
Theory
***********

If you are new on PCA, a good theoretical introduction is given by `Course Material PCA <https://www.ini.rub.de/PEOPLE/wiskott/Teaching/Material/index.html>`_ and in the following videos.

.. raw:: html

Expand Down
13 changes: 12 additions & 1 deletion docs/tutorials/PCA_eigenfaces.rst
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,18 @@ Eigenfaces

Example for Principal Component Analysis (PCA) on face images also known as `Eigenfaces <https://en.wikipedia.org/wiki/Eigenface>`_

See `PCA_2D_example <PCA_2D_example.html#PCA_2D_example>`__ for a theoretical introduction.
Theory
***********

If you are new on PCA, a good theoretical introduction is given by `Course Material PCA <https://www.ini.rub.de/PEOPLE/wiskott/Teaching/Material/index.html>`_ and in the following videos.

.. raw:: html

<div style="margin-top:10px;">
<iframe width="560" height="315" src="http://www.youtube.com/embed/9H-1FH1gn6w" frameborder="0" allowfullscreen></iframe>
</div>

See also `PCA_2D_example <PCA_2D_example.html#PCA_2D_example>`__ first.

Results
***********
Expand Down

0 comments on commit af7dd26

Please sign in to comment.