Skip to content

Commit

Permalink
added more theory to regression page (#118)
Browse files Browse the repository at this point in the history
* added content for regression
* completed regression theory
  • Loading branch information
sbalan7 committed Apr 18, 2021
1 parent 6c02c0f commit 30302d6
Showing 1 changed file with 10 additions and 7 deletions.
17 changes: 10 additions & 7 deletions docs/regression_algos.rst
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,11 @@ Regression Algorithms
Ordinary Least Squares
======================

Be the first to `contribute! <https://github.com/bfortuner/ml-cheatsheet>`__
OLS is the method with which linear regression is performed. The square of the difference from the mean is taken for every data point, and the summed loss function is to be minimized.

.. math::
l = \sum_{i=1}^n (y_i - \bar{y})^2
Polynomial
Expand Down Expand Up @@ -43,17 +47,16 @@ Ridge regression is similar to lasso regression, but the regularization term use
l = \sum_{i=1}^n (y_i - \tilde{y})^2 + \alpha \sum_{j=1}^p w^2_j
Splines
=======

Be the first to `contribute! <https://github.com/bfortuner/ml-cheatsheet>`__

Stepwise
========

Be the first to `contribute! <https://github.com/bfortuner/ml-cheatsheet>`__
Stepwise regression or spline regression helps us fit a piece wise function to the data. It is usually used with linear models, but it can be generalized to higher degrees as well. The regression equation takes the form of

.. math::
y = ax + b(x-\bar{x})H_{\alpha}+c
where :math:`H_{\alpha}` is the shifted Heaviside step function, having its discontinuity at :math:`\alpha`.


.. rubric:: References
Expand Down

0 comments on commit 30302d6

Please sign in to comment.