Linear regression
models are used to show or predict the relationship between two variables or factors. There are 2 types of Linear Regressions.
- Single Linear Regression
(singleindependent
variable (input) and a correspondingdependent
variable (output)) - Multiple Linear Regression
(one continuousdependent
variable and two or moreindependent
variables)
Single Linear Regression
attempts to find the relationship between a single independent variable (input) and a corresponding dependent variable (output). This can be expressed in the form of a straight line.
Multiple Linear Regression
attempts to model the relationship between two or more features and a response by fitting a linear equation to observed data. The steps to perform multiple linear Regression
are almost similar to that of single linear Regression
. The Difference Lies in the evaluation
. We can use it to find out which factor has the highest impact on the predicted output and now different variable relate to each other. We are required to rescale our data, when some values are way different than other values, this can lead to that the average value is not average on the graph (brouder explanation
)
To understand Linear Regression
it would be nice to read first how Gradient Descent
is working.
python3 sample_single.py
python3 sample_multiply.py
- https://youtu.be/nk2CQITm_eo
- http://www.stat.yale.edu/Courses/1997-98/101/linreg.htm
- https://www.jmp.com/en_ch/statistics-knowledge-portal/what-is-multiple-regression/fitting-multiple-regression-model.html
- https://towardsdatascience.com/simple-and-multiple-linear-regression-with-python-c9ab422ec29c (use incognito)