Skip to content

To know internal working of machine learning algorithms, I have implemented types of regression through scratch.

Notifications You must be signed in to change notification settings

Oprishri/Machine-Learning-Algorithms

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Machine-Learning-Algorithms-Scratch

Regression

  • Linear Regression is a machine learning algorithm based on supervised learning. It performs a regression task.
  • Regression models a target prediction value based on independent variables.
  • It is mostly used for finding out the relationship between variables and forecasting.
  • Different regression models differ based on – the kind of relationship between dependent and independent variables,they are considering and the number of independent variables being used.

alt text

Following are the type of regressions used in machine learning, which I have implemented.

  • Simple Linear Regression
  • Multivariate Linear Regression
  • Polynomial Regression
  • Ridge Regression
  • Lasso Regression
  • ElasticNet Regression
  • Logistic Regression

Classification

In machine learning, classification is a supervised learning concept which basically categorizes a set of data into classes.

  • Classification is a process of categorizing a given set of data into classes, It can be performed on both structured or unstructured data.

Decision Tree

A decision tree is a flowchart-like structure in which each internal node represents a "test" on an attribute (e.g. whether a coin flip comes up heads or tails), each branch represents the outcome of the test, and each leaf node represents a class label (decision taken after computing all attributes).

KNN

K-nearest neighbors (KNN) algorithm uses ‘feature similarity’ to predict the values of new datapoints which further means that the new data point will be assigned a value based on how closely it matches the points in the training set.

I have implemented Decision tree classifier and KNN classifier algorithms