atrition.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Employee Attrition Data"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We are going to find major causes of attrition in employees. Attrition results in lack of productivity which reults in lack of profit ,which ultimately leads to unemployment. It seems simple to point out few factors behind attrition such as low wages, working environment,relationship with boss etc, but actually there are a lot more from one's personal reason to his education. And this is where Statistics come in. This field of concern is so wide thatit has given birth to new ML research called **\"Interpretability\"**."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Importing Libraries and Dataset"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import numpy as np\n",
    "import warnings\n",
    "warnings.filterwarnings('ignore')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>﻿Age</th>\n",
       "      <th>Attrition</th>\n",
       "      <th>BusinessTravel</th>\n",
       "      <th>DailyRate</th>\n",
       "      <th>Department</th>\n",
       "      <th>DistanceFromHome</th>\n",
       "      <th>Education</th>\n",
       "      <th>EducationField</th>\n",
       "      <th>EmployeeCount</th>\n",
       "      <th>EmployeeNumber</th>\n",
       "      <th>...</th>\n",
       "      <th>RelationshipSatisfaction</th>\n",
       "      <th>StandardHours</th>\n",
       "      <th>StockOptionLevel</th>\n",
       "      <th>TotalWorkingYears</th>\n",
       "      <th>TrainingTimesLastYear</th>\n",
       "      <th>WorkLifeBalance</th>\n",
       "      <th>YearsAtCompany</th>\n",
       "      <th>YearsInCurrentRole</th>\n",
       "      <th>YearsSinceLastPromotion</th>\n",
       "      <th>YearsWithCurrManager</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>41</td>\n",
       "      <td>Yes</td>\n",
       "      <td>Travel_Rarely</td>\n",
       "      <td>1102</td>\n",
       "      <td>Sales</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>Life Sciences</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>80</td>\n",
       "      <td>0</td>\n",
       "      <td>8</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>6</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>49</td>\n",
       "      <td>No</td>\n",
       "      <td>Travel_Frequently</td>\n",
       "      <td>279</td>\n",
       "      <td>Research &amp; Development</td>\n",
       "      <td>8</td>\n",
       "      <td>1</td>\n",
       "      <td>Life Sciences</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>...</td>\n",
       "      <td>4</td>\n",
       "      <td>80</td>\n",
       "      <td>1</td>\n",
       "      <td>10</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>10</td>\n",
       "      <td>7</td>\n",
       "      <td>1</td>\n",
       "      <td>7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>37</td>\n",
       "      <td>Yes</td>\n",
       "      <td>Travel_Rarely</td>\n",
       "      <td>1373</td>\n",
       "      <td>Research &amp; Development</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>Other</td>\n",
       "      <td>1</td>\n",
       "      <td>4</td>\n",
       "      <td>...</td>\n",
       "      <td>2</td>\n",
       "      <td>80</td>\n",
       "      <td>0</td>\n",
       "      <td>7</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>33</td>\n",
       "      <td>No</td>\n",
       "      <td>Travel_Frequently</td>\n",
       "      <td>1392</td>\n",
       "      <td>Research &amp; Development</td>\n",
       "      <td>3</td>\n",
       "      <td>4</td>\n",
       "      <td>Life Sciences</td>\n",
       "      <td>1</td>\n",
       "      <td>5</td>\n",
       "      <td>...</td>\n",
       "      <td>3</td>\n",
       "      <td>80</td>\n",
       "      <td>0</td>\n",
       "      <td>8</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>8</td>\n",
       "      <td>7</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>27</td>\n",
       "      <td>No</td>\n",
       "      <td>Travel_Rarely</td>\n",
       "      <td>591</td>\n",
       "      <td>Research &amp; Development</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>Medical</td>\n",
       "      <td>1</td>\n",
       "      <td>7</td>\n",
       "      <td>...</td>\n",
       "      <td>4</td>\n",
       "      <td>80</td>\n",
       "      <td>1</td>\n",
       "      <td>6</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 35 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "   ﻿Age Attrition     BusinessTravel  DailyRate              Department  \\\n",
       "0    41       Yes      Travel_Rarely       1102                   Sales   \n",
       "1    49        No  Travel_Frequently        279  Research & Development   \n",
       "2    37       Yes      Travel_Rarely       1373  Research & Development   \n",
       "3    33        No  Travel_Frequently       1392  Research & Development   \n",
       "4    27        No      Travel_Rarely        591  Research & Development   \n",
       "\n",
       "   DistanceFromHome  Education EducationField  EmployeeCount  EmployeeNumber  \\\n",
       "0                 1          2  Life Sciences              1               1   \n",
       "1                 8          1  Life Sciences              1               2   \n",
       "2                 2          2          Other              1               4   \n",
       "3                 3          4  Life Sciences              1               5   \n",
       "4                 2          1        Medical              1               7   \n",
       "\n",
       "           ...           RelationshipSatisfaction StandardHours  \\\n",
       "0          ...                                  1            80   \n",
       "1          ...                                  4            80   \n",
       "2          ...                                  2            80   \n",
       "3          ...                                  3            80   \n",
       "4          ...                                  4            80   \n",
       "\n",
       "   StockOptionLevel  TotalWorkingYears  TrainingTimesLastYear WorkLifeBalance  \\\n",
       "0                 0                  8                      0               1   \n",
       "1                 1                 10                      3               3   \n",
       "2                 0                  7                      3               3   \n",
       "3                 0                  8                      3               3   \n",
       "4                 1                  6                      3               3   \n",
       "\n",
       "   YearsAtCompany YearsInCurrentRole  YearsSinceLastPromotion  \\\n",
       "0               6                  4                        0   \n",
       "1              10                  7                        1   \n",
       "2               0                  0                        0   \n",
       "3               8                  7                        3   \n",
       "4               2                  2                        2   \n",
       "\n",
       "   YearsWithCurrManager  \n",
       "0                     5  \n",
       "1                     7  \n",
       "2                     0  \n",
       "3                     0  \n",
       "4                     2  \n",
       "\n",
       "[5 rows x 35 columns]"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data = pd.read_csv('WA_Fn-UseC_-HR-Employee-Attrition.csv')\n",
    "data.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Index(['﻿Age', 'Attrition', 'BusinessTravel', 'DailyRate', 'Department',\n",
       "       'DistanceFromHome', 'Education', 'EducationField', 'EmployeeCount',\n",
       "       'EmployeeNumber', 'EnvironmentSatisfaction', 'Gender', 'HourlyRate',\n",
       "       'JobInvolvement', 'JobLevel', 'JobRole', 'JobSatisfaction',\n",
       "       'MaritalStatus', 'MonthlyIncome', 'MonthlyRate', 'NumCompaniesWorked',\n",
       "       'Over18', 'OverTime', 'PercentSalaryHike', 'PerformanceRating',\n",
       "       'RelationshipSatisfaction', 'StandardHours', 'StockOptionLevel',\n",
       "       'TotalWorkingYears', 'TrainingTimesLastYear', 'WorkLifeBalance',\n",
       "       'YearsAtCompany', 'YearsInCurrentRole', 'YearsSinceLastPromotion',\n",
       "       'YearsWithCurrManager'],\n",
       "      dtype='object')"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.columns"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Few of the predictors are useless carrying same value for all the observations ,thus having no significance in the desired output variable:\n",
    "####    'EmployeeCount' , 'EmployeeNumber' , 'Over18' , 'StandardHours"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Index(['﻿Age', 'Attrition', 'BusinessTravel', 'DailyRate', 'Department',\n",
       "       'DistanceFromHome', 'Education', 'EducationField',\n",
       "       'EnvironmentSatisfaction', 'Gender', 'HourlyRate', 'JobInvolvement',\n",
       "       'JobLevel', 'JobRole', 'JobSatisfaction', 'MaritalStatus',\n",
       "       'MonthlyIncome', 'MonthlyRate', 'NumCompaniesWorked', 'OverTime',\n",
       "       'PercentSalaryHike', 'PerformanceRating', 'RelationshipSatisfaction',\n",
       "       'StockOptionLevel', 'TotalWorkingYears', 'TrainingTimesLastYear',\n",
       "       'WorkLifeBalance', 'YearsAtCompany', 'YearsInCurrentRole',\n",
       "       'YearsSinceLastPromotion', 'YearsWithCurrManager'],\n",
       "      dtype='object')"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data = data.drop(['EmployeeCount','EmployeeNumber','Over18','StandardHours'],axis=1)\n",
    "data.columns"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Getting unique elements for every predictor variable"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['Single', 'Married', 'Divorced'], dtype=object)"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data['MaritalStatus'].unique()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Replacing our Attrition output by integer constants"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>﻿Age</th>\n",
       "      <th>Attrition</th>\n",
       "      <th>BusinessTravel</th>\n",
       "      <th>DailyRate</th>\n",
       "      <th>Department</th>\n",
       "      <th>DistanceFromHome</th>\n",
       "      <th>Education</th>\n",
       "      <th>EducationField</th>\n",
       "      <th>EnvironmentSatisfaction</th>\n",
       "      <th>Gender</th>\n",
       "      <th>...</th>\n",
       "      <th>PerformanceRating</th>\n",
       "      <th>RelationshipSatisfaction</th>\n",
       "      <th>StockOptionLevel</th>\n",
       "      <th>TotalWorkingYears</th>\n",
       "      <th>TrainingTimesLastYear</th>\n",
       "      <th>WorkLifeBalance</th>\n",
       "      <th>YearsAtCompany</th>\n",
       "      <th>YearsInCurrentRole</th>\n",
       "      <th>YearsSinceLastPromotion</th>\n",
       "      <th>YearsWithCurrManager</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>41</td>\n",
       "      <td>1</td>\n",
       "      <td>Travel_Rarely</td>\n",
       "      <td>1102</td>\n",
       "      <td>Sales</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>Life Sciences</td>\n",
       "      <td>2</td>\n",
       "      <td>Female</td>\n",
       "      <td>...</td>\n",
       "      <td>3</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>8</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>6</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>49</td>\n",
       "      <td>0</td>\n",
       "      <td>Travel_Frequently</td>\n",
       "      <td>279</td>\n",
       "      <td>Research &amp; Development</td>\n",
       "      <td>8</td>\n",
       "      <td>1</td>\n",
       "      <td>Life Sciences</td>\n",
       "      <td>3</td>\n",
       "      <td>Male</td>\n",
       "      <td>...</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>1</td>\n",
       "      <td>10</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>10</td>\n",
       "      <td>7</td>\n",
       "      <td>1</td>\n",
       "      <td>7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>37</td>\n",
       "      <td>1</td>\n",
       "      <td>Travel_Rarely</td>\n",
       "      <td>1373</td>\n",
       "      <td>Research &amp; Development</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>Other</td>\n",
       "      <td>4</td>\n",
       "      <td>Male</td>\n",
       "      <td>...</td>\n",
       "      <td>3</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>7</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>33</td>\n",
       "      <td>0</td>\n",
       "      <td>Travel_Frequently</td>\n",
       "      <td>1392</td>\n",
       "      <td>Research &amp; Development</td>\n",
       "      <td>3</td>\n",
       "      <td>4</td>\n",
       "      <td>Life Sciences</td>\n",
       "      <td>4</td>\n",
       "      <td>Female</td>\n",
       "      <td>...</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "      <td>8</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>8</td>\n",
       "      <td>7</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>27</td>\n",
       "      <td>0</td>\n",
       "      <td>Travel_Rarely</td>\n",
       "      <td>591</td>\n",
       "      <td>Research &amp; Development</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>Medical</td>\n",
       "      <td>1</td>\n",
       "      <td>Male</td>\n",
       "      <td>...</td>\n",
       "      <td>3</td>\n",
       "      <td>4</td>\n",
       "      <td>1</td>\n",
       "      <td>6</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 31 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "   ﻿Age Attrition     BusinessTravel  DailyRate              Department  \\\n",
       "0    41         1      Travel_Rarely       1102                   Sales   \n",
       "1    49         0  Travel_Frequently        279  Research & Development   \n",
       "2    37         1      Travel_Rarely       1373  Research & Development   \n",
       "3    33         0  Travel_Frequently       1392  Research & Development   \n",
       "4    27         0      Travel_Rarely        591  Research & Development   \n",
       "\n",
       "   DistanceFromHome  Education EducationField  EnvironmentSatisfaction  \\\n",
       "0                 1          2  Life Sciences                        2   \n",
       "1                 8          1  Life Sciences                        3   \n",
       "2                 2          2          Other                        4   \n",
       "3                 3          4  Life Sciences                        4   \n",
       "4                 2          1        Medical                        1   \n",
       "\n",
       "   Gender         ...           PerformanceRating  RelationshipSatisfaction  \\\n",
       "0  Female         ...                           3                         1   \n",
       "1    Male         ...                           4                         4   \n",
       "2    Male         ...                           3                         2   \n",
       "3  Female         ...                           3                         3   \n",
       "4    Male         ...                           3                         4   \n",
       "\n",
       "   StockOptionLevel TotalWorkingYears  TrainingTimesLastYear WorkLifeBalance  \\\n",
       "0                 0                 8                      0               1   \n",
       "1                 1                10                      3               3   \n",
       "2                 0                 7                      3               3   \n",
       "3                 0                 8                      3               3   \n",
       "4                 1                 6                      3               3   \n",
       "\n",
       "   YearsAtCompany  YearsInCurrentRole  YearsSinceLastPromotion  \\\n",
       "0               6                   4                        0   \n",
       "1              10                   7                        1   \n",
       "2               0                   0                        0   \n",
       "3               8                   7                        3   \n",
       "4               2                   2                        2   \n",
       "\n",
       "  YearsWithCurrManager  \n",
       "0                    5  \n",
       "1                    7  \n",
       "2                    0  \n",
       "3                    0  \n",
       "4                    2  \n",
       "\n",
       "[5 rows x 31 columns]"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.loc[data['Attrition']=='No','Attrition'] = 0\n",
    "data.loc[data['Attrition']=='Yes','Attrition'] = 1\n",
    "data.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Categorising on the basis of travel for business purposes; rarely,frequently or no travel"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "data['Business_Travel_Rarely']=0\n",
    "data['Business_Travel_Frequently']=0\n",
    "data['Business_Non-Travel']=0\n",
    "\n",
    "data.loc[data['BusinessTravel']=='Travel_Rarely','Business_Travel_Rarely'] = 1\n",
    "data.loc[data['BusinessTravel']=='Travel_Frequently','Business_Travel_Frequently'] = 1\n",
    "data.loc[data['BusinessTravel']=='Non-Travel','Business_Non-Travel'] = 1"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Categorising on the basis of education field"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "data['Life Sciences']=0\n",
    "data['Medical']=0\n",
    "data['Marketing']=0\n",
    "data['Technical Degree']=0\n",
    "data['Education Human Resources']=0\n",
    "data['Education_Other']=0\n",
    "\n",
    "data.loc[data['EducationField']=='Life Sciences','Life Sciences'] = 1\n",
    "data.loc[data['EducationField']=='Medical','Medical'] = 1\n",
    "data.loc[data['EducationField']=='Other','Education_Other'] = 1\n",
    "data.loc[data['EducationField']=='Technical Degree','Technical Degree'] = 1\n",
    "data.loc[data['EducationField']=='Human Resources','Education Human Resources'] = 1\n",
    "data.loc[data['EducationField']=='Marketing','Marketing'] = 1"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Categorising on the basis of working department"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "data['Sales']=0\n",
    "data['R&D']=0\n",
    "data['Dept_Human Resources'] =0\n",
    "\n",
    "data.loc[data['Department']=='Sales','Sales'] = 1\n",
    "data.loc[data['Department']=='Research & Development','R&D'] = 1\n",
    "data.loc[data['Department']=='Human Resources','Dept_Human Resources'] = 1"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "##  Setting predictor gender where male is indicated as 1 and female as 0"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "data.loc[data['Gender']=='Male','Gender'] = 1\n",
    "data.loc[data['Gender']=='Female','Gender'] = 0"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Categorising on the basis of Job Role"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>﻿Age</th>\n",
       "      <th>Attrition</th>\n",
       "      <th>BusinessTravel</th>\n",
       "      <th>DailyRate</th>\n",
       "      <th>Department</th>\n",
       "      <th>DistanceFromHome</th>\n",
       "      <th>Education</th>\n",
       "      <th>EducationField</th>\n",
       "      <th>EnvironmentSatisfaction</th>\n",
       "      <th>Gender</th>\n",
       "      <th>...</th>\n",
       "      <th>Dept_Human Resources</th>\n",
       "      <th>Research Scientist</th>\n",
       "      <th>Laboratory Technician</th>\n",
       "      <th>Sales Executive</th>\n",
       "      <th>Manufacturing Director</th>\n",
       "      <th>Healthcare Representative</th>\n",
       "      <th>Sales Representative</th>\n",
       "      <th>Research Director</th>\n",
       "      <th>Manager</th>\n",
       "      <th>Job_Human_Resources</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>41</td>\n",
       "      <td>1</td>\n",
       "      <td>Travel_Rarely</td>\n",
       "      <td>1102</td>\n",
       "      <td>Sales</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>Life Sciences</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>49</td>\n",
       "      <td>0</td>\n",
       "      <td>Travel_Frequently</td>\n",
       "      <td>279</td>\n",
       "      <td>Research &amp; Development</td>\n",
       "      <td>8</td>\n",
       "      <td>1</td>\n",
       "      <td>Life Sciences</td>\n",
       "      <td>3</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>37</td>\n",
       "      <td>1</td>\n",
       "      <td>Travel_Rarely</td>\n",
       "      <td>1373</td>\n",
       "      <td>Research &amp; Development</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>Other</td>\n",
       "      <td>4</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>33</td>\n",
       "      <td>0</td>\n",
       "      <td>Travel_Frequently</td>\n",
       "      <td>1392</td>\n",
       "      <td>Research &amp; Development</td>\n",
       "      <td>3</td>\n",
       "      <td>4</td>\n",
       "      <td>Life Sciences</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>27</td>\n",
       "      <td>0</td>\n",
       "      <td>Travel_Rarely</td>\n",
       "      <td>591</td>\n",
       "      <td>Research &amp; Development</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>Medical</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 52 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "   ﻿Age Attrition     BusinessTravel  DailyRate              Department  \\\n",
       "0    41         1      Travel_Rarely       1102                   Sales   \n",
       "1    49         0  Travel_Frequently        279  Research & Development   \n",
       "2    37         1      Travel_Rarely       1373  Research & Development   \n",
       "3    33         0  Travel_Frequently       1392  Research & Development   \n",
       "4    27         0      Travel_Rarely        591  Research & Development   \n",
       "\n",
       "   DistanceFromHome  Education EducationField  EnvironmentSatisfaction Gender  \\\n",
       "0                 1          2  Life Sciences                        2      0   \n",
       "1                 8          1  Life Sciences                        3      1   \n",
       "2                 2          2          Other                        4      1   \n",
       "3                 3          4  Life Sciences                        4      0   \n",
       "4                 2          1        Medical                        1      1   \n",
       "\n",
       "          ...          Dept_Human Resources  Research Scientist  \\\n",
       "0         ...                             0                   0   \n",
       "1         ...                             0                   1   \n",
       "2         ...                             0                   0   \n",
       "3         ...                             0                   1   \n",
       "4         ...                             0                   0   \n",
       "\n",
       "   Laboratory Technician Sales Executive  Manufacturing Director  \\\n",
       "0                      0               1                       0   \n",
       "1                      0               0                       0   \n",
       "2                      1               0                       0   \n",
       "3                      0               0                       0   \n",
       "4                      1               0                       0   \n",
       "\n",
       "  Healthcare Representative  Sales Representative  Research Director  Manager  \\\n",
       "0                         0                     0                  0        0   \n",
       "1                         0                     0                  0        0   \n",
       "2                         0                     0                  0        0   \n",
       "3                         0                     0                  0        0   \n",
       "4                         0                     0                  0        0   \n",
       "\n",
       "  Job_Human_Resources  \n",
       "0                   0  \n",
       "1                   0  \n",
       "2                   0  \n",
       "3                   0  \n",
       "4                   0  \n",
       "\n",
       "[5 rows x 52 columns]"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data['Research Scientist']=0\n",
    "data['Laboratory Technician']=0\n",
    "data['Sales Executive']=0\n",
    "data['Manufacturing Director']=0\n",
    "data['Healthcare Representative']=0\n",
    "data['Sales Representative']=0\n",
    "data['Research Director']=0\n",
    "data['Manager'] = 0\n",
    "data['Job_Human_Resources'] = 0\n",
    "\n",
    "data.loc[data['JobRole']=='Research Scientist','Research Scientist'] = 1\n",
    "data.loc[data['JobRole']=='Laboratory Technician','Laboratory Technician'] = 1\n",
    "data.loc[data['JobRole']=='Sales Executive','Sales Executive'] = 1\n",
    "data.loc[data['JobRole']=='Sales Representative','Sales Representative'] = 1\n",
    "data.loc[data['JobRole']=='Manufacturing Director','Manufacturing Director'] = 1\n",
    "data.loc[data['JobRole']=='Healthcare Representative','Healthcare Representative'] = 1\n",
    "data.loc[data['JobRole']=='Research Director','Research Director'] = 1\n",
    "data.loc[data['JobRole']=='Manager','Manager'] = 1\n",
    "data.loc[data['JobRole']=='Human Resources','Job_Human_Resources'] = 1\n",
    "data.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Categorising on the basis of Marital Satus of Employee"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "data['Marital_single']=0\n",
    "data['Marital_married']=0\n",
    "data['Marital_divorced']=0\n",
    "\n",
    "data.loc[data['MaritalStatus']=='Married','Marital_married'] = 1\n",
    "data.loc[data['MaritalStatus']=='Single','Marital_single'] = 1\n",
    "data.loc[data['MaritalStatus']=='Divorced','Marital_divorced'] = 1"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Setting up the Over Time predictor"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>﻿Age</th>\n",
       "      <th>Attrition</th>\n",
       "      <th>BusinessTravel</th>\n",
       "      <th>DailyRate</th>\n",
       "      <th>Department</th>\n",
       "      <th>DistanceFromHome</th>\n",
       "      <th>Education</th>\n",
       "      <th>EducationField</th>\n",
       "      <th>EnvironmentSatisfaction</th>\n",
       "      <th>Gender</th>\n",
       "      <th>...</th>\n",
       "      <th>Sales Executive</th>\n",
       "      <th>Manufacturing Director</th>\n",
       "      <th>Healthcare Representative</th>\n",
       "      <th>Sales Representative</th>\n",
       "      <th>Research Director</th>\n",
       "      <th>Manager</th>\n",
       "      <th>Job_Human_Resources</th>\n",
       "      <th>Marital_single</th>\n",
       "      <th>Marital_married</th>\n",
       "      <th>Marital_divorced</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>41</td>\n",
       "      <td>1</td>\n",
       "      <td>Travel_Rarely</td>\n",
       "      <td>1102</td>\n",
       "      <td>Sales</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>Life Sciences</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>49</td>\n",
       "      <td>0</td>\n",
       "      <td>Travel_Frequently</td>\n",
       "      <td>279</td>\n",
       "      <td>Research &amp; Development</td>\n",
       "      <td>8</td>\n",
       "      <td>1</td>\n",
       "      <td>Life Sciences</td>\n",
       "      <td>3</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>37</td>\n",
       "      <td>1</td>\n",
       "      <td>Travel_Rarely</td>\n",
       "      <td>1373</td>\n",
       "      <td>Research &amp; Development</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>Other</td>\n",
       "      <td>4</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>33</td>\n",
       "      <td>0</td>\n",
       "      <td>Travel_Frequently</td>\n",
       "      <td>1392</td>\n",
       "      <td>Research &amp; Development</td>\n",
       "      <td>3</td>\n",
       "      <td>4</td>\n",
       "      <td>Life Sciences</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>27</td>\n",
       "      <td>0</td>\n",
       "      <td>Travel_Rarely</td>\n",
       "      <td>591</td>\n",
       "      <td>Research &amp; Development</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>Medical</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 55 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "   ﻿Age Attrition     BusinessTravel  DailyRate              Department  \\\n",
       "0    41         1      Travel_Rarely       1102                   Sales   \n",
       "1    49         0  Travel_Frequently        279  Research & Development   \n",
       "2    37         1      Travel_Rarely       1373  Research & Development   \n",
       "3    33         0  Travel_Frequently       1392  Research & Development   \n",
       "4    27         0      Travel_Rarely        591  Research & Development   \n",
       "\n",
       "   DistanceFromHome  Education EducationField  EnvironmentSatisfaction Gender  \\\n",
       "0                 1          2  Life Sciences                        2      0   \n",
       "1                 8          1  Life Sciences                        3      1   \n",
       "2                 2          2          Other                        4      1   \n",
       "3                 3          4  Life Sciences                        4      0   \n",
       "4                 2          1        Medical                        1      1   \n",
       "\n",
       "        ...         Sales Executive  Manufacturing Director  \\\n",
       "0       ...                       1                       0   \n",
       "1       ...                       0                       0   \n",
       "2       ...                       0                       0   \n",
       "3       ...                       0                       0   \n",
       "4       ...                       0                       0   \n",
       "\n",
       "   Healthcare Representative Sales Representative  Research Director Manager  \\\n",
       "0                          0                    0                  0       0   \n",
       "1                          0                    0                  0       0   \n",
       "2                          0                    0                  0       0   \n",
       "3                          0                    0                  0       0   \n",
       "4                          0                    0                  0       0   \n",
       "\n",
       "   Job_Human_Resources  Marital_single  Marital_married Marital_divorced  \n",
       "0                    0               1                0                0  \n",
       "1                    0               0                1                0  \n",
       "2                    0               1                0                0  \n",
       "3                    0               0                1                0  \n",
       "4                    0               0                1                0  \n",
       "\n",
       "[5 rows x 55 columns]"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.loc[data['OverTime']=='No','OverTime'] = 0\n",
    "data.loc[data['OverTime']=='Yes','OverTime'] = 1\n",
    "data.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Checking for useless predictor variables and removing them"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Index(['﻿Age', 'Attrition', 'BusinessTravel', 'DailyRate', 'Department',\n",
       "       'DistanceFromHome', 'Education', 'EducationField',\n",
       "       'EnvironmentSatisfaction', 'Gender', 'HourlyRate', 'JobInvolvement',\n",
       "       'JobLevel', 'JobRole', 'JobSatisfaction', 'MaritalStatus',\n",
       "       'MonthlyIncome', 'MonthlyRate', 'NumCompaniesWorked', 'OverTime',\n",
       "       'PercentSalaryHike', 'PerformanceRating', 'RelationshipSatisfaction',\n",
       "       'StockOptionLevel', 'TotalWorkingYears', 'TrainingTimesLastYear',\n",
       "       'WorkLifeBalance', 'YearsAtCompany', 'YearsInCurrentRole',\n",
       "       'YearsSinceLastPromotion', 'YearsWithCurrManager',\n",
       "       'Business_Travel_Rarely', 'Business_Travel_Frequently',\n",
       "       'Business_Non-Travel', 'Life Sciences', 'Medical', 'Marketing',\n",
       "       'Technical Degree', 'Education Human Resources', 'Education_Other',\n",
       "       'Sales', 'R&D', 'Dept_Human Resources', 'Research Scientist',\n",
       "       'Laboratory Technician', 'Sales Executive', 'Manufacturing Director',\n",
       "       'Healthcare Representative', 'Sales Representative',\n",
       "       'Research Director', 'Manager', 'Job_Human_Resources', 'Marital_single',\n",
       "       'Marital_married', 'Marital_divorced'],\n",
       "      dtype='object')"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.columns"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>﻿Age</th>\n",
       "      <th>Attrition</th>\n",
       "      <th>DailyRate</th>\n",
       "      <th>DistanceFromHome</th>\n",
       "      <th>Education</th>\n",
       "      <th>EnvironmentSatisfaction</th>\n",
       "      <th>Gender</th>\n",
       "      <th>HourlyRate</th>\n",
       "      <th>JobInvolvement</th>\n",
       "      <th>JobLevel</th>\n",
       "      <th>...</th>\n",
       "      <th>Sales Executive</th>\n",
       "      <th>Manufacturing Director</th>\n",
       "      <th>Healthcare Representative</th>\n",
       "      <th>Sales Representative</th>\n",
       "      <th>Research Director</th>\n",
       "      <th>Manager</th>\n",
       "      <th>Job_Human_Resources</th>\n",
       "      <th>Marital_single</th>\n",
       "      <th>Marital_married</th>\n",
       "      <th>Marital_divorced</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>41</td>\n",
       "      <td>1</td>\n",
       "      <td>1102</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>94</td>\n",
       "      <td>3</td>\n",
       "      <td>2</td>\n",
       "      <td>...</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>49</td>\n",
       "      <td>0</td>\n",
       "      <td>279</td>\n",
       "      <td>8</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "      <td>1</td>\n",
       "      <td>61</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>37</td>\n",
       "      <td>1</td>\n",
       "      <td>1373</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>4</td>\n",
       "      <td>1</td>\n",
       "      <td>92</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>33</td>\n",
       "      <td>0</td>\n",
       "      <td>1392</td>\n",
       "      <td>3</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>56</td>\n",
       "      <td>3</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>27</td>\n",
       "      <td>0</td>\n",
       "      <td>591</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>40</td>\n",
       "      <td>3</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 50 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "   ﻿Age Attrition  DailyRate  DistanceFromHome  Education  \\\n",
       "0    41         1       1102                 1          2   \n",
       "1    49         0        279                 8          1   \n",
       "2    37         1       1373                 2          2   \n",
       "3    33         0       1392                 3          4   \n",
       "4    27         0        591                 2          1   \n",
       "\n",
       "   EnvironmentSatisfaction Gender  HourlyRate  JobInvolvement  JobLevel  \\\n",
       "0                        2      0          94               3         2   \n",
       "1                        3      1          61               2         2   \n",
       "2                        4      1          92               2         1   \n",
       "3                        4      0          56               3         1   \n",
       "4                        1      1          40               3         1   \n",
       "\n",
       "         ...         Sales Executive  Manufacturing Director  \\\n",
       "0        ...                       1                       0   \n",
       "1        ...                       0                       0   \n",
       "2        ...                       0                       0   \n",
       "3        ...                       0                       0   \n",
       "4        ...                       0                       0   \n",
       "\n",
       "   Healthcare Representative  Sales Representative Research Director  Manager  \\\n",
       "0                          0                     0                 0        0   \n",
       "1                          0                     0                 0        0   \n",
       "2                          0                     0                 0        0   \n",
       "3                          0                     0                 0        0   \n",
       "4                          0                     0                 0        0   \n",
       "\n",
       "   Job_Human_Resources  Marital_single  Marital_married  Marital_divorced  \n",
       "0                    0               1                0                 0  \n",
       "1                    0               0                1                 0  \n",
       "2                    0               1                0                 0  \n",
       "3                    0               0                1                 0  \n",
       "4                    0               0                1                 0  \n",
       "\n",
       "[5 rows x 50 columns]"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data = data.drop(['BusinessTravel','EducationField',\n",
    "                        'Department','JobRole','MaritalStatus'],axis=1)\n",
    "data.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Converting datatypes of some predictor variables"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "collapsed": false,
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "﻿Age                           int64\n",
       "Attrition                     object\n",
       "DailyRate                      int64\n",
       "DistanceFromHome               int64\n",
       "Education                      int64\n",
       "EnvironmentSatisfaction        int64\n",
       "Gender                        object\n",
       "HourlyRate                     int64\n",
       "JobInvolvement                 int64\n",
       "JobLevel                       int64\n",
       "JobSatisfaction                int64\n",
       "MonthlyIncome                  int64\n",
       "MonthlyRate                    int64\n",
       "NumCompaniesWorked             int64\n",
       "OverTime                      object\n",
       "PercentSalaryHike              int64\n",
       "PerformanceRating              int64\n",
       "RelationshipSatisfaction       int64\n",
       "StockOptionLevel               int64\n",
       "TotalWorkingYears              int64\n",
       "TrainingTimesLastYear          int64\n",
       "WorkLifeBalance                int64\n",
       "YearsAtCompany                 int64\n",
       "YearsInCurrentRole             int64\n",
       "YearsSinceLastPromotion        int64\n",
       "YearsWithCurrManager           int64\n",
       "Business_Travel_Rarely         int64\n",
       "Business_Travel_Frequently     int64\n",
       "Business_Non-Travel            int64\n",
       "Life Sciences                  int64\n",
       "Medical                        int64\n",
       "Marketing                      int64\n",
       "Technical Degree               int64\n",
       "Education Human Resources      int64\n",
       "Education_Other                int64\n",
       "Sales                          int64\n",
       "R&D                            int64\n",
       "Dept_Human Resources           int64\n",
       "Research Scientist             int64\n",
       "Laboratory Technician          int64\n",
       "Sales Executive                int64\n",
       "Manufacturing Director         int64\n",
       "Healthcare Representative      int64\n",
       "Sales Representative           int64\n",
       "Research Director              int64\n",
       "Manager                        int64\n",
       "Job_Human_Resources            int64\n",
       "Marital_single                 int64\n",
       "Marital_married                int64\n",
       "Marital_divorced               int64\n",
       "dtype: object"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.dtypes"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "data['Attrition'] = data['Attrition'].astype('int')\n",
    "data['Gender'] = data['Gender'].astype('int')\n",
    "data['OverTime'] = data['OverTime'].astype('int')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Finding coorelation among various predictors"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>﻿Age</th>\n",
       "      <th>Attrition</th>\n",
       "      <th>DailyRate</th>\n",
       "      <th>DistanceFromHome</th>\n",
       "      <th>Education</th>\n",
       "      <th>EnvironmentSatisfaction</th>\n",
       "      <th>Gender</th>\n",
       "      <th>HourlyRate</th>\n",
       "      <th>JobInvolvement</th>\n",
       "      <th>JobLevel</th>\n",
       "      <th>...</th>\n",
       "      <th>Sales Executive</th>\n",
       "      <th>Manufacturing Director</th>\n",
       "      <th>Healthcare Representative</th>\n",
       "      <th>Sales Representative</th>\n",
       "      <th>Research Director</th>\n",
       "      <th>Manager</th>\n",
       "      <th>Job_Human_Resources</th>\n",
       "      <th>Marital_single</th>\n",
       "      <th>Marital_married</th>\n",
       "      <th>Marital_divorced</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>﻿Age</th>\n",
       "      <td>1.000000</td>\n",
       "      <td>-0.159205</td>\n",
       "      <td>0.010661</td>\n",
       "      <td>-0.001686</td>\n",
       "      <td>0.208034</td>\n",
       "      <td>0.010146</td>\n",
       "      <td>-0.036311</td>\n",
       "      <td>0.024287</td>\n",
       "      <td>0.029820</td>\n",
       "      <td>0.509604</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.002001</td>\n",
       "      <td>0.049726</td>\n",
       "      <td>0.098825</td>\n",
       "      <td>-0.175785</td>\n",
       "      <td>0.185891</td>\n",
       "      <td>0.294248</td>\n",
       "      <td>-0.029856</td>\n",
       "      <td>-0.119185</td>\n",
       "      <td>0.083919</td>\n",
       "      <td>0.033120</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Attrition</th>\n",
       "      <td>-0.159205</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>-0.056652</td>\n",
       "      <td>0.077924</td>\n",
       "      <td>-0.031373</td>\n",
       "      <td>-0.103369</td>\n",
       "      <td>0.029453</td>\n",
       "      <td>-0.006846</td>\n",
       "      <td>-0.130016</td>\n",
       "      <td>-0.169105</td>\n",
       "      <td>...</td>\n",
       "      <td>0.019774</td>\n",
       "      <td>-0.082994</td>\n",
       "      <td>-0.078696</td>\n",
       "      <td>0.157234</td>\n",
       "      <td>-0.088870</td>\n",
       "      <td>-0.083316</td>\n",
       "      <td>0.036215</td>\n",
       "      <td>0.175419</td>\n",
       "      <td>-0.090984</td>\n",
       "      <td>-0.087716</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>DailyRate</th>\n",
       "      <td>0.010661</td>\n",
       "      <td>-0.056652</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>-0.004985</td>\n",
       "      <td>-0.016806</td>\n",
       "      <td>0.018355</td>\n",
       "      <td>-0.011716</td>\n",
       "      <td>0.023381</td>\n",
       "      <td>0.046135</td>\n",
       "      <td>0.002966</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.000513</td>\n",
       "      <td>-0.005302</td>\n",
       "      <td>0.040141</td>\n",
       "      <td>0.005375</td>\n",
       "      <td>-0.000021</td>\n",
       "      <td>-0.013224</td>\n",
       "      <td>-0.021156</td>\n",
       "      <td>-0.075835</td>\n",
       "      <td>0.040035</td>\n",
       "      <td>0.037080</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>DistanceFromHome</th>\n",
       "      <td>-0.001686</td>\n",
       "      <td>0.077924</td>\n",
       "      <td>-0.004985</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.021042</td>\n",
       "      <td>-0.016075</td>\n",
       "      <td>-0.001851</td>\n",
       "      <td>0.031131</td>\n",
       "      <td>0.008783</td>\n",
       "      <td>0.005303</td>\n",
       "      <td>...</td>\n",
       "      <td>0.030761</td>\n",
       "      <td>0.011848</td>\n",
       "      <td>0.022916</td>\n",
       "      <td>-0.015994</td>\n",
       "      <td>-0.022351</td>\n",
       "      <td>-0.039190</td>\n",
       "      <td>-0.024089</td>\n",
       "      <td>-0.027445</td>\n",
       "      <td>0.030232</td>\n",
       "      <td>-0.005440</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Education</th>\n",
       "      <td>0.208034</td>\n",
       "      <td>-0.031373</td>\n",
       "      <td>-0.016806</td>\n",
       "      <td>0.021042</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>-0.027128</td>\n",
       "      <td>-0.016547</td>\n",
       "      <td>0.016775</td>\n",
       "      <td>0.042438</td>\n",
       "      <td>0.101589</td>\n",
       "      <td>...</td>\n",
       "      <td>0.053398</td>\n",
       "      <td>-0.005290</td>\n",
       "      <td>0.024270</td>\n",
       "      <td>-0.091465</td>\n",
       "      <td>0.049694</td>\n",
       "      <td>0.028453</td>\n",
       "      <td>-0.005295</td>\n",
       "      <td>0.004168</td>\n",
       "      <td>-0.001865</td>\n",
       "      <td>-0.002439</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>EnvironmentSatisfaction</th>\n",
       "      <td>0.010146</td>\n",
       "      <td>-0.103369</td>\n",
       "      <td>0.018355</td>\n",
       "      <td>-0.016075</td>\n",
       "      <td>-0.027128</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.000508</td>\n",
       "      <td>-0.049857</td>\n",
       "      <td>-0.008278</td>\n",
       "      <td>0.001212</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.024421</td>\n",
       "      <td>0.059178</td>\n",
       "      <td>0.014090</td>\n",
       "      <td>0.002949</td>\n",
       "      <td>-0.048689</td>\n",
       "      <td>0.010730</td>\n",
       "      <td>-0.022014</td>\n",
       "      <td>0.009035</td>\n",
       "      <td>-0.022180</td>\n",
       "      <td>0.016439</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Gender</th>\n",
       "      <td>-0.036311</td>\n",
       "      <td>0.029453</td>\n",
       "      <td>-0.011716</td>\n",
       "      <td>-0.001851</td>\n",
       "      <td>-0.016547</td>\n",
       "      <td>0.000508</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>-0.000478</td>\n",
       "      <td>0.017960</td>\n",
       "      <td>-0.039403</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.005348</td>\n",
       "      <td>-0.065197</td>\n",
       "      <td>0.006823</td>\n",
       "      <td>-0.028877</td>\n",
       "      <td>-0.006121</td>\n",
       "      <td>-0.033880</td>\n",
       "      <td>0.036082</td>\n",
       "      <td>-0.032752</td>\n",
       "      <td>-0.007804</td>\n",
       "      <td>0.046076</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>HourlyRate</th>\n",
       "      <td>0.024287</td>\n",
       "      <td>-0.006846</td>\n",
       "      <td>0.023381</td>\n",
       "      <td>0.031131</td>\n",
       "      <td>0.016775</td>\n",
       "      <td>-0.049857</td>\n",
       "      <td>-0.000478</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>0.042861</td>\n",
       "      <td>-0.027853</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.011886</td>\n",
       "      <td>-0.014394</td>\n",
       "      <td>0.014599</td>\n",
       "      <td>-0.018703</td>\n",
       "      <td>-0.025128</td>\n",
       "      <td>0.012659</td>\n",
       "      <td>-0.016189</td>\n",
       "      <td>-0.033436</td>\n",
       "      <td>0.036432</td>\n",
       "      <td>-0.006150</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>JobInvolvement</th>\n",
       "      <td>0.029820</td>\n",
       "      <td>-0.130016</td>\n",
       "      <td>0.046135</td>\n",
       "      <td>0.008783</td>\n",
       "      <td>0.042438</td>\n",
       "      <td>-0.008278</td>\n",
       "      <td>0.017960</td>\n",
       "      <td>0.042861</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>-0.012630</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.011413</td>\n",
       "      <td>-0.021939</td>\n",
       "      <td>0.001272</td>\n",
       "      <td>-0.027282</td>\n",
       "      <td>0.015200</td>\n",
       "      <td>0.017112</td>\n",
       "      <td>-0.004952</td>\n",
       "      <td>-0.045253</td>\n",
       "      <td>0.028324</td>\n",
       "      <td>0.016815</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>JobLevel</th>\n",
       "      <td>0.509604</td>\n",
       "      <td>-0.169105</td>\n",
       "      <td>0.002966</td>\n",
       "      <td>0.005303</td>\n",
       "      <td>0.101589</td>\n",
       "      <td>0.001212</td>\n",
       "      <td>-0.039403</td>\n",
       "      <td>-0.027853</td>\n",
       "      <td>-0.012630</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>0.127490</td>\n",
       "      <td>0.114896</td>\n",
       "      <td>0.115704</td>\n",
       "      <td>-0.216559</td>\n",
       "      <td>0.414319</td>\n",
       "      <td>0.552744</td>\n",
       "      <td>-0.100922</td>\n",
       "      <td>-0.087072</td>\n",
       "      <td>0.050547</td>\n",
       "      <td>0.037087</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>JobSatisfaction</th>\n",
       "      <td>-0.004892</td>\n",
       "      <td>-0.103481</td>\n",
       "      <td>0.030571</td>\n",
       "      <td>-0.003669</td>\n",
       "      <td>-0.011296</td>\n",
       "      <td>-0.006784</td>\n",
       "      <td>0.033252</td>\n",
       "      <td>-0.071335</td>\n",
       "      <td>-0.021476</td>\n",
       "      <td>-0.001944</td>\n",
       "      <td>...</td>\n",
       "      <td>0.012604</td>\n",
       "      <td>-0.013747</td>\n",
       "      <td>0.016367</td>\n",
       "      <td>0.001413</td>\n",
       "      <td>-0.006217</td>\n",
       "      <td>-0.005620</td>\n",
       "      <td>-0.029681</td>\n",
       "      <td>0.024571</td>\n",
       "      <td>-0.010315</td>\n",
       "      <td>-0.015197</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>MonthlyIncome</th>\n",
       "      <td>0.497855</td>\n",
       "      <td>-0.159840</td>\n",
       "      <td>0.007707</td>\n",
       "      <td>-0.017014</td>\n",
       "      <td>0.094961</td>\n",
       "      <td>-0.006259</td>\n",
       "      <td>-0.031858</td>\n",
       "      <td>-0.015794</td>\n",
       "      <td>-0.015271</td>\n",
       "      <td>0.950300</td>\n",
       "      <td>...</td>\n",
       "      <td>0.047792</td>\n",
       "      <td>0.055684</td>\n",
       "      <td>0.068177</td>\n",
       "      <td>-0.201514</td>\n",
       "      <td>0.485818</td>\n",
       "      <td>0.619573</td>\n",
       "      <td>-0.092250</td>\n",
       "      <td>-0.089361</td>\n",
       "      <td>0.056767</td>\n",
       "      <td>0.032203</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>MonthlyRate</th>\n",
       "      <td>0.028051</td>\n",
       "      <td>0.015170</td>\n",
       "      <td>-0.032182</td>\n",
       "      <td>0.027473</td>\n",
       "      <td>-0.026084</td>\n",
       "      <td>0.037600</td>\n",
       "      <td>-0.041482</td>\n",
       "      <td>-0.015297</td>\n",
       "      <td>-0.016322</td>\n",
       "      <td>0.039563</td>\n",
       "      <td>...</td>\n",
       "      <td>0.011854</td>\n",
       "      <td>0.007711</td>\n",
       "      <td>0.003829</td>\n",
       "      <td>-0.001200</td>\n",
       "      <td>0.025875</td>\n",
       "      <td>0.031717</td>\n",
       "      <td>-0.027470</td>\n",
       "      <td>0.037260</td>\n",
       "      <td>-0.034689</td>\n",
       "      <td>-0.000227</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>NumCompaniesWorked</th>\n",
       "      <td>0.299635</td>\n",
       "      <td>0.043494</td>\n",
       "      <td>0.038153</td>\n",
       "      <td>-0.029251</td>\n",
       "      <td>0.126317</td>\n",
       "      <td>0.012594</td>\n",
       "      <td>-0.039147</td>\n",
       "      <td>0.022157</td>\n",
       "      <td>0.015012</td>\n",
       "      <td>0.142501</td>\n",
       "      <td>...</td>\n",
       "      <td>0.005913</td>\n",
       "      <td>0.009580</td>\n",
       "      <td>0.026955</td>\n",
       "      <td>-0.104494</td>\n",
       "      <td>0.097925</td>\n",
       "      <td>0.042125</td>\n",
       "      <td>0.020578</td>\n",
       "      <td>-0.019161</td>\n",
       "      <td>-0.016142</td>\n",
       "      <td>0.040824</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>OverTime</th>\n",
       "      <td>0.028062</td>\n",
       "      <td>0.246118</td>\n",
       "      <td>0.009135</td>\n",
       "      <td>0.025514</td>\n",
       "      <td>-0.020322</td>\n",
       "      <td>0.070132</td>\n",
       "      <td>-0.041924</td>\n",
       "      <td>-0.007782</td>\n",
       "      <td>-0.003507</td>\n",
       "      <td>0.000544</td>\n",
       "      <td>...</td>\n",
       "      <td>0.006341</td>\n",
       "      <td>-0.010302</td>\n",
       "      <td>-0.000382</td>\n",
       "      <td>0.003347</td>\n",
       "      <td>0.002400</td>\n",
       "      <td>-0.011086</td>\n",
       "      <td>-0.014026</td>\n",
       "      <td>-0.006498</td>\n",
       "      <td>-0.013502</td>\n",
       "      <td>0.023462</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>PercentSalaryHike</th>\n",
       "      <td>0.003634</td>\n",
       "      <td>-0.013478</td>\n",
       "      <td>0.022704</td>\n",
       "      <td>0.040235</td>\n",
       "      <td>-0.011111</td>\n",
       "      <td>-0.031701</td>\n",
       "      <td>0.002733</td>\n",
       "      <td>-0.009062</td>\n",
       "      <td>-0.017205</td>\n",
       "      <td>-0.034730</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.046683</td>\n",
       "      <td>0.034682</td>\n",
       "      <td>0.020591</td>\n",
       "      <td>0.031102</td>\n",
       "      <td>-0.017017</td>\n",
       "      <td>-0.005394</td>\n",
       "      <td>-0.021032</td>\n",
       "      <td>-0.001386</td>\n",
       "      <td>0.020895</td>\n",
       "      <td>-0.023478</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>PerformanceRating</th>\n",
       "      <td>0.001904</td>\n",
       "      <td>0.002889</td>\n",
       "      <td>0.000473</td>\n",
       "      <td>0.027110</td>\n",
       "      <td>-0.024539</td>\n",
       "      <td>-0.029548</td>\n",
       "      <td>-0.013859</td>\n",
       "      <td>-0.002172</td>\n",
       "      <td>-0.029071</td>\n",
       "      <td>-0.021222</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.041401</td>\n",
       "      <td>0.029775</td>\n",
       "      <td>-0.000928</td>\n",
       "      <td>-0.006214</td>\n",
       "      <td>-0.035744</td>\n",
       "      <td>0.032050</td>\n",
       "      <td>-0.010154</td>\n",
       "      <td>-0.001045</td>\n",
       "      <td>0.009585</td>\n",
       "      <td>-0.010310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>RelationshipSatisfaction</th>\n",
       "      <td>0.053535</td>\n",
       "      <td>-0.045872</td>\n",
       "      <td>0.007846</td>\n",
       "      <td>0.006557</td>\n",
       "      <td>-0.009118</td>\n",
       "      <td>0.007665</td>\n",
       "      <td>0.022868</td>\n",
       "      <td>0.001330</td>\n",
       "      <td>0.034297</td>\n",
       "      <td>0.021642</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.004836</td>\n",
       "      <td>0.003640</td>\n",
       "      <td>-0.005090</td>\n",
       "      <td>-0.024859</td>\n",
       "      <td>-0.005492</td>\n",
       "      <td>0.025638</td>\n",
       "      <td>0.044169</td>\n",
       "      <td>0.040817</td>\n",
       "      <td>-0.043382</td>\n",
       "      <td>0.006199</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>StockOptionLevel</th>\n",
       "      <td>0.037510</td>\n",
       "      <td>-0.137145</td>\n",
       "      <td>0.042143</td>\n",
       "      <td>0.044872</td>\n",
       "      <td>0.018422</td>\n",
       "      <td>0.003432</td>\n",
       "      <td>0.012716</td>\n",
       "      <td>0.050263</td>\n",
       "      <td>0.021523</td>\n",
       "      <td>0.013984</td>\n",
       "      <td>...</td>\n",
       "      <td>0.015756</td>\n",
       "      <td>0.007735</td>\n",
       "      <td>0.014021</td>\n",
       "      <td>-0.048067</td>\n",
       "      <td>0.015807</td>\n",
       "      <td>-0.015637</td>\n",
       "      <td>-0.009864</td>\n",
       "      <td>-0.638957</td>\n",
       "      <td>0.225574</td>\n",
       "      <td>0.446285</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>TotalWorkingYears</th>\n",
       "      <td>0.680381</td>\n",
       "      <td>-0.171063</td>\n",
       "      <td>0.014515</td>\n",
       "      <td>0.004628</td>\n",
       "      <td>0.148280</td>\n",
       "      <td>-0.002693</td>\n",
       "      <td>-0.046881</td>\n",
       "      <td>-0.002334</td>\n",
       "      <td>-0.005533</td>\n",
       "      <td>0.782208</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.012241</td>\n",
       "      <td>0.064077</td>\n",
       "      <td>0.112159</td>\n",
       "      <td>-0.207726</td>\n",
       "      <td>0.312148</td>\n",
       "      <td>0.465837</td>\n",
       "      <td>-0.076482</td>\n",
       "      <td>-0.089529</td>\n",
       "      <td>0.053512</td>\n",
       "      <td>0.036291</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>TrainingTimesLastYear</th>\n",
       "      <td>-0.019621</td>\n",
       "      <td>-0.059478</td>\n",
       "      <td>0.002453</td>\n",
       "      <td>-0.036942</td>\n",
       "      <td>-0.025100</td>\n",
       "      <td>-0.019359</td>\n",
       "      <td>-0.038787</td>\n",
       "      <td>-0.008548</td>\n",
       "      <td>-0.015338</td>\n",
       "      <td>-0.018191</td>\n",
       "      <td>...</td>\n",
       "      <td>0.013241</td>\n",
       "      <td>-0.013987</td>\n",
       "      <td>-0.012432</td>\n",
       "      <td>0.040377</td>\n",
       "      <td>-0.004527</td>\n",
       "      <td>0.003052</td>\n",
       "      <td>-0.035902</td>\n",
       "      <td>0.024129</td>\n",
       "      <td>-0.029602</td>\n",
       "      <td>0.008405</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>WorkLifeBalance</th>\n",
       "      <td>-0.021490</td>\n",
       "      <td>-0.063939</td>\n",
       "      <td>-0.037848</td>\n",
       "      <td>-0.026556</td>\n",
       "      <td>0.009819</td>\n",
       "      <td>0.027627</td>\n",
       "      <td>-0.002753</td>\n",
       "      <td>-0.004607</td>\n",
       "      <td>-0.014617</td>\n",
       "      <td>0.037818</td>\n",
       "      <td>...</td>\n",
       "      <td>0.032092</td>\n",
       "      <td>0.002011</td>\n",
       "      <td>-0.026101</td>\n",
       "      <td>0.045148</td>\n",
       "      <td>0.034403</td>\n",
       "      <td>0.005137</td>\n",
       "      <td>0.043887</td>\n",
       "      <td>0.014921</td>\n",
       "      <td>-0.006388</td>\n",
       "      <td>-0.009080</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>YearsAtCompany</th>\n",
       "      <td>0.311309</td>\n",
       "      <td>-0.134392</td>\n",
       "      <td>-0.034055</td>\n",
       "      <td>0.009508</td>\n",
       "      <td>0.069114</td>\n",
       "      <td>0.001458</td>\n",
       "      <td>-0.029747</td>\n",
       "      <td>-0.019582</td>\n",
       "      <td>-0.021355</td>\n",
       "      <td>0.534739</td>\n",
       "      <td>...</td>\n",
       "      <td>0.042602</td>\n",
       "      <td>0.031968</td>\n",
       "      <td>0.069758</td>\n",
       "      <td>-0.163464</td>\n",
       "      <td>0.153918</td>\n",
       "      <td>0.330965</td>\n",
       "      <td>-0.052569</td>\n",
       "      <td>-0.070935</td>\n",
       "      <td>0.044925</td>\n",
       "      <td>0.025728</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>YearsInCurrentRole</th>\n",
       "      <td>0.212901</td>\n",
       "      <td>-0.160545</td>\n",
       "      <td>0.009932</td>\n",
       "      <td>0.018845</td>\n",
       "      <td>0.060236</td>\n",
       "      <td>0.018007</td>\n",
       "      <td>-0.041483</td>\n",
       "      <td>-0.024106</td>\n",
       "      <td>0.008717</td>\n",
       "      <td>0.389447</td>\n",
       "      <td>...</td>\n",
       "      <td>0.092349</td>\n",
       "      <td>0.067877</td>\n",
       "      <td>0.054695</td>\n",
       "      <td>-0.149751</td>\n",
       "      <td>0.136332</td>\n",
       "      <td>0.167499</td>\n",
       "      <td>-0.057876</td>\n",
       "      <td>-0.086486</td>\n",
       "      <td>0.065488</td>\n",
       "      <td>0.018532</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>YearsSinceLastPromotion</th>\n",
       "      <td>0.216513</td>\n",
       "      <td>-0.033019</td>\n",
       "      <td>-0.033229</td>\n",
       "      <td>0.010029</td>\n",
       "      <td>0.054254</td>\n",
       "      <td>0.016194</td>\n",
       "      <td>-0.026985</td>\n",
       "      <td>-0.026716</td>\n",
       "      <td>-0.024184</td>\n",
       "      <td>0.353885</td>\n",
       "      <td>...</td>\n",
       "      <td>0.049202</td>\n",
       "      <td>-0.007241</td>\n",
       "      <td>0.075902</td>\n",
       "      <td>-0.085622</td>\n",
       "      <td>0.074455</td>\n",
       "      <td>0.224255</td>\n",
       "      <td>-0.054603</td>\n",
       "      <td>-0.053090</td>\n",
       "      <td>0.054102</td>\n",
       "      <td>-0.005279</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>YearsWithCurrManager</th>\n",
       "      <td>0.202089</td>\n",
       "      <td>-0.156199</td>\n",
       "      <td>-0.026363</td>\n",
       "      <td>0.014406</td>\n",
       "      <td>0.069065</td>\n",
       "      <td>-0.004999</td>\n",
       "      <td>-0.030599</td>\n",
       "      <td>-0.020123</td>\n",
       "      <td>0.025976</td>\n",
       "      <td>0.375281</td>\n",
       "      <td>...</td>\n",
       "      <td>0.083028</td>\n",
       "      <td>0.076207</td>\n",
       "      <td>0.039407</td>\n",
       "      <td>-0.168743</td>\n",
       "      <td>0.131279</td>\n",
       "      <td>0.164695</td>\n",
       "      <td>-0.051006</td>\n",
       "      <td>-0.047793</td>\n",
       "      <td>0.032972</td>\n",
       "      <td>0.014095</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Business_Travel_Rarely</th>\n",
       "      <td>0.028791</td>\n",
       "      <td>-0.049538</td>\n",
       "      <td>0.002078</td>\n",
       "      <td>-0.020116</td>\n",
       "      <td>0.004126</td>\n",
       "      <td>0.008496</td>\n",
       "      <td>-0.014682</td>\n",
       "      <td>0.027541</td>\n",
       "      <td>0.026714</td>\n",
       "      <td>0.023433</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.011920</td>\n",
       "      <td>0.000598</td>\n",
       "      <td>-0.015503</td>\n",
       "      <td>-0.025257</td>\n",
       "      <td>0.034600</td>\n",
       "      <td>0.027294</td>\n",
       "      <td>0.008962</td>\n",
       "      <td>-0.020808</td>\n",
       "      <td>0.055613</td>\n",
       "      <td>-0.043287</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Business_Travel_Frequently</th>\n",
       "      <td>-0.024743</td>\n",
       "      <td>0.115143</td>\n",
       "      <td>-0.011776</td>\n",
       "      <td>0.005081</td>\n",
       "      <td>-0.008292</td>\n",
       "      <td>-0.012624</td>\n",
       "      <td>-0.022015</td>\n",
       "      <td>-0.018819</td>\n",
       "      <td>0.004424</td>\n",
       "      <td>-0.021557</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.010175</td>\n",
       "      <td>0.009783</td>\n",
       "      <td>0.008029</td>\n",
       "      <td>0.055469</td>\n",
       "      <td>-0.023579</td>\n",
       "      <td>-0.042583</td>\n",
       "      <td>0.001896</td>\n",
       "      <td>0.027734</td>\n",
       "      <td>-0.030785</td>\n",
       "      <td>0.005779</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Business_Non-Travel</th>\n",
       "      <td>-0.011215</td>\n",
       "      <td>-0.074457</td>\n",
       "      <td>0.012096</td>\n",
       "      <td>0.023605</td>\n",
       "      <td>0.004524</td>\n",
       "      <td>0.003568</td>\n",
       "      <td>0.050461</td>\n",
       "      <td>-0.016994</td>\n",
       "      <td>-0.045779</td>\n",
       "      <td>-0.007295</td>\n",
       "      <td>...</td>\n",
       "      <td>0.031022</td>\n",
       "      <td>-0.013536</td>\n",
       "      <td>0.012878</td>\n",
       "      <td>-0.033780</td>\n",
       "      <td>-0.021431</td>\n",
       "      <td>0.014078</td>\n",
       "      <td>-0.015890</td>\n",
       "      <td>-0.004622</td>\n",
       "      <td>-0.043635</td>\n",
       "      <td>0.057455</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Life Sciences</th>\n",
       "      <td>0.016824</td>\n",
       "      <td>-0.032703</td>\n",
       "      <td>0.004028</td>\n",
       "      <td>-0.024499</td>\n",
       "      <td>0.013184</td>\n",
       "      <td>-0.024526</td>\n",
       "      <td>0.006770</td>\n",
       "      <td>0.038759</td>\n",
       "      <td>0.003228</td>\n",
       "      <td>-0.008431</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.091122</td>\n",
       "      <td>0.052023</td>\n",
       "      <td>0.029084</td>\n",
       "      <td>-0.043208</td>\n",
       "      <td>0.018401</td>\n",
       "      <td>-0.011143</td>\n",
       "      <td>-0.063119</td>\n",
       "      <td>0.021469</td>\n",
       "      <td>-0.017866</td>\n",
       "      <td>-0.002672</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Medical</th>\n",
       "      <td>-0.006354</td>\n",
       "      <td>-0.046999</td>\n",
       "      <td>0.034202</td>\n",
       "      <td>0.013486</td>\n",
       "      <td>-0.072335</td>\n",
       "      <td>-0.021299</td>\n",
       "      <td>-0.013146</td>\n",
       "      <td>-0.020418</td>\n",
       "      <td>0.017103</td>\n",
       "      <td>-0.014114</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.133532</td>\n",
       "      <td>0.035496</td>\n",
       "      <td>0.034165</td>\n",
       "      <td>-0.051990</td>\n",
       "      <td>0.062898</td>\n",
       "      <td>-0.001128</td>\n",
       "      <td>-0.042895</td>\n",
       "      <td>-0.004249</td>\n",
       "      <td>-0.007139</td>\n",
       "      <td>0.013316</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Marketing</th>\n",
       "      <td>0.038162</td>\n",
       "      <td>0.055781</td>\n",
       "      <td>-0.064449</td>\n",
       "      <td>0.039294</td>\n",
       "      <td>0.072405</td>\n",
       "      <td>0.000479</td>\n",
       "      <td>-0.024143</td>\n",
       "      <td>0.004452</td>\n",
       "      <td>-0.018657</td>\n",
       "      <td>0.092698</td>\n",
       "      <td>...</td>\n",
       "      <td>0.457308</td>\n",
       "      <td>-0.115206</td>\n",
       "      <td>-0.108929</td>\n",
       "      <td>0.133065</td>\n",
       "      <td>-0.083548</td>\n",
       "      <td>0.025577</td>\n",
       "      <td>-0.066690</td>\n",
       "      <td>-0.013323</td>\n",
       "      <td>0.018491</td>\n",
       "      <td>-0.007212</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Technical Degree</th>\n",
       "      <td>-0.027604</td>\n",
       "      <td>0.069355</td>\n",
       "      <td>0.030869</td>\n",
       "      <td>-0.014802</td>\n",
       "      <td>-0.026742</td>\n",
       "      <td>0.027713</td>\n",
       "      <td>0.003886</td>\n",
       "      <td>0.011283</td>\n",
       "      <td>-0.004519</td>\n",
       "      <td>-0.054707</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.058843</td>\n",
       "      <td>0.007817</td>\n",
       "      <td>0.018681</td>\n",
       "      <td>0.057185</td>\n",
       "      <td>-0.022905</td>\n",
       "      <td>-0.038946</td>\n",
       "      <td>-0.008623</td>\n",
       "      <td>0.014265</td>\n",
       "      <td>0.002710</td>\n",
       "      <td>-0.019243</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Education Human Resources</th>\n",
       "      <td>0.001696</td>\n",
       "      <td>0.036466</td>\n",
       "      <td>-0.043144</td>\n",
       "      <td>-0.002624</td>\n",
       "      <td>0.026479</td>\n",
       "      <td>-0.006898</td>\n",
       "      <td>0.028956</td>\n",
       "      <td>-0.033670</td>\n",
       "      <td>0.002079</td>\n",
       "      <td>0.010409</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.073020</td>\n",
       "      <td>-0.045251</td>\n",
       "      <td>-0.042785</td>\n",
       "      <td>-0.033462</td>\n",
       "      <td>-0.032816</td>\n",
       "      <td>0.082271</td>\n",
       "      <td>0.549751</td>\n",
       "      <td>-0.072051</td>\n",
       "      <td>0.057339</td>\n",
       "      <td>0.012107</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Education_Other</th>\n",
       "      <td>-0.041466</td>\n",
       "      <td>-0.017898</td>\n",
       "      <td>-0.003893</td>\n",
       "      <td>-0.007969</td>\n",
       "      <td>0.038043</td>\n",
       "      <td>0.064602</td>\n",
       "      <td>0.022992</td>\n",
       "      <td>-0.042163</td>\n",
       "      <td>-0.011895</td>\n",
       "      <td>-0.016724</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.036995</td>\n",
       "      <td>-0.010820</td>\n",
       "      <td>0.017609</td>\n",
       "      <td>-0.033774</td>\n",
       "      <td>-0.006044</td>\n",
       "      <td>-0.008046</td>\n",
       "      <td>0.001594</td>\n",
       "      <td>0.004972</td>\n",
       "      <td>-0.009171</td>\n",
       "      <td>0.005411</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Sales</th>\n",
       "      <td>-0.027549</td>\n",
       "      <td>0.080855</td>\n",
       "      <td>-0.003616</td>\n",
       "      <td>0.014085</td>\n",
       "      <td>0.014215</td>\n",
       "      <td>-0.025606</td>\n",
       "      <td>-0.032017</td>\n",
       "      <td>-0.012047</td>\n",
       "      <td>-0.026107</td>\n",
       "      <td>0.114307</td>\n",
       "      <td>...</td>\n",
       "      <td>0.808869</td>\n",
       "      <td>-0.218320</td>\n",
       "      <td>-0.206425</td>\n",
       "      <td>0.370667</td>\n",
       "      <td>-0.158327</td>\n",
       "      <td>0.035248</td>\n",
       "      <td>-0.126381</td>\n",
       "      <td>0.033002</td>\n",
       "      <td>0.005378</td>\n",
       "      <td>-0.043451</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>R&amp;D</th>\n",
       "      <td>0.017883</td>\n",
       "      <td>-0.085293</td>\n",
       "      <td>0.014871</td>\n",
       "      <td>-0.008117</td>\n",
       "      <td>-0.018604</td>\n",
       "      <td>0.027976</td>\n",
       "      <td>0.015760</td>\n",
       "      <td>0.018686</td>\n",
       "      <td>0.023187</td>\n",
       "      <td>-0.107830</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.733497</td>\n",
       "      <td>0.240754</td>\n",
       "      <td>0.227637</td>\n",
       "      <td>-0.336127</td>\n",
       "      <td>0.174596</td>\n",
       "      <td>-0.071356</td>\n",
       "      <td>-0.263128</td>\n",
       "      <td>-0.009990</td>\n",
       "      <td>-0.019997</td>\n",
       "      <td>0.035158</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Dept_Human Resources</th>\n",
       "      <td>0.020523</td>\n",
       "      <td>0.016832</td>\n",
       "      <td>-0.026726</td>\n",
       "      <td>-0.012901</td>\n",
       "      <td>0.011435</td>\n",
       "      <td>-0.007597</td>\n",
       "      <td>0.035652</td>\n",
       "      <td>-0.016551</td>\n",
       "      <td>0.004789</td>\n",
       "      <td>-0.006157</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.112959</td>\n",
       "      <td>-0.070000</td>\n",
       "      <td>-0.066186</td>\n",
       "      <td>-0.051764</td>\n",
       "      <td>-0.050765</td>\n",
       "      <td>0.087615</td>\n",
       "      <td>0.904983</td>\n",
       "      <td>-0.051443</td>\n",
       "      <td>0.034767</td>\n",
       "      <td>0.016037</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Research Scientist</th>\n",
       "      <td>-0.146518</td>\n",
       "      <td>-0.000360</td>\n",
       "      <td>-0.002624</td>\n",
       "      <td>-0.010986</td>\n",
       "      <td>0.000709</td>\n",
       "      <td>0.001940</td>\n",
       "      <td>0.009745</td>\n",
       "      <td>0.020034</td>\n",
       "      <td>0.047604</td>\n",
       "      <td>-0.387788</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.265775</td>\n",
       "      <td>-0.164700</td>\n",
       "      <td>-0.155727</td>\n",
       "      <td>-0.121792</td>\n",
       "      <td>-0.119442</td>\n",
       "      <td>-0.135949</td>\n",
       "      <td>-0.095342</td>\n",
       "      <td>0.053522</td>\n",
       "      <td>-0.039987</td>\n",
       "      <td>-0.012115</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Laboratory Technician</th>\n",
       "      <td>-0.143176</td>\n",
       "      <td>0.098290</td>\n",
       "      <td>-0.006728</td>\n",
       "      <td>0.012369</td>\n",
       "      <td>-0.063566</td>\n",
       "      <td>-0.001533</td>\n",
       "      <td>0.067793</td>\n",
       "      <td>0.018028</td>\n",
       "      <td>-0.022724</td>\n",
       "      <td>-0.344608</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.246873</td>\n",
       "      <td>-0.152987</td>\n",
       "      <td>-0.144652</td>\n",
       "      <td>-0.113130</td>\n",
       "      <td>-0.110947</td>\n",
       "      <td>-0.126280</td>\n",
       "      <td>-0.088561</td>\n",
       "      <td>0.019873</td>\n",
       "      <td>-0.009233</td>\n",
       "      <td>-0.011224</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Sales Executive</th>\n",
       "      <td>-0.002001</td>\n",
       "      <td>0.019774</td>\n",
       "      <td>-0.000513</td>\n",
       "      <td>0.030761</td>\n",
       "      <td>0.053398</td>\n",
       "      <td>-0.024421</td>\n",
       "      <td>-0.005348</td>\n",
       "      <td>-0.011886</td>\n",
       "      <td>-0.011413</td>\n",
       "      <td>0.127490</td>\n",
       "      <td>...</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>-0.176592</td>\n",
       "      <td>-0.166971</td>\n",
       "      <td>-0.130586</td>\n",
       "      <td>-0.128066</td>\n",
       "      <td>-0.145765</td>\n",
       "      <td>-0.102226</td>\n",
       "      <td>0.006210</td>\n",
       "      <td>0.005751</td>\n",
       "      <td>-0.013853</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Manufacturing Director</th>\n",
       "      <td>0.049726</td>\n",
       "      <td>-0.082994</td>\n",
       "      <td>-0.005302</td>\n",
       "      <td>0.011848</td>\n",
       "      <td>-0.005290</td>\n",
       "      <td>0.059178</td>\n",
       "      <td>-0.065197</td>\n",
       "      <td>-0.014394</td>\n",
       "      <td>-0.021939</td>\n",
       "      <td>0.114896</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.176592</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>-0.103472</td>\n",
       "      <td>-0.080924</td>\n",
       "      <td>-0.079362</td>\n",
       "      <td>-0.090330</td>\n",
       "      <td>-0.063349</td>\n",
       "      <td>-0.021331</td>\n",
       "      <td>0.002819</td>\n",
       "      <td>0.020543</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Healthcare Representative</th>\n",
       "      <td>0.098825</td>\n",
       "      <td>-0.078696</td>\n",
       "      <td>0.040141</td>\n",
       "      <td>0.022916</td>\n",
       "      <td>0.024270</td>\n",
       "      <td>0.014090</td>\n",
       "      <td>0.006823</td>\n",
       "      <td>0.014599</td>\n",
       "      <td>0.001272</td>\n",
       "      <td>0.115704</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.166971</td>\n",
       "      <td>-0.103472</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>-0.076515</td>\n",
       "      <td>-0.075038</td>\n",
       "      <td>-0.085409</td>\n",
       "      <td>-0.059898</td>\n",
       "      <td>-0.030126</td>\n",
       "      <td>0.004913</td>\n",
       "      <td>0.027897</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Sales Representative</th>\n",
       "      <td>-0.175785</td>\n",
       "      <td>0.157234</td>\n",
       "      <td>0.005375</td>\n",
       "      <td>-0.015994</td>\n",
       "      <td>-0.091465</td>\n",
       "      <td>0.002949</td>\n",
       "      <td>-0.028877</td>\n",
       "      <td>-0.018703</td>\n",
       "      <td>-0.027282</td>\n",
       "      <td>-0.216559</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.130586</td>\n",
       "      <td>-0.080924</td>\n",
       "      <td>-0.076515</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>-0.058687</td>\n",
       "      <td>-0.066797</td>\n",
       "      <td>-0.046845</td>\n",
       "      <td>0.072439</td>\n",
       "      <td>-0.023659</td>\n",
       "      <td>-0.052890</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Research Director</th>\n",
       "      <td>0.185891</td>\n",
       "      <td>-0.088870</td>\n",
       "      <td>-0.000021</td>\n",
       "      <td>-0.022351</td>\n",
       "      <td>0.049694</td>\n",
       "      <td>-0.048689</td>\n",
       "      <td>-0.006121</td>\n",
       "      <td>-0.025128</td>\n",
       "      <td>0.015200</td>\n",
       "      <td>0.414319</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.128066</td>\n",
       "      <td>-0.079362</td>\n",
       "      <td>-0.075038</td>\n",
       "      <td>-0.058687</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>-0.065508</td>\n",
       "      <td>-0.045941</td>\n",
       "      <td>-0.042299</td>\n",
       "      <td>0.008271</td>\n",
       "      <td>0.037524</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Manager</th>\n",
       "      <td>0.294248</td>\n",
       "      <td>-0.083316</td>\n",
       "      <td>-0.013224</td>\n",
       "      <td>-0.039190</td>\n",
       "      <td>0.028453</td>\n",
       "      <td>0.010730</td>\n",
       "      <td>-0.033880</td>\n",
       "      <td>0.012659</td>\n",
       "      <td>0.017112</td>\n",
       "      <td>0.552744</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.145765</td>\n",
       "      <td>-0.090330</td>\n",
       "      <td>-0.085409</td>\n",
       "      <td>-0.066797</td>\n",
       "      <td>-0.065508</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>-0.052290</td>\n",
       "      <td>-0.055176</td>\n",
       "      <td>0.049982</td>\n",
       "      <td>0.001997</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Job_Human_Resources</th>\n",
       "      <td>-0.029856</td>\n",
       "      <td>0.036215</td>\n",
       "      <td>-0.021156</td>\n",
       "      <td>-0.024089</td>\n",
       "      <td>-0.005295</td>\n",
       "      <td>-0.022014</td>\n",
       "      <td>0.036082</td>\n",
       "      <td>-0.016189</td>\n",
       "      <td>-0.004952</td>\n",
       "      <td>-0.100922</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.102226</td>\n",
       "      <td>-0.063349</td>\n",
       "      <td>-0.059898</td>\n",
       "      <td>-0.046845</td>\n",
       "      <td>-0.045941</td>\n",
       "      <td>-0.052290</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>-0.052320</td>\n",
       "      <td>0.030995</td>\n",
       "      <td>0.021541</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Marital_single</th>\n",
       "      <td>-0.119185</td>\n",
       "      <td>0.175419</td>\n",
       "      <td>-0.075835</td>\n",
       "      <td>-0.027445</td>\n",
       "      <td>0.004168</td>\n",
       "      <td>0.009035</td>\n",
       "      <td>-0.032752</td>\n",
       "      <td>-0.033436</td>\n",
       "      <td>-0.045253</td>\n",
       "      <td>-0.087072</td>\n",
       "      <td>...</td>\n",
       "      <td>0.006210</td>\n",
       "      <td>-0.021331</td>\n",
       "      <td>-0.030126</td>\n",
       "      <td>0.072439</td>\n",
       "      <td>-0.042299</td>\n",
       "      <td>-0.055176</td>\n",
       "      <td>-0.052320</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>-0.629981</td>\n",
       "      <td>-0.366691</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Marital_married</th>\n",
       "      <td>0.083919</td>\n",
       "      <td>-0.090984</td>\n",
       "      <td>0.040035</td>\n",
       "      <td>0.030232</td>\n",
       "      <td>-0.001865</td>\n",
       "      <td>-0.022180</td>\n",
       "      <td>-0.007804</td>\n",
       "      <td>0.036432</td>\n",
       "      <td>0.028324</td>\n",
       "      <td>0.050547</td>\n",
       "      <td>...</td>\n",
       "      <td>0.005751</td>\n",
       "      <td>0.002819</td>\n",
       "      <td>0.004913</td>\n",
       "      <td>-0.023659</td>\n",
       "      <td>0.008271</td>\n",
       "      <td>0.049982</td>\n",
       "      <td>0.030995</td>\n",
       "      <td>-0.629981</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>-0.491506</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Marital_divorced</th>\n",
       "      <td>0.033120</td>\n",
       "      <td>-0.087716</td>\n",
       "      <td>0.037080</td>\n",
       "      <td>-0.005440</td>\n",
       "      <td>-0.002439</td>\n",
       "      <td>0.016439</td>\n",
       "      <td>0.046076</td>\n",
       "      <td>-0.006150</td>\n",
       "      <td>0.016815</td>\n",
       "      <td>0.037087</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.013853</td>\n",
       "      <td>0.020543</td>\n",
       "      <td>0.027897</td>\n",
       "      <td>-0.052890</td>\n",
       "      <td>0.037524</td>\n",
       "      <td>0.001997</td>\n",
       "      <td>0.021541</td>\n",
       "      <td>-0.366691</td>\n",
       "      <td>-0.491506</td>\n",
       "      <td>1.000000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>50 rows × 50 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                ﻿Age  Attrition  DailyRate  DistanceFromHome  \\\n",
       "﻿Age                        1.000000  -0.159205   0.010661         -0.001686   \n",
       "Attrition                  -0.159205   1.000000  -0.056652          0.077924   \n",
       "DailyRate                   0.010661  -0.056652   1.000000         -0.004985   \n",
       "DistanceFromHome           -0.001686   0.077924  -0.004985          1.000000   \n",
       "Education                   0.208034  -0.031373  -0.016806          0.021042   \n",
       "EnvironmentSatisfaction     0.010146  -0.103369   0.018355         -0.016075   \n",
       "Gender                     -0.036311   0.029453  -0.011716         -0.001851   \n",
       "HourlyRate                  0.024287  -0.006846   0.023381          0.031131   \n",
       "JobInvolvement              0.029820  -0.130016   0.046135          0.008783   \n",
       "JobLevel                    0.509604  -0.169105   0.002966          0.005303   \n",
       "JobSatisfaction            -0.004892  -0.103481   0.030571         -0.003669   \n",
       "MonthlyIncome               0.497855  -0.159840   0.007707         -0.017014   \n",
       "MonthlyRate                 0.028051   0.015170  -0.032182          0.027473   \n",
       "NumCompaniesWorked          0.299635   0.043494   0.038153         -0.029251   \n",
       "OverTime                    0.028062   0.246118   0.009135          0.025514   \n",
       "PercentSalaryHike           0.003634  -0.013478   0.022704          0.040235   \n",
       "PerformanceRating           0.001904   0.002889   0.000473          0.027110   \n",
       "RelationshipSatisfaction    0.053535  -0.045872   0.007846          0.006557   \n",
       "StockOptionLevel            0.037510  -0.137145   0.042143          0.044872   \n",
       "TotalWorkingYears           0.680381  -0.171063   0.014515          0.004628   \n",
       "TrainingTimesLastYear      -0.019621  -0.059478   0.002453         -0.036942   \n",
       "WorkLifeBalance            -0.021490  -0.063939  -0.037848         -0.026556   \n",
       "YearsAtCompany              0.311309  -0.134392  -0.034055          0.009508   \n",
       "YearsInCurrentRole          0.212901  -0.160545   0.009932          0.018845   \n",
       "YearsSinceLastPromotion     0.216513  -0.033019  -0.033229          0.010029   \n",
       "YearsWithCurrManager        0.202089  -0.156199  -0.026363          0.014406   \n",
       "Business_Travel_Rarely      0.028791  -0.049538   0.002078         -0.020116   \n",
       "Business_Travel_Frequently -0.024743   0.115143  -0.011776          0.005081   \n",
       "Business_Non-Travel        -0.011215  -0.074457   0.012096          0.023605   \n",
       "Life Sciences               0.016824  -0.032703   0.004028         -0.024499   \n",
       "Medical                    -0.006354  -0.046999   0.034202          0.013486   \n",
       "Marketing                   0.038162   0.055781  -0.064449          0.039294   \n",
       "Technical Degree           -0.027604   0.069355   0.030869         -0.014802   \n",
       "Education Human Resources   0.001696   0.036466  -0.043144         -0.002624   \n",
       "Education_Other            -0.041466  -0.017898  -0.003893         -0.007969   \n",
       "Sales                      -0.027549   0.080855  -0.003616          0.014085   \n",
       "R&D                         0.017883  -0.085293   0.014871         -0.008117   \n",
       "Dept_Human Resources        0.020523   0.016832  -0.026726         -0.012901   \n",
       "Research Scientist         -0.146518  -0.000360  -0.002624         -0.010986   \n",
       "Laboratory Technician      -0.143176   0.098290  -0.006728          0.012369   \n",
       "Sales Executive            -0.002001   0.019774  -0.000513          0.030761   \n",
       "Manufacturing Director      0.049726  -0.082994  -0.005302          0.011848   \n",
       "Healthcare Representative   0.098825  -0.078696   0.040141          0.022916   \n",
       "Sales Representative       -0.175785   0.157234   0.005375         -0.015994   \n",
       "Research Director           0.185891  -0.088870  -0.000021         -0.022351   \n",
       "Manager                     0.294248  -0.083316  -0.013224         -0.039190   \n",
       "Job_Human_Resources        -0.029856   0.036215  -0.021156         -0.024089   \n",
       "Marital_single             -0.119185   0.175419  -0.075835         -0.027445   \n",
       "Marital_married             0.083919  -0.090984   0.040035          0.030232   \n",
       "Marital_divorced            0.033120  -0.087716   0.037080         -0.005440   \n",
       "\n",
       "                            Education  EnvironmentSatisfaction    Gender  \\\n",
       "﻿Age                         0.208034                 0.010146 -0.036311   \n",
       "Attrition                   -0.031373                -0.103369  0.029453   \n",
       "DailyRate                   -0.016806                 0.018355 -0.011716   \n",
       "DistanceFromHome             0.021042                -0.016075 -0.001851   \n",
       "Education                    1.000000                -0.027128 -0.016547   \n",
       "EnvironmentSatisfaction     -0.027128                 1.000000  0.000508   \n",
       "Gender                      -0.016547                 0.000508  1.000000   \n",
       "HourlyRate                   0.016775                -0.049857 -0.000478   \n",
       "JobInvolvement               0.042438                -0.008278  0.017960   \n",
       "JobLevel                     0.101589                 0.001212 -0.039403   \n",
       "JobSatisfaction             -0.011296                -0.006784  0.033252   \n",
       "MonthlyIncome                0.094961                -0.006259 -0.031858   \n",
       "MonthlyRate                 -0.026084                 0.037600 -0.041482   \n",
       "NumCompaniesWorked           0.126317                 0.012594 -0.039147   \n",
       "OverTime                    -0.020322                 0.070132 -0.041924   \n",
       "PercentSalaryHike           -0.011111                -0.031701  0.002733   \n",
       "PerformanceRating           -0.024539                -0.029548 -0.013859   \n",
       "RelationshipSatisfaction    -0.009118                 0.007665  0.022868   \n",
       "StockOptionLevel             0.018422                 0.003432  0.012716   \n",
       "TotalWorkingYears            0.148280                -0.002693 -0.046881   \n",
       "TrainingTimesLastYear       -0.025100                -0.019359 -0.038787   \n",
       "WorkLifeBalance              0.009819                 0.027627 -0.002753   \n",
       "YearsAtCompany               0.069114                 0.001458 -0.029747   \n",
       "YearsInCurrentRole           0.060236                 0.018007 -0.041483   \n",
       "YearsSinceLastPromotion      0.054254                 0.016194 -0.026985   \n",
       "YearsWithCurrManager         0.069065                -0.004999 -0.030599   \n",
       "Business_Travel_Rarely       0.004126                 0.008496 -0.014682   \n",
       "Business_Travel_Frequently  -0.008292                -0.012624 -0.022015   \n",
       "Business_Non-Travel          0.004524                 0.003568  0.050461   \n",
       "Life Sciences                0.013184                -0.024526  0.006770   \n",
       "Medical                     -0.072335                -0.021299 -0.013146   \n",
       "Marketing                    0.072405                 0.000479 -0.024143   \n",
       "Technical Degree            -0.026742                 0.027713  0.003886   \n",
       "Education Human Resources    0.026479                -0.006898  0.028956   \n",
       "Education_Other              0.038043                 0.064602  0.022992   \n",
       "Sales                        0.014215                -0.025606 -0.032017   \n",
       "R&D                         -0.018604                 0.027976  0.015760   \n",
       "Dept_Human Resources         0.011435                -0.007597  0.035652   \n",
       "Research Scientist           0.000709                 0.001940  0.009745   \n",
       "Laboratory Technician       -0.063566                -0.001533  0.067793   \n",
       "Sales Executive              0.053398                -0.024421 -0.005348   \n",
       "Manufacturing Director      -0.005290                 0.059178 -0.065197   \n",
       "Healthcare Representative    0.024270                 0.014090  0.006823   \n",
       "Sales Representative        -0.091465                 0.002949 -0.028877   \n",
       "Research Director            0.049694                -0.048689 -0.006121   \n",
       "Manager                      0.028453                 0.010730 -0.033880   \n",
       "Job_Human_Resources         -0.005295                -0.022014  0.036082   \n",
       "Marital_single               0.004168                 0.009035 -0.032752   \n",
       "Marital_married             -0.001865                -0.022180 -0.007804   \n",
       "Marital_divorced            -0.002439                 0.016439  0.046076   \n",
       "\n",
       "                            HourlyRate  JobInvolvement  JobLevel  \\\n",
       "﻿Age                          0.024287        0.029820  0.509604   \n",
       "Attrition                    -0.006846       -0.130016 -0.169105   \n",
       "DailyRate                     0.023381        0.046135  0.002966   \n",
       "DistanceFromHome              0.031131        0.008783  0.005303   \n",
       "Education                     0.016775        0.042438  0.101589   \n",
       "EnvironmentSatisfaction      -0.049857       -0.008278  0.001212   \n",
       "Gender                       -0.000478        0.017960 -0.039403   \n",
       "HourlyRate                    1.000000        0.042861 -0.027853   \n",
       "JobInvolvement                0.042861        1.000000 -0.012630   \n",
       "JobLevel                     -0.027853       -0.012630  1.000000   \n",
       "JobSatisfaction              -0.071335       -0.021476 -0.001944   \n",
       "MonthlyIncome                -0.015794       -0.015271  0.950300   \n",
       "MonthlyRate                  -0.015297       -0.016322  0.039563   \n",
       "NumCompaniesWorked            0.022157        0.015012  0.142501   \n",
       "OverTime                     -0.007782       -0.003507  0.000544   \n",
       "PercentSalaryHike            -0.009062       -0.017205 -0.034730   \n",
       "PerformanceRating            -0.002172       -0.029071 -0.021222   \n",
       "RelationshipSatisfaction      0.001330        0.034297  0.021642   \n",
       "StockOptionLevel              0.050263        0.021523  0.013984   \n",
       "TotalWorkingYears            -0.002334       -0.005533  0.782208   \n",
       "TrainingTimesLastYear        -0.008548       -0.015338 -0.018191   \n",
       "WorkLifeBalance              -0.004607       -0.014617  0.037818   \n",
       "YearsAtCompany               -0.019582       -0.021355  0.534739   \n",
       "YearsInCurrentRole           -0.024106        0.008717  0.389447   \n",
       "YearsSinceLastPromotion      -0.026716       -0.024184  0.353885   \n",
       "YearsWithCurrManager         -0.020123        0.025976  0.375281   \n",
       "Business_Travel_Rarely        0.027541        0.026714  0.023433   \n",
       "Business_Travel_Frequently   -0.018819        0.004424 -0.021557   \n",
       "Business_Non-Travel          -0.016994       -0.045779 -0.007295   \n",
       "Life Sciences                 0.038759        0.003228 -0.008431   \n",
       "Medical                      -0.020418        0.017103 -0.014114   \n",
       "Marketing                     0.004452       -0.018657  0.092698   \n",
       "Technical Degree              0.011283       -0.004519 -0.054707   \n",
       "Education Human Resources    -0.033670        0.002079  0.010409   \n",
       "Education_Other              -0.042163       -0.011895 -0.016724   \n",
       "Sales                        -0.012047       -0.026107  0.114307   \n",
       "R&D                           0.018686        0.023187 -0.107830   \n",
       "Dept_Human Resources         -0.016551        0.004789 -0.006157   \n",
       "Research Scientist            0.020034        0.047604 -0.387788   \n",
       "Laboratory Technician         0.018028       -0.022724 -0.344608   \n",
       "Sales Executive              -0.011886       -0.011413  0.127490   \n",
       "Manufacturing Director       -0.014394       -0.021939  0.114896   \n",
       "Healthcare Representative     0.014599        0.001272  0.115704   \n",
       "Sales Representative         -0.018703       -0.027282 -0.216559   \n",
       "Research Director            -0.025128        0.015200  0.414319   \n",
       "Manager                       0.012659        0.017112  0.552744   \n",
       "Job_Human_Resources          -0.016189       -0.004952 -0.100922   \n",
       "Marital_single               -0.033436       -0.045253 -0.087072   \n",
       "Marital_married               0.036432        0.028324  0.050547   \n",
       "Marital_divorced             -0.006150        0.016815  0.037087   \n",
       "\n",
       "                                  ...         Sales Executive  \\\n",
       "﻿Age                              ...               -0.002001   \n",
       "Attrition                         ...                0.019774   \n",
       "DailyRate                         ...               -0.000513   \n",
       "DistanceFromHome                  ...                0.030761   \n",
       "Education                         ...                0.053398   \n",
       "EnvironmentSatisfaction           ...               -0.024421   \n",
       "Gender                            ...               -0.005348   \n",
       "HourlyRate                        ...               -0.011886   \n",
       "JobInvolvement                    ...               -0.011413   \n",
       "JobLevel                          ...                0.127490   \n",
       "JobSatisfaction                   ...                0.012604   \n",
       "MonthlyIncome                     ...                0.047792   \n",
       "MonthlyRate                       ...                0.011854   \n",
       "NumCompaniesWorked                ...                0.005913   \n",
       "OverTime                          ...                0.006341   \n",
       "PercentSalaryHike                 ...               -0.046683   \n",
       "PerformanceRating                 ...               -0.041401   \n",
       "RelationshipSatisfaction          ...               -0.004836   \n",
       "StockOptionLevel                  ...                0.015756   \n",
       "TotalWorkingYears                 ...               -0.012241   \n",
       "TrainingTimesLastYear             ...                0.013241   \n",
       "WorkLifeBalance                   ...                0.032092   \n",
       "YearsAtCompany                    ...                0.042602   \n",
       "YearsInCurrentRole                ...                0.092349   \n",
       "YearsSinceLastPromotion           ...                0.049202   \n",
       "YearsWithCurrManager              ...                0.083028   \n",
       "Business_Travel_Rarely            ...               -0.011920   \n",
       "Business_Travel_Frequently        ...               -0.010175   \n",
       "Business_Non-Travel               ...                0.031022   \n",
       "Life Sciences                     ...               -0.091122   \n",
       "Medical                           ...               -0.133532   \n",
       "Marketing                         ...                0.457308   \n",
       "Technical Degree                  ...               -0.058843   \n",
       "Education Human Resources         ...               -0.073020   \n",
       "Education_Other                   ...               -0.036995   \n",
       "Sales                             ...                0.808869   \n",
       "R&D                               ...               -0.733497   \n",
       "Dept_Human Resources              ...               -0.112959   \n",
       "Research Scientist                ...               -0.265775   \n",
       "Laboratory Technician             ...               -0.246873   \n",
       "Sales Executive                   ...                1.000000   \n",
       "Manufacturing Director            ...               -0.176592   \n",
       "Healthcare Representative         ...               -0.166971   \n",
       "Sales Representative              ...               -0.130586   \n",
       "Research Director                 ...               -0.128066   \n",
       "Manager                           ...               -0.145765   \n",
       "Job_Human_Resources               ...               -0.102226   \n",
       "Marital_single                    ...                0.006210   \n",
       "Marital_married                   ...                0.005751   \n",
       "Marital_divorced                  ...               -0.013853   \n",
       "\n",
       "                            Manufacturing Director  Healthcare Representative  \\\n",
       "﻿Age                                      0.049726                   0.098825   \n",
       "Attrition                                -0.082994                  -0.078696   \n",
       "DailyRate                                -0.005302                   0.040141   \n",
       "DistanceFromHome                          0.011848                   0.022916   \n",
       "Education                                -0.005290                   0.024270   \n",
       "EnvironmentSatisfaction                   0.059178                   0.014090   \n",
       "Gender                                   -0.065197                   0.006823   \n",
       "HourlyRate                               -0.014394                   0.014599   \n",
       "JobInvolvement                           -0.021939                   0.001272   \n",
       "JobLevel                                  0.114896                   0.115704   \n",
       "JobSatisfaction                          -0.013747                   0.016367   \n",
       "MonthlyIncome                             0.055684                   0.068177   \n",
       "MonthlyRate                               0.007711                   0.003829   \n",
       "NumCompaniesWorked                        0.009580                   0.026955   \n",
       "OverTime                                 -0.010302                  -0.000382   \n",
       "PercentSalaryHike                         0.034682                   0.020591   \n",
       "PerformanceRating                         0.029775                  -0.000928   \n",
       "RelationshipSatisfaction                  0.003640                  -0.005090   \n",
       "StockOptionLevel                          0.007735                   0.014021   \n",
       "TotalWorkingYears                         0.064077                   0.112159   \n",
       "TrainingTimesLastYear                    -0.013987                  -0.012432   \n",
       "WorkLifeBalance                           0.002011                  -0.026101   \n",
       "YearsAtCompany                            0.031968                   0.069758   \n",
       "YearsInCurrentRole                        0.067877                   0.054695   \n",
       "YearsSinceLastPromotion                  -0.007241                   0.075902   \n",
       "YearsWithCurrManager                      0.076207                   0.039407   \n",
       "Business_Travel_Rarely                    0.000598                  -0.015503   \n",
       "Business_Travel_Frequently                0.009783                   0.008029   \n",
       "Business_Non-Travel                      -0.013536                   0.012878   \n",
       "Life Sciences                             0.052023                   0.029084   \n",
       "Medical                                   0.035496                   0.034165   \n",
       "Marketing                                -0.115206                  -0.108929   \n",
       "Technical Degree                          0.007817                   0.018681   \n",
       "Education Human Resources                -0.045251                  -0.042785   \n",
       "Education_Other                          -0.010820                   0.017609   \n",
       "Sales                                    -0.218320                  -0.206425   \n",
       "R&D                                       0.240754                   0.227637   \n",
       "Dept_Human Resources                     -0.070000                  -0.066186   \n",
       "Research Scientist                       -0.164700                  -0.155727   \n",
       "Laboratory Technician                    -0.152987                  -0.144652   \n",
       "Sales Executive                          -0.176592                  -0.166971   \n",
       "Manufacturing Director                    1.000000                  -0.103472   \n",
       "Healthcare Representative                -0.103472                   1.000000   \n",
       "Sales Representative                     -0.080924                  -0.076515   \n",
       "Research Director                        -0.079362                  -0.075038   \n",
       "Manager                                  -0.090330                  -0.085409   \n",
       "Job_Human_Resources                      -0.063349                  -0.059898   \n",
       "Marital_single                           -0.021331                  -0.030126   \n",
       "Marital_married                           0.002819                   0.004913   \n",
       "Marital_divorced                          0.020543                   0.027897   \n",
       "\n",
       "                            Sales Representative  Research Director   Manager  \\\n",
       "﻿Age                                   -0.175785           0.185891  0.294248   \n",
       "Attrition                               0.157234          -0.088870 -0.083316   \n",
       "DailyRate                               0.005375          -0.000021 -0.013224   \n",
       "DistanceFromHome                       -0.015994          -0.022351 -0.039190   \n",
       "Education                              -0.091465           0.049694  0.028453   \n",
       "EnvironmentSatisfaction                 0.002949          -0.048689  0.010730   \n",
       "Gender                                 -0.028877          -0.006121 -0.033880   \n",
       "HourlyRate                             -0.018703          -0.025128  0.012659   \n",
       "JobInvolvement                         -0.027282           0.015200  0.017112   \n",
       "JobLevel                               -0.216559           0.414319  0.552744   \n",
       "JobSatisfaction                         0.001413          -0.006217 -0.005620   \n",
       "MonthlyIncome                          -0.201514           0.485818  0.619573   \n",
       "MonthlyRate                            -0.001200           0.025875  0.031717   \n",
       "NumCompaniesWorked                     -0.104494           0.097925  0.042125   \n",
       "OverTime                                0.003347           0.002400 -0.011086   \n",
       "PercentSalaryHike                       0.031102          -0.017017 -0.005394   \n",
       "PerformanceRating                      -0.006214          -0.035744  0.032050   \n",
       "RelationshipSatisfaction               -0.024859          -0.005492  0.025638   \n",
       "StockOptionLevel                       -0.048067           0.015807 -0.015637   \n",
       "TotalWorkingYears                      -0.207726           0.312148  0.465837   \n",
       "TrainingTimesLastYear                   0.040377          -0.004527  0.003052   \n",
       "WorkLifeBalance                         0.045148           0.034403  0.005137   \n",
       "YearsAtCompany                         -0.163464           0.153918  0.330965   \n",
       "YearsInCurrentRole                     -0.149751           0.136332  0.167499   \n",
       "YearsSinceLastPromotion                -0.085622           0.074455  0.224255   \n",
       "YearsWithCurrManager                   -0.168743           0.131279  0.164695   \n",
       "Business_Travel_Rarely                 -0.025257           0.034600  0.027294   \n",
       "Business_Travel_Frequently              0.055469          -0.023579 -0.042583   \n",
       "Business_Non-Travel                    -0.033780          -0.021431  0.014078   \n",
       "Life Sciences                          -0.043208           0.018401 -0.011143   \n",
       "Medical                                -0.051990           0.062898 -0.001128   \n",
       "Marketing                               0.133065          -0.083548  0.025577   \n",
       "Technical Degree                        0.057185          -0.022905 -0.038946   \n",
       "Education Human Resources              -0.033462          -0.032816  0.082271   \n",
       "Education_Other                        -0.033774          -0.006044 -0.008046   \n",
       "Sales                                   0.370667          -0.158327  0.035248   \n",
       "R&D                                    -0.336127           0.174596 -0.071356   \n",
       "Dept_Human Resources                   -0.051764          -0.050765  0.087615   \n",
       "Research Scientist                     -0.121792          -0.119442 -0.135949   \n",
       "Laboratory Technician                  -0.113130          -0.110947 -0.126280   \n",
       "Sales Executive                        -0.130586          -0.128066 -0.145765   \n",
       "Manufacturing Director                 -0.080924          -0.079362 -0.090330   \n",
       "Healthcare Representative              -0.076515          -0.075038 -0.085409   \n",
       "Sales Representative                    1.000000          -0.058687 -0.066797   \n",
       "Research Director                      -0.058687           1.000000 -0.065508   \n",
       "Manager                                -0.066797          -0.065508  1.000000   \n",
       "Job_Human_Resources                    -0.046845          -0.045941 -0.052290   \n",
       "Marital_single                          0.072439          -0.042299 -0.055176   \n",
       "Marital_married                        -0.023659           0.008271  0.049982   \n",
       "Marital_divorced                       -0.052890           0.037524  0.001997   \n",
       "\n",
       "                            Job_Human_Resources  Marital_single  \\\n",
       "﻿Age                                  -0.029856       -0.119185   \n",
       "Attrition                              0.036215        0.175419   \n",
       "DailyRate                             -0.021156       -0.075835   \n",
       "DistanceFromHome                      -0.024089       -0.027445   \n",
       "Education                             -0.005295        0.004168   \n",
       "EnvironmentSatisfaction               -0.022014        0.009035   \n",
       "Gender                                 0.036082       -0.032752   \n",
       "HourlyRate                            -0.016189       -0.033436   \n",
       "JobInvolvement                        -0.004952       -0.045253   \n",
       "JobLevel                              -0.100922       -0.087072   \n",
       "JobSatisfaction                       -0.029681        0.024571   \n",
       "MonthlyIncome                         -0.092250       -0.089361   \n",
       "MonthlyRate                           -0.027470        0.037260   \n",
       "NumCompaniesWorked                     0.020578       -0.019161   \n",
       "OverTime                              -0.014026       -0.006498   \n",
       "PercentSalaryHike                     -0.021032       -0.001386   \n",
       "PerformanceRating                     -0.010154       -0.001045   \n",
       "RelationshipSatisfaction               0.044169        0.040817   \n",
       "StockOptionLevel                      -0.009864       -0.638957   \n",
       "TotalWorkingYears                     -0.076482       -0.089529   \n",
       "TrainingTimesLastYear                 -0.035902        0.024129   \n",
       "WorkLifeBalance                        0.043887        0.014921   \n",
       "YearsAtCompany                        -0.052569       -0.070935   \n",
       "YearsInCurrentRole                    -0.057876       -0.086486   \n",
       "YearsSinceLastPromotion               -0.054603       -0.053090   \n",
       "YearsWithCurrManager                  -0.051006       -0.047793   \n",
       "Business_Travel_Rarely                 0.008962       -0.020808   \n",
       "Business_Travel_Frequently             0.001896        0.027734   \n",
       "Business_Non-Travel                   -0.015890       -0.004622   \n",
       "Life Sciences                         -0.063119        0.021469   \n",
       "Medical                               -0.042895       -0.004249   \n",
       "Marketing                             -0.066690       -0.013323   \n",
       "Technical Degree                      -0.008623        0.014265   \n",
       "Education Human Resources              0.549751       -0.072051   \n",
       "Education_Other                        0.001594        0.004972   \n",
       "Sales                                 -0.126381        0.033002   \n",
       "R&D                                   -0.263128       -0.009990   \n",
       "Dept_Human Resources                   0.904983       -0.051443   \n",
       "Research Scientist                    -0.095342        0.053522   \n",
       "Laboratory Technician                 -0.088561        0.019873   \n",
       "Sales Executive                       -0.102226        0.006210   \n",
       "Manufacturing Director                -0.063349       -0.021331   \n",
       "Healthcare Representative             -0.059898       -0.030126   \n",
       "Sales Representative                  -0.046845        0.072439   \n",
       "Research Director                     -0.045941       -0.042299   \n",
       "Manager                               -0.052290       -0.055176   \n",
       "Job_Human_Resources                    1.000000       -0.052320   \n",
       "Marital_single                        -0.052320        1.000000   \n",
       "Marital_married                        0.030995       -0.629981   \n",
       "Marital_divorced                       0.021541       -0.366691   \n",
       "\n",
       "                            Marital_married  Marital_divorced  \n",
       "﻿Age                               0.083919          0.033120  \n",
       "Attrition                         -0.090984         -0.087716  \n",
       "DailyRate                          0.040035          0.037080  \n",
       "DistanceFromHome                   0.030232         -0.005440  \n",
       "Education                         -0.001865         -0.002439  \n",
       "EnvironmentSatisfaction           -0.022180          0.016439  \n",
       "Gender                            -0.007804          0.046076  \n",
       "HourlyRate                         0.036432         -0.006150  \n",
       "JobInvolvement                     0.028324          0.016815  \n",
       "JobLevel                           0.050547          0.037087  \n",
       "JobSatisfaction                   -0.010315         -0.015197  \n",
       "MonthlyIncome                      0.056767          0.032203  \n",
       "MonthlyRate                       -0.034689         -0.000227  \n",
       "NumCompaniesWorked                -0.016142          0.040824  \n",
       "OverTime                          -0.013502          0.023462  \n",
       "PercentSalaryHike                  0.020895         -0.023478  \n",
       "PerformanceRating                  0.009585         -0.010310  \n",
       "RelationshipSatisfaction          -0.043382          0.006199  \n",
       "StockOptionLevel                   0.225574          0.446285  \n",
       "TotalWorkingYears                  0.053512          0.036291  \n",
       "TrainingTimesLastYear             -0.029602          0.008405  \n",
       "WorkLifeBalance                   -0.006388         -0.009080  \n",
       "YearsAtCompany                     0.044925          0.025728  \n",
       "YearsInCurrentRole                 0.065488          0.018532  \n",
       "YearsSinceLastPromotion            0.054102         -0.005279  \n",
       "YearsWithCurrManager               0.032972          0.014095  \n",
       "Business_Travel_Rarely             0.055613         -0.043287  \n",
       "Business_Travel_Frequently        -0.030785          0.005779  \n",
       "Business_Non-Travel               -0.043635          0.057455  \n",
       "Life Sciences                     -0.017866         -0.002672  \n",
       "Medical                           -0.007139          0.013316  \n",
       "Marketing                          0.018491         -0.007212  \n",
       "Technical Degree                   0.002710         -0.019243  \n",
       "Education Human Resources          0.057339          0.012107  \n",
       "Education_Other                   -0.009171          0.005411  \n",
       "Sales                              0.005378         -0.043451  \n",
       "R&D                               -0.019997          0.035158  \n",
       "Dept_Human Resources               0.034767          0.016037  \n",
       "Research Scientist                -0.039987         -0.012115  \n",
       "Laboratory Technician             -0.009233         -0.011224  \n",
       "Sales Executive                    0.005751         -0.013853  \n",
       "Manufacturing Director             0.002819          0.020543  \n",
       "Healthcare Representative          0.004913          0.027897  \n",
       "Sales Representative              -0.023659         -0.052890  \n",
       "Research Director                  0.008271          0.037524  \n",
       "Manager                            0.049982          0.001997  \n",
       "Job_Human_Resources                0.030995          0.021541  \n",
       "Marital_single                    -0.629981         -0.366691  \n",
       "Marital_married                    1.000000         -0.491506  \n",
       "Marital_divorced                  -0.491506          1.000000  \n",
       "\n",
       "[50 rows x 50 columns]"
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.corr()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Dividing data into train and test dataset"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "441"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from sklearn.cross_validation import train_test_split\n",
    "#from random import seed\n",
    "\n",
    "#seed(20)\n",
    "train_x = data.drop(['Attrition'],axis=1)\n",
    "train_y = data['Attrition']\n",
    "\n",
    "X,test_x,Y,test_y = train_test_split(train_x, train_y, test_size=0.3,random_state=20)\n",
    "len(test_x)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Applying Loigistic Regression to our model"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "LogisticRegression(C=1.0, class_weight=None, dual=False, fit_intercept=True,\n",
       "          intercept_scaling=1, max_iter=100, multi_class='ovr', n_jobs=1,\n",
       "          penalty='l2', random_state=None, solver='liblinear', tol=0.0001,\n",
       "          verbose=0, warm_start=False)"
      ]
     },
     "execution_count": 20,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from sklearn.linear_model import LogisticRegression\n",
    "\n",
    "#Y=Y.astype('int')\n",
    "\n",
    "clf = LogisticRegression()\n",
    "clf.fit(np.array(X),Y)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Calculating accuracy of our model"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "collapsed": false,
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.873015873015873"
      ]
     },
     "execution_count": 21,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from sklearn.metrics import accuracy_score\n",
    "\n",
    "pred_y = clf.predict(test_x)\n",
    "\n",
    "accuracy = accuracy_score(test_y, pred_y, normalize=True, sample_weight=None)\n",
    "accuracy"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Getting quantitative estimates of our model"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "             precision    recall  f1-score   support\n",
      "\n",
      "          0       0.88      0.98      0.93       371\n",
      "          1       0.77      0.29      0.42        70\n",
      "\n",
      "avg / total       0.86      0.87      0.85       441\n",
      "\n"
     ]
    }
   ],
   "source": [
    "from sklearn.metrics import classification_report\n",
    "\n",
    "print(classification_report(test_y, pred_y))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### We have applied logistic model to the data getting an accuracy of 87.30%. As it is clear from our model that we are getting low value of recall for true value of attrition ,i.e., we are not getting enough of the relevant information from the data. The retrieved model shows high senstivity but low specifity.\n",
    "\n",
    "Now ,we will try a new model with few less relevant features trimmed out from our dataset."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Applying Recursive Feature Elimination (RFE) for feature selection"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[False False False False  True  True False  True  True  True False False\n",
      "  True  True False  True  True  True  True  True  True  True  True  True\n",
      "  True  True  True  True  True  True  True  True  True  True  True  True\n",
      "  True False  True  True  True  True  True  True  True  True  True  True\n",
      "  True]\n",
      "[ 5  8  2  6  1  1  7  1  1  1  9 10  1  1  3  1  1  1  1  1  1  1  1  1\n",
      "  1  1  1  1  1  1  1  1  1  1  1  1  1  4  1  1  1  1  1  1  1  1  1  1\n",
      "  1]\n"
     ]
    }
   ],
   "source": [
    "from sklearn.feature_selection import RFE\n",
    "\n",
    "rfe = RFE(clf,40)\n",
    "rfe = rfe.fit(train_x,train_y)\n",
    "print(rfe.support_)\n",
    "print(rfe.ranking_)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Transforming our data to desired no. of features"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(1029, 40)"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "X =rfe.transform(X)\n",
    "X.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(441, 40)"
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "test_x = rfe.transform(test_x)\n",
    "test_x.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Calculating accuracy of our modified model"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.8798185941043084"
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from sklearn.metrics import accuracy_score\n",
    "\n",
    "clf.fit(X,Y)\n",
    "pred_y = clf.predict(test_x)\n",
    "\n",
    "accuracy = accuracy_score(test_y, pred_y, normalize=True, sample_weight=None)\n",
    "accuracy"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Quantitative estimates of our transformed model"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "             precision    recall  f1-score   support\n",
      "\n",
      "          0       0.90      0.96      0.93       371\n",
      "          1       0.70      0.43      0.53        70\n",
      "\n",
      "avg / total       0.87      0.88      0.87       441\n",
      "\n"
     ]
    }
   ],
   "source": [
    "from sklearn.metrics import classification_report\n",
    "\n",
    "print(classification_report(test_y, pred_y))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Thus, we see a slight increase in accuracy of our model. We have trimmed our dataset to 40 features. Though we are reporting a decrease in precision of attried employees, we are getting a noticeable increase in recall and F-score.This ultimately results in increase of specificity of our model.This model also reduces our memory space and processing time as the operations to be performed are much less than former.\n",
    "\n",
    "We can work for better accuracies by changing number of features for selection and other parameters."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python [Root]",
   "language": "python",
   "name": "Python [Root]"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}