homework/Day_029_HW.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "# 作業 : (Kaggle)鐵達尼生存預測"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# [作業目標]\n",
    "- 試著模仿範例寫法, 在鐵達尼生存預測中, 練習特徵重要性的寫作與觀察"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# [作業重點]\n",
    "- 仿造範例, 完成特徵重要性的計算, 並觀察對預測結果的影響 (In[3]~[5], Out[3]~[5]) \n",
    "- 仿造範例, 將兩個特徵重要性最高的特徵重組出新特徵, 並觀察對預測結果的影響 (In[8], Out[8]) "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2019-05-22T01:44:10.360476Z",
     "start_time": "2019-05-22T01:44:09.479616Z"
    }
   },
   "outputs": [],
   "source": [
    "# 做完特徵工程前的所有準備 (與前範例相同)\n",
    "import pandas as pd\n",
    "import numpy as np\n",
    "import copy\n",
    "from sklearn.preprocessing import LabelEncoder, MinMaxScaler\n",
    "from sklearn.model_selection import cross_val_score\n",
    "from sklearn.ensemble import GradientBoostingClassifier"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2019-05-22T01:44:11.429778Z",
     "start_time": "2019-05-22T01:44:11.392722Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Pclass</th>\n",
       "      <th>Name</th>\n",
       "      <th>Sex</th>\n",
       "      <th>Age</th>\n",
       "      <th>SibSp</th>\n",
       "      <th>Parch</th>\n",
       "      <th>Ticket</th>\n",
       "      <th>Fare</th>\n",
       "      <th>Cabin</th>\n",
       "      <th>Embarked</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>3</td>\n",
       "      <td>Braund, Mr. Owen Harris</td>\n",
       "      <td>male</td>\n",
       "      <td>22.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>A/5 21171</td>\n",
       "      <td>7.2500</td>\n",
       "      <td>NaN</td>\n",
       "      <td>S</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>Cumings, Mrs. John Bradley (Florence Briggs Th...</td>\n",
       "      <td>female</td>\n",
       "      <td>38.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>PC 17599</td>\n",
       "      <td>71.2833</td>\n",
       "      <td>C85</td>\n",
       "      <td>C</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3</td>\n",
       "      <td>Heikkinen, Miss. Laina</td>\n",
       "      <td>female</td>\n",
       "      <td>26.0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>STON/O2. 3101282</td>\n",
       "      <td>7.9250</td>\n",
       "      <td>NaN</td>\n",
       "      <td>S</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>Futrelle, Mrs. Jacques Heath (Lily May Peel)</td>\n",
       "      <td>female</td>\n",
       "      <td>35.0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>113803</td>\n",
       "      <td>53.1000</td>\n",
       "      <td>C123</td>\n",
       "      <td>S</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>3</td>\n",
       "      <td>Allen, Mr. William Henry</td>\n",
       "      <td>male</td>\n",
       "      <td>35.0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>373450</td>\n",
       "      <td>8.0500</td>\n",
       "      <td>NaN</td>\n",
       "      <td>S</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Pclass                                               Name     Sex   Age  \\\n",
       "0       3                            Braund, Mr. Owen Harris    male  22.0   \n",
       "1       1  Cumings, Mrs. John Bradley (Florence Briggs Th...  female  38.0   \n",
       "2       3                             Heikkinen, Miss. Laina  female  26.0   \n",
       "3       1       Futrelle, Mrs. Jacques Heath (Lily May Peel)  female  35.0   \n",
       "4       3                           Allen, Mr. William Henry    male  35.0   \n",
       "\n",
       "   SibSp  Parch            Ticket     Fare Cabin Embarked  \n",
       "0      1      0         A/5 21171   7.2500   NaN        S  \n",
       "1      1      0          PC 17599  71.2833   C85        C  \n",
       "2      0      0  STON/O2. 3101282   7.9250   NaN        S  \n",
       "3      1      0            113803  53.1000  C123        S  \n",
       "4      0      0            373450   8.0500   NaN        S  "
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data_path = 'data/'\n",
    "df = pd.read_csv(data_path + 'titanic_train.csv')\n",
    "\n",
    "train_Y = df['Survived']\n",
    "df = df.drop(['PassengerId', 'Survived'] , axis = 1)\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2019-05-22T01:44:12.512990Z",
     "start_time": "2019-05-22T01:44:12.472523Z"
    }
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/Users/jasonch/anaconda3/lib/python3.6/site-packages/sklearn/utils/validation.py:595: DataConversionWarning: Data with input dtype int64 was converted to float64 by MinMaxScaler.\n",
      "  warnings.warn(msg, DataConversionWarning)\n",
      "/Users/jasonch/anaconda3/lib/python3.6/site-packages/sklearn/utils/validation.py:595: DataConversionWarning: Data with input dtype int64 was converted to float64 by MinMaxScaler.\n",
      "  warnings.warn(msg, DataConversionWarning)\n",
      "/Users/jasonch/anaconda3/lib/python3.6/site-packages/sklearn/utils/validation.py:595: DataConversionWarning: Data with input dtype int64 was converted to float64 by MinMaxScaler.\n",
      "  warnings.warn(msg, DataConversionWarning)\n",
      "/Users/jasonch/anaconda3/lib/python3.6/site-packages/sklearn/utils/validation.py:595: DataConversionWarning: Data with input dtype int64 was converted to float64 by MinMaxScaler.\n",
      "  warnings.warn(msg, DataConversionWarning)\n",
      "/Users/jasonch/anaconda3/lib/python3.6/site-packages/sklearn/utils/validation.py:595: DataConversionWarning: Data with input dtype int64 was converted to float64 by MinMaxScaler.\n",
      "  warnings.warn(msg, DataConversionWarning)\n",
      "/Users/jasonch/anaconda3/lib/python3.6/site-packages/sklearn/utils/validation.py:595: DataConversionWarning: Data with input dtype int64 was converted to float64 by MinMaxScaler.\n",
      "  warnings.warn(msg, DataConversionWarning)\n",
      "/Users/jasonch/anaconda3/lib/python3.6/site-packages/sklearn/utils/validation.py:595: DataConversionWarning: Data with input dtype int64 was converted to float64 by MinMaxScaler.\n",
      "  warnings.warn(msg, DataConversionWarning)\n",
      "/Users/jasonch/anaconda3/lib/python3.6/site-packages/sklearn/utils/validation.py:595: DataConversionWarning: Data with input dtype int64 was converted to float64 by MinMaxScaler.\n",
      "  warnings.warn(msg, DataConversionWarning)\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Pclass</th>\n",
       "      <th>Name</th>\n",
       "      <th>Sex</th>\n",
       "      <th>Age</th>\n",
       "      <th>SibSp</th>\n",
       "      <th>Parch</th>\n",
       "      <th>Ticket</th>\n",
       "      <th>Fare</th>\n",
       "      <th>Cabin</th>\n",
       "      <th>Embarked</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.121348</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.283951</td>\n",
       "      <td>0.125</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.769118</td>\n",
       "      <td>0.014151</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0.0</td>\n",
       "      <td>0.213483</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.481481</td>\n",
       "      <td>0.125</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.876471</td>\n",
       "      <td>0.139136</td>\n",
       "      <td>0.557823</td>\n",
       "      <td>0.333333</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.396629</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.333333</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.983824</td>\n",
       "      <td>0.015469</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>0.0</td>\n",
       "      <td>0.305618</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.444444</td>\n",
       "      <td>0.125</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.072059</td>\n",
       "      <td>0.103644</td>\n",
       "      <td>0.380952</td>\n",
       "      <td>1.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1.0</td>\n",
       "      <td>0.016854</td>\n",
       "      <td>1.0</td>\n",
       "      <td>0.444444</td>\n",
       "      <td>0.000</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.694118</td>\n",
       "      <td>0.015713</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.000000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Pclass      Name  Sex       Age  SibSp  Parch    Ticket      Fare  \\\n",
       "0     1.0  0.121348  1.0  0.283951  0.125    0.0  0.769118  0.014151   \n",
       "1     0.0  0.213483  0.0  0.481481  0.125    0.0  0.876471  0.139136   \n",
       "2     1.0  0.396629  0.0  0.333333  0.000    0.0  0.983824  0.015469   \n",
       "3     0.0  0.305618  0.0  0.444444  0.125    0.0  0.072059  0.103644   \n",
       "4     1.0  0.016854  1.0  0.444444  0.000    0.0  0.694118  0.015713   \n",
       "\n",
       "      Cabin  Embarked  \n",
       "0  0.000000  1.000000  \n",
       "1  0.557823  0.333333  \n",
       "2  0.000000  1.000000  \n",
       "3  0.380952  1.000000  \n",
       "4  0.000000  1.000000  "
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# 因為需要把類別型與數值型特徵都加入, 故使用最簡版的特徵工程\n",
    "LEncoder = LabelEncoder()\n",
    "MMEncoder = MinMaxScaler()\n",
    "\n",
    "for c in df.columns:\n",
    "    df[c] = df[c].fillna(-1)\n",
    "    if df[c].dtype == 'object':\n",
    "        df[c] = LEncoder.fit_transform(list(df[c].values))\n",
    "    df[c] = MMEncoder.fit_transform(df[c].values.reshape(-1, 1))\n",
    "\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2019-05-22T01:44:13.685541Z",
     "start_time": "2019-05-22T01:44:13.562611Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Sex         0.443961\n",
       "Pclass      0.111901\n",
       "Ticket      0.097155\n",
       "Fare        0.088285\n",
       "Name        0.082338\n",
       "Age         0.073264\n",
       "Cabin       0.071533\n",
       "Embarked    0.012220\n",
       "Parch       0.011581\n",
       "SibSp       0.007761\n",
       "dtype: float64"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# 梯度提升樹擬合後, 將結果依照重要性由高到低排序 (note : D27作業中'Ticket'是第一名特徵, 'Age'是數值特徵中排名最高者)\n",
    "estimator = GradientBoostingClassifier()\n",
    "estimator.fit(df.values, train_Y)\n",
    "feats = pd.Series(data = estimator.feature_importances_, index = df.columns)\n",
    "feats = feats.sort_values(ascending = False)\n",
    "feats"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 先用梯度提升機對鐵達尼生存預測做訓練，再用其特徵重要性回答下列問題\n",
    "\n",
    "# 作業1\n",
    "* 將特徵重要性較低的一半特徵刪除後，再做生存率預估，正確率是否有變化?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2019-05-22T01:44:20.189918Z",
     "start_time": "2019-05-22T01:44:19.728444Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.8215972695810002"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# 原始特徵 + 梯度提升樹\n",
    "train_X = MMEncoder.fit_transform(df)\n",
    "cross_val_score(estimator, train_X, train_Y, cv = 5).mean()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2019-05-22T01:47:16.374111Z",
     "start_time": "2019-05-22T01:47:15.981996Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.8125895324717789"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# 高重要性特徵 + 梯度提升樹 \n",
    "\"\"\"\n",
    "Your Code Here\n",
    "\"\"\"\n",
    "high_feature = list(feats[:5].index)\n",
    "train_X = MMEncoder.fit_transform(df[high_feature])\n",
    "cross_val_score(estimator, train_X, train_Y, cv = 5).mean()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 作業2\n",
    "* 將特徵重要性最高的兩個特徵做特徵組合，是否能再進一步提升預測力?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2019-05-22T01:47:38.891279Z",
     "start_time": "2019-05-22T01:47:38.481178Z"
    }
   },
   "outputs": [],
   "source": [
    "import seaborn as sns\n",
    "import matplotlib.pyplot as plt"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2019-05-22T01:47:50.014752Z",
     "start_time": "2019-05-22T01:47:49.777220Z"
    }
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYUAAAEKCAYAAAD9xUlFAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAGVtJREFUeJzt3X2UXHd93/H3Z2Z29WBJlizJwViyJRc5xvi4MWcxpuQYuTZU+PRIbeMDcqGF1MVuGkOxIYl7QgkV5bSBBo5zMMVKISFuYyHoCWxzTEwLdkyNRbV+QCDZpopk0PoBrW1Z1vM+zLd/3Ls/j1azO3dXc3e00ud1jq25M7+59/u7c3c+c58VEZiZmQFUOl2AmZmdOhwKZmaWOBTMzCxxKJiZWeJQMDOzxKFgZmaJQ8HMzBKHgpmZJQ4FMzNLap0uYLKWLFkSK1as6HQZZmYzyqOPPvpiRCxt1W7GhcKKFSvo6+vrdBlmZjOKpJ8XaefNR2ZmljgUzMwscSiYmVniUDAzs8ShYGZmSWlHH0n6KvAPgb0RcVmT1wXcCVwPHAY+GBGPlVHLbZse41tPPM9EtxOqCmrVCkvP6mL+nG6efeUIhwZHGKmfGjchqghalSKBgAgm7OvcrgqHh+qTmr5EGmmrObJ4bg0khkaC7lqFVefO520XncPmvj08+8rR9P7uqpjdVQXg8OAww01Kqij7d2zfK8Cvvm4+v7fmElZfci4PPrWXP/zrp9j14qH8M4um44NsHlUqYla1QqUSVFShu1Zh6bxZRAQvHhpkcLhOV1Vc/CsLuOXqi1h9ybnp/bdteoxv//j542qq5POncZJvW7mIe2/5ey3m1msefGovdz+0i5/98tUT5t0ju15mz77DLF80Nw1vf24/hwZHqNeD+bNrvP7sWfxs76ET6oqA+bNrvOm8+Wx//gCHBkc4q7vK68+exdO/PHTc51kTDE/wAVcEc7srLFs4F0nsPXCUI0N1jg6OMHZ2d1Xg7Lndab4eHBw5rv7/t/fAuPO52bwYHc/AwWMcHhxhuJ4t6JWKODbehz0Fs6rZslt0jF1VMTwS4/5dLJ7bxbkLZnPg2HDq/30/eZ7dLx3O3l+BQ0N1xrvf2axahesv+xVeeHUwLQNjl8l2Ull3XpN0NXAQ+PNxQuF64MNkofBW4M6IeGur8fb09MRkDkm9bdNj/OUTzxermdZfeFZcV1WQfyHtOzxUyrxdOq+bf3bVhdyz5efZNCIYmeSEKnmYjoqAajV7ZvFZ3XTXqmxY+yZWX3LupJYnKB4MDz61l0/2bmdweISXDg3mhWTzbv/RYZbO62bJvFm8dOgYew8MMqcmDg5O/ouwAnTVxLGJvvkLjgeAAj9WqgJJnL9wNoMjdfYeGGTB7CoHj46kGd84n4ET5kU9n8joD56Z9ncq4IJz5jA4UueXrx6DgFpVDE5iYT1nbhevXziHI0MjDI1EWiYL1yA9GhE9rdqVtvkoIh4CXp6gyTqywIiI2AIslHReu+vo3fZC4bYzbUE71dUqFSoV8cqRcgIB4MDRYf7r/9nNgaPDVCua8nTqZF9u9YBQXjviwNFhuqri7od2AZNbngAe2b2vULu7H9pFVzWbXgUdN+8qyvopiVePDFMRHBysI/I1uEn2s6KT/7Ovk82nIivSdaAq8eLBwVT//iPDVCpqOp+bzYt6vhY2EwMBsppH+5+v4FCtTO5zeOXIEJKY2107bplst06evHY+sKdhuD9/7oSfYZJuBm4GuOCCCyY1kVNl88+ZSgW/OKZquF5naDAQQa1aGXcVfCKj70lvzR9IMDhSZ05Xlf592ap+WcvTnn2HWTini8GROtX8m3503nXldUD2b2WSQVCWwvM6XpuXkK2ZDcVrgTZ2PgecMC8CUIvNoqe60f7D1PrRuOg1LpPt1skdzc0W7abzKiI2RkRPRPQsXdryLO3jVE+Vv6AzVASlfonVKhXO6q5Sq2SBMNlfzpC/J9+E1PjrOwK6qxWODI2wbNFcoLzlafmiuRwZGqG7IdhG5109rwOyf0+V3zmF57Vem5ej9Y/u64AT53OzeaH8fzP5r3m0/zC1fjQueo3LZLt1MhT6geUNw8uA59o9kbWXv65w25m8wJ2Khut16vVg4Zyu0ubt/Nk1/uWvr2T+7Boj9ZjydCpkf3QVZb9Ih+t16mQ7cIdGgluuvgiY3PIE2T6FIm65+iKGRrLp1Ynj5l0937cQESyYU6MeMK+7km1Kmez+E6AeJ79TtkI2n4pkZAUYiWDJvO5U/9lzatTr0XQ+N5sXFeXTZGb+nQpS/0f3YY3UJ/c5LJzTRURweHD4uGWy3Tq5+agXuFXSJrIdzfsjovgevIK+sP7NgI8+ajSVo4+O+2XXou3iuTWkbCda0aOPjgwO06ykokcfXb5sYTr6qFIPouDRR9VKoHGOPuquipVL5h13pMfo8tTuo49WX3IuG8j2LQyPvHrCvHtk18v07zvMisXzuPEtJ3/00YK8/VSOPjqru8L5+dFHAweOcrjg0UeHBkeOq3/06KNm87nZvEifz8FjHJqBRx8dPDac9/+CdPTRrJomdfRR/77DLJvBRx/dC6wGlgC/BP4A6AKIiC/nh6R+EVhDdkjqb0ZEy8OKJnv0kZmZFT/6qLQ1hYi4scXrAfx2WdM3M7PJ8xnNZmaWOBTMzCxxKJiZWeJQMDOzxKFgZmaJQ8HMzBKHgpmZJQ4FMzNLHApmZpY4FMzMLHEomJlZ4lAwM7PEoWBmZolDwczMEoeCmZklDgUzM0scCmZmljgUzMwscSiYmVniUDAzs8ShYGZmiUPBzMwSh4KZmSUOBTMzSxwKZmaWOBTMzCxxKJiZWeJQMDOzxKFgZmaJQ8HMzJJSQ0HSGklPS9op6Y4mr18g6QFJj0vaJun6MusxM7OJlRYKkqrAXcC7gUuBGyVdOqbZJ4DNEXEFsB74Uln1mJlZa2WuKVwJ7IyIXRExCGwC1o1pE8CC/PHZwHMl1mNmZi3UShz3+cCehuF+4K1j2nwK+K6kDwNnAdeVWI+ZmbVQ5pqCmjwXY4ZvBP4sIpYB1wP3SDqhJkk3S+qT1DcwMFBCqWZmBuWGQj+wvGF4GSduHroJ2AwQEY8As4ElY0cUERsjoiciepYuXVpSuWZmVmYobAVWSVopqZtsR3LvmDa/AK4FkPRGslDwqoCZWYeUFgoRMQzcCtwPPEl2lNF2SRskrc2bfQz4kKQfA/cCH4yIsZuYzMxsmpS5o5mIuA+4b8xzn2x4vAN4e5k1mJlZcT6j2czMEoeCmZklDgUzM0scCmZmljgUzMwscSiYmVniUDAzs8ShYGZmiUPBzMwSh4KZmSUOBTMzSxwKZmaWOBTMzCxxKJiZWeJQMDOzxKFgZmaJQ8HMzBKHgpmZJQ4FMzNLHApmZpY4FMzMLHEomJlZ4lAwM7PEoWBmZolDwczMEoeCmZklDgUzM0scCmZmljgUzMwscSiYmVniUDAzs6TUUJC0RtLTknZKumOcNu+RtEPSdkl/UWY9ZmY2sVpZI5ZUBe4C3gn0A1sl9UbEjoY2q4B/C7w9IvZJOreseszMrLUy1xSuBHZGxK6IGAQ2AevGtPkQcFdE7AOIiL0l1mNmZi2UGQrnA3sahvvz5xpdDFws6WFJWyStaTYiSTdL6pPUNzAwUFK5ZmY24eYjSQeAGO/1iFgw0dubvaXJ9FcBq4FlwA8kXRYRr4yZzkZgI0BPT8+49ZiZ2cmZMBQiYj6ApA3AC8A9ZF/27wPmtxh3P7C8YXgZ8FyTNlsiYgjYLelpspDYWrQDZmbWPkU3H/2DiPhSRByIiFcj4r8Av9HiPVuBVZJWSuoG1gO9Y9p8C7gGQNISss1Ju4qXb2Zm7VQ0FEYkvU9SVVJF0vuAkYneEBHDwK3A/cCTwOaI2C5pg6S1ebP7gZck7QAeAH4nIl6aWlfMzOxkKaL1JnpJK4A7gbeT7Rd4GPhoRDxTYm1N9fT0RF9f33RP1sxsRpP0aET0tGpX6DyF/Mt/7OGkZmZ2mim0+UjSxZK+J+mn+fDlkj5RbmlmZjbdiu5T+BOyM4+HACJiG9mOYzMzO40UDYW5EfF/xzw33O5izMyss4qGwouS/g75yWeSbgCeL60qMzPriKIXxPttsjOKL5H0LLCb7AQ2MzM7jRQNhZ9HxHWSzgIqEXGgzKLMzKwzim4+2i1pI3AVcLDEeszMrIOKhsKvAv+bbDPSbklflPTr5ZVlZmadUCgUIuJIRGyOiH8CXAEsAP6m1MrMzGzaFb6fgqR3SPoS8BgwG3hPaVWZmVlHFNrRLGk38ASwmeyidYdKrcrMzDqi6NFHfzciXi21EjMz67hWd1773Yj4LPAZSSdcTjUiPlJaZWZmNu1arSk8mf/ra1WbmZ0BWt2O83/mD7dFxOPTUI+ZmXVQ0aOPPi/pKUmflvSmUisyM7OOKXqewjXAamAA2CjpJ76fgpnZ6afweQoR8UJE/DHwr8gOT/1kaVWZmVlHFL3z2hslfSq/89oXgR8Cy0qtzMzMpl3R8xT+FLgXeFdEPFdiPWZm1kEtQ0FSFfjbiLhzGuoxM7MOarn5KCJGgMWSuqehHjMz66DCN9kBHpbUC6TrHkXE50upyszMOqJoKDyX/1cB5pdXjpmZdVKhUIiIf192IWZm1nlFL539ANDsgnh/v+0VmZlZxxTdfPTxhsezgd8AhttfjpmZdVLRzUePjnnqYUm+HaeZ2Wmm6OajcxoGK0AP8LpSKjIzs44peu2jR8nuqdBHdomL24GbWr1J0hpJT0vaKemOCdrdICkk9RSsx8zMStDqzmtvAfZExMp8+ANk+xOeAXa0eG8VuAt4J9APbJXUGxE7xrSbD3wE+NEU+2BmZm3Sak3hbmAQQNLVwH8EvgbsBza2eO+VwM6I2BURg8AmYF2Tdp8GPgscnUTdZmZWglahUI2Il/PH7wU2RsT/iIh/B7yhxXvPB/Y0DPfnzyWSrgCWR8RfTaJmMzMrSctQkDS6iela4PsNr7XaSa0mz6VzHSRVgC8AH2tVpKSbJfVJ6hsYGGjV3MzMpqhVKNwL/I2kbwNHgB8ASHoD2SakifQDyxuGl5FdKmPUfOAy4EFJzwBXAb3NdjZHxMaI6ImInqVLl7aYrJmZTdWEv/Yj4jOSvgecB3w3IkZ/6VeAD7cY91ZglaSVwLPAeuCfNox7P7BkdFjSg8DHI6Jvsp0wM7P2aHmeQkRsafLczwq8b1jSrcD9QBX4akRsl7QB6IuI3qkUbGZm5Sl6mYspiYj7gPvGPNf03s4RsbrMWszMrLWiJ6+ZmdkZwKFgZmaJQ8HMzBKHgpmZJQ4FMzNLHApmZpY4FMzMLHEomJlZ4lAwM7PEoWBmZolDwczMEoeCmZklDgUzM0scCmZmljgUzMwscSiYmVniUDAzs8ShYGZmiUPBzMwSh4KZmSUOBTMzSxwKZmaWOBTMzCxxKJiZWeJQMDOzxKFgZmaJQ8HMzBKHgpmZJQ4FMzNLHApmZpY4FMzMLCk1FCStkfS0pJ2S7mjy+u2SdkjaJul7ki4ssx4zM5tYaaEgqQrcBbwbuBS4UdKlY5o9DvRExOXAN4HPllWPmZm1VuaawpXAzojYFRGDwCZgXWODiHggIg7ng1uAZSXWY2ZmLZQZCucDexqG+/PnxnMT8J1mL0i6WVKfpL6BgYE2lmhmZo3KDAU1eS6aNpTeD/QAn2v2ekRsjIieiOhZunRpG0s0M7NGtRLH3Q8sbxheBjw3tpGk64DfB94REcdKrMfMzFooc01hK7BK0kpJ3cB6oLexgaQrgLuBtRGxt8RazMysgNJCISKGgVuB+4Engc0RsV3SBklr82afA+YB35D0hKTecUZnZmbToMzNR0TEfcB9Y577ZMPj68qcvpmZTY7PaDYzs8ShYGZmiUPBzMwSh4KZmSUOBTMzSxwKZmaWOBTMzCxxKJiZWeJQMDOzxKFgZmaJQ8HMzBKHgpmZJQ4FMzNLHApmZpY4FMzMLHEomJlZ4lAwM7PEoWBmZolDwczMEoeCmZklDgUzM0scCmZmljgUzMwscSiYmVniUDAzs8ShYGZmiUPBzMwSh4KZmSUOBTMzSxwKZmaWlBoKktZIelrSTkl3NHl9lqSv56//SNKKMusxM7OJ1coasaQqcBfwTqAf2CqpNyJ2NDS7CdgXEW+QtB74Q+C9ZdRz26bH6N32AiP1SM91VSCA4Xr7plOtiCsvXAiq8JNn93F4sE7DJBFQEdQjm/ao7oqoA8ONjZtYMLvG0EidY8PHj3e6VQWSWtY7FeL4eXMyqsr+HengvLJT05J53ew/PMRQG5fhdi6741m+aA6fXncZqy85t5Txl7mmcCWwMyJ2RcQgsAlYN6bNOuBr+eNvAtdKUrsLuW3TY/zlE88fFwgAQ/X2BgLASD14ZPc+tu5+iYPHTvziDrIvqLELzmA9Cn3Bvnp0mCNDnQ0EyPpQRiBAe/+oRsKBYM29eHCwrYEA5QcCwJ59R/g3X3+cB5/aW8r4ywyF84E9DcP9+XNN20TEMLAfWNzuQnq3vdDuUbY07C8iMyvJq0eGufuhXaWMu8xQaPaLf+xXZZE2SLpZUp+kvoGBgUkXMnYNwcxsJgugf9/hUsZdZij0A8sbhpcBz43XRlINOBt4eeyIImJjRPRERM/SpUsnXUi10vYtUmZmHSNg2aK5pYy7zFDYCqyStFJSN7Ae6B3Tphf4QP74BuD7EdH2n/VrL39du0fZUs05ZGYlWTCnxi1XX1TKuEsLhXwfwa3A/cCTwOaI2C5pg6S1ebOvAIsl7QRuB044bLUdvrD+zfzjXzvvhDWGrgrU2jwHqhXxtpWLeMvKxcyfVWHsSorIj9wZ877uiqgVWKNZMLvGnK4TxzvdqqJQvVPRzrFW9doRSGaNlszrpqvNy/B0LGrLF83hzvdeUdrRRyrhh3mpenp6oq+vr9NlmJnNKJIejYieVu18RrOZmSUOBTMzSxwKZmaWOBTMzCxxKJiZWTLjjj6SNAD8fIpvXwK82MZyZgL3+czgPp8ZTqbPF0ZEy7N/Z1wonAxJfUUOyTqduM9nBvf5zDAdffbmIzMzSxwKZmaWnGmhsLHTBXSA+3xmcJ/PDKX3+Yzap2BmZhM709YUzMxsAqdlKEhaI+lpSTslnXDlVUmzJH09f/1HklZMf5XtVaDPt0vaIWmbpO9JurATdbZTqz43tLtBUkia8UeqFOmzpPfkn/V2SX8x3TW2U4Hl+gJJD0h6PF+2r+9Ene0k6auS9kr66TivS9If5/Nkm6Q3t7WAiDit/gOqwN8CFwHdwI+BS8e0+dfAl/PH64Gvd7ruaejzNcDc/PFvnQl9ztvNBx4CtgA9na57Gj7nVcDjwKJ8+NxO111yfzcCv5U/vhR4ptN1t6HfVwNvBn46zuvXA98hu1L3VcCP2jn903FN4UpgZ0TsiohBYBOwbkybdcDX8sffBK6VNJOvut+yzxHxQESM3r9vC9md8GayIp8zwKeBzwJHp7O4khTp84eAuyJiH0BElHN39+lRpL8BLMgfn82Jd3eccSLiIZrcgbLBOuDPI7MFWCjpvHZN/3QMhfOBPQ3D/flzTdtEdjOg/cDiaamuHEX63Ogmsl8aM1nLPku6AlgeEX81nYWVqMjnfDFwsaSHJW2RtGbaqmu/Iv39FPB+Sf3AfcCHp6e0jprs3/uk1No1olNIs1/8Yw+xKtJmJincH0nvB3qAd5RaUfkm7LOkCvAF4IPTVdA0KPI518g2Ia0mWxv8gaTLIuKVkmsrQ5H+3gj8WUT8kaS3Affk/a2XX17HlPr9dTquKfQDyxuGl3HiKmVqI6lGtto50eraqa5In5F0HfD7wNqIODZNtZWlVZ/nA5cBD0p6hmzba+8M39lcdNn+dkQMRcRu4GmykJiJivT3JmAzQEQ8Aswmuz7Q6azQ3/tUnY6hsBVYJWmlpG6yHcm9Y9r0Ah/IH98AfD/yPTgzVMs+55tS7iYLhJm8nXnUhH2OiP0RsSQiVkTECrL9KGsjYibfy7XIsv0tsoMKkLSEbHPSrmmtsn2K9PcXwLUAkt5IFgoD01rl9OsF/nl+FNJVwP6IeL5dIz/tNh9FxLCkW4H7yY5e+GpEbJe0AeiLiF7gK2SrmTvJ1hDWd67ik1ewz58D5gHfyPep/yIi1nas6JNUsM+nlYJ9vh94l6QdwAjwOxHxUueqnrqC/f0Y8CeSbiPbhPLBGf4DD0n3km3+W5LvK/kDoAsgIr5Mtu/kemAncBj4zbZOf4bPPzMza6PTcfORmZlNkUPBzMwSh4KZmSUOBTMzSxwKZmaWOBTMGkhaLOmJ/L8XJD3bMPzDFu99cDInx0n6qKS5J1+1WfucducpmJ2M/Jj+XwOQ9CngYET855Im91Hgv5Eda252SvCagllBkg42PP5dST+R9GNJ/2lMu4qkr0n6D/nwuyQ9IukxSd+QNE/SR4DXAw9IemB6e2I2Pq8pmE2SpHcD/wh4a0QclnROw8s14L+TXQv/M/mlJj4BXBcRhyT9HnB7RGyQdDtwTUS8OO2dMBuHQ8Fs8q4D/nT0/hQR0XgxxbuBzRHxmXz4KrKbvzycX16kG3hkGms1mxSHgtnkifEvVfxD4BpJfxQRR/O2/ysibpy26sxOgvcpmE3ed4F/MXrk0JjNR18hu2DZN/LLsm8B3i7pDXnbuZIuztseILvEt9kpw6FgNkkR8ddkly/uk/QE8PExr38eeAy4B3iJ7EY/90raRhYSl+RNNwLf8Y5mO5X4KqlmZpZ4TcHMzBKHgpmZJQ4FMzNLHApmZpY4FMzMLHEomJlZ4lAwM7PEoWBmZsn/By2xzdumyDRsAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "# 觀察重要特徵與目標的分布\n",
    "# 第一名 : Ticket              \n",
    "sns.regplot(x = df['Ticket'], y = train_Y, fit_reg = False)\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2019-05-22T01:47:53.861576Z",
     "start_time": "2019-05-22T01:47:53.702523Z"
    }
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYUAAAEKCAYAAAD9xUlFAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAFtBJREFUeJzt3X+wX3V95/Hn63t/hIQAAgnqkNRgCSLFuti7yK6OxRpdpLswYxmF1al2UNxuEVe0HXbaWhbH2a3WulhxJW3dqjsVqDtTsx0srgqibnG5FEX51caAJqIlKvIz5Nd97x/fb85eb27u95vknvv1Js/HTCbfc87ne877c7/n3tf59T0nVYUkSQCdYRcgSfrZYShIkhqGgiSpYShIkhqGgiSpYShIkhqGgiSpYShIkhqGgiSpMTrsAvbXihUras2aNcMuQ5IWlTvuuOOHVbWyX7tFFwpr1qxhcnJy2GVI0qKS5DuDtPPwkSSpYShIkhqGgiSpYShIkhqGgiSp0drVR0k+Bvxr4OGqOn2W6QGuBs4FngLeVFV/31Y9t9z3MP/ls/eyceuT7J4q9vVoocA+p82XDnDckWM8+vQudu7uv7SxTtg1R80HW8vUgG3HOuGIsQ5PbN/9U7UESKBq9p/d0rEORy4ZZeXyJTz+9E4e+snTP7XMDnDc8nEefWonu6oYCTzrqCVs2znFj7ftpAqWjHYIUzy96wA7egDS+zfaCbuB3VP7/gQ6wCnPXM65L3g2n7jtO/zwiR1zzne0E45ZOspTO6bYtnP3vHy2I510P8+pYvc8zG82S8c6POe4ZTy5YzcPP74dgJOOX8YVr34+ANfeuol/fPhxntzeXbenpqrv+hVgJFAJodg17Q2dwEjCVBUzf1UCHLdslGVLxnjoJ9ua6XP9DncCy5eMcuIzlvL40zv5wWNPs7u6n1/CTy17UJ3AzFVjfCRc+vKTuWzdKQB86PP/wDW3fJvt+1hAAinodMJU73e96P7OBdgNHDk+wptfelIzz7akrSevJXkZ8ATwiX2EwrnA2+iGwouBq6vqxf3mOzExUft7Seot9z3Muz79DR55csdeK5YWxp4/sAfwO6efUSPpBtFUwbKxDuNjI4yNhH96dLufc8/l69YC8MHP/+NBBX8HGBnp/qzf/isnH1AwJLmjqiYGWVYrqupW4MdzNDmfbmBUVd0GPCPJs9uo5dpbN/HE9l17pbkWTjFYICRtV6L5sGdrfKTTYSThiR27eWL7Lh7btovyM2z82Vce4M++8sBB7wlOAaOdDp1059mmYZ5TOBHYPG14S2/cXpJckmQyyeTWrVv3e0GbH3lqzkNGkvbfnoMM6R0+2T1V7Ng9hY99//+e3LGbJ3fM38G8TpjX+c26jFbnPrfZtidmXZ2qan1VTVTVxMqVfb+lvZfVxy5jpHdsTtL82LNXV9U79t8J4yMd9/amOXJ8hCPHR+ZtflPFvM5vNsMMhS3A6mnDq4CH2ljQW1/2XJYvGaXjyjo0YbCVza3MxaHofqa7p6bYXcXy8RGWLxnl6KWjxM+w8eaXnsSbX3rSQW+QdoBdU1NMVXeebRpmKGwAfj1dZwGPVtX321jQ2aeewB9d8ELWnrC8OZu/LwuRGx1gxZFjjI0MtrR+NR9sLYMa64SjlozsVUvobinuq8alYx2OXz7O8551FKueccRey+wAK5aPd/sZGO3AqmOWcPyysWarc8lohyMW+E5de4JsvBNG+mxRdIBTn7mcy9etZcXy8b7zHeuEFUeOsWxs75/ngRrphLFOaHM7culYh1OfuZzVxy5ldKRDEk5eeSQfuuhF/NEFL2TN8cs5bvk4S8c6jPWuhuonwGhvT2N0xhs66f6sZvtVCXD8slFWH7v0p6bP9fPsBI4+YpTn99bF0U53j2ekt94diNlWjfGRcPm6tVy27hQuW3cK71i3liVzLCDprkN7fmZ7ZjnWCeOdkE5YOjZywCeZ90ebVx99CjgbWAH8E/AHwBhAVX20d0nqh4Fz6F6S+htV1feyogO5+kiSDneDXn3U2rZXVV3UZ3oBv9XW8iVJ+89vNEuSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKnRaigkOSfJ/Uk2Jrliluk/l+TmJHcmuSvJuW3WI0maW2uhkGQEuAZ4NXAacFGS02Y0+z3ghqo6A7gQ+Ehb9UiS+mtzT+FMYGNVbaqqHcB1wPkz2hRwdO/1McBDLdYjSepjtMV5nwhsnja8BXjxjDZXAp9L8jbgSGBdi/VIkvpoc08hs4yrGcMXAX9RVauAc4FPJtmrpiSXJJlMMrl169YWSpUkQbuhsAVYPW14FXsfHroYuAGgqv4OOAJYMXNGVbW+qiaqamLlypUtlStJajMUbgfWJjkpyTjdE8kbZrT5LvAKgCTPpxsK7gpI0pC0FgpVtQu4FLgJuJfuVUZ3J7kqyXm9Zu8E3pLkG8CngDdV1cxDTJKkBdLmiWaq6kbgxhnj3j3t9T3AS9qsQZI0OL/RLElqGAqSpIahIElqGAqSpIahIElqGAqSpIahIElqGAqSpIahIElqGAqSpIahIElqGAqSpIahIElqGAqSpIahIElqGAqSpIahIElqGAqSpIahIElqGAqSpIahIElqGAqSpIahIElqGAqSpIahIElqGAqSpIahIElqGAqSpIahIElqGAqSpIahIElqtBoKSc5Jcn+SjUmu2Eeb1ya5J8ndSf6yzXokSXMbbWvGSUaAa4BXAluA25NsqKp7prVZC/xH4CVV9UiSE9qqR5LUX5t7CmcCG6tqU1XtAK4Dzp/R5i3ANVX1CEBVPdxiPZKkPtoMhROBzdOGt/TGTXcKcEqSrya5Lck5s80oySVJJpNMbt26taVyJUlzHj5K8jhQ+5peVUfP9fbZ3jLL8tcCZwOrgC8nOb2qfjJjOeuB9QATExP7rEeSdHDmDIWqOgogyVXAD4BP0v1j/3rgqD7z3gKsnja8Cnholja3VdVO4IEk99MNidsH7YAkaf4MevjoX1XVR6rq8ap6rKr+G/Brfd5zO7A2yUlJxoELgQ0z2vw18HKAJCvoHk7aNHj5kqT5NGgo7E7y+iQjSTpJXg/snusNVbULuBS4CbgXuKGq7k5yVZLzes1uAn6U5B7gZuC3q+pHB9YVSdLBSlX/Q/RJ1gBXAy+he17gq8B/qKoHW6xtVhMTEzU5ObnQi5WkRS3JHVU10a/dQN9T6P3xn3k5qSTpEDPQ4aMkpyT5QpJv9YZ/McnvtVuaJGmhDXpO4U/pfvN4J0BV3UX3xLEk6RAyaCgsq6r/O2PcrvkuRpI0XIOGwg+T/Dy9L58luQD4fmtVSZKGYtAb4v0W3W8Un5rke8ADdL/AJkk6hAwaCt+pqnVJjgQ6VfV4m0VJkoZj0MNHDyRZD5wFPNFiPZKkIRo0FJ4HfJ7uYaQHknw4yUvbK0uSNAwDhUJVbauqG6rqNcAZwNHAl1qtTJK04AZ+nkKSX07yEeDvgSOA17ZWlSRpKAY60ZzkAeDrwA10b1r3ZKtVSZKGYtCrj15YVY+1Wokkaej6PXntd6rqfcB7k+x1O9Wquqy1yiRJC67fnsK9vf+9V7UkHQb6PY7zf/Ve3lVVdy5APZKkIRr06qM/TnJfkvck+YVWK5IkDc2g31N4OXA2sBVYn+SbPk9Bkg49A39Poap+UFUfAv4d3ctT391aVZKkoRj0yWvPT3Jl78lrHwb+D7Cq1cokSQtu0O8p/HfgU8CrquqhFuuRJA1R31BIMgJ8u6quXoB6JElD1PfwUVXtBo5PMr4A9UiShmjgh+wAX02yAWjue1RVf9xKVZKkoRg0FB7q/esAR7VXjiRpmAYKhar6T20XIkkavkFvnX0zMNsN8X5l3iuSJA3NoIeP3jXt9RHArwG75r8cSdIwDXr46I4Zo76axMdxStIhZtDDR8dNG+wAE8CzWqlIkjQ0g9776A66z1SYpHuLi8uBi/u9Kck5Se5PsjHJFXO0uyBJJZkYsB5JUgv6PXntnwObq+qk3vAb6Z5PeBC4p897R4BrgFcCW4Dbk2yoqntmtDsKuAz42gH2QZI0T/rtKVwL7ABI8jLgPwMfBx4F1vd575nAxqraVFU7gOuA82dp9x7gfcDT+1G3JKkF/UJhpKp+3Hv9OmB9Vf3Pqvp94OQ+7z0R2DxteEtvXCPJGcDqqvqb/ahZktSSvqGQZM8hplcAX5w2rd9J6swyrvmuQ5IO8EHgnf2KTHJJkskkk1u3bu3XXJJ0gPqFwqeALyX5DLAN+DJAkpPpHkKayxZg9bThVXRvlbHHUcDpwC1JHgTOAjbMdrK5qtZX1URVTaxcubLPYiVJB2rOrf2qem+SLwDPBj5XVXu29DvA2/rM+3ZgbZKTgO8BFwL/dtq8HwVW7BlOcgvwrqqa3N9OSJLmR9/vKVTVbbOM+4cB3rcryaXATcAI8LGqujvJVcBkVW04kIIlSe0Z9DYXB6SqbgRunDFu1mc7V9XZbdYiSepv0C+vSZIOA4aCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGoaCJKlhKEiSGq2GQpJzktyfZGOSK2aZfnmSe5LcleQLSZ7TZj2SpLm1FgpJRoBrgFcDpwEXJTltRrM7gYmq+kXg08D72qpHktRfm3sKZwIbq2pTVe0ArgPOn96gqm6uqqd6g7cBq1qsR5LUR5uhcCKwedrwlt64fbkY+OxsE5JckmQyyeTWrVvnsURJ0nRthkJmGVezNkzeAEwA759telWtr6qJqppYuXLlPJYoSZputMV5bwFWTxteBTw0s1GSdcDvAr9cVdtbrEeS1Eebewq3A2uTnJRkHLgQ2DC9QZIzgGuB86rq4RZrkSQNoLVQqKpdwKXATcC9wA1VdXeSq5Kc12v2fmA58FdJvp5kwz5mJ0laAG0ePqKqbgRunDHu3dNer2tz+ZKk/eM3miVJDUNBktQwFCRJDUNBktQwFCRJDUNBktQwFCRJDUNBktQwFCRJDUNBktQwFCRJDUNBktQwFCRJDUNBktQwFCRJDUNBktQwFCRJDUNBktQwFCRJDUNBktQwFCRJDUNBktQwFCRJDUNBktQwFCRJDUNBktQwFCRJDUNBktQwFCRJDUNBktRoNRSSnJPk/iQbk1wxy/QlSa7vTf9akjVt1iNJmttoWzNOMgJcA7wS2ALcnmRDVd0zrdnFwCNVdXKSC4E/BF4337Xcct/D/P5nvsXmR7bN96xntWS0w65dU+xekKVpjwA17CJ0yOsA6YTdUwu/tgVYdexS3nP+6Zx96gmtLKPNPYUzgY1VtamqdgDXAefPaHM+8PHe608Dr0iS+Szilvse5u3X37lggQCw3UAYCgNBC2EKhhII0F3HNz+yjbdffye33PdwK8toMxROBDZPG97SGzdrm6raBTwKHD+fRVx76yYe27ZrPmcpSUP12LZdXHvrplbm3WYozLbFPzNeB2lDkkuSTCaZ3Lp1634VsfmRp9yClHRIKWDLI0+1Mu82Q2ELsHra8CrgoX21STIKHAP8eOaMqmp9VU1U1cTKlSv3q4jVxy6bNXkkabHqnltY1sq82wyF24G1SU5KMg5cCGyY0WYD8Mbe6wuAL1bVvG7Yv/Vlz+Xopa2dT5ekBXf00lHe+rLntjLv1kKhd47gUuAm4F7ghqq6O8lVSc7rNftz4PgkG4HLgb0uWz1YZ596Ale/7gxWH7t0vme9T0tGO4ws2NK0h3uEWggdYKQznLUtwOpjl3L1685o7eqjzPOGeesmJiZqcnJy2GVI0qKS5I6qmujXzm80S5IahoIkqWEoSJIahoIkqWEoSJIai+7qoyRbge8c4NtXAD+cx3IWA/t8eLDPh4eD6fNzqqrvt38XXSgcjCSTg1ySdSixz4cH+3x4WIg+e/hIktQwFCRJjcMtFNYPu4AhsM+HB/t8eGi9z4fVOQVJ0twOtz0FSdIcDslQSHJOkvuTbEyy151XkyxJcn1v+teSrFn4KufXAH2+PMk9Se5K8oUkzxlGnfOpX5+ntbsgSSVZ9FeqDNLnJK/tfdZ3J/nLha5xPg2wXv9ckpuT3Nlbt88dRp3zKcnHkjyc5Fv7mJ4kH+r9TO5K8qJ5LaCqDql/wAjwbeC5wDjwDeC0GW3+PfDR3usLgeuHXfcC9PnlwLLe6988HPrca3cUcCtwGzAx7LoX4HNeC9wJHNsbPmHYdbfc3/XAb/ZenwY8OOy656HfLwNeBHxrH9PPBT5L907aZwFfm8/lH4p7CmcCG6tqU1XtAK4Dzp/R5nzg473XnwZekWQx346/b5+r6uaq2vP8vtvoPglvMRvkcwZ4D/A+4OmFLK4lg/T5LcA1VfUIQFW183T3hTFIfws4uvf6GPZ+uuOiU1W3MssTKKc5H/hEdd0GPCPJs+dr+YdiKJwIbJ42vKU3btY21X0Y0KPA8QtSXTsG6fN0F9Pd0ljM+vY5yRnA6qr6m4UsrEWDfM6nAKck+WqS25Kcs2DVzb9B+nsl8IYkW4AbgbctTGlDtb+/7/vlUHxO5Wxb/DMvsRqkzWIycH+SvAGYAH651YraN2efk3SADwJvWqiCFsAgn/Mo3UNIZ9PdG/xyktOr6ict19aGQfp7EfAXVfWBJP8C+GSvv1Ptlzc0rf79OhT3FLYAq6cNr2LvXcqmTZJRurudc+2u/awbpM8kWQf8LnBeVW1foNra0q/PRwGnA7ckeZDusdcNi/xk86Dr9meqamdVPQDcTzckFqNB+nsxcANAVf0dcATd+wMdygb6fT9Qh2Io3A6sTXJSknG6J5I3zGizAXhj7/UFwBerdwZnkerb596hlGvpBsJiPs68x5x9rqpHq2pFVa2pqjV0z6OcV1WL+Vmug6zbf033ogKSrKB7OGnTglY5fwbp73eBVwAkeT7dUNi6oFUuvA3Ar/euQjoLeLSqvj9fMz/kDh9V1a4klwI30b164WNVdXeSq4DJqtoA/Dnd3cyNdPcQLhxexQdvwD6/H1gO/FXvnPp3q+q8oRV9kAbs8yFlwD7fBLwqyT3AbuC3q+pHw6v6wA3Y33cCf5rkHXQPobxpkW/gkeRTdA//reidK/kDYAygqj5K99zJucBG4CngN+Z1+Yv85ydJmkeH4uEjSdIBMhQkSQ1DQZLUMBQkSQ1DQZLUMBSkWfTuqvqBacPvSnLlEEuSFoShIM1uO/Ca3hfApMOGoSDNbhfd2zK/Y+aEJP+m9xyOO5N8Pskze+OvTPLxJJ9L8mCS1yR5X5JvJvnbJGO9dr+U5EtJ7khy03ze4VI6WIaCtG/XAK9PcsyM8V8BzqqqM+jezvl3pk37eeBX6d7e+H8AN1fVC4BtwK/2guFPgAuq6peAjwHvbbcb0uAOudtcSPOlqh5L8gngMrp/1PdYBVzf28IfBx6YNu2zVbUzyTfp3prhb3vjvwmsAZ5H90Z9/7t3u5ERYN7uWyMdLPcUpLn9V7p34jxy2rg/AT7c2wN4K92bsO2xHaB36+ad0+7DM0V3IyzA3VX1z3r/XlBVr2q7E9KgDAVpDlX1Y7q3Zr542uhjgO/1Xr9xrzfN7X5gZe/e/yQZS/ILB12oNE8MBam/D/DT9+i/ku7dZr8M/HB/ZtR7rOQFwB8m+QbwdeBfzlOd0kHzLqmSpIZ7CpKkhqEgSWoYCpKkhqEgSWoYCpKkhqEgSWoYCpKkhqEgSWr8P/rfZRXwO/h4AAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "# 第二名 : Name        \n",
    "sns.regplot(x = df['Name'], y = train_Y, fit_reg = False)\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2019-05-22T01:52:32.881253Z",
     "start_time": "2019-05-22T01:52:32.794653Z"
    }
   },
   "outputs": [],
   "source": [
    "# 製作新特徵看效果\n",
    "\"\"\"\n",
    "Your Code Here\n",
    "\"\"\"\n",
    "df['Add_char'] = (df['Ticket'] + df['Name']) / 2\n",
    "df['Multi_char'] = df['Ticket'] * df['Name']\n",
    "df['TN_div1p'] = df['Ticket'] / (df['Name'] + 1) * 2\n",
    "df['NT_div1p'] = df['Name'] / (df['Ticket'] + 1) * 2"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2019-05-22T01:52:34.110474Z",
     "start_time": "2019-05-22T01:52:33.524258Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.8170838435669078"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "train_X = MMEncoder.fit_transform(df)\n",
    "cross_val_score(estimator, train_X, train_Y, cv = 5).mean()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "toc": {
   "base_numbering": 1,
   "nav_menu": {},
   "number_sections": true,
   "sideBar": true,
   "skip_h1_title": false,
   "title_cell": "Table of Contents",
   "title_sidebar": "Contents",
   "toc_cell": false,
   "toc_position": {},
   "toc_section_display": true,
   "toc_window_display": false
  },
  "varInspector": {
   "cols": {
    "lenName": 16,
    "lenType": 16,
    "lenVar": 40
   },
   "kernels_config": {
    "python": {
     "delete_cmd_postfix": "",
     "delete_cmd_prefix": "del ",
     "library": "var_list.py",
     "varRefreshCmd": "print(var_dic_list())"
    },
    "r": {
     "delete_cmd_postfix": ") ",
     "delete_cmd_prefix": "rm(",
     "library": "var_list.r",
     "varRefreshCmd": "cat(var_dic_list()) "
    }
   },
   "types_to_exclude": [
    "module",
    "function",
    "builtin_function_or_method",
    "instance",
    "_Feature"
   ],
   "window_display": false
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}