ML0101EN-Clas-SVM-cancer-py-v1.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a href=\"https://www.bigdatauniversity.com\"><img src = \"https://ibm.box.com/shared/static/cw2c7r3o20w9zn8gkecaeyjhgw3xdgbj.png\" width = 400, align =\"center\"></a>\n",
    "\n",
    "<h1 align=center><font size = 5> SVM (Support Vector Machines)</font></h1>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In this notebook, you will use SVM (Support Vector Machines) to build and train a model using human cell records, and classify cells to whether the samples are benign or malignant.\n",
    "\n",
    "SVM works by mapping data to a high-dimensional feature space so that data points can be categorized, even when the data are not otherwise linearly separable. A separator between the categories is found, then the data are transformed in such a way that the separator could be drawn as a hyperplane. Following this, characteristics of new data can be used to predict the group to which a new record should belong."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import pylab as pl\n",
    "import numpy as np\n",
    "import scipy.optimize as opt\n",
    "from sklearn import preprocessing\n",
    "from sklearn.model_selection import train_test_split\n",
    "%matplotlib inline \n",
    "import matplotlib.pyplot as plt"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "###  Load the Cancer data \n",
    "The example is based on a dataset that is publicly available from the UCI Machine Learning Repository (Asuncion and Newman, 2007)[http://mlearn.ics.uci.edu/MLRepository.html]. The dataset consists of several hundred human cell sample records, each of which contains the values of a set of cell characteristics. The fields in each record are:\n",
    "\n",
    "|Field name|Description|\n",
    "|--- |--- |\n",
    "|ID|Clump thickness|\n",
    "|Clump|Clump thickness|\n",
    "|UnifSize|Uniformity of cell size|\n",
    "|UnifShape|Uniformity of cell shape|\n",
    "|MargAdh|Marginal adhesion|\n",
    "|SingEpiSize|Single epithelial cell size|\n",
    "|BareNuc|Bare nuclei|\n",
    "|BlandChrom|Bland chromatin|\n",
    "|NormNucl|Normal nucleoli|\n",
    "|Mit|Mitoses|\n",
    "|Class|Benign or malignant|\n",
    "\n",
    "For the purposes of this example, we're using a dataset that has a relatively small number of predictors in each record. To download the data, we will use `!wget` to download it from IBM Object Storage.  \n",
    "__Did you know?__ When it comes to Machine Learning, you will likely be working with large datasets. As a business, where can you host your data? IBM is offering a unique opportunity for businesses, with 10 Tb of IBM Cloud Object Storage: [Sign up now for free](http://cocl.us/ML0101EN-IBM-Offer-CC)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "--2020-01-21 15:09:21--  https://s3-api.us-geo.objectstorage.softlayer.net/cf-courses-data/CognitiveClass/ML0101ENv3/labs/cell_samples.csv\n",
      "Resolving s3-api.us-geo.objectstorage.softlayer.net (s3-api.us-geo.objectstorage.softlayer.net)... 67.228.254.196\n",
      "Connecting to s3-api.us-geo.objectstorage.softlayer.net (s3-api.us-geo.objectstorage.softlayer.net)|67.228.254.196|:443... connected.\n",
      "HTTP request sent, awaiting response... 200 OK\n",
      "Length: 20675 (20K) [text/csv]\n",
      "Saving to: ‘cell_samples.csv’\n",
      "\n",
      "cell_samples.csv    100%[===================>]  20.19K  --.-KB/s    in 0.02s   \n",
      "\n",
      "2020-01-21 15:09:21 (983 KB/s) - ‘cell_samples.csv’ saved [20675/20675]\n",
      "\n"
     ]
    }
   ],
   "source": [
    "#Click here and press Shift+Enter\n",
    "!wget -O cell_samples.csv https://s3-api.us-geo.objectstorage.softlayer.net/cf-courses-data/CognitiveClass/ML0101ENv3/labs/cell_samples.csv"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "### Load Data From CSV File  "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>Clump</th>\n",
       "      <th>UnifSize</th>\n",
       "      <th>UnifShape</th>\n",
       "      <th>MargAdh</th>\n",
       "      <th>SingEpiSize</th>\n",
       "      <th>BareNuc</th>\n",
       "      <th>BlandChrom</th>\n",
       "      <th>NormNucl</th>\n",
       "      <th>Mit</th>\n",
       "      <th>Class</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1000025</td>\n",
       "      <td>5</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1002945</td>\n",
       "      <td>5</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>5</td>\n",
       "      <td>7</td>\n",
       "      <td>10</td>\n",
       "      <td>3</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1015425</td>\n",
       "      <td>3</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>3</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1016277</td>\n",
       "      <td>6</td>\n",
       "      <td>8</td>\n",
       "      <td>8</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "      <td>4</td>\n",
       "      <td>3</td>\n",
       "      <td>7</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1017023</td>\n",
       "      <td>4</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "        ID  Clump  UnifSize  UnifShape  MargAdh  SingEpiSize BareNuc  \\\n",
       "0  1000025      5         1          1        1            2       1   \n",
       "1  1002945      5         4          4        5            7      10   \n",
       "2  1015425      3         1          1        1            2       2   \n",
       "3  1016277      6         8          8        1            3       4   \n",
       "4  1017023      4         1          1        3            2       1   \n",
       "\n",
       "   BlandChrom  NormNucl  Mit  Class  \n",
       "0           3         1    1      2  \n",
       "1           3         2    1      2  \n",
       "2           3         1    1      2  \n",
       "3           3         7    1      2  \n",
       "4           3         1    1      2  "
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cell_df = pd.read_csv(\"cell_samples.csv\")\n",
    "cell_df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The ID field contains the patient identifiers. The characteristics of the cell samples from each patient are contained in fields Clump to Mit. The values are graded from 1 to 10, with 1 being the closest to benign.\n",
    "\n",
    "The Class field contains the diagnosis, as confirmed by separate medical procedures, as to whether the samples are benign (value = 2) or malignant (value = 4).\n",
    "\n",
    "Lets look at the distribution of the classes based on Clump thickness and Uniformity of cell size:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAX4AAAEGCAYAAABiq/5QAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjEsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy8QZhcZAAAgAElEQVR4nO3dfXRU9b3v8fcXkpSJkmgh9nLEm6G9UsODRohZHKFHVJCuK1Xrsr2leq/SKF2tQVtrq21Xfeg6p8vj8bb2aG/vpY3IaUu0Bx9LfUB6dFWtbQhCFTIHrHVATrmHIXpzqolNQr73j5k8AoY8zN472Z/XWqw988tk7y+/2fnkl9/M7J+5OyIiEh8Twi5ARESCpeAXEYkZBb+ISMwo+EVEYkbBLyISMwVhF3Aspk6d6slkMuwyRETGlK1btx5097KB7WMi+JPJJI2NjWGXISIyppjZniO1a6pHRCRmFPwiIjGj4BcRiZkxMcd/JB0dHezbt4/33nsv7FLGlUmTJjF9+nQKCwvDLkVE8mTMBv++ffuYPHkyyWQSMwu7nHHB3Wlubmbfvn3MmDEj7HJEJE/yNtVjZveZ2QEz29Gn7YNm9oyZvZbbnjjc/b/33ntMmTJFoT+KzIwpU6bE5q+oTKaVLVv2k8m0hlpHKtXMunU7SKWaQ60jCqLSF1E4NzZufJ2rr36ajRtfH/V953PEfz9wL/BPfdpuBn7l7neY2c25+zcN9wAK/dEXlz6tr09RU/M0RUUTaG/voq5uGStWVARex+rVm7n33u0992trK7nnniWB1xEFUemLKJwbc+euZceO7C+/urpXmTt3Cq+8snLU9p+3Eb+7/xp4a0DzxcC63O11wCX5Or7I0WQyrdTUPE1bWyctLe20tXVSU/N04KO7VKq5X9AB3Hvv9tBHu2GISl9E4dzYuPH1ntDv9uqrzaM68g/6XT0fcvf9ALntSUd7oJmtMrNGM2vMZDKBFRiU5557juXLlwPw+OOPc8cddwR27O3bt/PEE08EdryoSadbKCrqf+oXFk4gnW4JtI6Ghv1Dah/PotIXUTg3Hn30D0NqH47Ivp3T3de4e5W7V5WVHfaJ43Hloosu4uabbw7seHEP/mSylPb2rn5tHR1dJJOlgdZRXT1tSO3jWVT6IgrnxiWX/JchtQ9H0MH/72Y2DSC3PRDkwUf7BZt0Os1pp53G1VdfzZw5c7j88svZvHkzCxcu5NRTT6WhoYGGhgbOPvtszjzzTM4++2x27dp12H7uv/9+amtrAXj99ddZsGABZ511FrfccgvHH388kP0LYfHixVx22WWcdtppXH755XSvnvbtb3+bs846izlz5rBq1aqe9sWLF3PTTTdRXV3NzJkzef7552lvb+eWW27hwQcfpLKykgcffHBU+mIsKSsrpq5uGYlEASUlRSQSBdTVLaOsrDjQOioqplBbW9mvrba2koqKKYHWEQVR6YsonBvLl3+EuXP7/7/nzp3C8uUfGb2DuHve/gFJYEef+/8A3Jy7fTNw57HsZ/78+T5QU1PTYW3vZ/36Jk8kvuelpd/3ROJ7vn790L7/SN544w2fOHGiv/LKK37o0CGfN2+er1y50ru6uvzRRx/1iy++2FtaWryjo8Pd3Z955hm/9NJL3d392Wef9QsvvNDd3deuXevXXnutu7tfeOGFvn79end3/+EPf+jHHXdcz+NLSkr8zTff9EOHDvmCBQv8+eefd3f35ubmnpquuOIKf/zxx93d/ZxzzvEbbrjB3d1/+ctf+vnnn3/Y8Y5kqH07Vh048K43NPzJDxx4N9Q6mpoO+v33v+pNTQdDrSMKotIXUTg3fvGLP3hNzVP+i1/8Ydj7ABr9CJmat3f1mFk9sBiYamb7gFuBO4Cfm1kNsBf4VL6O31ffF2za2rJtNTVPs2RJ+Yh/k8+YMYO5c+cCMHv2bM4//3zMjLlz55JOp2lpaeHKK6/ktddew8zo6Oh43/299NJLPProowB89rOf5cYbb+z5WnV1NdOnTwegsrKSdDrNokWLePbZZ7nzzjtpbW3lrbfeYvbs2XziE58A4NJLLwVg/vz5pNPpEf1fx5uysuLAR/lHUlExJZaj/COJSl9E4dxYvvwjozvK7yNvwe/uK47ypfPzdcyj6X7Bpjv0ofcFm5E+uR/4wAd6bk+YMKHn/oQJE+js7ORb3/oW5557Lo888gjpdJrFixePyrEmTpxIZ2cn7733Hl/84hdpbGzklFNO4bbbbuv3Pvzu7+l+vIhIZF/cHU1hvmDT0tLCySefDGTn8gezYMECHnroIQAeeOCBQR/fHfJTp07lnXfeYcOGDYN+z+TJk/nzn/886ONEZHyKRfCH+YLN1772Nb7+9a+zcOFCDh06NOjj7777br773e9SXV3N/v37KS19/19OJ5xwAtdccw1z587lkksu4ayzzhr0GOeeey5NTU2xfXFXJO7Mc+8AibKqqiofuBBLKpWiomJon6bLZFpJp1tIJktDn787mtbWVhKJBGbGAw88QH19PY899ligNQynb0Ukesxsq7tXDWwfsxdpG44ovGAzmK1bt1JbW4u7c8IJJ3DfffeFXZKIjDOxCv6x4GMf+xi///3vwy5DRMaxWMzxi4hILwW/iEjMKPhFRGJGwS8iEjMK/hFIp9PMmTNnxPtpbGzkuuuuG4WKREQGp3f1REBVVRVVVYe91VZEJC9iNuLPAFty29HR2dnJlVdeyemnn85ll11Ga2srW7du5ZxzzmH+/PksW7aM/fuzi0kc6TLJ0H9Rlkwmw9KlS5k3bx6f//znKS8v5+DBg6TTaSoqKrjmmmuYPXs2F1xwAW19Lz4kInKMYhT89UA5sDS3rR+Vve7atYtVq1bxyiuvUFJSwg9+8ANWr17Nhg0b2Lp1K5/73Of45je/2fP4zs5OGhoauPvuu7n99tsP29/tt9/Oeeedx8svv8wnP/lJ9u7d2/O11157jWuvvZadO3dywgkn9FzTR0RkKGIy1ZMBaoC23D9y95cAI1vd65RTTmHhwoUAXHHFFXznO99hx44dLF26FIBDhw4xbVrvKkKDXSb5hRde4JFHHgHg4x//OCeeeGLP12bMmEFlZeX7fr+IyGBiEvxpoIje0AcozLWPLPjNrN/9yZMnM3v2bF566aUjPn6wyyS/37WTBl6WWVM9IjIcMZnqSQLtA9o6cu0js3fv3p6Qr6+vZ8GCBWQymZ62jo4Odu7cecz7W7RoET//+c8B2LRpE2+//faIaxQR6SsmwV8G1AEJoCS3rWOko32AiooK1q1bx+mnn85bb73VM79/0003ccYZZ1BZWclvfvObY97frbfeyqZNm5g3bx5PPvkk06ZNY/LkySOuU0SkW6wuy5yd60+THemPPPTz4S9/+QsTJ06koKCAl156iS984Qts37490Bp0WWaR8UGXZQayYR/NwO+2d+9ePv3pT9PV1UVRURE/+tGPwi5JRMaZmAV/9J166qls27Yt7DJEZBwb03P8Y2GaaqxRn4qMf2M2+CdNmkRzc7OCahS5O83NzUyaNCnsUkQkj8bsVM/06dPZt28fmczoXX5Bsr9Qp0+fHnYZIpJHYzb4CwsLmTFjRthliIiMOWN2qkdERIZHwS8iEjMKfhGRmFHwi4jEjIJfRCRmFPwiIjGj4BcRiRkFv4hIzCj4RURiRsEvIhIzCn4RkZgJJfjN7MtmttPMdphZvZnpcpASYxlgS24bYhWZVrZs2U8m0xpqHZJ/gQe/mZ0MXAdUufscYCLwmaDrEImGeqAcWJrb1odTRX2K8vI1LF36z5SXr6G+PhVKHRKMsKZ6CoCEmRUAxcCfQqpDJEQZoAZoA1py2xqCHvlnMq3U1DxNW1snLS3ttLV1UlPztEb+41jgwe/u/wbcBewF9gMt7r5p4OPMbJWZNZpZo665L+NTGiga0FaYaw+winQLRUX9o6CwcALpdEugdUhwwpjqORG4GJgB/BVwnJldMfBx7r7G3avcvaqsLNoLpIsMTxJoH9DWkWsPsIpkKe3tXf2r6OgimSwNtA4JThhTPUuAN9w94+4dwMPA2SHUIRKyMqAOSAAluW1drj3AKsqKqatbRiJRQElJEYlEAXV1yygrKw60DglOGCtw7QUWmFkx2UnN84HGEOoQiYAVZMdCabIj/XD+ul2xooIlS8pJp1tIJksV+uNc4MHv7r8zsw3Ay0AnsA1YE3QdItFRRliB36+KsmIFfkyEsuauu98K3BrGsUVE4k6f3BURiRkFv4hIzCj4RURiRsEvIhIzCn4RkZhR8IuIxIyCX0QkZhT8IiIxo+AXEYkZBb+ISMwo+EVEYkbBLyISMwp+EZGYUfDHTCbTypYt+7WeqkSSzs9eqVQz69btIJVqHvV9h3JZZglHfX2KmpqnKSqaQHt7F3V1y1ixoiLsskQAnZ99rV69mXvv3d5zv7a2knvuWTJq+zd3H7Wd5UtVVZU3NmqRrpHIZFopL19DW1tnT1siUcCePau0+IaETudnr1SqmVmz1h7W3tS0koqKKUPal5ltdfeqge2a6omJdLqFoqL+T3dh4QTS6ZaQKhLppfOzV0PD/iG1D4eCPyaSyVLa27v6tXV0dJFMloZUkUgvnZ+9qqunDal9OBT8MVFWVkxd3TISiQJKSopIJAqoq1sWuz+jJZp0fvaqqJhCbW1lv7ba2sohT/O8H83xx0wm00o63UIyWRrLHyqJNp2fvVKpZhoa9lNdPW3YoX+0OX69qydmysqKY/8DJdGl87NXRcWUUR3l96WpHhGRmFHwi4jEjIJfRCRmFPwiIjGj4BcRiRkFv4hIzCj4RURiRsEvIhIzCn4RkZhR8IuIxMyQgt/MjstXISIiEoxjCn4zO9vMmoBU7v4ZZva/8lqZiIjkxbGO+L8HLAOaAdz998Df5KsoERHJn2Oe6nH3Nwc0HRruQc3sBDPbYGb/amYpM/vr4e5LhkaLWfeKTl9kgC25rURBFM6NKCy2/qaZnQ24mRUB15Gb9hmm7wNPuftluf3pOqwB0GLWvaLTF/VADVAEtAN1wIoQ6pBuUTg3IrHYuplNJRvWSwADNgHXu/uQfxWZWQnwe+DDfoyrwGghlpHTYta9otMXGaAcaOvTlgD2AGUB1iHdonBuRGmx9YS7X+7uH3L3k9z9CqBwSBX0+jDZM36tmW0zsx8f6d1CZrbKzBrNrDGT0Z/AI6XFrHtFpy/SZEf6/SrJtUsYonBuRGmx9TfMrN7MEn3anhjmMQuAecAP3f1M4F3g5oEPcvc17l7l7lVlZRr9jJQWs+4Vnb5Ikp3e6VdJrl3CEIVzI0qLrb8KPA+8YGYfybXZMI+5D9jn7r/L3d9A9heB5JEWs+4Vnb4oIzunnwBKcts6NM0TniicG5FZbN3MXnb3eWa2EPgRcBNwu7sPK7DN7HnganffZWa3Ace5+1eP9njN8Y8eLWbdKzp9kSE7vZNEoR8NUTg38rnY+rEG/7bctAxmNg14EKhy92H1iJlVAj8mO8H5R2Clu799tMcr+EVEhu5owX+sb+f8r9033H2/mZ0HnD3cYtx9O3BYMSIikn/vG/xmdoW7/xRYYXbEKf1f56UqERHJm8FG/N1vs5yc70JERCQY7xv87v5/ctvbgylHRETy7X3fzmlm15jZqbnbZmb3mVmLmb1iZmcGU6KIiIymwd7Hfz29HyNcAZxB9pO3NwD/mL+yREQkXwYL/k5378jdXg78k7s3u/tmeuf/RURkDBks+LvMbJqZTQLOBzb3+VriKN8jIiIRNti7er4FNAITgcfdfSeAmZ1D9oNXIiIyxgwW/MVkrxt7uru/3Ke9EfhveatKRETyZrCpnq+7eyfZyyv0cPd33f2d/JUlIiL5MtiIv9nMngVmmNnjA7/o7hflpywREcmXwYL/QrKXTP4J8D/zX46IiOTbYJ/cbQd+a2Znu7uWwRIRGQcGu0jb3e7+JeA+Mzvs+s2a6hmaKFzjOwo1RIX6oj/1R6/RuBZ+lGsYbKrnJ7ntXaN61Biqr09RU/M0RUUTaG/voq5uGStWVMSuhqhQX/Sn/ui1evVm7r13e8/92tpK7rlnybiq4ZgWYgnbWF+IJZNppbx8DW1tnT1tiUQBe/asCmxkFYUaokJ90Z/6o1cq1cysWWsPa29qWhnYyH80azjaQizHtOaumS00s2fMbLeZ/dHM3jAzfYDrGKXTLRQV9e/qwsIJpNMtsaohKtQX/ak/ejU07B9S+1it4VhX4KoDvgxsBQ6N2tFjIpkspb29q19bR0cXyWRprGqICvVFf+qPXtXV04bUPlZrOKYRP9Di7k+6+4HcRdqa3b151KoY58rKiqmrW0YiUUBJSRGJRAF1dcsC/TM6CjVEhfqiP/VHr4qKKdTWVvZrq62tDPQF3iBqONbF1u8ge72eh4G/dLcPuIxD3oz1Of5uUXjXRBRqiAr1RX/qj17j5V09R5vjP9bgfzZ3s/vBBri7nzesaoZovAS/iEiQjhb8g72P/4bczY25rQMZ4AV3f2N0SxQRkSAMNsc/Offv+Ny/yUAV8KSZfSbPtYmISB4MdsmGIy6ybmYfJLsoywP5KEpERPLnWN/V04+7v0V2nl9ERMaYYQW/mZ0HvD3KtYiISAAGe3H3VXrfydPtg8CfgP+Rr6JERCR/Bvvk7vIB9x1odvd381SPiIjk2WAv7u4JqhAREQnGsOb4RURk7FLwi4jEjIJfRCRmFPwiIjGj4BcRiRkFv4hIzIQW/GY20cy2mdnGwR8tMvoOHtxDU9OTHDyody1D9nr8W7bsJ5NpjXUNUakjlWpm3bodpFKjv+ZVmCP+64FUiMeXGHvxxbsoLj6Vk0++lOLiU3nxxbvCLilU9fUpysvXsHTpP1Nevob6+uB/NKNQQ1TqWL16M7NmreWqq55i1qy1rF69eVT3f0wLsYw2M5sOrAP+DrjB3Qd+QrgfLcQio+ngwT0UF59KcXFHT1trayGtra8xdWp5iJWFI5Nppbx8DW1tnT1tiUQBe/asCmwlrijUEJU6UqlmZs1ae1h7U9PKIa/EdbSFWMIa8d8NfA3oOtoDzGyVmTWaWWMmkwmuMhn3DhxooqNjYr+2jo6JHDjQFFJF4UqnWygq6h8FhYUTSKdbYlVDVOpoaNg/pPbhCDz4zWw5cMDdt77f49x9jbtXuXtVWVlZQNVJHJx00iwKCw/1ayssPMRJJ80KqaJwJZOltLf3H4N1dHSRTJbGqoao1FFdPW1I7cMRxoh/IXCRmaXJLuRynpn9NIQ6JKamTi1n27bv0NpaSEvLJFpbC9m27TuxnOYBKCsrpq5uGYlEASUlRSQSBdTVLQt0iiUKNUSljoqKKdTWVvZrq62tHNVF30OZ4+85uNli4EbN8UsYDh7cw4EDTZx00qzYhn5fmUwr6XQLyWRp4IEbpRqiUkcq1UxDw36qq6cNO/SHtdi6yHg2dWq5Ar+PsrLiUMM2KjVEpY6KiimjOsrvK9Tgd/fngOfCrEFEJG70yV0RkZhR8IuIxIyCX0QkZhT8IiIxo+AXEYkZBb+ISMwo+EVEYkbBLyISMwp+EZGYUfCLiMSMgl9EJGYU/CIiMaPgFxGJmZgEfwbYktuGWEWmlS1b9pPJtMa6hqjYtKmBv/3bf2TTpoZQ64jKc5JKNbNu3Q5SqebQaohKX0RBXp8Pd4/8v/nz5/vwrXf3hLuX5rbrR7CvEVSxvskTie95aen3PZH4nq9f3xTLGqLiq19d5e++W+hvvz3J33230L/61VWh1BGV56S29hmHf+j5V1v7TOA1RKUvomC0ng+g0Y+QqaGuwHWshr8CVwYoB9r6tCWAPUBw6/hmMq2Ul6+hra2zt4pEAXv2rApssYco1BAVmzY1sGjRIoqLO3raWlsLeeGFF7jggurA6ojKc5JKNTNr1trD2puaVuZtIZCBotIXUTCaz8fRVuAa51M9aaBoQFthrj3AKtItFBX17+rCwgmk0y2xqiEqGhp+S3v7xH5tHR0TaGj4baB1ROU5aWjYP6T2fIhKX0RBEM/HOA/+JNA+oK0j1x5gFclS2tu7+lfR0UUyWRqrGqKiunoBRUWH+rUVFnZRXb0g0Dqi8pxUV08bUns+RKUvoiCI52OcB38ZUEd2eqckt60jyGkeyK7fWVe3jESigJKSIhKJAurqlgX6J2wUaoiKCy6o5rbbVtLaWkhLywdobS3ktttWBjrNA9F5TioqplBbW9mvrba2MrBpHohOX0RBEM/HOJ/j75YhO72TJOjQ71dFppV0uoVksjS0EzoKNUTFpk0NNDT8lurqBYGHfl9ReU5SqWYaGvZTXT0t0NDvKyp9EQWj8XwcbY4/JsEvIhI/MX1xV0REBlLwi4jEjIJfRCRmFPwiIjGj4BcRiRkFv4hIzCj4RURiRsEvIhIzCn4RkZhR8IuIxIyCX0QkZhT8IiIxo+AXEYmZwIPfzE4xs2fNLGVmO83s+qBrCE8UFn2PQg3RqGP37l1s3PgAu3fvCq2GrPD7IiqisOB7HIQx4u8EvuLuFcAC4FozmxVCHQGrJ7v+79Lctj6mNUSjjrVrv8H06XNZtGgl06fPZe3abwReQ1b4fREVq1dvZtastVx11VPMmrWW1as3h13SuBX69fjN7DHgXnd/5miPGfvX44/Cou9RqCEadezevYvp0+cettj6vn2vMnPmRwOpISv8voiKKCz4Ph5F8nr8ZpYEzgR+d4SvrTKzRjNrzGTG+p/AacJf9D0KNUSjjt27tx1xsfXdu7cFVkNWmrD7IiqisOB7nIQW/GZ2PPAQ8CV3/4+BX3f3Ne5e5e5VZWVjffSTJPxF36NQQzTqmDnzzCMutj5z5pmB1ZCVJOy+iIooLPgeJ6EEv5kVkg39n7n7w2HUEKwoLPoehRqiUcfMmR/lwQdv7LfY+oMP3hjwNA9EoS+iIgoLvsdJ4HP8ZmbAOuAtd//SsXzP2J/j7xaFRd+jUEM06ti9exe7d29j5swzQwj9vsLvi6iIwoLv40lkFls3s0XA88CrQFeu+Rvu/sTRvmf8BL+ISHCOFvwFQRfi7i8AFvRxRUQkS5/cFRGJGQW/iEjMKPhFRGJGwS8iEjMKfhGRmFHwi4jEjIJfRCRmFPwiIjGj4BcRiRkFv4hIzCj4RURiRsEvIhIzCn4RkZiJSfBfAhyf24bpK2TXWP1KiDXcSXa1yztDrCEqdbwI3JrbhikDbMltRfIv9MXWj8XIrsd/pCtAh/F/nkjv8gPd9zsDruE4oHXA/XcCriEqdVwAPDPg/tMB1wBQD9SQXXu3newKXCtCqEPGo0gutp5/RxvhBz3y/wr9Qx/gEMGO/O+kf9gCvEvwI+4o1PEi/UMfYBPBj/wzZEO/DWjJbWvQyF/ybZwH/+YhtufLhiG250P9ENvzJQp1bBpie76kyY70+yrMtYvkzzgP/iVDbM+Xy4bYng9Hmz4IelohCnVcMMT2fEmSnd7pqyPXLpI/muMPTAHZ6Z1uYczxH092WqVbWHP8UahjGf1H+GHP8ReSDX3N8cvoiekcP2RD/mKy4XIx4YQ+ZEP+BuA/57ZBhz5kw/XvgcrcNozQj0odTwMvALfktmGEPmRDfg/Z6cc9KPQlCDEY8YuIxFOMR/wiItKXgl9EJGYU/CIiMaPgFxGJGQW/iEjMKPhFRGJGwS8iEjNj4n38ZpYh++mW8WAqcDDsIiJCfdFLfdFLfdFrpH1R7u5lAxvHRPCPJ2bWeKQPVMSR+qKX+qKX+qJXvvpCUz0iIjGj4BcRiRkFf/DWhF1AhKgveqkveqkveuWlLzTHLyISMxrxi4jEjIJfRCRmFPwBMLNTzOxZM0uZ2U4zuz7smsJmZhPNbJuZbQy7lrCZ2QlmtsHM/jV3jvx12DWFxcy+nPsZ2WFm9WY2KeyagmJm95nZATPb0aftg2b2jJm9ltueOBrHUvAHoxP4irtXAAuAa81sVsg1he16IBV2ERHxfeApdz8NOIOY9ouZnQxcB1S5+xyy65N+JtyqAnU/8PEBbTcDv3L3U4Ff5e6PmII/AO6+391fzt3+M9kf7JPDrSo8ZjYduBD4cdi1hM3MSoC/IbvYLu7e7u7/L9yqQlUAJMysACgG/hRyPYFx918Dbw1ovhhYl7u9DrhkNI6l4A+YmSWBM4HfhVtJqO4GvgZ0hV1IBHwYyABrc1NfPzaz48IuKgzu/m/AXcBeYD/Q4u6bwq0qdB9y9/2QHUACJ43GThX8ATKz44GHgC+5+3+EXU8YzGw5cMDdt4ZdS0QUAPOAH7r7mcC7jNKf82NNbv76YmAG8FfAcWZ2RbhVjU8K/oCYWSHZ0P+Zuz8cdj0hWghcZGZp4AHgPDP7abglhWofsM/du/8C3ED2F0EcLQHecPeMu3cADwNnh1xT2P7dzKYB5LYHRmOnCv4AmJmRncNNuft3w64nTO7+dXef7u5Jsi/c/Yu7x3ZU5+7/F3jTzD6aazofaAqxpDDtBRaYWXHuZ+Z8YvpCdx+PA1fmbl8JPDYaOy0YjZ3IoBYC/x141cy259q+4e5PhFiTRMdq4GdmVgT8EVgZcj2hcPffmdkG4GWy74TbRowu32Bm9cBiYKqZ7QNuBe4Afm5mNWR/MX5qVI6lSzaIiMSLpnpERGJGwS8iEjMKfhGRmFHwi4jEjIJfRCRmFPwigJn9JzN7wMxeN7MmM3vCzGb2vVKiyHih9/FL7OU+LPQIsM7dP5NrqwQ+FGphInmiEb8InAt0uPv/7m5w9+3Am933zewqM7u3z/2NZrY4d/sdM/t7M9tqZpvNrNrMnjOzP5rZRX2+/zEze8rMdpnZrYH970QGUPCLwBxgJBeNOw54zt3nA38G/hZYCnwS+Hafx1UDlwOVwKfMrGoExxQZNk31iIxcO/BU7varwF/cvcPMXgWSfR73jLs3A5jZw8AioDHIQkVAI34RgJ3A/EEe00n/n5e+SwJ2eO+1T7qAvwC4exf9B1cDr4+i66VIKBT8IvAvwAfM7JruBjM7Cyjv85g0UGlmE8zsFLLTNkO1NLeGaoLsSkovjqBmkWFT8Evs5UbrnyQbzK+b2U7gNvov+/ci8AbZqZy7yF5BcqheAH4CbAcecndN80godHVOkQCY2ZYRTzgAAAA2SURBVFVkFxGvDbsWEY34RURiRiN+EZGY0YhfRCRmFPwiIjGj4BcRiRkFv4hIzCj4RURi5v8DIiJIkAYBN7sAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "ax = cell_df[cell_df['Class'] == 4][0:50].plot(kind='scatter', x='Clump', y='UnifSize', color='DarkBlue', label='malignant')\n",
    "cell_df[cell_df['Class'] == 2][0:50].plot(kind='scatter', x='Clump', y='UnifSize', color='Yellow', label='benign', ax=ax)\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Data pre-processing and selection"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Lets first look at columns data types:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "ID              int64\n",
       "Clump           int64\n",
       "UnifSize        int64\n",
       "UnifShape       int64\n",
       "MargAdh         int64\n",
       "SingEpiSize     int64\n",
       "BareNuc        object\n",
       "BlandChrom      int64\n",
       "NormNucl        int64\n",
       "Mit             int64\n",
       "Class           int64\n",
       "dtype: object"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cell_df.dtypes"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "It looks like the __BareNuc__ column includes some values that are not numerical. We can drop those rows:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "ID             int64\n",
       "Clump          int64\n",
       "UnifSize       int64\n",
       "UnifShape      int64\n",
       "MargAdh        int64\n",
       "SingEpiSize    int64\n",
       "BareNuc        int64\n",
       "BlandChrom     int64\n",
       "NormNucl       int64\n",
       "Mit            int64\n",
       "Class          int64\n",
       "dtype: object"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cell_df = cell_df[pd.to_numeric(cell_df['BareNuc'], errors='coerce').notnull()]\n",
    "cell_df['BareNuc'] = cell_df['BareNuc'].astype('int')\n",
    "cell_df.dtypes"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 5,  1,  1,  1,  2,  1,  3,  1,  1],\n",
       "       [ 5,  4,  4,  5,  7, 10,  3,  2,  1],\n",
       "       [ 3,  1,  1,  1,  2,  2,  3,  1,  1],\n",
       "       [ 6,  8,  8,  1,  3,  4,  3,  7,  1],\n",
       "       [ 4,  1,  1,  3,  2,  1,  3,  1,  1]])"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "feature_df = cell_df[['Clump', 'UnifSize', 'UnifShape', 'MargAdh', 'SingEpiSize', 'BareNuc', 'BlandChrom', 'NormNucl', 'Mit']]\n",
    "X = np.asarray(feature_df)\n",
    "X[0:5]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We want the model to predict the value of Class (that is, benign (=2) or malignant (=4)). As this field can have one of only two possible values, we need to change its measurement level to reflect this."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([2, 2, 2, 2, 2])"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cell_df['Class'] = cell_df['Class'].astype('int')\n",
    "y = np.asarray(cell_df['Class'])\n",
    "y [0:5]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Train/Test dataset"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Okay, we split our dataset into train and test set:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train set: (546, 9) (546,)\n",
      "Test set: (137, 9) (137,)\n"
     ]
    }
   ],
   "source": [
    "X_train, X_test, y_train, y_test = train_test_split( X, y, test_size=0.2, random_state=4)\n",
    "print ('Train set:', X_train.shape,  y_train.shape)\n",
    "print ('Test set:', X_test.shape,  y_test.shape)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Modeling (SVM with Scikit-learn)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The SVM algorithm offers a choice of kernel functions for performing its processing. Basically, mapping data into a higher dimensional space is called kernelling. The mathematical function used for the transformation is known as the kernel function, and can be of different types, such as:\n",
    "\n",
    "    1.Linear\n",
    "    2.Polynomial\n",
    "    3.Radial basis function (RBF)\n",
    "    4.Sigmoid\n",
    "Each of these functions has its characteristics, its pros and cons, and its equation, but as there's no easy way of knowing which function performs best with any given dataset, we usually choose different functions in turn and compare the results. Let's just use the default, RBF (Radial Basis Function) for this lab."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/home/jupyterlab/conda/envs/python/lib/python3.6/site-packages/sklearn/svm/base.py:196: FutureWarning: The default value of gamma will change from 'auto' to 'scale' in version 0.22 to account better for unscaled features. Set gamma explicitly to 'auto' or 'scale' to avoid this warning.\n",
      "  \"avoid this warning.\", FutureWarning)\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "SVC(C=1.0, cache_size=200, class_weight=None, coef0=0.0,\n",
       "  decision_function_shape='ovr', degree=3, gamma='auto_deprecated',\n",
       "  kernel='rbf', max_iter=-1, probability=False, random_state=None,\n",
       "  shrinking=True, tol=0.001, verbose=False)"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from sklearn import svm\n",
    "clf = svm.SVC(kernel='rbf')\n",
    "clf.fit(X_train, y_train) "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "After being fitted, the model can then be used to predict new values:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([2, 4, 2, 4, 2])"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "yhat = clf.predict(X_test)\n",
    "yhat [0:5]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Evaluation"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sklearn.metrics import classification_report, confusion_matrix\n",
    "import itertools"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "def plot_confusion_matrix(cm, classes,\n",
    "                          normalize=False,\n",
    "                          title='Confusion matrix',\n",
    "                          cmap=plt.cm.Blues):\n",
    "    \"\"\"\n",
    "    This function prints and plots the confusion matrix.\n",
    "    Normalization can be applied by setting `normalize=True`.\n",
    "    \"\"\"\n",
    "    if normalize:\n",
    "        cm = cm.astype('float') / cm.sum(axis=1)[:, np.newaxis]\n",
    "        print(\"Normalized confusion matrix\")\n",
    "    else:\n",
    "        print('Confusion matrix, without normalization')\n",
    "\n",
    "    print(cm)\n",
    "\n",
    "    plt.imshow(cm, interpolation='nearest', cmap=cmap)\n",
    "    plt.title(title)\n",
    "    plt.colorbar()\n",
    "    tick_marks = np.arange(len(classes))\n",
    "    plt.xticks(tick_marks, classes, rotation=45)\n",
    "    plt.yticks(tick_marks, classes)\n",
    "\n",
    "    fmt = '.2f' if normalize else 'd'\n",
    "    thresh = cm.max() / 2.\n",
    "    for i, j in itertools.product(range(cm.shape[0]), range(cm.shape[1])):\n",
    "        plt.text(j, i, format(cm[i, j], fmt),\n",
    "                 horizontalalignment=\"center\",\n",
    "                 color=\"white\" if cm[i, j] > thresh else \"black\")\n",
    "\n",
    "    plt.tight_layout()\n",
    "    plt.ylabel('True label')\n",
    "    plt.xlabel('Predicted label')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "              precision    recall  f1-score   support\n",
      "\n",
      "           2       1.00      0.94      0.97        90\n",
      "           4       0.90      1.00      0.95        47\n",
      "\n",
      "   micro avg       0.96      0.96      0.96       137\n",
      "   macro avg       0.95      0.97      0.96       137\n",
      "weighted avg       0.97      0.96      0.96       137\n",
      "\n",
      "Confusion matrix, without normalization\n",
      "[[85  5]\n",
      " [ 0 47]]\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAaQAAAEXCAYAAADiEjDuAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjEsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy8QZhcZAAAgAElEQVR4nO3dd5ydVbn28d+VBEzoJRAhdAQRUQJEjoJyUJAjRUCRZgPhyGvvIioHu3CsgIgKimJDEEUiiIA5osihNwVBOggEQpEeSsL1/rHWwGZOMnvPZGb2M9nXl8/+zH7KXs+aJMw9q91LtomIiOi2cd2uQEREBCQgRUREQyQgRUREIyQgRUREIyQgRUREI0zodgUiImL0jF9mTXvunI7v95x7zrT9uhGs0jMSkCIieojnzuF5L9yj4/sfv+Lbk0ewOs+RgBQR0VMEauZoTQJSREQvESB1uxbzlYAUEdFr0kKKiIhGSAspIiK6L2NIERHRFGkhRURE10kwbny3azFfCUgREb0mXXYREdEI6bKLiIjua+6khmbWKiIiRkbfwthOX50UKX1Y0tWSrpJ0gqSJklaQdLak6+vX5duVk4AUEdFrNK7zV7uipKnAB4DptjcCxgN7AQcBM22vB8ysxwNKQIqI6Cka1oBUTQAmSZoALAHcCewCHF+vHw/s2q6QBKSIiF4zTp2/YLKkS1peB7QWZfsO4GvAbcAs4EHbZwFTbM+q98wCVm5XrUxqiIjoJWKwkxrutT19gcWVsaFdgLWBB4BfSnrrUKqWFlJERK8Z3kkN2wI3277H9lPAr4EtgLslrVIep1WA2e0KSkCKiOgpwz6GdBvwcklLSBKwDXANMAPYp96zD3Bqu4LSZRcR0WuGcWGs7QslnQxcBswFLgeOAZYCTpK0PyVo7d6urASkiIheM8wLY21/BvhMv9NPUFpLHUtAiojoJYNY8DraEpAiInpNQ1MHJSBFRPSatJAiIqL7mptcNQEpIqLXpIUUERFdN/hMDaMmASkioqekyy4iIpoiXXYREdEIaSFFREQjpIUUERFdp4whRUREU6SFFBERTaAEpIiI6DaRgBQREU2g+mqgBKSIiJ6itJAiIqIZEpAiIqIREpAiIqIREpAiIqL7GjypoZnLdSMiYkSoTmro9NW2POmFkq5oeT0k6UOSVpB0tqTr69fl25WVgBQxAEmTJP1W0oOSfrkQ5bxF0lnDWbdukfQqSf/odj1i6IYzINn+h+1ptqcBmwGPAacABwEzba8HzKzHA0pAikWCpDdLukTSI5JmSTpD0iuHoeg3AVOAFW3vPtRCbP/M9nbDUJ8RJcmSXjDQPbbPtf3C0apTDL/hDEj9bAPcaPtWYBfg+Hr+eGDXdh9OQIoxT9JHgMOBL1OCxxrA0ZT/IRbWmsB1tucOQ1ljnqSMO491Ao1Txy9gcv1lr+91wACl7wWcUN9PsT0LoH5duV3VEpBiTJO0LPB54L22f237UdtP2f6t7Y/Xe54n6XBJd9bX4ZKeV69tLel2SR+VNLu2rt5Rr30OOATYs7a89pf0WUk/bXn+WrVVMaEe7yvpJkkPS7pZ0ltazv+l5XNbSLq4dgVeLGmLlmvnSPqCpPNqOWdJmryA77+v/ge21H9XSTtIuk7S/ZI+1XL/5pLOl/RAvfcoSYvXa3+ut11Zv989W8r/hKS7gB/2naufWbc+Y9N6vKqkeyVtvVB/sTGiBtlCutf29JbXMQsoc3FgZ2DIXdsJSDHWvQKYSOmzXpBPAy8HpgEbA5sDB7dcfz6wLDAV2B/4tqTlbX+G0uo60fZStn8wUEUkLQkcCWxve2lgC+CK+dy3AnB6vXdF4BvA6ZJWbLntzcA7KL9VLg58bIBHP5/yZzCVEkCPBd5K6c9/FXCIpHXqvfOADwOTKX922wDvAbC9Vb1n4/r9nthS/gqU1uJzfju2fSPwCeBnkpYAfgj8yPY5A9Q3umi4JzW02B64zPbd9fhuSasA1K+z2xWQgBRj3YqU3+AG6lJ7C/B527Nt3wN8Dnhby/Wn6vWnbP8OeAQY6hjJ08BGkibZnmX76vncsyNwve2f2J5r+wTgWuD1Lff80PZ1tucAJ1GC6YI8BXzJ9lPALyjB5gjbD9fnXw28FMD2pbYvqM+9Bfge8O8dfE+fsf1Erc9z2D4WuB64EFiF8gtANNgIBaS9eba7DmAGsE99vw9warsCEpBirLuP0sc90NjGqsCtLce31nPPlNEvoD0GLDXYith+FNgTeBcwS9LpkjbooD59dZracnzXIOpzn+159X1fwLi75fqcvs9LWl/SaZLukvQQpQU43+7AFvfYfrzNPccCGwHfsv1Em3uj2zSIVyfFldbxa4Fft5w+DHitpOvrtcPalZOAFGPd+cDjDDyD505Kd1OfNeq5oXgUWKLl+PmtF22fafu1lJbCtZQf1O3q01enO4ZYp8H4DqVe69leBvgU7X/seKCLkpaiTCr5AfDZ2iUZTaXhbyHZfsz2irYfbDl3n+1tbK9Xv97frpwEpBhNH6Z0H11FadpPBD5L+UF8RX3tMJgC6/8Ah1DGfXaVtISkxSRtL+kr9bYTgIMlrVQnBxwC/HRBZbZxBbCVpDVUJlR8su+CpCmSdq5jSU9Quv7mzaeM3wHrq0xVnyBpT2BD4LQh1mkwlgYeAh6prbd397t+N7DO//nUwI4ALrX9n5Sxse8ubCUl3SLpbyoLLS9Z2PLiuUaoy26hJSDFaJkKfACYTunaGU+ZIgrwTcoYyTTKD+tBsf0N4COUiQr3AP8E3gf8pt7yReAS4K/A34DL6rlBs302cGIt61KeG0TGAR+ltIDup4zNvGc+ZdwH7FTvvQ84ENjJ9r1DqdMgfYwyYeJhSuvtxH7XPwscX2fh7dGuMEm7AK+jdFNC+XvYVHV24UJ6dV1wOX0YyooWTQ1IsgdsjUcMl6nABZRZbg9RgsWRlJlojwBf617Vomkk3QJMH6Ug3VMWX+kFnvzGr7S/sZp1zG6XjtYvBWkhxWi5gxJ0bgNmAQ8Cfal03kdpcRwHtM13FT3BwFmSLtXACzFjKIZ5UsNwaWRAkjSv9h1fKekytSwaHEJZn5e07UJ8fpKkP0kaL2mayqLCqyX9tfb99933C0nrDfU5PWB5SuaEtSmzzJakrJX5DrAupbtuFvD1blUwGmVL25tS1ra8V9JW7T4QHRqBSQ3DpZEBCZhT+443pgwaHzrUgmwfYvsPC1GX/YBf12m1jwFvt/1iSr/54ZKWq/d9hzIWEPO3LXAzZYznKcr00C0og+jzKGtdjqUsWo0eZ/vO+nU2ZdFz/l0MowSkoVsG+FffgaSPq6Ra+atKape+9C3XSDq2tl7OkjSpXvuRpDfV9ztIulbSXyQdKem0ev6zko5TSdlyk6QPtDz/LdQFXXWh4vX1/Z2Ulccr1fvOBbZVcn0tyG2UbAlLUDoCtgGuoUyP7vMGygy86GGSlpS0dN97YDvy72JYNTUgNfWH5yRJV1CmBa8CvAZA0nbAepTflgTMqE352+r5vW2/U9JJwG60TO2VNJGyKn0r2zdLal1RDLAB8GrKtNh/SPpOfcY6dUX7c0janJLS5UYA209LuoEyaH9pv3sPoC/liiZspom9OUzy2YMPZI/ddnl07ty5XH7lVbzzPR9++7FHf/PIaS99MTbcctttvOv9H+Ouu2bv2b60RdNLN1i921Xoug02fDG33HQTkyYtwfMmTmT55ZdnyvNXOWPappt1u2pdd+Xll91re6X2d7bR0A36mhqQ5tS9NZD0CuDHkjai/Ka0HXB5vW8pSiC6DbjZdl/esEuBtfqVuQFwk+2b6/EJPDcv1+l1hfkTkmZTskY/DTzQv3IqeZl+Auxj++mWS7Mp4yPPCUg1GeExAOOWWNnPe2Hb2bSLpEN/eQuH/vKIZ4619q4c8NU/AX969qZlt+Z5y45+3ZriD38+vNtViAZbaenF+mf4GJLRbvl0qqkB6Rm2z1dZzLgSJa4favt7rfdIWouyELHPPGBSv6La/Q30//wEykywif2etQxl8d/Bti/oV8ZEnk3dEhHRON3oiutU48eQVFaTj6csIDwT2E8lVQmSpkpqu8dGdS2wTg1eUHKODcj2v4DxtbsPlfTqpwA/tj2/FOvrUzIRREQ0VsaQBqdvDAlKy2afOsvtLEkvAs6vf1CPUKYOzy89y3PYniPpPcDvJd0LXNRhXc4CXgn8AdgD2ApYUdK+9fq+tq+QNIXS1Tirw3IjIrqiqS2kRgYk2+MHuHYEJXdWfxu13PO1lvf7ttzzR9sbqPxtfJuSTgbbn+33jI1aDo+ipEP5g+2fsuAcaG+mTJqIiGi2Zsaj5nfZDbN31pbX1ZQN2doGENuXA3+UtMAgWT3As/vHR0Q0VrrsGsD2NymJPAf7ueM6uOeHQ6pURMRoUrrsIiKiAQQ0NB4lIEVE9JbmTvtOQIqI6DENjUcJSBERvSYtpIiI6D41t4XUa9O+IyJ6moBx49Txq6MypeUknVx3U7hG0iskrSDpbEnX169ts0onIEVE9Bip81eHjgB+b3sDyo4H1wAHATNtrwfMrMcDSkCKiOgxw7kwtiac3gr4AYDtJ20/QNkhui9ZwPHAru3KSkCKiOglg2gd1Xg0WdIlLa8D+pW4DmUn6B9KulzS9+vGilP6cnvWr20TYWdSQ0REDykLYwc1q+Fe29MHuD4B2BR4v+0LJR1BB91z85MWUkRET+m8u67DwHU7cLvtC+vxyZQAdXfdzLRvU9PZ7QpKQIqI6DHDOanB9l3APyW9sJ7aBvg7MAPYp57bBzi1XVnpsouI6DEjsDD2/cDP6iamNwHvoDR4TpK0P3AbsHu7QhKQIiJ6yQgsjLV9BTC/caZtBlNOAlJERA8ZwqSGUZOAFBHRYzrNwDDaEpAiInpMQxtICUgRET0lO8ZGREQTZMfYiIhoiOwYGxERDdHQeJSAFBHRa9JCioiI7mvwjrEJSBERPSQLYyMiojESkCIiohEaGo8SkCIiek1aSBER0X2Z1BAREU2gLIyNiIimaGg8SkCKiOg14xoakRKQIiJ6TEPjUQJSREQvUbafiIiIpmjohrEJSBERvSYtpIiIaIThjkeSbgEeBuYBc21Pl7QCcCKwFnALsIftfw1UzrjhrVZERDSZqGuROvxvEF5te5rt6fX4IGCm7fWAmfV4QAtsIUlaZqAP2n5oMDWNiIhmGKUxpF2Arev744FzgE8M9IGBuuyuBgzPCZF9xwbWGGIlIyKiWzToTA2TJV3ScnyM7WP63WPgLEkGvlevT7E9C8D2LEkrt3vQAgOS7dUHU+OIiBgbBjmGdG9LN9yCbGn7zhp0zpZ07VDq1dEYkqS9JH2qvl9N0mZDeVhERHSXKJkaOn11wvad9ets4BRgc+BuSasA1K+z25XTNiBJOgp4NfC2euox4Lsd1TIiIhpH6vzVviwtKWnpvvfAdsBVwAxgn3rbPsCp7crqZNr3FrY3lXQ5gO37JS3eweciIqKBhnkd0hTglFrmBODntn8v6WLgJEn7A7cBu7crqJOA9JSkcZRBKyStCDw91JpHRET3dNry6ZTtm4CN53P+PmCbwZTVSUD6NvArYCVJnwP2AD43mIdERERzjNls37Z/LOlSYNt6anfbV41stSIiYqQ0Mxx1njpoPPAUpdsu2R0iIsawpuay62SW3aeBE4BVgdWAn0v65EhXLCIihl+Z9t35azR10kJ6K7CZ7ccAJH0JuBQ4dCQrFhERI2DwmRpGTScB6dZ+900AbhqZ6kRExEhraDwaMLnqNyljRo8BV0s6sx5vB/xldKoXERHDScD4hu7QN1ALqW8m3dXA6S3nLxi56kRExEgbc112tn8wmhWJiIjR0cxw1MEYkqR1gS8BGwIT+87bXn8E6xURESNAau7C2E7WFP0I+CElqG4PnAT8YgTrFBERI2g4k6sOp04C0hK2zwSwfaPtgynZvyMiYgxSnfrdyWs0dTLt+wmVWt0o6V3AHUDbnf8iIqKZGtpj11FA+jCwFPAByljSssB+I1mpiIgYGaLzjfdGWyfJVS+sbx/m2U36IiJiLOrC2FCnBloYewp1D6T5sf3GEalRRESMqDG3Dgk4atRq0UM2edEanHdh/mhj/vY74YpuVyF6QFO3bBhoYezM0axIRESMPDE2W0gREbEIamgquwSkiIhe09SA1HFXoqTnjWRFIiJi5JUMDMO/MFbSeEmXSzqtHq8g6WxJ19evy7cro5MdYzeX9Dfg+nq8saRvdVzLiIholBHaMfaDwDUtxwcBM22vB8ysxwPXq4OHHAnsBNwHYPtKkjooImLMGu5cdpJWA3YEvt9yehfg+Pr+eGDXduV0MoY0zvat/Zpu8zqrZkRENIkYdLbvyZIuaTk+xvYx/e45HDgQWLrl3BTbswBsz5LUNuVcJwHpn5I2ByxpPPB+4LoOPhcREQ00yHVI99qevqCLknYCZtu+VNLWC1OvTgLSuynddmsAdwN/qOciImIMGuZlSFsCO0vagbJn3jKSfgrcLWmV2jpaBZjdrqC2gdL2bNt72Z5cX3vZvnehv4WIiBh1Ukmu2umrHduftL2a7bWAvYD/sf1WYAawT71tH+DUdmV1smPsscwnp53tA9rWNCIiGmeUEjUcBpwkaX/gNmD3dh/opMvuDy3vJwJvAP45pOpFRETXjdTCWNvnAOfU9/cB2wzm851sP3Fi67GknwBnD+YhERHRDEOYZTdqhpI6aG1gzeGuSEREjI6GxqOOxpD+xbNjSOOA++lgxW1ERDTQ4DMwjJoBA5LKatiNgTvqqadtL3DTvoiIaD7RzIg04LTvGnxOsT2vvhKMIiLGsDKGNCK57BZaJwt2L5K06YjXJCIiRkVTA9ICu+wkTbA9F3gl8E5JNwKPUgKsbSdIRUSMQWNxx9iLgE3pIENrRESMDX1ddk00UEASgO0bR6kuEREx0gaxrcRoGyggrSTpIwu6aPsbI1CfiIgYYWNxYex4YClo6PzAiIgYtLHaZTfL9udHrSYRETEqGtpAaj+GFBERixIxrqE/3gcKSIPK0hoREc0nwfhBbhk7WhYYkGzfP5oViYiI0TEWJzVERMQiRozNMaSIiFgEpYUUERGN0NB4lIAUEdFLRGdZtbshASkiopeouclVmxooIyJihGgQr7ZlSRMlXSTpSklXS/pcPb+CpLMlXV+/Lt+urASkiIgeUlIHqeNXB54AXmN7Y2Aa8DpJLwcOAmbaXg+YWY8HlIAUEdFjhrOF5OKRerhYfRnYBTi+nj+eDrYySkCKiOgxUucvYLKkS1peB/zf8jRe0hXAbOBs2xcCU2zPAqhfV25Xr0xqiIjoKRrspIZ7bU8f6Abb84BpkpYDTpG00VBqlhZSREQP6Zv23elrMGw/AJwDvA64W9IqAPXr7HafT0CKiOgxkjp+dVDWSrVlhKRJwLbAtcAMYJ962z7Aqe3KSpddRESPGeZVSKsAx0saT2nknGT7NEnnAydJ2h+4Ddi9XUEJSBERvWSYF8ba/iuwyXzO38cgtzFKQIqI6CFJHRQREY3R1NRBCUgRET2mmeEoASkiouc0tIGUgBQR0UvKGFIzI1ICUkREj0kLKSIiGkAoLaSIiGiCtJAiIqLrMoYUERHNoLSQIiKiIRKQIiKiETKpISIiuk7AuGbGowSkiIhekxZSREQ0QsaQIiKiEdJCioiIrssYUkRENERSB0VERBNkYWzEc5115u/52Ec+yLx589h3v//k4wce1O0qRQNI8KUd1uf+x57ia3+8mfe/ak1WWWYiAEsuPp5Hn5zHp07/R5drObYJGN/QiJSAFKNu3rx5fOgD7+X0M85m6mqr8cqXv4yddtqZF224YberFl22/QYrcceDTzBpsXEAfOvcW5+59pbNVuWxJ+d1q2qLlGaGIxjX7QpE77n4ootYd90XsPY667D44ouz+557cdpvT+12taLLVlhiMaZNXYY/3nDffK+/fM3lOP+Wf41yrRZRGsSrXVHS6pL+KOkaSVdL+mA9v4KksyVdX78u366sBKQYdXfeeQerrbb6M8dTp67GHXfc0cUaRRO8bfpUTrjsTuz/e22DlZfkwcfnctfDT45+xRZBGsR/HZgLfNT2i4CXA++VtCFwEDDT9nrAzHo8oBELSJIs6SctxxMk3SPptDaf27rvHkk7Sxq1wQVJ0yTt0O/crpIO6XfuTfX7m16PV5L0+9Gq51jn+fzEUUP7tGN0bDJ1GR56fC433z9nvte3WGt5/vfmtI6Gi9T5qx3bs2xfVt8/DFwDTAV2AY6vtx0P7NqurJEcQ3oU2EjSJNtzgNcCg/o12PYMYMZIVG4BpgHTgd+1nDsQ2LnvQNLSwAeAC/vO2b5H0ixJW9o+b7QqO1ZNnboat9/+z2eO77jjdlZdddUu1ii6bf2Vl2TT1ZZh2tQNWWy8mLTYeN6z5Rocfd5tjBO8bI1l+fTvrut2NRcZg/z1b7KkS1qOj7F9zHzLldYCNqH8fJxiexaUoCVp5XYPGukuuzOAHev7vYET+i5I2lzS/0q6vH59Yf8PS9pX0lH1/bqSLpB0saTPS3qknt9a0jmSTpZ0raSfqf66LemQev9Vko5pOX+OpP+WdJGk6yS9StLiwOeBPSVdIWlPSesDT9i+t6VaXwC+Ajzer7q/Ad4yDH9mi7zpL3sZN9xwPbfcfDNPPvkkvzzxF+y4087tPxiLrBMvn8X7f/13PnjK3/nWubdy9V0Pc/R5twGw0SpLc+dDT3D/Y091uZaLkMGNId1re3rLa0HBaCngV8CHbD80lGqN9Cy7XwCH1C64lwLHAa+q164FtrI9V9K2wJeB3QYo6wjgCNsnSHpXv2ubAC8G7gTOA7YE/gIcZfvzALX7cCfgt/UzE2xvXrvoPmN729o1N932++pn3gFc1vcQSZsAq9s+TdLH+tXhEuCL86u4pAOAA+rhI5MWU+atwrIvWn+d1YHxwN2bTdvorm5XKJphxx13XPqVH/3olBPe/pobgMm7nXzyUj/8+oWPnvDVr97T7bo1wJoLW0CJM8PbRS5pMUow+pntX9fTd0tapbaOVgFmtytnRAOS7b/WJtzePLcbDGBZ4HhJ6wEGFmtT3Ct4tg/y58DXWq5dZPt2AElXAGtRAtKrJR0ILAGsAFzNswGp7w/t0nr//KwC3FPLHQd8E9h3AffOBubb71R/o5jvbxW9TtIltqd3ux7RPLaRdMluu+221m677cZXvvKVbldp0TDMC2Nrz9MPgGtsf6Pl0gxgH+Cw+rXtVNrRmGU3gxI8Tuh3/gvAH21vBLwemLgQz3ii5f08YIKkicDRwJtsvwQ4tt8znmi9fwHlzmn5zNLARsA5km6hzCaZ0Texod43/xHZiIgGGcZZ31B6pN4GvKYOd1xRe54OA14r6XrKHILD2hU0GgtjjwMetP03SVu3nF+WZyc57NtBORdQuvROBPbq4P6+QHJv7dt8E3Bym888TAk8fa4B3gpg+0Fgct8FSecAH7PdN9i3PnBVB/WKiOiuYWwh2f7LACVuM5iyRryFZPt220fM59JXgEMlnUcZR2jnQ8BHJF1E6Up7sM1zH6C0iv5GmXBwcQfP+COwYd+kBuDPwCZ9kyHaeDVwegf3xXOlKzMGkn8fw24wq5BGdzmG5rcmpIkkLQHMsW1JewF7295lFJ57BPBb239oc9+fgV1sZ7FERDTWhi/d1D8/7U8d37/JmstcOlrjvGMpl91mwFG1tfIAsN8oPffLwL8NdIOklYBvJBhFRNMNYmxo1I2ZgGT7XGDjLjz3btoszrV9D6VbMCKi+RoakcZMQIpoJUkeK/3NEQ2TDfoiFpKkFSkZMubZflzSONtPd7teEWNNU1NHJtt3jCWfAP4L+Kmk1ROMoh1JK0v6sqTnS1q22/VpimFehzRsEpBiLPkUcAhwOfAzSbvVVlPEgjwELA58BPiypM27XJ/uG0w0GuWIlC67aDRJa1Mmszxlu2+d15ck3UBZKL0Y8IuMKUWr2hp62PbjwMdqirKtgJMk/We7ZRyLuqaOIaWFFI0laQNKDsQtgGMlfaTvmu0TKfkI3ylp/bo+rZn/l8WoqsswrgfeLmkZANvX2/4Bpdv3x5Je0c06dpMY3v2QhlMCUjSSpBWAH1LWdx0IvA54X91EUQC2TwZ+Dxwtacm0kKJajDL55Y3A9pKW7LtQf5E5mPJv6fldql/XNbTHLl120VgPAN8ATq6z6f4q6VxgfGvgsf3V2j0zFcgOboHtO+t2M/cA7wUeqbsAqO4KcAYlw//SQG9ue9LQvoS0kKJRJE2W1Je/7Pcu+mbTzaXuByNpTUnL1tbSbZTtRaJHSVpJ0vL1vShbzlwM/D/KzMyrgZdB2b2UkuX/Hd2pbfc1NZddAlI0St2d9zHgJbYfBpDUl3x3EvCUpE0piWyfX1tL3yeZ1ntW3avsTcAGAPXfxBmUDPzXAlMo+5XNlTSp3vM54LS6sVzPyRhSRBsqxgH/AnaYzy2XALsDRwKftv2POrvuaduPjGZdozlqC3pF4M0tpx+m7NL8d+C/KbkvD6z39bnAdk/ui54xpIg26m+2lnQc8EdJc2wfbntevWU8ZX+q19k+K1O9e1u/v/+vUHag3s/2cbbPl3QZcJPt79b731RzUwLPBLLe1NAxpASk6Lq+HyySJgPjbP9T0h7AcZKetn1kvfUM4M+2L0ww6m11R+hpwAWSNgSeB5wEvErSf9g+0/Z7W+4fR+m263ml5dPMiJSAFF1Xg9HOwCeBpSUdYvvXkvYHfll3/P257avgmR8uCUa9bSVgs7o27SWUDTLvoIwjbSdpBdsn9N3c062h/rowNtSpjCFF10l6MfA+4J3Ap4HPStrL9qXAv1N2CH6vpC9IGl/HjBKQepjtf1J+fr2RMhZ0l+3ZwM+BK4CdJX1b0hp9ExniWRlDipgPSatS8ozNqy2gqyTNA74gaaLtH0n6aL19M0rXzGNdqm50Wb+u2uOA+4ENJX0B+KbtWyWdAfwK+BKwE3CdpJn5JaZFQ1tICUjRNZLWrD9AzgH2kPR24CTbp0maABwq6Szbd9aPnN+1ykYj1O7d1wGbA3fa/r6kf6NMdnlPncjwWuDjto0tDOkAAAvVSURBVD9clwxkvPE5hnd9UZ2EtBMw2/ZG9dwKwImUBci3AHt0sqN2uuxiVPWl/anJLo+T9EHbPwF+SVm4+KbaMvoNsFVLMIoe1vLvZhPgCEpqoDdI+ontC4HjKYujjwL+x/ZcANvz+t7Hs4Z5HdKPKKm9Wh0EzLS9HjCzHreVFlKMqpYJDO+gpAd6o6QJtr8u6Wlga2C8pB8D93WxqtEg9d/N5sA+wOds/1zStyippX5s++3AJZK+bvuOzMJcsOEeG7L9Z0lr9Tu9C+X/ZSi/LJxDSWw7oLSQYsRJWkrSEvX9ctSJC8DelP2N/k3Se23/FDgPuKxfyqAIgFUpW0i8VNIStudQtiBZXdKp9Z474Zk1bbEgg5vVMFnSJS2vAzp4wpSaoqkvVdPKnVQrLaQYUTUAfQg4StIc4Ml66RHbT9Y+/78C+0p6vG4RENG6Pm01YJbt30h6EPgMsIOk023PkbQ9sBEkEHVqkGNI99qePlJ1aZUWUowo2w8AxwATgTfYfgyYAXxd0mo1X92VwJ+BV6psyBfR1033euBnwLclvQs4F/gi8G5Kd+8k24/bvqSbdR1rxqnz1xDdLWkVgPq1o0XJCUgxYuoCVurEhJ2Bt0raFfgFcAEws07pPhw4lZI8dekuVTcaRtKWwOcoXbsTKOvU/ovyy8vXKUFp2a5VcKwaxISGhVhAO4My3kf9euoA9z4jXXYxIvqSnkqaYvtu20dLegh4A+UXocOBG4DlgF0p2wWsR1lXEj1MZf+rpylbjfwnZQv7jSlBaF/gC5RAdaHtTHwZkmGd9n0CZQLDZEm3U7pUD6NsF78/ZXuY3TspKwEpRkTtbtkB+G9JFwBn2v5pnb27M+Xf3gzbj6tsJ/0VYD+XDdSiB7XMjJsIPFZn0k0Avge8zfa1dQ3SKsBU29d3s75jlRje1EG2917ApW0GW1YCUowISdOBPSlZGDagJL1c3vaxKnvQ7Ar8ibKeZDawZ9Yc9baWRa/vUdkdeEbdYmQycFCd5r0m8KEEo4XT0EQNGUOK4Vd/gPwImGD7bMqkhguAF0t6j+0fAh/r2wrA9o0JRlHXGX0cOAWYTpl5+WLKXkbLAV8FDrd9efdquWjIBn3RM1x2ff08Jevy7rafoGRiuBzYSNLqCUDRStKawDeB0+svLB+n7H/1NmAN27sCu9k+pS9rQwxdtjCPRVZLWpdXSfqIpG0p6UL2Af5L0m41fcvPgC/WTM3R4/oFlnsou7vuL2k927dRUgQtSZmduUxfLrSsNRoGDU33nYAUC62l7/8Y4CHgaOCttn9HycrwVUl72J6bllHAcxa9biHpQuAp4P8Bv6Yk1V3P9h2U7cePtf1QN+u7qGloPEpAioUnaVlKtt/XA3+jbA9xUr18OmViw6zu1C6apk7rtqRXA9sCa1MmuEygLHr9G3CkpPVt32772i5Wd5EzmPGjjCFF40laV9IbJe0CYPtBylqDrwFHAjvbnlUXwW5p+ze2z03ff29T2Xacuj7tJZSJL2dRtpK4EbgYeJoyeeFSYKnu1HTRlzGkWCRIWp+y6npL4BM1nQuUHyjPB75q+7Y67fu/KQPTQPr+e1ndH+ejkpappx4HzrJ9ge1bbL8NeAT4H+BJ2wfbvqxb9V3kNbTPLgEpOiZpQ8qmW5+0/VHKWJEkvdD2r4AzKHvUnA78gLJJ2jldq3A0Ql3cOoeyvfjSNSXQ/ZS1aTu03HoMsDjw8760UzEyGhqPsjA2BmUFYGPbv63HBwJ3AO+WdK7t90qaAqwL3FcXNWZfmh5WW0bfBA6zfY2kg4CXAJ+iTGI4RdKnKAHrbcAnKemlxlO672IENLXzPL+FRMds/wXYUdJNkv4AnGx7e8oixtdKOqjmrftf2/+on0kw6m2LUcYXP183cTsGuIKSJPUm4D8omTxeC3yY0kKaTsltGCNiMCNIGUOKBrN9BiXr8taUGVHYfpIyXvRU92oWTVSzcRxNCULfAJahBKUbgIMp40UforSOVgC+BbyzTpSJEdCXyy6z7GKRYHsmJUHqdQCSXkBZWf+3btYrmqN1RmXdMfRbPBuUlge+Q+nu/YCk5Skto7nA9ravGv0aRxNkDCmGxPbvJD0t6THgZkrCy7O6Xa/ovpZFr/9B2TbiCeC7lOncB1Iyu3+Ckolhxb4MDJTt62MUZAwpFjm2f09ZDHtwfR/Rl7ljJ+BQ4BrKJIUT6uVDKd11hwNP2L6pO7XsbU0dQ0oLKRZK7b4js+l6m6Q1gNVtnydpOcqGbHsCL6XMmHsS+A2wC2VzvdVtP96t+va0LowNdSoBKYZFglFvqmNFSwMXAg9Ker/tsyV9krJlxKcpaaVU7/kdsI3tG7pV517XjfVFnUqXXUQMmYuHKGmA/gl8WNIbaxJdAxfV92tTFkt/Mr+8NEBDV8amhRQRQyJpMdt9U/3PobSIzqBsrAdwNrCepO9Qdgh+i+0Lu1HXeK7RHhvqVFpIETFokjYAfiBp63rqLGBZ4OXAj4H9KRkZ3liPd7X9P12oasxHU9chpYUUEUOxMvBWyrb036Wk+fkksDdlrGgS8GXKluO/6VotY76GO87U/dCOoExg+b7tw4ZSTgJSRAya7T9L2go4E7gT2AL4BTCVslvwSZSfe7d3rZKxYMMYkSSNB75NSf90O3CxpBm2/z7YshKQImJIbP9F0hspa4peStmWZHtgWdvzJJ1Ut66PhhnmMaTNgRv61pRJ+gVlen8CUkSMHttnSvoY8Ffg5bYvkrRYvZZg1ECXX3bpmUssrsmD+MhESZe0HB9j+5iW46mUGZZ9bgf+bSh1S0CKiIVi+3RJ84DrJG3QkgooGsj264a5yPk1t4Y0tT+z7CJiodXUUftRctdFb7kdWL3leDXKuOKgKWvUImI4JY1Ub6k7Al8HbEPJ4H4x8GbbVw+2rHTZRcSwSjDqLbbnSnofZcbleOC4oQQjSAspIiIaImNIERHRCAlIERHRCAlI0bMkzZN0haSrJP1S0hILUdbWkk6r73eWdNAA9y4n6T1DeMZn65qfjs73u+dHkt40iGetJSlbiceoSkCKXjbH9jTbG1E2kHtX60UVg/5/xPaMNrm8lgMGHZAiFnUJSBHFucALasvgGklHA5cBq0vaTtL5ki6rLamloCSUlHStpL9QslpTz+8r6aj6foqkUyRdWV9bAIcB69bW2VfrfR+XdLGkv0r6XEtZn5b0D0l/AF7Y7puQ9M5azpWSftWv1betpHMlXVe3GEfSeElfbXn2/1vYP8iIoUpAip5X11FsD/ytnnoh8GPbmwCPAgcD29reFLgE+IikicCxwOuBVwHPX0DxRwJ/sr0xsClwNXAQcGNtnX1c0nbAepScYNOAzSRtJWkzYC9gE0rAe1kH386vbb+sPu8ayjYQfdYC/h3YEfhu/R72Bx60/bJa/jslrd3BcyKGXdYhRS+bJOmK+v5cyo6mqwK32r6gnn85sCFwXt10bnHgfGAD4Gbb1wNI+ilwwHye8Rrg7QC251G2+V6+3z3b1dfl9XgpSoBaGjjF9mP1GTM6+J42kvRFSrfgUpS1IX1Osv00cL2km+r3sB3w0pbxpWXrs6/r4FkRwyoBKXrZHNvTWk/UoPNo6yngbNt797tvGkPM1zUfAg61/b1+z/jQEJ7xI8pmeFdK2hfYuuVa/7Jcn/1+262BC0lrDfK5EQstXXYRA7sA2FLSCwAkLSFpfeBaYG1J69b79l7A52cC766fHS9pGeBhSuunz5nAfi1jU1MlrQz8GXiDpEmSlqZ0D7azNDCrZtx+S79ru0saV+u8DvCP+ux392XolrS+pCU7eE7EsEsLKWIAtu+pLY0TJD2vnj7Y9nWSDgBOl3Qv8Bdgo/kU8UHgGEn7A/OAd9s+X9J5dVr1GXUc6UXA+bWF9gjwVtuXSToRuAK4ldKt2M5/UXZsvZUyJtYa+P4B/AmYArzL9uOSvk8ZW7pM5eH3ALt29qcTMbySOigiIhohXXYREdEICUgREdEICUgREdEICUgREdEICUgREdEICUgREdEICUgREdEI/x+xG7mXtCON6QAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 2 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Compute confusion matrix\n",
    "cnf_matrix = confusion_matrix(y_test, yhat, labels=[2,4])\n",
    "np.set_printoptions(precision=2)\n",
    "\n",
    "print (classification_report(y_test, yhat))\n",
    "\n",
    "# Plot non-normalized confusion matrix\n",
    "plt.figure()\n",
    "plot_confusion_matrix(cnf_matrix, classes=['Benign(2)','Malignant(4)'],normalize= False,  title='Confusion matrix')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "You can also easily use the __f1_score__ fron sklearn library:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.9639038982104676"
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from sklearn.metrics import f1_score\n",
    "f1_score(y_test, yhat, average='weighted') "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Lets try jaccard index for accuracy:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.9635036496350365"
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from sklearn.metrics import jaccard_similarity_score\n",
    "jaccard_similarity_score(y_test, yhat)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Practice\n",
    "Can you rebuild the model, but this time with a __linear__ kernel? You can use __ kernel='linear'__ option, when you define the svm. How the accuracy changes with the new kernel function?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0.9782552410493706\n",
      "0.9781021897810219\n",
      "              precision    recall  f1-score   support\n",
      "\n",
      "           2       1.00      0.97      0.98        90\n",
      "           4       0.94      1.00      0.97        47\n",
      "\n",
      "   micro avg       0.98      0.98      0.98       137\n",
      "   macro avg       0.97      0.98      0.98       137\n",
      "weighted avg       0.98      0.98      0.98       137\n",
      "\n",
      "Confusion matrix, without normalization\n",
      "[[87  3]\n",
      " [ 0 47]]\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAaQAAAEXCAYAAADiEjDuAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjEsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy8QZhcZAAAgAElEQVR4nO3debzc49nH8c83CZIQJEJE7BpbtYJU1fZoLbVVUrvSRiktutgbrSq6UFpF0TbWoJZQKqWWNG1aPISE2J4g9i1NxL5ESFzPH/c9jNOTM3NOZs78Tub79prXmd8y9+8+SZzr3Nt1KyIwMzNrtG6NroCZmRk4IJmZWUE4IJmZWSE4IJmZWSE4IJmZWSH0aHQFzMys83RfcpWIubOrvj9mv3xrRGxfxyp9xAHJzKyJxNzZLLbWnlXf/96Uc/vXsTqf4IBkZtZUBCrmaI0DkplZMxEgNboWrXJAMjNrNm4hmZlZIbiFZGZmjecxJDMzKwq3kMzMrOEk6Na90bVolQOSmVmzcZedmZkVgrvszMys8TypwczMisALY83MrDDcQjIzs8Zzl52ZmRVFN3fZmZlZo4nCtpCKWSszM6sfqfpXVcXpCEmPSHpY0pWSekrqJ2mcpGn5a99K5TggmZk1lTyGVO2rUmnSIOD7wNCIWA/oDuwNjATGR8RgYHw+bpMDkplZs6lxC4k0/NNLUg+gN/ASMAwYna+PBoZXKsQBycys2bSvhdRf0qSy18HlRUXEi8CvgeeA6cAbEXEbMCAipud7pgPLVaqWJzWYmTWT9rV8AGZFxND5F6e+pNbQasDrwDWS9utI1RyQzMyaTW1n2W0DPB0RLwNIug7YFJghaWBETJc0EJhZqSB32ZmZNZvajiE9B2wiqbckAVsDU4GxwIh8zwjghkoFuYVkZtZUapupISImSroWuA+YC9wPjAKWAMZIOpAUtPaoVJYDkplZs6lxctWI+Cnw0xan55BaS1VzQDIzayYFztTggGRm1lScXNXMzIrC+yGZmVkhuIVkZmaF4BaSmZk1nDyGZGZmReEWkpmZFYEckMzMrNGEA5KZmRWB8quAHJDMzJqK3EIyM7NicEAyM7NCcEAyM7NCcEAyM7PG86QGMzMrAhV4UkMx80eYFYSkXpL+KukNSdcsQDn7SrqtlnVrFElbSHqs0fWwjpNU9aszOSDZQkHS1yRNkvS2pOmSbpa0eQ2K3h0YACwTERW3YJ6fiPhTRGxXg/rUlaSQ9Km27omI2yNirc6qk9WeA5JZnUg6EjgT+CUpeKwMnAcMq0HxqwCPR8TcGpTV5UlyN39XJ1A3Vf3qTA5I1qVJWgo4GTgsIq6LiHci4oOI+GtEHJPvWUzSmZJeyq8zJS2Wr20l6QVJR0mamVtX38zXTgJOAPbKLa8DJZ0o6fKy56+aWxU98vH+kp6S9JakpyXtW3b+jrLPbSrp3twVeK+kTcuuTZD0M0l35nJuk9R/Pt9/qf7HltV/uKQdJT0u6VVJPyq7f2NJd0l6Pd97jqRF87V/59seyN/vXmXl/1DSf4CLS+fyZ9bIz9gwH68gaZakrRboL9bqyi0ks/r4AtATuL6Ne34MbAIMAdYHNgaOL7u+PLAUMAg4EDhXUt+I+Cmp1XV1RCwRERe2VRFJiwNnAztERB9gU2BKK/f1A27K9y4DnAHcJGmZstu+BnwTWA5YFDi6jUcvT/ozGEQKoOcD+wEbAVsAJ0haPd87DzgC6E/6s9saOBQgIrbM96yfv9+ry8rvR2otHlz+4Ih4Evgh8CdJvYGLgUsiYkIb9bUGKk1qqFVAkrSWpCllrzclHS6pn6Rxkqblr30rleWAZF3dMsCsCl1q+wInR8TMiHgZOAn4etn1D/L1DyLib8DbQEfHSD4E1pPUKyKmR8QjrdyzEzAtIi6LiLkRcSXwKPCVsnsujojHI2I2MIYUTOfnA+AXEfEBcBUp2JwVEW/l5z8CfBYgIiZHxN35uc8AfwT+p4rv6acRMSfX5xMi4nxgGjARGEj6BcAKrJYBKSIei4ghETGE9EvQu6RfEEcC4yNiMDA+H7fJAcm6uleA/hXGNlYAni07fjaf+6iMFgHtXWCJ9lYkIt4B9gK+A0yXdJOktauoT6lOg8qO/9OO+rwSEfPy+1LAmFF2fXbp85LWlHSjpP9IepPUAmy1O7DMyxHxXoV7zgfWA34XEXMq3GuNpna82mdr4MmIeJY0hjs6nx8NDK/0YQck6+ruAt6j7X/sL5G6m0pWzuc64h2gd9nx8uUXI+LWiNiW1FJ4lPSDulJ9SnV6sYN1ao/fk+o1OCKWBH5E5R870dZFSUuQJpVcCJyYuyStqNTuFlJ/pRmspdfBbZS+N3Blfj8gIqYD5K/LVaqaA5J1piNI3UcPk/7R9gSuJo2zTAGeoZUxl7ZExBukcZNz82B+b0mLSNpB0mn5tiuB4yUtmycHnABcPr8yK5gCbClpZaUJFceVLkgaIGmXPJY0h9T1N6+VMv4GrKk0Vb2HpL2AdYEbO1in9ugDvAm8nVtvh7S4PgNY/b8+1bazgMkR8S3S2NgfFqSCknpKukfSA5IeUZpcYjXUzoA0KyKGlr1GzafMRYFdgA6v13NAss4yCPg+MJTUtdOd9NvUXqTxkSHAn4Hr2ltwRJwBHEmaqPAy8DzwXeAv+ZafA5OAB4GHgPvyuXaLiHGkIPogMJlPBpFuwFGkFtCrpLGZQ1sp4xVg53zvK8CxwM4RMasjdWqno0kTJt4itd6ubnH9RGB0noW3Z6XCJA0Dtid1U0L6e9hQeXZhB80BvhQR65P+XWwvaZMFKM9aqNMsux2A+yKi1F08Q9LA/LyBwMyK9YposzVuViuDgLtJs9zeJAWLs4FS9gIBzwFfIg2Qm5Fn7t0BHBIRExtdn4XBost+KvrvelrlG7Ppo3abHBFDK90n6Srg1oi4OB+fThrfPFXSSKBfRBzbVhluIVlneRH4NSnoTAfe4ONgBGl68gwcjAyQ1F3SFNJv1eMcjGqsxpMa8i8O2/LJHo5TgW0lTcvXTq1UTiEDkqR5eT77A5LuU9miwQ6UdbKkbRbg870k/Sv/DzJEaVHhI5IezH3/pfuukjS4o89pAn1Js25WI80yW5y0VqZkHz4eDLUmFxHz8jTiFYGNJa3X6DotNNo/qaGiiHg3IpbJY7qlc69ExNYRMTh/fbVSOYUMSMDsPK99fdKg8SkdLSgiToiIvy9AXQ4ArsvTat8FvhERnyb1m58pael83+9JYwHWum2Ap0ljPB+QfpMq/aLRA9iV/x7PsCYXEa8DE0j/v1mN1GkMaYEVNSCVWxJ4rXQg6RilVCsPlmbfKKVvmSrp/Nx6uU1Sr3ztEkm75/c7SnpU0h2SzpZ0Yz5/oqSLlFK2PCXp+2XP3xe4ASAvVJyW379E6k5YNt93O7CNnOtrfp4jZUvoTeoI2BqYmq9tQ5qK/EJjqmZFkmdDLp3f9+Ljfx9WI0UNSEX94dkr9x/3JK3n+BKApO2AwaTULwLGStqS9MNuMLBPRBwkaQywG2VTeyX1JK1K3zIinpbUsntobeCLpGmxj0n6fX7G6nlF+ydI2piU0uVJgIj4UNITpEH7yS3uPZhSyhX12Eg9K2bQWCidePyx7LnbsHfmzp3L/Q88zEGHHvGN999//+yL/ng2E++dzB8vGN30M2zWX3vlRleh4dZaex2ee/YZevXqTc+ePVl66b4sP3CFzTfYsOK4+kJvyv2TZ0XEspXvrKCY2yEVNiDNzv3HSPoCcGnuQ94uv+7P9y1BCkTPAU9HRGkNy2Rg1RZlrg08FRFP5+Mr+WRerpvyCvM5kmaSskZ/CLzesnJ5CuNlwIiI+LDs0kzS+MgnAlKetz8KoFvv5WKxtSrOpl0onXLNM5xyzVkfHWu14SwGHHJGyjnarH8u5SbceVblm6xpLd27R8sMHx3S2S2fahU1IH0kIu5SWsy4LCmunxIRfyy/R9KqpLULJfOAXi2KqvQ30PLzPUgzwXq2eNaSpMV/x0fE3S3K6MnHqVvMzAqnEV1x1Sr8GJLSavLupAWEtwIHKKUqQdIgSRXTUWSPAqvn4AVpQWabIuI1oHvu7iutRL4euDQiWluNvCYpE4GZWWF5DKl9SmNIkFo2I/Ist9skrQPclf+g3iZNHW4tPcsnRMRsSYcCt0iaBdxTZV1uAzYH/g7sCWwJLCNp/3x9/4iYImkAqatxepXlmpk1RFFbSIUMSBHRvY1rZ5FyZ7W0Xtk9vy57v3/ZPf+MiLWV/jbOJaWTISJObPGM8jUP55DSofw9Ii5n/jnQvkaaNGFmVmzFjEfF77KrsYNyy+sR0oZsFQNIRNwP/FPSfINk9jofp1o3Myssd9kVQET8FvhtBz53URX3XNyhSpmZdSa5y87MzApAQEHjkQOSmVlzKe60bwckM7MmU9B45IBkZtZs3EIyM7PGk1tIZmZWAAK6dStmRHJAMjNrMm4hmZlZIXgMyczMGq/AY0jNljrIzKyppYWxtU0dJGlpSdfmHbmnSvqCpH6Sxkmalr9W3JnUAcnMrKlUH4za0bV3FnBLRKxN2jV7KjASGB8Rg4Hx+bhNDkhmZk1Gqv5VuSwtSdqW50KAiHg/Il4HhvFxwunRwPBKZTkgmZk1mXa2kPpLmlT2OrhFcasDLwMXS7pf0gWSFgcGlPaHy18rbqbqSQ1mZs2k/ZMaZkXE0Dau9wA2BL4XERMlnUUV3XOtcQvJzKyJ1GFSwwvACxExMR9fSwpQMyQNJD1vIDCzUkEOSGZmTaZbN1X9qiQi/gM8L2mtfGpr4P+AscCIfG4EcEOlstxlZ2bWZOqwDul7wJ8kLQo8BXyT1OAZI+lA4Dlgj0qFOCCZmTWTOuwYGxFTgNbGmbZuTzkOSGZmTcQ7xpqZWUF4x1gzMyuIgsYjByQzs2bjFpKZmTVegbN9OyCZmTWR0sLYInJAMjNrMg5IZmZWCAWNRw5IZmbNxi0kMzNrPE9qMDOzIpAXxpqZWVEUNB45IJmZNZtuBY1IDkhmZk2moPHIAcnMrJmoDttP1IoDkplZk6liI9iGcEAyM2sybiGZmVkhFDQeOSCZmTUTkdYiFdF8A5KkJdv6YES8WfvqmJlZvXXFMaRHgIBPhNLScQAr17FeZmZWD6p9pgZJzwBvAfOAuRExVFI/4GpgVeAZYM+IeK2tcuYbkCJipVpV1szMiqNOY0hfjIhZZccjgfERcaqkkfn4h20V0K2ap0jaW9KP8vsVJW3U0RqbmVnjiJSpodrXAhgGjM7vRwPDK32gYkCSdA7wReDr+dS7wB86WEEzM2swqfoX0F/SpLLXwa0UGcBtkiaXXR8QEdMB8tflKtWrmll2m0bEhpLuzwW/KmnRar5pMzMrnnaOIc2KiKEV7tksIl6StBwwTtKjHalXNV12H0jqRoqASFoG+LAjDzMzs8ZqT+uo2rgVES/lrzOB64GNgRmSBqZnaiAws1I51QSkc4E/A8tKOgm4A/hVddU0M7OiqeUYkqTFJfUpvQe2Ax4GxgIj8m0jgBsqlVWxyy4iLpU0Gdgmn9ojIh6uWEszMyukGk+yGwBcn7sBewBXRMQtku4Fxkg6EHgO2KNSQdVmaugOfEDqtqtqZp6ZmRVTLdchRcRTwPqtnH8F2Lo9ZVUzy+7HwJXACsCKwBWSjmvPQ8zMrBjStO/qX52pmhbSfsBGEfEugKRfAJOBU+pZMTMzq4M6ZGqolWoC0rMt7usBPFWf6piZWb0VNB61mVz1t6Qxo3eBRyTdmo+3I820MzOzLkZA94JmV22rhVSaSfcIcFPZ+bvrVx0zM6u3LtdlFxEXdmZFzMyscxQzHFUxhiRpDeAXwLpAz9L5iFizjvUyM7M6kFjQpKl1U82aokuAi0lBdQdgDHBVHetkZmZ1VOvUQbVSTUDqHRG3AkTEkxFxPCn7t5mZdUHKU7+reXWmaqZ9z1Gq1ZOSvgO8SBVpxM3MrJgK2mNXVUA6AlgC+D5pLGkp4IB6VsrMzOpDLPDGe3VTTXLVifntW3y8SZ+ZmXVFDRgbqlZbC2OvJ++B1JqI2LUuNTIzs7rqcuuQgHM6rRZNZIN1VubOif6jtdYdfPUDja6CNYGibtnQ1sLY8Z1ZETMzqz/RNVtIZma2ECpoKjsHJDOzZtPlA5KkxSJiTj0rY2Zm9ZUyMBQzIlWzY+zGkh4CpuXj9SX9ru41MzOzuijqjrHVTLY4G9gZeAUgIh7AqYPMzLqsrpzLrltEPNvi3Lx6VMbMzOpLpGzf1b6qLlfqLul+STfm436Sxkmalr/2rVRGNQHpeUkbA5EfeDjweNW1NDOzQunWjlc7/ACYWnY8EhgfEYOB8fm4Yr0qOQQ4ElgZmAFsks+ZmVkXVOsuO0krAjsBF5SdHgaMzu9HA8MrlVNNLruZwN7VVcvMzIpM7eyKA/pLmlR2PCoiRrW450zgWKBP2bkBETEdICKmS6q4S0Q1O8aeTys57SLi4EqfNTOz4mnnZIVZETF0/mVpZ2BmREyWtNWC1KuadUh/L3vfE/gq8PyCPNTMzBqnxtO5NwN2kbQjKUYsKelyYIakgbl1NBCYWamgarrsri4/lnQZMK5j9TYzs0YqzbKrlYg4DjgOILeQjo6I/SSdDowATs1fb6hUVkdSB60GrNKBz5mZWQF00vqiU4Exkg4EngP2qPSBasaQXuPjMaRuwKtUMX3PzMwKqI4ZGCJiAjAhv38F2Lo9n28zICklPFofeDGf+jAi5rtpn5mZFZ/ogrnscvC5PiLm5ZeDkZlZF5bGkLpuLrt7JG1Y95qYmVmnKGpAmm+XnaQeETEX2Bw4SNKTwDukABsR4SBlZtYFFXX7ibbGkO4BNqSKdA9mZtY1lLrsiqitgCSAiHiyk+piZmb11oBtJarVVkBaVtKR87sYEWfUoT5mZlZntVwYW0ttBaTuwBJQ0PmBZmbWbl21y256RJzcaTUxM7NOUdAGUuUxJDMzW5iIbgX98d5WQGpXygczMys+Cbq3cyvYzjLfgBQRr3ZmRczMrHN0xUkNZma2kBFdcwzJzMwWQm4hmZlZIRQ0HjkgmZk1E1FdVu1GcEAyM2sm6prJVc3MbCFUzHDkgGRm1lRS6qBihqSidiWamVmdqB2vimVJPSXdI+kBSY9IOimf7ydpnKRp+WvfSmU5IJmZNRmp+lcV5gBfioj1gSHA9pI2AUYC4yNiMDA+H7fJAcnMrKkIqfpXJZG8nQ8Xya8AhgGj8/nRVLHZqwOSmVkTKU37rvYF9Jc0qex18H+VKXWXNAWYCYyLiInAgIiYDpC/Llepbp7UYGbWZNo57XtWRAxt64aImAcMkbQ0cL2k9TpSL7eQzMyaTC0nNZSLiNeBCcD2wAxJAwHy15mVPu+AZGbWTPLC2FqNIUlaNreMkNQL2AZ4FBgLjMi3jQBuqFSWu+zMzJpIHVIHDQRGS+qeix4TETdKugsYI+lA4Dlgj0oFOSCZmTWZWqYOiogHgQ1aOf8K7dzo1QHJzKzJFDNPgwOSmVnTKWjmIAckM7NmksaQihmRHJDMzJqMW0hmZlYAQm4hmZlZEbiFZGZmDecxJDMzK4bqt5XodA5IZmZNxgHJzMwKwZMazMys4QR0K2Y8ckAyM2s2biGZmVkheAzJzMwKwS0kMzNrOI8hmZlZQTh1kJmZFYEXxpp90m233sLRR/6AefPmsf8B3+KYY0c2ukpWABKcvP2avDb7A86Y8DSHbb4Ky/dZDIDei3bn3ffn8ZObH29wLbs2Ad0LGpEckKzTzZs3j8O/fxg33TyOQSuuyOabfI6dd96FddZdt9FVswb78lr9eenN9+i1SHcAzr3j2Y+u7bPhQN59/8NGVW2hUsxwBN0aXQFrPvfecw9rrPEpVlt9dRZddFH22GtvbvzrDY2uljVY316LsP6gJZnwxKutXt945aW5+9nXOrlWCym149WJHJCs07300ousuOJKHx0PGrQiL774YgNrZEWw79AVuPr+6UTEf11ba7nFefO9ucx46/0G1Gzho3b8V7EsaSVJ/5Q0VdIjkn6Qz/eTNE7StPy1b6Wy6haQJIWky8qOe0h6WdKNFT63VekeSbtI6rTBBUlDJO3Y4txwSSe0OLd7/v6G5uNlJd3SWfXs6lr7gaOC9mlb5xgyqA9vvTeXZ16d3er1TVZZmrueeb2Ta7Xwkqp/VWEucFRErANsAhwmaV1gJDA+IgYD4/Nxm+rZQnoHWE9Sr3y8LdCuX4MjYmxEnFrzms3fEGDHFueOBc4rHUjqA3wfmFg6FxEvA9MlbdYZlezqBg1akRdeeP6j4xdffIEVVlihgTWyRhu87OJssOKS/GbYOhy6+SqsM2AJvr3pykBaMzN0paWY+KwDUq3UsscuIqZHxH35/VvAVGAQMAwYnW8bDQyvVFa9u+xuBnbK7/cBrixdkLSxpP+VdH/+ulbLD0vaX9I5+f0aku6WdK+kkyW9nc9vJWmCpGslPSrpT8q/bks6Id//sKRRZecnSPqVpHskPS5pC0mLAicDe0maImkvSWsCcyJiVlm1fgacBrzXorp/AfatwZ/ZQm/o5z7HE09M45mnn+b999/nmquvYqedd2l0tayBrpnyHw6/fipH3TCV8+54lqkz3uaP//scAJ9evg/T35zDa7M/aHAtFyLti0j9JU0qex0832KlVYENSL+wD4iI6ZCCFrBcpWrVe5bdVcAJuQvus8BFwBb52qPAlhExV9I2wC+B3doo6yzgrIi4UtJ3WlzbAPg08BJwJ7AZcAdwTkScDJC7D3cG/po/0yMiNs5ddD+NiG1y19zQiPhu/sw3gftKD5G0AbBSRNwo6egWdZgE/Ly1iue/wNJf4tu9FtFjbXyfzWKpddZcfSWgOzBjoyHr/afRFbJi2Gmnnfp84aijBly235eeAPpfe+21S1z0m4nvXHb66S83um4FsMqCFpDiTLu6yGdFxNCK5UpLAH8GDo+INzvSDV/XgBQRD+aIuQ/wtxaXlwJGSxoMBLBIheK+wMdNviuAX5dduyciXgCQNAVYlRSQvijpWKA30A94hI8D0nX56+R8f2sGAi/ncrsBvwX2n8+9M4FW+50iYhQwan7fWDOTNKmaf+zWfCICSZN22223VXfbbTdOO+20Rldp4VCHhbGSFiEFoz9FROln6wxJAyNiuqSBpJ+RbeqMWXZjScHjyhbnfwb8MyLWA74C9FyAZ8wpez8P6CGpJ2nsZ/eI+AxwfotnzCm/fz7lzi77TB9gPWCCpGdIg3djSxMb8n2tj8iamRVILceQ8lDIhcDUiDij7NJYYER+PwKouLajMwLSRcDJEfFQi/NL8fEkh/2rKOduPu7S27uK+0uBZFZuSu5exWfeIgWekqnApwAi4o2I6B8Rq0bEqrk+u0TEpHzvmsDDVTzDzKyxarsOaTPg68CX8vj7lDwUciqwraRppEltFSeo1T1TQ+5KO6uVS6eRuuyOBP5RRVGHA5dLOgq4CXijwnNfl3Q+8BDwDHBvFc/4JzAyd/udQure+40kRWtzlT/pi7le1j7uyrS2+N9HzdU2uWpE3MH8Q9fW7SlLlX/OFoOk3sDsiAhJewP7RMSwTnjuWcBfI+LvFe77NzAsIryU3MwKa93PbhhX3Pivqu/fYJUlJ3fWOG9XymW3EXBO7q98HTigk577S+Dzbd0gaVngDAcjMyu6BmQEqlqXCUgRcTuwfgOeO4M0ONfWPS+T1iGZmRVfQSNSlwlIZuWqHNczs1Z4gz6zBSRpGVKGjHkR8Z6kbhHh/QjM2qmoqSOd7du6kh8CPyHNtlzJwcgqkbScpF9KWl7SUo2uT1EUdPcJByTrUn4EnADcD/xJ0m651WQ2P28CiwJHAr+UtHGD69N47YlGnRyR3GVnhSZpNdJklg8iorTO6xeSniAtlF4EuMpjSlYut4beioj3gKNzirItgTGSvlVpGcfCrqhjSG4hWWFJWpuUA3FT4Py8iBqAiLialI/wIElr5vVpxfy/zDpVXoYxDfiGpCUBImJaRFxI6va9VNIXGlnHRhI13w+pZhyQrJAk9QMuJq3vOhbYHviu0iaKAoiIa4FbgPMkLe4WkmWLkCa/7ArsIGnx0oX8i8zxpH9Lyzeofg1X0B47d9lZYb0OnAFcm2fTPSjpdqB7eeCJiNNz98wg4PEG1dUKJCJeytvNvAwcBryd04EppzK7mZThvw/QnNueFLQvwS0kKxRJ/SWV8pfdEklpNt1c8n4wklaRtFRuLT1H2l7EmpSkZSX1ze9F2nLmXuDbpJmZjwCfg482i5sHfLMxtW08teO/zuSAZIWSd+d9F/hM3g4ZSd3z5V7AB5I2JCWyXT63li7AmdabVt6rbHdgbYD8b+JmUgb+R4EBpL145krqle85Cbgx7+PTdDyGZFaBkm7Aa8COrdwyCdgDOBv4cUQ8lmfXfRgRb3dmXa04cgt6GeBrZaffIu3S/H/Ar0i5L4/N95XcHRFNuS+6x5DMKsi/2Yaki4B/SpodEWdGxLx8S3dgP2D7iLjNU72bW4u//9J2NgdExEURcZek+4CnIuIP+f7dc25K4KNA1pwKOobkgGQNV/rBIqk/0C0inpe0J3CRpA8j4ux8683AvyNiooNRc8s7Qg8B7pa0LrAYMAbYQtKXI+LWiDis7P5uVLGFdjNILZ9iRiQHJGu4HIx2AY4D+kg6ISKuk3QgcE3e8feKiHgYPvrh4mDU3JYFNspr0z5D2iDzRdI40naS+kXElaWbm7o11FIDxoaq5TEkazhJnwa+CxwE/Bg4UdLeETEZ+B9gIHCYpJ9J6p7HjByQmlhEPE/6+bUraSzoPxExE7gCmALsIulcSSuXJjLYxzyGZNYKSSuQ8ozNyy2ghyXNA34mqWdEXJK3rYe0SeNipFl41oRadNVeBLwKrCvpZ8BvI+JZSTcDfwZ+AewMPC5pvH+JKVPQFpIDkjWMpFXyD5AJwJ6SvgGMiYgbJfUATpF0W0S8lD9yV8Mqa4WQu3e3BzYGXoqICyR9njTZ5dA8kWFb4JiIOCIvGfB44yd0/vqiarnLzjpVKe1PTnZ5kaQfRMRlwDWkhYu755bRX4Aty4KRNbGyfzcbAGeRUgN9VdJlETERGE1aHAHlEWcAAAuZSURBVH0O8I+ImAsQEfNK7+1jtVyHJOkiSTMlPVx2rp+kcZKm5a99q6mXA5J1qrIJDKeR0gPtKumoiLgUmAhsBeyVfwC90riaWpHkfzcbA98CToqI00iLYftJujQiJkXEkcAWEfFXJ9qdvzrsPnEJKddkuZHA+IgYDIzPxxU5IFndSVpCUu/8fmnyxAVgH9L+Rp+XdFhEXA7cCdzXImWQGcAKpC0kPiupd0TMJm1BspKkG/I9L8FHa9psfmoYkSLi36SxvHLDSK1W8tfh1VTLY0hWVzkAHQ6cI2k28H6+9HZEvJ/7/B8E9pf0Xt4iwKx8fdqKwPSI+IukN4CfAjtKuikiZkvaAVgPHIiq1c4xpP6SJpUdj4qIUfO9OxmQcwYSEdMlLVfNgxyQrK4i4vWcLLUn8NW8vmgs8BtJ342IFyQ9APQFNpf0j4h4uqGVtkLIwegrwNHA1Jyx+wLg56Q1a4tJui63lCa1UZS10K19HZqzImJonaryCe6ys7rJC1jJExN2AfaTNBy4CrgbGJ+ndJ8J3EBKntqnQdW1gpG0GXASqWu3B2md2k+AfwO/AQ4BlmpYBbuqdkxoWICRuBmSBgLkr1VlyXBAsrooJT2VNAAgIs4j7fD6VdKW5GeSxpLeIPUvzwEG89990dZkSr/IkLYa+Rbp38v6pCD0BeBnwARgWEQ0535GC6zuS2PHAiPy+xGkXzgrcped1UXubtkR+JWku4FbI+LyPPlpF9K/vbER8Z7SdtKnAQfkDdSsCZUteu0JvBsRV+T1aH8Evh4Rj+Y1SAOBQRExrZH17apEbVMHSbqSNDu2v6QXSGN8pwJjcvqv50hZ+ityQLK6kDQU2IuUhWFtUtLLvhFxvtIeNMOBf5HWk8wE9vKao+ZWtuj1UKXdgcfmLUb6AyMl/Y7UajrcwWjB1HJOfETsM59LW7e3LHfZWc3lHyCXAD0iYhwwijRm9GlJh0bExcDRpa0AIuJJByPL64yOAa4HhpJmXn6atJfR0sDpwJkRcX/jarlw8AZ91jQi7fp6Minr8h4RMYeUieF+YD1JKzkAWTlJqwC/BW7Kv7AcQ9r/6uvAyhExHNgtIq73otcF5y3MbaFVltZlC0lHStqGtDp7BPATSbvl9C1/An6eMzVbk2sRWF4m7e56oKTBEfEcKUXQ4qTZmUtGxGvgtUY1UdB03w5ItsDK+v5HAW8C5wH7RcTfSDPpTpe0Z0TMdcvI4BOLXjeVNBH4APg2aSbmKTkovUjafvz8iHizkfVd2BQ0Hjkg2YKTtBQpzf9XgIdI20OMyZdvIk1smN6Y2lnRSOqWg9EXgW2A1UgTXHqQFr0+BJwtac2IeCEiHm1gdRc67Rk/8hiSFZ6kNSTtKmkYQES8QZra+WvgbGCXnC5kOLBZRPwlIm53339zU9p2nLw+7TOkiS+3kbaSeBK4F/iQNHlhMrBEY2q68PMYki0UJK1JWuS2GfBDSd/Jl54ElgdOj4jn8rTvX5EGpgH3/TczSf2AoyQtmU+9B9wWEXdHxDMR8XXgbeAfwPsRcXxE3Neo+i70Ctpn54BkVZO0LnA1cFxEHEUaK5KktSLiz8DNpD1qbgIuJG2SNqFhFbZCyItbZ5O2F++TUwK9SlqbtmPZraOARYEryrI1WB0UNB55Yay1Sz9g/Yj4az4+FngROETS7RFxWE4VtAbwSl7U6N06m1huGf0WODUipkoaCXwG+BFpEsP1kn5EClhfJyVN/SqpZe3tR+qkqJ3n/i3EqhYRdwA7SXpK0t+BayNiB9Iixm0ljYyIGRHxvxHxWP6Mg1FzW4Q0vniypFVJraAppCSpTwFfJmXy2BY4gtRCGgr0bkBdm0R7RpA8hmQFFhE3k7Iub0WaEUVEvE8aL/qgcTWzIsrZOM4jBaEzgCVJQekJ4HjSeNHhpNZRP+B3wEF5oozVQSmXnWfZ2UIhIsaTEqQ+DiDpU6SV9Q81sl5WHOUzKvNGbb/j46DUF/g9qbv3+5L6klpGc4EdIuLhzq+xFYHHkKxDIuJvkj6U9C7wNCnh5W2Nrpc1Xtmi1y+Tto2YA/yBNJ37WFJm9x+SMjEsU8rAQNq+3jqBx5BsoRMRt5AWwx6f35uVMnfsDJwCTCVNUrgyXz6F1F13JjAnIp5qTC2bW1HHkNxCsgWSu+/wbLrmJmllYKWIuFPS0qT9b/YCPkuaMfc+8BdgGGkX2JUi4r1G1bepNWBsqFoOSFYTDkbNKY8V9QEmAm9I+l5EjJN0HGnLiB+T0kop3/M3YOuIeKJRdW52jVhfVC132ZlZh0XyJikN0PPAEZJ2zUl0A7gnv1+NtFj6OP/yUgAFXRnrFpKZdYikRSKiNNV/AqlFdDNpYz2AccBgSb8n7RC8b0RMbERd7ZM6e2yoWm4hmVm7SVobuFDSVvnUbcBSwCbApcCBpIwMu+bj4RHxjwZU1VpR1HVIbiGZWUcsB+xH2pb+D6Q0P8cB+5DGinoBvyRtOf6XhtXSWlXrOJP3QzuLNIHlgog4tSPlOCCZWbtFxL8lbQncCrwEbApcBQwi7RY8hvRz74WGVdLmr4YRSVJ34FxS+qcXgHsljY2I/2tvWQ5IZtYhEXGHpF1Ja4o+S9qWZAdgqYiYJ2lM3rreCqbGY0gbA0+U1pRJuoo0vd8Bycw6T0TcKulo4EFgk4i4R9Ii+ZqDUQHdf9/kW3svqv7t+EhPSZPKjkdFxKiy40GkGZYlLwCf70jdHJDMbIFExE2S5gGPS1q7LBWQFVBEbF/jIltrbnVoar9n2ZnZAsupow4g5a6z5vICsFLZ8YqkccV2k9eomVktOY1Uc8k7Aj8ObE3K4H4v8LWIeKS9ZbnLzsxqysGouUTEXEnfJc247A5c1JFgBG4hmZlZQXgMyczMCsEByczMCsEByZqWpHmSpkh6WNI1knovQFlbSboxv99F0sg27l1a0qEdeMaJec1PVedb3HOJpN3b8axVJXkrcetUDkjWzGZHxJCIWI+0gdx3yi8qaff/IxExtkIur6WBdgcks4WdA5JZcjvwqdwymCrpPOA+YCVJ20m6S9J9uSW1BKSEkpIelXQHKas1+fz+ks7J7wdIul7SA/m1KXAqsEZunZ2e7ztG0r2SHpR0UllZP5b0mKS/A2tV+iYkHZTLeUDSn1u0+raRdLukx/MW40jqLun0smd/e0H/IM06ygHJml5eR7ED8FA+tRZwaURsALwDHA9sExEbApOAIyX1BM4HvgJsASw/n+LPBv4VEesDGwKPACOBJ3Pr7BhJ2wGDSTnBhgAbSdpS0kbA3sAGpID3uSq+nesi4nP5eVNJ20CUrAr8D7AT8If8PRwIvBERn8vlHyRptSqeY1ZzXodkzayXpCn5/e2kHU1XAJ6NiLvz+U2AdYE786ZziwJ3AWsDT0fENABJlwMHt/KMLwHfAIiIeaRtvvu2uGe7/Lo/Hy9BClB9gOsj4t38jLFVfE/rSfo5qVtwCdLakJIxEfEhME3SU/l72A74bNn40lL52Y9X8SyzmnJAsmY2OyKGlJ/IQeed8lPAuIjYp8V9Q+hgvq5WCDglIv7Y4hmHd+AZl5A2w3tA0v7AVmXXWpYV+dnfi4jywIWkVdv5XLMF5i47s7bdDWwm6VMAknpLWhN4FFhN0hr5vn3m8/nxwCH5s90lLQm8RWr9lNwKHFA2NjVI0nLAv4GvSuolqQ+pe7CSPsD0nHF73xbX9pDULdd5deCx/OxDShm6Ja0pafEqnmNWc24hmbUhIl7OLY0rJS2WTx8fEY9LOhi4SdIs4A5gvVaK+AEwStKBwDzgkIi4S9KdeVr1zXkcaR3grtxCexvYLyLuk3Q1MAV4ltStWMlPSDu2PksaEysPfI8B/wIGAN+JiPckXUAaW7pP6eEvA8Or+9Mxqy2nDjIzs0Jwl52ZmRWCA5KZmRWCA5KZmRWCA5KZmRWCA5KZmRWCA5KZmRWCA5KZmRXC/wOHNZTZf9quPwAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 2 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "# write your code here\n",
    "clf2=svm.SVC(kernel='linear',C=0.001)\n",
    "clf2.fit(X_train,y_train)\n",
    "yhat2=clf2.predict(X_test)\n",
    "print(f1_score(y_test,yhat2,average='weighted'))\n",
    "print(jaccard_similarity_score(y_test,yhat2))\n",
    "cnf_matrix = confusion_matrix(y_test, yhat2, labels=[2,4])\n",
    "np.set_printoptions(precision=2)\n",
    "\n",
    "print (classification_report(y_test, yhat2))\n",
    "\n",
    "# Plot non-normalized confusion matrix\n",
    "plt.figure()\n",
    "plot_confusion_matrix(cnf_matrix, classes=['Benign(2)','Malignant(4)'],normalize= False,  title='Confusion matrix')\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Double-click __here__ for the solution.\n",
    "\n",
    "<!-- Your answer is below:\n",
    "    \n",
    "clf2 = svm.SVC(kernel='linear')\n",
    "clf2.fit(X_train, y_train) \n",
    "yhat2 = clf2.predict(X_test)\n",
    "print(\"Avg F1-score: %.4f\" % f1_score(y_test, yhat2, average='weighted'))\n",
    "print(\"Jaccard score: %.4f\" % jaccard_similarity_score(y_test, yhat2))\n",
    "\n",
    "-->"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "## Want to learn more?\n",
    "\n",
    "IBM SPSS Modeler is a comprehensive analytics platform that has many machine learning algorithms. It has been designed to bring predictive intelligence to decisions made by individuals, by groups, by systems – by your enterprise as a whole. A free trial is available through this course, available here: [SPSS Modeler](http://cocl.us/ML0101EN-SPSSModeler).\n",
    "\n",
    "Also, you can use Watson Studio to run these notebooks faster with bigger datasets. Watson Studio is IBM's leading cloud solution for data scientists, built by data scientists. With Jupyter notebooks, RStudio, Apache Spark and popular libraries pre-packaged in the cloud, Watson Studio enables data scientists to collaborate on their projects without having to install anything. Join the fast-growing community of Watson Studio users today with a free account at [Watson Studio](https://cocl.us/ML0101EN_DSX)\n",
    "\n",
    "### Thanks for completing this lesson!\n",
    "\n",
    "Notebook created by: <a href = \"https://ca.linkedin.com/in/saeedaghabozorgi\">Saeed Aghabozorgi</a>\n",
    "\n",
    "<hr>\n",
    "Copyright &copy; 2018 [Cognitive Class](https://cocl.us/DX0108EN_CC). This notebook and its source code are released under the terms of the [MIT License](https://bigdatauniversity.com/mit-license/).​"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python",
   "language": "python",
   "name": "conda-env-python-py"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.7"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}