Pr_033_HackathonSubmission.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# State of San Diego Infrastructure\n",
    "##### COGS 108 Final Project by : Anaelle Kim, Grant Sheagley, Dylan Christiano, Shawn Le"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# Imports: Tools we will need to use for cleaning and analysis of question\n",
    "import numpy as np \n",
    "import pandas as pd \n",
    "import matplotlib.pyplot as plt \n",
    "import re \n",
    "import difflib \n",
    "\n",
    "from scipy.stats import chi2_contingency"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Background\n",
    "\n",
    "The background of our research question originates from each members' inherent interest in the prevalence of Motor Vehicle Accidents (MVA) within the United States as a whole. Considering the fact that MVAs have the potential of damaging not just infrastructure, but also the lives of those involved in said MVAs, it was hard for each of us within this research group to not question why this might occur in the first place. As soon as we identified the fact that this is the research question we would be investigating for our data science project, we immediately started looking for any public information regarding MVAs, but more specifically, MVAs within the city of San Diego. After some deep research, we were able to find said data, and from these sources, we started to build up on our ideas regarding how we would analyze and integrate the data into a presentable form."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Research Question\n",
    "\n",
    "Our research question concerns the following: Are there implicit determinants of MVAs in the city of San Diego? In our project, we look into data regarding weather, infrastructural integrity, and the overall lighting (bright, dark, etc.) in the areas relative to the location of each MVA. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Significance\n",
    "\n",
    "Our research inherently deals with accidents that directly affect people in a way that is potentially harmful, not just to the infrastrucutre in San Diego, but also to the livelihood of the individuals involved in the accidents themselves. Any time there is a MVA, there is a chance that there is physical harm done, and that said physical harm may haven been partly due to the conditions surrounding the accident itself, such as potholes, poor lighting, etc. The importance we, as a group, see in this project is oriented around the possibility that doing data analysis and showing statistics on MVAs and their corresponding conditions could potentially reveal ways in which the San Diego can better prevent these accidents from occurring. For example, if we happen find a correlation between poor lighting and higher occurences of MVAs, then it may provide the initiative to investigate these areas and even potentially replace said lighting. Or if we happen to find an area of San Diego that has a high rate of MVAs while under the influence, then this could also be used to better gauge where there needs to be patrolling done to identify and prevent these forms of MVAs."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Hypothesis\n",
    "\n",
    "Our prediction as a group is that there will be a strong correlation between poor street conditions and MVAs (i.e. the more worse the street condition, the more MVA's there will be). We came to form this hypothesis as a byproduct of the inherent assumption that accidents are more probable in areas where the conditions at hand are less than optimal in creating an environment that ensures easier transportation. In other words, our hypothesis was formed simply because it seemed more logical to assume that poor conditions are more likely to hold accidents than conditions that do not have such poor conditions. These conditions will be defined by Overall Condition Index (OCI): \n",
    "\n",
    "\"Good\" street conditions are defined as follows: A street in this category has little or no cracking, minor potholes, or other distresses. It has excellent drivability and needs little maintenance or remedial repair. A street in good condition has an OCI rating between 70 and 100. \n",
    "\n",
    "\"Fair\" street conditions are defined as follows: A street in this category has moderate cracking, some minor potholes and has adequate drivability. It is typically in need of remedial repairs and a slurry seal. A street in fair condition has an OCI rating between 40 and 69. \n",
    "\n",
    "\"Poor\" conditions are defined as follows: A street in this category has severe cracking, numerous areas of failed pavement with possible sub base failure, and exhibits a rough ride. It qualifies for a comprehensive repair or a total reconstruction – meaning that a street may be replaced from the ground up if conditions warrant that effort. A street in poor condition has an OCI rating between 0 and 39. \n",
    "\n",
    "However, there is also the possibility that MVAs within San Diego have implications regarding a variety of different characteristics of the city itself. There may also be additional problems besides infrastructure, such as the nature of obtaining drivers licenses, or maybe even the physical or mental state in which drivers are operating the vehicles themselves."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Potential Solutions\n",
    "\n",
    "There are many potential answers to the variety of different problems inherent within our research question. If our project renders our hypothesis valid, than a possible solution would be to have the city of San Diego distribute more money to improving the conditions of road infrastructure. If our hypothesis ends up lacking support, then are possible solutions could be highly variable. For example, if there ends up being a correlation between weather and MVAs, then a possible solution may orient around the city of San Diego promoting driving and safety techniques to cope with said weather. If there is a correlation between lighting and MVAs, then a possible solution may deal with funds towards things like better street lights, or less prevalence of fluorescent lighting if brightness ends up being correlated to MVAs. These potential solutions will be explored further towards the end of the study once there has been actual data analysis. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Potential Confounds\n",
    "\n",
    "There are a variety of potential confounds in regards to our data project. When it comes to determining why accidents occur within San Diego, or even as a whole, we as a group could potentially be dealing with a lot more than just variables regarding weather, OCI, and lighting. In fact, we could be dealing with the mentality inherent in American culture. For example, a variable that could affect the level of car crashes in San Diego could be oriented around the fact that Americans are inherently more attracted to the idea of owning and operating their own vehicles, in comparison to European culture, which is more heavily reliant on public transportation. Another potential, and similar, confound could deal with the actual skill of those driving. There is not necessarily any data quantifying the level of driving skill in each of these MVAs, but that is something that could be a direct cause of many MVAs in contrast to variables such as lighting, weather, and OCI. Regardless, the variables mentioned above would be extremely hard to do actual data analysis on, considering the fact that there really is not any kind of relevant data oriented around these two topics, despite the fact that they could be potentially influencing our research question."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Research after Hypothesis:\n",
    "\n",
    "If our hypothesis, which is that there will be a strong correlation between poor street conditions and MVAs, ends up being incorrect, then we as a group will investigate further into the nature of the incidents themselves. Rather than look into the infrastructure as a possible influence in MVAs in San Diego, such as the lighting and the weather. If these additional variables prove to be insignificant in regards to MVAs, we will end up investigating other factors in which these MVAs occurred, such as whether or not those involved in the MVAs were in any way under the infleunce while operating their respective vehicles."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Methods and Sources\n",
    "\n",
    "In regards to where we received our data, there were two individual sources that we used. For our MVA, lighting, and weather data, we used the California Highway Patrol Homepage, linked here: http://iswitrs.chp.ca.gov/Reports/jsp/RawData.jsp\n",
    "\n",
    "As for our OCI data, we used the Streets Overall Condition Index page on sandiego.gov, as linked here: https://data.sandiego.gov/datasets/streets-overall-condition-index/\n",
    "\n",
    "The methods by which we conducted our cleaning and analysis will be detailed in the study below. However, as a brief summarization, this is what was done in regards to the cleaning process of our datasets:\n",
    "1. The main dataset that needed cleaning was our main MVA set, which required us to remove highways, state roads, and interstates that were not represented by the OCI dataset. In addition to this, we also cleared any data involving drugs or alcohol, simply because it would interfere with our analysis of infrastructural influence of MVAs. \n",
    "\n",
    "Here is a brief summarization of what was done in regards to data analytics:\n",
    "1. Each OCI value was given a particular color code, and was then graphed into a barh plot relative to the number of MVAs corresponding to 'Poor,' 'Fair,' and 'Good,' OCI values. It is our intention to measure the signficance of this visualization using a ttest or chi-square, however, we are still in the process of making that happen. Despite this, we were able to employ chi-square statistics in regards to statistical significance between OCI, weather, and lighting, and MVAs, weather and lighting. After an additional barh plot was displayed to show the prevalence of MVAs relative to weather and lighting conditions. A chi-square statistic was then found for each of these variables (OCI, weather and lighting, and MVAs, weather, and lighting). Following this statistical analysis and data visualization, one last graph, a bar graph, was displayed to show the prevalence of of accidents and their corresponding causes (i.e. unsafe speeding, wrong side of the wrong, etc.) More info on what will be done from during this week before presentation and project submission will be detailed in the discussion at the very end of the project. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Section 1: Loading and Cleaning the Data process"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The main variable that we will judge whether or not a street is safe or not, is the OCI. From streets.sandiego.gov, \n",
    "\n",
    "The 100-point OCI rating system the City [San Diego] uses classifies streets into one of three categories:\n",
    "Good - A street in this category has little or no cracking, minor potholes, or other distresses. It has excellent drivability and needs little maintenance or remedial repair. A street in good condition has an OCI rating between: 70 and 100.\n",
    "\n",
    "Fair - A street in this category has moderate cracking, some minor potholes and has adequate drivability. It is typically in need of remedial repairs and a slurry seal. A street in fair condition has an OCI rating between:\n",
    "40 and 69.\n",
    "\n",
    "Poor - A street in this category has severe cracking, numerous areas of failed pavement with possible sub base failure, and exhibits a rough ride. It qualifies for a comprehensive repair or a total reconstruction – meaning that a street may be replaced from the ground up if conditions warrant that effort. A street in poor condition has an OCI rating between:\n",
    "0 and 39.\n",
    "\n",
    "In essence, we will be using this index to first investigate our hypothesis and find a possible correlation between street conditions [OCI] and motor vehicle accidents [Frequency]. Once we have evidence for or against our hypothesis, we can then move onto exploring other factors that contribute to MVAs.\n",
    "\n",
    "We accomplish this by drawing OCI data and MVA collision data over a period of 5 years from the city of San Diego via their official website and combining them into a single dataframe to analyze. \n",
    "\n",
    "We can create this single dataframe by matching an OCI with the street in which an accident occured:"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Step A.\n",
    "Creating the data frame by loading the collision data csv"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "10075\n"
     ]
    }
   ],
   "source": [
    "col_name = [\"COLLISION_DATE\",\"COLLISION_TIME\",\"PRIMARY_RD\",\"SECONDARY_RD\",\"CHP_BEAT_TYPE\",\"WEATHER_1\",\"COLLISION_SEVERITY\",\"PRIMARY_COLL_FACTOR\",\"PCF_VIOL_CATEGORY\",\"LIGHTING\",\"ROAD_SURFACE\",\"ROAD_COND_1\"]\n",
    "MVA_DF = pd.DataFrame(data=None, index=None, columns=col_name, dtype=None) #New empty dataframe\n",
    "size = 0\n",
    "for i in range (1):\n",
    "    year = 2015 #File name\n",
    "    DF = pd.read_csv('CollisionRecords_%i.csv' % year,sep = '\\t', dtype='unicode') #Read the csv file\n",
    "    DF = DF[col_name]\n",
    "    size += len(DF) #Check size matches \n",
    "    MVA_DF = MVA_DF.append(DF)#Add DF to our initialized dataframe\n",
    "\n",
    "print(size) # Checking Size"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Step B.\n",
    "Creating the data frame by loading oci data csv"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": false,
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>oci</th>\n",
       "      <th>street</th>\n",
       "      <th>street_from</th>\n",
       "      <th>street_to</th>\n",
       "      <th>oci_desc</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>49.23</td>\n",
       "      <td>TEBO CT</td>\n",
       "      <td>PICADOR BL</td>\n",
       "      <td>ROBB ROY PL</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>35.32</td>\n",
       "      <td>04TH AV</td>\n",
       "      <td>K ST</td>\n",
       "      <td>J ST</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>78.48</td>\n",
       "      <td>MELBOURNE DR</td>\n",
       "      <td>SHAWN AV</td>\n",
       "      <td>IRVINGTON AV</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>34.29</td>\n",
       "      <td>BAYARD ST</td>\n",
       "      <td>REED AV</td>\n",
       "      <td>THOMAS AV</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>28.28</td>\n",
       "      <td>QUINCE DR</td>\n",
       "      <td>06TH AV</td>\n",
       "      <td>QUINCE ST</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>75.72</td>\n",
       "      <td>PRINCESS ST</td>\n",
       "      <td>SPINDRIFT DR</td>\n",
       "      <td>CITY BOUNDARY</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>83.43</td>\n",
       "      <td>CLAVELITA ST</td>\n",
       "      <td>ARLISS CT</td>\n",
       "      <td>DEL SUR BL</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>100</td>\n",
       "      <td>IRIS AV</td>\n",
       "      <td>ALBATA CT</td>\n",
       "      <td>ROCHDALE LN</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>51.55</td>\n",
       "      <td>ARLISS CT</td>\n",
       "      <td>CLAVELITA ST</td>\n",
       "      <td>END</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>45.26</td>\n",
       "      <td>K ST</td>\n",
       "      <td>19TH ST</td>\n",
       "      <td>20TH ST</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>28.94</td>\n",
       "      <td>K ST</td>\n",
       "      <td>22ND ST</td>\n",
       "      <td>24TH ST</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>78.95</td>\n",
       "      <td>MEADOWBROOK DR</td>\n",
       "      <td>GLOAMING AV</td>\n",
       "      <td>MEADOWBROOK CT</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>13.47</td>\n",
       "      <td>36TH ST</td>\n",
       "      <td>K ST</td>\n",
       "      <td>J ST</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>61.06</td>\n",
       "      <td>SAN VICENTE ST</td>\n",
       "      <td>SAN VICENTE WY</td>\n",
       "      <td>SAN VICENTE CT</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>39</td>\n",
       "      <td>MADRONE AV</td>\n",
       "      <td>RITCHEY ST</td>\n",
       "      <td>68TH ST</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>57</td>\n",
       "      <td>TICO CT</td>\n",
       "      <td>DARWIN WY</td>\n",
       "      <td>END</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>69.95</td>\n",
       "      <td>REDWOOD ST</td>\n",
       "      <td>60TH ST</td>\n",
       "      <td>END</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>47.29</td>\n",
       "      <td>19TH ST</td>\n",
       "      <td>E ST</td>\n",
       "      <td>BROADWAY</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>38.02</td>\n",
       "      <td>GUY ST</td>\n",
       "      <td>COUTS ST</td>\n",
       "      <td>WITHERBY ST</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>51</td>\n",
       "      <td>POBLADO RD</td>\n",
       "      <td>MOON SONG CT</td>\n",
       "      <td>SUN MAIDEN CT</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>74.31</td>\n",
       "      <td>W LEWIS ST</td>\n",
       "      <td>EAGLE ST</td>\n",
       "      <td>FALCON ST</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>100</td>\n",
       "      <td>STONEBRIDGE PY</td>\n",
       "      <td>MERRITAGE CT</td>\n",
       "      <td>DOWNING LN</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>83.4</td>\n",
       "      <td>ROSE GARDEN CT</td>\n",
       "      <td>STONEBRIDGE PY</td>\n",
       "      <td>HIDEAWAY LN</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>76.77</td>\n",
       "      <td>MERRITAGE CT</td>\n",
       "      <td>STONEBRIDGE PY</td>\n",
       "      <td>BELLA ROSA RD</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>69.8</td>\n",
       "      <td>AVALON VISTA CT</td>\n",
       "      <td>BEGIN</td>\n",
       "      <td>MARINER DR</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>75.59</td>\n",
       "      <td>TIMBERGATE CR</td>\n",
       "      <td>CHICARITA CREEK RD</td>\n",
       "      <td>END</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>81.13</td>\n",
       "      <td>HALF MILE DR</td>\n",
       "      <td>HIGH BLUFF DR</td>\n",
       "      <td>TIVERTON RD</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>55.12</td>\n",
       "      <td>DE MAYO RD</td>\n",
       "      <td>BEGIN</td>\n",
       "      <td>NOB AV</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>75.95</td>\n",
       "      <td>CICHLID WY</td>\n",
       "      <td>DARKWOOD RD</td>\n",
       "      <td>CRISSCROSS LN</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>47.4</td>\n",
       "      <td>SALINAS WY</td>\n",
       "      <td>TRIPOLI RD</td>\n",
       "      <td>PARMA LN</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28068</th>\n",
       "      <td>77.18</td>\n",
       "      <td>BEDFORD HILL</td>\n",
       "      <td>CONCORD RIDGE TR</td>\n",
       "      <td>VIA MONTENERO</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28069</th>\n",
       "      <td>100</td>\n",
       "      <td>CAM DEL SUR</td>\n",
       "      <td>BING CROSBY BL</td>\n",
       "      <td>CASEY GLEN</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28070</th>\n",
       "      <td>67.19</td>\n",
       "      <td>DEL MAR HEIGHTS RD</td>\n",
       "      <td>SEAGROVE ST</td>\n",
       "      <td>OLD CARMEL VALLEY RD</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28071</th>\n",
       "      <td>67.45</td>\n",
       "      <td>JUDICIAL DR</td>\n",
       "      <td>GOLDEN HAVEN DR</td>\n",
       "      <td>EXECUTIVE DR</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28072</th>\n",
       "      <td>56</td>\n",
       "      <td>DRUCKER LN</td>\n",
       "      <td>KERNS ST</td>\n",
       "      <td>CORRIDOR SECTION</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28073</th>\n",
       "      <td>47.54</td>\n",
       "      <td>ZASLAVSKY PL</td>\n",
       "      <td>NIGHTHAWK LN</td>\n",
       "      <td>LONE QUAIL RD</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28074</th>\n",
       "      <td>83.61</td>\n",
       "      <td>SIEMPRE VIVA CT</td>\n",
       "      <td>BRITANNIA PARK PL</td>\n",
       "      <td>END</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28075</th>\n",
       "      <td>81.44</td>\n",
       "      <td>LARKDALE AV</td>\n",
       "      <td>MACAWA AV</td>\n",
       "      <td>SEDERSTROM WY</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28076</th>\n",
       "      <td>87.84</td>\n",
       "      <td>LARKDALE AV</td>\n",
       "      <td>KRENZ ST</td>\n",
       "      <td>LARKDALE PL</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28077</th>\n",
       "      <td>100</td>\n",
       "      <td>CAM DEL SUR</td>\n",
       "      <td>FOUR GEE RD</td>\n",
       "      <td>ZASLAVSKY PL</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28078</th>\n",
       "      <td>54.69</td>\n",
       "      <td>SUTHERLAND ST</td>\n",
       "      <td>PACIFIC (FTG) HY</td>\n",
       "      <td>END</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28079</th>\n",
       "      <td>35.36</td>\n",
       "      <td>SANDROCK RD</td>\n",
       "      <td>GRAMERCY DR</td>\n",
       "      <td>HAMMOND DR</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28080</th>\n",
       "      <td>42.56</td>\n",
       "      <td>MACAWA AV</td>\n",
       "      <td>AFTON RD</td>\n",
       "      <td>MURRAY RIDGE RD</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28081</th>\n",
       "      <td>63.89</td>\n",
       "      <td>NEVA AV</td>\n",
       "      <td>LARKDALE AV</td>\n",
       "      <td>AFTON RD</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28082</th>\n",
       "      <td>84.34</td>\n",
       "      <td>PACIFIC HIGHLANDS PY</td>\n",
       "      <td>CARMEL VALLEY RD</td>\n",
       "      <td>MOONFLOWER MEADOWS TL</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28083</th>\n",
       "      <td>63.9</td>\n",
       "      <td>RANCHO DEL SOL WY</td>\n",
       "      <td>MORNING GLORY WY</td>\n",
       "      <td>RANCHO SANTA FE FARM RD</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28084</th>\n",
       "      <td>84.34</td>\n",
       "      <td>DECATUR RD</td>\n",
       "      <td>SOMERS LN</td>\n",
       "      <td>HORNET WY</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28085</th>\n",
       "      <td>82.9</td>\n",
       "      <td>FARRAGUT RD</td>\n",
       "      <td>BEGIN</td>\n",
       "      <td>CUSHING RD</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28086</th>\n",
       "      <td>77.94</td>\n",
       "      <td>SIMS RD</td>\n",
       "      <td>HISTORIC DECATUR RD</td>\n",
       "      <td>TRUXTUN RD</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28087</th>\n",
       "      <td>69</td>\n",
       "      <td>BRIARLAKE WOODS DR</td>\n",
       "      <td>HEATHER RUN CT</td>\n",
       "      <td>GABLEWOOD WY</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28088</th>\n",
       "      <td>31.46</td>\n",
       "      <td>LOGAN AV</td>\n",
       "      <td>S 43RD ST</td>\n",
       "      <td>DOMINION ST</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28089</th>\n",
       "      <td>76.89</td>\n",
       "      <td>S 43RD ST</td>\n",
       "      <td>LOGAN AV</td>\n",
       "      <td>NATIONAL AV</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28090</th>\n",
       "      <td>59.89</td>\n",
       "      <td>ARDATH RD</td>\n",
       "      <td>HIDDEN VALLEY RD</td>\n",
       "      <td>ARDATH CT</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28091</th>\n",
       "      <td>86.03</td>\n",
       "      <td>TOYON MESA CT</td>\n",
       "      <td>RANCHO TOYON PL</td>\n",
       "      <td>SILVER ACACIA PL</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28092</th>\n",
       "      <td>79.29</td>\n",
       "      <td>CALLE CRISTOBAL</td>\n",
       "      <td>CAM SANTA FE</td>\n",
       "      <td>CAM PROPICO</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28093</th>\n",
       "      <td>61.71</td>\n",
       "      <td>RANCHO SANTA FE FARM RD</td>\n",
       "      <td>CAMTO MENDIOLA</td>\n",
       "      <td>RANCHO DEL SOL WY</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28094</th>\n",
       "      <td>80.57</td>\n",
       "      <td>CHAUNCEY ST</td>\n",
       "      <td>CUSHING RD</td>\n",
       "      <td>HISTORIC DECATUR RD</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28095</th>\n",
       "      <td>100</td>\n",
       "      <td>OLD CREEK RD</td>\n",
       "      <td>CAROWIND LN</td>\n",
       "      <td>OLIVE KNOLL CT</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28096</th>\n",
       "      <td>79.33</td>\n",
       "      <td>GREEN VALLEY CT</td>\n",
       "      <td>BEGIN</td>\n",
       "      <td>OLD CREEK RD</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28097</th>\n",
       "      <td>79.02</td>\n",
       "      <td>VIA SANTA BRISA</td>\n",
       "      <td>WHISPERING RIDGE RD</td>\n",
       "      <td>END</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>28098 rows × 5 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "         oci                   street          street_from  \\\n",
       "0      49.23                  TEBO CT           PICADOR BL   \n",
       "1      35.32                  04TH AV                 K ST   \n",
       "2      78.48             MELBOURNE DR             SHAWN AV   \n",
       "3      34.29                BAYARD ST              REED AV   \n",
       "4      28.28                QUINCE DR              06TH AV   \n",
       "5      75.72              PRINCESS ST         SPINDRIFT DR   \n",
       "6      83.43             CLAVELITA ST            ARLISS CT   \n",
       "7        100                  IRIS AV            ALBATA CT   \n",
       "8      51.55                ARLISS CT         CLAVELITA ST   \n",
       "9      45.26                     K ST              19TH ST   \n",
       "10     28.94                     K ST              22ND ST   \n",
       "11     78.95           MEADOWBROOK DR          GLOAMING AV   \n",
       "12     13.47                  36TH ST                 K ST   \n",
       "13     61.06           SAN VICENTE ST       SAN VICENTE WY   \n",
       "14        39               MADRONE AV           RITCHEY ST   \n",
       "15        57                  TICO CT            DARWIN WY   \n",
       "16     69.95               REDWOOD ST              60TH ST   \n",
       "17     47.29                  19TH ST                 E ST   \n",
       "18     38.02                   GUY ST             COUTS ST   \n",
       "19        51               POBLADO RD         MOON SONG CT   \n",
       "20     74.31               W LEWIS ST             EAGLE ST   \n",
       "21       100           STONEBRIDGE PY         MERRITAGE CT   \n",
       "22      83.4           ROSE GARDEN CT       STONEBRIDGE PY   \n",
       "23     76.77             MERRITAGE CT       STONEBRIDGE PY   \n",
       "24      69.8          AVALON VISTA CT                BEGIN   \n",
       "25     75.59            TIMBERGATE CR   CHICARITA CREEK RD   \n",
       "26     81.13             HALF MILE DR        HIGH BLUFF DR   \n",
       "27     55.12               DE MAYO RD                BEGIN   \n",
       "28     75.95               CICHLID WY          DARKWOOD RD   \n",
       "29      47.4               SALINAS WY           TRIPOLI RD   \n",
       "...      ...                      ...                  ...   \n",
       "28068  77.18             BEDFORD HILL     CONCORD RIDGE TR   \n",
       "28069    100              CAM DEL SUR       BING CROSBY BL   \n",
       "28070  67.19       DEL MAR HEIGHTS RD          SEAGROVE ST   \n",
       "28071  67.45              JUDICIAL DR      GOLDEN HAVEN DR   \n",
       "28072     56               DRUCKER LN             KERNS ST   \n",
       "28073  47.54             ZASLAVSKY PL         NIGHTHAWK LN   \n",
       "28074  83.61          SIEMPRE VIVA CT    BRITANNIA PARK PL   \n",
       "28075  81.44              LARKDALE AV            MACAWA AV   \n",
       "28076  87.84              LARKDALE AV             KRENZ ST   \n",
       "28077    100              CAM DEL SUR          FOUR GEE RD   \n",
       "28078  54.69            SUTHERLAND ST     PACIFIC (FTG) HY   \n",
       "28079  35.36              SANDROCK RD          GRAMERCY DR   \n",
       "28080  42.56                MACAWA AV             AFTON RD   \n",
       "28081  63.89                  NEVA AV          LARKDALE AV   \n",
       "28082  84.34     PACIFIC HIGHLANDS PY     CARMEL VALLEY RD   \n",
       "28083   63.9        RANCHO DEL SOL WY     MORNING GLORY WY   \n",
       "28084  84.34               DECATUR RD            SOMERS LN   \n",
       "28085   82.9              FARRAGUT RD                BEGIN   \n",
       "28086  77.94                  SIMS RD  HISTORIC DECATUR RD   \n",
       "28087     69       BRIARLAKE WOODS DR       HEATHER RUN CT   \n",
       "28088  31.46                 LOGAN AV            S 43RD ST   \n",
       "28089  76.89                S 43RD ST             LOGAN AV   \n",
       "28090  59.89                ARDATH RD     HIDDEN VALLEY RD   \n",
       "28091  86.03            TOYON MESA CT      RANCHO TOYON PL   \n",
       "28092  79.29          CALLE CRISTOBAL         CAM SANTA FE   \n",
       "28093  61.71  RANCHO SANTA FE FARM RD       CAMTO MENDIOLA   \n",
       "28094  80.57              CHAUNCEY ST           CUSHING RD   \n",
       "28095    100             OLD CREEK RD          CAROWIND LN   \n",
       "28096  79.33          GREEN VALLEY CT                BEGIN   \n",
       "28097  79.02          VIA SANTA BRISA  WHISPERING RIDGE RD   \n",
       "\n",
       "                     street_to oci_desc  \n",
       "0                  ROBB ROY PL     Fair  \n",
       "1                         J ST     Poor  \n",
       "2                 IRVINGTON AV     Good  \n",
       "3                    THOMAS AV     Poor  \n",
       "4                    QUINCE ST     Poor  \n",
       "5                CITY BOUNDARY     Good  \n",
       "6                   DEL SUR BL     Good  \n",
       "7                  ROCHDALE LN     Good  \n",
       "8                          END     Fair  \n",
       "9                      20TH ST     Fair  \n",
       "10                     24TH ST     Poor  \n",
       "11              MEADOWBROOK CT     Good  \n",
       "12                        J ST     Poor  \n",
       "13              SAN VICENTE CT     Fair  \n",
       "14                     68TH ST     Poor  \n",
       "15                         END     Fair  \n",
       "16                         END     Fair  \n",
       "17                    BROADWAY     Fair  \n",
       "18                 WITHERBY ST     Poor  \n",
       "19               SUN MAIDEN CT     Fair  \n",
       "20                   FALCON ST     Good  \n",
       "21                  DOWNING LN     Good  \n",
       "22                 HIDEAWAY LN     Good  \n",
       "23               BELLA ROSA RD     Good  \n",
       "24                  MARINER DR     Fair  \n",
       "25                         END     Good  \n",
       "26                 TIVERTON RD     Good  \n",
       "27                      NOB AV     Fair  \n",
       "28               CRISSCROSS LN     Good  \n",
       "29                    PARMA LN     Fair  \n",
       "...                        ...      ...  \n",
       "28068            VIA MONTENERO     Good  \n",
       "28069               CASEY GLEN     Good  \n",
       "28070     OLD CARMEL VALLEY RD     Fair  \n",
       "28071             EXECUTIVE DR     Fair  \n",
       "28072         CORRIDOR SECTION     Fair  \n",
       "28073            LONE QUAIL RD     Fair  \n",
       "28074                      END     Good  \n",
       "28075            SEDERSTROM WY     Good  \n",
       "28076              LARKDALE PL     Good  \n",
       "28077             ZASLAVSKY PL     Good  \n",
       "28078                      END     Fair  \n",
       "28079               HAMMOND DR     Poor  \n",
       "28080          MURRAY RIDGE RD     Fair  \n",
       "28081                 AFTON RD     Fair  \n",
       "28082    MOONFLOWER MEADOWS TL     Good  \n",
       "28083  RANCHO SANTA FE FARM RD     Fair  \n",
       "28084                HORNET WY     Good  \n",
       "28085               CUSHING RD     Good  \n",
       "28086               TRUXTUN RD     Good  \n",
       "28087             GABLEWOOD WY     Fair  \n",
       "28088              DOMINION ST     Poor  \n",
       "28089              NATIONAL AV     Good  \n",
       "28090                ARDATH CT     Fair  \n",
       "28091         SILVER ACACIA PL     Good  \n",
       "28092              CAM PROPICO     Good  \n",
       "28093        RANCHO DEL SOL WY     Fair  \n",
       "28094      HISTORIC DECATUR RD     Good  \n",
       "28095           OLIVE KNOLL CT     Good  \n",
       "28096             OLD CREEK RD     Good  \n",
       "28097                      END     Good  \n",
       "\n",
       "[28098 rows x 5 columns]"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "year = 2011\n",
    "DF_OCI = pd.read_csv('OCI_SD_%i.csv' % year,sep = ',', dtype='unicode') #Read the csv file\n",
    "DF_OCI= DF_OCI[['oci','street','street_from','street_to','oci_desc']] #Keep only relevant variables\n",
    "DF_OCI"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Step C.\n",
    "Cleaning the data: removing things such as highways and accidents that did not occur on a street of the offical OC. We do this to keep consistency with the datasets.  "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "#Function to aply multiple conditions/regexp on string\n",
    "def multiple_replace(dico, name_street):\n",
    "  # Create a regular expression  from the dictionary keys\n",
    "  regex = re.compile(\"(%s)\" % \"|\".join(map(re.escape, dico.keys())))\n",
    "\n",
    "  # For each match, look-up corresponding value in dictionary\n",
    "  return (regex.sub(lambda mo: dico[mo.string[mo.start():mo.end()]], name_street) )"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>COLLISION_DATE</th>\n",
       "      <th>COLLISION_TIME</th>\n",
       "      <th>PRIMARY_RD</th>\n",
       "      <th>SECONDARY_RD</th>\n",
       "      <th>CHP_BEAT_TYPE</th>\n",
       "      <th>WEATHER_1</th>\n",
       "      <th>COLLISION_SEVERITY</th>\n",
       "      <th>PRIMARY_COLL_FACTOR</th>\n",
       "      <th>PCF_VIOL_CATEGORY</th>\n",
       "      <th>LIGHTING</th>\n",
       "      <th>ROAD_SURFACE</th>\n",
       "      <th>ROAD_COND_1</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>20150424</td>\n",
       "      <td>2235</td>\n",
       "      <td>01ST AV</td>\n",
       "      <td>W JUNIPER ST</td>\n",
       "      <td>0</td>\n",
       "      <td>B</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>C</td>\n",
       "      <td>B</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>20150428</td>\n",
       "      <td>2008</td>\n",
       "      <td>SEA WORLD DR</td>\n",
       "      <td>MISSION BAY DR</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>11</td>\n",
       "      <td>E</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>20150430</td>\n",
       "      <td>1418</td>\n",
       "      <td>DEL MAR TRAILS RD</td>\n",
       "      <td>MONA LISA ST</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>10</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>20150714</td>\n",
       "      <td>1831</td>\n",
       "      <td>GRAMERCY DR</td>\n",
       "      <td>TOWSER ST</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>8</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>20150629</td>\n",
       "      <td>2145</td>\n",
       "      <td>SOUTH 32ND ST</td>\n",
       "      <td>S 32ND ST 500</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>20150715</td>\n",
       "      <td>2129</td>\n",
       "      <td>INGRAHAM ST</td>\n",
       "      <td>DANA LANDING RD</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>11</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>20150813</td>\n",
       "      <td>1823</td>\n",
       "      <td>NAVAJO RD</td>\n",
       "      <td>GOLFCREST DR</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>12</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>20150822</td>\n",
       "      <td>730</td>\n",
       "      <td>FRIARS RD</td>\n",
       "      <td>PACIFIC HY</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>8</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>20150831</td>\n",
       "      <td>1726</td>\n",
       "      <td>GRAND AV</td>\n",
       "      <td>DAWES ST</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>10</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>20150830</td>\n",
       "      <td>1608</td>\n",
       "      <td>CARMEL MOUNTAIN RD</td>\n",
       "      <td>CARMEL CREEK RD</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>20150829</td>\n",
       "      <td>955</td>\n",
       "      <td>EL CAJON BL</td>\n",
       "      <td>ALTADENA AV</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>10</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>20150915</td>\n",
       "      <td>1046</td>\n",
       "      <td>GENESEE AV</td>\n",
       "      <td>CENTURION SQ</td>\n",
       "      <td>0</td>\n",
       "      <td>B</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>B</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>20150926</td>\n",
       "      <td>220</td>\n",
       "      <td>CLAIRMONT DR</td>\n",
       "      <td>RAPPAHANNOCK AV</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>8</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>20151220</td>\n",
       "      <td>2014</td>\n",
       "      <td>ROSECRANS ST</td>\n",
       "      <td>QUALTROUGH ST</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>8</td>\n",
       "      <td>D</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>20150107</td>\n",
       "      <td>1720</td>\n",
       "      <td>RANCHO BERNARDO RD</td>\n",
       "      <td>ACENA DR</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>10</td>\n",
       "      <td>B</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>20150111</td>\n",
       "      <td>13</td>\n",
       "      <td>DEL SOL BL</td>\n",
       "      <td>BEYER WAY</td>\n",
       "      <td>0</td>\n",
       "      <td>B</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>8</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>20150115</td>\n",
       "      <td>1554</td>\n",
       "      <td>RICHMOND ST</td>\n",
       "      <td>ESSEX ST</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>10</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>20150131</td>\n",
       "      <td>1807</td>\n",
       "      <td>UNIVERSITY AV</td>\n",
       "      <td>47TH ST</td>\n",
       "      <td>0</td>\n",
       "      <td>B</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>11</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>20150103</td>\n",
       "      <td>25</td>\n",
       "      <td>BACON ST</td>\n",
       "      <td>CORONADO AV</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>20150509</td>\n",
       "      <td>1108</td>\n",
       "      <td>JAMACHA RD</td>\n",
       "      <td>GLENCOE DR</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>8</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>20150105</td>\n",
       "      <td>955</td>\n",
       "      <td>MIRAMAR RD</td>\n",
       "      <td>MIRAMAR RD 7100</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>20150106</td>\n",
       "      <td>1539</td>\n",
       "      <td>DENNERY RD</td>\n",
       "      <td>PALM AV</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>4</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>20150129</td>\n",
       "      <td>954</td>\n",
       "      <td>HAWTHORN ST</td>\n",
       "      <td>ALBATROSS ST</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>21</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>20150127</td>\n",
       "      <td>1811</td>\n",
       "      <td>RUFFIN RD</td>\n",
       "      <td>SKY PARK CT</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>8</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>20150105</td>\n",
       "      <td>1626</td>\n",
       "      <td>GARNET AV</td>\n",
       "      <td>EVERTS ST</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>4</td>\n",
       "      <td>A</td>\n",
       "      <td>9</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>20150105</td>\n",
       "      <td>1937</td>\n",
       "      <td>ASH ST</td>\n",
       "      <td>02ND AV</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>4</td>\n",
       "      <td>A</td>\n",
       "      <td>9</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>20150103</td>\n",
       "      <td>1348</td>\n",
       "      <td>TEXAS ST</td>\n",
       "      <td>MONROE AV</td>\n",
       "      <td>0</td>\n",
       "      <td>-</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>20150106</td>\n",
       "      <td>1700</td>\n",
       "      <td>BALBOA AV</td>\n",
       "      <td>RUFFNER ST</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>9</td>\n",
       "      <td>B</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>20150102</td>\n",
       "      <td>1516</td>\n",
       "      <td>LINDA VISTA RD</td>\n",
       "      <td>MESA COLLEGE DR</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>4</td>\n",
       "      <td>A</td>\n",
       "      <td>8</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>20150101</td>\n",
       "      <td>2230</td>\n",
       "      <td>54TH ST</td>\n",
       "      <td>STREAMVIEW DR</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>8</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4604</th>\n",
       "      <td>20151212</td>\n",
       "      <td>1840</td>\n",
       "      <td>ST-94 WESTBOUND</td>\n",
       "      <td>EUCLID AVENUE O/C</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>8</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4605</th>\n",
       "      <td>20151205</td>\n",
       "      <td>1805</td>\n",
       "      <td>I8 EB</td>\n",
       "      <td>MORENA BL</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4606</th>\n",
       "      <td>20151206</td>\n",
       "      <td>1410</td>\n",
       "      <td>I805 NB FROM TELEGRAPH CANYON RD.</td>\n",
       "      <td>TELEGRAPH CANYON RD.</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>4</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4607</th>\n",
       "      <td>20151208</td>\n",
       "      <td>1900</td>\n",
       "      <td>I -15 S/B</td>\n",
       "      <td>CLAIREMONT MESA BLVD</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4608</th>\n",
       "      <td>20151209</td>\n",
       "      <td>1720</td>\n",
       "      <td>SR 94 W/B</td>\n",
       "      <td>KELTON AVE</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4609</th>\n",
       "      <td>20151102</td>\n",
       "      <td>708</td>\n",
       "      <td>9550 CARMEL MOUNTAIN ROAD</td>\n",
       "      <td>SUN DEVIL WAY</td>\n",
       "      <td>S</td>\n",
       "      <td>B</td>\n",
       "      <td>0</td>\n",
       "      <td>B</td>\n",
       "      <td>22</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4610</th>\n",
       "      <td>20151207</td>\n",
       "      <td>1455</td>\n",
       "      <td>COLLEGE AVENUE S/B</td>\n",
       "      <td>LINDO PASEO</td>\n",
       "      <td>S</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>8</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4611</th>\n",
       "      <td>20151214</td>\n",
       "      <td>1830</td>\n",
       "      <td>SR 52 E/B</td>\n",
       "      <td>MAST BLVD</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>4</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>D</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4612</th>\n",
       "      <td>20151216</td>\n",
       "      <td>1740</td>\n",
       "      <td>I-805 S/B</td>\n",
       "      <td>SR-15 U/C</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>8</td>\n",
       "      <td>D</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4613</th>\n",
       "      <td>20151205</td>\n",
       "      <td>1210</td>\n",
       "      <td>163 S/B</td>\n",
       "      <td>ROBINSON AVE.</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4614</th>\n",
       "      <td>20151212</td>\n",
       "      <td>1610</td>\n",
       "      <td>I805 NB TO I8 TRANSITION ROAD</td>\n",
       "      <td>ADAMS AVE. O/C</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4615</th>\n",
       "      <td>20151216</td>\n",
       "      <td>1740</td>\n",
       "      <td>SR 163 S/B</td>\n",
       "      <td>I-8</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4616</th>\n",
       "      <td>20151216</td>\n",
       "      <td>1750</td>\n",
       "      <td>SR 163 S/B</td>\n",
       "      <td>I-8</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4617</th>\n",
       "      <td>20151217</td>\n",
       "      <td>1520</td>\n",
       "      <td>PASEO LUCIDO N/B (13000 BLK)</td>\n",
       "      <td>CALLE SAUCILLO</td>\n",
       "      <td>S</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>21</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4618</th>\n",
       "      <td>20151113</td>\n",
       "      <td>1235</td>\n",
       "      <td>VIA DE LA VALLE (2600 BLOCK)</td>\n",
       "      <td>I-5 N/B</td>\n",
       "      <td>S</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>8</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4619</th>\n",
       "      <td>20151222</td>\n",
       "      <td>2140</td>\n",
       "      <td>N/B I-805 TO E/B I-8</td>\n",
       "      <td>I-8</td>\n",
       "      <td>1</td>\n",
       "      <td>B</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>C</td>\n",
       "      <td>B</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4620</th>\n",
       "      <td>20151228</td>\n",
       "      <td>1600</td>\n",
       "      <td>SR 52 E/B</td>\n",
       "      <td>MAST BLVD</td>\n",
       "      <td>3</td>\n",
       "      <td>B</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>B</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4621</th>\n",
       "      <td>20151225</td>\n",
       "      <td>1630</td>\n",
       "      <td>4375 DERRICK DR</td>\n",
       "      <td>BALBOA ARMS DR.</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>21</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4622</th>\n",
       "      <td>20151217</td>\n",
       "      <td>1525</td>\n",
       "      <td>PASEO LUCIDO N/B (13000 BLK)</td>\n",
       "      <td>CALLE SAUCILLO</td>\n",
       "      <td>S</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>6</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4623</th>\n",
       "      <td>20151118</td>\n",
       "      <td>1522</td>\n",
       "      <td>04TH AVE (900 BLOCK)</td>\n",
       "      <td>E ST</td>\n",
       "      <td>S</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>C</td>\n",
       "      <td>18</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>D</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4624</th>\n",
       "      <td>20151123</td>\n",
       "      <td>1410</td>\n",
       "      <td>SR 163 S/B</td>\n",
       "      <td>WASHINGTON ST</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>4</td>\n",
       "      <td>A</td>\n",
       "      <td>7</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4625</th>\n",
       "      <td>20151014</td>\n",
       "      <td>900</td>\n",
       "      <td>ST-94 W/B</td>\n",
       "      <td>28TH STREET</td>\n",
       "      <td>3</td>\n",
       "      <td>B</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>4</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4626</th>\n",
       "      <td>20151103</td>\n",
       "      <td>1605</td>\n",
       "      <td>ST-163 (S/B)</td>\n",
       "      <td>GENESEE AVENUE</td>\n",
       "      <td>3</td>\n",
       "      <td>C</td>\n",
       "      <td>4</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>B</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4627</th>\n",
       "      <td>20151025</td>\n",
       "      <td>252</td>\n",
       "      <td>ST-15 SOUTHBOUND</td>\n",
       "      <td>UNIVERSITY AVENUE</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>8</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4628</th>\n",
       "      <td>20151126</td>\n",
       "      <td>500</td>\n",
       "      <td>N/B BRIARWOOD ROAD</td>\n",
       "      <td>PICASSO DR.</td>\n",
       "      <td>5</td>\n",
       "      <td>C</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>8</td>\n",
       "      <td>C</td>\n",
       "      <td>B</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4629</th>\n",
       "      <td>20151015</td>\n",
       "      <td>810</td>\n",
       "      <td>ST-15 NORTHBOUND</td>\n",
       "      <td>ADAMS AVENUE</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>8</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4630</th>\n",
       "      <td>20151110</td>\n",
       "      <td>1435</td>\n",
       "      <td>ST-15 N/B</td>\n",
       "      <td>OCEAN VIEW BOULEVARD</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>D</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4631</th>\n",
       "      <td>20151216</td>\n",
       "      <td>650</td>\n",
       "      <td>CALLE QUEBRADA</td>\n",
       "      <td>GOETZE ROAD</td>\n",
       "      <td>S</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>8</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4632</th>\n",
       "      <td>20151028</td>\n",
       "      <td>145</td>\n",
       "      <td>ST-15 SOUTHBOUND</td>\n",
       "      <td>ST-94</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>11</td>\n",
       "      <td>D</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4633</th>\n",
       "      <td>20151224</td>\n",
       "      <td>2130</td>\n",
       "      <td>ST-163 SOUTHBOUND</td>\n",
       "      <td>I-8</td>\n",
       "      <td>3</td>\n",
       "      <td>B</td>\n",
       "      <td>1</td>\n",
       "      <td>A</td>\n",
       "      <td>11</td>\n",
       "      <td>D</td>\n",
       "      <td>B</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>4634 rows × 12 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "     COLLISION_DATE COLLISION_TIME                         PRIMARY_RD  \\\n",
       "0          20150424           2235                            01ST AV   \n",
       "1          20150428           2008                       SEA WORLD DR   \n",
       "2          20150430           1418                  DEL MAR TRAILS RD   \n",
       "3          20150714           1831                        GRAMERCY DR   \n",
       "4          20150629           2145                      SOUTH 32ND ST   \n",
       "5          20150715           2129                        INGRAHAM ST   \n",
       "6          20150813           1823                          NAVAJO RD   \n",
       "7          20150822            730                          FRIARS RD   \n",
       "8          20150831           1726                           GRAND AV   \n",
       "9          20150830           1608                 CARMEL MOUNTAIN RD   \n",
       "10         20150829            955                        EL CAJON BL   \n",
       "11         20150915           1046                         GENESEE AV   \n",
       "12         20150926            220                       CLAIRMONT DR   \n",
       "13         20151220           2014                       ROSECRANS ST   \n",
       "14         20150107           1720                 RANCHO BERNARDO RD   \n",
       "15         20150111             13                         DEL SOL BL   \n",
       "16         20150115           1554                        RICHMOND ST   \n",
       "17         20150131           1807                      UNIVERSITY AV   \n",
       "18         20150103             25                           BACON ST   \n",
       "19         20150509           1108                         JAMACHA RD   \n",
       "20         20150105            955                         MIRAMAR RD   \n",
       "21         20150106           1539                         DENNERY RD   \n",
       "22         20150129            954                        HAWTHORN ST   \n",
       "23         20150127           1811                          RUFFIN RD   \n",
       "24         20150105           1626                          GARNET AV   \n",
       "25         20150105           1937                             ASH ST   \n",
       "26         20150103           1348                           TEXAS ST   \n",
       "27         20150106           1700                          BALBOA AV   \n",
       "28         20150102           1516                     LINDA VISTA RD   \n",
       "29         20150101           2230                            54TH ST   \n",
       "...             ...            ...                                ...   \n",
       "4604       20151212           1840                    ST-94 WESTBOUND   \n",
       "4605       20151205           1805                              I8 EB   \n",
       "4606       20151206           1410  I805 NB FROM TELEGRAPH CANYON RD.   \n",
       "4607       20151208           1900                          I -15 S/B   \n",
       "4608       20151209           1720                          SR 94 W/B   \n",
       "4609       20151102            708          9550 CARMEL MOUNTAIN ROAD   \n",
       "4610       20151207           1455                 COLLEGE AVENUE S/B   \n",
       "4611       20151214           1830                          SR 52 E/B   \n",
       "4612       20151216           1740                          I-805 S/B   \n",
       "4613       20151205           1210                            163 S/B   \n",
       "4614       20151212           1610      I805 NB TO I8 TRANSITION ROAD   \n",
       "4615       20151216           1740                         SR 163 S/B   \n",
       "4616       20151216           1750                         SR 163 S/B   \n",
       "4617       20151217           1520       PASEO LUCIDO N/B (13000 BLK)   \n",
       "4618       20151113           1235       VIA DE LA VALLE (2600 BLOCK)   \n",
       "4619       20151222           2140               N/B I-805 TO E/B I-8   \n",
       "4620       20151228           1600                          SR 52 E/B   \n",
       "4621       20151225           1630                    4375 DERRICK DR   \n",
       "4622       20151217           1525       PASEO LUCIDO N/B (13000 BLK)   \n",
       "4623       20151118           1522               04TH AVE (900 BLOCK)   \n",
       "4624       20151123           1410                         SR 163 S/B   \n",
       "4625       20151014            900                          ST-94 W/B   \n",
       "4626       20151103           1605                       ST-163 (S/B)   \n",
       "4627       20151025            252                   ST-15 SOUTHBOUND   \n",
       "4628       20151126            500                 N/B BRIARWOOD ROAD   \n",
       "4629       20151015            810                   ST-15 NORTHBOUND   \n",
       "4630       20151110           1435                          ST-15 N/B   \n",
       "4631       20151216            650                    CALLE QUEBRADA    \n",
       "4632       20151028            145                   ST-15 SOUTHBOUND   \n",
       "4633       20151224           2130                  ST-163 SOUTHBOUND   \n",
       "\n",
       "              SECONDARY_RD CHP_BEAT_TYPE WEATHER_1 COLLISION_SEVERITY  \\\n",
       "0             W JUNIPER ST             0         B                  1   \n",
       "1           MISSION BAY DR             0         A                  1   \n",
       "2             MONA LISA ST             0         A                  1   \n",
       "3                TOWSER ST             0         A                  1   \n",
       "4            S 32ND ST 500             0         A                  1   \n",
       "5          DANA LANDING RD             0         A                  1   \n",
       "6             GOLFCREST DR             0         A                  1   \n",
       "7               PACIFIC HY             0         A                  1   \n",
       "8                 DAWES ST             0         A                  1   \n",
       "9          CARMEL CREEK RD             0         A                  1   \n",
       "10             ALTADENA AV             0         A                  1   \n",
       "11            CENTURION SQ             0         B                  1   \n",
       "12         RAPPAHANNOCK AV             0         A                  1   \n",
       "13           QUALTROUGH ST             0         A                  1   \n",
       "14                ACENA DR             0         A                  1   \n",
       "15               BEYER WAY             0         B                  1   \n",
       "16                ESSEX ST             0         A                  1   \n",
       "17                 47TH ST             0         B                  1   \n",
       "18             CORONADO AV             0         A                  1   \n",
       "19              GLENCOE DR             0         A                  1   \n",
       "20         MIRAMAR RD 7100             0         A                  3   \n",
       "21                 PALM AV             0         A                  4   \n",
       "22            ALBATROSS ST             0         A                  0   \n",
       "23             SKY PARK CT             0         A                  0   \n",
       "24               EVERTS ST             0         A                  4   \n",
       "25                 02ND AV             0         A                  4   \n",
       "26               MONROE AV             0         -                  3   \n",
       "27              RUFFNER ST             0         A                  3   \n",
       "28         MESA COLLEGE DR             0         A                  4   \n",
       "29           STREAMVIEW DR             0         A                  3   \n",
       "...                    ...           ...       ...                ...   \n",
       "4604     EUCLID AVENUE O/C             3         A                  0   \n",
       "4605             MORENA BL             1         A                  0   \n",
       "4606  TELEGRAPH CANYON RD.             1         A                  4   \n",
       "4607  CLAIREMONT MESA BLVD             1         A                  0   \n",
       "4608            KELTON AVE             3         A                  0   \n",
       "4609         SUN DEVIL WAY             S         B                  0   \n",
       "4610           LINDO PASEO             S         A                  0   \n",
       "4611             MAST BLVD             3         A                  4   \n",
       "4612             SR-15 U/C             1         A                  0   \n",
       "4613         ROBINSON AVE.             3         A                  0   \n",
       "4614        ADAMS AVE. O/C             1         A                  0   \n",
       "4615                   I-8             3         A                  0   \n",
       "4616                   I-8             3         A                  0   \n",
       "4617        CALLE SAUCILLO             S         A                  0   \n",
       "4618               I-5 N/B             S         A                  0   \n",
       "4619                   I-8             1         B                  0   \n",
       "4620             MAST BLVD             3         B                  0   \n",
       "4621       BALBOA ARMS DR.             A         A                  0   \n",
       "4622        CALLE SAUCILLO             S         A                  0   \n",
       "4623                  E ST             S         A                  0   \n",
       "4624         WASHINGTON ST             3         A                  4   \n",
       "4625           28TH STREET             3         B                  0   \n",
       "4626        GENESEE AVENUE             3         C                  4   \n",
       "4627     UNIVERSITY AVENUE             1         A                  1   \n",
       "4628           PICASSO DR.             5         C                  0   \n",
       "4629          ADAMS AVENUE             1         A                  1   \n",
       "4630  OCEAN VIEW BOULEVARD             1         A                  0   \n",
       "4631           GOETZE ROAD             S         A                  0   \n",
       "4632                 ST-94             1         A                  1   \n",
       "4633                   I-8             3         B                  1   \n",
       "\n",
       "     PRIMARY_COLL_FACTOR PCF_VIOL_CATEGORY LIGHTING ROAD_SURFACE ROAD_COND_1  \n",
       "0                      A                 3        C            B           H  \n",
       "1                      A                11        E            A           H  \n",
       "2                      A                10        A            A           H  \n",
       "3                      A                 8        A            A           H  \n",
       "4                      A                 3        C            A           H  \n",
       "5                      A                11        C            A           H  \n",
       "6                      A                12        A            A           H  \n",
       "7                      A                 8        A            A           H  \n",
       "8                      A                10        A            A           H  \n",
       "9                      A                 3        A            A           H  \n",
       "10                     A                10        A            A           H  \n",
       "11                     A                 3        A            B           H  \n",
       "12                     A                 8        C            A           H  \n",
       "13                     A                 8        D            A           H  \n",
       "14                     A                10        B            A           H  \n",
       "15                     A                 8        C            A           H  \n",
       "16                     A                10        A            A           H  \n",
       "17                     A                11        C            A           H  \n",
       "18                     A                 3        C            A           H  \n",
       "19                     A                 8        A            A           H  \n",
       "20                     A                 3        A            A           H  \n",
       "21                     A                 3        A            A           H  \n",
       "22                     A                21        A            A           H  \n",
       "23                     A                 8        C            A           H  \n",
       "24                     A                 9        A            A           H  \n",
       "25                     A                 9        C            A           H  \n",
       "26                     A                 3        A            A           H  \n",
       "27                     A                 9        B            A           H  \n",
       "28                     A                 8        A            A           H  \n",
       "29                     A                 8        C            A           H  \n",
       "...                  ...               ...      ...          ...         ...  \n",
       "4604                   A                 8        C            A           H  \n",
       "4605                   A                 3        C            A           H  \n",
       "4606                   A                 3        A            A           H  \n",
       "4607                   A                 3        C            A           H  \n",
       "4608                   A                 3        C            A           H  \n",
       "4609                   B                22        A            A           H  \n",
       "4610                   A                 8        A            A           H  \n",
       "4611                   A                 3        D            A           H  \n",
       "4612                   A                 8        D            A           H  \n",
       "4613                   A                 3        A            A           H  \n",
       "4614                   A                 3        A            A           H  \n",
       "4615                   A                 3        C            A           H  \n",
       "4616                   A                 3        C            A           H  \n",
       "4617                   A                21        A            A           H  \n",
       "4618                   A                 8        A            A           H  \n",
       "4619                   A                 3        C            B           H  \n",
       "4620                   A                 3        A            B           H  \n",
       "4621                   A                21        C            A           H  \n",
       "4622                   A                 6        A            A           H  \n",
       "4623                   C                18        A            A           D  \n",
       "4624                   A                 7        A            A           H  \n",
       "4625                   A                 4        A            A           H  \n",
       "4626                   A                 3        A            B           H  \n",
       "4627                   A                 8        C            A           H  \n",
       "4628                   A                 8        C            B           H  \n",
       "4629                   A                 8        A            A           H  \n",
       "4630                   D                 0        A            A           H  \n",
       "4631                   A                 8        A            A           H  \n",
       "4632                   A                11        D            A           H  \n",
       "4633                   A                11        D            B           H  \n",
       "\n",
       "[4634 rows x 12 columns]"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#MVA_DF put the street names in the closest format from the OCI dataset\n",
    "\n",
    "pattern_digitAV = re.compile(\"^(^[0-9])([A-Z].*)\") #If start with one digit and followed by str\n",
    "dico = {\"HWY\" : \"HY\", \"RT \" : \"I-\",\"INTERSTATE \": \"I-\",\"STATE ROUTE \": \"ST-\"} \n",
    "for i in range(len(MVA_DF)) : #When finished, len(DF)\n",
    "    #print(\"ONE  : \",(MVA_DF[\"PRIMARY_RD\"])[i],\" Intersection : \",(MVA_DF[\"SECONDARY_RD\"])[i])\n",
    "    (MVA_DF[\"PRIMARY_RD\"])[i] = multiple_replace(dico,(MVA_DF[\"PRIMARY_RD\"])[i]) #Get the street name\n",
    "    (MVA_DF[\"SECONDARY_RD\"])[i] = multiple_replace(dico,(MVA_DF[\"SECONDARY_RD\"])[i]) #Get intersection \n",
    "    digit_AV_street = pattern_digitAV.match((MVA_DF[\"PRIMARY_RD\"])[i]) # Check if match with pattern\n",
    "    digit_AV_Inter =pattern_digitAV.match((MVA_DF[\"SECONDARY_RD\"])[i]) # Check if match with pattern\n",
    "    if digit_AV_Inter is not None : \n",
    "        (MVA_DF[\"SECONDARY_RD\"])[i]= \"0\" + digit_AV_Inter.group()    #Add a 0 in front if match\n",
    "    if digit_AV_street is not (None):\n",
    "        (MVA_DF[\"PRIMARY_RD\"])[i] = \"0\" + digit_AV_street.group() #Add a 0 in front if match\n",
    "        \n",
    "MVA_DF = MVA_DF.loc[MVA_DF.PCF_VIOL_CATEGORY != '1'] #If driving under drugs or alcohol\n",
    "MVA_DF = MVA_DF[~(MVA_DF.PRIMARY_RD.str.startswith('I-'))] #Take off the accidents owhen on the main Interstates road but not if at intersection\n",
    "MVA_DF = MVA_DF[~(MVA_DF.PRIMARY_RD.str.startswith('SR-'))] #Take off the accidents on State Routes (not in OCI df)\n",
    "\n",
    "MVA_DF= MVA_DF.reset_index(drop=True)\n",
    "MVA_DF"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Step D.\n",
    "This is where we merge the data between the OCI and the MVA collision data into a single dataframe"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "CAS A DETERMINER\n",
      "Close_M_S :  ['S 32ND ST']\n",
      "Close_M_S :  ['CARMEL MTN RD']\n",
      "No street_from match\n",
      "Street :  GENESEE AV  Intersection :  CENTURION SQ\n",
      "Close_M_S :  ['CLAIREMONT DR']\n",
      "Close_M_S :  ['OTAY MESA RD']\n",
      "Close_M_S :  ['CAM DE LA PLAZA']\n",
      "Close_M_S :  ['PAMO AV']\n",
      "Close_M_S :  ['OCEAN VIEW BL']\n",
      "Close_M_S :  ['BLACK MTN RD']\n",
      "No street_from match\n",
      "Street :  CABLE ST  Intersection :  CABLE ST 1783\n",
      "Close_M_S :  ['LA JOLLA PY']\n",
      "No street_from match\n",
      "Street :  BERNARDO CENTER DR  Intersection :  I-15\n",
      "Close_M_S :  ['E SAN YSIDRO BL']\n",
      "Close_M_S :  ['BLACK MTN RD']\n",
      "Close_M_S :  ['GRIBBLE ST']\n",
      "Close_M_S :  ['PAMO AV']\n",
      "No street_from match\n",
      "Street :  HOWARD AV  Intersection :  SAN YSIDRO BL\n",
      "Close_M_S :  ['CARMEL MTN RD']\n",
      "CAS A DETERMINER\n",
      "No street_from match\n",
      "Street :  58TH ST  Intersection :  58TH ST 4000\n",
      "Close_M_S :  ['LA JOLLA SCENIC S DR']\n",
      "Close_M_S :  ['CAM DE LA REINA']\n",
      "CAS A DETERMINER\n",
      "No street_from match\n",
      "Street :  UNIVERSITY AV  Intersection :  UNIVERSITY AV 5000\n",
      "Close_M_S :  ['TED WILLIAMS PY']\n",
      "Close_M_S :  ['CAM DEL SUR']\n",
      "Close_M_S :  ['W WASHINGTON ST']\n",
      "Close_M_S :  ['MIRAMAR RD']\n",
      "No street_from match\n",
      "Street :  ADRIAN ST  Intersection :  WEST POINT LOMA BL\n",
      "CAS A DETERMINER\n",
      "No street_from match\n",
      "Street :  PARK BL  Intersection :  SPACE THEATER WY\n",
      "CAS A DETERMINER\n",
      "Close_M_S :  ['CAM RUIZ']\n",
      "No street_from match\n",
      "Street :  BEYER BL  Intersection :  WEST PARK\n",
      "Close_M_S :  ['SCRIPPS POWAY PY']\n",
      "Close_M_S :  ['S 47TH ST']\n",
      "CAS A DETERMINER\n",
      "No street_from match\n",
      "Street :  CARROLL CANYON RD  Intersection :  I-15\n",
      "Close_M_S :  ['SABRE SPRINGS PY']\n",
      "Close_M_S :  ['CAM RUIZ']\n",
      "Close_M_S :  ['CAM RUIZ']\n",
      "No street_from match\n",
      "Street :  NORMAL ST  Intersection :  PARK BL\n",
      "No street_from match\n",
      "Street :  SUNSET CLIFFS BL  Intersection :  I-8\n",
      "Close_M_S :  ['TORREY LN']\n",
      "No street_from match\n",
      "Street :  MIRAMAR RD  Intersection :  I-805\n",
      "CAS A DETERMINER\n",
      "No street_from match\n",
      "Street :  SANTO RD  Intersection :  SANTO RD 5900\n",
      "Close_M_S :  ['CARMEL MTN RD']\n",
      "CAS A DETERMINER\n",
      "Close_M_S :  ['CAM DE LA PLAZA']\n",
      "Close_M_S :  ['S EUCLID AV']\n",
      "No street_from match\n",
      "Street :  LINDA VISTA RD  Intersection :  LINDA VISTA RD 8000\n",
      "Close_M_S :  ['CAM DE LA REINA']\n",
      "Close_M_S :  ['CLAIREMONT MESA BL']\n",
      "CAS A DETERMINER\n",
      "Close_M_S :  ['CATALINA RD']\n",
      "No street_from match\n",
      "Street :  WOODMAN  Intersection :  WOODMAN 700\n",
      "No street_from match\n",
      "Street :  EL CAJON BL  Intersection :  EL CAJON BL 6517\n",
      "No street_from match\n",
      "Street :  NORTH TORREY PINES RD  Intersection :  CARMEL VALLEY RD\n",
      "Close_M_S :  ['CAM DEL SUR']\n",
      "Close_M_S :  ['EL CAM REAL']\n",
      "Close_M_S :  ['MIRA MONTE']\n",
      "No street_from match\n",
      "Street :  W HAWTHORN  Intersection :  HAWTHORN\n",
      "CAS A DETERMINER\n",
      "Close_M_S :  ['S 43RD ST']\n",
      "Close_M_S :  ['CAM DEL RIO NORTH']\n",
      "No street_from match\n",
      "Street :  FAIRMOUNT AV  Intersection :  SUMAC DR\n",
      "No street_from match\n",
      "Street :  MERCY RD  Intersection :  I-15\n",
      "No street_from match\n",
      "Street :  UNIVERSITY AV  Intersection :  UNIVERSITY AV 1000\n",
      "No street_from match\n",
      "Street :  SORRENTO VALLEY BL  Intersection :  PENASQUITOS WEST ENT\n",
      "Close_M_S :  ['19TH ST']\n",
      "Close_M_S :  ['CAM RUIZ']\n",
      "CAS A DETERMINER\n",
      "No street_from match\n",
      "Street :  KURTZ ST  Intersection :  KURTZ ST 2700\n",
      "CAS A DETERMINER\n",
      "No street_from match\n",
      "Street :  MIDWAY DR  Intersection :  POST OFFICE DRIVEWAY\n",
      "Close_M_S :  ['STONEBRIDGE PY']\n",
      "No street_from match\n",
      "Street :  WEST MISSION BAY DR  Intersection :  SD LIGHT POST 165240\n",
      "Close_M_S :  ['PAMO AV']\n",
      "No street_from match\n",
      "Street :  GRAMERCY DR  Intersection :  RUFFIN RD\n",
      "Close_M_S :  ['WEST BERNARDO DR']\n",
      "No street_from match\n",
      "Street :  CORONADO AV  Intersection :  THERMAL AV\n",
      "No street_from match\n",
      "Street :  54TH ST  Intersection :  WESTOVER PL\n",
      "No street_from match\n",
      "Street :  EL CAJON BL  Intersection :  ALICE ST\n",
      "Close_M_S :  ['W WASHINGTON ST']\n",
      "No street_from match\n",
      "Street :  CAM DEL RIO  Intersection :  MISSION GORGE\n",
      "Close_M_S :  ['PAMO AV']\n",
      "Close_M_S :  ['CAM RUIZ']\n",
      "Close_M_S :  ['OCEAN FRONT ST']\n",
      "Close_M_S :  ['CAM DE LA REINA']\n",
      "Close_M_S :  ['STONE CANYON RD']\n",
      "Close_M_S :  ['JENNINGS PL']\n",
      "No street_from match\n",
      "Street :  MESA COLLEGE DR  Intersection :  I-163\n",
      "Close_M_S :  ['S 28TH ST']\n",
      "Close_M_S :  ['PAMO AV']\n",
      "Close_M_S :  ['SAN PASQUAL ST']\n",
      "Close_M_S :  ['W SAN YSIDRO BL']\n",
      "CAS A DETERMINER\n",
      "Close_M_S :  ['OCEAN VIEW BL']\n",
      "No street_from match\n",
      "Street :  MIRAMAR RD  Intersection :  I-805\n",
      "Close_M_S :  ['S EUCLID AV']\n",
      "No street_from match\n",
      "Street :  EL CAJON BL  Intersection :  I-15\n",
      "Close_M_S :  ['ABERNATHY WY']\n",
      "No street_from match\n",
      "Street :  HEALTH CENTER DR  Intersection :  MARY BIRCH LN\n",
      "Close_M_S :  ['CAM DE LA REINA']\n",
      "No street_from match\n",
      "Street :  EL CAJON BL  Intersection :  ROLANDO BL\n",
      "No street_from match\n",
      "Street :  MORENA BL  Intersection :  I-8\n",
      "CAS A DETERMINER\n",
      "Close_M_S :  ['S 32ND ST']\n",
      "No street_from match\n",
      "Street :  FEDERAL BL  Intersection :  FEDERAL BL 4704\n",
      "No street_from match\n",
      "Street :  UNIVERSITY AV  Intersection :  UNIVERSITY AV 4400\n",
      "Close_M_S :  ['CAM DEL RIO NORTH']\n",
      "No street_from match\n",
      "Street :  POMERADO RD  Intersection :  I-15\n",
      "Close_M_S :  ['SAN PASQUAL RD']\n",
      "No street_from match\n",
      "Street :  UNIVERSITY AV  Intersection :  I-15\n",
      "No street_from match\n",
      "Street :  REGENTS RD  Intersection :  MIRAMAR ST\n",
      "No street_from match\n",
      "Street :  BOUNDARY ST  Intersection :  ADAMS AV\n",
      "No street_from match\n",
      "Street :  RANCHO MISSION RD  Intersection :  CAMINITO CUERVO\n",
      "Close_M_S :  ['S EUCLID AV']\n",
      "Close_M_S :  ['BERNARDO HEIGHTS PY']\n",
      "No street_from match\n",
      "Street :  NORTH HARBOR DR  Intersection :  RENTAL CAR ACCESS  RD\n",
      "Close_M_S :  ['CAM DEL RIO WEST']\n",
      "No street_from match\n",
      "Street :  MISSION BAY DR  Intersection :  OLLIE ST\n",
      "Close_M_S :  ['CAM RUIZ']\n",
      "No street_from match\n",
      "Street :  GOVERNOR DR  Intersection :  I-805\n",
      "Close_M_S :  ['CAM SANTA FE']\n",
      "No street_from match\n",
      "Street :  EL CAJON BL  Intersection :  EL CERRITO\n",
      "CAS A DETERMINER\n",
      "No street_from match\n",
      "Street :  DIVISION ST  Intersection :  HIGHLAND AV\n",
      "Close_M_S :  ['TOYNE ST']\n",
      "Close_M_S :  ['BLACK MTN RD']\n",
      "No street_from match\n",
      "Street :  SCRIPPS LAKE DR  Intersection :  SCRIPPS LAKE DR 10700\n",
      "No street_from match\n",
      "Street :  ALTA VIEW  Intersection :  ALTA VIEW 3000\n",
      "No street_from match\n",
      "Street :  OLNEY ST  Intersection :  OLNEY ST 4400\n",
      "Close_M_S :  ['S EUCLID AV']\n"
     ]
    }
   ],
   "source": [
    "#To be changed - Instead of looping wanted to merge on street name but don't think its possible - So we should make multiple conditions for determining if street + intersection corresponds to the right OCI\n",
    "#If we have info on To or From  - look directly into the right street-to or street_from - \n",
    "#Otherwise, if double answers, check if same OCI_desc - if same just add it - Otherwise should we include it or just exclude these cases ? \n",
    "\n",
    "TEMP = pd.DataFrame(data=None, index=None, columns= None, dtype=None) #New empty dataframe\n",
    "TEMP2 = pd.DataFrame(data=None, index=None, columns= None, dtype=None) #New empty dataframe\n",
    "DF = pd.DataFrame(data=None, index=None, columns= None, dtype=None) #New empty dataframe\n",
    "street_len = 0\n",
    "intersection_len = 0\n",
    "\n",
    "for i in range(400) : \n",
    "    street_name = (MVA_DF[\"PRIMARY_RD\"])[i]\n",
    "    intersection = (MVA_DF[\"SECONDARY_RD\"])[i]\n",
    "    \n",
    "    TEMP = DF_OCI.loc[(DF_OCI['street'].str.contains(street_name))]\n",
    "    \n",
    "    if TEMP.empty:\n",
    "        Close_Match_Street = (difflib.get_close_matches(street_name, (DF_OCI['street']),n=1))\n",
    "        print(\"Close_M_S : \", Close_Match_Street)\n",
    "        if (Close_Match_Street != []) : \n",
    "            TEMP = DF_OCI.loc[DF_OCI['street'].str.contains(Close_Match_Street[0])]\n",
    "        else :\n",
    "            print(\"No street match\")\n",
    "            print(\"Street : \",street_name,\" Intersection : \",intersection)\n",
    "            street_len = street_len +1\n",
    "            \n",
    "    else :\n",
    "        TEMP2 = TEMP.loc[(TEMP['street_from'] == intersection)|(TEMP['street_to']==(intersection))]  \n",
    "        if TEMP2.empty : \n",
    "            Close_Match_Intersection = (difflib.get_close_matches(intersection, (TEMP['street_from']),n=1))\n",
    "            Close_Match_To = (difflib.get_close_matches(intersection, (TEMP['street_to']),n=1))\n",
    "            if (Close_Match_Intersection != []) & (Close_Match_To != []) : \n",
    "                TEMP2 = TEMP.loc[(TEMP['street_from'] == Close_Match_Intersection[0])|(TEMP['street_to']== Close_Match_To[0])]\n",
    "            elif (Close_Match_Intersection != []) : \n",
    "                TEMP2 = TEMP.loc[(TEMP['street_from'] == Close_Match_Intersection[0])]\n",
    "            elif (Close_Match_To != []) : \n",
    "                TEMP2 = TEMP.loc[(TEMP['street_to'] == Close_Match_To[0])]\n",
    "            else : \n",
    "                print(\"No street_from match\")\n",
    "                print(\"Street : \",street_name,\" Intersection : \",intersection)\n",
    "                intersection_len = intersection_len +1\n",
    "                \n",
    "        \n",
    "        TEMP2= TEMP2.reset_index(drop=True)\n",
    "        length = len(TEMP2)\n",
    "        if length ==1 :\n",
    "            DF = DF.append(TEMP2)\n",
    "        elif length ==2 : \n",
    "            if (TEMP2['oci_desc'])[0] == (TEMP2['oci_desc'])[1]:\n",
    "                DF = DF.append(TEMP2.loc[[1]])\n",
    "        elif length >2 :\n",
    "            print(\"CAS A DETERMINER\")\n",
    "  "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Step E\n",
    "Checking the new dataframe and resetting the index to reorder the data cells"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>oci</th>\n",
       "      <th>street</th>\n",
       "      <th>street_from</th>\n",
       "      <th>street_to</th>\n",
       "      <th>oci_desc</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>80.26</td>\n",
       "      <td>01ST AV</td>\n",
       "      <td>IVY ST</td>\n",
       "      <td>JUNIPER ST</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>76.33</td>\n",
       "      <td>GRAMERCY DR</td>\n",
       "      <td>GREYLING DR</td>\n",
       "      <td>TOWSER ST</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>68.95</td>\n",
       "      <td>GRAND AV</td>\n",
       "      <td>DAWES ST</td>\n",
       "      <td>EVERTS ST</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>52.59</td>\n",
       "      <td>EL CAJON BL</td>\n",
       "      <td>ALTADENA AV</td>\n",
       "      <td>51ST ST</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>83.16</td>\n",
       "      <td>RANCHO BERNARDO RD</td>\n",
       "      <td>BERNARDO CENTER DR</td>\n",
       "      <td>ACENA DR</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>60.58</td>\n",
       "      <td>DEL SOL BL</td>\n",
       "      <td>BEYER WY</td>\n",
       "      <td>DEL SOL LN</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>80</td>\n",
       "      <td>RICHMOND ST</td>\n",
       "      <td>ESSEX ST</td>\n",
       "      <td>UNIVERSITY AV</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>55.99</td>\n",
       "      <td>UNIVERSITY AV</td>\n",
       "      <td>MENLO AV</td>\n",
       "      <td>47TH ST</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>39</td>\n",
       "      <td>BACON ST</td>\n",
       "      <td>CORONADO AV</td>\n",
       "      <td>SANTA CRUZ AV</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>59.62</td>\n",
       "      <td>MIRAMAR RD</td>\n",
       "      <td>MIRAMAR ML</td>\n",
       "      <td>MIRAMAR PL</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>61.2</td>\n",
       "      <td>DENNERY RD</td>\n",
       "      <td>PALM (SB) AV</td>\n",
       "      <td>OCEAN VIEW HILLS PY</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>59.86</td>\n",
       "      <td>W HAWTHORN ST</td>\n",
       "      <td>FRONT ST</td>\n",
       "      <td>ALBATROSS ST</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>51</td>\n",
       "      <td>GARNET AV</td>\n",
       "      <td>DAWES ST</td>\n",
       "      <td>EVERTS ST</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>50</td>\n",
       "      <td>ASH ST</td>\n",
       "      <td>02ND AV</td>\n",
       "      <td>03RD AV</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>100</td>\n",
       "      <td>54TH ST</td>\n",
       "      <td>MARVIN ST</td>\n",
       "      <td>STREAMVIEW DR</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>86.76</td>\n",
       "      <td>EL CAJON BL</td>\n",
       "      <td>71ST ST</td>\n",
       "      <td>72ND ST</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>47.08</td>\n",
       "      <td>61ST ST</td>\n",
       "      <td>NANCITA CT</td>\n",
       "      <td>IMPERIAL AV</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>30.7</td>\n",
       "      <td>19TH ST</td>\n",
       "      <td>C ST</td>\n",
       "      <td>B ST</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>61.53</td>\n",
       "      <td>B ST</td>\n",
       "      <td>16TH ST</td>\n",
       "      <td>17TH ST</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>81.59</td>\n",
       "      <td>TOWNE CENTRE DR</td>\n",
       "      <td>LA JOLLA VILLAGE DR</td>\n",
       "      <td>EXECUTIVE DR</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>62.11</td>\n",
       "      <td>WARING RD</td>\n",
       "      <td>BIRCHWOOD ST</td>\n",
       "      <td>ELDRIDGE ST</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>39</td>\n",
       "      <td>DERRICK DR</td>\n",
       "      <td>BALBOA ARMS DR</td>\n",
       "      <td>CHATEAU DR</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>87.13</td>\n",
       "      <td>MAIN ST</td>\n",
       "      <td>UNA ST</td>\n",
       "      <td>VESTA ST</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>83.65</td>\n",
       "      <td>EL CAJON BL</td>\n",
       "      <td>KANSAS ST</td>\n",
       "      <td>30TH ST</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>58.64</td>\n",
       "      <td>PENNANT WY</td>\n",
       "      <td>HONORS DR</td>\n",
       "      <td>REGENTS RD</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>31.37</td>\n",
       "      <td>BLACK HILLS WY</td>\n",
       "      <td>SAWTOOTH RD</td>\n",
       "      <td>APPALACHIAN WY</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>64.89</td>\n",
       "      <td>NAVAJO RD</td>\n",
       "      <td>CAM ESTRELLADO</td>\n",
       "      <td>PARK RIDGE BL</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>20.49</td>\n",
       "      <td>17TH ST</td>\n",
       "      <td>MARKET ST</td>\n",
       "      <td>G ST</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>79.5</td>\n",
       "      <td>AIRWAY RD</td>\n",
       "      <td>OTAY MESA RD</td>\n",
       "      <td>CALIENTE AV</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>69</td>\n",
       "      <td>OLIVER AV</td>\n",
       "      <td>EVERTS ST</td>\n",
       "      <td>FANUEL ST</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>139</th>\n",
       "      <td>33.29</td>\n",
       "      <td>SUNSET CLIFFS BL</td>\n",
       "      <td>SANTA CRUZ AV</td>\n",
       "      <td>DEL MONTE AV</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>140</th>\n",
       "      <td>39</td>\n",
       "      <td>FANUEL ST</td>\n",
       "      <td>GARNET AV</td>\n",
       "      <td>FELSPAR ST</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>141</th>\n",
       "      <td>41.05</td>\n",
       "      <td>VILLA LA JOLLA DR</td>\n",
       "      <td>HOLIDAY CT</td>\n",
       "      <td>LA JOLLA VILLAGE DR</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>142</th>\n",
       "      <td>56.44</td>\n",
       "      <td>RIVER RUN DR</td>\n",
       "      <td>RIO SAN DIEGO DR</td>\n",
       "      <td>FRIARS RD</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>143</th>\n",
       "      <td>87.65</td>\n",
       "      <td>KEARNY VILLA RD</td>\n",
       "      <td>BALBOA AV</td>\n",
       "      <td>CENTURY PARK CT</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>144</th>\n",
       "      <td>86.04</td>\n",
       "      <td>CANYON LAKE DR</td>\n",
       "      <td>PINETREE DR</td>\n",
       "      <td>AVIARY DR</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>145</th>\n",
       "      <td>82.99</td>\n",
       "      <td>CARMEL CREEK RD</td>\n",
       "      <td>CARMEL MTN RD</td>\n",
       "      <td>MAPLE RIDGE</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>146</th>\n",
       "      <td>47.75</td>\n",
       "      <td>ROSECRANS ST</td>\n",
       "      <td>CAUBY ST</td>\n",
       "      <td>MIDWAY DR</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>147</th>\n",
       "      <td>61.42</td>\n",
       "      <td>CHATSWORTH BL</td>\n",
       "      <td>LA CRESTA DR</td>\n",
       "      <td>OLIPHANT ST</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>148</th>\n",
       "      <td>51</td>\n",
       "      <td>LA JOLLA VILLAGE DR</td>\n",
       "      <td>REGENTS RD</td>\n",
       "      <td>COSTA VERDE BL</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>149</th>\n",
       "      <td>29.63</td>\n",
       "      <td>INGRAHAM ST</td>\n",
       "      <td>GARNET AV</td>\n",
       "      <td>FELSPAR ST</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>150</th>\n",
       "      <td>43.01</td>\n",
       "      <td>C ST</td>\n",
       "      <td>08TH AV</td>\n",
       "      <td>09TH AV</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>151</th>\n",
       "      <td>55.76</td>\n",
       "      <td>POMERADO RD</td>\n",
       "      <td>BERNARDO HEIGHTS PY</td>\n",
       "      <td>STONE CANYON RD</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>152</th>\n",
       "      <td>100</td>\n",
       "      <td>SPRING CANYON RD</td>\n",
       "      <td>RIESLING DR</td>\n",
       "      <td>CYPRESS CANYON PARK DR</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>153</th>\n",
       "      <td>32.27</td>\n",
       "      <td>SUNSET CLIFFS BL</td>\n",
       "      <td>NARRAGANSETT AV</td>\n",
       "      <td>NIAGARA AV</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>154</th>\n",
       "      <td>86.22</td>\n",
       "      <td>HEINRICH HERTZ DR</td>\n",
       "      <td>AIRWAY RD</td>\n",
       "      <td>NIELS BOHR CT</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>155</th>\n",
       "      <td>31.76</td>\n",
       "      <td>LINDA VISTA RD</td>\n",
       "      <td>COLUSA ST</td>\n",
       "      <td>BRUNNER ST</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>156</th>\n",
       "      <td>65.34</td>\n",
       "      <td>TORREY PINES RD</td>\n",
       "      <td>LA JOLLA PY</td>\n",
       "      <td>ARDATH LN</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>157</th>\n",
       "      <td>81.63</td>\n",
       "      <td>KALMIA ST</td>\n",
       "      <td>30TH ST</td>\n",
       "      <td>SAN MARCOS AV</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>158</th>\n",
       "      <td>64.89</td>\n",
       "      <td>NAVAJO RD</td>\n",
       "      <td>CAM ESTRELLADO</td>\n",
       "      <td>PARK RIDGE BL</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>159</th>\n",
       "      <td>87.6</td>\n",
       "      <td>IMPERIAL AV</td>\n",
       "      <td>EUCLID AV</td>\n",
       "      <td>SAN JACINTO DR</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>160</th>\n",
       "      <td>69.2</td>\n",
       "      <td>LINDA VISTA RD</td>\n",
       "      <td>GLIDDEN ST</td>\n",
       "      <td>KRAMER ST</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>161</th>\n",
       "      <td>51</td>\n",
       "      <td>GARNET AV</td>\n",
       "      <td>NOYES ST</td>\n",
       "      <td>OLNEY ST</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>162</th>\n",
       "      <td>33.72</td>\n",
       "      <td>IMPERIAL AV</td>\n",
       "      <td>65TH ST</td>\n",
       "      <td>66TH ST</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>163</th>\n",
       "      <td>47.73</td>\n",
       "      <td>AIRWAY RD</td>\n",
       "      <td>PASEO DE LAS AMERICAS</td>\n",
       "      <td>MICHAEL FARADAY DR</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>164</th>\n",
       "      <td>74.93</td>\n",
       "      <td>J ST</td>\n",
       "      <td>13TH ST</td>\n",
       "      <td>14TH ST</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>165</th>\n",
       "      <td>82.68</td>\n",
       "      <td>HOME AV</td>\n",
       "      <td>FEDERAL BL</td>\n",
       "      <td>ASH ST</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>166</th>\n",
       "      <td>39</td>\n",
       "      <td>GARNET AV</td>\n",
       "      <td>BOND ST</td>\n",
       "      <td>MISSION BAY DR</td>\n",
       "      <td>Poor</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>167</th>\n",
       "      <td>74.94</td>\n",
       "      <td>SUNSET CLIFFS BL</td>\n",
       "      <td>VOLTAIRE ST</td>\n",
       "      <td>LOTUS ST</td>\n",
       "      <td>Good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>168</th>\n",
       "      <td>59.2</td>\n",
       "      <td>ESCALA DR</td>\n",
       "      <td>COLONNADES PL</td>\n",
       "      <td>CHRETIEN CT</td>\n",
       "      <td>Fair</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>169 rows × 5 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "       oci               street            street_from  \\\n",
       "0    80.26              01ST AV                 IVY ST   \n",
       "1    76.33          GRAMERCY DR            GREYLING DR   \n",
       "2    68.95             GRAND AV               DAWES ST   \n",
       "3    52.59          EL CAJON BL            ALTADENA AV   \n",
       "4    83.16   RANCHO BERNARDO RD     BERNARDO CENTER DR   \n",
       "5    60.58           DEL SOL BL               BEYER WY   \n",
       "6       80          RICHMOND ST               ESSEX ST   \n",
       "7    55.99        UNIVERSITY AV               MENLO AV   \n",
       "8       39             BACON ST            CORONADO AV   \n",
       "9    59.62           MIRAMAR RD             MIRAMAR ML   \n",
       "10    61.2           DENNERY RD           PALM (SB) AV   \n",
       "11   59.86        W HAWTHORN ST               FRONT ST   \n",
       "12      51            GARNET AV               DAWES ST   \n",
       "13      50               ASH ST                02ND AV   \n",
       "14     100              54TH ST              MARVIN ST   \n",
       "15   86.76          EL CAJON BL                71ST ST   \n",
       "16   47.08              61ST ST             NANCITA CT   \n",
       "17    30.7              19TH ST                   C ST   \n",
       "18   61.53                 B ST                16TH ST   \n",
       "19   81.59      TOWNE CENTRE DR    LA JOLLA VILLAGE DR   \n",
       "20   62.11            WARING RD           BIRCHWOOD ST   \n",
       "21      39           DERRICK DR         BALBOA ARMS DR   \n",
       "22   87.13              MAIN ST                 UNA ST   \n",
       "23   83.65          EL CAJON BL              KANSAS ST   \n",
       "24   58.64           PENNANT WY              HONORS DR   \n",
       "25   31.37       BLACK HILLS WY            SAWTOOTH RD   \n",
       "26   64.89            NAVAJO RD         CAM ESTRELLADO   \n",
       "27   20.49              17TH ST              MARKET ST   \n",
       "28    79.5            AIRWAY RD           OTAY MESA RD   \n",
       "29      69            OLIVER AV              EVERTS ST   \n",
       "..     ...                  ...                    ...   \n",
       "139  33.29     SUNSET CLIFFS BL          SANTA CRUZ AV   \n",
       "140     39            FANUEL ST              GARNET AV   \n",
       "141  41.05    VILLA LA JOLLA DR             HOLIDAY CT   \n",
       "142  56.44         RIVER RUN DR       RIO SAN DIEGO DR   \n",
       "143  87.65      KEARNY VILLA RD              BALBOA AV   \n",
       "144  86.04       CANYON LAKE DR            PINETREE DR   \n",
       "145  82.99      CARMEL CREEK RD          CARMEL MTN RD   \n",
       "146  47.75         ROSECRANS ST               CAUBY ST   \n",
       "147  61.42        CHATSWORTH BL           LA CRESTA DR   \n",
       "148     51  LA JOLLA VILLAGE DR             REGENTS RD   \n",
       "149  29.63          INGRAHAM ST              GARNET AV   \n",
       "150  43.01                 C ST                08TH AV   \n",
       "151  55.76          POMERADO RD    BERNARDO HEIGHTS PY   \n",
       "152    100     SPRING CANYON RD            RIESLING DR   \n",
       "153  32.27     SUNSET CLIFFS BL        NARRAGANSETT AV   \n",
       "154  86.22    HEINRICH HERTZ DR              AIRWAY RD   \n",
       "155  31.76       LINDA VISTA RD              COLUSA ST   \n",
       "156  65.34      TORREY PINES RD            LA JOLLA PY   \n",
       "157  81.63            KALMIA ST                30TH ST   \n",
       "158  64.89            NAVAJO RD         CAM ESTRELLADO   \n",
       "159   87.6          IMPERIAL AV              EUCLID AV   \n",
       "160   69.2       LINDA VISTA RD             GLIDDEN ST   \n",
       "161     51            GARNET AV               NOYES ST   \n",
       "162  33.72          IMPERIAL AV                65TH ST   \n",
       "163  47.73            AIRWAY RD  PASEO DE LAS AMERICAS   \n",
       "164  74.93                 J ST                13TH ST   \n",
       "165  82.68              HOME AV             FEDERAL BL   \n",
       "166     39            GARNET AV                BOND ST   \n",
       "167  74.94     SUNSET CLIFFS BL            VOLTAIRE ST   \n",
       "168   59.2            ESCALA DR          COLONNADES PL   \n",
       "\n",
       "                  street_to oci_desc  \n",
       "0                JUNIPER ST     Good  \n",
       "1                 TOWSER ST     Good  \n",
       "2                 EVERTS ST     Fair  \n",
       "3                   51ST ST     Fair  \n",
       "4                  ACENA DR     Good  \n",
       "5                DEL SOL LN     Fair  \n",
       "6             UNIVERSITY AV     Good  \n",
       "7                   47TH ST     Fair  \n",
       "8             SANTA CRUZ AV     Poor  \n",
       "9                MIRAMAR PL     Fair  \n",
       "10      OCEAN VIEW HILLS PY     Fair  \n",
       "11             ALBATROSS ST     Fair  \n",
       "12                EVERTS ST     Fair  \n",
       "13                  03RD AV     Fair  \n",
       "14            STREAMVIEW DR     Good  \n",
       "15                  72ND ST     Good  \n",
       "16              IMPERIAL AV     Fair  \n",
       "17                     B ST     Poor  \n",
       "18                  17TH ST     Fair  \n",
       "19             EXECUTIVE DR     Good  \n",
       "20              ELDRIDGE ST     Fair  \n",
       "21               CHATEAU DR     Poor  \n",
       "22                 VESTA ST     Good  \n",
       "23                  30TH ST     Good  \n",
       "24               REGENTS RD     Fair  \n",
       "25           APPALACHIAN WY     Poor  \n",
       "26            PARK RIDGE BL     Fair  \n",
       "27                     G ST     Poor  \n",
       "28              CALIENTE AV     Good  \n",
       "29                FANUEL ST     Fair  \n",
       "..                      ...      ...  \n",
       "139            DEL MONTE AV     Poor  \n",
       "140              FELSPAR ST     Poor  \n",
       "141     LA JOLLA VILLAGE DR     Fair  \n",
       "142               FRIARS RD     Fair  \n",
       "143         CENTURY PARK CT     Good  \n",
       "144               AVIARY DR     Good  \n",
       "145             MAPLE RIDGE     Good  \n",
       "146               MIDWAY DR     Fair  \n",
       "147             OLIPHANT ST     Fair  \n",
       "148          COSTA VERDE BL     Fair  \n",
       "149              FELSPAR ST     Poor  \n",
       "150                 09TH AV     Fair  \n",
       "151         STONE CANYON RD     Fair  \n",
       "152  CYPRESS CANYON PARK DR     Good  \n",
       "153              NIAGARA AV     Poor  \n",
       "154           NIELS BOHR CT     Good  \n",
       "155              BRUNNER ST     Poor  \n",
       "156               ARDATH LN     Fair  \n",
       "157           SAN MARCOS AV     Good  \n",
       "158           PARK RIDGE BL     Fair  \n",
       "159          SAN JACINTO DR     Good  \n",
       "160               KRAMER ST     Fair  \n",
       "161                OLNEY ST     Fair  \n",
       "162                 66TH ST     Poor  \n",
       "163      MICHAEL FARADAY DR     Fair  \n",
       "164                 14TH ST     Good  \n",
       "165                  ASH ST     Good  \n",
       "166          MISSION BAY DR     Poor  \n",
       "167                LOTUS ST     Good  \n",
       "168             CHRETIEN CT     Fair  \n",
       "\n",
       "[169 rows x 5 columns]"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "DF = DF.reset_index(drop=True)\n",
    "DF"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "DF = pd.read_csv('Final_DF.csv') ## Dataframe we will use for the analysis"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "DF.loc[DF['oci_desc'] == 'Good']\n",
    "\n",
    "A = pd.DataFrame(data=None, index=None, columns= None, dtype=None) # New dataframe"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Section 2: Preliminary Data Analytics\n",
    "This section will used to quickly check values and poke around the new dataframe. Not committal to analysis."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Unnamed: 0</th>\n",
       "      <th>oci</th>\n",
       "      <th>street</th>\n",
       "      <th>street_from</th>\n",
       "      <th>street_to</th>\n",
       "      <th>oci_desc</th>\n",
       "      <th>COLLISION_DATE</th>\n",
       "      <th>COLLISION_TIME</th>\n",
       "      <th>PRIMARY_RD</th>\n",
       "      <th>SECONDARY_RD</th>\n",
       "      <th>CHP_BEAT_TYPE</th>\n",
       "      <th>WEATHER_1</th>\n",
       "      <th>COLLISION_SEVERITY</th>\n",
       "      <th>PRIMARY_COLL_FACTOR</th>\n",
       "      <th>PCF_VIOL_CATEGORY</th>\n",
       "      <th>LIGHTING</th>\n",
       "      <th>ROAD_SURFACE</th>\n",
       "      <th>ROAD_COND_1</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0</td>\n",
       "      <td>39.67</td>\n",
       "      <td>EL PASEO GRANDE</td>\n",
       "      <td>CALLE CLARA</td>\n",
       "      <td>VALLECITOS</td>\n",
       "      <td>Poor</td>\n",
       "      <td>20111003</td>\n",
       "      <td>1810</td>\n",
       "      <td>EL PASEO GRANDE</td>\n",
       "      <td>CALLE CLARA</td>\n",
       "      <td>0</td>\n",
       "      <td>B</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>13</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>86.43</td>\n",
       "      <td>MONTEZUMA RD</td>\n",
       "      <td>COLLWOOD BL</td>\n",
       "      <td>YERBA SANTA DR</td>\n",
       "      <td>Good</td>\n",
       "      <td>20110427</td>\n",
       "      <td>1420</td>\n",
       "      <td>MONTEZUMA RD</td>\n",
       "      <td>YERBA SANTA RD</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>08</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2</td>\n",
       "      <td>51.44</td>\n",
       "      <td>MIRAMAR RD</td>\n",
       "      <td>BLACK MTN RD</td>\n",
       "      <td>KEARNY VILLA RD</td>\n",
       "      <td>Fair</td>\n",
       "      <td>20110518</td>\n",
       "      <td>1030</td>\n",
       "      <td>MIRA MAR RD</td>\n",
       "      <td>KEARNY VILLA RD</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>4</td>\n",
       "      <td>A</td>\n",
       "      <td>12</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>3</td>\n",
       "      <td>65.88</td>\n",
       "      <td>EL CAJON BL</td>\n",
       "      <td>46TH ST</td>\n",
       "      <td>46TH ST</td>\n",
       "      <td>Fair</td>\n",
       "      <td>20110530</td>\n",
       "      <td>1738</td>\n",
       "      <td>EL CAJON BL</td>\n",
       "      <td>36TH ST</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>2</td>\n",
       "      <td>A</td>\n",
       "      <td>03</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>4</td>\n",
       "      <td>51.34</td>\n",
       "      <td>MONROE AV</td>\n",
       "      <td>MISSION AV</td>\n",
       "      <td>ALABAMA ST</td>\n",
       "      <td>Fair</td>\n",
       "      <td>20110529</td>\n",
       "      <td>2237</td>\n",
       "      <td>MONROE AV</td>\n",
       "      <td>ALABAMA ST</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>08</td>\n",
       "      <td>C</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Unnamed: 0    oci           street   street_from        street_to oci_desc  \\\n",
       "0           0  39.67  EL PASEO GRANDE   CALLE CLARA       VALLECITOS     Poor   \n",
       "1           1  86.43     MONTEZUMA RD   COLLWOOD BL   YERBA SANTA DR     Good   \n",
       "2           2  51.44       MIRAMAR RD  BLACK MTN RD  KEARNY VILLA RD     Fair   \n",
       "3           3  65.88      EL CAJON BL       46TH ST          46TH ST     Fair   \n",
       "4           4  51.34        MONROE AV    MISSION AV       ALABAMA ST     Fair   \n",
       "\n",
       "   COLLISION_DATE  COLLISION_TIME       PRIMARY_RD     SECONDARY_RD  \\\n",
       "0        20111003            1810  EL PASEO GRANDE      CALLE CLARA   \n",
       "1        20110427            1420     MONTEZUMA RD   YERBA SANTA RD   \n",
       "2        20110518            1030      MIRA MAR RD  KEARNY VILLA RD   \n",
       "3        20110530            1738      EL CAJON BL          36TH ST   \n",
       "4        20110529            2237        MONROE AV       ALABAMA ST   \n",
       "\n",
       "  CHP_BEAT_TYPE WEATHER_1  COLLISION_SEVERITY PRIMARY_COLL_FACTOR  \\\n",
       "0             0         B                   3                   A   \n",
       "1             0         A                   3                   A   \n",
       "2             0         A                   4                   A   \n",
       "3             0         A                   2                   A   \n",
       "4             0         A                   3                   A   \n",
       "\n",
       "  PCF_VIOL_CATEGORY LIGHTING ROAD_SURFACE ROAD_COND_1  \n",
       "0                13        A            A           H  \n",
       "1                08        A            A           H  \n",
       "2                12        A            A           H  \n",
       "3                03        A            A           H  \n",
       "4                08        C            A           H  "
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "DF.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Unnamed: 0</th>\n",
       "      <th>oci</th>\n",
       "      <th>street</th>\n",
       "      <th>street_from</th>\n",
       "      <th>street_to</th>\n",
       "      <th>oci_desc</th>\n",
       "      <th>COLLISION_DATE</th>\n",
       "      <th>COLLISION_TIME</th>\n",
       "      <th>PRIMARY_RD</th>\n",
       "      <th>SECONDARY_RD</th>\n",
       "      <th>CHP_BEAT_TYPE</th>\n",
       "      <th>WEATHER_1</th>\n",
       "      <th>COLLISION_SEVERITY</th>\n",
       "      <th>PRIMARY_COLL_FACTOR</th>\n",
       "      <th>PCF_VIOL_CATEGORY</th>\n",
       "      <th>LIGHTING</th>\n",
       "      <th>ROAD_SURFACE</th>\n",
       "      <th>ROAD_COND_1</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>6368</th>\n",
       "      <td>6368</td>\n",
       "      <td>61.10</td>\n",
       "      <td>ENRICO FERMI DR</td>\n",
       "      <td>MARCONI DR</td>\n",
       "      <td>VIA DE LA AMISTAD</td>\n",
       "      <td>Fair</td>\n",
       "      <td>20141217</td>\n",
       "      <td>1205</td>\n",
       "      <td>ENRICO FERMI DR</td>\n",
       "      <td>MARCONI DR</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>08</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6369</th>\n",
       "      <td>6369</td>\n",
       "      <td>42.48</td>\n",
       "      <td>NORTH HARBOR DR</td>\n",
       "      <td>N HARBOR DR RA</td>\n",
       "      <td>SCOTT ST</td>\n",
       "      <td>Fair</td>\n",
       "      <td>20140307</td>\n",
       "      <td>520</td>\n",
       "      <td>NORTH HARBOR DR</td>\n",
       "      <td>HARBOR ISLAND DR</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>4</td>\n",
       "      <td>A</td>\n",
       "      <td>08</td>\n",
       "      <td>B</td>\n",
       "      <td>-</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6370</th>\n",
       "      <td>6370</td>\n",
       "      <td>58.41</td>\n",
       "      <td>OBERLIN DR</td>\n",
       "      <td>SCRANTON RD</td>\n",
       "      <td>YOUNGSTOWN WY</td>\n",
       "      <td>Fair</td>\n",
       "      <td>20140213</td>\n",
       "      <td>1310</td>\n",
       "      <td>OBERLIN DR</td>\n",
       "      <td>SCRANTON RD</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>4</td>\n",
       "      <td>A</td>\n",
       "      <td>12</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6371</th>\n",
       "      <td>6371</td>\n",
       "      <td>100.00</td>\n",
       "      <td>01ST AV</td>\n",
       "      <td>BEECH ST</td>\n",
       "      <td>CEDAR ST</td>\n",
       "      <td>Good</td>\n",
       "      <td>20141023</td>\n",
       "      <td>1311</td>\n",
       "      <td>01ST AV</td>\n",
       "      <td>CEDAR ST</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>3</td>\n",
       "      <td>A</td>\n",
       "      <td>-</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6372</th>\n",
       "      <td>6372</td>\n",
       "      <td>61.51</td>\n",
       "      <td>CAM DEL RIO WEST</td>\n",
       "      <td>I-5 SB OFF RA</td>\n",
       "      <td>HANCOCK ST</td>\n",
       "      <td>Fair</td>\n",
       "      <td>20141204</td>\n",
       "      <td>1038</td>\n",
       "      <td>CAMINO DEL RIO W</td>\n",
       "      <td>HANCOCK ST</td>\n",
       "      <td>0</td>\n",
       "      <td>A</td>\n",
       "      <td>4</td>\n",
       "      <td>-</td>\n",
       "      <td>-</td>\n",
       "      <td>A</td>\n",
       "      <td>A</td>\n",
       "      <td>H</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "      Unnamed: 0     oci            street     street_from          street_to  \\\n",
       "6368        6368   61.10   ENRICO FERMI DR      MARCONI DR  VIA DE LA AMISTAD   \n",
       "6369        6369   42.48   NORTH HARBOR DR  N HARBOR DR RA           SCOTT ST   \n",
       "6370        6370   58.41        OBERLIN DR     SCRANTON RD      YOUNGSTOWN WY   \n",
       "6371        6371  100.00           01ST AV        BEECH ST           CEDAR ST   \n",
       "6372        6372   61.51  CAM DEL RIO WEST   I-5 SB OFF RA         HANCOCK ST   \n",
       "\n",
       "     oci_desc  COLLISION_DATE  COLLISION_TIME        PRIMARY_RD  \\\n",
       "6368     Fair        20141217            1205   ENRICO FERMI DR   \n",
       "6369     Fair        20140307             520   NORTH HARBOR DR   \n",
       "6370     Fair        20140213            1310        OBERLIN DR   \n",
       "6371     Good        20141023            1311           01ST AV   \n",
       "6372     Fair        20141204            1038  CAMINO DEL RIO W   \n",
       "\n",
       "          SECONDARY_RD CHP_BEAT_TYPE WEATHER_1  COLLISION_SEVERITY  \\\n",
       "6368        MARCONI DR             0         A                   0   \n",
       "6369  HARBOR ISLAND DR             0         A                   4   \n",
       "6370       SCRANTON RD             0         A                   4   \n",
       "6371          CEDAR ST             0         A                   3   \n",
       "6372        HANCOCK ST             0         A                   4   \n",
       "\n",
       "     PRIMARY_COLL_FACTOR PCF_VIOL_CATEGORY LIGHTING ROAD_SURFACE ROAD_COND_1  \n",
       "6368                   A                08        A            A           H  \n",
       "6369                   A                08        B            -           H  \n",
       "6370                   A                12        A            A           H  \n",
       "6371                   A                -         A            A           H  \n",
       "6372                   -                -         A            A           H  "
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "DF.tail()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "A    5264\n",
       "B     948\n",
       "C      88\n",
       "-      37\n",
       "E      23\n",
       "F      13\n",
       "Name: WEATHER_1, dtype: int64"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "DF.WEATHER_1.value_counts()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "A    4229\n",
       "C    1696\n",
       "B     220\n",
       "D     170\n",
       "-      46\n",
       "E      12\n",
       "Name: LIGHTING, dtype: int64"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "DF.LIGHTING.value_counts()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "08    1344\n",
       "03    1170\n",
       "09    1068\n",
       "12     754\n",
       "04     355\n",
       "11     330\n",
       "10     289\n",
       "-      258\n",
       "21     212\n",
       "05     139\n",
       "00     116\n",
       "17     109\n",
       "18      72\n",
       "06      47\n",
       "07      37\n",
       "22      35\n",
       "01      19\n",
       "13      10\n",
       "15       3\n",
       "16       3\n",
       "14       2\n",
       "02       1\n",
       "Name: PCF_VIOL_CATEGORY, dtype: int64"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "DF.PCF_VIOL_CATEGORY.value_counts() "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "A    6098\n",
       "D     104\n",
       "C      72\n",
       "-      64\n",
       "B      35\n",
       "Name: PRIMARY_COLL_FACTOR, dtype: int64"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "DF.PRIMARY_COLL_FACTOR.value_counts() "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 82,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Fair    3291\n",
       "Good    1742\n",
       "Poor    1340\n",
       "Name: oci_desc, dtype: int64"
      ]
     },
     "execution_count": 82,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "DF.oci_desc.value_counts()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "## Section 3: Data Analysis"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAY8AAAEWCAYAAACe8xtsAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3Xu8VXWd//HXW4UO5DEiSCS5aSqnVCgPqQ2Cl8I0GyEb\nLjko5ahcfhaNMjJTztBlHjVRGhiX0CYMUyARMh+QGKhgkQiKqXOkVFAQSQwNEonEz++Ptc5xczyX\nvZB99t6H9/Px2I+z93fdPuusc/Z7f9daey1FBGZmZlkcUuwCzMys/Dg8zMwsM4eHmZll5vAwM7PM\nHB5mZpaZw8PMzDJzeJiZWWYOD2sxkjZK2iOpU732RyWFpJ6SJkpa0cC0ndJpT8xpOzOd7tpmlnum\npDcl/TXn8csDt2YHHyUmSPqjpNclPS/p25LeVW+8j0laLOlVSdslrZb0hXTYmZI2F2cN7J1yeFhL\n2wCMqH0h6SSgfc7wW4GPS+pVb7rhwOMR8URO26XAduCSPJa7JSIOz3l8pqGRJB2Wz0oYU4ErSH73\nlcB5wDnA/NoRJJ0OLAceAD4IvA8YA3yqpYu1A8/hYS1tDvu+2V8K/LT2RURsJnnDGVlvuktyx5P0\nbuBzwDjgOEnV+1OMpEmS7pB0q6QdwChJh6Q9oGck/VnSfEkdc6YZKem5dNhX0x7VJ9JhsyV9K2fc\nfT5dS+oqaYGkbZI2SPpSvVrmS/qppJ2SnsxdL0ndJN2ZTvtnST+U1Db9RH9Sznjvl7RLUud66/qu\ntAeQ23vrnPYc3p/27u7O6SWslPS29whJxwFjgYsjYlVEvBERTwIXAZ+SdHY66mTgloj4n4h4ORJr\nI2LYfmwqKzEOD2tpvwOOkFQl6VCSHsWt9ca5hZzwkHQC0Be4LWeczwJ/BX4O3EMSQvvrQuAOoAPw\nM+AqYDAwEOgKvAJMS2v5EDAjra8ryafpo/NZSPpG/EvgMeADJJ/Ux0s6N2e0fwTmprXcBfwwnfZQ\n4G7gOaBnOv3ciNiTjv/POfMYASyLiG25y4+IvwF3ktPzA4YCD0TES8DVwGagM3Ak8B9AQ9cvOgfY\nHBGr681/E8n2/aSk9sDpJL9Xa4UcHlYMtb2PTwI1wAv1hi8EjpT08fT1JcCSem+GlwLzImIvSagM\nl9SmiWV2TT9R1z6G5gxbFRGLIuLNiHgdGA18NSI2p2+4k4DPpbu0PgfcHREr0mHXAW/mud79gM4R\n8Y2I2BMRzwI3kQRorQcjYnG6XnOAPmn7x0jCakJEvBYRuyPiwXTYLcAISUpfj0ynbcht9Zb3ed4K\n5b8DRwE9IuLvEbEyGr74XSfgxUbm/2I6/L0k7y+NjWdlzuFhxTCH5E1rFDm7ompFxC6SHsUl6Rvi\nxey7y6obcBZJLwHgF0AF8OkmlrklIjrkPObnDNtUb9wewMLaoCEJuL0kn8a75o4fEa8Bf252jd+a\n7z4hRvLp/siccbbmPN8FVKSh1Q14LiLeqD/TiHgoHfdMSb1Jji/c1UgN9wHtJZ0qqSdJj25hOmwy\n8DSwVNKzkiY2Mo+XSUKmIUelw18hCdXGxrMy5/CwFhcRz5EcOD+fZDdKQ24h2aXySZIDsrlnR40k\n+dv9paStwLMk4bG/u67qf7reBJxXL2wqIuIFkk/S3WpHTHfPvC9n2tfY9wSALvXmu6HefCsj4vw8\natwEdG/igP4tJLuuRgJ3RMTuBlc06dHMJ9l1NYKkF7UzHbYzIq6OiGNIdp/9q6RzGpjNcqCbpI/l\nNqahfhrJLrNdwCqS4yDWCjk8rFguA85OP7k3ZCXwKjCLt/bt17oU+DrJp+bax0XA+ZLeV39G+2Em\n8N+SekDdQeUL02F3ABdI6i+pLfAN9v0/WpfW0VFSF2B8zrDVwE5J10pqJ+lQSSdK6pdHTatJgus7\nkt4tqULSP+QMvxUYQhIgb+vN1XMbMIykR1d3HEnSBZI+mPb2/kLS23rbLrmI+APJ7+hnkk5L1+PD\nwALg1xHx63TUfyM5AWFC7XaR1EfS3DzW10qcw8OKIiKeiYg1TQwPkjfBHuy7y+q0tG1aRGzNedxF\nsstlRIMzzGYKyW6fpZJ2khwEPjWt60mSM7xuI3kzf4XkIHOtOSQHxDcCS4F5Oeu0F7iAJOw2kOze\nuRl4T3MFpdN+hmSX1PPpMoflDN8EPELSi1rZzLweIukhdQWW5Aw6Dvg1yYkIq4DpEXFfI7P5f2nt\nt6bj/wq4n5yeRkT8Fjg7fTwraTvJh4HFza2vlT75ZlBm74ykjcC/5HziLlYd/0tybOdrxazDDg7+\nQpRZK5Ae/P4s8JHiVmIHC++2Mitzkr4JPAFMjogNxa7HDg7ebWVmZpm552FmZpm12mMenTp1ip49\nexa7DDOzsrJ27dqXI6Jzc+O12vDo2bMna9Y0eiaomZk1QNJz+Yzn3VZmZpaZw8PMzDJzeJiZWWYO\nDzMzy8zhYWZmmTk8zMwsM4eHmZll5vAwM7PMHB5mZpaZw8PMzDJzeJiZWWYODzMzy8zhYWZmmTk8\nzMwsM4eHmZll5vAwM7PMWu3NoNjyKJMmTWLmwMFMmPk1Zp//HDtrvsOPB32J8Zvas637HK6bt52z\n7x/HWTNu57p52xnXZQjLBnTiqfk3cWGHNuxcdAXnDf4eAKMqHmbY3HlUDp7F0RUXMG3rQnoPvZwT\nls6m+txK1tyzk5srljF7dz8e5AjOqxrLzprvMKriYSZxA5t3301/dvAgR1B9biVbHxhYN4/xm9qz\npGY651WNZfSqKWzrsoJJ3ADA92vO4OqqlXXT/3jQlzhnxcssG9Cpbj0q7nmByqqJXLThImYOHMya\ne3ayftAoLtYCJsz8Gjf2GgNAZdVEtnWfw31jRrBl+h7Gb2rP6FVT6D30crqObcviPsdy/mPPsGX6\nHrqObctZM26n8/MjGb1qCrtfuZ4be42hsmoiAD/otguAc1a8TM3crmyZvod1P6ri6qqVdBn4AKMf\nWMQkbmDZgE5ctnQqE15tx7guQzipV3dGr5rCN4d1LMhmv2/MCKqGb6n7fW38zqcLshyzg517HmZm\nlpnDw8zMMnN4mJlZZg4PMzPLzOFhZmaZOTzMzCwzh4eZmWXm8DAzs8wcHmZmlpnDw8zMMnN4mJlZ\nZg4PMzPLzOFhZmaZOTzMzCyzFrsku6S9wOPpMmuASyNiV0st38zMDpyW7Hm8HhF9I+JEYA8w+p3M\nTAn3nMzMiqBYb74rgQ8CSPpXSU+kj/G1IzTULqmnpPWSfgo8AXQrSvVmZge5Fr+ToKTDgPOAX0k6\nBfgCcCog4CFJD5CEWkPtrwDHkezy+l1L125mZomW7Hm0k7QOWAM8D/wY6A8sjIjXIuKvwJ3AGU20\nAzzXWHBIukLSGklrtu2KQq+PmdlBqyV7Hq9HRN/cBkn7M5/XGhsQEbOAWQDVXQ91epiZFUixDziv\nBAZLai/p3cCQtK2xdjMzKwEtfswjV0Q8Imk2sDptujkiHgVoqF1Sz5au0czM3q7FwiMiDm+k/Xrg\n+nzaI2IjcGIh6jMzs/wVe7eVmZmVIYeHmZll5vAwM7PMHB5mZpaZw8PMzDJzeJiZWWYODzMzy8zh\nYWZmmTk8zMwsM4eHmZll5vAwM7PMHB5mZpaZw8PMzDJTROu8Z1J1dXWsWbOm2GWYmZUVSWsjorq5\n8dzzMDOzzBweZmaWmcPDzMwyc3iYmVlmDg8zM8vM4WFmZpk5PMzMLDOHh5mZZebwMDOzzBweZmaW\nmcPDzMwyc3iYmVlmDg8zM8vM4WFmZpk5PMzMLDOHh5mZZebwMDOzzA5rbgRJxwMTgB6540fE2QWs\ny8zMSliz4QH8HJgJ3ATsLWw5ZmZWDvIJjzciYkbBKzEzs7KRzzGPX0oaK+koSR1rHwWvzMzMSlY+\nPY9L058TctoCOObAl2NmZuWg2fCIiF4tUYiZmZWPfM62agOMAQakTfcDP4qIvxewLjMzK2H57Laa\nAbQBpqevR6Zt/1KooszMrLTlEx79IqJPzuvlkh4rVEFmZlb68jnbaq+kY2tfSDoGf9/DzOyglk/P\nYwJwn6RnAZF80/wLBa3KzMxKWj5nWy2TdBxwQtq0PiL+VtiyzMyslDUaHpLOjojlkj5bb9AHJRER\ndxa4NjMzK1FN9TwGAsuBzzQwLACHh5nZQarR8IiI/0qffiMiNuQOk+QvDpqZHcTyOdtqQQNtdxzo\nQszMrHw0dcyjN/Bh4D31jnscAVQUujAzMytdTR3zOAG4AOjAvsc9dgKXF7IoMzMrbYqIpkeQTo+I\nVS1UzwHTrWOHWHXFL9m56Aq2TN/DU/NvYnKH17lqwwz6XlnDZUunMuHVdsw8/cts6z6H6+ZtB6D3\n0MvpOrYt84YPo/PWAYzrMoTv15zB5NHfAuC6edvpPfRy1v2oismjv8WEmV/j/MeeYXGfY9lZVc0k\nbmDz7rvZuegKKgfPYueiK1jc51hu7DWGCa+2q5tf3ytrOGfFy5zUqzs/6LaL8Zvas6RmOjdXLGNB\nrwUsqZnO+kGjeGr+Tcw8/cuMXjWFyR1eZ1TFw8wcOJjOz49kZ813eJAjqD63ks7Pj2TU4h70vbKG\nrmPbsrjPsfS9soZ1P6qqW/a2LiuYOXAwFfe8wJJF19SNU7vs6nMrmTDza8w+/zl+0G0X56x4mUl8\nhdm7+7Fk0TXMGz6MMwbMoevYtlQOnkX1uZVsfWAgJ/XqzqjFPZg8+ltcN287F3ZoQ392UFk1EYCd\nNd+pm7523Y6uuICTenVn9KopjOsyZJ/lVA6eBcD6QaPqltWfHXU1X121ku/XnMGNvcbssx6XLZ0K\nwJJF17D8zGlc2KFN3e+m9ve3seLzRfhrbMSkvxS7ArO3kbQ2IqqbGy+fYx5/kvRLSdskvSTpF+m3\nzM3M7CCVT3jcBswHjgK6ktyW9vZCFmVmZqUtn/BoHxFzIuKN9HErPmBuZnZQy+faVkskTQTmknw5\ncBiwuPZWtBGxvYD1mZlZCconPIamP6+s1z4c347WzOyg5NvQmplZZvtzYUQAXxjRzOwg5gsjmplZ\nZk1eGFHSIcCSiJjfgjWZmVmJa/JU3Yh4E/i3FqrFzMzKRD7f8/i1pGskdZPUsfZR8MrMzKxk5XOq\n7rD057icNp+ia2Z2EPOpumZmllmzu60kjZPUIef1eyWNLWxZZmZWyvI55nF5RLxa+yIiXiHP+3lI\nOlLSbZKelbRW0ipJQ/a32Jz53i+p2UsGm5lZYeQTHodKUu0LSYcCbZubKJ1mEbAiIo6JiFNILmly\n9P4Wa2ZmpSGf8PgVME/SOZLOIbkc+6/ymO5sYE9EzKxtiIjnIuJGSRWSfiLpcUmPSjoLoIn2dpLm\nSqqRtBBol3lNzczsgMnnbKtrgSuAMenre4Gb85juw8AjjQwbB0REnJTeK32ppOObaB8D7IqIKkkn\nNzZfSVektfLe9s4XM7NCyedsqzeBmcDM9PsdR0fE3qwLkjQN6A/sATYDN6bzf0rSc8Dx6fCG2gcA\nU9P230v6fSO1zgJmQXIb2qw1mplZfvI52+p+SUekwbEWuEnSDXnM+0ngo7UvImIccA7QeX+LNTOz\n0pDPMY/3RMQO4LPATyPiVJIQaM5yoELSmJy29unPlcDFAOluqe7A+ibaVwCfT9tPBE7OY/lmZlYg\n+YTHYZKOIrkp1N35zjgiAhgMDJS0QdJq4BaSYyjTgUMkPQ7MA0ZFxN+aaJ8BHC6pBvgGSQ/IzMyK\nJJ8D5t8A7gF+ExEPSzoG+GM+M4+IF0lOz23IFxoYf3cj7a83MR8zM2th+Rww/znw85zXzwIXFbIo\nMzMrbfkcMD9e0jJJT6SvT5b0tcKXZmZmpSqfYx43Af8O/B2SU2XxLiQzs4NaPuHRPiJW12t7oxDF\nmJlZecgnPF6WdCzJPTyQ9DngxYJWZWZmJS2fs63GkXxru7ekF4ANpN/FMDOzg1M+Z1s9C3xC0ruB\nQyJiZ+HLMjOzUtZkeEg6geRCg73TphpJsyLiDwWvzMzMSlajxzwknQ7cD+wk2W11E/AacL+k01qk\nOjMzK0lN9Tz+ExgREffntC2StBz4L+C8QhZmZmalq6mzrY6tFxwARMQDwDEFq8jMzEpeU+HR1IHx\n1w50IWZmVj6UXPy2gQHSS8DchgYBQyPiyEIW9k5VV1fHmjVril2GmVlZkbQ2IqqbG6+pYx4Tmhjm\nd2Uzs4NYo+EREbe0ZCFmZlY+8rk8iZmZ2T4cHmZmlpnDw8zMMmv0mIekG0mvpNuQiPhSQSoyM7OS\n19TZVj6jyszMGtRUeMwDKiNiW26jpM40/QVCMzNr5Zo65jEVOKOB9v7ADYUpx8zMykFT4XFKRNxZ\nvzEiFgIDCleSmZmVuqbCo/1+TmdmZq1cUyHwkqSP1W+U1A/Y1sD4ZmZ2kGju2lbzJc0G1qZt1cAl\nwPAC12VmZiWs0Z5HRKwGTiW5iu6o9CHg1Ih4qCWKMzOz0tTkPcwj4k+Svg18MG16OiJ2F74sMzMr\nZU3dw/wwSd8FNgG3AD8FNkn6rqQ2LVWgmZmVnqYOmE8GOgLHRMQpEfFR4FigA/C9lijOzMxKU1Ph\ncQFweUTUfZs8InYAY4DzC12YmZmVrqbCI6KBe9RGxF6auGCimZm1fk2Fx/9JuqR+o6R/Bp4qXElm\nZlbqmjrbahxwp6Qvsu/3PNoBQwpdmJmZla6m7mH+AnCqpLOBD6fNiyNiWYtUZmZmJavJ73kARMRy\nYHkL1GJmZmXCFzg0M7PMHB5mZpaZw8PMzDJzeJiZWWYODzMzy8zhYWZmmTk8zMwsM4eHmZll5vAw\nM7PMHB5mZpaZw8PMzDJzeJiZWWbNXhixXL303E42T1zJ+kGjeGr+TfQeejnjN7Vn/rffYHGfY+l7\nZQ3nrHiZzbvvZv2gUYzf1J6LNlzEzIGD6fz8SOZ/+w3mDR/GJG6om+e0rQu5sEMb1g8aRdexbQFY\nfuY0AL45rCMV97zAkkXXsLjPsUwe/S22PjCQaVsX1g2/b8wIFvc5lmG9ruXoiguYtnXhPu2105zU\nq3tdnTurqjljwBy6jm27T90n9erOkprp9GcHD3IER1dcwPdrzuDqqpWc1Ks7P+i2i8uWTmXCq+3q\n1v2iDRcxe3e/uvWpHXbOipfr1m9clyFM27qQbV1WMIkbmLZ1Ib2HXs7FWsB9Y0ZQOXgW51WNZdTi\nHnXz6XtlDRdrARX3vEBl1URGLe7BsF7X0p8dXLVhRt04ly2dypJF13DWjNsLu/Ez6Pz8SEavmsK2\nLitY0GvB29Zr/Kb2+6zPxorPM4mvMHt3P5YsugaAecOHMXt3P67aMKPud3HfmBF17RNebcfM07/M\nRRsuqtuWW6bv4bKlU6msmrhPPaNXTanbBhd2aEP1uZV1v3eAoysuoGZuV86acTv3jRnB8jOnsa3L\nirq/21GLe9T9jdTM7cqW6Xu4WAu4bt52tnVZwRkD5gAwflN7Rq+awu5Xrmfy6G/V/R4asvuV6wG4\numolywZ04mItYOsDA+ky8AE6Pz+SH3TbVTfP3P+h0aum8M1hHev+D2r/R67aMIOrq1YybetCdr9y\nPTurqlnQa0Hd32dl1cS31VL7O6md3+bdd3NzxTKGzZ3Hlul76Dq2LcvPnMY3h3Xkunnb+eawjnR+\nfiTbus+h8/Mj6/5XarfRZUun8iBHsH7QqLrfVa7a33f1uZVsfWAgk/hK3XrV+kG3XXW/29zlXTdv\nO7tfub5uO3y/5gz6XlnDU/NvyvbHmUHvoZfXzX/czLMLtpxc7nmYmVlmDg8zM8vM4WFmZpk5PMzM\nLDOHh5mZZebwMDOzzBweZmaWmcPDzMwyc3iYmVlmDg8zM8vM4WFmZpk5PMzMLDOHh5mZZebwMDOz\nzIoSHpL2SlqX8+jZxLhdJd3RctWZmVlzinU/j9cjom8+I0bEFuBz9dslHRYRbxzwyszMrFkls9tK\nUk9JKyU9kj4+ntP+RPp8lKS7JC0HlhW1YDOzg1ixeh7tJK1Ln2+IiCHAS8AnI2K3pOOA24HqBqb9\nKHByRGxvoVrNzKyeUtpt1Qb4oaS+wF7g+Eamvbex4JB0BXAFwHsPf/+BqtXMzOoppXuYfwX4E9CH\nZHfa7kbGe62xGUTELGAWQPfOJ8SBLtDMzBIlc8wDeA/wYkS8CYwEDi1yPWZm1ohSCo/pwKWSHgN6\n00QPw8zMiqsou60i4vAG2v4InJzTdG3avhE4MX0+G5hd8ALNzKxJpdTzMDOzMuHwMDOzzBweZmaW\nmcPDzMwyc3iYmVlmDg8zM8vM4WFmZpk5PMzMLDOHh5mZZebwMDOzzBweZmaWmcPDzMwyc3iYmVlm\nimid90yqrq6ONWvWFLsMM7OyImltRDR0C/B9uOdhZmaZOTzMzCwzh4eZmWXm8DAzs8wcHmZmlpnD\nw8zMMnN4mJlZZg4PMzPLzOFhZmaZOTzMzCwzh4eZmWXm8DAzs8wcHmZmlpnDw8zMMnN4mJlZZg4P\nMzPLzOFhZmaZtdo7CUraCawvdh3vUCfg5WIX8Q6Ue/1Q/utQ7vVD+a9DudXfIyI6NzfSYS1RSZGs\nz+dWiqVM0ppyXodyrx/Kfx3KvX4o/3Uo9/ob491WZmaWmcPDzMwya83hMavYBRwA5b4O5V4/lP86\nlHv9UP7rUO71N6jVHjA3M7PCac09DzMzKxCHh5mZZdYqw0PSpyStl/S0pInFrqcxkjZKelzSOklr\n0raOku6V9Mf053tzxv/3dJ3WSzq3SDX/r6SXJD2R05a5ZkmnpOv+tKSpklTE+idJeiHdDusknV/C\n9XeTdJ+k/5P0pKQvp+3ltA0aW4ey2A6SKiStlvRYWv/X0/ay2QYHRES0qgdwKPAMcAzQFngM+FCx\n62qk1o1Ap3pt3wUmps8nAv+TPv9Qui7vAnql63hoEWoeAHwUeOKd1AysBk4DBCwBziti/ZOAaxoY\ntxTrPwr4aPq8EvhDWmc5bYPG1qEstkO6rMPT522Ah9IaymYbHIhHa+x5fAx4OiKejYg9wFzgwiLX\nlMWFwC3p81uAwTntcyPibxGxAXiaZF1bVESsALbXa85Us6SjgCMi4neR/Af9NGeagmqk/saUYv0v\nRsQj6fOdQA3wAcprGzS2Do0pqXWIxF/Tl23SR1BG2+BAaI3h8QFgU87rzTT9h1lMAfxa0lpJV6Rt\nR0bEi+nzrcCR6fNSXq+sNX8gfV6/vZiukvT7dLdW7e6Gkq5fUk/gIySffMtyG9RbByiT7SDpUEnr\ngJeAeyOibLfB/mqN4VFO+kdEX+A8YJykAbkD008jZXUudTnWDMwg2c3ZF3gR+H5xy2mepMOBBcD4\niNiRO6xctkED61A22yEi9qb/u0eT9CJOrDe8LLbBO9Eaw+MFoFvO66PTtpITES+kP18CFpLshvpT\n2p0l/flSOnopr1fWml9In9dvL4qI+FP6ZvAmcBNv7Q4syfoltSF50/1ZRNyZNpfVNmhoHcptOwBE\nxKvAfcCnKLNt8E61xvB4GDhOUi9JbYHhwF1FrultJL1bUmXtc2AQ8ARJrZemo10K/CJ9fhcwXNK7\nJPUCjiM52FYKMtWcdu13SDotPbvkkpxpWlztP3xqCMl2gBKsP13ej4GaiLg+Z1DZbIPG1qFctoOk\nzpI6pM/bAZ8EnqKMtsEBUewj9oV4AOeTnMHxDPDVYtfTSI3HkJyB8RjwZG2dwPuAZcAfgV8DHXOm\n+Wq6Tusp0lkZwO0kuxT+TrKP9rL9qRmoJnlzeAb4IenVDopU/xzgceD3JP/oR5Vw/f1Jdof8HliX\nPs4vs23Q2DqUxXYATgYeTet8AvjPtL1stsGBePjyJGZmlllr3G1lZmYF5vAwM7PMHB5mZpaZw8PM\nzDJzeJiZWWYODys7kvbmXHl1XXqJi1ZP0u3ppTu+Uq99kqSQ9MGctvFpW7Wkn0i6st40gyUtqfc6\nJPXOaesp6f4CrpKVMYeHlaPXI6JvzmNj7kBJhxWproKR1AXoFxEnR8QNDYzyOMkXYmv9E8n3hyD5\nbsvweuMPT9trjQAeTH+aNcvhYa2CpFGS7pK0nOSLWkiaIOnh9NP613PG/aqkP0h6MP00f03afr+k\n6vR5J0kb0+eHSpqcM68r0/Yz02nukPSUpJ/V3o9BUj9Jv1Vyz4fVkiolrZDUN6eOByX1qbceFWlP\n4XFJj0o6Kx20FPhA2tM6o4FfwSLSq0dLOhb4C/ByOmwZ0Dvn0hnvBj6RTlN7jan+JF+YzA2ZvaRX\nIJb04XQ91qW/g+Py3DTWSrW6T2h2UGin5IqmABsiYkj6/KPAyRGxXdIgkstAfIzkXgl3Kbnw5Gsk\nb5B9Sf7+HwHWNrO8y4C/REQ/Se8CfiNpaTrsI8CHgS3Ab4B/kLQamAcMi4iHJR0BvE5ySY5RwHhJ\nxwMVEfFYvWWNI7mu3knpLqSl6bj/CNwdycX4GrID2KTkAn0Xpsv/AsnM9kpaAAwFpgCfAe6Pty6o\neCHwq4j4g6Q/SzolItZGxCbgs+k4o4EpEfEzJZf9ObSZ35m1cu55WDnK3W01JKf93oiovVfHoPTx\nKElA9CYJkzOAhRGxK33zzOe6Z4OAS9LAeojkMhS1n7xXR8TmSC7mtw7oCZwAvBgRDwNExI6IeAP4\nOXCBkosCfhGY3cCy+gO3ptM9BTwHHJ9HjZDcu2Y4yT0hFtYblrvrqqFdVnNz5tHQrqtVwH9Iuhbo\nERGv51mTtVLueVhr8lrOcwHfjogf5Y4gaXwT07/BWx+oKurN66qIuKfevM4E/pbTtJcm/qciYpek\ne0k+6Q8FTmmilv1xNzAZWBMRO7TvHU1/CxyV7ib7OGmQSOoInA2cJClIehQhaULkXLsoIm6T9BDw\naWCxpCsjYvkBrt/KiHse1lrdA3wx3Z+PpA9Iej+wAhgsqZ2Sqxp/Jmeajbz1hv65evMak/YYkHR8\netygMetJ3qj7peNX5hzEvxmYCjwcEa80MO1K4OLa5QDd0/k1KyJ2AdcC/93AsCDZlXULsCQidues\n55yI6BERPSOiG7CBpIdWR9IxwLMRMZXkyq8n51OTtV4OD2uVImIpcBuwStLjwB1AZSS3P51HcjXj\nJSSX8K8tnEGBAAAAsElEQVT1PZKQeBTolNN+M/B/wCOSngB+RNM9jD3AMOBGSY8B95L2ZCJiLcnx\niZ80Mvl04JC05nnAqIj4WyPjNrTsuek6NuR2oA9v32VVfxfXAt6+62oo8ES66+5Eklum2kHMV9W1\ng5qkScBfI+J7LbS8rsD9QO/0OIlZWXLPw6yFSLqE5ID7Vx0cVu7c8zAzs8zc8zAzs8wcHmZmlpnD\nw8zMMnN4mJlZZg4PMzPL7P8DnSV0o5mnO6wAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x10eef2630>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# First visualization of data\n",
    "pd.crosstab(DF.oci_desc, DF.oci).plot.barh(title = \"MVA Frequency vs OCI\", stacked = True)\n",
    "plt.xlabel(\"Frequency of MVA's\")\n",
    "plt.ylabel(\"OCI Description\")\n",
    "plt.legend().set_visible(False)\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Out of:  6373 accidents\n",
      "27.334065589204453 51.6397301114075 21.026204299388045\n"
     ]
    }
   ],
   "source": [
    "totals = len(DF.oci) # Get the dataframe\n",
    "\n",
    "# Get the proportions\n",
    "good_pro = 100 * (len(DF.loc[DF['oci_desc'] == 'Good']) / totals)\n",
    "fair_pro = 100 * (len(DF.loc[DF['oci_desc'] == 'Fair']) / totals)\n",
    "poor_pro = 100 * (len(DF.loc[DF['oci_desc'] == 'Poor']) / totals)\n",
    "\n",
    "# Reporting\n",
    "print(\"Out of: \", totals, \"accidents\")\n",
    "print(good_pro, fair_pro, poor_pro)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Observation 1\n",
    "We first try to find evidence of any correlation between road conditions and possible motor vehicle accidents. In our hypothesis, we argued that there should be a strong correlation from the get go. To visualize this, we plotted the frequency of accidents that occured in each of the category description of OCI. \n",
    "\n",
    "The legend reflects the different OCIs and is ordered from least to greatest with the exception of 100. We can thus see each individual OCI adds up to the total amount of collisions in a single category. \n",
    "\n",
    "There is immediately a huge disparity in the frequency of MVAs when comparing the OCI Descriptions. We see that the amount of fair road accidents eclipse both good and fair accidents. This means that a huge proportion of accidents in our dataset must have occurred on \"fair\" quality roads. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Observation 2\n",
    "It turns out that of all the motor vehicle accidents in our dataset, about half of the MVAs occurred on streets with \"fair\" OCI rating. Furthermore, the amount of MVAs for \"good\" and \"poor\" rated streets are around the same proportions. This directly provides evidence to the contrary of our hypothesis and raises the question \"Do street conditions even play a role in the causation of MVAs?\" \n",
    "\n",
    "This leads us to believe that there must be other factors worth looking into that can explain the causation of these motor vehicle accidents rather than street conditions."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAXwAAACTCAYAAACNgqIpAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAE8pJREFUeJzt3X2UHFWZx/HvjwDhnZAEUQhkAAFXMYsmAmJQxFWjGxUU\nWXJQEHGjHhaDqLtkfQH0KLpyWN/2LIIir4Ki8uLLRiMhgCdAmIG8IlFJQIloACEhiIDh2T/ubVJp\nZrprZroyM92/zzl9pupW1e3ndjq3q29XPVcRgZmZtb8thjoAMzPbPNzhm5l1CHf4ZmYdwh2+mVmH\ncIdvZtYh3OGbmXUId/hmZh3CHb6ZWYdwh29m1iG2HOoAisaPHx9dXV1DHYaZ2YjS09PzcETs2my/\nYdXhd3V10d3dPdRhmJmNKJLuL7Ofh3TMzDqEO3wzsw4xvDr8np6hjsDMrG01HcOXNBp4F9BV3D8i\nPlvi2A3A0kLRURFxX7+jNDOzQSvzo+11wFqgB3iqn/U/GREH9TsqMzNruTId/oSImFZ5JGZmVqky\nY/gLJL18gPVvK2lRflzT2w6SZkrqltT90ACfxMzMmlOzKQ4l3Q28GFhFGtIREBExqWnl0vqI2KFs\nMFOk6PaUi2Zm/SKpJyKmNNuvzJDOW1oQj5mZDbGmQzoRcT8wBnhbfozJZWZmNoI07fAlzQKuAF6Q\nH5dLOrWSaCZPrqRaMzMrN6RzMnBIRDwBIOlLwK3A15sd2J/xezMzq1aZq3QEbCisb8hlZmY2gpQ5\nw/8OcHvhssqjgG9XF5KZmVWhaYcfEedJmg9MzUUnRcRdlUZlZmYt12eHL2mniFgnaSxwX37Uto2N\niL9UH56ZmbVKozP87wLTSTl0indDKa/vU2FcZmbWYn12+BExPf/de/OFY2ZmVSlzHf4NZcrMzGx4\nazSGvw2wHTBe0i5svBRzJ2CPMpX3kg//qoj4Yp8HeAIUM7PKNBrD/yBwGrA7cGehfB3wjZL1Ox++\nmdkw0WgM/6vAVyWdGhFN76o1M7PhrdGQzpERMQ9YLemd9dsj4kcl6t9W0qLC+jkR8b0BxGlmZoPU\naEjndcA8UobMegGU6fCbDulImgnMBNirRIVmZjYwTSdAGVTlngDFzKxyg54ARdLpjQ6MiPMGEpiZ\nmQ2NRkM6O+a/BwCvAq7P628DFpasv34Mf05EnNG/EM3MrBUaXaVzNoCkm4FXRsTjef0s4KdlKo+I\nUf2KxhOgmJlVpkw+/N2ApwvrT+cyMzMbQcrkw78UWFiXD/+S6kIyM7MqlMmH/3lJc3A+fDOzEa3M\nGT7AIuDB2v6S9oqI31cWlZmZtVzTDl/SqcCZwJ/ZOJ9tAJOqDc3MzFqpzBn+LOCAiHik6mDMzKw6\nZa7S+QOwtupAzMysWmXO8FcC8yX9FHiqVljJnbY9PSCB0yuYmbVcmQ7/9/mxdX6YmdkIVOayzNod\ntzvk9fVVB2VmZq1XZk7bAyXdBSwHlkvqkfSy6kMzM7NWKvOj7QXA6RExMSImAh8DLmxVAJJmSuqW\n1P1Qqyo1M7PnKdPhbx8RN9ZWImI+sH2rAoiICyJiSkRM2bVVlZqZ2fOU6fBXSvq0pK78+BTpyp3S\nJJ0iaVF+7D6wUM3MbDCaznglaRfgbFIunQBuAc6OiEdbHcwUKbrBl2WamfVDK2a82gbYMSIeAj5S\nKH8B8GRLoqw3eTJ0d1dStZlZp2s0pPM14PBeyl8D/Hc14ZiZWVUadfiTI+JH9YURcQ3w2upCMjOz\nKjTq8Lcb4HFmZjYMNeq410g6uL5Q0qsAXzJvZjbCNEqt8Ang+5IuBnpy2RTgBOC4iuMyM7MW6/MM\nPyIWAgeTJjx5X34IOCQibt8cwZmZWes0TJ4WEWtIs12ZmdkIV3ZO282jlg+/yDdhmZm1RKVX20h6\noaSrJN2bs2z+TNL+VT6nmZn1rmGHL2mUpHMHUrEkAdcA8yNi34iYDMwGdhtIfWZmNjjNxvA3SJo6\nwLpfDzwTEecX6ls8wLrMzGyQyozh3yXpeuBq4IlaYW934dY5kI2Xc5qZ2RAr0+FvAzwCHFkoC6BZ\nh1+KpJnATIC9WlGhmZn1qml65AFXLL0BODMiSufdeS49cpGv0jEza6hseuQyc9ruL+kGScvy+qQ8\nCUoz84DR+Qy+VtckSb1l4DQzs4qVuSzzQtLVNc8ARMQSSqRWiPTV4Wjgn/JlmcuBc4A/DTxcMzMb\nqDJj+NtFxEJtekPU38tUHhF/BI4tHY0nQDEzq0yZM/yHJe1L+qEWSccAD1YalZmZtVyZM/xTgAuA\nl0haDawC3lNpVGZm1nJNO/yIWEkah98e2CIiHq8+LDMza7WmHb6k0cC7gC5gy9pYfkR8ttLIzMys\npcoM6VwHrCXdNftUteGYmVlVynT4EyJiWuWRmJlZpcpcpbNA0ssrj8TMzCrV5xm+pKWkSzG3BE6S\ntJI0pCPSfVWTWh5NbxOgtBunijCzIdJoSGf6YCqWtAFYSvqA2AD8W0QsGEydZmY2cH12+BFxP4Ck\nyyLivcVtki4D3tvrgRs9GREH5f3fTEqr8LrBhWtmZgNVZgz/ZcUVSaOAyf18np2AR/t5jJmZtVCj\nMfzZwH8C20paVysGnibdedvMtpIWkfLpv4hN8+kXn8f58M3MNoOm+fAlnRMRs/tdsbQ+InbIy68G\nvgUcGA2esNd8+O3GP9qaWYuVzYdfJrXCbEm7APuRztZr5TeXDSYibpU0HtgVWFP2ODMza50yqRU+\nAMwCJgCLgEOBW+ljiKaPOl4CjCJNlWhmZkOgzJ22s4BXAbdFxOtz5/2FEsfVxvAhjf2fGBEbGh7h\nfPhmZpUp0+H/LSL+JglJoyPiHkkHNDsoIka1ID4zM2uRMh3+A5LGANcCcyU9CtxfbVhmZtZqZX60\nPTovniXpRmBnYE6lUZmZWcuVOcNH0lRgv4j4jqRdgT1IM1+ZmdkI0fROW0lnAv8B1K7F3wq4vMqg\nzMys9cqkVjgaeDvwBEBE/BHYscqgzMys9cp0+E/nu2MDIM9ta2ZmI0yZMfzvS/omMEbSvwLvBy6s\nJJpOyIdvZlZvM6VcKXOVzrmS3gisAw4APhMRc8tULuko4BrgHyLinkFFamZmg9IoW+ZpwALgztzB\nl+rk68wAfpX/njmgCM3MrCUajeFPAL4CrJF0k6QvSJouaWyZiiXtAEwFTgaOG3yoZmY2GH12+BHx\n8Yg4DHgh6ZLMvwAnAcsk3V2i7ncAcyLiN8Ajkvo7aYqZmbVQmat0tiXNWLVzfvwRuL3EcTOAq/Ly\nVXn9eSTNlNQtqfuhEpWamdnA9DkBiqQLSNMbPk7q4G8jZcxsOlVhHvZ5AHiIdDnnqPx3YsdPgGJm\nVm+QV+mUnQCl0Rn+XsBo4E/AalIH/ljJ5z8GuCwiJkZEV0TsSUrFcHjJ483MrMUajeFPI+XBPzcX\nfQy4Q9IvJJ3dpN4ZpMsxi35IH8M6ZmZWvaZz2gJImgC8BjgMmA6Mi4gxrQ5mypQp0e0JUMzM+mXQ\nc9pK+gipgz8MeIZ0Tf4C4CJgaYviNDOzzaTRnbZdwNXARyPiwc0TjpmZVaXPDj8iTt+cgZiZWbVK\njeFvLpIeB1YMdRyb2Xjg4aEOYjPqtPZC57W509oLQ9/miRGxa7OdSs14tRmtKPPDQzuR1N1Jbe60\n9kLntbnT2gsjp81l7rQ1M7M24A7fzKxDDLcO/4KhDmAIdFqbO6290Hlt7rT2wghp87D60dbMzKoz\n3M7wzcysIu7wzcw6xLDp8CVNk7RC0u8knTHU8QyUpIskrZG0rFA2VtJcSb/Nf3cpbJud27xC0psL\n5ZMlLc3bviYNz9ndJe0p6UZJd0taLmlWLm/nNm8jaaGkxbnNZ+fytm0zgKRRku6S9JO83u7tvS/H\nukhSdy4b2W2OiCF/kPLl3wvsA2wNLAZeOtRxDbAtrwVeCSwrlP0XcEZePgP4Ul5+aW7raGDv/BqM\nytsWAocCAv4PeMtQt62P9r4IeGVe3hH4TW5XO7dZwA55eSvSfBGHtnObc6ynA98FftLu7+sc633A\n+LqyEd3m4XKGfzDwu4hYGRFPk2bIescQxzQgEXEzaTrIoncAl+TlS4CjCuVXRcRTEbEK+B1wsKQX\nATtFxG2R3jGXFo4ZViLiwYi4My8/Dvwa2IP2bnNExPq8ulV+BG3c5pwx95+BbxWK27a9DYzoNg+X\nDn8P4A+F9QdyWbvYLTYmoPsTsFte7qvde+Tl+vJhTVIX8ArSGW9btzkPbywC1gBzI6Ld2/wV4N+B\nZwtl7dxeSB/iv5TUI2lmLhvRbR5uqRXaXkSEpLa7FlbSDqRJbk6LiHXFYcp2bHNEbAAOkjQGuEbS\ngXXb26bNkqYDayKiR9IRve3TTu0tmBoRqyW9AJgr6Z7ixpHY5uFyhr8a2LOwPiGXtYs/56925L9r\ncnlf7V6dl+vLhyVJW5E6+ysi4ke5uK3bXBMRjwE3AtNo3za/Bni7pPtIw61HSrqc9m0vABGxOv9d\nQ5rB72BGeJuHS4d/B7CfpL0lbQ0cB1w/xDG10vXAiXn5ROC6QvlxkkZL2hvYD1iYvzKuk3Ro/kX/\nhMIxw0qO79vAryPivMKmdm7zrvnMHknbAm8E7qFN2xwRsyNiQkR0kf5vzouI99Cm7QWQtL2kHWvL\nwJuAZYz0Ng/Vr8X1D+CtpCs87gU+OdTxDKIdVwIPkmYJewA4GRgH3AD8FvglMLaw/ydzm1dQ+PUe\nmEJ6g90LfIN8V/RwewBTSWOdS4BF+fHWNm/zJOCu3OZlwGdyedu2uRDvEWy8Sqdt20u6YnBxfiyv\n9Ukjvc1OrWBm1iGGy5COmZlVzB2+mVmHcIdvZtYh3OGbmXUId/hmZh3CHX4bknSUpJD0kiGO4zRJ\n2/XzmMOVMlAuyte4F7dFvuGntr6lpIdq2Rsb1HmEpMP6F/0mx28n6RFJO9WVXyvpXxoc9z5J3+hj\n289q1/L3sf0sSR8fQKzXSrqtv8cVjv+QpBN6Ke9SIQPsAOrt93vBWs8dfnuaAfwq/x1KpwH9/U9+\nPHBORBwUEU/WbXsCOLDwQfBGyt21eATQrw5f0nNpRyLir8DPgaML23cm3YPw4/7UW6jzrZHu0m2Z\n/AEyGdhZ0j4DjOv8iLi0lXFlA3kvWIu5w28zOafNVNINX8cVyo+QdJOk6yStlPRFSccr5XVfKmnf\nvF+XpHmSlki6QdJeufxiSccU6ltfqHe+pB9IukfSFUo+AuwO3Cjpxl7ifINSbvWlSnMIjJb0AeBY\n4HOSruijiT8jZW2E9IF2ZaHOsfkMd4mk2yRNUkro9iHgo/lbw+FN2ni+pNtJaXCLriy+nqTO/+cR\n8dd8V+ZF+bW8S1Ix0+vukuYo5U9/rk6lXOvj8/IJOZbFki7r5bXaN9fRI+mWBt/c3kn6ALqKTf/t\nd5N0Ta5/ce3bTm/PW/xmoZTHfbGkxcAphfpGSfqypDvy8R/M5aXeC/n4iyUty//+H+2jPdZqQ31H\nmx+tfZDOkL+dlxcAk/PyEcBjpPz1o0lnxmfnbbOAr+TlHwMn5uX3A9fm5YuBYwrPs75Q71pSjpAt\ngFtJSaegl3ziuXwbUmbB/fP6paSka897nrrj1pPucv1BrmMRm975+XXgzLx8JLAoL58FfLxQT6M2\n/oScx7zuubcG/gyMy+tzgOl5+QvAe/LyGNId49sD7wNWAjvneO8H9iy+NsDL8v7jc/nY+phJd3bu\nl5cPIaU26O31mQscDuwPLC2Uf6/w+o7K8ZR53iXAa/Pyl8lzPAAzgU/l5dFANykHfKn3AulbyNxC\nfGOG+v9Npzx8ht9+ZpDO8Mh/i8M6d0TKX/8U6TbvX+TypUBXXn41aZILgMtI3xaaWRgRD0TEs6RO\nuKvJ/gcAqyLiN3n9EtLEMU1FxJJc/wzS2X7R1BwzETEPGKe6cfesURuvjpQJs/55nyblSzkmn5m/\ngjTMAynPyhlK6ZLnkzr3vfK2GyJibUT8DbgbmFhX9ZH5OR/Oz7PJXAr5G9thwNW5/m+SPrSp2283\nUv6WX+XX9RltzOB5JPC/uf4NEbG2xPOOIXXENxdep5o3ASfkeG4npRvYL28r815YCewj6euSpgHr\netnHKuD0yG1E0ljSf+SXK6VtHQWEpE/kXZ4q7P5sYf1Zmr8X/k4eApS0BemMt6ZY74YSdQ3W9cC5\npDPKcS2u+4kG264EPk2auei6iHgmlwt4V0SsKO4s6RAG/9psATwWEQc12e9YYBdglVJq6p1IH4qf\n7OfzlSHg1Ij4+SaFKXVy0/ZGxKOS/hF4M2m47VjSNy2rmM/w28sxwGURMTEiuiJiT2AV6Wt+WQvY\nOP57PHBLXr6P9FUc4O2kWZ6aeZw07WG9FUCXpBfn9fcCN/UjxotIw1FL68pvyTHXOp+HI2JdL3H0\n1cZm5pPOZE+h8NsB6Uz/VOWeVtIryjYEmAe8W9K4fOzY4sYc/ypJ787blTvLejOAafnfvYv0b1Vr\n4w3Ah/Pxo5R+cG72vI8Bj0mqffs5vq69H1ZKi42k/ZUySjby3L9B/oa0RUT8EPgUaUpQ2wzc4beX\nGaS83UU/pH9X65wKnCRpCakjnpXLLwRel3/AezWNz4RrLgDm1P9om4c3TiINUywlfcM4v2yAecjg\na71sOguYnGP/IhvT2P4YOLr2o22DNjZ73mdJvx+MY9MPqM+RPgCXSFqe18u2ZTnweeCm/Nqe18tu\nxwMn5+3LqZv+M/8wPRF47nLMSNPsrc3fMmYBr8+vdQ9pvugyz3sS8D956KY48fa3SMNTdypdqvlN\nmn9zKb4X9gDm53ovB2Y3OdZaxNkyzcw6hM/wzcw6hDt8M7MO4Q7fzKxDuMM3M+sQ7vDNzDqEO3wz\nsw7hDt/MrEP8P8dgmLj8Ct8iAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x10eef2e80>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAX0AAACTCAYAAABiQMkXAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAFCxJREFUeJzt3XuwHGWZx/Hvj4BckgBCEJFLjrBcVlkEEnDVgJHdFcwq\nwoosKRRB3aiLCKKusOoayktQV6RQaxFci4AKriJyEVFu4VIoMUdOEsIahIAKIgFWQlBuhmf/eN8j\nneHMTM+c6ZlJ5vepmjrd73S//UyfmXd63n77aUUEZmY2GDbodQBmZtY9bvTNzAaIG30zswHiRt/M\nbIC40TczGyBu9M3MBogbfTOzAeJG38xsgLjRNzMbIBv2OoBaU6ZMiaGhoV6HYWa2ThkeHn44IrZp\ntlzfNfpDQ0MsWrSo12GYma1TJP26zHLu3jEzGyBu9M3MBkjfNfrDw72OwMxs/VV5n76kNcDSQtFF\nEXF61ds1M7Pn68aJ3CciYu8ubMfMzJpo2uhL2gb4F2CouHxEvLO6sMzMrApljvQvBW4CrgHWtLGN\nTSWNFObnRcR3igtImgPMSXM7tbEJMzMrQ81ulyhpZDzdM5Iej4hJ5ZefHhEep29m1gpJwxExvdly\nZUbvXCFpVgdiMjOzHivT6J9IaviflLQ6Px6rOjAzM+u8pn36ETF5nNuo7dO/KiJOqbfwtGnj3JqZ\nmdVVasimpEOBA/Psgoi4ouwGImJCO4GZmVnnNe3ekXQ6qYvnjvw4UdK8qgMzM7POK3OkPwvYOyKe\nBZA0H7gNOLXKwMzMrPPK5t7ZsjC9RRWBmJlZ9coc6c8DbpN0PSBS337dE7FmZta/yozeuVDSAmC/\nXPTRiPh9pVGZmVkl6nbvSNoj/90X2A64Lz9eksvMzGwd0+hI/2RSPpwvjvFcAAdVEpGZmVWmTO6d\nTSLiyWZlHQtI0wNS7p0moZmZWdbJ3Du3lCwzM7M+V7d7R9KLge1JaRT2IY3cAdgc2KwLsZmZWYc1\n6tM/GDgW2AE4o1C+Gvj3CmMyM7OK1G30I2I+MF/SWyLi4iqD8E1UzMy6o+6JXEknN1oxIs5o9PwY\n9R1Puu0iwKyI+N3Yy/lErplZq8qeyG3UvTOaUnl30oVZl+X5NwELWw0oIr4KfLXV9czMrHMade+c\nBiDpRmDfiFid5+cCP+xKdGZm1lFlhmxuCzxdmH86l1Vi2rTUreOuHTOzziuTcO18YKGkS/L8YcD8\n6kIyM7OqlEm49hlJVwEzctFxEXFbtWGZmVkVSt0uERgBHhhdXtJOEfGbyqIyM7NKNG30JZ0AfBJ4\nEFhDujI3gL2qDc3MzDqtzJH+icDuEfFI1cGYmVm1yoze+S2wqupAzMysemWO9FcACyT9EHhqtLDV\nK3LNzKz3yjT6v8mPF+RHpYaHQWq+XJHH9JuZlVNmyObolbmT8vzjZSqWtAZYCmwE/Jk03v9LEfFs\n29Gamdm4lBm9sydwAbBVnn8YOCYiljVZ9YmI2Duv8yLg26Rc/J8cV8RmZta2MidyzwFOjoipETEV\n+BBwbisbiYiVpNTJ75da7bwxM7NOKdPoT4yI60dnImIBMLHVDUXECmAC8KLa5yTNkbRI0iJ4qNWq\nzcyspDKN/gpJn5A0lB8fJ43o6ZiIOCcipqdc0Nt0smozMyso0+i/k9QSfx+4GJiSy1oiaWfSFb0r\nW13XzMw6o9GN0TcBJkfEQ8AHCuUvAp5oZSOStgHOBr4S9W7VZWZmlWt0pH8WcMAY5a8BvlSi7k0l\njUhaBlwD/AQ4rdlKxXz6ZR9mZlZOoyGb0yJiTm1hRFwi6dPNKo6ICeOKzMzMOq7Rkf5mba5nZmZ9\nqlHjvVLS/rWFkvbD4yrNzNZJjbp3PgL8j6TzgOFcNh04Bjiq4rjMzKwCdY/0I2IhsD/ppinH5oeA\nV0bErd0IzszMOqth7p2cPsG5cszM1hM+IWtmNkDc6JuZDZAyN1FpWyGnvkgpGN4fEbc0Wqedm6jU\n8gVbZmZjK5NP/3KgthldBSwCvhYRTzZYvZhT/2BgHvDaNmM1M7NxKpVlE3iclEP/XOAxYDWwG63l\n1d8c+EOrAZqZWeeU6d55dUTsV5i/XNLPI2K/nFenkU0ljQCbANsBB7UbqJmZjV+ZI/1JknYancnT\nk/Ls003WfSIi9o6IPYBDgPPHunOWb6JiZtYdZY70PwTcLOlu0gnZlwL/KmkiML/shiLip5KmkHLz\nr6x57hzSbRmRpvs0rJlZRZo2+hFxpaRdgT1y0fLCydszy25I0h6k2yU+0nKUZmbWEWWHbE4DhvLy\nr5BERJxfYr3RPn1IvxLeERFrWg/TzMw6ocyQzQuAXYAR0lh7SEM4mzb67eTUnzYNFi1qdS0zMyuj\nzJH+dOBlvs2hmdm6r8zonduBF1cdiJmZVa/Mkf4U4A5JC4GnRgsj4tDKojIzs0qUafTnVh2EmZl1\nR5khmzd0IxAzM6te3UZf0s0RMUPSatZOuCYgImLzyqMzM7OOqtvoR8SM/Hdy98IxM7MqlRqnHxFv\nb1bWKZ3Ip2/rLg8MNqtWmSGbLy/OSNqQdIVuKZJeLOkiSXdLGpZ0paTdWg3UzMzGr26jL+nU3J+/\nl6TH8mM18CBwaZnKc0bNS4AFEbFLREwDTgW27UDsZmbWokZ9+vOAeZLmRcSpbdb/OuCZiDi7UO/i\nNusyM7NxKjNk81RJ2wNTi8tHxI0l6t8TGG62kKQ5wJw0t1PDZc3MrH1lTuSeDhwF3MHaCdfKNPql\nOJ++mVl3lLki93Bg94h4qumSz7cMOKKN9czMrAJlb4y+UZv1XwdsnLtvAJC0l6QD2qzPzMzGodEV\nuV8mdeP8CRiRdC1rJ1z7QLPKIyIkHQ6cKemjwJPAvcBJ9dZxPn0zs+o06t4ZbXqHgcva3UBE/A44\nst31zcyscxoN2Sx903MzM1s3lBm9s5S1E64BrCL9Evh0RPhG52Zm64gyo3d+RBqq+e08fxSwGfB7\n4DzgTZVEZmZmHVem0f/7iNi3ML9U0i8iYl9Jb6sqMDMz67wyQzYnSNp/dEbSfsCEPPvnSqIyM7NK\nlDnSfzfwDUmTSDdQeQx4t6SJwLwqgzMzs85SlExgLmkLgIhYVWlAmh7PjRY1MxsM472XhKThiJje\nbLlGF2e9LSK+KenkmvIcYJxRMpDDSOmV/zoifllmHTMzq0ajPv2J+e/kMR6TWtjGbODm/NfMzHqo\ndPfOWitJJ0XEmSWWmwQsJ+XVvzwidm++jrt3zGzwdKt7p8zonbGc3HwRAN4MXBURdwKPSCp9m0Uz\nM+u8dhv9srcunw1clKcvok4Xj6Q5khZJWgQPtRmSmZk10273zm8iouEtriRtBdxHasWDNLY/gKnR\nYKPu3jGzQdQPo3dW8/ycO5CO8jctEcMRwAUR8Z5CnTcAB9DBu26ZmVl5jbJsTh5n3bOBz9WUXZzL\n3eibmfVAmSty2xIRrxuj7Kxm6/kmKmZm1Wn3RK6Zma2D3OibmQ0QN/pmZgOkrSGbVcqjhpb3Oo4x\nTAEe7nUQNfoxJnBcrejHmMBxtaof4poaEds0W6iyE7njsLzMWNNuk7So3+Lqx5jAcbWiH2MCx9Wq\nfo1rLO7eMTMbIG70zcwGSD82+uf0OoA6+jGufowJHFcr+jEmcFyt6te4nqfvTuSamVl1+vFI38zM\nKuJG38xsgPRNoy/pEEnLJd0l6ZQebP9eSUsljaS8/ik9tKSrJf0q/31hYflTc6zLJR3cwTi+IWml\npNsLZS3HIWlafj13STpLozc37lxMcyXdn/fXiKRZ3Ywp17ejpOsl3SFpmaQTc3nP9leDmHq6vyRt\nImmhpMU5rtNyea/fW/Xi6of31wRJt0m6Is/3dF91TET0/EHKtX83sDPwAmAx8LIux3AvMKWm7PPA\nKXn6FOBzefplOcaNgZfm2Cd0KI4DgX2B28cTB7AQ+FtSKuwfAW/ocExzgQ+PsWxXYsr1bQfsm6cn\nA3fm7fdsfzWIqaf7K9cxKU9vBNya6+71e6teXP3w/joZ+DZwRT98Djv16Jcj/f2BuyJiRUQ8TbrL\n1pt7HBOkGObn6fnAYYXyiyLiqYi4B7iL9BrGLSJuBP5vPHFI2g7YPCJ+Fumdd35hnU7FVE9XYspx\nPRARv8jTq4H/Bbanh/urQUz1dOt/GBHxeJ7dKD+C3r+36sVVT1fikrQD8I/A12u23bN91Sn90uhv\nD/y2MH8fjT8oVQjgGknDkubksm0j4oE8/Xtg2zzd7XhbjWP7PF11fCdIWpK7f0Z/6vYkJklDwD6k\nI8W+2F81MUGP91furhgBVgJXR0Rf7Ks6cUFv99eZwL8BzxbKer6vOqFfGv1+MCMi9gbeABwv6cDi\nk/mbuufjW/slDuC/SN1xewMPAF/sVSCSJpFu0HNSRDxWfK5X+2uMmHq+vyJiTX6P70A6Et2z5vme\n7Ks6cfVsf0l6I7AyIobrLdNHn8OW9Uujfz+wY2F+h1zWNRFxf/67EriE1F3zYP6JRv67Mi/e7Xhb\njeP+PF1ZfBHxYP6wPgucy3PdW12NSdJGpMb1WxHx/Vzc0/01Vkz9sr9yLI8C1wOH0EfvrWJcPd5f\nrwEOlXQvqav5IEnfpI/21bj08oTC6IOU+G0F6STI6Incl3dx+xOByYXpW0gfiC+w9ombz+fpl7P2\niZsVdOhEbq5/iLVPmrYcB88/gTSrwzFtV5j+IKlPs9sxidRPemZNec/2V4OYerq/gG2ALfP0psBN\nwBt7/d5qEFfP31+5zpk8dyK355/DTjx6uvGanTuLNNLhbuBjXd72zvmfthhYNrp9YGvgWuBXwDXA\nVoV1PpZjXU4Hz8gDF5J+zj5D6gN8VztxANOB2/NzXyFffd3BmC4AlgJLgMtqPqSVx5Trm0H6ib0E\nGMmPWb3cXw1i6un+AvYCbsvbvx34j3bf412Kq+fvr1znTJ5r9Hu6rzr1cBoGM7MB0i99+mZm1gVu\n9M3MBogbfTOzAeJG38xsgLjRNzMbIG7011OSDpMUkvbocRwnSdqsxXUOyBkXRyRtWvNc5AtlRuc3\nlPTQaCbEBnXOlPTq1qJfa/3NJD0iafOa8h9I+ucG6x0r6St1nrtS0pYN1p0r6cNtxPoDST9rdb3C\n+u+VdMwY5UMqZFpto96W3wvWeW7011+zgZvz3146CWj1g340MC8i9o6IJ2qe+yOwZ+HL4B8od5Xj\nTKClRl/ShqPTEfEn4MfA4YXntyCNy7+8lXoLdc6KdBVqx+QvkWnAFpJ2bjOusyPi/E7GlbXzXrAO\nc6O/Hsp5X2aQLqI6qlA+U9INki6VtELS6ZKOVspnvlTSLnm5IUnX5WRX10raKZefJ+mIQn2PF+pd\nIOl7kn4p6VtKPgC8BLhe0vVjxPl3SvnKl+akWhtLejdwJPApSd+q8xKvJGVAhPSldmGhzq3yke4S\nST+TtFdOfPZe4IP518MBTV7j2ZJuJaXSLbqwuD9JXwA/jog/SZqYX8PC/JqKWWJfIukqpTzsf6lT\n6R4OU/L0MTmWxZIuGGNf7ZLrGJZ0U4NfcP9E+hK6iLX/99tKuiTXv3j0V89Y2y3+wlDKB79Y0mLg\n+EJ9EyR9QdLP8/rvyeWl3gt5/fMk3Z7//x+s83qs03p9dZgfnX+QjpT/O0/fAkzL0zOBR0k53zcm\nHSGflp87kZw6gNRovCNPvxP4QZ4+DziisJ3HC/WuIuUW2QD4KSmBHYxxn4JcvgkpM+Fuef58UnKy\n522nZr3HSVdxfi/XMcLaV01+Gfhknj4IGMnTcynkZ2/yGq9gjLQapBQhDwJb5/mrgDfm6c8Cb8vT\nW5KuLp8IHEu6LH+LHO+vgR2L+4Z0Gf+do/uJfKVnMWbSlaC75ulXAtfV2T9XAwcAuwFLC+XfKezf\nCTmeMttdAhyYp79ATsUBzAE+nqc3BhaRUhCUei+Qfo1cXYhvy15/bgbl4SP99dNs0pEe+W+xi+fn\nkXK+P0W6NPwnuXwpKb8OwKtIN4+AdDn8jBLbXBgR90VKkDVSqKue3YF7IuLOPD+fdLOWpiJiSa5/\nNumov2hGjpmIuA7YWjX98Fmj1/jdiFgzxnafJqUEOCIfoe9D6vIBeD1wilKK4AWkBn6n/Ny1EbEq\nIp4E7gCm1lR9UN7mw3k7a927IP9yezXw3Vz/10hf3NQsty2wK3Bz3q/P6LlMmgeRMlcSKZHZqhLb\n3ZLUGN9Y2E+jXg8ck+O5lZSiYNf8XJn3wgpgZ0lflnQI8NgYy1gFNmy+iK1LJG1F+jD/jaQgHdWF\npI/kRZ4qLP5sYf5Zmr8f/kzuEpS0AenId1Sx3jUl6hqvy4D/JB1Zbt3huv/Y4LkLgU+QEmhdGhHP\n5HIBb4mI5cWFJb2S8e+bDYBHI6UfbuRI4IXAPUp35duc9MX4sRa3V4aAEyLix2sVSjMp8Xoj4g+S\nXgEcTOp6O5L0i8sq5iP99c8RwAURMTUihiJiR+Ae0k/+sm7huf7go0mZDyH9PJ+Wpw8l3eWomdWk\n2wbWWg4MSfqrPP924IYWYvwGqWtqaU35TTnm0Qbo4Uj57GvjqPcam1lAOqI9nsK5BNIR/wnKra2k\nfcq+EOA64K2Sts7rblV8Msd/j6S35ueVG8xas0lpiYciYoj0vxp9jdcC78vrT1A6Cd1su48Cj0oa\n/RV0dM3rfZ9SGmkk7SZpYpPX+Zf/Qf6ltEFEXAx8nHQ7TusCN/rrn9mk+wEUXUxro3hOAI6TtITU\nGJ+Yy88FXptP6r2KxkfEo84Brqo9kZu7Oo4jdVksJf3SOLtsgLn74KwxnpoLTMuxnw68I5dfDhw+\neiK3wWtstt1nSecTtmbtL6lPkb4El0halufLvpZlwGeAG/K+PWOMxY4G3pWfX0bN7UTzyeqpwF+G\naka6dd+q/GvjROB1eV8Pk+5BXWa7xwFfzd04xZt6f53UVfULpWGcX6P5L5jie2F7YEGu95vAqU3W\ntQ5xlk0zswHiI30zswHiRt/MbIC40TczGyBu9M3MBogbfTOzAeJG38xsgLjRNzMbIP8P3SQzt1yP\nPscAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x10fdfbb00>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.subplot(2,1,1)\n",
    "DF.WEATHER_1.value_counts().plot.barh(color = 'r')\n",
    "plt.xlabel('Amount of Motor Vehicle Accidents')\n",
    "plt.ylabel('Weather Condition')\n",
    "plt.show()\n",
    "\n",
    "plt.subplot(2,1,2)\n",
    "DF.LIGHTING.value_counts().plot.barh(color = 'b')\n",
    "plt.xlabel('Amount of Motor Vehicle Accidents')\n",
    "plt.ylabel('Lighting Condtion')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Chi - Squared Test for Independence: \n",
    "We want to see if there is a actually an impact of lighting and weather for the fair and poor streets. We believe that lighting would play a more impact on the more dangerous roads. \n",
    "\n",
    "To start we set our hypothesis:\n",
    "- Ho: There is no association between OCI quality (fair and poor) and street lighting or adverse weather conditions.\n",
    "- Ha: There is an association between OCI quality (fair and poor) and street lighting or adverse weather conditions. \n",
    "\n",
    "Inference: \n",
    "- Two or more categorical groups for each data cell (Accident types).\n",
    "- Large Sample Size: Frequencies are at least 1, at least 5 for majority of cells.\n",
    "- Data is independent: These data sets do not depend on one another.\n",
    "\n",
    "Alpha:\n",
    "- .05"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 90,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The chi-squred value is: 0.00154751312519 and the p - value is: 0.968620556964 with 1 degrees of freedom\n"
     ]
    }
   ],
   "source": [
    "row_1 = [] # Initialize 2 rows to see \n",
    "row_2 = []\n",
    "\n",
    "## Looping over the observed values\n",
    "for i in range(1):\n",
    "    row_1.append(len(DF.loc[(DF['oci_desc'] == DF['oci_desc'].value_counts().index[0]) \n",
    "                           & (DF['LIGHTING'] == 'C')]))\n",
    "    row_2.append(len(DF.loc[(DF['oci_desc'] == DF['oci_desc'].value_counts().index[0]) \n",
    "                           & (DF['WEATHER_1'] == 'B')]))\n",
    "\n",
    "for i in range(1):\n",
    "    row_1.append(len(DF.loc[(DF['oci_desc'] == DF['oci_desc'].value_counts().index[2]) \n",
    "                           & (DF['LIGHTING'] == 'C')]))\n",
    "    row_2.append(len(DF.loc[(DF['oci_desc'] == DF['oci_desc'].value_counts().index[2]) \n",
    "                           & (DF['WEATHER_1'] == 'B')]))\n",
    "\n",
    "row_1 = list(filter(lambda a: a != 0, row_1)) # Removing outliers from expected value\n",
    "row_2 = list(filter(lambda a: a != 0, row_2))\n",
    "\n",
    "x_squared_data_1 = [row_1,row_2] # Combining the observed results\n",
    "x_squared_value_1, x_p_value_1, x_df_1, x_expected_array_1 = chi2_contingency(x_squared_data_1, correction=False)\n",
    "\n",
    "print(\"The chi-squred value is:\", x_squared_value_1, \"and the p - value is:\", x_p_value_1, \"with\", x_df_1, \"degrees of freedom\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We do not have significant evidence at the .05 level. With the p - value > .1, we have evidence that even the quality of OCI is independent of lighting and weather effects on a motor vehicle accident. Thus, we have to look into other variables to investigate. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Observation 3\n",
    "Since (it appears, we still need to do statistical analysis on OCI relative to MVAs) we have (presumably) strong evidence against our hypothesis, we move into exploring other variables in our dataframe that could potentially cause MVAs. We examine factors such as lighting and weather conditions in this new case. We don't consider the collision factor because we are focusing on motor vehicle accidents.\n",
    "\n",
    "Based on the Statewide Integrated Traffic Records System (SWITRS), a [legend] was re-engineered beginning with collisions dated January 2002.  As part of this re-engineering, they have changed the format of the raw data provided upon request to SWITRS data users:\n",
    "\n",
    "Weather_1: the weather condition at the time of the collision\n",
    "\n",
    "A - Clear\n",
    "B - Cloudy\n",
    "C - Raining\n",
    "D - Snowing\n",
    "E - Fog\n",
    "F - Other\n",
    "G - Wind\n",
    "-- Not Stated\n",
    "\n",
    "Lighting: The amount of light present at the collision\n",
    "\n",
    "A - Daylight\n",
    "B - Dusk - Dawn\n",
    "C - Dark - Street Lights\n",
    "D - Dark - No Street Lights\n",
    "E - Dark - Street Lights Not Functioning\n",
    "-- Not Stated\n",
    "\n",
    "It seems that most of the MVA collisions occurred in either clear (A) or cloudy (B) weather, so weather doesn't appear to make a strong impact as we would expect. We move onto lighting and notice that not all accidents occurred in broad daylight. A sizeable portion of these collisions seem to appear at night with streetlights on (C). \n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Observation 4\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0.31845238095238093\n",
      "0.26495726495726496\n",
      "0.19756554307116106\n"
     ]
    }
   ],
   "source": [
    "print(len(DF.loc[(DF['PCF_VIOL_CATEGORY'] == '08') & (DF['LIGHTING'] == 'C')]) / len(DF.loc[(DF['PCF_VIOL_CATEGORY'] == '08')]))\n",
    "print(len(DF.loc[(DF['PCF_VIOL_CATEGORY'] == '03') & (DF['LIGHTING'] == 'C')]) / len(DF.loc[(DF['PCF_VIOL_CATEGORY'] == '03')]))\n",
    "print(len(DF.loc[(DF['PCF_VIOL_CATEGORY'] == '09') & (DF['LIGHTING'] == 'C')]) / len(DF.loc[(DF['PCF_VIOL_CATEGORY'] == '09')]))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAY8AAAEKCAYAAADq59mMAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3Xd8VfX9+PHXO4OEFVbCDAhaRPZIRCoqyFAUBYMD1FbU\n/gTX11Fb66itttrSurW1FBVRq6KCCnXUbV0IJQjIEMNSEwIEFMLOev/++JzAJWTcJDf35N68n4/H\nedxzP/fcc965Ge+czxRVxRhjjKmOGL8DMMYYE3kseRhjjKk2Sx7GGGOqzZKHMcaYarPkYYwxptos\neRhjjKk2Sx7GGGOqrc6Sh4jMFJGtIrKinNduEhEVkeSAsltFZK2IrBGR0wPK00TkK++1R0RE6ipm\nY4wxwanLO49ZwJiyhSLSGTgN+C6grBcwCejtvecxEYn1Xv4HcAXQ3duOOKcxxpjwiqurE6vqxyLS\ntZyXHgRuBuYFlI0HZqvqAWCDiKwFBovIRiBJVb8AEJFngHOAt6q6fnJysnbtWt7ljTHGlCc5OZm3\n3377bVWt8p/0Okse5RGR8UCOqi4rU/vUCfgi4Hm2V1bo7Zctr1LXrl1ZvHhx7QI2xpgGJrA5oTJh\nSx4i0gS4DVdlVVfXmAJMAejSpUtdXcYYYxq8cPa2OgboBizzqqNSgSUi0h7IAToHHJvqleV4+2XL\ny6WqM1Q1XVXTU1JSQhy+McaYUmFLHqr6laq2VdWuqtoVVwU1SFU3A/OBSSKSICLdcA3ji1Q1F8gX\nkSFeL6tLOLytxBhjjA/qrNpKRF4AhgPJIpIN/F5VnyzvWFVdKSIvAauAIuAaVS32Xr4a13OrMa6h\nvMrGcmNM6BUWFpKdnc3+/fv9DsWEQGJiIqmpqcTHx9fo/RKt63mkp6erNZgbEzobNmygefPmtGnT\nBhtuFdlUle3bt7Nr1y66det22Gsikqmq6VWdw0aYG2OCsn//fkscUUJEaNOmTa3uIi15GGOCZokj\netT2exm9yePAAb8jMMaYqBW9yWP9eigo8DsKY0wIZWdnM378eLp3784xxxzD9ddfT0Ed/543a9YM\ngI0bN9KnT586vVYkid7ksXcv/Pa3fkdhjAkRVWXChAmcc845ZGVl8c0337B7925uv/32Wp23qKgo\nRBE2LNGbPFJS4N574Z13/I7EGBMCH3zwAYmJiVx22WUAxMbG8uCDDzJz5kwGDx7MypUrDx47fPhw\nFi9ezJ49e7j88ssZPHgwAwcOZN48N0xs1qxZjBs3jhEjRjBy5Eh2797NyJEjGTRoEH379j14nKlY\nWOe2CqvUVGjbFi65BJYtg3bt/I7ImOhxww2wdGlozzlgADz0UIUvr1y5krS0tMPKkpKS6NKlC2PH\njuWll17irrvuIjc3l9zcXNLT07ntttsYMWIEM2fOZMeOHQwePJhRo0YBsGTJEpYvX07r1q0pKiri\n1VdfJSkpiW3btjFkyBDGjRtnHQQqEb13HjExMHs27NwJl14KJSV+R2SMqSPDhw9nzpw5ALz00kuc\nd955ALzzzjtMmzaNAQMGMHz4cPbv389337nVIEaPHk3r1q0BVyV222230a9fP0aNGkVOTg5btmzx\n54uJENF75wHQpw/cfz9cc437j+aXv/Q7ImOiQyV3CHWlV69eBxNEqfz8fL777juOP/542rRpw/Ll\ny3nxxReZPn064JLC3Llz6dGjx2HvW7hwIU2bNj34/LnnniMvL4/MzEzi4+Pp2rWrjaSvQvTeeZS6\n6ioYPx5uuQWWLPE7GmNMDY0cOZK9e/fyzDPPAFBcXMxNN93EpZdeSpMmTZg4cSJ//etf2blzJ/36\n9QPg9NNP59FHH6V0Jo0vv/yy3HPv3LmTtm3bEh8fz4cffsi3334bni8qgkV/8hCBJ5907R+TJsHu\n3X5HZIypARHh1Vdf5eWXX6Z79+4ce+yxJCYm8qc//QmA8847j9mzZ3PBBRccfM8dd9xBYWEh/fr1\no3fv3txxxx3lnvviiy9m8eLF9O3bl2eeeYbjjjsuLF9TJGs4c1v9979w6qkweTI89ZR/gRkToVav\nXk3Pnj39DsOEUHnfU5vbqqxhw9y4j1mz4Pnn/Y7GGGMiWsNJHgC/+x2ceCJceaUbgW6MMaZGGlby\niItzdx0xMXDhhVBY6HdExhgTkRpW8gA46ih4/HFYtMjdiRhjjKm2hpc8AM4/H664Av7yF3jvPb+j\nMcaYiNMwkwfAgw9Cjx7w859DXp7f0RhjTERpuMmjaVM3fckPP7jpS6K0y7Ix0eKee+6hd+/e9OvX\njwEDBrBw4UIAHnroIfbu3Ruy67z22musWrWq3NfuvPNO7rvvviPKTzzxxCrP27VrV7Zt23ZE+Ucf\nfcTnn39erRhXrlzJiBEj6NGjB927d+ePf/wj4R520XCTB0D//nDfffDmm/DII35HY4ypwIIFC3j9\n9dcPTmb43nvv0blzZ6Dy5FFcXFzta1WWPCpS3T/+gaqbPPbt28e4ceO45ZZbWLNmDcuWLePzzz/n\nscceq3EMNdGwkwfAtdfCWWfBzTeHfpZQY0xI5ObmkpycTEJCAgDJycl07NiRRx55hE2bNnHqqady\n6qmnAm7xpptuuon+/fuzYMECMjMzGTZsGGlpaZx++unk5uYCsG7dOsaMGUNaWhonn3wyX3/9NZ9/\n/jnz58/n17/+NQMGDGDdunVBxVe6YFRJSQlXX301xx13HKNHj+bMM888bD6uRx999OC0719//TUb\nN25k+vTpPPjggwwYMIBPPvmEl19+mT59+tC/f39OOeWUI671/PPPM3ToUE477TQAmjRpwt/+9jem\nTZsGuLujyy+/nOHDh3P00UfzSB39Y1xnEyOKyEzgLGCrqvbxyu4FzgYKgHXAZaq6w3vtVuAXQDFw\nnaq+7ZWnAbOAxsCbwPUayvszETfivF8/N31JZqar0jLGVCgr6wZ27w7tP1vNmg2ge/fyJ1w87bTT\n+MMf/sCxxx7LqFGjmDhxIsOGDeO6667jgQce4MMPPyQ5ORmAPXv2cMIJJ3D//fdTWFjIsGHDmDdv\nHikpKbz44ovcfvvtzJw5kylTpjB9+nS6d+/OwoULufrqq/nggw8YN24cZ5111sGZeavjlVdeYePG\njaxatYqtW7fSs2dPLr/88oOvJycns2TJEh577DHuu+8+nnjiCa688kqaNWvGr371KwD69u3L22+/\nTadOndixY8cR1yhvavpjjjmG3bt3k5+fD8DXX3/Nhx9+yK5du+jRowdXXXUV8fHx1f56KlOXdx6z\ngDFlyt4F+qhqP+Ab4FYAEekFTAJ6e+95TERivff8A7gC6O5tZc9Ze8nJ8K9/wTffwPXXh/z0xpja\nadasGZmZmcyYMYOUlBQmTpzIrFmzyj02NjaWc889F4A1a9awYsUKRo8ezYABA7j77rvJzs5m9+7d\nfP7555x//vkMGDCAqVOnHrwjqY1PP/2U888/n5iYGNq3b3/wbqjUhAkTAEhLS2Pjxo3lnmPo0KFc\neumlPP744zWqdgMYO3YsCQkJJCcn07Zt2zqZXr7O7jxU9WMR6VqmLHBZvy+A0tQ+HpitqgeADSKy\nFhgsIhuBJFX9AkBEngHOAd4KecAjRsCtt8Kf/gSjR8PEiSG/hDHRoqI7hLoUGxvL8OHDGT58OH37\n9uXpp5/m0ksvPeK4xMREYmPd/56qSu/evVmwYMFhx+Tn59OyZUuWhrmqurTaLTY2tsLlb6dPn87C\nhQt54403SEtLIzMzkzZt2hx8vVevXnz88ceHvWf9+vU0a9aMpKSkw65T1bVqw882j8s5lAQ6Ad8H\nvJbtlXXy9suWl0tEpojIYhFZnFeT7rd33glDhsCUKbBhQ/Xfb4ypE2vWrCErK+vg86VLl3LUUUcB\n0Lx5c3bt2lXu+3r06EFeXt7B5FFYWMjKlStJSkqiW7duvPzyy4BLMsuWLavyfFUZOnQoc+fOpaSk\nhC1btvDRRx9V+Z6y11u3bh0nnHACf/jDH0hJSeH7778/7PiLL76YTz/9lPe8MWr79u3juuuu4+ab\nb65RzDXlS/IQkduBIuC5UJ5XVWeoarqqpqekpFT/BPHxhyZNvOgim77EmHpi9+7dTJ48mV69etGv\nXz9WrVrFnXfeCcCUKVMYM2bMEVVEAI0aNWLOnDn85je/oX///gwYMOBgz6bnnnuOJ598kv79+9O7\nd++D65ZPmjSJe++9l4EDB5bbYH733XeTmpp6cAt07rnnkpqaSq9evfjZz37GoEGDaNGiRaVf29ln\nn82rr756sMH817/+NX379qVPnz6ceOKJ9O/f/7DjGzduzLx587j77rvp0aMHffv25fjjj+faa68N\n+vMMCVWtsw3oCqwoU3YpsABoElB2K3BrwPO3gZ8CHYCvA8ovBP4ZzLXT0tK0xmbPVgXV22+v+TmM\niTKrVq3yO4SIsGvXLlVV3bZtmx599NGam5vrc0QVK+97CizWIP7GhnUZWhEZA9wMDFPVwI7Z84Hn\nReQBoCOuYXyRqhaLSL6IDAEWApcAj9Z5oBMnwttvu/aPkSPdOiDGGBOEs846ix07dlBQUMAdd9xB\n+/bt/Q6pTtRlV90XgOFAsohkA7/H3WEkAO+KCMAXqnqlqq4UkZeAVbjqrGtUtbSbwdUc6qr7FnXR\nWF6eRx6Bzz5z1VdvvQUDBoTlssaYyBZMO0c0qMveVheWU/xkJcffA9xTTvlioE8IQwtOs2Ywdy6M\nGePWAHnqKeuBZRo8VcX7x89EOK3lcDkbYV6ZPn1g8WIYNMgNILz1Vqhhv2tjIl1iYiLbt28P+xxK\nJvRUle3bt5OYmFjjc4S1zSMitW8PH3wA//d/MG0aLFvmemS1bOl3ZMaEVWpqKtnZ2dSoG7ypdxIT\nE4/oLVYdljyC0agR/POf7g7k2mth8GB47TXo1cvvyIwJm/j4eLp16+Z3GKaesGqr6pg6FT78EPLz\n3WBCr1+4McY0NJY8quukk1w7SI8ecM458Ic/QEmJ31EZY0xYWfKoidRU+Phjtwrh738P550HNZzO\nwBhjIpElj5pq3BieftotZzt/Pvz0p7B2rd9RGWNMWFjyqA0RuOEGNxo9NxeOPx7eeafq9xljTISz\n5BEKI0e6dpAuXeCMM9zSttYX3hgTxSx5hEq3bvD553DuufDrX8PFF0MF6yobY0yks+QRSk2bwosv\nugkVZ892PbO+/dbvqIwxJuQseYSaiJvG5N//hnXrID0d/vtfv6MyxpiQsuRRV8aOhUWL3Proo0bB\n3/9u7SDGmKhhyaMu9egBX3zhGtGvvRbuOWLSYGOMiUiWPOpaixZuHqyzz4b774d9+/yOyBhjas2S\nRzjExMCNN8KOHfDyy35HY4wxtWbJI1yGD4djj3Wz8xpjTISz5BEuIjBlihsLsmKF39EYY0ytWPII\np8mTD60NYowxEazKxaBEJAW4AugaeLyqXl53YUWp5GQ3A++zz8Jf/gJNmvgdkTHG1Egwdx7zgBbA\ne8AbAVulRGSmiGwVkRUBZa1F5F0RyfIeWwW8dquIrBWRNSJyekB5moh85b32iIhIdb7AemfqVNi5\n041EN8aYCBVM8miiqr9R1ZdUdW7pFsT7ZgFjypTdAryvqt2B973niEgvYBLQ23vPYyIS673nH7g7\nn+7eVvackeXkk6FnT6u6MsZEtGCSx+sicmZ1T6yqHwM/lCkeDzzt7T8NnBNQPltVD6jqBmAtMFhE\nOgBJqvqFqirwTMB7IlNpw/nChbBsmd/RGGNMjQSTPK7HJZD9IrLL2/JreL12qprr7W8G2nn7nYDv\nA47L9so6eftlyyPbJZdAQoLdfRhjIlaVyUNVm6tqjKomevvNVTWpthf27iRCOtmTiEwRkcUisjgv\nLy+Upw6t1q3hggvgX/+C3bv9jsYYY6otqK66IjJORO7ztrNqcb0tXlUU3uNWrzwH6BxwXKpXluPt\nly0vl6rOUNV0VU1PSUmpRZhhMHWqW/d89my/IzHGmGqrMnmIyDRc1dUqb7teRP5cw+vNByZ7+5Nx\nPblKyyeJSIKIdMM1jC/yqrjyRWSI18vqkoD3RLYTT4Teva3qyhgTkYK58zgTGK2qM1V1Jq6309iq\n3iQiLwALgB4iki0ivwCmAaNFJAsY5T1HVVcCL+GS03+Aa1S12DvV1cATuEb0dcBb1fj66i8Rd/ex\neDEsWeJ3NMYYUy2iVawxISLLgeGq+oP3vDXwkar2C0N8NZaenq6LFy/2O4zK7dgBHTvCz39udyDG\nmHpBRDJVNb2q44K58/gz8KWIzBKRp4FMwBamCIWWLWHiRHj+edf+YYwxESKY3lYvAEOAV4C5wE9V\n1YZHh8rUqa7H1fPP+x2JMcYErcLkISLHeY+DgA64MRbZQEevzITCCSdAv36u2sqWqTXGRIjKJkb8\nJTAFuL+c1xQYUScRNTSlDefXXOMaz48/3u+IjDGmSlU2mEeqiGgwL7Vzp2s4v/BCeOIJv6MxxjRg\nIWswF5HzRaS5t/9bEXlFRAaGIkjjadHCJY4XXnCJxBhj6rlgelvdoaq7ROQk3NiMJ4HpdRtWAzR1\nKuzdC88953ckxhhTpWCSR+lgvbHADFV9A2hUdyE1UOnpMHCgNZwbYyJCMMkjR0T+CUwE3hSRhCDf\nZ6qjtOF8+XI3XbsxxtRjwSSBC4C3gdNVdQfQGvh1nUbVUF10ETRrZqPNjTH1XmXjPEqnXU8EPgK2\ne1OTHAAipBtThGne3CWQ2bPhxx/9jsYYYypU2Z1H6ZDnTFyyyAzYLHnUlalTYf9+ePZZvyMxxpgK\n2TiP+uj4413PqxUrXFuIMcaESbDjPCocYV7VFCSqavOI15WpU+GKK+Czz+Ckk/yOxhhjjlDZ9CTl\nTUtSyqYnqUuTJsEvf+kazi15GGPqoQqTh6qeGs5ATIBmzdwaH08+CQ89BG3a+B2RMcYcprJqqwmV\nvVFVXwl9OOagqVPhscfgmWfgxhv9jsYYYw5TWbXV2ZW8prj1PUxd6dcPhgxxVVc33GAN58aYeqWy\naqvLwhmIKcfUqXDZZfDxxzBsmN/RGGPMQcHMqttCRB4QkcXedr+ItAhHcA3eBRe4GXdtxLkxpp4J\nZnqSmcAu3DQlFwD5wFN1GZTxNGkCl1wCc+fCtm1+R2OMMQcFkzyOUdXfq+p6b7sLOLo2FxWRG0Vk\npYisEJEXRCRRRFqLyLsikuU9tgo4/lYRWSsia0Tk9NpcO+JMnQoFBTBrlt+RGGPMQcEkj33eWh4A\niMhQYF9NLyginYDrgHRV7QPEApOAW4D3VbU78L73HBHp5b3eGxgDPCYisTW9fsTp3RuGDoUZM2yq\ndmNMvRFM8rgS+LuIbBSRjcDfvLLaiAMai0gc0ATYBIwHnvZefxo4x9sfD8xW1QOqugFYCwyu5fUj\ny9SpkJUFH37odyTGGAMEkTxUdZmq9gf6Af1UdaCqLqvpBVU1B7gP+A7IBXaq6jtAO1XN9Q7bDLTz\n9jsB3wecItsrO4KITClt2M/Ly6tpiPXPeedBq1bWcG6MqTcqm5L9lyLyi9Lnqpqvqvki8gsRuaGm\nF/TaMsYD3YCOQFMR+VngMepma6x2HY2qzlDVdFVNT0lJqWmI9U/jxjB5Mrz6Kmzd6nc0xhhT6Z3H\nxcAz5ZQ/C1xei2uOAjaoap6qFuIGG54IbBGRDgDeY+lfyRygc8D7U72yhmXKFCgshKeso5sxxn+V\nJY8474/7YVS1AKjNcOfvgCEi0kREBBgJrAbmA5O9YyYD87z9+cAkEUkQkW5Ad2BRLa4fmXr2hFNO\ncQ3nJSV+R2OMaeAqSx4xItKubGF5ZdWhqguBOcAS4CsvhhnANGC0iGTh7k6mecevBF4CVgH/Aa5R\n1eLaxBCxpk6F9evh/ff9jsQY08BVuBiUiFyC61J7E+4PPUAacC/wN1V9utw31hMRvRhURQ4cgE6d\nYPhwmDPH72iMMVGo1otBqeozIpIH/AHog2vAXgn8TlXfClmkJngJCXDppfDww7B5M7Rv73dExpgG\nqtKuuqr6lqoOU9U2qprs7Vvi8NPll0NRkZuyxBhjfBLMIEFTn/TqBT16uG67xhjjE0sekWjCBPjo\nI/jhB78jMcY0UJUNErzeexwavnBMUDIyoLgYXn/d70iMMQ1UZXcepYtBPRqOQEw1pKdDaqpVXRlj\nfFPZMrSrvTEXHUVkeUC54GYQ6Ve3oZkKicA558CTT8KePdC0qd8RGWMamArvPFT1QuBk3Cy2Zwds\nZ1H5+uYmHDIyYN8+ePttvyMxxjRAVXXV3ezNqJsLNPe2Tar6bTiCM5U45RRo3dqqrowxvqis2goA\nERmGmyBxI67KqrOITFbVj+s4NlOZuDg4+2yYN89NmBgf73dExpgGJJiuug8Ap3kDBE8BTgcerNuw\nTFAyMmDHDtdt1xhjwiiY5BGvqmtKn6jqN4D9m1sfnHYaNGliVVfGmLALJnksFpEnRGS4tz0ORNmM\ngxGqcWMYMwZee82maTfGhFUwyeMq3HTo13nbKq/M1AcZGZCbC4sa3hInxhj/VNlgrqoHcO0eD9R9\nOKbaxo51jeevvgpDhvgdjTGmgbC5rSJdq1YwYoRLHhWszWKMMaFmySMaZGRAVhasWuV3JMaYBqLK\n5CEifcMRiKmF8ePdlCXW68oYEybB3Hk8JiKLRORqEWlR5xGZ6uvQwbV3WPIwxoRJlclDVU8GLgY6\nA5ki8ryIjK7zyEz1ZGTAkiXwrc0cY4ype0G1eahqFvBb4DfAMOAREflaRCbU5KIi0lJE5njnWC0i\nPxWR1iLyrohkeY+tAo6/VUTWisgaETm9JteMehkZ7vG11/yNwxjTIATT5tFPRB4EVgMjgLNVtae3\nX9NpSh4G/qOqxwH9vXPfAryvqt2B973niEgvYBLQGxiDq0aLreF1o9dPfgJ9+sArr/gdiTGmAQjm\nzuNRYAnQX1WvUdUlAKq6CXc3Ui1eu8kpwJPeeQpUdQcwHnjaO+xp4BxvfzwwW1UPqOoG3BTxg6t7\n3QYhIwM+/RTy8vyOxBgT5YJJHmOB51V1H4CIxIhIEwBVfbYG1+wG5AFPiciX3tQnTYF2qprrHbMZ\naOftdwK+D3h/tldmysrIcNOUzJ/vdyTGmCgXTPJ4D2gc8LyJV1ZTccAg4B+qOhDYg1dFVUpVFaj2\niDcRmSIii0VkcV5D/O97wAA46ijrdWWMqXPBJI9EVd1d+sTbb1KLa2YD2aq60Hs+B5dMtohIBwDv\ncav3eg6up1epVK/sCKo6Q1XTVTU9JSWlFiFGKBF39/Huu7Brl9/RGGOiWDDJY4+IDCp9IiJpwL6a\nXlBVNwPfi0gPr2gkbrLF+cBkr2wyMM/bnw9MEpEEEekGdAdsFsCKZGRAQQG89ZbfkRhjoliVEyMC\nNwAvi8gm3EqC7YGJtbzu/wHPiUgjYD1wGS6RvSQivwC+BS4AUNWVIvISLsEUAdeoanEtrx+9hg6F\nlBRXdXXBBX5HY4yJUqJBTKYnIvFA6Z3CGlUtrNOoQiA9PV0XL26gy45ccQW8+KLrdZWQ4Hc0xpgI\nIiKZqppe1XHBTox4PNAP1zZxoYhcUpvgTB3LyHBtHh984HckxpgoVWW1lYg8CxwDLAVKq4sUeKYO\n4zK1MXIkNG/uqq7OOMPvaIwxUSiYNo90oJcGU79l6oeEBDjzTJg3D/7xD4i1AfnGmNAKptpqBa6R\n3ESSjAzYuhUWLPA7EmNMFArmziMZWCUii4ADpYWqOq7OojK1d8YZ0KiRq7o66SS/ozHGRJlgksed\ndR2EqQNJSTBqlEse993nBhAaY0yIBLOex3+BjUC8t/8/3ESJpr7LyIANG2DZMr8jMcZEmWCmZL8C\nN4XIP72iToAtGhEJxo2DmBib68oYE3LBNJhfAwwF8uHgwlBt6zIoEyJt27oR55Y8jDEhFkzyOKCq\nBaVPRCSOGsx4a3wyYQJ89RWsW+d3JMaYKBJM8viviNwGNPbWLn8Z+HfdhmVC5hxvTS27+zDGhFAw\nyeMW3OJNXwFTgTepwQqCxiddu8LAgZY8jDEhFUxvqxJVfVxVz1fV87x9q7aKJBkZbrDg5s1+R2KM\niRLB9LbaICLry27hCM6ESEYGqLrpSowxJgSCnduqVCJwPtC6bsIxdaJ3b/jJT1zV1dSpfkdjjIkC\nwVRbbQ/YclT1IWBsGGIzoVK6PO0HH8DOnX5HY4yJAsFUWw0K2NJF5EqCu2Mx9UlGBhQWwhtv+B2J\nMSYKBJME7g/YL8JNVWLrm0aaE06ADh1c1dVFF/kdjTEmwlWZPFT11HAEYupYTAyMHw/PPgv79kHj\nxn5HZIyJYMGsJPjLyl5X1QdCF07oFBfv8juE+icjA6ZPh/feg7PP9jsaY0wEC2aQYDpwFW5CxE7A\nlbi1zJt7W720d28W27bZQPjDDB8OLVrYgEFjTK0FkzxSgUGqepOq3gSkAV1U9S5VvaumFxaRWBH5\nUkRe9563FpF3RSTLe2wVcOytIrJWRNaIyOnBnD82tjErVmSwZctzNQ0x+jRq5O445s+HoiK/ozHG\nRLBgkkc7oCDgeYFXVlvXA6sDnt8CvK+q3YH3veeISC9gEtAbGAM8JiJVLsrduPGxtGx5MqtX/5yc\nnMdCEG6UyMiA7dvhk0/8jsQYE8GCSR7PAItE5E4RuRNYCDxdm4uKSCpurMgTAcXjA877NHBOQPls\nVT2gqhuAtcDgqq8RS9++b9KmzVlkZV3Dt9/eg82qApx+OiQmWtWVMaZWghkkeA9wGfCjt12mqn+q\n5XUfAm4GSgLK2qlqrre/mUN3N52A7wOOy/bKjiAiU0RksYgszsvLIza2Mb17z6Vdu5+xYcNvWbfu\n15ZAmjZ1CeS119yUJcYYUwPB3HkANAHyVfVhIFtEutX0giJyFrBVVTMrOsabeLHaf9lUdYaqpqtq\nekpKCgAxMfEcd9zTdOx4DdnZ97NmzRWoFtc0/OiQkQHffw+ZFX4LjDGmUsF01f09rsdVD+ApIB74\nF251wZoYCowTkTNxc2Ulici/gC0i0kFVc0WkA7DVOz4H6Bzw/lSvLGgiMXTv/ijx8a349tu7KS7e\nSc+e/yKDkr2VAAAYb0lEQVQmJqGGX0KEO/tsiI11VVfp6VUfb4wxZQRz55EBjAP2AKjqJmrRRVdV\nb1XVVFXtimsI/0BVfwbMByZ7h00GSqeAnQ9MEpEE746nO7CoutcVEbp1+yPHHHM/eXlz+OqrcRQX\n76nplxHZWreGYcOs3cMYU2PBJI+CwGokEWlaR7FMA0aLSBYwynuOqq4EXgJWAf8BrtFa1Dt17vxL\nevR4kh9/fI9ly06jsPDHEIQegTIyYPVqWLPG70iMMREomOTxkoj8E2gpIlcA7wGPh+LiqvqRqp7l\n7W9X1ZGq2l1VR6nqDwHH3aOqx6hqD1V9q7bX7dDhcnr1epFdu/7H0qXDKSjYUttTRh5bntYYUwsS\nTO8jb+3y0wAB3lbVd+s6sNpKT0/XxYsXV3rMDz+8w4oVGSQkdKR///dITDwqTNHVE4MHQ1YWjBgB\ngwZBWprbvM4GxpiGR0QyVbXKxtBKk4c3GO+9SJwcMZjkAbBz5+d89dVYYmKa0r//uzRt2jMM0dUT\nS5bAX//qHrOyDpWnph5KJKVJpX17/+I0xoRNSJKHd6L3gQmqGlGrCAWbPAB2717OsmWnAcX06/cf\nmjdPq9vg6qOdO+HLL10iycx0j2vWHBoL0rHj4Xcngwa5MhF/4zbGhFQok8c8YCDwLl6PKwBVva62\nQdal6iQPcBMpLls2mqKiH+jb93VatjylDqOLELt2wdKlhxJKZiZ8/TWUeGM727U7/O5k+HBo2dLX\nkI0xtRPK5DG5vHJVrdUUJXWtuskD4MCBHJYtG83+/Rvo3XsObdrYartH2LMHli07dHeSmQmrVkFx\nMcTHw8iRcO65bu0QazsxJuLUOnmISBdV/S7kkYVJTZIHQEHBNpYvH8OePcs47rinadfOVt2r0r59\nLonMnw9z58L69W7xqWHDXCLJyHBVXMaYei/Y5FFZV93XAk42NyRRRYBGjZIZMOADkpKGsnr1z2xG\n3mA0bgwnneQa39eudW0nt90GmzfDtde6BvihQ+GBB+Dbb/2O1hgTApUlj8CW0KPrOpD6JC4uiX79\n3qJNm7FkZV3DN99cQ0lJQdVvNK4BfcAA+OMfXXXWypVw112uuuumm6BrVzclyp//DN9843e0xpga\nqix5aAX7DYKbkfdVOnf+FZs2PcbSpcM4cKBaU2oZgF694I47XMP72rXwl7+4ebVuuw169IC+feHO\nO2HFCpvl15gIUlmbRzGud5UAjYG9pS/hJr5NCkuENVTTNo/ybN06hzVrLiMmpgm9e79Ey5bDQnLe\nBu377+GVV1wbyaefusRx7LEwYQJcdJFLKsaYsAtZb6tIFcrkAbBnz2pWrMhg3761HHPMX0lNvRGx\nMQ6hsXmzW19k7lz48ENX9sYbbt0RY0xYhaLB3ARo2rQnaWmLSE4ez7p1N7Fq1SSKinb7HVZ0aN8e\nrrwS3n0XcnOhd2+44ALXZmKMqZcseVRDXFwSvXvP4eij/0Je3hyWLBnM3r02K21IpaTAv//tenCd\ndRbk5fkdkTGmHJY8qklE6NLlZvr3f5fCwjwyM48nL89mpg2pLl1g3jx3FzJhAhw44HdExpgyLHnU\nUKtWI0hLW0KTJj1ZuXIC69ffSklJkd9hRY8TToBZs1xj+pQp1hPLmHrGkkctJCZ2ZuDAj+nQYSrf\nfTeN5cvHUFBg1SwhM3GiGyPyzDOui68xpt6w5FFLMTEJ9OgxnR49ZrJz56dkZqaRn1/tVXJNRe64\nAy68EG691XXtNcbUC5Y8QqRDh8sYNOgzIIYvvzyZTZtCstiiEYGZM2HIEPjZz9wcWsYY31nyCKHm\nzdNIT8+kZcvhfPPNFL7++v9RXLzf77AiX2KiGweSkgLjxkGOjfQ3xm+WPEIsPr4N/fq9yVFH/ZbN\nm5/kyy9PYt++jX6HFfnatYPXX4f8fJdA9uyp+j3GmDoT9uQhIp1F5EMRWSUiK0Xkeq+8tYi8KyJZ\n3mOrgPfcKiJrRWSNiNT7YccisXTr9kf69JnHvn1ZZGam8cMP7/gdVuTr2xdmz3bzZF1yyaFFqYwx\nYRf26UlEpAPQQVWXiEhzIBM4B7gU+EFVp4nILUArVf2NiPQCXgAGAx2B94BjVbW4suuEenqSmtq7\nN4uVKyewZ89KWrc+k8TELjRq1JGEhE4kJHQ8uB8X18qmOwnWQw/BjTe6RvQ//cnvaIyJKsFOTxIX\njmACqWoukOvt7xKR1UAnYDww3DvsaeAj4Dde+WxVPQBsEJG1uESyILyR10yTJt0ZNOgL1q27mZ07\nPyE/fwFFRT8ccVxMTKKXSA4llNLngfuxsU19+Crqmeuvd8vh/vnPbmbeyeUudmmMqUNhTx6BRKQr\nbn30hUA7L7EAbAbaefudgC8C3pbtlUWM2NimHHvs3w8+Ly7eT0HBJg4c2OQ95hx8fuBADrt3f8n2\n7a9TUrK3nHO1IDHxKNq1u4gOHa4gPr51OL+U+kEEHn3UTfF+xRVw9NFw8sl+R2VMg+Jb8hCRZsBc\n4AZVzQ+sslFVFZFq16eJyBRgCkCXLl1CFWrIxcYm0rjx0TRuXPEaW6pKcXH+YQmmdH/37qWsX38L\nGzfeRbt2l5Caeh1Nm/YK41dQD8THw8svuy68GRmwaJFLIsaYsPAleYhIPC5xPKeqpSO/tohIB1XN\n9dpFtnrlOUDngLenemVHUNUZwAxwbR51EnyYiAhxcS2Ii2tB06Y9j3h99+7lZGc/wubNs8jN/Set\nWp1GauoNtG59OiINpBNdq1auB9aQIW4SxQULoEULv6MypkHwo7eVAE8Cq1X1gYCX5gOlldeTgXkB\n5ZNEJEFEugHdgQY/hLtZs34cd9wT/PSn39Ot293s2fMVX311JosW9SQn5+8NZ7r47t3dyPO1a900\n7kU2v5gx4eDHv6hDgZ8DI0RkqbedCUwDRotIFjDKe46qrgReAlYB/wGuqaqnVUPSqFEKRx11O0OG\nbKRnz+eIi2tJVta1LFiQytq1v2oYY0yGDYPp0+Gdd+CGG/yOxpgGwVYSjEI7d35BdvZD5OXNAZTk\n5HNITb2eFi1Oju7uwDffDPfe6xrTr73W72iMiUi2DG0DTh6l9u//nk2bHmPTphkUFf1As2YDSU29\nnrZtJxETk+B3eKFXXAznnusWk3rjDRgzxu+IjIk4ljwseRxUXLyXLVv+RXb2w+zdu4r4+LZ07HgV\nHTteSUJCe7/DC63du1233fXrXQN6rwbWC82YWrLkYcnjCKrKjz++T3b2Q/zwwxuINKJt20mkpl5P\n8+aD/A4vdLKz4fjj3VK2Cxa4ebGMMUGx5GHJo1J792aRk/MIublPUVKyhxYtTiI19QbatBlPTIyv\nY0dD43//g1NOgcJCGDTI3Y2cfDKcdBIkJ/sdnTH1liUPSx5BKSraSW7uTHJyHmH//o0kJHShU6f/\no0OHXxAf36rqE9RnX34Jc+bAJ5+4QYSla6Efd9zhyaRrVzdq3RhjycOSR/WoFrNt27/JyXmYHTs+\nIiamCe3bX0pq6nU0adLD7/Bq78ABWLzYJZJPPoHPPoOdO91rnTodnkz69IGYBjLQ0pgyLHlY8qix\nXbuWkpPzCFu2PIdqAa1bn0Fq6vW0anVa9HT1LS6GlSsPJZNPPoFNm9xrLVvC0KGHkkl6OiREYe80\nY8phycOSR60VFGxl06Z/smnTYxQUbKZJk5506nQd7dv/PPpm91WFjRsPTyZr1rjXEhPhhBPg9NNh\n7Fi3rki0JFFjyrDkYckjZEpKCti69SVych5m167FxMW1okOHK+jU6RoSE+vvBJS1lpcHn37qEsmH\nH7pFqAA6d4Yzz3SJZMQIaBplidQ0aJY8LHmEnKqSn/852dkPk5fn5rNMSckgNfUGkpJOjJ4qrYps\n2gRvveUGIL77rhtTkpAAp57qEsnYsdCtm99RGlMrljwsedSp/fu/Iyfn7+TmPk5R0Y80a5ZGy5Yn\nk5DQmYSE1IOPjRp1iI6uv2UdOODuSN54w21ZWa68Z89DiWToUDd1vDERxJKHJY+wKC7ew5Yt/2LT\nphns3buGkpI9ZY6IoVGjDl5CSSUxsfPB/cMTTIT/kc3KOpRI/vtfN76kRQs47TSXSM44A9q29TtK\nY6pkycOSR9ipKkVFOzlwIJsDB74v8+j29+//voIE0/5gUmncuDspKRk0bz44MqvCdu2C995zieTN\nNyE31zWwH3+8SySjR0P//tCkid+RGnMESx6WPOql0hUS9+8/PKkE7u/btxbVQhITu5KScgFt206k\nWbOBkZlISkpcQ3vpXcmiRa5nV2ysq+JKS3Mj4NPSXEJp1szviE0DZ8nDkkfEKizcwfbt89i69UV+\n/PFdVIto3PgnpKRMpG3biTRt2icyEwm4HlyffQZLlkBmptu2bHGvibjR74EJZeBAaN7c35hNg2LJ\nw5JHVCgs3E5e3qts3TqbHTs+BEpo0qQnbdtOJCVlIk2bHud3iLW3aZNLIoEJpXTAoohbLTEwoQwa\nZMvtmjpjycOSR9QpKNhCXt5ctm59kZ07PwGUpk3707atuyNp3Phov0MMnc2bDyWT0sfvvz/0+jHH\nuCRy1FFuosfSLSXl0H7LljbNiqk2Sx6WPKLagQM55OXNYevWF8nPXwBA8+bpXtXWBdE5eDEv7/CE\n8uWX7g5l//7yj4+JgTZtDk8oZRNM6daqletWHBdX8WaJqEGw5GHJo8HYv/9btm59ma1bZ7N7dyYA\nSUk/pW3biSQlDSEuruXBLSpXUNy71yWWbdsO38qWlT7fvt3N7VVdIlUnmLg4l4y6dnVbt26HHjt3\nhkaNQvzFm1Cz5GHJo0Hau3cteXkvsXXri+zZs/yI12NiGh+WTOLiWpV5Xn5ZfHwrYmNbRMeAx5IS\nN6NwYHLZscONTSkqqt1WWAhbt7p5wr777vAkFRPjZjAuL7F07QqpqS75GF9FXfIQkTHAw0As8ISq\nTqvseEseZu/eb9i3by1FRTu87ceAfbcVFh5eBpX/Rx4b26zaiedQWRIiDajqp6gIcnJgwwaXTDZu\nPLS/YYN7raTk0PGxse7upDShlLbntGkDrVsf2tq0gaQkm5yyjkRV8hCRWOAbYDSQDfwPuFBVV1X0\nHkseprrcGJQ9FSSaIxPPkeU7gcp+n4TY2CRiY5sAofnDFxvbhNjYFsTFJREbmxTwWH7Z4c+TiInx\nsRqpoMAtGRyYUAKTTGmPs/LExrp2mtJkUja5lH3esqXroZaUZNPrVyHY5BEp94iDgbWquh5ARGYD\n44EKk4cx1SUixMU1Iy6uGZBa7ferllBUlF9FgtlBScnekMSrqpSU7KWoKJ/i4p3s37+B4uJ8L4ad\nVHUXBRATk+gltKa4/9FivLuj6jzW9H3eY6cY6BSDnBQDNEWkL9AfUSGmQIjdDzH7SojdW0LM7kJi\n8wuIyT9A7I/7if1xLzHbdhO7bSMxy5cRu2UnMVt3EVNyxJd6SKNGLomUbqVJpbytvNdCWbUWE1Oz\nLTbW3Xn5ePcVKcmjExDQT5Fs4ASfYjGmXCIxxMe3JD6+pd+heIlln5dY8gMed5Z57spKSvagWgKU\nVOOxGNUSVIsOKwOtwbmOfFQtoqRkP6re8sGJ3hbEEvRCPDGSSKw2IqYknpjiGCgucdVkJSWuLaZk\nOxRvLVNWcng7TTHwo7fVgbSrILaCznJBEal5AqpoC1KkJI+giMgUYApAly5R2FXTmCCJiFel1QRo\n73c4taJaTHHxPkpK9lJcvMd73FvmcU85ZYdeUy2o3kWLS6Co0HUAKO1IULofyqr+f/w/KI47lMCC\n2UqTXOBz1eqdo7Jzr14dVOiRkjxygM4Bz1O9ssOo6gxgBrg2j/CEZoypSyKxXlWizfsVFkFWhUVK\n14//Ad1FpJuINAImAfN9jskYYxqsiLjzUNUiEbkWeBvXVXemqq70OSxjjGmwIiJ5AKjqm8Cbfsdh\njDEmcqqtjDHG1COWPIwxxlSbJQ9jjDHVZsnDGGNMtVnyMMYYU20RMTFiTYjILmCN33GUkQxs8zuI\nMiym4NXHuCym4FhMwUkEslV1TFUHRnPyWBzMzJDhZDEFpz7GBPUzLospOBZTcKoTk1VbGWOMqTZL\nHsYYY6otmpPHDL8DKIfFFJz6GBPUz7gspuBYTMEJOqaobfMwxhhTd6L5zsMYY0wdiYrkISJjRGSN\niKwVkVu8sgEi8oWILBWRxSIyuB7E1F9EFojIVyLybxFJCnNMM0Vkq4isCCg7X0RWikiJiPjS86O8\nzyrgtZtEREUkiPXjQhZPeZ/Ti97P0lIR2SgiS8MVTyUx+foz7sVQ3s95ffys/igiy72Y3hGRjuGM\nyYuhvM/qXhH52ovtVRHxfxnKYKlqRG+4KdrXAUcDjYBlQC/gHeAM75gzgY/qQUz/A4Z5x1wO/DHM\nn9UpwCBgRUBZT6AH8BGQXl++f95rnXHT8H8LJPv5OZV5/X7gd/Xge+fbz3hV37t6+FklBexfB0yv\nD58VcBoQ5x3zF+Av4YyrNls03HkMBtaq6np1a03OBsYDCpT+Z98C2FQPYjoW+Ng75l3g3DDGhKp+\nDPxQpmy1qvo5mLKizwrgQeBm3PcybMr7nEqJiAAXAC/Ug5j8/BmHyr939eqzUtX8gKdNCfPPFBV8\nVqr6jqoWecd8gVslNSJEzHoelegEfB/wPBs4AbgBeFtE7sNVz51YD2Jaifvleg04n8OX1m2oyv2s\nRGQ8kKOqyyTIZTHD5GRgi6pm+R0I/v6MQ8U/56Xq02eFiNwDXALsBE4N8+Wr+qzA1Ua8GLaIaika\n7jwqchVwo6p2Bm4EnvQ5HnA/HFeLSCbQHCjwOZ76qglwG/A7vwMpx4WE+T/pStTHn/FA9emzQlVv\n9z6r54Br/Y4nkIjcDhThYosI0ZA8cjj8P/hUr2wy8IpX9jLuttHXmFT1a1U9TVXTcL9U68IYU31V\n3me1AegGLBORjV7ZEhFpH/7wDhGROGAC9ee/Qz9/xqHi3736+FkFeo4wVxlT+Wd1KXAWcLF6jR+R\nIBqSx/+A7iLSTUQaAZOA+bj632HeMSOAcN46lxuTiLQFEJEY4LfA9DDGVF+V91m9oqptVbWrqnbF\n3eIPUtXNfgYKjAK+VtVsn+Mo5efPOFT8uwf17LMSke4BT8cDX4c5hIr+JozBteuNU9W9YY6pdvxu\nsQ/Fhutp8g3uP/nbvbKTgExcr4aFQFo9iOl6r+wbYBreIM0wxvQCkAsU4v4g/wLI8PYPAFuAt+vD\n96/M6xsJb2+rIz4nr3wWcGW4P59Kvne+/oxX9r2rh5/VXGAFsBz4N9CpPnxWwFpcW8hSbwtrL7Da\nbDbC3BhjTLVFQ7WVMcaYMLPkYYwxptoseRhjjKk2Sx7GGGOqzZKHMcaYarPkYaKCiLQXkdkisk5E\nMkXkTRE5tpLju5bOuioiw0XkdW9/XNmZfcu8L11EHglBvE+JyNQyZeeIyFve/udVvP9g/FUcc1HA\n85DEbgxY8jBRwJuA71XcrLLHqBvBfyvQrrrnUtX5qjqtktcXq+p1NY/2oBdwA8UCTfLKUdVQzFPV\nFTiYPEIYuzGWPExUOBUoVNWDI/ZVdZmqfiLOvSKywltHZWJlJxKRS0Xkb97++d77lonIx15Z4F1K\naxF5zVuL4QsR6eeV3+mtKfGRiKwXkfL+YL8PHCciHbz3NMWNyn7Ne77be6wyfu8O4xMRWeJtpYln\nGnCyt4bFjSGM3ZiomFXXmD64kdblmQAMAPoDycD/ShNBEH4HnK6qORUs0nMX8KWqniMiI4BnvGsB\nHIdLas2BNSLyD1UtLH2jqhaLyFzclOUPA2fj7pzyOVww8W8FRqvqfm8ajheAdOAW4Feqeha4xBeK\n2I0Bu/Mw0e8k4AVVLVbVLcB/geODfO9nwCwRuQK3mE95534WQFU/ANrIodUh31DVA6q6DffHvbwq\ntMCqq4NVVjWIPx54XES+wk2Q2CuIr622sZsGzpKHiQYrgbRQn1RVr8RNYNkZyBSRNtV4+4GA/WLK\nv8v/HOggIv1xa3G8UcNQb8TNS9Yfd8fRqIbnKRVM7KaBs+RhosEHQIKITCktEJF+InIy8AkwUURi\nRSQFt0TpomBOKiLHqOpCVf0dkMeRi3d9AlzsHTsc2FZOtVOF1E0s9yLwNPCWqu4v57Bg4m8B5Kpq\nCfBzDt0l7cJVPZWnVrEbY8nDRDzvj3AGMMrrqrsS+DOwGdcLazlu5tkPgJs1+Knd7/UaqVfg7hKW\nlXn9TiBNRJbjGqcn1yD8F3B3DBUtmhRM/I8Bk0VkGa69Yo9Xvhwo9hr8b6yD2E0DZrPqGmOMqTa7\n8zDGGFNtljyMMcZUmyUPY4wx1WbJwxhjTLVZ8jDGGFNtljyMMcZUmyUPY4wx1WbJwxhjTLX9f2zb\nC3oVxDjPAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1108938d0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "DF_EX4 = DF.loc[(DF['PCF_VIOL_CATEGORY'] == '08') | (DF['PCF_VIOL_CATEGORY'] == '03') \n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '09') | (DF['PCF_VIOL_CATEGORY'] == '12')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '04') | (DF['PCF_VIOL_CATEGORY'] == '11')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '10') | (DF['PCF_VIOL_CATEGORY'] == '05')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '17') | (DF['PCF_VIOL_CATEGORY'] == '18')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '06') | (DF['PCF_VIOL_CATEGORY'] == '07')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '22') | (DF['PCF_VIOL_CATEGORY'] == '01')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '13') | (DF['PCF_VIOL_CATEGORY'] == '16')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '15') | (DF['PCF_VIOL_CATEGORY'] == '14')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '02')]\n",
    "\n",
    "\n",
    "DF_OB4 = DF.loc[(DF['PCF_VIOL_CATEGORY'] == '08') & (DF['LIGHTING'] == 'C') | \n",
    "                (DF['PCF_VIOL_CATEGORY'] == '03') & (DF['LIGHTING'] == 'C') | \n",
    "                (DF['PCF_VIOL_CATEGORY'] == '09') & (DF['LIGHTING'] == 'C') |\n",
    "                (DF['PCF_VIOL_CATEGORY'] == '12') & (DF['LIGHTING'] == 'C') |\n",
    "                (DF['PCF_VIOL_CATEGORY'] == '04') & (DF['LIGHTING'] == 'C') |\n",
    "                (DF['PCF_VIOL_CATEGORY'] == '11') & (DF['LIGHTING'] == 'C') |\n",
    "                (DF['PCF_VIOL_CATEGORY'] == '10') & (DF['LIGHTING'] == 'C') |\n",
    "                (DF['PCF_VIOL_CATEGORY'] == '05') & (DF['LIGHTING'] == 'C') \n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '17') & (DF['LIGHTING'] == 'C')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '18') & (DF['LIGHTING'] == 'C')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '06') & (DF['LIGHTING'] == 'C')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '07') & (DF['LIGHTING'] == 'C')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '22') & (DF['LIGHTING'] == 'C')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '01') & (DF['LIGHTING'] == 'C')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '13') & (DF['LIGHTING'] == 'C')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '16') & (DF['LIGHTING'] == 'C')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '15') & (DF['LIGHTING'] == 'C')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '14') & (DF['LIGHTING'] == 'C')\n",
    "                | (DF['PCF_VIOL_CATEGORY'] == '02') & (DF['LIGHTING'] == 'C')] \n",
    "\n",
    "\n",
    "DF_EX4.PCF_VIOL_CATEGORY.value_counts().plot(color = 'r', label = 'Overall')\n",
    "DF_OB4.PCF_VIOL_CATEGORY.value_counts().plot(color = 'y', label = 'Street Lights On')\n",
    "plt.xlabel(\"Collision Violation\")\n",
    "plt.ylabel(\"Frequency of Collision\")\n",
    "plt.legend()\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Chi - Squared Test for Independence\n",
    "We want to further investigate and see if there is any possible association between street lighting and adverse weather conditions on MVAs. We can do this by using the Chi Squared test for independence on the total types of accidents occurred. This allows us to see if the accidents that occurred could possibly be dependent on the street lighting and weather. \n",
    "\n",
    "To start we set our hypothesis:\n",
    "- Ho: There is no association between MVA's and street lighting or adverse weather conditions.\n",
    "- Ha: There is an association between MVA's and street lighting or adverse weather conditions. \n",
    "\n",
    "Inference: \n",
    "- Two or more categorical groups for each data cell (Accident types).\n",
    "- Large Sample Size: Frequencies are at least 1, at least 5 for majority of cells.\n",
    "- Data is independent: These data sets do not depend on one another.\n",
    "\n",
    "Alpha:\n",
    "- .05"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 77,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The chi-squred value is: 38.7164875704 and the p - value is: 0.00480520182373 with 19 degrees of freedom\n"
     ]
    }
   ],
   "source": [
    "row1 = [] # Initialize 2 rows to see \n",
    "row2 = []\n",
    "\n",
    "## Looping over the observed values\n",
    "for i in range(len(DF['PCF_VIOL_CATEGORY'].value_counts())):\n",
    "    row1.append(len(DF.loc[(DF['PCF_VIOL_CATEGORY'] == DF['PCF_VIOL_CATEGORY'].value_counts().index[i]) \n",
    "                           & (DF['LIGHTING'] == 'C')]))\n",
    "    row2.append(len(DF.loc[(DF['PCF_VIOL_CATEGORY'] == DF['PCF_VIOL_CATEGORY'].value_counts().index[i]) \n",
    "                           & (DF['WEATHER_1'] == 'B')]))\n",
    "\n",
    "row1 = list(filter(lambda a: a != 0, row1)) # Removing outliers from expected value\n",
    "row2 = list(filter(lambda a: a != 0, row2))\n",
    "\n",
    "x_squared_data = [row1,row2] # Combining the observed results\n",
    "x_squared_value, x_p_value, x_df, x_expected_array = chi2_contingency(x_squared_data, correction=False)\n",
    "\n",
    "print(\"The chi-squred value is:\", x_squared_value, \"and the p - value is:\", x_p_value, \"with\", x_df, \"degrees of freedom\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Observation 5 (of test): \n",
    "Based on the p value, there is significant evidence at the .05 level to reject the null hypothesis. With a p value < .05 there is strong evidence that suggests that there is an association between MVA accidents and adverse weather and lighting conditions. \n",
    "\n",
    "This means that there could be more variance in the type of accidents that occurred with  "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAY8AAAENCAYAAAD34uk0AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAHHlJREFUeJzt3X+4HVV97/H3J4kE0AIJOYaYHyZqAIMKhmOkWgsWbGJR\nkrYUExSil5LbS8Af9T5A0Eesj2mRKig+DddcfhhQiJEgSVtBQ0QplRDCz5CElJQYkpjAEVS05QYT\nvvePWccMm3POntn77LPPPufzep55zpo1s2atvWef/d0za2aNIgIzM7MyhjS7AWZm1nocPMzMrDQH\nDzMzK83Bw8zMSnPwMDOz0hw8zMysNAcPMzMrrWHBQ9J1kp6R9FgXyz4tKSSNyuUtkLRF0mZJ03P5\nx0tan5ZdJUmNarOZmRXTyCOPbwIzKjMljQf+FHgqlzcFmA0ck8oskjQ0Lb4aOBeYnKZXbNPMzPpW\nw4JHRNwNPNfFoiuBC4H8re0zgaURsScitgJbgGmSxgCHRMSayG6FvwGY1ag2m5lZMcP6sjJJM4Gd\nEfFIxdmnscCa3PyOlPe7lK7Mr2rUqFExceLEutprZjbYPPDAA7+IiLZq6/VZ8JB0MHAJ2SmrRtUx\nD5gHMGHCBNatW9eoqszMBiRJ24qs15dXW70RmAQ8IulnwDjgQUlHADuB8bl1x6W8nSldmd+liFgc\nEe0R0d7WVjVwmplZjfoseETE+oh4bURMjIiJZKegpkbEbmAlMFvScEmTyDrG10bELuB5SSekq6zO\nBlb0VZvNzKxrjbxU92bgXuAoSTskndPduhGxAVgGbATuAOZHxL60+DzgGrJO9P8Ebm9Um83MrBgN\n1Od5tLe3h/s8zMzKkfRARLRXW893mJuZWWkOHmZmVpqDh5mZlebgYWZmpfXpHeZNdVMP4ymeOTAv\nGjAzaxQfeZiZWWkOHmZmVpqDh5mZlebgYWZmpTl4mJlZaQ4eZmZWmoOHmZmV5uBhZmalOXiYmVlp\nDh5mZlaag4eZmZXm4GFmZqU5eJiZWWkOHmZmVpqDh5mZlebgYWZmpTl4mJlZaQ0LHpKuk/SMpMdy\nef8o6XFJj0r6nqTDcssWSNoiabOk6bn84yWtT8uuktTDIwHNzKwvNPLI45vAjIq8VcBbIuJtwH8A\nCwAkTQFmA8ekMoskDU1lrgbOBSanqXKbZmbWxxoWPCLibuC5irwfRsTeNLsGGJfSM4GlEbEnIrYC\nW4BpksYAh0TEmogI4AZgVqPabGZmxTSzz+N/ALen9Fhge27ZjpQ3NqUr883MrImaEjwkfQbYC3y7\nl7c7T9I6Ses6Ojp6c9NmZpbT58FD0keBDwAfTqeiAHYC43OrjUt5O9l/aiuf36WIWBwR7RHR3tbW\n1qvtNjOz/fo0eEiaAVwInBYR/51btBKYLWm4pElkHeNrI2IX8LykE9JVVmcDK/qyzWZm9krDGrVh\nSTcDJwGjJO0ALiW7umo4sCpdcbsmIv4mIjZIWgZsJDudNT8i9qVNnUd25dZBZH0kt2NmZk3VsOAR\nEXO6yL62h/UXAgu7yF8HvKUXm2ZmZnVqWPAYUG7q4b7EM6P7ZWZmA5SHJzEzs9IcPMzMrDQHDzMz\nK83Bw8zMSnPwMDOz0hw8zMysNAcPMzMrzcHDzMxKc/AwM7PSHDzMzKw0Bw8zMyvNwcPMzEpz8DAz\ns9IcPMzMrDQPyd5oPQ3nDh7S3cxako88zMysNAcPMzMrzcHDzMxKc/AwM7PSHDzMzKw0Bw8zMyut\nYcFD0nWSnpH0WC5vpKRVkp5If0fkli2QtEXSZknTc/nHS1qfll0lqcq1r2Zm1miNPPL4JjCjIu9i\nYHVETAZWp3kkTQFmA8ekMoskDU1lrgbOBSanqXKbZmbWxxoWPCLibuC5iuyZwJKUXgLMyuUvjYg9\nEbEV2AJMkzQGOCQi1kREADfkypiZWZP0dZ/H6IjYldK7gdEpPRbYnltvR8obm9KV+WZm1kRN6zBP\nRxK9OjaHpHmS1kla19HR0ZubNjOznL4OHk+nU1Gkv8+k/J3A+Nx641LezpSuzO9SRCyOiPaIaG9r\na+vVhpuZ2X59HTxWAnNTei6wIpc/W9JwSZPIOsbXplNcz0s6IV1ldXaujJmZNUnDRtWVdDNwEjBK\n0g7gUuAyYJmkc4BtwBkAEbFB0jJgI7AXmB8R+9KmziO7cusg4PY0mZlZEzUseETEnG4WndzN+guB\nhV3krwPe0otNMzOzOvkOczMzK83Bw8zMSnPwMDOz0hw8zMysNAcPMzMrzcHDzMxKc/AwM7PSHDzM\nzKw0Bw8zMyvNwcPMzEpz8DAzs9IcPMzMrDQHDzMzK83Bw8zMSnPwMDOz0hw8zMystELBQ9JbG90Q\nMzNrHUWPPBZJWivpPEmHNrRFZmbW7xUKHhHxHuDDwHjgAUk3SXpfQ1tmZmb9VuE+j4h4AvgscBFw\nInCVpMcl/UWjGmdmZv1T0T6Pt0m6EtgE/AnwwYh4c0pf2cD2mZlZPzSs4HpfB64BLomIFzozI+Ln\nkj7bkJaZmVm/VfS01anATZ2BQ9IQSQcDRMSNZSuV9ClJGyQ9JulmSQdKGilplaQn0t8RufUXSNoi\nabOk6WXrMzOz3lU0eNwJHJSbPzjllSZpLPBxoD0i3gIMBWYDFwOrI2IysDrNI2lKWn4MMIPsyq+h\ntdRtZma9o2jwODAifts5k9IH11HvMOAgScPSdn4OzASWpOVLgFkpPRNYGhF7ImIrsAWYVkfdZmZW\np6LB478kTe2ckXQ88EIP63crInYCXwaeAnYBv46IHwKjI2JXWm03MDqlxwLbc5vYkfLMzKxJinaY\nfxL4rqSfAwKOAD5US4WpL2MmMAn4VdruR/LrRERIihq2PQ+YBzBhwoRammdmZgUUCh4Rcb+ko4Gj\nUtbmiPhdjXWeAmyNiA4ASbcC7wKeljQmInZJGgM8k9bfSXZzYqdxKa+rdi4GFgO0t7eXDj5mZlZM\nmYER3wG8DZgKzJF0do11PgWcIOlgSQJOJrt/ZCUwN60zF1iR0iuB2ZKGS5oETAbW1li3mZn1gkJH\nHpJuBN4IPAzsS9kB3FC2woi4T9ItwIPAXuAhsqOF1wDLJJ0DbAPOSOtvkLQM2JjWnx8R+7rcuJmZ\n9YmifR7twJSI6JVTQRFxKXBpRfYesqOQrtZfCCzsjbrNzKx+RU9bPUbWSW5mZlb4yGMUsFHSWrIj\nBAAi4rSGtMrMzPq1osHj841shHXjJvW8/ExfUGZmzVH0Ut2fSHo9MDki7kzjWnmIEDOzQarokOzn\nArcA30hZY4HbGtUoMzPr34p2mM8H3g08D79/MNRrG9UoMzPr34oGjz0R8WLnTBrQ0CfczcwGqaLB\n4yeSLiEbCfd9wHeBf25cs8zMrD8rGjwuBjqA9cD/BL5P9jxzMzMbhIpebfUS8H/TZGZmg1zRsa22\n0kUfR0S8oddbZGZm/V6Zsa06HQj8FTCy95tjZmatoFCfR0Q8m5t2RsRXgVMb3DYzM+unip62mpqb\nHUJ2JFL0qMXMzAaYogHgK7n0XuBnpOdtmJnZ4FP0aqv3NrohZmbWOoqetvrbnpZHxBW90xwzM2sF\nZa62egfZ88QBPkj2HPEnGtEoMzPr34oGj3HA1Ij4DYCkzwP/GhEfaVTDzMys/yo6PMlo4MXc/Isp\nz8zMBqGiRx43AGslfS/NzwKWNKZJZmbW3xW92mqhpNuB96Ssj0XEQ41rlpmZ9WdFT1sBHAw8HxFf\nA3ZImlRrpZIOk3SLpMclbZL0h5JGSlol6Yn0d0Ru/QWStkjaLGl6rfWamVnvKPoY2kuBi4AFKetV\nwLfqqPdrwB0RcTRwLLCJbNj31RExGVid5pE0BZgNHAPMABZJ8vPTzcyaqOiRx58DpwH/BRARPwf+\noJYKJR0K/DFwbdrWixHxK2Am+/tRlpD1q5Dyl0bEnojYCmwBptVSt5mZ9Y6iwePFiAjSsOySXl1H\nnZPIHix1vaSHJF2Ttjc6InaldXaz/2quscD2XPkdKc/MzJqkaPBYJukbwGGSzgXupPYHQw0DpgJX\nR8TbyY5mLs6vkA9UZUiaJ2mdpHUdHR01Ns/MzKopOiT7l4FbgOXAUcDnIuLrNda5A9gREfel+VvI\ngsnTksYApL/PpOU7gfG58uNSXlftXBwR7RHR3tbWVmPzzMysmqqX6qbO6TvT4Iir6q0wInZL2i7p\nqIjYDJwMbEzTXOCy9HdFKrISuEnSFcDrgMlkQ6OYmVmTVA0eEbFP0kuSDo2IX/dSvRcA35Z0APAk\n8DGyo6Blks4BtpGGfI+IDZKWkQWXvcD8iNjXS+0wM7MaFL3D/LfAekmrSFdcAUTEx2upNCIe5uWP\ntu10cjfrLwQW1lKXmZn1vqLB49Y0mZmZ9Rw8JE2IiKciwuNYmZnZ71W72uq2zoSk5Q1ui5mZtYhq\nwUO59Bsa2RAzM2sd1YJHdJM2M7NBrFqH+bGSnic7AjkopUnzERGHNLR1ZmbWL/UYPCLCo9eamdkr\nlHmeh5mZGeDgYWZmNXDwMDOz0hw8zMysNAcPMzMrzcHDzMxKc/AwM7PSHDzMzKw0Bw8zMyvNwcPM\nzEpz8DAzs9IcPMzMrDQHDzMzK83Bw8zMSnPwMDOz0poWPCQNlfSQpH9J8yMlrZL0RPo7IrfuAklb\nJG2WNL1ZbTYzs0wzjzw+AWzKzV8MrI6IycDqNI+kKcBs4BhgBrBIkh9SZWbWRE0JHpLGAacC1+Sy\nZwJLUnoJMCuXvzQi9kTEVmALMK2v2mpmZq/UrCOPrwIXAi/l8kZHxK6U3g2MTumxwPbcejtS3itI\nmidpnaR1HR0dvdxkMzPr1OfBQ9IHgGci4oHu1omIAKLstiNicUS0R0R7W1tbPc00M7MeDGtCne8G\nTpP0Z8CBwCGSvgU8LWlMROySNAZ4Jq2/ExifKz8u5ZmZWZP0+ZFHRCyIiHERMZGsI/xHEfERYCUw\nN602F1iR0iuB2ZKGS5oETAbW9nGzzcwspxlHHt25DFgm6RxgG3AGQERskLQM2AjsBeZHxL7mNdPM\nzJoaPCLix8CPU/pZ4ORu1lsILOyzhpmZWY98h7mZmZXWn05bWW+6ST0vP7P0xWxmZr/nIw8zMyvN\nwcPMzEpz8DAzs9Lc52Fd66nPxP0lZoOejzzMzKw0Bw8zMyvNwcPMzEpz8DAzs9IcPMzMrDQHDzMz\nK82X6lrv82W+ZgOejzzMzKw0Bw8zMyvNwcPMzEpzn4f1Lx5K3qwl+MjDzMxKc/AwM7PSHDzMzKw0\nBw8zMyutz4OHpPGS7pK0UdIGSZ9I+SMlrZL0RPo7IldmgaQtkjZLmt7XbTYzs5drxpHHXuDTETEF\nOAGYL2kKcDGwOiImA6vTPGnZbOAYYAawSNLQJrTbzMySPr9UNyJ2AbtS+jeSNgFjgZnASWm1JcCP\ngYtS/tKI2ANslbQFmAbc27ctt37Pl/ma9Zmm9nlImgi8HbgPGJ0CC8BuYHRKjwW254rtSHlmZtYk\nTQsekl4DLAc+GRHP55dFRAClfyZKmidpnaR1HR0dvdRSMzOr1JTgIelVZIHj2xFxa8p+WtKYtHwM\n8EzK3wmMzxUfl/JeISIWR0R7RLS3tbU1pvFmZtaUq60EXAtsiogrcotWAnNTei6wIpc/W9JwSZOA\nycDavmqvmZm9UjPGtno3cBawXtLDKe8S4DJgmaRzgG3AGQARsUHSMmAj2ZVa8yNiX98328zMOjXj\naqt7gO4uizm5mzILgYUNa5SZmZXiO8zNzKw0Bw8zMyvNwcPMzEpz8DAzs9IcPMzMrDQ/htYMPC6W\nWUk+8jAzs9IcPMzMrDSftjLrDT2d9vIpLxuAHDzMms39LdaCfNrKzMxKc/AwM7PSHDzMzKw0Bw8z\nMyvNwcPMzErz1VZmrcxXalmT+MjDzMxKc/AwM7PSHDzMzKw093mYDVbuL7E6OHiYWW08nteg5uBh\nZn3PgafltUyfh6QZkjZL2iLp4ma3x8xsMGuJIw9JQ4F/At4H7ADul7QyIjY2t2Vm1ufcV9MvtMqR\nxzRgS0Q8GREvAkuBmU1uk5nZoNUSRx7AWGB7bn4H8M4mtcXMWpWPWnqNIvr/myXpdGBGRPx1mj8L\neGdEnF+x3jxgXpo9CtjczSZHAb+oo0n1lB9sZZtZdyuWbWbdfs2tUbbRdb8+ItqqbiUi+v0E/CHw\ng9z8AmBBHdtbV2d7ai4/2Mq2arv9fvk199eyza67c2qVPo/7gcmSJkk6AJgNrGxym8zMBq2W6POI\niL2Szgd+AAwFrouIDU1ulpnZoNUSwQMgIr4PfL+XNre4ieUHW9lm1t2KZZtZt19za5Rtdt1Ai3SY\nm5lZ/9IqfR5mZtaPOHiYmVlpDh5mZlaag8cgIem1zW6D9W+SDm92G6x1DPjgIald0l2SviVpvKRV\nkn4t6X5Jb69S9ghJV0v6J0mHS/q8pPWSlkkaU6XsayR9QdKGVF+HpDWSPtqrL7DrukdWTIcDayWN\nkDSy0fX3N5Jur7J8Ri59qKRrJT0q6SZJo6uUPVTSZZIel/ScpGclbUp5h/XWa+htqX2jUrpd0pPA\nfZK2STqxStkHJX1W0htrqPcQSf8g6UZJZ1YsW1R2e7myPe7j/qieYF30x2Cj3m8YBMEDWARcDvwr\n8FPgGxFxKHBxWtaTbwIbycbVugt4Afgz4N+A/1Ol7LeBJ4HpwN8BVwFnAe+V9PfVGl3nTv8F8EBu\nWkc2PtiDKV2zAl/EvfZlKumIEutO7WY6HjiuSvH8/vgKsAv4INnNqd+oUnYZ8EvgpIgYGRGHA+9N\necsKtLueL+KafxgBp0ZE5xAV/wh8KCLeRDZy9VeqlB0BHAbcJWmtpE9Jel3BZl8PCFgOzJa0XNLw\ntOyEngrWuY/r/TFY8w+MVKaeYF3Pj8Ga3++qeuM29f48AQ/l0k91t6yGsg9XKftIxfz96e8Q4PEC\n7V4OXAbMIrubfjkwPC17sErZTwN3AG/N5W0t8Z5N7WY6HthVpewPgIuAI3J5R6S8H5bcdz2+zop1\n9wE/IgvyldMLReup3K8F9vPmWpbl9wvwZeApYC3wKeB1BV/zWuD9wByyHzinp/yTgXurlN0EDEvp\nNRXL1pd4v95D9iNsd3qv51UpW/n+fgb4d+DwAp/rmvdxKn8HcAHZD8dH02dyfMpbUeI1XwN8EXh9\n2l+3Fah7fS59F/COlD6SKsOFAC+lz0l++l36+2Sj3u+qr6mewq0wAfcCfwr8FbANmJXyTyyw0x7J\npb9YsezRKmV/CvxRSs/k5WNzFflSqWunA+OA7wJXAn9Q7UNWUbaeL+K6vkwr1u8xuFes+xgwuZtl\n26uU3QH8LVnQ3Uq6/6ngfv4hcCEwOpc3On0x3Vmg3fV8Edfzw+iC1PY/AT4PfC39T/wdcGPRNufy\nhgIzgOurlN0EDKnI+yiwAdjWqH1c4P2q9iOh5h8Yuddda7Cu+cdgPe931W3XU7gVJuBYsl/DtwNH\np3+SX6Y3791Vyn4BeE0X+W8CbilQ79pU1z3AkSm/Dfh4X+104DRgDbC7RJl6vojr+jKt2NZ5JdY9\nHTiqm2WzqpS9NDd9DmhL+UcAN1QpOwL4Utpfz6VpU8obWaDd9XwR1/zDKK13EvAdstOZ68lGcJgH\nvKpKuaVl9mNF2cuBU7rInwE80ah9nNbp6cdgtS/wmn9gpHVqDtapfOePwSso8WOwnve72jQo7jCX\n9GayX/+vIzv/t5PsMHVTgbJHp7JjU9ZOYGXBsp31jgWiZNnLyU7z3FmRPwP4ekRMLtHuV5P1v9xa\nsO7Tyf6ZXjGkvaRZEXFbD2VHkJ0WmAl0duo9TXbq7bKI+GW1+muVXvNY4L6I+G0uf0ZE3FGg7Cxq\n21f5/QzlPl9LI2J2tfW6KXss2ZfDS2SnT/4XMDfVf25E/LRK+fxrhuwLsuhrruf/orv99P6IqNan\nVk+9XwAuz9eZ8t9E9tk8vYeyl1ZkLYqIjtQvd3lEnF2g/pPI9tGRZENDbQduIxurb2+18mkbpwGX\nABMjolCfYD3vWY/bHejBQ9JFZKPwLiV70yCL4rPJfkFd1kPZC4EzU9kdJcvWXG+B1/SxiLi+St1z\naml3vXU3qmyBbX8cmE/2q/844BMRsSItezAipvZQ9kL2v19lPyNN28/1lM19Rm6mb/8vLgDOp/b9\nVFO91TTzc122vKSDgDdGxGMF9nPD3rOaD1laZQL+gy4Ow4EDqH6Y3JSyBV7TU/217kaVLbDt9aRT\njMBEsqvKPpHmq53/b8n93KzPSJ1lm7Kfmvlet+p+rja1zKi6dXiJ7HTVtor8MWlZfyyLpEe7W0TW\nh9Av666z3fUYEul0RET8LJ0iuEXS61PdPWnJ/dzEz0g9ZZu1n5r6uW7R/dyjwRA8PgmslvQE+5+D\nPoGs0/v8bks1tyxkH4rpZB3ueSK7kqu/1l1P2Xo8Lem4iHgYICJ+K+kDwHXAW6uUbdX93KzPSD1l\nm7WfoLmf61bczz0a8MEjIu6QdCQwjZd3GN0fEfv6Y9nkX8gO7x+uXCDpx/217jrL1uNs4GWdjpF1\nQp4tqccb/Vp1P9dTtomvuSn7KWnm57rl9nM1A77D3MzMet9gGJ7EzMx6mYOHmZmV5uBhA0Ya7O7h\nNO2WtDM3f0AftmOKpEckPSRpYhfL2yWFpFNq3P5QSf/WzbJvSZpV43anKjcAoFlPHDxswIiIZyPi\nuIg4jmzU4ys75yPixT5syl8AN0fE2yPiZ10sn0M2ZM2cWjYeEfsi4j11tK87U8mGrTCrysHDBjxJ\nfy/p/Nz8lyTNl3SKsiHNb5e0WdlQ3UrrvF/SvcqGTP+OpFd3sd2pku5TNjT3cmVDdZ9GdgnkBZLu\n7KLMEOAvyYYReX/+iEjSx9K2HpF0fco7QtKKXP47JQ2T9KvO7UlapGwI/FXAqNz23iHpJ5IeSK9x\ndMq/R9kQ4WvT635Xumv5c8CH05Fat0N1mAED/w5zT4NzIht87n+n9JvYPyT+ULJxvkYApwD/TXan\n81CykYRnkY3J9RPg4FTmM8AlXdSxkTS4JtkzQb6c0l8EPtlNu04kjbBM9ryPmSl9LPA4aTDF3N/l\nwPkpPQw4JP39Vco7g2zQzyFkw048n17DcLJ7AEal9T4MLE7pe4AvpfRpwB0p/dfAV5u97zy1xjTg\n7/Mwi4gtkn4j6a1kz2BYGxG/TAcZayKdWpK0FPijVGwK8NO0zgFkX7i/p+yBPAdGxL+nrCXAjQWa\n0zmGFunvHGAF2Wir34mI51Kbn0vrnEQ2DhGR3Q/xvKT8/+0fk50iewnYkbvu/83AMcCd6TUMZf/Y\nRgC3pr8PkAVPs1IcPGywuJZsSPuJvPzpgJU3OgXZnbt3RMRZvdkASa8i6w85VdkorUOAw7o6JdZF\nm0pXRzZUeHd9I3vS3334e8Bq4D4PGyyWkz1a9jgg3xdxgqQJkoaSnQK6h+x0z4mS3gAg6dWSXjYE\nfkQ8C7wg6V0p6yyyU109eR/Z6bPxETExIiYA/0w2XPaPgA8pPVZU+x8vehfwNylvqKRDKrZ5dyo3\nRNJYstNikJ1SGytpWip7gKRjqrTvN2TPijCrysHDBoWI+H9kX7Sdp3g6rSW7MmsjsJnsOQdPA+cA\n35H0CFkwObKLzZ4FXKls4LopZH0dPZkDfK8ibzkwJyIeIXs2x92SHiZ7rjhkne/TJa0nG4H26Iry\nt5A9wnYj2fOq702vdw/Zw5OuSO17CHhnlfb9CDg2XWLsDnPrkYcnsUEhXeX0MNkT555MeaeQdUbX\ndF+E2WDmIw8b8FJH+X+S9WM82ez2mA0EPvIwM7PSfORhZmalOXiYmVlpDh5mZlaag4eZmZXm4GFm\nZqU5eJiZWWn/HyVeAME42cLbAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x110832748>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "DF.PCF_VIOL_CATEGORY.value_counts().plot.bar(color = 'orange')\n",
    "plt.xlabel('Type of Accident')\n",
    "plt.ylabel('Frequency')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Observation 6\n",
    "Finally, we move onto the types of accidents that occur. Based on the Statewide Integrated Traffic Records System (SWITRS), the type of accidents that usual occur are:\n",
    "\n",
    "- 01 - Driving or Bicycling Under the Influence of Alcohol or Drug\n",
    "- 02 - Impeding Traffic\n",
    "- 03 - Unsafe Speed\n",
    "- 04 - Following Too Closely\n",
    "- 05 - Wrong Side of Road\n",
    "- 06 - Improper Passing\n",
    "- 07 - Unsafe Lane Change\n",
    "- 08 - Improper Turning\n",
    "- 09 - Automobile Right of Way\n",
    "- 10 - Pedestrian Right of Way\n",
    "- 11 - Pedestrian Violation\n",
    "- 12 - Traffic Signals and Signs\n",
    "- 13 - Hazardous Parking\n",
    "- 14 - Lights\n",
    "- 15 - Brakes\n",
    "- 16 - Other Equipment\n",
    "- 17 - Other Hazardous Violation\n",
    "- 18 - Other Than Driver (or Pedestrian)\n",
    "- 19 - Unknown\n",
    "- 20 - Unkown\n",
    "- 21 - Unsafe Starting or Backing\n",
    "- 22 - Other Improper Driving\n",
    "- 23 - Pedestrian or \"Other\" Under the Influence of Alcohol or Drug\n",
    "- 24 - Fell Asleep\n",
    "- 00 - Unknown\n",
    "- -- Not Stated\n",
    "\n",
    "On the above chart, we see the majority of the \"techinical\" accidents [08 -> 04] be more right skewed whereas the more environmentally operation accidents (EOA) [11 -> 02] seem to occur less frequently. With the information from the collision violation vs frequency of collision graph and the chi squared test, we can start to infer the EOA type accidents would seem to rely on the lighting of the situation whereas the techinical accidents don't. The results of our study seem to indicate that though accidents could be caused by the infrastructure (lighting), the majority of accidents happen outside of these variables. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 79,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "387"
      ]
     },
     "execution_count": 79,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "815\n",
      "428\n"
     ]
    }
   ],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": 48,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "928\n",
      "205\n"
     ]
    }
   ],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": 89,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'Good'"
      ]
     },
     "execution_count": 89,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": []
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "## Discussion \n",
    "\n",
    "From our data so far, we can say based on the chi-square statistical analysis that there is likely very little correlation between OCI, weather, and lighting (p-value=0.968620556964), we can assume that there may be a connection between MVAs, lighting, and weather (p-value=0.00480520182373). However, in order to truly provide evidence against our initial hypothesis, we need to conduct statistical analysis of the relationship between OCI and MVAs. This is a fundamental constituent of our study that we unfortunately have to spend more time on during the week before presentation and project submission, simply due to the fact that this project is very much a learning experience for every single one of us in the group. In addition to this, statistical analyis should, and will be done on types of accidents, and their relations to weather, lighting, and OCI. In regards to a solution, it would be far-stretched to assume that any 'solution' given at this time adequately represents the end solution to our project. The truth of the matter is that we have technically not provided enough evidence to uphold the null hypothesis (which states that our initial hypothesis is wrong), and because of this, we can not provide a solid solution to anything. The only inkling of correlation that occurs in our study is between MVAs, lighting, and weather. Any solution in this regard would be oriented around distributed a greater amount of funds to more appropriate lighting, or even perhaps funding towards providing the city of San Diego with better information on how to cope with weather while operating vehicles and employ safer techniques while driving. But again, to suggest that this an actual solution at this time would be shortsighted and a complete disregard to the further work that needs to be done for our project. While the analysis has been difficult in areas, there is some good indication that we find, not just influences of MVAs, but influences that can be addressed by the city of San Diego itself--Especially if our statistical analyis follows the trend of highlighting correlations between MVAs, lighting, and weather like it has been. In the interim, though, our group will seek the help of our TAs and professor in regards to running statistical analysis of OCI relative to MVAs. Once this is completed, we will be able to confidently move towards our alternative hypothesis, or even search for other influences that coincide more with our null hypothesis (such as weather and lighting). "
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.0"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}