5. Loading and Visualizing Network Data (Student).ipynb

{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": false,
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import networkx as nx\n",
    "import os\n",
    "import numpy as np\n",
    "import warnings\n",
    "import numpy as np\n",
    "import matplotlib.pyplot as plt\n",
    "\n",
    "from circos import CircosPlot\n",
    "warnings.filterwarnings('ignore')\n",
    "\n",
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "# Tables to Networks, Networks to Tables\n",
    "\n",
    "Networks can be represented in a tabular form in two ways: As an adjacency list with edge attributes stored as columnar values, and as a node list with node attributes stored as columnar values.\n",
    "\n",
    "Storing the network data as a single massive adjacency table, with node attributes repeated on each row, can get unwieldy, especially if the graph is large, or grows to be so. One way to get around this is to store two files: one with node data and node attributes, and one with edge data and edge attributes. \n",
    "\n",
    "The Divvy bike sharing dataset is one such example of a network data set that has been stored as such."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "# Loading Node Lists and Adjacency Lists\n",
    "\n",
    "Let's use the Divvy bike sharing data set as a starting point. The Divvy data set is comprised of the following data:\n",
    "\n",
    "- Stations and metadata (like a node list with attributes saved)\n",
    "- Trips and metadata (like an edge list with attributes saved)\n",
    "\n",
    "The `README.txt` file in the Divvy directory should help orient you around the data."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": false,
    "slideshow": {
     "slide_type": "fragment"
    }
   },
   "outputs": [],
   "source": [
    "# This block of code checks to make sure that a particular directory is present.\n",
    "if \"divvy_2013\" not in os.listdir('datasets/'):\n",
    "    print('Unzip the divvy_2013.zip file in the datasets folder.')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": false,
    "scrolled": true,
    "slideshow": {
     "slide_type": "subslide"
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>name</th>\n",
       "      <th>latitude</th>\n",
       "      <th>longitude</th>\n",
       "      <th>dpcapacity</th>\n",
       "      <th>landmark</th>\n",
       "      <th>online date</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>id</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>State St &amp; Harrison St</td>\n",
       "      <td>41.873958</td>\n",
       "      <td>-87.627739</td>\n",
       "      <td>19</td>\n",
       "      <td>30</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>Wilton Ave &amp; Diversey Pkwy</td>\n",
       "      <td>41.932500</td>\n",
       "      <td>-87.652681</td>\n",
       "      <td>19</td>\n",
       "      <td>66</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Morgan St &amp; 18th St</td>\n",
       "      <td>41.858086</td>\n",
       "      <td>-87.651073</td>\n",
       "      <td>15</td>\n",
       "      <td>163</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>Racine Ave &amp; 18th St</td>\n",
       "      <td>41.858181</td>\n",
       "      <td>-87.656487</td>\n",
       "      <td>15</td>\n",
       "      <td>164</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>Wood St &amp; North Ave</td>\n",
       "      <td>41.910329</td>\n",
       "      <td>-87.672516</td>\n",
       "      <td>15</td>\n",
       "      <td>223</td>\n",
       "      <td>2013-08-12</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>Wood St &amp; Division St</td>\n",
       "      <td>41.903320</td>\n",
       "      <td>-87.672730</td>\n",
       "      <td>15</td>\n",
       "      <td>246</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>Loomis St &amp; Taylor St</td>\n",
       "      <td>41.869417</td>\n",
       "      <td>-87.660996</td>\n",
       "      <td>15</td>\n",
       "      <td>139</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>Sheffield Ave &amp; Kingsbury St</td>\n",
       "      <td>41.909592</td>\n",
       "      <td>-87.653497</td>\n",
       "      <td>15</td>\n",
       "      <td>154</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>Aberdeen St &amp; Jackson Blvd</td>\n",
       "      <td>41.877726</td>\n",
       "      <td>-87.654787</td>\n",
       "      <td>15</td>\n",
       "      <td>157</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>May St &amp; Taylor St</td>\n",
       "      <td>41.869482</td>\n",
       "      <td>-87.655486</td>\n",
       "      <td>15</td>\n",
       "      <td>160</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>Orleans St &amp; Elm St</td>\n",
       "      <td>41.902924</td>\n",
       "      <td>-87.637715</td>\n",
       "      <td>15</td>\n",
       "      <td>172</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>Fairbanks Ct &amp; Grand Ave</td>\n",
       "      <td>41.891860</td>\n",
       "      <td>-87.620620</td>\n",
       "      <td>15</td>\n",
       "      <td>262</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>Michigan Ave &amp; Pearson St</td>\n",
       "      <td>41.897660</td>\n",
       "      <td>-87.623510</td>\n",
       "      <td>23</td>\n",
       "      <td>34</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>McClurg Ct &amp; Illinois St</td>\n",
       "      <td>41.891020</td>\n",
       "      <td>-87.617300</td>\n",
       "      <td>23</td>\n",
       "      <td>51</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>Larrabee St &amp; North Ave</td>\n",
       "      <td>41.910210</td>\n",
       "      <td>-87.643500</td>\n",
       "      <td>19</td>\n",
       "      <td>174</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>Larrabee St &amp; Menomonee St</td>\n",
       "      <td>41.914680</td>\n",
       "      <td>-87.643320</td>\n",
       "      <td>15</td>\n",
       "      <td>282</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>Noble St &amp; Milwaukee Ave</td>\n",
       "      <td>41.900680</td>\n",
       "      <td>-87.662600</td>\n",
       "      <td>15</td>\n",
       "      <td>290</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>Ashland Ave &amp; Augusta Blvd</td>\n",
       "      <td>41.899643</td>\n",
       "      <td>-87.667700</td>\n",
       "      <td>15</td>\n",
       "      <td>248</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>Franklin St &amp; Chicago Ave</td>\n",
       "      <td>41.896802</td>\n",
       "      <td>-87.635638</td>\n",
       "      <td>23</td>\n",
       "      <td>17</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32</th>\n",
       "      <td>Racine Ave &amp; Congress Pkwy</td>\n",
       "      <td>41.874640</td>\n",
       "      <td>-87.657030</td>\n",
       "      <td>19</td>\n",
       "      <td>76</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>State St &amp; Van Buren St</td>\n",
       "      <td>41.877181</td>\n",
       "      <td>-87.627844</td>\n",
       "      <td>27</td>\n",
       "      <td>3</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>34</th>\n",
       "      <td>Cannon Dr &amp; Fullerton Ave</td>\n",
       "      <td>41.926756</td>\n",
       "      <td>-87.634429</td>\n",
       "      <td>15</td>\n",
       "      <td>124</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35</th>\n",
       "      <td>Streeter Dr &amp; Illinois St</td>\n",
       "      <td>41.891071</td>\n",
       "      <td>-87.612200</td>\n",
       "      <td>35</td>\n",
       "      <td>22</td>\n",
       "      <td>2013-08-05</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>36</th>\n",
       "      <td>Franklin St &amp; Jackson Blvd</td>\n",
       "      <td>41.877708</td>\n",
       "      <td>-87.635321</td>\n",
       "      <td>27</td>\n",
       "      <td>19</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>37</th>\n",
       "      <td>Dearborn St &amp; Adams St</td>\n",
       "      <td>41.879356</td>\n",
       "      <td>-87.629791</td>\n",
       "      <td>19</td>\n",
       "      <td>20</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>42</th>\n",
       "      <td>Wabash Ave &amp; Cermak Rd</td>\n",
       "      <td>41.853239</td>\n",
       "      <td>-87.625337</td>\n",
       "      <td>15</td>\n",
       "      <td>170</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>43</th>\n",
       "      <td>Michigan Ave &amp; Washington St</td>\n",
       "      <td>41.883893</td>\n",
       "      <td>-87.624649</td>\n",
       "      <td>43</td>\n",
       "      <td>1</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>44</th>\n",
       "      <td>State St &amp; Randolph St</td>\n",
       "      <td>41.884730</td>\n",
       "      <td>-87.627734</td>\n",
       "      <td>27</td>\n",
       "      <td>2</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>45</th>\n",
       "      <td>Michigan Ave &amp; Congress Pkwy</td>\n",
       "      <td>41.876066</td>\n",
       "      <td>-87.624433</td>\n",
       "      <td>15</td>\n",
       "      <td>40</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46</th>\n",
       "      <td>Wells St &amp; Walton St</td>\n",
       "      <td>41.899930</td>\n",
       "      <td>-87.634430</td>\n",
       "      <td>19</td>\n",
       "      <td>46</td>\n",
       "      <td>2013-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>322</th>\n",
       "      <td>Kimbark Ave &amp; 53rd St</td>\n",
       "      <td>41.799568</td>\n",
       "      <td>-87.594747</td>\n",
       "      <td>15</td>\n",
       "      <td>397</td>\n",
       "      <td>2013-09-21</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>323</th>\n",
       "      <td>Sheridan Rd &amp; Lawrence Ave</td>\n",
       "      <td>41.969517</td>\n",
       "      <td>-87.654691</td>\n",
       "      <td>15</td>\n",
       "      <td>384</td>\n",
       "      <td>2013-09-23</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>324</th>\n",
       "      <td>Stockton Dr &amp; Wrightwood Ave</td>\n",
       "      <td>41.931320</td>\n",
       "      <td>-87.638742</td>\n",
       "      <td>15</td>\n",
       "      <td>276</td>\n",
       "      <td>2013-10-03</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>325</th>\n",
       "      <td>Clark St &amp; Winnemac Ave</td>\n",
       "      <td>41.973385</td>\n",
       "      <td>-87.668365</td>\n",
       "      <td>15</td>\n",
       "      <td>392</td>\n",
       "      <td>2013-09-23</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>326</th>\n",
       "      <td>Clark St &amp; Leland Ave</td>\n",
       "      <td>41.967096</td>\n",
       "      <td>-87.667429</td>\n",
       "      <td>11</td>\n",
       "      <td>239</td>\n",
       "      <td>2013-09-27</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>327</th>\n",
       "      <td>Sheffield Ave &amp; Webster Ave</td>\n",
       "      <td>41.921687</td>\n",
       "      <td>-87.653714</td>\n",
       "      <td>19</td>\n",
       "      <td>188</td>\n",
       "      <td>2013-09-25</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>328</th>\n",
       "      <td>Ellis Ave &amp; 58th St</td>\n",
       "      <td>41.788746</td>\n",
       "      <td>-87.601334</td>\n",
       "      <td>15</td>\n",
       "      <td>365</td>\n",
       "      <td>2013-09-25</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>329</th>\n",
       "      <td>Lake Shore Dr &amp; Diversey Pkwy</td>\n",
       "      <td>41.932684</td>\n",
       "      <td>-87.636250</td>\n",
       "      <td>15</td>\n",
       "      <td>347</td>\n",
       "      <td>2013-09-25</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>330</th>\n",
       "      <td>Lincoln Ave &amp; Addison St</td>\n",
       "      <td>41.946176</td>\n",
       "      <td>-87.673308</td>\n",
       "      <td>19</td>\n",
       "      <td>77</td>\n",
       "      <td>2013-09-26</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>331</th>\n",
       "      <td>Halsted St &amp; Blackhawk St</td>\n",
       "      <td>41.908540</td>\n",
       "      <td>-87.648568</td>\n",
       "      <td>19</td>\n",
       "      <td>176</td>\n",
       "      <td>2013-09-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>332</th>\n",
       "      <td>Halsted St &amp; Diversey Pkwy</td>\n",
       "      <td>41.933341</td>\n",
       "      <td>-87.648747</td>\n",
       "      <td>15</td>\n",
       "      <td>208</td>\n",
       "      <td>2013-09-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>333</th>\n",
       "      <td>Ashland Ave &amp; Blackhawk St</td>\n",
       "      <td>41.907066</td>\n",
       "      <td>-87.667252</td>\n",
       "      <td>15</td>\n",
       "      <td>224</td>\n",
       "      <td>2013-09-27</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>334</th>\n",
       "      <td>Lake Shore Dr &amp; Belmont Ave</td>\n",
       "      <td>41.940775</td>\n",
       "      <td>-87.639192</td>\n",
       "      <td>19</td>\n",
       "      <td>233</td>\n",
       "      <td>2013-09-27</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>335</th>\n",
       "      <td>Calumet Ave &amp; 35th St</td>\n",
       "      <td>41.831379</td>\n",
       "      <td>-87.618034</td>\n",
       "      <td>15</td>\n",
       "      <td>345</td>\n",
       "      <td>2013-10-17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>336</th>\n",
       "      <td>Cottage Grove Ave &amp; 47th St</td>\n",
       "      <td>41.809855</td>\n",
       "      <td>-87.606755</td>\n",
       "      <td>15</td>\n",
       "      <td>422</td>\n",
       "      <td>2013-10-17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>337</th>\n",
       "      <td>Clark St &amp; Chicago Ave</td>\n",
       "      <td>41.896544</td>\n",
       "      <td>-87.630931</td>\n",
       "      <td>19</td>\n",
       "      <td>303</td>\n",
       "      <td>2013-09-27</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>338</th>\n",
       "      <td>Calumet Ave &amp; 18th St</td>\n",
       "      <td>41.857611</td>\n",
       "      <td>-87.619407</td>\n",
       "      <td>15</td>\n",
       "      <td>102</td>\n",
       "      <td>2013-09-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>339</th>\n",
       "      <td>Emerald Ave &amp; 31st St</td>\n",
       "      <td>41.838198</td>\n",
       "      <td>-87.645143</td>\n",
       "      <td>11</td>\n",
       "      <td>404</td>\n",
       "      <td>2013-09-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>340</th>\n",
       "      <td>Clark St &amp; Wrightwood Ave</td>\n",
       "      <td>41.929546</td>\n",
       "      <td>-87.643118</td>\n",
       "      <td>15</td>\n",
       "      <td>209</td>\n",
       "      <td>2013-10-24</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>341</th>\n",
       "      <td>Adler Planetarium</td>\n",
       "      <td>41.866095</td>\n",
       "      <td>-87.607267</td>\n",
       "      <td>19</td>\n",
       "      <td>431</td>\n",
       "      <td>2013-10-09</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>342</th>\n",
       "      <td>Wolcott Ave &amp; Polk St</td>\n",
       "      <td>41.871262</td>\n",
       "      <td>-87.673688</td>\n",
       "      <td>15</td>\n",
       "      <td>284</td>\n",
       "      <td>2013-10-12</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>343</th>\n",
       "      <td>Racine Ave &amp; Wrightwood Ave</td>\n",
       "      <td>41.928887</td>\n",
       "      <td>-87.658971</td>\n",
       "      <td>15</td>\n",
       "      <td>297</td>\n",
       "      <td>2013-10-24</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>344</th>\n",
       "      <td>Wolcott Ave &amp; Lawrence Ave</td>\n",
       "      <td>41.968641</td>\n",
       "      <td>-87.676335</td>\n",
       "      <td>15</td>\n",
       "      <td>26</td>\n",
       "      <td>2013-10-09</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>345</th>\n",
       "      <td>Lake Park Ave &amp; 56th St</td>\n",
       "      <td>41.793242</td>\n",
       "      <td>-87.587782</td>\n",
       "      <td>15</td>\n",
       "      <td>119</td>\n",
       "      <td>2013-10-09</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>346</th>\n",
       "      <td>Ada St &amp; Washington Blvd</td>\n",
       "      <td>41.882830</td>\n",
       "      <td>-87.661206</td>\n",
       "      <td>15</td>\n",
       "      <td>353</td>\n",
       "      <td>2013-10-10</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>347</th>\n",
       "      <td>Ashland Ave &amp; Grace St</td>\n",
       "      <td>41.950687</td>\n",
       "      <td>-87.668700</td>\n",
       "      <td>15</td>\n",
       "      <td>319</td>\n",
       "      <td>2013-10-12</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>348</th>\n",
       "      <td>California Ave &amp; 21st St</td>\n",
       "      <td>41.854016</td>\n",
       "      <td>-87.695445</td>\n",
       "      <td>15</td>\n",
       "      <td>96</td>\n",
       "      <td>2013-10-14</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>349</th>\n",
       "      <td>Halsted St &amp; Wrightwood Ave</td>\n",
       "      <td>41.929143</td>\n",
       "      <td>-87.649077</td>\n",
       "      <td>15</td>\n",
       "      <td>210</td>\n",
       "      <td>2013-10-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>350</th>\n",
       "      <td>Ashland Ave &amp; Chicago Ave</td>\n",
       "      <td>41.895966</td>\n",
       "      <td>-87.667747</td>\n",
       "      <td>15</td>\n",
       "      <td>247</td>\n",
       "      <td>2013-10-22</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>351</th>\n",
       "      <td>Cottage Grove Ave &amp; 51st St</td>\n",
       "      <td>41.803038</td>\n",
       "      <td>-87.606615</td>\n",
       "      <td>15</td>\n",
       "      <td>440</td>\n",
       "      <td>2013-10-17</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>300 rows × 6 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                              name   latitude  longitude  dpcapacity  \\\n",
       "id                                                                     \n",
       "5           State St & Harrison St  41.873958 -87.627739          19   \n",
       "13      Wilton Ave & Diversey Pkwy  41.932500 -87.652681          19   \n",
       "14             Morgan St & 18th St  41.858086 -87.651073          15   \n",
       "15            Racine Ave & 18th St  41.858181 -87.656487          15   \n",
       "16             Wood St & North Ave  41.910329 -87.672516          15   \n",
       "17           Wood St & Division St  41.903320 -87.672730          15   \n",
       "19           Loomis St & Taylor St  41.869417 -87.660996          15   \n",
       "20    Sheffield Ave & Kingsbury St  41.909592 -87.653497          15   \n",
       "21      Aberdeen St & Jackson Blvd  41.877726 -87.654787          15   \n",
       "22              May St & Taylor St  41.869482 -87.655486          15   \n",
       "23             Orleans St & Elm St  41.902924 -87.637715          15   \n",
       "24        Fairbanks Ct & Grand Ave  41.891860 -87.620620          15   \n",
       "25       Michigan Ave & Pearson St  41.897660 -87.623510          23   \n",
       "26        McClurg Ct & Illinois St  41.891020 -87.617300          23   \n",
       "27         Larrabee St & North Ave  41.910210 -87.643500          19   \n",
       "28      Larrabee St & Menomonee St  41.914680 -87.643320          15   \n",
       "29        Noble St & Milwaukee Ave  41.900680 -87.662600          15   \n",
       "30      Ashland Ave & Augusta Blvd  41.899643 -87.667700          15   \n",
       "31       Franklin St & Chicago Ave  41.896802 -87.635638          23   \n",
       "32      Racine Ave & Congress Pkwy  41.874640 -87.657030          19   \n",
       "33         State St & Van Buren St  41.877181 -87.627844          27   \n",
       "34       Cannon Dr & Fullerton Ave  41.926756 -87.634429          15   \n",
       "35       Streeter Dr & Illinois St  41.891071 -87.612200          35   \n",
       "36      Franklin St & Jackson Blvd  41.877708 -87.635321          27   \n",
       "37          Dearborn St & Adams St  41.879356 -87.629791          19   \n",
       "42          Wabash Ave & Cermak Rd  41.853239 -87.625337          15   \n",
       "43    Michigan Ave & Washington St  41.883893 -87.624649          43   \n",
       "44          State St & Randolph St  41.884730 -87.627734          27   \n",
       "45    Michigan Ave & Congress Pkwy  41.876066 -87.624433          15   \n",
       "46            Wells St & Walton St  41.899930 -87.634430          19   \n",
       "..                             ...        ...        ...         ...   \n",
       "322          Kimbark Ave & 53rd St  41.799568 -87.594747          15   \n",
       "323     Sheridan Rd & Lawrence Ave  41.969517 -87.654691          15   \n",
       "324   Stockton Dr & Wrightwood Ave  41.931320 -87.638742          15   \n",
       "325        Clark St & Winnemac Ave  41.973385 -87.668365          15   \n",
       "326          Clark St & Leland Ave  41.967096 -87.667429          11   \n",
       "327    Sheffield Ave & Webster Ave  41.921687 -87.653714          19   \n",
       "328            Ellis Ave & 58th St  41.788746 -87.601334          15   \n",
       "329  Lake Shore Dr & Diversey Pkwy  41.932684 -87.636250          15   \n",
       "330       Lincoln Ave & Addison St  41.946176 -87.673308          19   \n",
       "331      Halsted St & Blackhawk St  41.908540 -87.648568          19   \n",
       "332     Halsted St & Diversey Pkwy  41.933341 -87.648747          15   \n",
       "333     Ashland Ave & Blackhawk St  41.907066 -87.667252          15   \n",
       "334    Lake Shore Dr & Belmont Ave  41.940775 -87.639192          19   \n",
       "335          Calumet Ave & 35th St  41.831379 -87.618034          15   \n",
       "336    Cottage Grove Ave & 47th St  41.809855 -87.606755          15   \n",
       "337         Clark St & Chicago Ave  41.896544 -87.630931          19   \n",
       "338          Calumet Ave & 18th St  41.857611 -87.619407          15   \n",
       "339          Emerald Ave & 31st St  41.838198 -87.645143          11   \n",
       "340      Clark St & Wrightwood Ave  41.929546 -87.643118          15   \n",
       "341              Adler Planetarium  41.866095 -87.607267          19   \n",
       "342          Wolcott Ave & Polk St  41.871262 -87.673688          15   \n",
       "343    Racine Ave & Wrightwood Ave  41.928887 -87.658971          15   \n",
       "344     Wolcott Ave & Lawrence Ave  41.968641 -87.676335          15   \n",
       "345        Lake Park Ave & 56th St  41.793242 -87.587782          15   \n",
       "346       Ada St & Washington Blvd  41.882830 -87.661206          15   \n",
       "347         Ashland Ave & Grace St  41.950687 -87.668700          15   \n",
       "348       California Ave & 21st St  41.854016 -87.695445          15   \n",
       "349    Halsted St & Wrightwood Ave  41.929143 -87.649077          15   \n",
       "350      Ashland Ave & Chicago Ave  41.895966 -87.667747          15   \n",
       "351    Cottage Grove Ave & 51st St  41.803038 -87.606615          15   \n",
       "\n",
       "     landmark online date  \n",
       "id                         \n",
       "5          30  2013-06-28  \n",
       "13         66  2013-06-28  \n",
       "14        163  2013-06-28  \n",
       "15        164  2013-06-28  \n",
       "16        223  2013-08-12  \n",
       "17        246  2013-06-28  \n",
       "19        139  2013-06-28  \n",
       "20        154  2013-06-28  \n",
       "21        157  2013-06-28  \n",
       "22        160  2013-06-28  \n",
       "23        172  2013-06-28  \n",
       "24        262  2013-06-28  \n",
       "25         34  2013-06-28  \n",
       "26         51  2013-06-28  \n",
       "27        174  2013-06-28  \n",
       "28        282  2013-06-28  \n",
       "29        290  2013-06-28  \n",
       "30        248  2013-06-28  \n",
       "31         17  2013-06-28  \n",
       "32         76  2013-06-28  \n",
       "33          3  2013-06-28  \n",
       "34        124  2013-06-28  \n",
       "35         22  2013-08-05  \n",
       "36         19  2013-06-28  \n",
       "37         20  2013-06-28  \n",
       "42        170  2013-06-28  \n",
       "43          1  2013-06-28  \n",
       "44          2  2013-06-28  \n",
       "45         40  2013-06-28  \n",
       "46         46  2013-06-28  \n",
       "..        ...         ...  \n",
       "322       397  2013-09-21  \n",
       "323       384  2013-09-23  \n",
       "324       276  2013-10-03  \n",
       "325       392  2013-09-23  \n",
       "326       239  2013-09-27  \n",
       "327       188  2013-09-25  \n",
       "328       365  2013-09-25  \n",
       "329       347  2013-09-25  \n",
       "330        77  2013-09-26  \n",
       "331       176  2013-09-28  \n",
       "332       208  2013-09-28  \n",
       "333       224  2013-09-27  \n",
       "334       233  2013-09-27  \n",
       "335       345  2013-10-17  \n",
       "336       422  2013-10-17  \n",
       "337       303  2013-09-27  \n",
       "338       102  2013-09-28  \n",
       "339       404  2013-09-28  \n",
       "340       209  2013-10-24  \n",
       "341       431  2013-10-09  \n",
       "342       284  2013-10-12  \n",
       "343       297  2013-10-24  \n",
       "344        26  2013-10-09  \n",
       "345       119  2013-10-09  \n",
       "346       353  2013-10-10  \n",
       "347       319  2013-10-12  \n",
       "348        96  2013-10-14  \n",
       "349       210  2013-10-28  \n",
       "350       247  2013-10-22  \n",
       "351       440  2013-10-17  \n",
       "\n",
       "[300 rows x 6 columns]"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "stations = pd.read_csv('datasets/divvy_2013/Divvy_Stations_2013.csv', parse_dates=['online date'], index_col='id', encoding='utf-8')\n",
    "stations"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": false,
    "scrolled": false,
    "slideshow": {
     "slide_type": "subslide"
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>starttime</th>\n",
       "      <th>stoptime</th>\n",
       "      <th>bikeid</th>\n",
       "      <th>tripduration</th>\n",
       "      <th>from_station_id</th>\n",
       "      <th>from_station_name</th>\n",
       "      <th>to_station_id</th>\n",
       "      <th>to_station_name</th>\n",
       "      <th>usertype</th>\n",
       "      <th>gender</th>\n",
       "      <th>birthday</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>trip_id</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>3940</th>\n",
       "      <td>2013-06-27 01:06:00</td>\n",
       "      <td>2013-06-27 09:46:00</td>\n",
       "      <td>914</td>\n",
       "      <td>31177</td>\n",
       "      <td>91</td>\n",
       "      <td>Clinton St &amp; Washington Blvd</td>\n",
       "      <td>48</td>\n",
       "      <td>Larrabee St &amp; Kingsbury St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1982.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4095</th>\n",
       "      <td>2013-06-27 12:06:00</td>\n",
       "      <td>2013-06-27 12:11:00</td>\n",
       "      <td>480</td>\n",
       "      <td>301</td>\n",
       "      <td>85</td>\n",
       "      <td>Michigan Ave &amp; Oak St</td>\n",
       "      <td>85</td>\n",
       "      <td>Michigan Ave &amp; Oak St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1982.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4113</th>\n",
       "      <td>2013-06-27 11:09:00</td>\n",
       "      <td>2013-06-27 11:11:00</td>\n",
       "      <td>711</td>\n",
       "      <td>140</td>\n",
       "      <td>88</td>\n",
       "      <td>May St &amp; Randolph St</td>\n",
       "      <td>88</td>\n",
       "      <td>May St &amp; Randolph St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1982.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4118</th>\n",
       "      <td>2013-06-27 12:11:00</td>\n",
       "      <td>2013-06-27 12:16:00</td>\n",
       "      <td>480</td>\n",
       "      <td>316</td>\n",
       "      <td>85</td>\n",
       "      <td>Michigan Ave &amp; Oak St</td>\n",
       "      <td>28</td>\n",
       "      <td>Larrabee St &amp; Menomonee St</td>\n",
       "      <td>Customer</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4119</th>\n",
       "      <td>2013-06-27 11:12:00</td>\n",
       "      <td>2013-06-27 11:13:00</td>\n",
       "      <td>711</td>\n",
       "      <td>87</td>\n",
       "      <td>88</td>\n",
       "      <td>May St &amp; Randolph St</td>\n",
       "      <td>88</td>\n",
       "      <td>May St &amp; Randolph St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1982.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4134</th>\n",
       "      <td>2013-06-27 11:24:00</td>\n",
       "      <td>2013-06-27 14:38:00</td>\n",
       "      <td>145</td>\n",
       "      <td>11674</td>\n",
       "      <td>17</td>\n",
       "      <td>Wood St &amp; Division St</td>\n",
       "      <td>61</td>\n",
       "      <td>Wood St &amp; Milwaukee Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1978.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4162</th>\n",
       "      <td>2013-06-27 11:39:00</td>\n",
       "      <td>2013-06-27 16:01:00</td>\n",
       "      <td>711</td>\n",
       "      <td>15758</td>\n",
       "      <td>88</td>\n",
       "      <td>May St &amp; Randolph St</td>\n",
       "      <td>34</td>\n",
       "      <td>Cannon Dr &amp; Fullerton Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1982.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4192</th>\n",
       "      <td>2013-06-27 12:15:00</td>\n",
       "      <td>2013-06-27 12:16:00</td>\n",
       "      <td>303</td>\n",
       "      <td>60</td>\n",
       "      <td>28</td>\n",
       "      <td>Larrabee St &amp; Menomonee St</td>\n",
       "      <td>28</td>\n",
       "      <td>Larrabee St &amp; Menomonee St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1982.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4216</th>\n",
       "      <td>2013-06-27 13:00:00</td>\n",
       "      <td>2013-06-27 13:03:00</td>\n",
       "      <td>907</td>\n",
       "      <td>171</td>\n",
       "      <td>45</td>\n",
       "      <td>Michigan Ave &amp; Congress Pkwy</td>\n",
       "      <td>90</td>\n",
       "      <td>Millennium Park</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1982.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4255</th>\n",
       "      <td>2013-06-27 13:18:00</td>\n",
       "      <td>2013-06-27 19:34:00</td>\n",
       "      <td>907</td>\n",
       "      <td>22549</td>\n",
       "      <td>45</td>\n",
       "      <td>Michigan Ave &amp; Congress Pkwy</td>\n",
       "      <td>54</td>\n",
       "      <td>Ogden Ave &amp; Chicago Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1982.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4263</th>\n",
       "      <td>2013-06-27 14:39:00</td>\n",
       "      <td>2013-06-27 14:40:00</td>\n",
       "      <td>145</td>\n",
       "      <td>62</td>\n",
       "      <td>61</td>\n",
       "      <td>Wood St &amp; Milwaukee Ave</td>\n",
       "      <td>300</td>\n",
       "      <td>Broadway &amp; Barry Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1978.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4275</th>\n",
       "      <td>2013-06-27 14:44:00</td>\n",
       "      <td>2013-06-27 14:45:00</td>\n",
       "      <td>77</td>\n",
       "      <td>64</td>\n",
       "      <td>32</td>\n",
       "      <td>Racine Ave &amp; Congress Pkwy</td>\n",
       "      <td>32</td>\n",
       "      <td>Racine Ave &amp; Congress Pkwy</td>\n",
       "      <td>Customer</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4288</th>\n",
       "      <td>2013-06-27 14:56:00</td>\n",
       "      <td>2013-06-27 14:57:00</td>\n",
       "      <td>524</td>\n",
       "      <td>66</td>\n",
       "      <td>68</td>\n",
       "      <td>Clinton St &amp; Tilden St</td>\n",
       "      <td>68</td>\n",
       "      <td>Clinton St &amp; Tilden St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1983.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4289</th>\n",
       "      <td>2013-06-27 14:57:00</td>\n",
       "      <td>2013-06-27 15:05:00</td>\n",
       "      <td>78</td>\n",
       "      <td>487</td>\n",
       "      <td>32</td>\n",
       "      <td>Racine Ave &amp; Congress Pkwy</td>\n",
       "      <td>349</td>\n",
       "      <td>Halsted St &amp; Wrightwood Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Female</td>\n",
       "      <td>1980.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4291</th>\n",
       "      <td>2013-06-27 14:58:00</td>\n",
       "      <td>2013-06-27 15:05:00</td>\n",
       "      <td>77</td>\n",
       "      <td>433</td>\n",
       "      <td>32</td>\n",
       "      <td>Racine Ave &amp; Congress Pkwy</td>\n",
       "      <td>19</td>\n",
       "      <td>Loomis St &amp; Taylor St</td>\n",
       "      <td>Customer</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4316</th>\n",
       "      <td>2013-06-27 15:06:00</td>\n",
       "      <td>2013-06-27 15:09:00</td>\n",
       "      <td>77</td>\n",
       "      <td>123</td>\n",
       "      <td>19</td>\n",
       "      <td>Loomis St &amp; Taylor St</td>\n",
       "      <td>19</td>\n",
       "      <td>Loomis St &amp; Taylor St</td>\n",
       "      <td>Customer</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4342</th>\n",
       "      <td>2013-06-27 15:13:00</td>\n",
       "      <td>2013-06-27 15:27:00</td>\n",
       "      <td>77</td>\n",
       "      <td>852</td>\n",
       "      <td>19</td>\n",
       "      <td>Loomis St &amp; Taylor St</td>\n",
       "      <td>55</td>\n",
       "      <td>Halsted St &amp; James M Rochford St</td>\n",
       "      <td>Customer</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4343</th>\n",
       "      <td>2013-06-27 15:09:00</td>\n",
       "      <td>2013-06-27 15:14:00</td>\n",
       "      <td>587</td>\n",
       "      <td>272</td>\n",
       "      <td>68</td>\n",
       "      <td>Clinton St &amp; Tilden St</td>\n",
       "      <td>68</td>\n",
       "      <td>Clinton St &amp; Tilden St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1983.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4345</th>\n",
       "      <td>2013-06-27 16:14:00</td>\n",
       "      <td>2013-06-27 16:15:00</td>\n",
       "      <td>711</td>\n",
       "      <td>83</td>\n",
       "      <td>34</td>\n",
       "      <td>Cannon Dr &amp; Fullerton Ave</td>\n",
       "      <td>311</td>\n",
       "      <td>Lincoln Ave &amp; Eastwood Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1982.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4346</th>\n",
       "      <td>2013-06-27 15:14:00</td>\n",
       "      <td>2013-06-28 00:18:00</td>\n",
       "      <td>145</td>\n",
       "      <td>32646</td>\n",
       "      <td>61</td>\n",
       "      <td>Wood St &amp; Milwaukee Ave</td>\n",
       "      <td>91</td>\n",
       "      <td>Clinton St &amp; Washington Blvd</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1978.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4350</th>\n",
       "      <td>2013-06-27 15:15:00</td>\n",
       "      <td>2013-06-27 15:27:00</td>\n",
       "      <td>78</td>\n",
       "      <td>730</td>\n",
       "      <td>349</td>\n",
       "      <td>Halsted St &amp; Wrightwood Ave</td>\n",
       "      <td>55</td>\n",
       "      <td>Halsted St &amp; James M Rochford St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Female</td>\n",
       "      <td>1980.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4378</th>\n",
       "      <td>2013-06-27 15:54:00</td>\n",
       "      <td>2013-06-27 23:15:00</td>\n",
       "      <td>524</td>\n",
       "      <td>26479</td>\n",
       "      <td>320</td>\n",
       "      <td>Loomis St &amp; Lexington St</td>\n",
       "      <td>27</td>\n",
       "      <td>Larrabee St &amp; North Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1983.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4384</th>\n",
       "      <td>2013-06-27 16:42:00</td>\n",
       "      <td>2013-06-27 22:23:00</td>\n",
       "      <td>78</td>\n",
       "      <td>20457</td>\n",
       "      <td>55</td>\n",
       "      <td>Halsted St &amp; James M Rochford St</td>\n",
       "      <td>31</td>\n",
       "      <td>Franklin St &amp; Chicago Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Female</td>\n",
       "      <td>1980.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4389</th>\n",
       "      <td>2013-06-27 16:34:00</td>\n",
       "      <td>2013-06-27 16:36:00</td>\n",
       "      <td>66</td>\n",
       "      <td>127</td>\n",
       "      <td>42</td>\n",
       "      <td>Wabash Ave &amp; Cermak Rd</td>\n",
       "      <td>42</td>\n",
       "      <td>Wabash Ave &amp; Cermak Rd</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Female</td>\n",
       "      <td>1980.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4390</th>\n",
       "      <td>2013-06-27 16:41:00</td>\n",
       "      <td>2013-06-27 16:50:00</td>\n",
       "      <td>66</td>\n",
       "      <td>528</td>\n",
       "      <td>42</td>\n",
       "      <td>Wabash Ave &amp; Cermak Rd</td>\n",
       "      <td>42</td>\n",
       "      <td>Wabash Ave &amp; Cermak Rd</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Female</td>\n",
       "      <td>1980.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4415</th>\n",
       "      <td>2013-06-27 18:21:00</td>\n",
       "      <td>2013-06-27 18:37:00</td>\n",
       "      <td>384</td>\n",
       "      <td>973</td>\n",
       "      <td>36</td>\n",
       "      <td>Franklin St &amp; Jackson Blvd</td>\n",
       "      <td>36</td>\n",
       "      <td>Franklin St &amp; Jackson Blvd</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1967.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4427</th>\n",
       "      <td>2013-06-27 18:32:00</td>\n",
       "      <td>2013-06-27 18:37:00</td>\n",
       "      <td>348</td>\n",
       "      <td>308</td>\n",
       "      <td>81</td>\n",
       "      <td>Daley Center Plaza</td>\n",
       "      <td>81</td>\n",
       "      <td>Daley Center Plaza</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1971.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4476</th>\n",
       "      <td>2013-06-27 18:38:00</td>\n",
       "      <td>2013-06-27 19:35:00</td>\n",
       "      <td>152</td>\n",
       "      <td>3401</td>\n",
       "      <td>81</td>\n",
       "      <td>Daley Center Plaza</td>\n",
       "      <td>67</td>\n",
       "      <td>Sheffield Ave &amp; Fullerton Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1964.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4480</th>\n",
       "      <td>2013-06-27 19:40:00</td>\n",
       "      <td>2013-06-27 22:28:00</td>\n",
       "      <td>27</td>\n",
       "      <td>10105</td>\n",
       "      <td>340</td>\n",
       "      <td>Clark St &amp; Wrightwood Ave</td>\n",
       "      <td>46</td>\n",
       "      <td>Wells St &amp; Walton St</td>\n",
       "      <td>Customer</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4490</th>\n",
       "      <td>2013-06-27 18:45:00</td>\n",
       "      <td>2013-06-27 19:03:00</td>\n",
       "      <td>418</td>\n",
       "      <td>1094</td>\n",
       "      <td>37</td>\n",
       "      <td>Dearborn St &amp; Adams St</td>\n",
       "      <td>76</td>\n",
       "      <td>Lake Shore Dr &amp; Monroe St</td>\n",
       "      <td>Customer</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109177</th>\n",
       "      <td>2013-12-31 19:34:00</td>\n",
       "      <td>2013-12-31 20:01:00</td>\n",
       "      <td>825</td>\n",
       "      <td>1632</td>\n",
       "      <td>289</td>\n",
       "      <td>Wells St &amp; Concord Ln</td>\n",
       "      <td>165</td>\n",
       "      <td>Clark St &amp; Waveland Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1985.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109198</th>\n",
       "      <td>2013-12-31 19:42:00</td>\n",
       "      <td>2013-12-31 19:51:00</td>\n",
       "      <td>2181</td>\n",
       "      <td>524</td>\n",
       "      <td>214</td>\n",
       "      <td>Damen Ave &amp; Grand Ave</td>\n",
       "      <td>285</td>\n",
       "      <td>Wood St &amp; Grand Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Female</td>\n",
       "      <td>1979.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109199</th>\n",
       "      <td>2013-12-31 19:42:00</td>\n",
       "      <td>2013-12-31 19:51:00</td>\n",
       "      <td>1978</td>\n",
       "      <td>523</td>\n",
       "      <td>214</td>\n",
       "      <td>Damen Ave &amp; Grand Ave</td>\n",
       "      <td>285</td>\n",
       "      <td>Wood St &amp; Grand Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1976.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109201</th>\n",
       "      <td>2013-12-31 19:44:00</td>\n",
       "      <td>2013-12-31 20:01:00</td>\n",
       "      <td>1304</td>\n",
       "      <td>1003</td>\n",
       "      <td>158</td>\n",
       "      <td>Milwaukee Ave &amp; Wabansia Ave</td>\n",
       "      <td>214</td>\n",
       "      <td>Damen Ave &amp; Grand Ave</td>\n",
       "      <td>Customer</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109202</th>\n",
       "      <td>2013-12-31 19:55:00</td>\n",
       "      <td>2013-12-31 20:07:00</td>\n",
       "      <td>188</td>\n",
       "      <td>712</td>\n",
       "      <td>304</td>\n",
       "      <td>Halsted St &amp; Waveland Ave</td>\n",
       "      <td>251</td>\n",
       "      <td>Clarendon Ave &amp; Leland Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1969.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109203</th>\n",
       "      <td>2013-12-31 20:02:00</td>\n",
       "      <td>2013-12-31 20:11:00</td>\n",
       "      <td>171</td>\n",
       "      <td>548</td>\n",
       "      <td>165</td>\n",
       "      <td>Clark St &amp; Waveland Ave</td>\n",
       "      <td>234</td>\n",
       "      <td>Clark St &amp; Montrose Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1985.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109222</th>\n",
       "      <td>2013-12-31 20:12:00</td>\n",
       "      <td>2013-12-31 20:25:00</td>\n",
       "      <td>2484</td>\n",
       "      <td>804</td>\n",
       "      <td>100</td>\n",
       "      <td>Orleans St &amp; Merchandise Mart Plaza</td>\n",
       "      <td>75</td>\n",
       "      <td>Canal St &amp; Jackson Blvd</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1964.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109223</th>\n",
       "      <td>2013-12-31 20:30:00</td>\n",
       "      <td>2013-12-31 20:37:00</td>\n",
       "      <td>435</td>\n",
       "      <td>390</td>\n",
       "      <td>234</td>\n",
       "      <td>Clark St &amp; Montrose Ave</td>\n",
       "      <td>318</td>\n",
       "      <td>Southport Ave &amp; Irving Park Rd</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Female</td>\n",
       "      <td>1981.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109224</th>\n",
       "      <td>2013-12-31 20:31:00</td>\n",
       "      <td>2013-12-31 20:38:00</td>\n",
       "      <td>2676</td>\n",
       "      <td>387</td>\n",
       "      <td>305</td>\n",
       "      <td>Western Ave &amp; Division St</td>\n",
       "      <td>130</td>\n",
       "      <td>Damen Ave &amp; Division St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1984.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109231</th>\n",
       "      <td>2013-12-31 20:38:00</td>\n",
       "      <td>2014-01-01 12:08:00</td>\n",
       "      <td>2676</td>\n",
       "      <td>55776</td>\n",
       "      <td>130</td>\n",
       "      <td>Damen Ave &amp; Division St</td>\n",
       "      <td>230</td>\n",
       "      <td>Lincoln Ave &amp; Roscoe St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1984.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109233</th>\n",
       "      <td>2013-12-31 20:43:00</td>\n",
       "      <td>2013-12-31 20:51:00</td>\n",
       "      <td>1400</td>\n",
       "      <td>470</td>\n",
       "      <td>118</td>\n",
       "      <td>Sedgwick St &amp; North Ave</td>\n",
       "      <td>138</td>\n",
       "      <td>Clybourn Ave &amp; Division St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1972.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109240</th>\n",
       "      <td>2013-12-31 20:51:00</td>\n",
       "      <td>2013-12-31 21:05:00</td>\n",
       "      <td>36</td>\n",
       "      <td>819</td>\n",
       "      <td>141</td>\n",
       "      <td>Clark St &amp; Lincoln Ave</td>\n",
       "      <td>181</td>\n",
       "      <td>LaSalle St &amp; Illinois St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1972.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109256</th>\n",
       "      <td>2013-12-31 21:07:00</td>\n",
       "      <td>2013-12-31 21:10:00</td>\n",
       "      <td>1917</td>\n",
       "      <td>209</td>\n",
       "      <td>60</td>\n",
       "      <td>Dayton St &amp; North Ave</td>\n",
       "      <td>20</td>\n",
       "      <td>Sheffield Ave &amp; Kingsbury St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Female</td>\n",
       "      <td>1983.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109257</th>\n",
       "      <td>2013-12-31 21:12:00</td>\n",
       "      <td>2013-12-31 21:16:00</td>\n",
       "      <td>1917</td>\n",
       "      <td>284</td>\n",
       "      <td>20</td>\n",
       "      <td>Sheffield Ave &amp; Kingsbury St</td>\n",
       "      <td>93</td>\n",
       "      <td>Sheffield Ave &amp; Willow St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Female</td>\n",
       "      <td>1983.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109275</th>\n",
       "      <td>2013-12-31 21:36:00</td>\n",
       "      <td>2013-12-31 22:00:00</td>\n",
       "      <td>2799</td>\n",
       "      <td>1421</td>\n",
       "      <td>227</td>\n",
       "      <td>Southport Ave &amp; Waveland Ave</td>\n",
       "      <td>228</td>\n",
       "      <td>Damen Ave &amp; Melrose Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1984.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109276</th>\n",
       "      <td>2013-12-31 21:36:00</td>\n",
       "      <td>2013-12-31 22:01:00</td>\n",
       "      <td>2859</td>\n",
       "      <td>1493</td>\n",
       "      <td>227</td>\n",
       "      <td>Southport Ave &amp; Waveland Ave</td>\n",
       "      <td>228</td>\n",
       "      <td>Damen Ave &amp; Melrose Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Female</td>\n",
       "      <td>1978.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109277</th>\n",
       "      <td>2013-12-31 21:36:00</td>\n",
       "      <td>2013-12-31 22:01:00</td>\n",
       "      <td>2642</td>\n",
       "      <td>1447</td>\n",
       "      <td>227</td>\n",
       "      <td>Southport Ave &amp; Waveland Ave</td>\n",
       "      <td>228</td>\n",
       "      <td>Damen Ave &amp; Melrose Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1986.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109278</th>\n",
       "      <td>2013-12-31 21:38:00</td>\n",
       "      <td>2013-12-31 22:00:00</td>\n",
       "      <td>2316</td>\n",
       "      <td>1309</td>\n",
       "      <td>227</td>\n",
       "      <td>Southport Ave &amp; Waveland Ave</td>\n",
       "      <td>228</td>\n",
       "      <td>Damen Ave &amp; Melrose Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1989.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109279</th>\n",
       "      <td>2013-12-31 21:50:00</td>\n",
       "      <td>2013-12-31 22:07:00</td>\n",
       "      <td>1667</td>\n",
       "      <td>987</td>\n",
       "      <td>119</td>\n",
       "      <td>Ashland Ave &amp; Lake St</td>\n",
       "      <td>275</td>\n",
       "      <td>Ashland Ave &amp; 13th St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1977.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109280</th>\n",
       "      <td>2013-12-31 21:55:00</td>\n",
       "      <td>2013-12-31 22:04:00</td>\n",
       "      <td>171</td>\n",
       "      <td>573</td>\n",
       "      <td>234</td>\n",
       "      <td>Clark St &amp; Montrose Ave</td>\n",
       "      <td>254</td>\n",
       "      <td>Pine Grove Ave &amp; Irving Park Rd</td>\n",
       "      <td>Customer</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109283</th>\n",
       "      <td>2013-12-31 22:03:00</td>\n",
       "      <td>2013-12-31 22:13:00</td>\n",
       "      <td>198</td>\n",
       "      <td>650</td>\n",
       "      <td>284</td>\n",
       "      <td>Michigan Ave &amp; Jackson Blvd</td>\n",
       "      <td>43</td>\n",
       "      <td>Michigan Ave &amp; Washington St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Female</td>\n",
       "      <td>1976.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109308</th>\n",
       "      <td>2013-12-31 22:10:00</td>\n",
       "      <td>2013-12-31 22:16:00</td>\n",
       "      <td>2931</td>\n",
       "      <td>353</td>\n",
       "      <td>130</td>\n",
       "      <td>Damen Ave &amp; Division St</td>\n",
       "      <td>69</td>\n",
       "      <td>Damen Ave &amp; Pierce Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1972.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109309</th>\n",
       "      <td>2013-12-31 22:10:00</td>\n",
       "      <td>2013-12-31 22:16:00</td>\n",
       "      <td>2048</td>\n",
       "      <td>346</td>\n",
       "      <td>130</td>\n",
       "      <td>Damen Ave &amp; Division St</td>\n",
       "      <td>69</td>\n",
       "      <td>Damen Ave &amp; Pierce Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Female</td>\n",
       "      <td>1976.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109310</th>\n",
       "      <td>2013-12-31 22:12:00</td>\n",
       "      <td>2013-12-31 22:16:00</td>\n",
       "      <td>347</td>\n",
       "      <td>248</td>\n",
       "      <td>340</td>\n",
       "      <td>Clark St &amp; Wrightwood Ave</td>\n",
       "      <td>300</td>\n",
       "      <td>Broadway &amp; Barry Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1989.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109331</th>\n",
       "      <td>2013-12-31 22:20:00</td>\n",
       "      <td>2013-12-31 22:26:00</td>\n",
       "      <td>347</td>\n",
       "      <td>357</td>\n",
       "      <td>300</td>\n",
       "      <td>Broadway &amp; Barry Ave</td>\n",
       "      <td>117</td>\n",
       "      <td>Wilton Ave &amp; Belmont Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1989.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109336</th>\n",
       "      <td>2013-12-31 22:29:00</td>\n",
       "      <td>2013-12-31 22:35:00</td>\n",
       "      <td>788</td>\n",
       "      <td>368</td>\n",
       "      <td>169</td>\n",
       "      <td>Canal St &amp; Harrison St</td>\n",
       "      <td>77</td>\n",
       "      <td>Clinton St &amp; Madison St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1952.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109338</th>\n",
       "      <td>2013-12-31 22:35:00</td>\n",
       "      <td>2013-12-31 22:49:00</td>\n",
       "      <td>2239</td>\n",
       "      <td>868</td>\n",
       "      <td>216</td>\n",
       "      <td>California Ave &amp; Division St</td>\n",
       "      <td>69</td>\n",
       "      <td>Damen Ave &amp; Pierce Ave</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Female</td>\n",
       "      <td>1978.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109369</th>\n",
       "      <td>2013-12-31 23:07:00</td>\n",
       "      <td>2013-12-31 23:31:00</td>\n",
       "      <td>1536</td>\n",
       "      <td>1492</td>\n",
       "      <td>22</td>\n",
       "      <td>May St &amp; Taylor St</td>\n",
       "      <td>22</td>\n",
       "      <td>May St &amp; Taylor St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1985.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109392</th>\n",
       "      <td>2013-12-31 23:36:00</td>\n",
       "      <td>2013-12-31 23:46:00</td>\n",
       "      <td>2069</td>\n",
       "      <td>600</td>\n",
       "      <td>120</td>\n",
       "      <td>Wentworth Ave &amp; Archer Ave</td>\n",
       "      <td>135</td>\n",
       "      <td>Halsted St &amp; 21st St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1984.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1109397</th>\n",
       "      <td>2013-12-31 23:46:00</td>\n",
       "      <td>2013-12-31 23:52:00</td>\n",
       "      <td>2097</td>\n",
       "      <td>316</td>\n",
       "      <td>206</td>\n",
       "      <td>Halsted St &amp; Archer Ave</td>\n",
       "      <td>339</td>\n",
       "      <td>Emerald Ave &amp; 31st St</td>\n",
       "      <td>Subscriber</td>\n",
       "      <td>Male</td>\n",
       "      <td>1963.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>759788 rows × 11 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                  starttime            stoptime  bikeid  tripduration  \\\n",
       "trip_id                                                                 \n",
       "3940    2013-06-27 01:06:00 2013-06-27 09:46:00     914         31177   \n",
       "4095    2013-06-27 12:06:00 2013-06-27 12:11:00     480           301   \n",
       "4113    2013-06-27 11:09:00 2013-06-27 11:11:00     711           140   \n",
       "4118    2013-06-27 12:11:00 2013-06-27 12:16:00     480           316   \n",
       "4119    2013-06-27 11:12:00 2013-06-27 11:13:00     711            87   \n",
       "4134    2013-06-27 11:24:00 2013-06-27 14:38:00     145         11674   \n",
       "4162    2013-06-27 11:39:00 2013-06-27 16:01:00     711         15758   \n",
       "4192    2013-06-27 12:15:00 2013-06-27 12:16:00     303            60   \n",
       "4216    2013-06-27 13:00:00 2013-06-27 13:03:00     907           171   \n",
       "4255    2013-06-27 13:18:00 2013-06-27 19:34:00     907         22549   \n",
       "4263    2013-06-27 14:39:00 2013-06-27 14:40:00     145            62   \n",
       "4275    2013-06-27 14:44:00 2013-06-27 14:45:00      77            64   \n",
       "4288    2013-06-27 14:56:00 2013-06-27 14:57:00     524            66   \n",
       "4289    2013-06-27 14:57:00 2013-06-27 15:05:00      78           487   \n",
       "4291    2013-06-27 14:58:00 2013-06-27 15:05:00      77           433   \n",
       "4316    2013-06-27 15:06:00 2013-06-27 15:09:00      77           123   \n",
       "4342    2013-06-27 15:13:00 2013-06-27 15:27:00      77           852   \n",
       "4343    2013-06-27 15:09:00 2013-06-27 15:14:00     587           272   \n",
       "4345    2013-06-27 16:14:00 2013-06-27 16:15:00     711            83   \n",
       "4346    2013-06-27 15:14:00 2013-06-28 00:18:00     145         32646   \n",
       "4350    2013-06-27 15:15:00 2013-06-27 15:27:00      78           730   \n",
       "4378    2013-06-27 15:54:00 2013-06-27 23:15:00     524         26479   \n",
       "4384    2013-06-27 16:42:00 2013-06-27 22:23:00      78         20457   \n",
       "4389    2013-06-27 16:34:00 2013-06-27 16:36:00      66           127   \n",
       "4390    2013-06-27 16:41:00 2013-06-27 16:50:00      66           528   \n",
       "4415    2013-06-27 18:21:00 2013-06-27 18:37:00     384           973   \n",
       "4427    2013-06-27 18:32:00 2013-06-27 18:37:00     348           308   \n",
       "4476    2013-06-27 18:38:00 2013-06-27 19:35:00     152          3401   \n",
       "4480    2013-06-27 19:40:00 2013-06-27 22:28:00      27         10105   \n",
       "4490    2013-06-27 18:45:00 2013-06-27 19:03:00     418          1094   \n",
       "...                     ...                 ...     ...           ...   \n",
       "1109177 2013-12-31 19:34:00 2013-12-31 20:01:00     825          1632   \n",
       "1109198 2013-12-31 19:42:00 2013-12-31 19:51:00    2181           524   \n",
       "1109199 2013-12-31 19:42:00 2013-12-31 19:51:00    1978           523   \n",
       "1109201 2013-12-31 19:44:00 2013-12-31 20:01:00    1304          1003   \n",
       "1109202 2013-12-31 19:55:00 2013-12-31 20:07:00     188           712   \n",
       "1109203 2013-12-31 20:02:00 2013-12-31 20:11:00     171           548   \n",
       "1109222 2013-12-31 20:12:00 2013-12-31 20:25:00    2484           804   \n",
       "1109223 2013-12-31 20:30:00 2013-12-31 20:37:00     435           390   \n",
       "1109224 2013-12-31 20:31:00 2013-12-31 20:38:00    2676           387   \n",
       "1109231 2013-12-31 20:38:00 2014-01-01 12:08:00    2676         55776   \n",
       "1109233 2013-12-31 20:43:00 2013-12-31 20:51:00    1400           470   \n",
       "1109240 2013-12-31 20:51:00 2013-12-31 21:05:00      36           819   \n",
       "1109256 2013-12-31 21:07:00 2013-12-31 21:10:00    1917           209   \n",
       "1109257 2013-12-31 21:12:00 2013-12-31 21:16:00    1917           284   \n",
       "1109275 2013-12-31 21:36:00 2013-12-31 22:00:00    2799          1421   \n",
       "1109276 2013-12-31 21:36:00 2013-12-31 22:01:00    2859          1493   \n",
       "1109277 2013-12-31 21:36:00 2013-12-31 22:01:00    2642          1447   \n",
       "1109278 2013-12-31 21:38:00 2013-12-31 22:00:00    2316          1309   \n",
       "1109279 2013-12-31 21:50:00 2013-12-31 22:07:00    1667           987   \n",
       "1109280 2013-12-31 21:55:00 2013-12-31 22:04:00     171           573   \n",
       "1109283 2013-12-31 22:03:00 2013-12-31 22:13:00     198           650   \n",
       "1109308 2013-12-31 22:10:00 2013-12-31 22:16:00    2931           353   \n",
       "1109309 2013-12-31 22:10:00 2013-12-31 22:16:00    2048           346   \n",
       "1109310 2013-12-31 22:12:00 2013-12-31 22:16:00     347           248   \n",
       "1109331 2013-12-31 22:20:00 2013-12-31 22:26:00     347           357   \n",
       "1109336 2013-12-31 22:29:00 2013-12-31 22:35:00     788           368   \n",
       "1109338 2013-12-31 22:35:00 2013-12-31 22:49:00    2239           868   \n",
       "1109369 2013-12-31 23:07:00 2013-12-31 23:31:00    1536          1492   \n",
       "1109392 2013-12-31 23:36:00 2013-12-31 23:46:00    2069           600   \n",
       "1109397 2013-12-31 23:46:00 2013-12-31 23:52:00    2097           316   \n",
       "\n",
       "         from_station_id                    from_station_name  to_station_id  \\\n",
       "trip_id                                                                        \n",
       "3940                  91         Clinton St & Washington Blvd             48   \n",
       "4095                  85                Michigan Ave & Oak St             85   \n",
       "4113                  88                 May St & Randolph St             88   \n",
       "4118                  85                Michigan Ave & Oak St             28   \n",
       "4119                  88                 May St & Randolph St             88   \n",
       "4134                  17                Wood St & Division St             61   \n",
       "4162                  88                 May St & Randolph St             34   \n",
       "4192                  28           Larrabee St & Menomonee St             28   \n",
       "4216                  45         Michigan Ave & Congress Pkwy             90   \n",
       "4255                  45         Michigan Ave & Congress Pkwy             54   \n",
       "4263                  61              Wood St & Milwaukee Ave            300   \n",
       "4275                  32           Racine Ave & Congress Pkwy             32   \n",
       "4288                  68               Clinton St & Tilden St             68   \n",
       "4289                  32           Racine Ave & Congress Pkwy            349   \n",
       "4291                  32           Racine Ave & Congress Pkwy             19   \n",
       "4316                  19                Loomis St & Taylor St             19   \n",
       "4342                  19                Loomis St & Taylor St             55   \n",
       "4343                  68               Clinton St & Tilden St             68   \n",
       "4345                  34            Cannon Dr & Fullerton Ave            311   \n",
       "4346                  61              Wood St & Milwaukee Ave             91   \n",
       "4350                 349          Halsted St & Wrightwood Ave             55   \n",
       "4378                 320             Loomis St & Lexington St             27   \n",
       "4384                  55     Halsted St & James M Rochford St             31   \n",
       "4389                  42               Wabash Ave & Cermak Rd             42   \n",
       "4390                  42               Wabash Ave & Cermak Rd             42   \n",
       "4415                  36           Franklin St & Jackson Blvd             36   \n",
       "4427                  81                   Daley Center Plaza             81   \n",
       "4476                  81                   Daley Center Plaza             67   \n",
       "4480                 340            Clark St & Wrightwood Ave             46   \n",
       "4490                  37               Dearborn St & Adams St             76   \n",
       "...                  ...                                  ...            ...   \n",
       "1109177              289                Wells St & Concord Ln            165   \n",
       "1109198              214                Damen Ave & Grand Ave            285   \n",
       "1109199              214                Damen Ave & Grand Ave            285   \n",
       "1109201              158         Milwaukee Ave & Wabansia Ave            214   \n",
       "1109202              304            Halsted St & Waveland Ave            251   \n",
       "1109203              165              Clark St & Waveland Ave            234   \n",
       "1109222              100  Orleans St & Merchandise Mart Plaza             75   \n",
       "1109223              234              Clark St & Montrose Ave            318   \n",
       "1109224              305            Western Ave & Division St            130   \n",
       "1109231              130              Damen Ave & Division St            230   \n",
       "1109233              118              Sedgwick St & North Ave            138   \n",
       "1109240              141               Clark St & Lincoln Ave            181   \n",
       "1109256               60                Dayton St & North Ave             20   \n",
       "1109257               20         Sheffield Ave & Kingsbury St             93   \n",
       "1109275              227         Southport Ave & Waveland Ave            228   \n",
       "1109276              227         Southport Ave & Waveland Ave            228   \n",
       "1109277              227         Southport Ave & Waveland Ave            228   \n",
       "1109278              227         Southport Ave & Waveland Ave            228   \n",
       "1109279              119                Ashland Ave & Lake St            275   \n",
       "1109280              234              Clark St & Montrose Ave            254   \n",
       "1109283              284          Michigan Ave & Jackson Blvd             43   \n",
       "1109308              130              Damen Ave & Division St             69   \n",
       "1109309              130              Damen Ave & Division St             69   \n",
       "1109310              340            Clark St & Wrightwood Ave            300   \n",
       "1109331              300                 Broadway & Barry Ave            117   \n",
       "1109336              169               Canal St & Harrison St             77   \n",
       "1109338              216         California Ave & Division St             69   \n",
       "1109369               22                   May St & Taylor St             22   \n",
       "1109392              120           Wentworth Ave & Archer Ave            135   \n",
       "1109397              206              Halsted St & Archer Ave            339   \n",
       "\n",
       "                          to_station_name    usertype  gender  birthday  \n",
       "trip_id                                                                  \n",
       "3940           Larrabee St & Kingsbury St  Subscriber    Male    1982.0  \n",
       "4095                Michigan Ave & Oak St  Subscriber    Male    1982.0  \n",
       "4113                 May St & Randolph St  Subscriber    Male    1982.0  \n",
       "4118           Larrabee St & Menomonee St    Customer     NaN       NaN  \n",
       "4119                 May St & Randolph St  Subscriber    Male    1982.0  \n",
       "4134              Wood St & Milwaukee Ave  Subscriber    Male    1978.0  \n",
       "4162            Cannon Dr & Fullerton Ave  Subscriber    Male    1982.0  \n",
       "4192           Larrabee St & Menomonee St  Subscriber    Male    1982.0  \n",
       "4216                      Millennium Park  Subscriber    Male    1982.0  \n",
       "4255              Ogden Ave & Chicago Ave  Subscriber    Male    1982.0  \n",
       "4263                 Broadway & Barry Ave  Subscriber    Male    1978.0  \n",
       "4275           Racine Ave & Congress Pkwy    Customer     NaN       NaN  \n",
       "4288               Clinton St & Tilden St  Subscriber    Male    1983.0  \n",
       "4289          Halsted St & Wrightwood Ave  Subscriber  Female    1980.0  \n",
       "4291                Loomis St & Taylor St    Customer     NaN       NaN  \n",
       "4316                Loomis St & Taylor St    Customer     NaN       NaN  \n",
       "4342     Halsted St & James M Rochford St    Customer     NaN       NaN  \n",
       "4343               Clinton St & Tilden St  Subscriber    Male    1983.0  \n",
       "4345           Lincoln Ave & Eastwood Ave  Subscriber    Male    1982.0  \n",
       "4346         Clinton St & Washington Blvd  Subscriber    Male    1978.0  \n",
       "4350     Halsted St & James M Rochford St  Subscriber  Female    1980.0  \n",
       "4378              Larrabee St & North Ave  Subscriber    Male    1983.0  \n",
       "4384            Franklin St & Chicago Ave  Subscriber  Female    1980.0  \n",
       "4389               Wabash Ave & Cermak Rd  Subscriber  Female    1980.0  \n",
       "4390               Wabash Ave & Cermak Rd  Subscriber  Female    1980.0  \n",
       "4415           Franklin St & Jackson Blvd  Subscriber    Male    1967.0  \n",
       "4427                   Daley Center Plaza  Subscriber    Male    1971.0  \n",
       "4476        Sheffield Ave & Fullerton Ave  Subscriber    Male    1964.0  \n",
       "4480                 Wells St & Walton St    Customer     NaN       NaN  \n",
       "4490            Lake Shore Dr & Monroe St    Customer     NaN       NaN  \n",
       "...                                   ...         ...     ...       ...  \n",
       "1109177           Clark St & Waveland Ave  Subscriber    Male    1985.0  \n",
       "1109198               Wood St & Grand Ave  Subscriber  Female    1979.0  \n",
       "1109199               Wood St & Grand Ave  Subscriber    Male    1976.0  \n",
       "1109201             Damen Ave & Grand Ave    Customer     NaN       NaN  \n",
       "1109202        Clarendon Ave & Leland Ave  Subscriber    Male    1969.0  \n",
       "1109203           Clark St & Montrose Ave  Subscriber    Male    1985.0  \n",
       "1109222           Canal St & Jackson Blvd  Subscriber    Male    1964.0  \n",
       "1109223    Southport Ave & Irving Park Rd  Subscriber  Female    1981.0  \n",
       "1109224           Damen Ave & Division St  Subscriber    Male    1984.0  \n",
       "1109231           Lincoln Ave & Roscoe St  Subscriber    Male    1984.0  \n",
       "1109233        Clybourn Ave & Division St  Subscriber    Male    1972.0  \n",
       "1109240          LaSalle St & Illinois St  Subscriber    Male    1972.0  \n",
       "1109256      Sheffield Ave & Kingsbury St  Subscriber  Female    1983.0  \n",
       "1109257         Sheffield Ave & Willow St  Subscriber  Female    1983.0  \n",
       "1109275           Damen Ave & Melrose Ave  Subscriber    Male    1984.0  \n",
       "1109276           Damen Ave & Melrose Ave  Subscriber  Female    1978.0  \n",
       "1109277           Damen Ave & Melrose Ave  Subscriber    Male    1986.0  \n",
       "1109278           Damen Ave & Melrose Ave  Subscriber    Male    1989.0  \n",
       "1109279             Ashland Ave & 13th St  Subscriber    Male    1977.0  \n",
       "1109280   Pine Grove Ave & Irving Park Rd    Customer     NaN       NaN  \n",
       "1109283      Michigan Ave & Washington St  Subscriber  Female    1976.0  \n",
       "1109308            Damen Ave & Pierce Ave  Subscriber    Male    1972.0  \n",
       "1109309            Damen Ave & Pierce Ave  Subscriber  Female    1976.0  \n",
       "1109310              Broadway & Barry Ave  Subscriber    Male    1989.0  \n",
       "1109331          Wilton Ave & Belmont Ave  Subscriber    Male    1989.0  \n",
       "1109336           Clinton St & Madison St  Subscriber    Male    1952.0  \n",
       "1109338            Damen Ave & Pierce Ave  Subscriber  Female    1978.0  \n",
       "1109369                May St & Taylor St  Subscriber    Male    1985.0  \n",
       "1109392              Halsted St & 21st St  Subscriber    Male    1984.0  \n",
       "1109397             Emerald Ave & 31st St  Subscriber    Male    1963.0  \n",
       "\n",
       "[759788 rows x 11 columns]"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "trips = pd.read_csv('datasets/divvy_2013/Divvy_Trips_2013.csv', \n",
    "                    parse_dates=['starttime', 'stoptime'], \n",
    "                    index_col=['trip_id'])\n",
    "trips = trips.sort()\n",
    "trips"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "subslide"
    }
   },
   "source": [
    "At this point, we have our `stations` and `trips` data loaded into memory. \n",
    "\n",
    "How we construct the graph depends on the kind of questions we want to answer, which makes the definition of the \"unit of consideration\" (or the entities for which we are trying to model their relationships) is extremely important. \n",
    "\n",
    "Let's try to answer the question: \"What are the most popular trip paths?\" In this case, the bike station is a reasonable \"unit of consideration\", so we will use the bike stations as the nodes. \n",
    "\n",
    "To start, let's initialize an directed graph `G`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": false,
    "slideshow": {
     "slide_type": "fragment"
    }
   },
   "outputs": [],
   "source": [
    "G = nx.DiGraph()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "subslide"
    }
   },
   "source": [
    "Then, let's iterate over the `stations` DataFrame, and add in the node attributes."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": false,
    "slideshow": {
     "slide_type": "fragment"
    }
   },
   "outputs": [],
   "source": [
    "for r, d in stations.iterrows(): # call the pandas DataFrame row-by-row iterator\n",
    "    G.add_node(r,   attr_dict=d.to_dict()) "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "subslide"
    }
   },
   "source": [
    "In order to answer the question of \"which stations are important\", we need to specify things a bit more. Perhaps a measure such as **betweenness centrality** or **degree centrality** may be appropriate here.\n",
    "\n",
    "The naive way would be to iterate over all the rows. Go ahead and try it at your own risk - it may take a long time :-). Alternatively, I would suggest doing a `pandas` `groupby`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": false,
    "slideshow": {
     "slide_type": "subslide"
    }
   },
   "outputs": [],
   "source": [
    "# # Run the following code at your own risk :)\n",
    "# for r, d in trips.iterrows():\n",
    "#     start = d['from_station_id']\n",
    "#     end = d['to_station_id']\n",
    "#     if (start, end) not in G.edges():\n",
    "#         G.add_edge(start, end, count=1)\n",
    "#     else:\n",
    "#         G.edge[start][end]['count'] += 1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "collapsed": false,
    "slideshow": {
     "slide_type": "subslide"
    }
   },
   "outputs": [],
   "source": [
    "for (start, stop), d in trips.groupby(['from_station_id', 'to_station_id']):\n",
    "    G.add_edge(start, stop, count=len(d))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[(5, 5, {'count': 232}),\n",
       " (5, 13, {'count': 1}),\n",
       " (5, 14, {'count': 15}),\n",
       " (5, 15, {'count': 9}),\n",
       " (5, 16, {'count': 4}),\n",
       " (5, 17, {'count': 7}),\n",
       " (5, 19, {'count': 13}),\n",
       " (5, 21, {'count': 16}),\n",
       " (5, 22, {'count': 18}),\n",
       " (5, 23, {'count': 5}),\n",
       " (5, 24, {'count': 36}),\n",
       " (5, 25, {'count': 62}),\n",
       " (5, 26, {'count': 55}),\n",
       " (5, 27, {'count': 4}),\n",
       " (5, 28, {'count': 4}),\n",
       " (5, 29, {'count': 12}),\n",
       " (5, 31, {'count': 8}),\n",
       " (5, 32, {'count': 14}),\n",
       " (5, 33, {'count': 58}),\n",
       " (5, 34, {'count': 7}),\n",
       " (5, 35, {'count': 83}),\n",
       " (5, 36, {'count': 238}),\n",
       " (5, 37, {'count': 132}),\n",
       " (5, 42, {'count': 47}),\n",
       " (5, 43, {'count': 55}),\n",
       " (5, 44, {'count': 71}),\n",
       " (5, 45, {'count': 43}),\n",
       " (5, 46, {'count': 3}),\n",
       " (5, 47, {'count': 65}),\n",
       " (5, 48, {'count': 3}),\n",
       " (5, 49, {'count': 141}),\n",
       " (5, 50, {'count': 24}),\n",
       " (5, 51, {'count': 69}),\n",
       " (5, 52, {'count': 86}),\n",
       " (5, 53, {'count': 25}),\n",
       " (5, 54, {'count': 13}),\n",
       " (5, 55, {'count': 22}),\n",
       " (5, 56, {'count': 18}),\n",
       " (5, 57, {'count': 49}),\n",
       " (5, 58, {'count': 2}),\n",
       " (5, 59, {'count': 179}),\n",
       " (5, 60, {'count': 3}),\n",
       " (5, 61, {'count': 10}),\n",
       " (5, 62, {'count': 61}),\n",
       " (5, 66, {'count': 64}),\n",
       " (5, 67, {'count': 8}),\n",
       " (5, 68, {'count': 114}),\n",
       " (5, 69, {'count': 5}),\n",
       " (5, 71, {'count': 9}),\n",
       " (5, 72, {'count': 99}),\n",
       " (5, 73, {'count': 25}),\n",
       " (5, 74, {'count': 6}),\n",
       " (5, 75, {'count': 179}),\n",
       " (5, 76, {'count': 141}),\n",
       " (5, 77, {'count': 149}),\n",
       " (5, 80, {'count': 26}),\n",
       " (5, 81, {'count': 134}),\n",
       " (5, 84, {'count': 8}),\n",
       " (5, 85, {'count': 51}),\n",
       " (5, 86, {'count': 8}),\n",
       " (5, 87, {'count': 4}),\n",
       " (5, 88, {'count': 7}),\n",
       " (5, 90, {'count': 181}),\n",
       " (5, 91, {'count': 70}),\n",
       " (5, 92, {'count': 10}),\n",
       " (5, 93, {'count': 4}),\n",
       " (5, 94, {'count': 9}),\n",
       " (5, 97, {'count': 191}),\n",
       " (5, 98, {'count': 52}),\n",
       " (5, 99, {'count': 25}),\n",
       " (5, 100, {'count': 19}),\n",
       " (5, 106, {'count': 23}),\n",
       " (5, 108, {'count': 21}),\n",
       " (5, 109, {'count': 30}),\n",
       " (5, 110, {'count': 37}),\n",
       " (5, 111, {'count': 2}),\n",
       " (5, 112, {'count': 4}),\n",
       " (5, 118, {'count': 4}),\n",
       " (5, 120, {'count': 36}),\n",
       " (5, 122, {'count': 4}),\n",
       " (5, 126, {'count': 14}),\n",
       " (5, 127, {'count': 1}),\n",
       " (5, 128, {'count': 3}),\n",
       " (5, 129, {'count': 6}),\n",
       " (5, 130, {'count': 1}),\n",
       " (5, 132, {'count': 1}),\n",
       " (5, 134, {'count': 25}),\n",
       " (5, 135, {'count': 7}),\n",
       " (5, 137, {'count': 3}),\n",
       " (5, 138, {'count': 2}),\n",
       " (5, 140, {'count': 46}),\n",
       " (5, 143, {'count': 4}),\n",
       " (5, 146, {'count': 7}),\n",
       " (5, 147, {'count': 12}),\n",
       " (5, 148, {'count': 5}),\n",
       " (5, 149, {'count': 10}),\n",
       " (5, 150, {'count': 24}),\n",
       " (5, 157, {'count': 2}),\n",
       " (5, 160, {'count': 1}),\n",
       " (5, 162, {'count': 2}),\n",
       " (5, 164, {'count': 12}),\n",
       " (5, 168, {'count': 51}),\n",
       " (5, 169, {'count': 39}),\n",
       " (5, 170, {'count': 11}),\n",
       " (5, 171, {'count': 1}),\n",
       " (5, 173, {'count': 15}),\n",
       " (5, 174, {'count': 115}),\n",
       " (5, 175, {'count': 42}),\n",
       " (5, 176, {'count': 34}),\n",
       " (5, 177, {'count': 11}),\n",
       " (5, 178, {'count': 36}),\n",
       " (5, 179, {'count': 6}),\n",
       " (5, 181, {'count': 28}),\n",
       " (5, 183, {'count': 4}),\n",
       " (5, 184, {'count': 7}),\n",
       " (5, 185, {'count': 2}),\n",
       " (5, 191, {'count': 12}),\n",
       " (5, 192, {'count': 38}),\n",
       " (5, 193, {'count': 2}),\n",
       " (5, 194, {'count': 24}),\n",
       " (5, 195, {'count': 31}),\n",
       " (5, 196, {'count': 18}),\n",
       " (5, 197, {'count': 17}),\n",
       " (5, 198, {'count': 19}),\n",
       " (5, 199, {'count': 51}),\n",
       " (5, 200, {'count': 3}),\n",
       " (5, 202, {'count': 2}),\n",
       " (5, 205, {'count': 2}),\n",
       " (5, 206, {'count': 6}),\n",
       " (5, 207, {'count': 9}),\n",
       " (5, 208, {'count': 5}),\n",
       " (5, 209, {'count': 2}),\n",
       " (5, 210, {'count': 10}),\n",
       " (5, 211, {'count': 17}),\n",
       " (5, 212, {'count': 9}),\n",
       " (5, 214, {'count': 1}),\n",
       " (5, 217, {'count': 2}),\n",
       " (5, 218, {'count': 2}),\n",
       " (5, 220, {'count': 4}),\n",
       " (5, 222, {'count': 1}),\n",
       " (5, 224, {'count': 2}),\n",
       " (5, 232, {'count': 5}),\n",
       " (5, 233, {'count': 3}),\n",
       " (5, 234, {'count': 1}),\n",
       " (5, 236, {'count': 1}),\n",
       " (5, 237, {'count': 2}),\n",
       " (5, 240, {'count': 1}),\n",
       " (5, 241, {'count': 4}),\n",
       " (5, 244, {'count': 4}),\n",
       " (5, 247, {'count': 1}),\n",
       " (5, 249, {'count': 12}),\n",
       " (5, 250, {'count': 16}),\n",
       " (5, 251, {'count': 6}),\n",
       " (5, 252, {'count': 8}),\n",
       " (5, 255, {'count': 37}),\n",
       " (5, 258, {'count': 1}),\n",
       " (5, 261, {'count': 8}),\n",
       " (5, 264, {'count': 10}),\n",
       " (5, 265, {'count': 2}),\n",
       " (5, 268, {'count': 2}),\n",
       " (5, 272, {'count': 1}),\n",
       " (5, 273, {'count': 25}),\n",
       " (5, 274, {'count': 1}),\n",
       " (5, 275, {'count': 3}),\n",
       " (5, 277, {'count': 1}),\n",
       " (5, 278, {'count': 1}),\n",
       " (5, 279, {'count': 1}),\n",
       " (5, 280, {'count': 6}),\n",
       " (5, 282, {'count': 4}),\n",
       " (5, 283, {'count': 51}),\n",
       " (5, 284, {'count': 5}),\n",
       " (5, 286, {'count': 22}),\n",
       " (5, 287, {'count': 15}),\n",
       " (5, 289, {'count': 2}),\n",
       " (5, 291, {'count': 3}),\n",
       " (5, 300, {'count': 3}),\n",
       " (5, 301, {'count': 5}),\n",
       " (5, 305, {'count': 2}),\n",
       " (5, 309, {'count': 1}),\n",
       " (5, 311, {'count': 3}),\n",
       " (5, 313, {'count': 3}),\n",
       " (5, 317, {'count': 3}),\n",
       " (5, 319, {'count': 2}),\n",
       " (5, 320, {'count': 7}),\n",
       " (5, 321, {'count': 23}),\n",
       " (5, 322, {'count': 2}),\n",
       " (5, 328, {'count': 9}),\n",
       " (5, 332, {'count': 1}),\n",
       " (5, 334, {'count': 2}),\n",
       " (5, 337, {'count': 4}),\n",
       " (5, 338, {'count': 12}),\n",
       " (5, 340, {'count': 3}),\n",
       " (5, 341, {'count': 13}),\n",
       " (5, 342, {'count': 1}),\n",
       " (5, 349, {'count': 1}),\n",
       " (5, 350, {'count': 3}),\n",
       " (5, 351, {'count': 2}),\n",
       " (13, 13, {'count': 168}),\n",
       " (13, 15, {'count': 1}),\n",
       " (13, 16, {'count': 7}),\n",
       " (13, 17, {'count': 12}),\n",
       " (13, 19, {'count': 5}),\n",
       " (13, 20, {'count': 40}),\n",
       " (13, 21, {'count': 3}),\n",
       " (13, 22, {'count': 2}),\n",
       " (13, 23, {'count': 13}),\n",
       " (13, 24, {'count': 6}),\n",
       " (13, 25, {'count': 23}),\n",
       " (13, 26, {'count': 15}),\n",
       " (13, 27, {'count': 22}),\n",
       " (13, 28, {'count': 20}),\n",
       " (13, 29, {'count': 10}),\n",
       " (13, 30, {'count': 15}),\n",
       " (13, 31, {'count': 11}),\n",
       " (13, 34, {'count': 138}),\n",
       " (13, 35, {'count': 12}),\n",
       " (13, 36, {'count': 5}),\n",
       " (13, 37, {'count': 6}),\n",
       " (13, 44, {'count': 9}),\n",
       " (13, 46, {'count': 26}),\n",
       " (13, 47, {'count': 14}),\n",
       " (13, 48, {'count': 18}),\n",
       " (13, 49, {'count': 9}),\n",
       " (13, 50, {'count': 1}),\n",
       " (13, 51, {'count': 7}),\n",
       " (13, 52, {'count': 2}),\n",
       " (13, 53, {'count': 15}),\n",
       " (13, 54, {'count': 11}),\n",
       " (13, 56, {'count': 6}),\n",
       " (13, 58, {'count': 18}),\n",
       " (13, 60, {'count': 42}),\n",
       " (13, 61, {'count': 22}),\n",
       " (13, 62, {'count': 2}),\n",
       " (13, 66, {'count': 4}),\n",
       " (13, 67, {'count': 156}),\n",
       " (13, 68, {'count': 1}),\n",
       " (13, 69, {'count': 47}),\n",
       " (13, 71, {'count': 7}),\n",
       " (13, 73, {'count': 3}),\n",
       " (13, 74, {'count': 10}),\n",
       " (13, 75, {'count': 2}),\n",
       " (13, 76, {'count': 14}),\n",
       " (13, 77, {'count': 4}),\n",
       " (13, 80, {'count': 5}),\n",
       " (13, 81, {'count': 1}),\n",
       " (13, 84, {'count': 4}),\n",
       " (13, 85, {'count': 63}),\n",
       " (13, 86, {'count': 21}),\n",
       " (13, 87, {'count': 52}),\n",
       " (13, 88, {'count': 3}),\n",
       " (13, 90, {'count': 11}),\n",
       " (13, 91, {'count': 7}),\n",
       " (13, 92, {'count': 3}),\n",
       " (13, 93, {'count': 36}),\n",
       " (13, 94, {'count': 60}),\n",
       " (13, 97, {'count': 8}),\n",
       " (13, 98, {'count': 2}),\n",
       " (13, 99, {'count': 10}),\n",
       " (13, 100, {'count': 5}),\n",
       " (13, 106, {'count': 3}),\n",
       " (13, 110, {'count': 18}),\n",
       " (13, 111, {'count': 3}),\n",
       " (13, 112, {'count': 7}),\n",
       " (13, 113, {'count': 27}),\n",
       " (13, 114, {'count': 54}),\n",
       " (13, 115, {'count': 113}),\n",
       " (13, 116, {'count': 2}),\n",
       " (13, 117, {'count': 73}),\n",
       " (13, 118, {'count': 20}),\n",
       " (13, 119, {'count': 2}),\n",
       " (13, 123, {'count': 31}),\n",
       " (13, 126, {'count': 51}),\n",
       " (13, 127, {'count': 4}),\n",
       " (13, 128, {'count': 2}),\n",
       " (13, 130, {'count': 7}),\n",
       " (13, 131, {'count': 7}),\n",
       " (13, 134, {'count': 1}),\n",
       " (13, 138, {'count': 4}),\n",
       " (13, 140, {'count': 7}),\n",
       " (13, 141, {'count': 40}),\n",
       " (13, 143, {'count': 39}),\n",
       " (13, 144, {'count': 36}),\n",
       " (13, 150, {'count': 2}),\n",
       " (13, 152, {'count': 72}),\n",
       " (13, 153, {'count': 120}),\n",
       " (13, 154, {'count': 37}),\n",
       " (13, 156, {'count': 59}),\n",
       " (13, 157, {'count': 56}),\n",
       " (13, 158, {'count': 12}),\n",
       " (13, 160, {'count': 1}),\n",
       " (13, 162, {'count': 33}),\n",
       " (13, 163, {'count': 66}),\n",
       " (13, 164, {'count': 5}),\n",
       " (13, 165, {'count': 38}),\n",
       " (13, 166, {'count': 24}),\n",
       " (13, 169, {'count': 1}),\n",
       " (13, 173, {'count': 11}),\n",
       " (13, 174, {'count': 2}),\n",
       " (13, 176, {'count': 18}),\n",
       " (13, 177, {'count': 48}),\n",
       " (13, 181, {'count': 7}),\n",
       " (13, 183, {'count': 2}),\n",
       " (13, 185, {'count': 2}),\n",
       " (13, 186, {'count': 1}),\n",
       " (13, 188, {'count': 9}),\n",
       " (13, 190, {'count': 70}),\n",
       " (13, 191, {'count': 1}),\n",
       " (13, 192, {'count': 13}),\n",
       " (13, 196, {'count': 2}),\n",
       " (13, 198, {'count': 7}),\n",
       " (13, 199, {'count': 1}),\n",
       " (13, 210, {'count': 10}),\n",
       " (13, 211, {'count': 8}),\n",
       " (13, 212, {'count': 4}),\n",
       " (13, 217, {'count': 1}),\n",
       " (13, 219, {'count': 9}),\n",
       " (13, 220, {'count': 384}),\n",
       " (13, 223, {'count': 14}),\n",
       " (13, 224, {'count': 9}),\n",
       " (13, 225, {'count': 24}),\n",
       " (13, 226, {'count': 17}),\n",
       " (13, 227, {'count': 16}),\n",
       " (13, 228, {'count': 10}),\n",
       " (13, 229, {'count': 28}),\n",
       " (13, 230, {'count': 11}),\n",
       " (13, 231, {'count': 4}),\n",
       " (13, 232, {'count': 14}),\n",
       " (13, 233, {'count': 6}),\n",
       " (13, 234, {'count': 2}),\n",
       " (13, 236, {'count': 1}),\n",
       " (13, 238, {'count': 5}),\n",
       " (13, 239, {'count': 19}),\n",
       " (13, 240, {'count': 4}),\n",
       " (13, 242, {'count': 3}),\n",
       " (13, 243, {'count': 12}),\n",
       " (13, 244, {'count': 6}),\n",
       " (13, 245, {'count': 6}),\n",
       " (13, 246, {'count': 4}),\n",
       " (13, 249, {'count': 3}),\n",
       " (13, 250, {'count': 4}),\n",
       " (13, 251, {'count': 4}),\n",
       " (13, 253, {'count': 5}),\n",
       " (13, 254, {'count': 5}),\n",
       " (13, 255, {'count': 1}),\n",
       " (13, 256, {'count': 5}),\n",
       " (13, 257, {'count': 6}),\n",
       " (13, 258, {'count': 11}),\n",
       " (13, 260, {'count': 9}),\n",
       " (13, 268, {'count': 8}),\n",
       " (13, 276, {'count': 2}),\n",
       " (13, 279, {'count': 4}),\n",
       " (13, 288, {'count': 3}),\n",
       " (13, 289, {'count': 11}),\n",
       " (13, 291, {'count': 9}),\n",
       " (13, 292, {'count': 2}),\n",
       " (13, 293, {'count': 1}),\n",
       " (13, 295, {'count': 4}),\n",
       " (13, 296, {'count': 5}),\n",
       " (13, 298, {'count': 3}),\n",
       " (13, 299, {'count': 11}),\n",
       " (13, 300, {'count': 14}),\n",
       " (13, 301, {'count': 1}),\n",
       " (13, 302, {'count': 17}),\n",
       " (13, 303, {'count': 11}),\n",
       " (13, 304, {'count': 3}),\n",
       " (13, 307, {'count': 4}),\n",
       " (13, 308, {'count': 4}),\n",
       " (13, 309, {'count': 2}),\n",
       " (13, 310, {'count': 1}),\n",
       " (13, 311, {'count': 7}),\n",
       " (13, 313, {'count': 26}),\n",
       " (13, 314, {'count': 1}),\n",
       " (13, 318, {'count': 3}),\n",
       " (13, 319, {'count': 33}),\n",
       " (13, 323, {'count': 3}),\n",
       " (13, 324, {'count': 50}),\n",
       " (13, 325, {'count': 3}),\n",
       " (13, 327, {'count': 21}),\n",
       " (13, 329, {'count': 56}),\n",
       " (13, 330, {'count': 4}),\n",
       " (13, 331, {'count': 1}),\n",
       " (13, 332, {'count': 66}),\n",
       " (13, 333, {'count': 4}),\n",
       " (13, 334, {'count': 6}),\n",
       " (13, 337, {'count': 2}),\n",
       " (13, 340, {'count': 38}),\n",
       " (13, 343, {'count': 3}),\n",
       " (13, 348, {'count': 7}),\n",
       " (13, 349, {'count': 18}),\n",
       " (13, 350, {'count': 3}),\n",
       " (14, 5, {'count': 24}),\n",
       " (14, 262, {'count': 1}),\n",
       " (14, 263, {'count': 2}),\n",
       " (14, 261, {'count': 3}),\n",
       " (14, 13, {'count': 1}),\n",
       " (14, 14, {'count': 145}),\n",
       " (14, 15, {'count': 91}),\n",
       " (14, 272, {'count': 3}),\n",
       " (14, 17, {'count': 6}),\n",
       " (14, 274, {'count': 5}),\n",
       " (14, 19, {'count': 16}),\n",
       " (14, 21, {'count': 5}),\n",
       " (14, 22, {'count': 26}),\n",
       " (14, 23, {'count': 1}),\n",
       " (14, 280, {'count': 4}),\n",
       " (14, 25, {'count': 3}),\n",
       " (14, 26, {'count': 5}),\n",
       " (14, 283, {'count': 2}),\n",
       " (14, 284, {'count': 3}),\n",
       " (14, 29, {'count': 6}),\n",
       " (14, 30, {'count': 1}),\n",
       " (14, 31, {'count': 1}),\n",
       " (14, 32, {'count': 11}),\n",
       " (14, 33, {'count': 15}),\n",
       " (14, 35, {'count': 2}),\n",
       " (14, 36, {'count': 19}),\n",
       " (14, 37, {'count': 18}),\n",
       " (14, 42, {'count': 6}),\n",
       " (14, 43, {'count': 7}),\n",
       " (14, 44, {'count': 3}),\n",
       " (14, 45, {'count': 9}),\n",
       " (14, 46, {'count': 2}),\n",
       " (14, 47, {'count': 7}),\n",
       " (14, 48, {'count': 33}),\n",
       " (14, 49, {'count': 6}),\n",
       " (14, 50, {'count': 6}),\n",
       " (14, 51, {'count': 2}),\n",
       " (14, 52, {'count': 1}),\n",
       " (14, 53, {'count': 8}),\n",
       " (14, 54, {'count': 3}),\n",
       " (14, 55, {'count': 34}),\n",
       " (14, 56, {'count': 6}),\n",
       " (14, 57, {'count': 48}),\n",
       " (14, 59, {'count': 71}),\n",
       " (14, 60, {'count': 4}),\n",
       " (14, 61, {'count': 1}),\n",
       " (14, 62, {'count': 15}),\n",
       " (14, 320, {'count': 1}),\n",
       " (14, 321, {'count': 1}),\n",
       " (14, 66, {'count': 2}),\n",
       " (14, 67, {'count': 1}),\n",
       " (14, 68, {'count': 5}),\n",
       " (14, 69, {'count': 4}),\n",
       " (14, 71, {'count': 10}),\n",
       " (14, 72, {'count': 11}),\n",
       " (14, 73, {'count': 15}),\n",
       " (14, 74, {'count': 1}),\n",
       " (14, 75, {'count': 8}),\n",
       " (14, 76, {'count': 13}),\n",
       " (14, 77, {'count': 30}),\n",
       " (14, 80, {'count': 26}),\n",
       " (14, 81, {'count': 11}),\n",
       " (14, 338, {'count': 1}),\n",
       " (14, 84, {'count': 18}),\n",
       " (14, 85, {'count': 1}),\n",
       " (14, 86, {'count': 3}),\n",
       " (14, 313, {'count': 1}),\n",
       " (14, 88, {'count': 1}),\n",
       " (14, 346, {'count': 3}),\n",
       " (14, 90, {'count': 33}),\n",
       " (14, 91, {'count': 31}),\n",
       " (14, 92, {'count': 4}),\n",
       " (14, 93, {'count': 1}),\n",
       " (14, 94, {'count': 2}),\n",
       " (14, 351, {'count': 2}),\n",
       " (14, 97, {'count': 33}),\n",
       " (14, 98, {'count': 1}),\n",
       " (14, 100, {'count': 7}),\n",
       " (14, 273, {'count': 8}),\n",
       " (14, 108, {'count': 20}),\n",
       " (14, 109, {'count': 4}),\n",
       " (14, 110, {'count': 2}),\n",
       " (14, 333, {'count': 1}),\n",
       " (14, 112, {'count': 4}),\n",
       " (14, 275, {'count': 1}),\n",
       " (14, 118, {'count': 2}),\n",
       " (14, 119, {'count': 5}),\n",
       " (14, 120, {'count': 4}),\n",
       " (14, 121, {'count': 4}),\n",
       " (14, 122, {'count': 4}),\n",
       " (14, 123, {'count': 2}),\n",
       " (14, 124, {'count': 26}),\n",
       " (14, 126, {'count': 3}),\n",
       " (14, 128, {'count': 1}),\n",
       " (14, 129, {'count': 76}),\n",
       " (14, 131, {'count': 1}),\n",
       " (14, 134, {'count': 33}),\n",
       " (14, 135, {'count': 16}),\n",
       " (14, 136, {'count': 1}),\n",
       " (14, 137, {'count': 28}),\n",
       " (14, 141, {'count': 1}),\n",
       " (14, 144, {'count': 1}),\n",
       " (14, 146, {'count': 3}),\n",
       " (14, 147, {'count': 2}),\n",
       " (14, 150, {'count': 6}),\n",
       " (14, 156, {'count': 1}),\n",
       " (14, 282, {'count': 7}),\n",
       " (14, 164, {'count': 2}),\n",
       " (14, 167, {'count': 8}),\n",
       " (14, 168, {'count': 16}),\n",
       " (14, 169, {'count': 20}),\n",
       " (14, 170, {'count': 10}),\n",
       " (14, 171, {'count': 5}),\n",
       " (14, 173, {'count': 1}),\n",
       " (14, 174, {'count': 4}),\n",
       " (14, 175, {'count': 1}),\n",
       " (14, 328, {'count': 2}),\n",
       " (14, 178, {'count': 3}),\n",
       " (14, 181, {'count': 5}),\n",
       " (14, 183, {'count': 1}),\n",
       " (14, 184, {'count': 5}),\n",
       " (14, 287, {'count': 21}),\n",
       " (14, 188, {'count': 1}),\n",
       " (14, 190, {'count': 2}),\n",
       " (14, 191, {'count': 5}),\n",
       " (14, 192, {'count': 3}),\n",
       " (14, 195, {'count': 3}),\n",
       " (14, 198, {'count': 10}),\n",
       " (14, 200, {'count': 1}),\n",
       " (14, 202, {'count': 15}),\n",
       " (14, 203, {'count': 5}),\n",
       " (14, 322, {'count': 2}),\n",
       " (14, 205, {'count': 36}),\n",
       " (14, 206, {'count': 9}),\n",
       " (14, 207, {'count': 5}),\n",
       " (14, 208, {'count': 3}),\n",
       " (14, 209, {'count': 1}),\n",
       " (14, 210, {'count': 1}),\n",
       " (14, 291, {'count': 1}),\n",
       " (14, 212, {'count': 1}),\n",
       " (14, 218, {'count': 3}),\n",
       " (14, 286, {'count': 1}),\n",
       " (14, 224, {'count': 2}),\n",
       " (14, 340, {'count': 1}),\n",
       " (14, 241, {'count': 47}),\n",
       " (14, 349, {'count': 2}),\n",
       " (14, 249, {'count': 5}),\n",
       " (14, 250, {'count': 1}),\n",
       " (14, 252, {'count': 4}),\n",
       " (14, 255, {'count': 8}),\n",
       " (15, 317, {'count': 5}),\n",
       " (15, 5, {'count': 12}),\n",
       " (15, 262, {'count': 2}),\n",
       " (15, 300, {'count': 1}),\n",
       " (15, 261, {'count': 5}),\n",
       " (15, 13, {'count': 1}),\n",
       " (15, 14, {'count': 65}),\n",
       " (15, 15, {'count': 96}),\n",
       " (15, 17, {'count': 1}),\n",
       " (15, 274, {'count': 10}),\n",
       " (15, 19, {'count': 36}),\n",
       " (15, 21, {'count': 15}),\n",
       " (15, 22, {'count': 28}),\n",
       " (15, 279, {'count': 1}),\n",
       " (15, 24, {'count': 1}),\n",
       " (15, 25, {'count': 1}),\n",
       " (15, 26, {'count': 1}),\n",
       " (15, 283, {'count': 3}),\n",
       " (15, 28, {'count': 1}),\n",
       " (15, 29, {'count': 5}),\n",
       " (15, 30, {'count': 3}),\n",
       " (15, 31, {'count': 5}),\n",
       " (15, 32, {'count': 69}),\n",
       " (15, 33, {'count': 30}),\n",
       " (15, 35, {'count': 4}),\n",
       " (15, 36, {'count': 57}),\n",
       " (15, 37, {'count': 5}),\n",
       " (15, 42, {'count': 6}),\n",
       " (15, 43, {'count': 3}),\n",
       " (15, 44, {'count': 16}),\n",
       " (15, 45, {'count': 7}),\n",
       " (15, 46, {'count': 4}),\n",
       " (15, 47, {'count': 4}),\n",
       " (15, 48, {'count': 10}),\n",
       " (15, 305, {'count': 1}),\n",
       " (15, 50, {'count': 16}),\n",
       " (15, 51, {'count': 14}),\n",
       " (15, 52, {'count': 3}),\n",
       " (15, 53, {'count': 1}),\n",
       " (15, 54, {'count': 2}),\n",
       " (15, 55, {'count': 34}),\n",
       " (15, 56, {'count': 3}),\n",
       " (15, 57, {'count': 80}),\n",
       " (15, 314, {'count': 1}),\n",
       " (15, 59, {'count': 79}),\n",
       " (15, 60, {'count': 4}),\n",
       " (15, 61, {'count': 4}),\n",
       " (15, 62, {'count': 7}),\n",
       " (15, 320, {'count': 6}),\n",
       " (15, 321, {'count': 1}),\n",
       " (15, 66, {'count': 1}),\n",
       " (15, 68, {'count': 2}),\n",
       " (15, 69, {'count': 3}),\n",
       " (15, 71, {'count': 7}),\n",
       " (15, 72, {'count': 15}),\n",
       " (15, 73, {'count': 44}),\n",
       " (15, 75, {'count': 22}),\n",
       " (15, 76, {'count': 4}),\n",
       " (15, 77, {'count': 6}),\n",
       " (15, 80, {'count': 21}),\n",
       " (15, 81, {'count': 11}),\n",
       " (15, 84, {'count': 7}),\n",
       " (15, 85, {'count': 6}),\n",
       " (15, 86, {'count': 3}),\n",
       " (15, 313, {'count': 4}),\n",
       " (15, 88, {'count': 2}),\n",
       " (15, 90, {'count': 26}),\n",
       " (15, 91, {'count': 1}),\n",
       " (15, 349, {'count': 5}),\n",
       " (15, 351, {'count': 5}),\n",
       " (15, 97, {'count': 15}),\n",
       " (15, 98, {'count': 14}),\n",
       " (15, 100, {'count': 1}),\n",
       " (15, 273, {'count': 5}),\n",
       " (15, 286, {'count': 1}),\n",
       " (15, 106, {'count': 1}),\n",
       " (15, 108, {'count': 20}),\n",
       " (15, 109, {'count': 8}),\n",
       " (15, 110, {'count': 1}),\n",
       " (15, 111, {'count': 1}),\n",
       " (15, 112, {'count': 5}),\n",
       " (15, 275, {'count': 55}),\n",
       " (15, 119, {'count': 9}),\n",
       " (15, 120, {'count': 11}),\n",
       " (15, 122, {'count': 1}),\n",
       " (15, 123, {'count': 2}),\n",
       " (15, 124, {'count': 18}),\n",
       " (15, 128, {'count': 3}),\n",
       " (15, 129, {'count': 47}),\n",
       " (15, 132, {'count': 1}),\n",
       " (15, 278, {'count': 3}),\n",
       " (15, 134, {'count': 23}),\n",
       " (15, 135, {'count': 14}),\n",
       " (15, 136, {'count': 7}),\n",
       " (15, 137, {'count': 17}),\n",
       " (15, 342, {'count': 5}),\n",
       " (15, 140, {'count': 1}),\n",
       " (15, 322, {'count': 1}),\n",
       " (15, 146, {'count': 18}),\n",
       " (15, 148, {'count': 1}),\n",
       " (15, 150, {'count': 2}),\n",
       " (15, 282, {'count': 21}),\n",
       " (15, 158, {'count': 1}),\n",
       " (15, 164, {'count': 1}),\n",
       " (15, 165, {'count': 2}),\n",
       " (15, 167, {'count': 1}),\n",
       " (15, 168, {'count': 5}),\n",
       " (15, 169, {'count': 3}),\n",
       " (15, 170, {'count': 3}),\n",
       " (15, 171, {'count': 3}),\n",
       " (15, 173, {'count': 1}),\n",
       " (15, 174, {'count': 3}),\n",
       " (15, 175, {'count': 13}),\n",
       " (15, 176, {'count': 3}),\n",
       " (15, 178, {'count': 33}),\n",
       " (15, 179, {'count': 1}),\n",
       " (15, 181, {'count': 3}),\n",
       " (15, 183, {'count': 2}),\n",
       " (15, 184, {'count': 2}),\n",
       " (15, 186, {'count': 9}),\n",
       " (15, 191, {'count': 3}),\n",
       " (15, 192, {'count': 7}),\n",
       " (15, 193, {'count': 1}),\n",
       " (15, 331, {'count': 2}),\n",
       " (15, 197, {'count': 1}),\n",
       " (15, 198, {'count': 9}),\n",
       " (15, 202, {'count': 21}),\n",
       " (15, 203, {'count': 9}),\n",
       " (15, 205, {'count': 59}),\n",
       " (15, 206, {'count': 7}),\n",
       " (15, 207, {'count': 1}),\n",
       " (15, 208, {'count': 4}),\n",
       " (15, 209, {'count': 3}),\n",
       " (15, 214, {'count': 4}),\n",
       " (15, 215, {'count': 3}),\n",
       " (15, 217, {'count': 2}),\n",
       " (15, 284, {'count': 4}),\n",
       " (15, 333, {'count': 40}),\n",
       " (15, 223, {'count': 1}),\n",
       " (15, 225, {'count': 1}),\n",
       " (15, 337, {'count': 2}),\n",
       " (15, 340, {'count': 1}),\n",
       " (15, 233, {'count': 1}),\n",
       " (15, 237, {'count': 1}),\n",
       " (15, 241, {'count': 85}),\n",
       " (15, 248, {'count': 1}),\n",
       " (15, 249, {'count': 11}),\n",
       " (15, 250, {'count': 1}),\n",
       " (15, 252, {'count': 17}),\n",
       " (15, 255, {'count': 2}),\n",
       " (16, 5, {'count': 1}),\n",
       " (16, 13, {'count': 24}),\n",
       " (16, 16, {'count': 69}),\n",
       " (16, 17, {'count': 35}),\n",
       " (16, 19, {'count': 2}),\n",
       " (16, 20, {'count': 49}),\n",
       " (16, 23, {'count': 18}),\n",
       " (16, 24, {'count': 31}),\n",
       " (16, 25, {'count': 5}),\n",
       " (16, 26, {'count': 4}),\n",
       " (16, 27, {'count': 8}),\n",
       " (16, 28, {'count': 3}),\n",
       " (16, 29, {'count': 19}),\n",
       " (16, 30, {'count': 14}),\n",
       " (16, 31, {'count': 36}),\n",
       " (16, 34, {'count': 11}),\n",
       " (16, 35, {'count': 1}),\n",
       " (16, 36, {'count': 27}),\n",
       " (16, 37, {'count': 2}),\n",
       " (16, 43, {'count': 4}),\n",
       " (16, 44, {'count': 4}),\n",
       " (16, 45, {'count': 1}),\n",
       " (16, 46, {'count': 7}),\n",
       " (16, 47, {'count': 23}),\n",
       " (16, 48, {'count': 4}),\n",
       " (16, 49, {'count': 16}),\n",
       " (16, 50, {'count': 3}),\n",
       " (16, 51, {'count': 3}),\n",
       " (16, 52, {'count': 1}),\n",
       " (16, 53, {'count': 8}),\n",
       " (16, 54, {'count': 4}),\n",
       " (16, 56, {'count': 9}),\n",
       " (16, 58, {'count': 101}),\n",
       " (16, 60, {'count': 36}),\n",
       " (16, 61, {'count': 44}),\n",
       " (16, 66, {'count': 7}),\n",
       " (16, 67, {'count': 20}),\n",
       " (16, 68, {'count': 2}),\n",
       " (16, 69, {'count': 72}),\n",
       " (16, 71, {'count': 8}),\n",
       " (16, 72, {'count': 1}),\n",
       " (16, 73, {'count': 1}),\n",
       " (16, 74, {'count': 9}),\n",
       " (16, 75, {'count': 24}),\n",
       " (16, 76, {'count': 1}),\n",
       " (16, 77, {'count': 1}),\n",
       " (16, 80, {'count': 7}),\n",
       " (16, 81, {'count': 9}),\n",
       " (16, 84, {'count': 16}),\n",
       " (16, 85, {'count': 13}),\n",
       " (16, 86, {'count': 21}),\n",
       " (16, 87, {'count': 15}),\n",
       " (16, 88, {'count': 11}),\n",
       " (16, 90, {'count': 2}),\n",
       " (16, 91, {'count': 2}),\n",
       " (16, 92, {'count': 16}),\n",
       " (16, 93, {'count': 19}),\n",
       " (16, 94, {'count': 35}),\n",
       " (16, 97, {'count': 3}),\n",
       " (16, 98, {'count': 15}),\n",
       " (16, 99, {'count': 2}),\n",
       " (16, 100, {'count': 18}),\n",
       " (16, 106, {'count': 10}),\n",
       " (16, 108, {'count': 3}),\n",
       " (16, 110, {'count': 11}),\n",
       " (16, 112, {'count': 3}),\n",
       " (16, 113, {'count': 7}),\n",
       " (16, 114, {'count': 12}),\n",
       " (16, 115, {'count': 9}),\n",
       " (16, 116, {'count': 11}),\n",
       " (16, 117, {'count': 6}),\n",
       " (16, 118, {'count': 21}),\n",
       " (16, 119, {'count': 6}),\n",
       " (16, 121, {'count': 1}),\n",
       " (16, 122, {'count': 1}),\n",
       " (16, 123, {'count': 21}),\n",
       " (16, 126, {'count': 31}),\n",
       " (16, 127, {'count': 1}),\n",
       " (16, 128, {'count': 20}),\n",
       " (16, 130, {'count': 39}),\n",
       " (16, 131, {'count': 2}),\n",
       " (16, 134, {'count': 1}),\n",
       " (16, 137, {'count': 1}),\n",
       " (16, 138, {'count': 5}),\n",
       " (16, 140, {'count': 5}),\n",
       " (16, 141, {'count': 13}),\n",
       " (16, 143, {'count': 7}),\n",
       " (16, 144, {'count': 21}),\n",
       " (16, 152, {'count': 4}),\n",
       " (16, 153, {'count': 4}),\n",
       " (16, 154, {'count': 14}),\n",
       " (16, 156, {'count': 9}),\n",
       " (16, 157, {'count': 2}),\n",
       " (16, 158, {'count': 7}),\n",
       " (16, 159, {'count': 1}),\n",
       " (16, 160, {'count': 7}),\n",
       " (16, 162, {'count': 4}),\n",
       " (16, 163, {'count': 3}),\n",
       " (16, 164, {'count': 4}),\n",
       " (16, 165, {'count': 9}),\n",
       " (16, 166, {'count': 2}),\n",
       " (16, 169, {'count': 2}),\n",
       " (16, 173, {'count': 6}),\n",
       " (16, 174, {'count': 1}),\n",
       " (16, 176, {'count': 19}),\n",
       " (16, 177, {'count': 11}),\n",
       " (16, 181, {'count': 3}),\n",
       " (16, 183, {'count': 21}),\n",
       " (16, 185, {'count': 6}),\n",
       " (16, 186, {'count': 7}),\n",
       " (16, 188, {'count': 2}),\n",
       " (16, 190, {'count': 25}),\n",
       " (16, 191, {'count': 13}),\n",
       " (16, 194, {'count': 2}),\n",
       " (16, 196, {'count': 2}),\n",
       " (16, 198, {'count': 4}),\n",
       " (16, 199, {'count': 3}),\n",
       " (16, 210, {'count': 21}),\n",
       " (16, 211, {'count': 5}),\n",
       " (16, 212, {'count': 5}),\n",
       " (16, 213, {'count': 7}),\n",
       " (16, 214, {'count': 8}),\n",
       " (16, 215, {'count': 3}),\n",
       " (16, 216, {'count': 4}),\n",
       " (16, 217, {'count': 1}),\n",
       " (16, 219, {'count': 9}),\n",
       " (16, 220, {'count': 6}),\n",
       " (16, 222, {'count': 2}),\n",
       " (16, 223, {'count': 15}),\n",
       " (16, 224, {'count': 5}),\n",
       " (16, 225, {'count': 2}),\n",
       " (16, 226, {'count': 5}),\n",
       " (16, 227, {'count': 7}),\n",
       " (16, 228, {'count': 1}),\n",
       " (16, 229, {'count': 2}),\n",
       " (16, 230, {'count': 5}),\n",
       " (16, 231, {'count': 1}),\n",
       " (16, 232, {'count': 8}),\n",
       " (16, 233, {'count': 1}),\n",
       " (16, 239, {'count': 2}),\n",
       " (16, 240, {'count': 1}),\n",
       " (16, 242, {'count': 3}),\n",
       " (16, 243, {'count': 1}),\n",
       " (16, 244, {'count': 1}),\n",
       " (16, 250, {'count': 2}),\n",
       " (16, 251, {'count': 2}),\n",
       " (16, 255, {'count': 4}),\n",
       " (16, 256, {'count': 1}),\n",
       " (16, 258, {'count': 3}),\n",
       " (16, 259, {'count': 4}),\n",
       " (16, 260, {'count': 9}),\n",
       " (16, 268, {'count': 4}),\n",
       " (16, 273, {'count': 1}),\n",
       " (16, 276, {'count': 3}),\n",
       " (16, 279, {'count': 3}),\n",
       " (16, 283, {'count': 1}),\n",
       " (16, 285, {'count': 4}),\n",
       " (16, 286, {'count': 9}),\n",
       " (16, 287, {'count': 10}),\n",
       " (16, 288, {'count': 6}),\n",
       " (16, 289, {'count': 9}),\n",
       " (16, 290, {'count': 1}),\n",
       " (16, 291, {'count': 10}),\n",
       " (16, 298, {'count': 1}),\n",
       " (16, 299, {'count': 1}),\n",
       " (16, 300, {'count': 8}),\n",
       " (16, 301, {'count': 8}),\n",
       " (16, 302, {'count': 3}),\n",
       " (16, 304, {'count': 1}),\n",
       " (16, 305, {'count': 1}),\n",
       " (16, 307, {'count': 7}),\n",
       " (16, 308, {'count': 2}),\n",
       " (16, 309, {'count': 6}),\n",
       " (16, 310, {'count': 8}),\n",
       " (16, 311, {'count': 1}),\n",
       " (16, 312, {'count': 1}),\n",
       " (16, 313, {'count': 1}),\n",
       " (16, 315, {'count': 3}),\n",
       " (16, 316, {'count': 1}),\n",
       " (16, 317, {'count': 1}),\n",
       " (16, 318, {'count': 1}),\n",
       " (16, 319, {'count': 3}),\n",
       " (16, 327, {'count': 2}),\n",
       " (16, 331, {'count': 1}),\n",
       " (16, 332, {'count': 2}),\n",
       " (16, 333, {'count': 6}),\n",
       " (16, 337, {'count': 5}),\n",
       " (16, 340, {'count': 1}),\n",
       " (16, 342, {'count': 1}),\n",
       " (16, 348, {'count': 1}),\n",
       " (16, 349, {'count': 1}),\n",
       " (17, 5, {'count': 2}),\n",
       " (17, 13, {'count': 21}),\n",
       " (17, 14, {'count': 4}),\n",
       " (17, 15, {'count': 1}),\n",
       " (17, 16, {'count': 25}),\n",
       " (17, 17, {'count': 118}),\n",
       " (17, 19, {'count': 7}),\n",
       " (17, 20, {'count': 28}),\n",
       " (17, 21, {'count': 4}),\n",
       " (17, 22, {'count': 2}),\n",
       " (17, 23, {'count': 22}),\n",
       " (17, 24, {'count': 1}),\n",
       " (17, 25, {'count': 15}),\n",
       " (17, 26, {'count': 23}),\n",
       " (17, 27, {'count': 16}),\n",
       " (17, 28, {'count': 9}),\n",
       " (17, 29, {'count': 30}),\n",
       " (17, 30, {'count': 57}),\n",
       " (17, 31, {'count': 15}),\n",
       " (17, 32, {'count': 5}),\n",
       " (17, 33, {'count': 6}),\n",
       " (17, 34, {'count': 7}),\n",
       " (17, 35, {'count': 3}),\n",
       " (17, 36, {'count': 32}),\n",
       " (17, 37, {'count': 8}),\n",
       " (17, 43, {'count': 6}),\n",
       " (17, 44, {'count': 8}),\n",
       " (17, 45, {'count': 6}),\n",
       " (17, 46, {'count': 8}),\n",
       " (17, 47, {'count': 27}),\n",
       " (17, 48, {'count': 20}),\n",
       " (17, 49, {'count': 10}),\n",
       " (17, 50, {'count': 2}),\n",
       " (17, 51, {'count': 11}),\n",
       " (17, 52, {'count': 13}),\n",
       " (17, 53, {'count': 7}),\n",
       " (17, 54, {'count': 26}),\n",
       " (17, 56, {'count': 57}),\n",
       " (17, 58, {'count': 54}),\n",
       " (17, 59, {'count': 3}),\n",
       " (17, 60, {'count': 25}),\n",
       " (17, 61, {'count': 84}),\n",
       " (17, 62, {'count': 2}),\n",
       " (17, 66, {'count': 14}),\n",
       " (17, 67, {'count': 25}),\n",
       " (17, 68, {'count': 2}),\n",
       " (17, 69, {'count': 308}),\n",
       " (17, 71, {'count': 30}),\n",
       " (17, 73, {'count': 8}),\n",
       " (17, 74, {'count': 20}),\n",
       " (17, 75, {'count': 10}),\n",
       " (17, 76, {'count': 2}),\n",
       " (17, 77, {'count': 19}),\n",
       " (17, 80, {'count': 8}),\n",
       " (17, 81, {'count': 10}),\n",
       " (17, 84, {'count': 8}),\n",
       " (17, 85, {'count': 27}),\n",
       " (17, 86, {'count': 38}),\n",
       " (17, 87, {'count': 11}),\n",
       " (17, 88, {'count': 25}),\n",
       " (17, 90, {'count': 9}),\n",
       " (17, 91, {'count': 43}),\n",
       " (17, 92, {'count': 16}),\n",
       " (17, 93, {'count': 16}),\n",
       " (17, 94, {'count': 14}),\n",
       " (17, 97, {'count': 7}),\n",
       " (17, 98, {'count': 13}),\n",
       " (17, 99, {'count': 7}),\n",
       " (17, 100, {'count': 15}),\n",
       " (17, 106, {'count': 5}),\n",
       " (17, 110, {'count': 9}),\n",
       " (17, 111, {'count': 3}),\n",
       " (17, 112, {'count': 37}),\n",
       " (17, 114, {'count': 5}),\n",
       " (17, 115, {'count': 7}),\n",
       " (17, 116, {'count': 15}),\n",
       " (17, 117, {'count': 3}),\n",
       " (17, 118, {'count': 6}),\n",
       " (17, 119, {'count': 4}),\n",
       " (17, 121, {'count': 1}),\n",
       " (17, 122, {'count': 40}),\n",
       " (17, 123, {'count': 41}),\n",
       " (17, 124, {'count': 4}),\n",
       " (17, 126, {'count': 18}),\n",
       " (17, 127, {'count': 1}),\n",
       " (17, 128, {'count': 63}),\n",
       " (17, 129, {'count': 1}),\n",
       " (17, 130, {'count': 76}),\n",
       " (17, 134, {'count': 1}),\n",
       " (17, 138, {'count': 4}),\n",
       " (17, 140, {'count': 13}),\n",
       " (17, 141, {'count': 4}),\n",
       " (17, 143, {'count': 9}),\n",
       " (17, 144, {'count': 8}),\n",
       " (17, 146, {'count': 2}),\n",
       " (17, 149, {'count': 1}),\n",
       " (17, 152, {'count': 3}),\n",
       " (17, 153, {'count': 4}),\n",
       " (17, 154, {'count': 8}),\n",
       " (17, 156, {'count': 4}),\n",
       " (17, 157, {'count': 3}),\n",
       " (17, 158, {'count': 32}),\n",
       " (17, 159, {'count': 23}),\n",
       " (17, 160, {'count': 11}),\n",
       " (17, 162, {'count': 7}),\n",
       " (17, 164, {'count': 12}),\n",
       " (17, 166, {'count': 7}),\n",
       " (17, 167, {'count': 1}),\n",
       " (17, 169, {'count': 2}),\n",
       " (17, 170, {'count': 1}),\n",
       " (17, 173, {'count': 13}),\n",
       " (17, 176, {'count': 21}),\n",
       " (17, 177, {'count': 4}),\n",
       " (17, 181, {'count': 15}),\n",
       " (17, 183, {'count': 78}),\n",
       " (17, 185, {'count': 14}),\n",
       " (17, 186, {'count': 4}),\n",
       " (17, 188, {'count': 6}),\n",
       " (17, 190, {'count': 2}),\n",
       " ...]"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "G.edges(data=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "44422"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(G.edges())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "300"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(G.nodes())"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Exercise\n",
    "\n",
    "Flex your memory muscles: can you make a scatter plot of the distribution of the number edges that have a certain number of trips? \n",
    "\n",
    "The key should be the number of trips between two nodes, and the value should be the number of edges that have that number of trips."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false,
    "slideshow": {
     "slide_type": "subslide"
    }
   },
   "outputs": [],
   "source": [
    "from collections import Counter\n",
    "# Count the number of edges that have x trips recorded on them.\n",
    "trip_count_distr = ______________________________\n",
    "\n",
    "# Then plot the distribution of these\n",
    "plt.scatter(_______________, _______________, alpha=0.1)\n",
    "plt.yscale('log')\n",
    "plt.xlabel('num. of trips')\n",
    "plt.ylabel('num. of edges')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "subslide"
    }
   },
   "source": [
    "### Exercise\n",
    "\n",
    "Create a new graph, and filter out the edges such that only those with more than 100 trips taken (i.e. `count >= 100`) are left."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false,
    "slideshow": {
     "slide_type": "subslide"
    }
   },
   "outputs": [],
   "source": [
    "# Filter the edges to just those with more than 100 trips.\n",
    "G_filtered = G.copy()\n",
    "for u, v, d in G.edges(data=True):\n",
    "    # Fill in your code here.\n",
    "        \n",
    "len(G_filtered.edges())"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "subslide"
    }
   },
   "source": [
    "Let's now try drawing the graph."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "subslide"
    }
   },
   "source": [
    "### Exercise\n",
    "\n",
    "Use `nx.draw(my_graph)` to draw the filtered graph to screen."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false,
    "slideshow": {
     "slide_type": "subslide"
    }
   },
   "outputs": [],
   "source": [
    "# Fill in your code here.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "subslide"
    }
   },
   "source": [
    "### Exercise\n",
    "\n",
    "Try visualizing the graph using a CircosPlot. Order the nodes by their connectivity in the **original** graph, but plot only the **filtered** graph edges."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false,
    "slideshow": {
     "slide_type": "subslide"
    }
   },
   "outputs": [],
   "source": [
    "nodes = sorted(_________________, key=lambda x:_________________)\n",
    "edges = ___________\n",
    "edgeprops = dict(alpha=0.1)\n",
    "nodecolor = plt.cm.viridis(np.arange(len(nodes)) / len(nodes)) \n",
    "fig = plt.figure(figsize=(6,6))\n",
    "ax = fig.add_subplot(111)\n",
    "c = CircosPlot(nodes, edges, radius=10, ax=ax, fig=fig, edgeprops=edgeprops, nodecolor=nodecolor)\n",
    "c.draw()\n",
    "plt.savefig('images/divvy.png', dpi=300)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "subslide"
    }
   },
   "source": [
    "In this visual, nodes are sorted from highest connectivity to lowest connectivity in the **unfiltered** graph.\n",
    "\n",
    "Edges represent only trips that were taken >100 times between those two nodes.\n",
    "\n",
    "Some things should be quite evident here. There are lots of trips between the highly connected nodes and other nodes, but there are local \"high traffic\" connections between stations of low connectivity as well (nodes in the top-right quadrant)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "# Saving NetworkX Graph Files\n",
    "\n",
    "NetworkX's API offers many formats for storing graphs to disk. If you intend to work exclusively with NetworkX, then pickling the file to disk is probably the easiest way.\n",
    "\n",
    "To write to disk: \n",
    "\n",
    "    nx.write_gpickle(G, handle)\n",
    "\n",
    "To load from disk:\n",
    "    \n",
    "    G = nx.read_gpickle(handle)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false,
    "slideshow": {
     "slide_type": "subslide"
    }
   },
   "outputs": [],
   "source": [
    "nx.write_gpickle(G, 'datasets/divvy_2013/divvy_graph.pkl')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true,
    "slideshow": {
     "slide_type": "fragment"
    }
   },
   "outputs": [],
   "source": [
    "G = nx.read_gpickle('datasets/divvy_2013/divvy_graph.pkl')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "celltoolbar": "Slideshow",
  "kernelspec": {
   "display_name": "Python [default]",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}