Type_The_Bible_v7.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Type Through The Bible\n",
    "\n",
    "By Kenneth Burchfiel\n",
    "\n",
    "Code is released under the MIT license; Bible verses are from the Web English Bible (Catholic Edition)* and are in the public domain.\n",
    "\n",
    "\\* Genesis was not found within the original WEB Catholic Edition folder, so I copied in files from another Web English Bible translation instead. I imagine, but am not certain, that these files are the same as the actual Catholic Edition Genesis files."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Instructions for getting started:\n",
    "\n",
    "If you have just downloaded this game, you'll want to create new copies of the **WEB_Catholic_Version_for_game_updated.csv**, **results.csv**, and **character_stats.csv** files. That way, the files will show your results and progress, not mine. You can do so using the following steps:\n",
    "\n",
    "1. Rename the existing versions of these files as **WEB_Catholic_Version_for_game_updated_sample.csv**, **results_sample.csv**, and **character_stats_sample.csv**.\n",
    "\n",
    "2. Make a copy of **WEB_Catholic_Version_for_game.csv** and rename it **WEB_Catholic_Version_for_game_updated.csv**.\n",
    "\n",
    "3. Make a copy of **blank_results_file.csv** and rename it **results.csv**.\n",
    "\n",
    "4. Make a copy of **blank_character_sttats_file.csv** and rename it **character_stats.csv**.\n",
    "\n",
    "\n",
    "You're now ready to play!"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## More documentation to come!"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Next steps: (Not necessarily in order of importance)\n",
    "\n",
    "* Finish documenting your v2 print code and the variables/ANSI escape codes that it uses\n",
    "* Improve chart formatting (e.g. add titles, legend names, etc.)\n",
    "* Add documentation to other parts of the code as well\n",
    "* Revise verse numbering for chapters that have lots of verses grouped together. (You can use the PDF version of the WEB as a guide for this)\n",
    "* Add in WPM comparisons by accuracy (in both scatterplot and bar chart form. You can create accuracy bins for the bar chart; these bins could be created automatically or specified ahead of time)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "pd.set_option('display.max_columns', 1000)\n",
    "import time\n",
    "import plotly.express as px\n",
    "from getch import getch # Installed this library using pip install py-getch, not\n",
    "# pip install getch. See https://github.com/joeyespo/py-getch\n",
    "import numpy as np\n",
    "from datetime import datetime, date, timezone # Based on \n",
    "# https://docs.python.org/3/library/datetime.html\n",
    "import os\n",
    "from colorama import just_fix_windows_console, Fore, Back, Style\n",
    "# From https://github.com/tartley/colorama/blob/master/demos/demo01.py\n",
    "just_fix_windows_console() # From https://github.com/tartley/colorama/blob/master/demos/demo01.py\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "extra_analyses = False"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Checking whether the program is currently running on a Jupyter notebook:\n",
    "\n",
    "(The program normally uses getch() to begin typing tests; however, I wasn't able to enter input after getch() got called within a Jupyter notebook and thus couldn't begin a typing test in that situation. Therefore, the program will use input() instead of getch() to start tests when running within a notebook.)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "# The following method of determining whether the code is running\n",
    "# within a Jupyter notebook is based on Gustavo Bezerra's response\n",
    "# at https://stackoverflow.com/a/39662359/13097194 . I found that\n",
    "# just calling get_ipython() was sufficient, at least on Windows and within\n",
    "# Visual Studio Code; his answer is more complex.\n",
    "\n",
    "try: \n",
    "    get_ipython()\n",
    "    run_on_notebook = True\n",
    "except:\n",
    "    run_on_notebook = False\n",
    "\n",
    "# print(run_on_notebook)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Book_Order</th>\n",
       "      <th>Book_Name</th>\n",
       "      <th>Chapter_Name</th>\n",
       "      <th>Book_and_Chapter</th>\n",
       "      <th>Chapter_Order</th>\n",
       "      <th>Verse_#</th>\n",
       "      <th>Verse_Order</th>\n",
       "      <th>Verse</th>\n",
       "      <th>Characters</th>\n",
       "      <th>Typed</th>\n",
       "      <th>Tests</th>\n",
       "      <th>Fastest_WPM</th>\n",
       "      <th>Characters_Typed</th>\n",
       "      <th>Total_Characters_Typed</th>\n",
       "      <th>Count</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>In the beginning, God created the heavens and ...</td>\n",
       "      <td>56</td>\n",
       "      <td>1</td>\n",
       "      <td>8</td>\n",
       "      <td>193.251509</td>\n",
       "      <td>56</td>\n",
       "      <td>448</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>The earth was formless and empty. Darkness was...</td>\n",
       "      <td>135</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>140.461827</td>\n",
       "      <td>135</td>\n",
       "      <td>270</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>God said, \"Let there be light,\" and there was ...</td>\n",
       "      <td>52</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>84.008493</td>\n",
       "      <td>52</td>\n",
       "      <td>52</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>God saw the light, and saw that it was good. G...</td>\n",
       "      <td>85</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>123.198378</td>\n",
       "      <td>85</td>\n",
       "      <td>85</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>5</td>\n",
       "      <td>5</td>\n",
       "      <td>God called the light \"day\", and the darkness h...</td>\n",
       "      <td>119</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>135.664272</td>\n",
       "      <td>119</td>\n",
       "      <td>119</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35374</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>17</td>\n",
       "      <td>35375</td>\n",
       "      <td>The Spirit and the bride say, \"Come!\" He who h...</td>\n",
       "      <td>160</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35375</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>18</td>\n",
       "      <td>35376</td>\n",
       "      <td>I testify to everyone who hears the words of t...</td>\n",
       "      <td>159</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35376</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>19</td>\n",
       "      <td>35377</td>\n",
       "      <td>If anyone takes away from the words of the boo...</td>\n",
       "      <td>174</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35377</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>20</td>\n",
       "      <td>35378</td>\n",
       "      <td>He who testifies these things says, \"Yes, I am...</td>\n",
       "      <td>89</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35378</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>21</td>\n",
       "      <td>35379</td>\n",
       "      <td>The grace of the Lord Jesus Christ be with all...</td>\n",
       "      <td>64</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>161.093106</td>\n",
       "      <td>64</td>\n",
       "      <td>64</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>35379 rows × 15 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "       Book_Order Book_Name  Chapter_Name Book_and_Chapter  Chapter_Order  \\\n",
       "0               1       GEN             1            GEN 1              1   \n",
       "1               1       GEN             1            GEN 1              1   \n",
       "2               1       GEN             1            GEN 1              1   \n",
       "3               1       GEN             1            GEN 1              1   \n",
       "4               1       GEN             1            GEN 1              1   \n",
       "...           ...       ...           ...              ...            ...   \n",
       "35374          95       REV            22           REV 22           1328   \n",
       "35375          95       REV            22           REV 22           1328   \n",
       "35376          95       REV            22           REV 22           1328   \n",
       "35377          95       REV            22           REV 22           1328   \n",
       "35378          95       REV            22           REV 22           1328   \n",
       "\n",
       "       Verse_#  Verse_Order  \\\n",
       "0            1            1   \n",
       "1            2            2   \n",
       "2            3            3   \n",
       "3            4            4   \n",
       "4            5            5   \n",
       "...        ...          ...   \n",
       "35374       17        35375   \n",
       "35375       18        35376   \n",
       "35376       19        35377   \n",
       "35377       20        35378   \n",
       "35378       21        35379   \n",
       "\n",
       "                                                   Verse  Characters  Typed  \\\n",
       "0      In the beginning, God created the heavens and ...          56      1   \n",
       "1      The earth was formless and empty. Darkness was...         135      1   \n",
       "2      God said, \"Let there be light,\" and there was ...          52      1   \n",
       "3      God saw the light, and saw that it was good. G...          85      1   \n",
       "4      God called the light \"day\", and the darkness h...         119      1   \n",
       "...                                                  ...         ...    ...   \n",
       "35374  The Spirit and the bride say, \"Come!\" He who h...         160      0   \n",
       "35375  I testify to everyone who hears the words of t...         159      0   \n",
       "35376  If anyone takes away from the words of the boo...         174      0   \n",
       "35377  He who testifies these things says, \"Yes, I am...          89      0   \n",
       "35378  The grace of the Lord Jesus Christ be with all...          64      1   \n",
       "\n",
       "       Tests  Fastest_WPM  Characters_Typed  Total_Characters_Typed  Count  \n",
       "0          8   193.251509                56                     448      1  \n",
       "1          2   140.461827               135                     270      1  \n",
       "2          1    84.008493                52                      52      1  \n",
       "3          1   123.198378                85                      85      1  \n",
       "4          1   135.664272               119                     119      1  \n",
       "...      ...          ...               ...                     ...    ...  \n",
       "35374      0          NaN                 0                       0      1  \n",
       "35375      0          NaN                 0                       0      1  \n",
       "35376      0          NaN                 0                       0      1  \n",
       "35377      0          NaN                 0                       0      1  \n",
       "35378      1   161.093106                64                      64      1  \n",
       "\n",
       "[35379 rows x 15 columns]"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_Bible = pd.read_csv('WEB_Catholic_Version_for_game_updated.csv')\n",
    "df_Bible"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Unix_Start_Time</th>\n",
       "      <th>Local_Start_Time</th>\n",
       "      <th>UTC_Start_Time</th>\n",
       "      <th>Characters</th>\n",
       "      <th>Seconds</th>\n",
       "      <th>CPS</th>\n",
       "      <th>WPM</th>\n",
       "      <th>Book</th>\n",
       "      <th>Chapter</th>\n",
       "      <th>Verse_Order</th>\n",
       "      <th>Verse</th>\n",
       "      <th>Verse #</th>\n",
       "      <th>Last 10 Avg</th>\n",
       "      <th>Last 100 Avg</th>\n",
       "      <th>Last 1000 Avg</th>\n",
       "      <th>cumulative_avg</th>\n",
       "      <th>Local_Start_Year</th>\n",
       "      <th>Local_Start_Month</th>\n",
       "      <th>Local_Start_Hour</th>\n",
       "      <th>Count</th>\n",
       "      <th>Local_Start_Date</th>\n",
       "      <th>Local_Start_Minute</th>\n",
       "      <th>Local_Start_10_Minute_Block</th>\n",
       "      <th>Local_Start_15_Minute_Block</th>\n",
       "      <th>Local_Start_30_Minute_Block</th>\n",
       "      <th>Local_End_Time</th>\n",
       "      <th>Local_End_Year</th>\n",
       "      <th>Local_End_Month</th>\n",
       "      <th>Local_End_Date</th>\n",
       "      <th>Local_End_Hour</th>\n",
       "      <th>Local_End_Minute</th>\n",
       "      <th>Local_End_15_Minute_Block</th>\n",
       "      <th>Local_End_10_Minute_Block</th>\n",
       "      <th>Local_End_30_Minute_Block</th>\n",
       "      <th>Mistake_Free_Test</th>\n",
       "      <th>WPM_Rank</th>\n",
       "      <th>WPM_Percentile</th>\n",
       "      <th>Backspaces as % of Verse Length</th>\n",
       "      <th>Incorrect Characters as % of Verse Length</th>\n",
       "      <th>Min Character Time (ms)</th>\n",
       "      <th>Median Character Time (ms)</th>\n",
       "      <th>Max Character Time (ms)</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Test_Number</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1.698121e+09</td>\n",
       "      <td>2023-10-24 00:17:38.017017</td>\n",
       "      <td>2023-10-24 04:17:38.017017+00:00</td>\n",
       "      <td>56</td>\n",
       "      <td>6.571754</td>\n",
       "      <td>8.521317</td>\n",
       "      <td>102.255799</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>In the beginning, God created the heavens and ...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>102.256</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>17</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24 00:17:44.588771456</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>0</td>\n",
       "      <td>17</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2303</td>\n",
       "      <td>8.323377</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1.698121e+09</td>\n",
       "      <td>2023-10-24 00:18:06.165502</td>\n",
       "      <td>2023-10-24 04:18:06.165502+00:00</td>\n",
       "      <td>135</td>\n",
       "      <td>13.997536</td>\n",
       "      <td>9.644554</td>\n",
       "      <td>115.734653</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>The earth was formless and empty. Darkness was...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>108.995</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>18</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24 00:18:20.163038180</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>0</td>\n",
       "      <td>18</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1958</td>\n",
       "      <td>22.062923</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1.698121e+09</td>\n",
       "      <td>2023-10-24 00:18:24.381290</td>\n",
       "      <td>2023-10-24 04:18:24.381290+00:00</td>\n",
       "      <td>56</td>\n",
       "      <td>4.714291</td>\n",
       "      <td>11.878774</td>\n",
       "      <td>142.545292</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>In the beginning, God created the heavens and ...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>120.179</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>18</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24 00:18:29.095581096</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>0</td>\n",
       "      <td>18</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>780</td>\n",
       "      <td>68.976503</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1.698121e+09</td>\n",
       "      <td>2023-10-24 00:21:24.331389</td>\n",
       "      <td>2023-10-24 04:21:24.331389+00:00</td>\n",
       "      <td>56</td>\n",
       "      <td>4.878704</td>\n",
       "      <td>11.478458</td>\n",
       "      <td>137.741497</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>In the beginning, God created the heavens and ...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>124.569</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>21</td>\n",
       "      <td>3</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24 00:21:29.210093071</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>0</td>\n",
       "      <td>21</td>\n",
       "      <td>2</td>\n",
       "      <td>3</td>\n",
       "      <td>1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1010</td>\n",
       "      <td>59.816806</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>1.698121e+09</td>\n",
       "      <td>2023-10-24 00:22:03.749152</td>\n",
       "      <td>2023-10-24 04:22:03.749152+00:00</td>\n",
       "      <td>135</td>\n",
       "      <td>19.078445</td>\n",
       "      <td>7.076048</td>\n",
       "      <td>84.912580</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>The earth was formless and empty. Darkness was...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>116.638</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>22</td>\n",
       "      <td>3</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24 00:22:22.827597200</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>0</td>\n",
       "      <td>22</td>\n",
       "      <td>2</td>\n",
       "      <td>3</td>\n",
       "      <td>1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2466</td>\n",
       "      <td>1.831939</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2507</th>\n",
       "      <td>1.700629e+09</td>\n",
       "      <td>2023-11-21 23:49:49.822542</td>\n",
       "      <td>2023-11-22 04:49:49.822542+00:00</td>\n",
       "      <td>123</td>\n",
       "      <td>8.923488</td>\n",
       "      <td>13.783848</td>\n",
       "      <td>165.406179</td>\n",
       "      <td>EXO</td>\n",
       "      <td>29</td>\n",
       "      <td>2354</td>\n",
       "      <td>You shall cut the ram into its pieces, and was...</td>\n",
       "      <td>17.0</td>\n",
       "      <td>141.791645</td>\n",
       "      <td>141.013309</td>\n",
       "      <td>131.264570</td>\n",
       "      <td>131.521</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>23</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>49</td>\n",
       "      <td>5</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "      <td>2023-11-21 23:49:58.746029663</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>23</td>\n",
       "      <td>49</td>\n",
       "      <td>4</td>\n",
       "      <td>5</td>\n",
       "      <td>2</td>\n",
       "      <td>0.0</td>\n",
       "      <td>101</td>\n",
       "      <td>96.017523</td>\n",
       "      <td>0.813008</td>\n",
       "      <td>0.813008</td>\n",
       "      <td>0.469685</td>\n",
       "      <td>58.214903</td>\n",
       "      <td>218.698978</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2508</th>\n",
       "      <td>1.700629e+09</td>\n",
       "      <td>2023-11-21 23:49:59.784727</td>\n",
       "      <td>2023-11-22 04:49:59.784727+00:00</td>\n",
       "      <td>140</td>\n",
       "      <td>13.892433</td>\n",
       "      <td>10.077428</td>\n",
       "      <td>120.929140</td>\n",
       "      <td>EXO</td>\n",
       "      <td>29</td>\n",
       "      <td>2355</td>\n",
       "      <td>You shall burn the whole ram on the altar: it ...</td>\n",
       "      <td>18.0</td>\n",
       "      <td>141.799736</td>\n",
       "      <td>140.749500</td>\n",
       "      <td>131.242792</td>\n",
       "      <td>131.517</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>23</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>49</td>\n",
       "      <td>5</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "      <td>2023-11-21 23:50:13.677160167</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>23</td>\n",
       "      <td>50</td>\n",
       "      <td>4</td>\n",
       "      <td>6</td>\n",
       "      <td>2</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1762</td>\n",
       "      <td>29.868578</td>\n",
       "      <td>10.000000</td>\n",
       "      <td>8.571429</td>\n",
       "      <td>12.137651</td>\n",
       "      <td>70.702791</td>\n",
       "      <td>334.392071</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2509</th>\n",
       "      <td>1.700629e+09</td>\n",
       "      <td>2023-11-21 23:50:14.600039</td>\n",
       "      <td>2023-11-22 04:50:14.600039+00:00</td>\n",
       "      <td>99</td>\n",
       "      <td>7.575344</td>\n",
       "      <td>13.068713</td>\n",
       "      <td>156.824560</td>\n",
       "      <td>EXO</td>\n",
       "      <td>29</td>\n",
       "      <td>2356</td>\n",
       "      <td>\"You shall take the other ram, and Aaron and h...</td>\n",
       "      <td>19.0</td>\n",
       "      <td>143.112084</td>\n",
       "      <td>140.817879</td>\n",
       "      <td>131.274855</td>\n",
       "      <td>131.527</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>23</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>50</td>\n",
       "      <td>6</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "      <td>2023-11-21 23:50:22.175383086</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>23</td>\n",
       "      <td>50</td>\n",
       "      <td>4</td>\n",
       "      <td>6</td>\n",
       "      <td>2</td>\n",
       "      <td>0.0</td>\n",
       "      <td>278</td>\n",
       "      <td>88.968538</td>\n",
       "      <td>1.010101</td>\n",
       "      <td>1.010101</td>\n",
       "      <td>0.876904</td>\n",
       "      <td>57.777762</td>\n",
       "      <td>246.771574</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2510</th>\n",
       "      <td>1.700629e+09</td>\n",
       "      <td>2023-11-21 23:50:22.823804</td>\n",
       "      <td>2023-11-22 04:50:22.823804+00:00</td>\n",
       "      <td>272</td>\n",
       "      <td>21.067447</td>\n",
       "      <td>12.910914</td>\n",
       "      <td>154.930967</td>\n",
       "      <td>EXO</td>\n",
       "      <td>29</td>\n",
       "      <td>2357</td>\n",
       "      <td>Then you shall kill the ram, and take some of ...</td>\n",
       "      <td>20.0</td>\n",
       "      <td>145.616766</td>\n",
       "      <td>140.601527</td>\n",
       "      <td>131.319924</td>\n",
       "      <td>131.537</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>23</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>50</td>\n",
       "      <td>6</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "      <td>2023-11-21 23:50:43.891251424</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>23</td>\n",
       "      <td>50</td>\n",
       "      <td>4</td>\n",
       "      <td>6</td>\n",
       "      <td>2</td>\n",
       "      <td>0.0</td>\n",
       "      <td>336</td>\n",
       "      <td>86.658702</td>\n",
       "      <td>1.838235</td>\n",
       "      <td>1.838235</td>\n",
       "      <td>11.717319</td>\n",
       "      <td>59.235811</td>\n",
       "      <td>330.488205</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2511</th>\n",
       "      <td>1.700629e+09</td>\n",
       "      <td>2023-11-21 23:50:53.642747</td>\n",
       "      <td>2023-11-22 04:50:53.642867+00:00</td>\n",
       "      <td>273</td>\n",
       "      <td>24.269703</td>\n",
       "      <td>11.248593</td>\n",
       "      <td>134.983111</td>\n",
       "      <td>EXO</td>\n",
       "      <td>29</td>\n",
       "      <td>2358</td>\n",
       "      <td>You shall take of the blood that is on the alt...</td>\n",
       "      <td>21.0</td>\n",
       "      <td>144.178197</td>\n",
       "      <td>140.325825</td>\n",
       "      <td>131.296062</td>\n",
       "      <td>131.538</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>23</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>50</td>\n",
       "      <td>6</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "      <td>2023-11-21 23:51:17.912449911</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>23</td>\n",
       "      <td>51</td>\n",
       "      <td>4</td>\n",
       "      <td>6</td>\n",
       "      <td>2</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1143</td>\n",
       "      <td>54.520112</td>\n",
       "      <td>5.128205</td>\n",
       "      <td>5.128205</td>\n",
       "      <td>1.009464</td>\n",
       "      <td>58.473825</td>\n",
       "      <td>535.244703</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>2511 rows × 42 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "             Unix_Start_Time            Local_Start_Time  \\\n",
       "Test_Number                                                \n",
       "1               1.698121e+09  2023-10-24 00:17:38.017017   \n",
       "2               1.698121e+09  2023-10-24 00:18:06.165502   \n",
       "3               1.698121e+09  2023-10-24 00:18:24.381290   \n",
       "4               1.698121e+09  2023-10-24 00:21:24.331389   \n",
       "5               1.698121e+09  2023-10-24 00:22:03.749152   \n",
       "...                      ...                         ...   \n",
       "2507            1.700629e+09  2023-11-21 23:49:49.822542   \n",
       "2508            1.700629e+09  2023-11-21 23:49:59.784727   \n",
       "2509            1.700629e+09  2023-11-21 23:50:14.600039   \n",
       "2510            1.700629e+09  2023-11-21 23:50:22.823804   \n",
       "2511            1.700629e+09  2023-11-21 23:50:53.642747   \n",
       "\n",
       "                               UTC_Start_Time  Characters    Seconds  \\\n",
       "Test_Number                                                            \n",
       "1            2023-10-24 04:17:38.017017+00:00          56   6.571754   \n",
       "2            2023-10-24 04:18:06.165502+00:00         135  13.997536   \n",
       "3            2023-10-24 04:18:24.381290+00:00          56   4.714291   \n",
       "4            2023-10-24 04:21:24.331389+00:00          56   4.878704   \n",
       "5            2023-10-24 04:22:03.749152+00:00         135  19.078445   \n",
       "...                                       ...         ...        ...   \n",
       "2507         2023-11-22 04:49:49.822542+00:00         123   8.923488   \n",
       "2508         2023-11-22 04:49:59.784727+00:00         140  13.892433   \n",
       "2509         2023-11-22 04:50:14.600039+00:00          99   7.575344   \n",
       "2510         2023-11-22 04:50:22.823804+00:00         272  21.067447   \n",
       "2511         2023-11-22 04:50:53.642867+00:00         273  24.269703   \n",
       "\n",
       "                   CPS         WPM Book  Chapter  Verse_Order  \\\n",
       "Test_Number                                                     \n",
       "1             8.521317  102.255799  GEN        1            1   \n",
       "2             9.644554  115.734653  GEN        1            2   \n",
       "3            11.878774  142.545292  GEN        1            1   \n",
       "4            11.478458  137.741497  GEN        1            1   \n",
       "5             7.076048   84.912580  GEN        1            2   \n",
       "...                ...         ...  ...      ...          ...   \n",
       "2507         13.783848  165.406179  EXO       29         2354   \n",
       "2508         10.077428  120.929140  EXO       29         2355   \n",
       "2509         13.068713  156.824560  EXO       29         2356   \n",
       "2510         12.910914  154.930967  EXO       29         2357   \n",
       "2511         11.248593  134.983111  EXO       29         2358   \n",
       "\n",
       "                                                         Verse  Verse #  \\\n",
       "Test_Number                                                               \n",
       "1            In the beginning, God created the heavens and ...      NaN   \n",
       "2            The earth was formless and empty. Darkness was...      NaN   \n",
       "3            In the beginning, God created the heavens and ...      NaN   \n",
       "4            In the beginning, God created the heavens and ...      NaN   \n",
       "5            The earth was formless and empty. Darkness was...      NaN   \n",
       "...                                                        ...      ...   \n",
       "2507         You shall cut the ram into its pieces, and was...     17.0   \n",
       "2508         You shall burn the whole ram on the altar: it ...     18.0   \n",
       "2509         \"You shall take the other ram, and Aaron and h...     19.0   \n",
       "2510         Then you shall kill the ram, and take some of ...     20.0   \n",
       "2511         You shall take of the blood that is on the alt...     21.0   \n",
       "\n",
       "             Last 10 Avg  Last 100 Avg  Last 1000 Avg  cumulative_avg  \\\n",
       "Test_Number                                                             \n",
       "1                    NaN           NaN            NaN         102.256   \n",
       "2                    NaN           NaN            NaN         108.995   \n",
       "3                    NaN           NaN            NaN         120.179   \n",
       "4                    NaN           NaN            NaN         124.569   \n",
       "5                    NaN           NaN            NaN         116.638   \n",
       "...                  ...           ...            ...             ...   \n",
       "2507          141.791645    141.013309     131.264570         131.521   \n",
       "2508          141.799736    140.749500     131.242792         131.517   \n",
       "2509          143.112084    140.817879     131.274855         131.527   \n",
       "2510          145.616766    140.601527     131.319924         131.537   \n",
       "2511          144.178197    140.325825     131.296062         131.538   \n",
       "\n",
       "             Local_Start_Year  Local_Start_Month  Local_Start_Hour  Count  \\\n",
       "Test_Number                                                                 \n",
       "1                        2023                 10                 0      1   \n",
       "2                        2023                 10                 0      1   \n",
       "3                        2023                 10                 0      1   \n",
       "4                        2023                 10                 0      1   \n",
       "5                        2023                 10                 0      1   \n",
       "...                       ...                ...               ...    ...   \n",
       "2507                     2023                 11                23      1   \n",
       "2508                     2023                 11                23      1   \n",
       "2509                     2023                 11                23      1   \n",
       "2510                     2023                 11                23      1   \n",
       "2511                     2023                 11                23      1   \n",
       "\n",
       "            Local_Start_Date  Local_Start_Minute  Local_Start_10_Minute_Block  \\\n",
       "Test_Number                                                                     \n",
       "1                 2023-10-24                  17                            2   \n",
       "2                 2023-10-24                  18                            2   \n",
       "3                 2023-10-24                  18                            2   \n",
       "4                 2023-10-24                  21                            3   \n",
       "5                 2023-10-24                  22                            3   \n",
       "...                      ...                 ...                          ...   \n",
       "2507              2023-11-21                  49                            5   \n",
       "2508              2023-11-21                  49                            5   \n",
       "2509              2023-11-21                  50                            6   \n",
       "2510              2023-11-21                  50                            6   \n",
       "2511              2023-11-21                  50                            6   \n",
       "\n",
       "             Local_Start_15_Minute_Block  Local_Start_30_Minute_Block  \\\n",
       "Test_Number                                                             \n",
       "1                                      2                            1   \n",
       "2                                      2                            1   \n",
       "3                                      2                            1   \n",
       "4                                      2                            1   \n",
       "5                                      2                            1   \n",
       "...                                  ...                          ...   \n",
       "2507                                   4                            2   \n",
       "2508                                   4                            2   \n",
       "2509                                   4                            2   \n",
       "2510                                   4                            2   \n",
       "2511                                   4                            2   \n",
       "\n",
       "                            Local_End_Time  Local_End_Year  Local_End_Month  \\\n",
       "Test_Number                                                                   \n",
       "1            2023-10-24 00:17:44.588771456            2023               10   \n",
       "2            2023-10-24 00:18:20.163038180            2023               10   \n",
       "3            2023-10-24 00:18:29.095581096            2023               10   \n",
       "4            2023-10-24 00:21:29.210093071            2023               10   \n",
       "5            2023-10-24 00:22:22.827597200            2023               10   \n",
       "...                                    ...             ...              ...   \n",
       "2507         2023-11-21 23:49:58.746029663            2023               11   \n",
       "2508         2023-11-21 23:50:13.677160167            2023               11   \n",
       "2509         2023-11-21 23:50:22.175383086            2023               11   \n",
       "2510         2023-11-21 23:50:43.891251424            2023               11   \n",
       "2511         2023-11-21 23:51:17.912449911            2023               11   \n",
       "\n",
       "            Local_End_Date  Local_End_Hour  Local_End_Minute  \\\n",
       "Test_Number                                                    \n",
       "1               2023-10-24               0                17   \n",
       "2               2023-10-24               0                18   \n",
       "3               2023-10-24               0                18   \n",
       "4               2023-10-24               0                21   \n",
       "5               2023-10-24               0                22   \n",
       "...                    ...             ...               ...   \n",
       "2507            2023-11-21              23                49   \n",
       "2508            2023-11-21              23                50   \n",
       "2509            2023-11-21              23                50   \n",
       "2510            2023-11-21              23                50   \n",
       "2511            2023-11-21              23                51   \n",
       "\n",
       "             Local_End_15_Minute_Block  Local_End_10_Minute_Block  \\\n",
       "Test_Number                                                         \n",
       "1                                    2                          2   \n",
       "2                                    2                          2   \n",
       "3                                    2                          2   \n",
       "4                                    2                          3   \n",
       "5                                    2                          3   \n",
       "...                                ...                        ...   \n",
       "2507                                 4                          5   \n",
       "2508                                 4                          6   \n",
       "2509                                 4                          6   \n",
       "2510                                 4                          6   \n",
       "2511                                 4                          6   \n",
       "\n",
       "             Local_End_30_Minute_Block  Mistake_Free_Test  WPM_Rank  \\\n",
       "Test_Number                                                           \n",
       "1                                    1                NaN      2303   \n",
       "2                                    1                NaN      1958   \n",
       "3                                    1                NaN       780   \n",
       "4                                    1                NaN      1010   \n",
       "5                                    1                NaN      2466   \n",
       "...                                ...                ...       ...   \n",
       "2507                                 2                0.0       101   \n",
       "2508                                 2                0.0      1762   \n",
       "2509                                 2                0.0       278   \n",
       "2510                                 2                0.0       336   \n",
       "2511                                 2                0.0      1143   \n",
       "\n",
       "             WPM_Percentile  Backspaces as % of Verse Length  \\\n",
       "Test_Number                                                    \n",
       "1                  8.323377                              NaN   \n",
       "2                 22.062923                              NaN   \n",
       "3                 68.976503                              NaN   \n",
       "4                 59.816806                              NaN   \n",
       "5                  1.831939                              NaN   \n",
       "...                     ...                              ...   \n",
       "2507              96.017523                         0.813008   \n",
       "2508              29.868578                        10.000000   \n",
       "2509              88.968538                         1.010101   \n",
       "2510              86.658702                         1.838235   \n",
       "2511              54.520112                         5.128205   \n",
       "\n",
       "             Incorrect Characters as % of Verse Length  \\\n",
       "Test_Number                                              \n",
       "1                                                  NaN   \n",
       "2                                                  NaN   \n",
       "3                                                  NaN   \n",
       "4                                                  NaN   \n",
       "5                                                  NaN   \n",
       "...                                                ...   \n",
       "2507                                          0.813008   \n",
       "2508                                          8.571429   \n",
       "2509                                          1.010101   \n",
       "2510                                          1.838235   \n",
       "2511                                          5.128205   \n",
       "\n",
       "             Min Character Time (ms)  Median Character Time (ms)  \\\n",
       "Test_Number                                                        \n",
       "1                                NaN                         NaN   \n",
       "2                                NaN                         NaN   \n",
       "3                                NaN                         NaN   \n",
       "4                                NaN                         NaN   \n",
       "5                                NaN                         NaN   \n",
       "...                              ...                         ...   \n",
       "2507                        0.469685                   58.214903   \n",
       "2508                       12.137651                   70.702791   \n",
       "2509                        0.876904                   57.777762   \n",
       "2510                       11.717319                   59.235811   \n",
       "2511                        1.009464                   58.473825   \n",
       "\n",
       "             Max Character Time (ms)  \n",
       "Test_Number                           \n",
       "1                                NaN  \n",
       "2                                NaN  \n",
       "3                                NaN  \n",
       "4                                NaN  \n",
       "5                                NaN  \n",
       "...                              ...  \n",
       "2507                      218.698978  \n",
       "2508                      334.392071  \n",
       "2509                      246.771574  \n",
       "2510                      330.488205  \n",
       "2511                      535.244703  \n",
       "\n",
       "[2511 rows x 42 columns]"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_results = pd.read_csv('results.csv', index_col='Test_Number')\n",
    "df_results"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Importing character-level stats: "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Character</th>\n",
       "      <th>Time Used to Type Last Character (ms)</th>\n",
       "      <th>Last 2 Characters</th>\n",
       "      <th>Time Used to Type Last 2 Characters (ms)</th>\n",
       "      <th>Count</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>s</td>\n",
       "      <td>41.634321</td>\n",
       "      <td>os</td>\n",
       "      <td>143.747330</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>e</td>\n",
       "      <td>72.476625</td>\n",
       "      <td>se</td>\n",
       "      <td>114.110947</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>s</td>\n",
       "      <td>58.168650</td>\n",
       "      <td>es</td>\n",
       "      <td>130.645275</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td></td>\n",
       "      <td>61.872482</td>\n",
       "      <td>s</td>\n",
       "      <td>120.041132</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>a</td>\n",
       "      <td>57.579994</td>\n",
       "      <td>a</td>\n",
       "      <td>119.452477</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21969</th>\n",
       "      <td></td>\n",
       "      <td>14.374018</td>\n",
       "      <td>h</td>\n",
       "      <td>42.366266</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21970</th>\n",
       "      <td>h</td>\n",
       "      <td>133.623600</td>\n",
       "      <td>h</td>\n",
       "      <td>147.997618</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21971</th>\n",
       "      <td>i</td>\n",
       "      <td>55.682898</td>\n",
       "      <td>hi</td>\n",
       "      <td>189.306498</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21972</th>\n",
       "      <td>m</td>\n",
       "      <td>73.549509</td>\n",
       "      <td>im</td>\n",
       "      <td>129.232407</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21973</th>\n",
       "      <td>.</td>\n",
       "      <td>68.367720</td>\n",
       "      <td>m.</td>\n",
       "      <td>141.917229</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>21974 rows × 5 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "      Character  Time Used to Type Last Character (ms) Last 2 Characters  \\\n",
       "0             s                              41.634321                os   \n",
       "1             e                              72.476625                se   \n",
       "2             s                              58.168650                es   \n",
       "3                                            61.872482                s    \n",
       "4             a                              57.579994                 a   \n",
       "...         ...                                    ...               ...   \n",
       "21969                                        14.374018                h    \n",
       "21970         h                             133.623600                 h   \n",
       "21971         i                              55.682898                hi   \n",
       "21972         m                              73.549509                im   \n",
       "21973         .                              68.367720                m.   \n",
       "\n",
       "       Time Used to Type Last 2 Characters (ms)  Count  \n",
       "0                                    143.747330      1  \n",
       "1                                    114.110947      1  \n",
       "2                                    130.645275      1  \n",
       "3                                    120.041132      1  \n",
       "4                                    119.452477      1  \n",
       "...                                         ...    ...  \n",
       "21969                                 42.366266      1  \n",
       "21970                                147.997618      1  \n",
       "21971                                189.306498      1  \n",
       "21972                                129.232407      1  \n",
       "21973                                141.917229      1  \n",
       "\n",
       "[21974 rows x 5 columns]"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_character_stats = pd.read_csv('character_stats.csv')\n",
    "df_character_stats"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Unix_Start_Time</th>\n",
       "      <th>Local_Start_Time</th>\n",
       "      <th>UTC_Start_Time</th>\n",
       "      <th>Characters</th>\n",
       "      <th>Seconds</th>\n",
       "      <th>CPS</th>\n",
       "      <th>WPM</th>\n",
       "      <th>Book</th>\n",
       "      <th>Chapter</th>\n",
       "      <th>Verse_Order</th>\n",
       "      <th>Verse</th>\n",
       "      <th>Verse #</th>\n",
       "      <th>Last 10 Avg</th>\n",
       "      <th>Last 100 Avg</th>\n",
       "      <th>Last 1000 Avg</th>\n",
       "      <th>cumulative_avg</th>\n",
       "      <th>Local_Start_Year</th>\n",
       "      <th>Local_Start_Month</th>\n",
       "      <th>Local_Start_Hour</th>\n",
       "      <th>Count</th>\n",
       "      <th>Local_Start_Date</th>\n",
       "      <th>Local_Start_Minute</th>\n",
       "      <th>Local_Start_10_Minute_Block</th>\n",
       "      <th>Local_Start_15_Minute_Block</th>\n",
       "      <th>Local_Start_30_Minute_Block</th>\n",
       "      <th>Local_End_Time</th>\n",
       "      <th>Local_End_Year</th>\n",
       "      <th>Local_End_Month</th>\n",
       "      <th>Local_End_Date</th>\n",
       "      <th>Local_End_Hour</th>\n",
       "      <th>Local_End_Minute</th>\n",
       "      <th>Local_End_15_Minute_Block</th>\n",
       "      <th>Local_End_10_Minute_Block</th>\n",
       "      <th>Local_End_30_Minute_Block</th>\n",
       "      <th>Mistake_Free_Test</th>\n",
       "      <th>WPM_Rank</th>\n",
       "      <th>WPM_Percentile</th>\n",
       "      <th>Backspaces as % of Verse Length</th>\n",
       "      <th>Incorrect Characters as % of Verse Length</th>\n",
       "      <th>Min Character Time (ms)</th>\n",
       "      <th>Median Character Time (ms)</th>\n",
       "      <th>Max Character Time (ms)</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Test_Number</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1.698121e+09</td>\n",
       "      <td>2023-10-24 00:17:38.017017</td>\n",
       "      <td>2023-10-24 04:17:38.017017+00:00</td>\n",
       "      <td>56</td>\n",
       "      <td>6.571754</td>\n",
       "      <td>8.521317</td>\n",
       "      <td>102.255799</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>In the beginning, God created the heavens and ...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>102.256</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>17</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24 00:17:44.588771456</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>0</td>\n",
       "      <td>17</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2303</td>\n",
       "      <td>8.323377</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1.698121e+09</td>\n",
       "      <td>2023-10-24 00:18:06.165502</td>\n",
       "      <td>2023-10-24 04:18:06.165502+00:00</td>\n",
       "      <td>135</td>\n",
       "      <td>13.997536</td>\n",
       "      <td>9.644554</td>\n",
       "      <td>115.734653</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>The earth was formless and empty. Darkness was...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>108.995</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>18</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24 00:18:20.163038180</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>0</td>\n",
       "      <td>18</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1958</td>\n",
       "      <td>22.062923</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1.698121e+09</td>\n",
       "      <td>2023-10-24 00:18:24.381290</td>\n",
       "      <td>2023-10-24 04:18:24.381290+00:00</td>\n",
       "      <td>56</td>\n",
       "      <td>4.714291</td>\n",
       "      <td>11.878774</td>\n",
       "      <td>142.545292</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>In the beginning, God created the heavens and ...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>120.179</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>18</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24 00:18:29.095581096</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>0</td>\n",
       "      <td>18</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>780</td>\n",
       "      <td>68.976503</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1.698121e+09</td>\n",
       "      <td>2023-10-24 00:21:24.331389</td>\n",
       "      <td>2023-10-24 04:21:24.331389+00:00</td>\n",
       "      <td>56</td>\n",
       "      <td>4.878704</td>\n",
       "      <td>11.478458</td>\n",
       "      <td>137.741497</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>In the beginning, God created the heavens and ...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>124.569</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>21</td>\n",
       "      <td>3</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24 00:21:29.210093071</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>0</td>\n",
       "      <td>21</td>\n",
       "      <td>2</td>\n",
       "      <td>3</td>\n",
       "      <td>1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1010</td>\n",
       "      <td>59.816806</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>1.698121e+09</td>\n",
       "      <td>2023-10-24 00:22:03.749152</td>\n",
       "      <td>2023-10-24 04:22:03.749152+00:00</td>\n",
       "      <td>135</td>\n",
       "      <td>19.078445</td>\n",
       "      <td>7.076048</td>\n",
       "      <td>84.912580</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>The earth was formless and empty. Darkness was...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>116.638</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>22</td>\n",
       "      <td>3</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-10-24 00:22:22.827597200</td>\n",
       "      <td>2023</td>\n",
       "      <td>10</td>\n",
       "      <td>2023-10-24</td>\n",
       "      <td>0</td>\n",
       "      <td>22</td>\n",
       "      <td>2</td>\n",
       "      <td>3</td>\n",
       "      <td>1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2466</td>\n",
       "      <td>1.831939</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2507</th>\n",
       "      <td>1.700629e+09</td>\n",
       "      <td>2023-11-21 23:49:49.822542</td>\n",
       "      <td>2023-11-22 04:49:49.822542+00:00</td>\n",
       "      <td>123</td>\n",
       "      <td>8.923488</td>\n",
       "      <td>13.783848</td>\n",
       "      <td>165.406179</td>\n",
       "      <td>EXO</td>\n",
       "      <td>29</td>\n",
       "      <td>2354</td>\n",
       "      <td>You shall cut the ram into its pieces, and was...</td>\n",
       "      <td>17.0</td>\n",
       "      <td>141.791645</td>\n",
       "      <td>141.013309</td>\n",
       "      <td>131.264570</td>\n",
       "      <td>131.521</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>23</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>49</td>\n",
       "      <td>5</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "      <td>2023-11-21 23:49:58.746029663</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>23</td>\n",
       "      <td>49</td>\n",
       "      <td>4</td>\n",
       "      <td>5</td>\n",
       "      <td>2</td>\n",
       "      <td>0.0</td>\n",
       "      <td>101</td>\n",
       "      <td>96.017523</td>\n",
       "      <td>0.813008</td>\n",
       "      <td>0.813008</td>\n",
       "      <td>0.469685</td>\n",
       "      <td>58.214903</td>\n",
       "      <td>218.698978</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2508</th>\n",
       "      <td>1.700629e+09</td>\n",
       "      <td>2023-11-21 23:49:59.784727</td>\n",
       "      <td>2023-11-22 04:49:59.784727+00:00</td>\n",
       "      <td>140</td>\n",
       "      <td>13.892433</td>\n",
       "      <td>10.077428</td>\n",
       "      <td>120.929140</td>\n",
       "      <td>EXO</td>\n",
       "      <td>29</td>\n",
       "      <td>2355</td>\n",
       "      <td>You shall burn the whole ram on the altar: it ...</td>\n",
       "      <td>18.0</td>\n",
       "      <td>141.799736</td>\n",
       "      <td>140.749500</td>\n",
       "      <td>131.242792</td>\n",
       "      <td>131.517</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>23</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>49</td>\n",
       "      <td>5</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "      <td>2023-11-21 23:50:13.677160167</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>23</td>\n",
       "      <td>50</td>\n",
       "      <td>4</td>\n",
       "      <td>6</td>\n",
       "      <td>2</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1762</td>\n",
       "      <td>29.868578</td>\n",
       "      <td>10.000000</td>\n",
       "      <td>8.571429</td>\n",
       "      <td>12.137651</td>\n",
       "      <td>70.702791</td>\n",
       "      <td>334.392071</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2509</th>\n",
       "      <td>1.700629e+09</td>\n",
       "      <td>2023-11-21 23:50:14.600039</td>\n",
       "      <td>2023-11-22 04:50:14.600039+00:00</td>\n",
       "      <td>99</td>\n",
       "      <td>7.575344</td>\n",
       "      <td>13.068713</td>\n",
       "      <td>156.824560</td>\n",
       "      <td>EXO</td>\n",
       "      <td>29</td>\n",
       "      <td>2356</td>\n",
       "      <td>\"You shall take the other ram, and Aaron and h...</td>\n",
       "      <td>19.0</td>\n",
       "      <td>143.112084</td>\n",
       "      <td>140.817879</td>\n",
       "      <td>131.274855</td>\n",
       "      <td>131.527</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>23</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>50</td>\n",
       "      <td>6</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "      <td>2023-11-21 23:50:22.175383086</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>23</td>\n",
       "      <td>50</td>\n",
       "      <td>4</td>\n",
       "      <td>6</td>\n",
       "      <td>2</td>\n",
       "      <td>0.0</td>\n",
       "      <td>278</td>\n",
       "      <td>88.968538</td>\n",
       "      <td>1.010101</td>\n",
       "      <td>1.010101</td>\n",
       "      <td>0.876904</td>\n",
       "      <td>57.777762</td>\n",
       "      <td>246.771574</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2510</th>\n",
       "      <td>1.700629e+09</td>\n",
       "      <td>2023-11-21 23:50:22.823804</td>\n",
       "      <td>2023-11-22 04:50:22.823804+00:00</td>\n",
       "      <td>272</td>\n",
       "      <td>21.067447</td>\n",
       "      <td>12.910914</td>\n",
       "      <td>154.930967</td>\n",
       "      <td>EXO</td>\n",
       "      <td>29</td>\n",
       "      <td>2357</td>\n",
       "      <td>Then you shall kill the ram, and take some of ...</td>\n",
       "      <td>20.0</td>\n",
       "      <td>145.616766</td>\n",
       "      <td>140.601527</td>\n",
       "      <td>131.319924</td>\n",
       "      <td>131.537</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>23</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>50</td>\n",
       "      <td>6</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "      <td>2023-11-21 23:50:43.891251424</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>23</td>\n",
       "      <td>50</td>\n",
       "      <td>4</td>\n",
       "      <td>6</td>\n",
       "      <td>2</td>\n",
       "      <td>0.0</td>\n",
       "      <td>336</td>\n",
       "      <td>86.658702</td>\n",
       "      <td>1.838235</td>\n",
       "      <td>1.838235</td>\n",
       "      <td>11.717319</td>\n",
       "      <td>59.235811</td>\n",
       "      <td>330.488205</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2511</th>\n",
       "      <td>1.700629e+09</td>\n",
       "      <td>2023-11-21 23:50:53.642747</td>\n",
       "      <td>2023-11-22 04:50:53.642867+00:00</td>\n",
       "      <td>273</td>\n",
       "      <td>24.269703</td>\n",
       "      <td>11.248593</td>\n",
       "      <td>134.983111</td>\n",
       "      <td>EXO</td>\n",
       "      <td>29</td>\n",
       "      <td>2358</td>\n",
       "      <td>You shall take of the blood that is on the alt...</td>\n",
       "      <td>21.0</td>\n",
       "      <td>144.178197</td>\n",
       "      <td>140.325825</td>\n",
       "      <td>131.296062</td>\n",
       "      <td>131.538</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>23</td>\n",
       "      <td>1</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>50</td>\n",
       "      <td>6</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "      <td>2023-11-21 23:51:17.912449911</td>\n",
       "      <td>2023</td>\n",
       "      <td>11</td>\n",
       "      <td>2023-11-21</td>\n",
       "      <td>23</td>\n",
       "      <td>51</td>\n",
       "      <td>4</td>\n",
       "      <td>6</td>\n",
       "      <td>2</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1143</td>\n",
       "      <td>54.520112</td>\n",
       "      <td>5.128205</td>\n",
       "      <td>5.128205</td>\n",
       "      <td>1.009464</td>\n",
       "      <td>58.473825</td>\n",
       "      <td>535.244703</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>2511 rows × 42 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "             Unix_Start_Time           Local_Start_Time  \\\n",
       "Test_Number                                               \n",
       "1               1.698121e+09 2023-10-24 00:17:38.017017   \n",
       "2               1.698121e+09 2023-10-24 00:18:06.165502   \n",
       "3               1.698121e+09 2023-10-24 00:18:24.381290   \n",
       "4               1.698121e+09 2023-10-24 00:21:24.331389   \n",
       "5               1.698121e+09 2023-10-24 00:22:03.749152   \n",
       "...                      ...                        ...   \n",
       "2507            1.700629e+09 2023-11-21 23:49:49.822542   \n",
       "2508            1.700629e+09 2023-11-21 23:49:59.784727   \n",
       "2509            1.700629e+09 2023-11-21 23:50:14.600039   \n",
       "2510            1.700629e+09 2023-11-21 23:50:22.823804   \n",
       "2511            1.700629e+09 2023-11-21 23:50:53.642747   \n",
       "\n",
       "                              UTC_Start_Time  Characters    Seconds  \\\n",
       "Test_Number                                                           \n",
       "1           2023-10-24 04:17:38.017017+00:00          56   6.571754   \n",
       "2           2023-10-24 04:18:06.165502+00:00         135  13.997536   \n",
       "3           2023-10-24 04:18:24.381290+00:00          56   4.714291   \n",
       "4           2023-10-24 04:21:24.331389+00:00          56   4.878704   \n",
       "5           2023-10-24 04:22:03.749152+00:00         135  19.078445   \n",
       "...                                      ...         ...        ...   \n",
       "2507        2023-11-22 04:49:49.822542+00:00         123   8.923488   \n",
       "2508        2023-11-22 04:49:59.784727+00:00         140  13.892433   \n",
       "2509        2023-11-22 04:50:14.600039+00:00          99   7.575344   \n",
       "2510        2023-11-22 04:50:22.823804+00:00         272  21.067447   \n",
       "2511        2023-11-22 04:50:53.642867+00:00         273  24.269703   \n",
       "\n",
       "                   CPS         WPM Book  Chapter  Verse_Order  \\\n",
       "Test_Number                                                     \n",
       "1             8.521317  102.255799  GEN        1            1   \n",
       "2             9.644554  115.734653  GEN        1            2   \n",
       "3            11.878774  142.545292  GEN        1            1   \n",
       "4            11.478458  137.741497  GEN        1            1   \n",
       "5             7.076048   84.912580  GEN        1            2   \n",
       "...                ...         ...  ...      ...          ...   \n",
       "2507         13.783848  165.406179  EXO       29         2354   \n",
       "2508         10.077428  120.929140  EXO       29         2355   \n",
       "2509         13.068713  156.824560  EXO       29         2356   \n",
       "2510         12.910914  154.930967  EXO       29         2357   \n",
       "2511         11.248593  134.983111  EXO       29         2358   \n",
       "\n",
       "                                                         Verse  Verse #  \\\n",
       "Test_Number                                                               \n",
       "1            In the beginning, God created the heavens and ...      NaN   \n",
       "2            The earth was formless and empty. Darkness was...      NaN   \n",
       "3            In the beginning, God created the heavens and ...      NaN   \n",
       "4            In the beginning, God created the heavens and ...      NaN   \n",
       "5            The earth was formless and empty. Darkness was...      NaN   \n",
       "...                                                        ...      ...   \n",
       "2507         You shall cut the ram into its pieces, and was...     17.0   \n",
       "2508         You shall burn the whole ram on the altar: it ...     18.0   \n",
       "2509         \"You shall take the other ram, and Aaron and h...     19.0   \n",
       "2510         Then you shall kill the ram, and take some of ...     20.0   \n",
       "2511         You shall take of the blood that is on the alt...     21.0   \n",
       "\n",
       "             Last 10 Avg  Last 100 Avg  Last 1000 Avg  cumulative_avg  \\\n",
       "Test_Number                                                             \n",
       "1                    NaN           NaN            NaN         102.256   \n",
       "2                    NaN           NaN            NaN         108.995   \n",
       "3                    NaN           NaN            NaN         120.179   \n",
       "4                    NaN           NaN            NaN         124.569   \n",
       "5                    NaN           NaN            NaN         116.638   \n",
       "...                  ...           ...            ...             ...   \n",
       "2507          141.791645    141.013309     131.264570         131.521   \n",
       "2508          141.799736    140.749500     131.242792         131.517   \n",
       "2509          143.112084    140.817879     131.274855         131.527   \n",
       "2510          145.616766    140.601527     131.319924         131.537   \n",
       "2511          144.178197    140.325825     131.296062         131.538   \n",
       "\n",
       "             Local_Start_Year  Local_Start_Month  Local_Start_Hour  Count  \\\n",
       "Test_Number                                                                 \n",
       "1                        2023                 10                 0      1   \n",
       "2                        2023                 10                 0      1   \n",
       "3                        2023                 10                 0      1   \n",
       "4                        2023                 10                 0      1   \n",
       "5                        2023                 10                 0      1   \n",
       "...                       ...                ...               ...    ...   \n",
       "2507                     2023                 11                23      1   \n",
       "2508                     2023                 11                23      1   \n",
       "2509                     2023                 11                23      1   \n",
       "2510                     2023                 11                23      1   \n",
       "2511                     2023                 11                23      1   \n",
       "\n",
       "            Local_Start_Date  Local_Start_Minute  Local_Start_10_Minute_Block  \\\n",
       "Test_Number                                                                     \n",
       "1                 2023-10-24                  17                            2   \n",
       "2                 2023-10-24                  18                            2   \n",
       "3                 2023-10-24                  18                            2   \n",
       "4                 2023-10-24                  21                            3   \n",
       "5                 2023-10-24                  22                            3   \n",
       "...                      ...                 ...                          ...   \n",
       "2507              2023-11-21                  49                            5   \n",
       "2508              2023-11-21                  49                            5   \n",
       "2509              2023-11-21                  50                            6   \n",
       "2510              2023-11-21                  50                            6   \n",
       "2511              2023-11-21                  50                            6   \n",
       "\n",
       "             Local_Start_15_Minute_Block  Local_Start_30_Minute_Block  \\\n",
       "Test_Number                                                             \n",
       "1                                      2                            1   \n",
       "2                                      2                            1   \n",
       "3                                      2                            1   \n",
       "4                                      2                            1   \n",
       "5                                      2                            1   \n",
       "...                                  ...                          ...   \n",
       "2507                                   4                            2   \n",
       "2508                                   4                            2   \n",
       "2509                                   4                            2   \n",
       "2510                                   4                            2   \n",
       "2511                                   4                            2   \n",
       "\n",
       "                            Local_End_Time  Local_End_Year  Local_End_Month  \\\n",
       "Test_Number                                                                   \n",
       "1            2023-10-24 00:17:44.588771456            2023               10   \n",
       "2            2023-10-24 00:18:20.163038180            2023               10   \n",
       "3            2023-10-24 00:18:29.095581096            2023               10   \n",
       "4            2023-10-24 00:21:29.210093071            2023               10   \n",
       "5            2023-10-24 00:22:22.827597200            2023               10   \n",
       "...                                    ...             ...              ...   \n",
       "2507         2023-11-21 23:49:58.746029663            2023               11   \n",
       "2508         2023-11-21 23:50:13.677160167            2023               11   \n",
       "2509         2023-11-21 23:50:22.175383086            2023               11   \n",
       "2510         2023-11-21 23:50:43.891251424            2023               11   \n",
       "2511         2023-11-21 23:51:17.912449911            2023               11   \n",
       "\n",
       "            Local_End_Date  Local_End_Hour  Local_End_Minute  \\\n",
       "Test_Number                                                    \n",
       "1               2023-10-24               0                17   \n",
       "2               2023-10-24               0                18   \n",
       "3               2023-10-24               0                18   \n",
       "4               2023-10-24               0                21   \n",
       "5               2023-10-24               0                22   \n",
       "...                    ...             ...               ...   \n",
       "2507            2023-11-21              23                49   \n",
       "2508            2023-11-21              23                50   \n",
       "2509            2023-11-21              23                50   \n",
       "2510            2023-11-21              23                50   \n",
       "2511            2023-11-21              23                51   \n",
       "\n",
       "             Local_End_15_Minute_Block  Local_End_10_Minute_Block  \\\n",
       "Test_Number                                                         \n",
       "1                                    2                          2   \n",
       "2                                    2                          2   \n",
       "3                                    2                          2   \n",
       "4                                    2                          3   \n",
       "5                                    2                          3   \n",
       "...                                ...                        ...   \n",
       "2507                                 4                          5   \n",
       "2508                                 4                          6   \n",
       "2509                                 4                          6   \n",
       "2510                                 4                          6   \n",
       "2511                                 4                          6   \n",
       "\n",
       "             Local_End_30_Minute_Block  Mistake_Free_Test  WPM_Rank  \\\n",
       "Test_Number                                                           \n",
       "1                                    1                NaN      2303   \n",
       "2                                    1                NaN      1958   \n",
       "3                                    1                NaN       780   \n",
       "4                                    1                NaN      1010   \n",
       "5                                    1                NaN      2466   \n",
       "...                                ...                ...       ...   \n",
       "2507                                 2                0.0       101   \n",
       "2508                                 2                0.0      1762   \n",
       "2509                                 2                0.0       278   \n",
       "2510                                 2                0.0       336   \n",
       "2511                                 2                0.0      1143   \n",
       "\n",
       "             WPM_Percentile  Backspaces as % of Verse Length  \\\n",
       "Test_Number                                                    \n",
       "1                  8.323377                              NaN   \n",
       "2                 22.062923                              NaN   \n",
       "3                 68.976503                              NaN   \n",
       "4                 59.816806                              NaN   \n",
       "5                  1.831939                              NaN   \n",
       "...                     ...                              ...   \n",
       "2507              96.017523                         0.813008   \n",
       "2508              29.868578                        10.000000   \n",
       "2509              88.968538                         1.010101   \n",
       "2510              86.658702                         1.838235   \n",
       "2511              54.520112                         5.128205   \n",
       "\n",
       "             Incorrect Characters as % of Verse Length  \\\n",
       "Test_Number                                              \n",
       "1                                                  NaN   \n",
       "2                                                  NaN   \n",
       "3                                                  NaN   \n",
       "4                                                  NaN   \n",
       "5                                                  NaN   \n",
       "...                                                ...   \n",
       "2507                                          0.813008   \n",
       "2508                                          8.571429   \n",
       "2509                                          1.010101   \n",
       "2510                                          1.838235   \n",
       "2511                                          5.128205   \n",
       "\n",
       "             Min Character Time (ms)  Median Character Time (ms)  \\\n",
       "Test_Number                                                        \n",
       "1                                NaN                         NaN   \n",
       "2                                NaN                         NaN   \n",
       "3                                NaN                         NaN   \n",
       "4                                NaN                         NaN   \n",
       "5                                NaN                         NaN   \n",
       "...                              ...                         ...   \n",
       "2507                        0.469685                   58.214903   \n",
       "2508                       12.137651                   70.702791   \n",
       "2509                        0.876904                   57.777762   \n",
       "2510                       11.717319                   59.235811   \n",
       "2511                        1.009464                   58.473825   \n",
       "\n",
       "             Max Character Time (ms)  \n",
       "Test_Number                           \n",
       "1                                NaN  \n",
       "2                                NaN  \n",
       "3                                NaN  \n",
       "4                                NaN  \n",
       "5                                NaN  \n",
       "...                              ...  \n",
       "2507                      218.698978  \n",
       "2508                      334.392071  \n",
       "2509                      246.771574  \n",
       "2510                      330.488205  \n",
       "2511                      535.244703  \n",
       "\n",
       "[2511 rows x 42 columns]"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "for column in ['Local_Start_Time', 'UTC_Start_Time']:\n",
    "    df_results[column] = pd.to_datetime(df_results[column])\n",
    "df_results['WPM'] = df_results['WPM'].astype('float') # Prevents a glitch\n",
    "# that can be caused when this column is stored as an object. The WPM\n",
    "# column should only be in object format when the results table is blank.\n",
    "df_results"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "# # If you accidentally overwrite your Unix_Start_Time values with something else,\n",
    "# # you can recreate them using UTC_Start_Time values as follows:\n",
    "# # (This code is based on that shown in\n",
    "# # https://pandas.pydata.org/pandas-docs/stable/user_guide/timeseries.html#from-timestamps-to-epoch )\n",
    "# df_results['Unix_Start_Time'] = ((df_results['UTC_Start_Time'] - pd.Timestamp(\n",
    "# \"1970-01-01\", tz = 'utc')) // pd.Timedelta(\"1ns\") / 1000000000)\n",
    "# df_results"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "# If you ever need to drop a particular result,\n",
    "# you can do so as follows:\n",
    "# df_results.drop(17, inplace = True)\n",
    "# df_results.to_csv('results.csv') # We want to preserve the index so as not\n",
    "# to lose our 'Test_Number' values\n",
    "# df_results"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(0.3893868923187256, 389387)"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Creating an RNG seed:\n",
    "# In order to make the RNG values a bit more random, the following code will\n",
    "# derive the RNG seed from the decimal component of the current timestamp.\n",
    "# This seed will change 1 million times each second.\n",
    "\n",
    "# Using the decimal component of time.time() to select an RNG seed:\n",
    "current_time = time.time()\n",
    "decimal_component = current_time - int(current_time) # This \n",
    "# line retrieves the decimal component of current_time. int() is used instead\n",
    "# of np.round() so that the code won't ever round current_time up prior\n",
    "# to the subtraction operation, which would return a different value.\n",
    "# I don't think that converting current_time to an integer (e.g. via\n",
    "# np.int64(current_time)) is necessary, as int() appears to handle at least \n",
    "# some integers larger than 32 bits in size just fine.\n",
    "decimal_component\n",
    "random_seed = round(decimal_component * 1000000)\n",
    "decimal_component, random_seed"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "rng = np.random.default_rng(random_seed) # Based on\n",
    "# https://numpy.org/doc/stable/reference/random/index.html?highlight=random#module-numpy.random"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Book_Order</th>\n",
       "      <th>Book_Name</th>\n",
       "      <th>Chapter_Name</th>\n",
       "      <th>Book_and_Chapter</th>\n",
       "      <th>Chapter_Order</th>\n",
       "      <th>Verse_#</th>\n",
       "      <th>Verse_Order</th>\n",
       "      <th>Verse</th>\n",
       "      <th>Characters</th>\n",
       "      <th>Typed</th>\n",
       "      <th>Tests</th>\n",
       "      <th>Fastest_WPM</th>\n",
       "      <th>Characters_Typed</th>\n",
       "      <th>Total_Characters_Typed</th>\n",
       "      <th>Count</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>In the beginning, God created the heavens and ...</td>\n",
       "      <td>56</td>\n",
       "      <td>1</td>\n",
       "      <td>8</td>\n",
       "      <td>193.251509</td>\n",
       "      <td>56</td>\n",
       "      <td>448</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>The earth was formless and empty. Darkness was...</td>\n",
       "      <td>135</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>140.461827</td>\n",
       "      <td>135</td>\n",
       "      <td>270</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "      <td>God said, \"Let there be light,\" and there was ...</td>\n",
       "      <td>52</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>84.008493</td>\n",
       "      <td>52</td>\n",
       "      <td>52</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>God saw the light, and saw that it was good. G...</td>\n",
       "      <td>85</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>123.198378</td>\n",
       "      <td>85</td>\n",
       "      <td>85</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>5</td>\n",
       "      <td>5</td>\n",
       "      <td>God called the light \"day\", and the darkness h...</td>\n",
       "      <td>119</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>135.664272</td>\n",
       "      <td>119</td>\n",
       "      <td>119</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35374</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>17</td>\n",
       "      <td>35375</td>\n",
       "      <td>The Spirit and the bride say, \"Come!\" He who h...</td>\n",
       "      <td>160</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35375</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>18</td>\n",
       "      <td>35376</td>\n",
       "      <td>I testify to everyone who hears the words of t...</td>\n",
       "      <td>159</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35376</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>19</td>\n",
       "      <td>35377</td>\n",
       "      <td>If anyone takes away from the words of the boo...</td>\n",
       "      <td>174</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35377</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>20</td>\n",
       "      <td>35378</td>\n",
       "      <td>He who testifies these things says, \"Yes, I am...</td>\n",
       "      <td>89</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35378</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>21</td>\n",
       "      <td>35379</td>\n",
       "      <td>The grace of the Lord Jesus Christ be with all...</td>\n",
       "      <td>64</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>161.093106</td>\n",
       "      <td>64</td>\n",
       "      <td>64</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>35379 rows × 15 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "       Book_Order Book_Name  Chapter_Name Book_and_Chapter  Chapter_Order  \\\n",
       "0               1       GEN             1            GEN 1              1   \n",
       "1               1       GEN             1            GEN 1              1   \n",
       "2               1       GEN             1            GEN 1              1   \n",
       "3               1       GEN             1            GEN 1              1   \n",
       "4               1       GEN             1            GEN 1              1   \n",
       "...           ...       ...           ...              ...            ...   \n",
       "35374          95       REV            22           REV 22           1328   \n",
       "35375          95       REV            22           REV 22           1328   \n",
       "35376          95       REV            22           REV 22           1328   \n",
       "35377          95       REV            22           REV 22           1328   \n",
       "35378          95       REV            22           REV 22           1328   \n",
       "\n",
       "       Verse_#  Verse_Order  \\\n",
       "0            1            1   \n",
       "1            2            2   \n",
       "2            3            3   \n",
       "3            4            4   \n",
       "4            5            5   \n",
       "...        ...          ...   \n",
       "35374       17        35375   \n",
       "35375       18        35376   \n",
       "35376       19        35377   \n",
       "35377       20        35378   \n",
       "35378       21        35379   \n",
       "\n",
       "                                                   Verse  Characters  Typed  \\\n",
       "0      In the beginning, God created the heavens and ...          56      1   \n",
       "1      The earth was formless and empty. Darkness was...         135      1   \n",
       "2      God said, \"Let there be light,\" and there was ...          52      1   \n",
       "3      God saw the light, and saw that it was good. G...          85      1   \n",
       "4      God called the light \"day\", and the darkness h...         119      1   \n",
       "...                                                  ...         ...    ...   \n",
       "35374  The Spirit and the bride say, \"Come!\" He who h...         160      0   \n",
       "35375  I testify to everyone who hears the words of t...         159      0   \n",
       "35376  If anyone takes away from the words of the boo...         174      0   \n",
       "35377  He who testifies these things says, \"Yes, I am...          89      0   \n",
       "35378  The grace of the Lord Jesus Christ be with all...          64      1   \n",
       "\n",
       "       Tests  Fastest_WPM  Characters_Typed  Total_Characters_Typed  Count  \n",
       "0          8   193.251509                56                     448      1  \n",
       "1          2   140.461827               135                     270      1  \n",
       "2          1    84.008493                52                      52      1  \n",
       "3          1   123.198378                85                      85      1  \n",
       "4          1   135.664272               119                     119      1  \n",
       "...      ...          ...               ...                     ...    ...  \n",
       "35374      0          NaN                 0                       0      1  \n",
       "35375      0          NaN                 0                       0      1  \n",
       "35376      0          NaN                 0                       0      1  \n",
       "35377      0          NaN                 0                       0      1  \n",
       "35378      1   161.093106                64                      64      1  \n",
       "\n",
       "[35379 rows x 15 columns]"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_Bible"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "[This fantastic answer](https://stackoverflow.com/a/23294659/13097194) by Kevin at Stack Overflow proved helpful in implementing user validation code within this program. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "def select_verse():\n",
    "    print(\"Select a verse to type! Enter 0 to receive a random verse\\n\\\n",
    "or enter a verse number (see 'Verse_Order column of\\n\\\n",
    "the WEB_Catholic_Version.csv spreadsheet for a list of numbers to enter)\\n\\\n",
    "to select a specific verse.\\n\\\n",
    "You can also enter -2 to receive a random verse that you haven't yet typed\\n\\\n",
    "or -3 to choose the first Bible verse that hasn't yet been typed.\")\n",
    "    while True:\n",
    "        try:\n",
    "            response = int(input())\n",
    "        except:\n",
    "            print(\"Please enter an integer corresponding to a particular Bible \\\n",
    "verse or 0 for a randomly selected verse.\")\n",
    "            continue # Allows the user to retry entering a number\n",
    "\n",
    "        if response == 0:\n",
    "            return rng.integers(1, 35380) # Selects any verse within the Bible.\n",
    "            # there are 35,379 verses present, so we'll pass 1 (the first verse)\n",
    "            # and 35,380 (1 more than the last verse, as rng.integers won't \n",
    "            # include the final number within the range) to rng.integers().\n",
    "        # The next two elif statements will require us to determine which \n",
    "        # verses haven't yet been typed. We can do so by filtering df_Bible\n",
    "        # to include only untyped verses.\n",
    "        elif response == -2:\n",
    "            verses_not_yet_typed = list(\n",
    "                df_Bible.query(\"Typed == 0\")['Verse_Order'].copy())\n",
    "            if len(verses_not_yet_typed) == 0:\n",
    "                print(\"Congratulations! You have typed all verses from \\\n",
    "the Bible, so there are no new verses to type! Try selecting another option \\\n",
    "instead.\")\n",
    "                continue\n",
    "            print(f\"{len(verses_not_yet_typed)} verses have not yet \\\n",
    "been typed.\")\n",
    "            return rng.choice(verses_not_yet_typed) # Chooses one of these\n",
    "            # untyped verses at random\n",
    "        elif response == -3:\n",
    "            verses_not_yet_typed = list(\n",
    "                df_Bible.query(\"Typed == 0\")['Verse_Order'].copy())\n",
    "            if len(verses_not_yet_typed) == 0:\n",
    "                print(\"Congratulations! You have typed all verses from \\\n",
    "the Bible, so there are no new verses to type! Try selecting another option \\\n",
    "instead.\")\n",
    "                continue\n",
    "            print(f\"{len(verses_not_yet_typed)} verses have not yet \\\n",
    "been typed.\")\n",
    "            verses_not_yet_typed.sort() # Probably not necessary, as df_Bible\n",
    "            # is already sorted from the first to the last verse.\n",
    "            return verses_not_yet_typed[0]\n",
    "        \n",
    "        else:\n",
    "            if ((response >= 1) \n",
    "            & (response <= 35379)): # Making sure that the response is \n",
    "                # an integer between 1 and 35,379 (inclusive) so that it \n",
    "                # matches one of the Bible verse numbers present:                    \n",
    "                return response\n",
    "            else: # Will be called if a non-integer number was passed\n",
    "                    # or if the integer didn't correspond to a Bible verse\n",
    "                    # number. \n",
    "                print(\"Please enter an integer between 1 and 35,379.\") # Since\n",
    "                # we're still within a While loop, the user will be returned\n",
    "                # to the initial try/except block.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "65"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "column_width = 120\n",
    "column_width - (55 % column_width)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[0,\n",
       " 4,\n",
       " 9,\n",
       " 13,\n",
       " 17,\n",
       " 23,\n",
       " 31,\n",
       " 35,\n",
       " 43,\n",
       " 49,\n",
       " 52,\n",
       " 57,\n",
       " 61,\n",
       " 66,\n",
       " 70,\n",
       " 74,\n",
       " 81,\n",
       " 87,\n",
       " 90,\n",
       " 95,\n",
       " 99,\n",
       " 106,\n",
       " 109,\n",
       " 114,\n",
       " 119,\n",
       " 123]"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "verse = \"God made the two great lights: the greater light to rule the day, and the lesser light to rule the night. He also made the stars.\"\n",
    "\n",
    "# Creating a list of words within the verse that we can use for\n",
    "# word-based typing test analyses:\n",
    "# We could use verse.split(' ') to create a list of words. However,\n",
    "# since our goal is to build a list that can then serve as the basis\n",
    "# of analyses, we'll want to create a list that includes:\n",
    "# 1. The starting and finishing index of each word within the verse. This will\n",
    "# allow us to determine when the player has arrived at and completed\n",
    "# that word.\n",
    "# 2. Words without any spacing or punctuation attached. (Learning how fast\n",
    "# you wrote 'they' is more interesting than is learning how fast \n",
    "# you wrote '\"that' or 'that,'.)\n",
    "# Therefore, the following code is more complex than a simple split()\n",
    "# operation.\n",
    "\n",
    "first_character_index_list = []\n",
    "# Determining the indices of the verse that contain starting letters of\n",
    "# words: \n",
    "# (We can find these indices by searching for characters that are preceded\n",
    "# by a non-alphabetic character *or* an alphabetic character that is also\n",
    "# the first character in the verse.\n",
    "for i in range(1, len(verse)):\n",
    "    if ((verse[i].isalpha()) & (verse[i-1].isalpha() == False)):\n",
    "        first_character_index_list.append(i)\n",
    "    if (verse[i].isalpha() & ((verse[i-1].isalpha() == True) & (i == 1))):\n",
    "        first_character_index_list.append(i-1) # In this case, the\n",
    "        # character preceding i is the starting character rather than i itself.\n",
    "\n",
    "first_character_index_list"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0 2 God\n",
      "4 7 made\n",
      "9 11 the\n",
      "13 15 two\n",
      "17 21 great\n",
      "23 28 lights\n",
      "31 33 the\n",
      "35 41 greater\n",
      "43 47 light\n",
      "49 50 to\n",
      "52 55 rule\n",
      "57 59 the\n",
      "61 63 day\n",
      "66 68 and\n",
      "70 72 the\n",
      "74 79 lesser\n",
      "81 85 light\n",
      "87 88 to\n",
      "90 93 rule\n",
      "95 97 the\n",
      "99 103 night\n",
      "106 107 He\n",
      "109 112 also\n",
      "114 117 made\n",
      "119 121 the\n",
      "123 127 stars\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>first_character_index</th>\n",
       "      <th>last_character_index</th>\n",
       "      <th>word</th>\n",
       "      <th>previous_character_index</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>God</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>4</td>\n",
       "      <td>7</td>\n",
       "      <td>made</td>\n",
       "      <td>3.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>9</td>\n",
       "      <td>11</td>\n",
       "      <td>the</td>\n",
       "      <td>8.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>13</td>\n",
       "      <td>15</td>\n",
       "      <td>two</td>\n",
       "      <td>12.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>17</td>\n",
       "      <td>21</td>\n",
       "      <td>great</td>\n",
       "      <td>16.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>23</td>\n",
       "      <td>28</td>\n",
       "      <td>lights</td>\n",
       "      <td>22.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>31</td>\n",
       "      <td>33</td>\n",
       "      <td>the</td>\n",
       "      <td>30.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>35</td>\n",
       "      <td>41</td>\n",
       "      <td>greater</td>\n",
       "      <td>34.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>43</td>\n",
       "      <td>47</td>\n",
       "      <td>light</td>\n",
       "      <td>42.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>49</td>\n",
       "      <td>50</td>\n",
       "      <td>to</td>\n",
       "      <td>48.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>52</td>\n",
       "      <td>55</td>\n",
       "      <td>rule</td>\n",
       "      <td>51.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>57</td>\n",
       "      <td>59</td>\n",
       "      <td>the</td>\n",
       "      <td>56.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>61</td>\n",
       "      <td>63</td>\n",
       "      <td>day</td>\n",
       "      <td>60.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>66</td>\n",
       "      <td>68</td>\n",
       "      <td>and</td>\n",
       "      <td>65.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>70</td>\n",
       "      <td>72</td>\n",
       "      <td>the</td>\n",
       "      <td>69.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>74</td>\n",
       "      <td>79</td>\n",
       "      <td>lesser</td>\n",
       "      <td>73.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>81</td>\n",
       "      <td>85</td>\n",
       "      <td>light</td>\n",
       "      <td>80.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>87</td>\n",
       "      <td>88</td>\n",
       "      <td>to</td>\n",
       "      <td>86.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>90</td>\n",
       "      <td>93</td>\n",
       "      <td>rule</td>\n",
       "      <td>89.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>95</td>\n",
       "      <td>97</td>\n",
       "      <td>the</td>\n",
       "      <td>94.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>99</td>\n",
       "      <td>103</td>\n",
       "      <td>night</td>\n",
       "      <td>98.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>106</td>\n",
       "      <td>107</td>\n",
       "      <td>He</td>\n",
       "      <td>105.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>109</td>\n",
       "      <td>112</td>\n",
       "      <td>also</td>\n",
       "      <td>108.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>114</td>\n",
       "      <td>117</td>\n",
       "      <td>made</td>\n",
       "      <td>113.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>119</td>\n",
       "      <td>121</td>\n",
       "      <td>the</td>\n",
       "      <td>118.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>123</td>\n",
       "      <td>127</td>\n",
       "      <td>stars</td>\n",
       "      <td>122.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    first_character_index  last_character_index     word  \\\n",
       "0                       0                     2      God   \n",
       "1                       4                     7     made   \n",
       "2                       9                    11      the   \n",
       "3                      13                    15      two   \n",
       "4                      17                    21    great   \n",
       "5                      23                    28   lights   \n",
       "6                      31                    33      the   \n",
       "7                      35                    41  greater   \n",
       "8                      43                    47    light   \n",
       "9                      49                    50       to   \n",
       "10                     52                    55     rule   \n",
       "11                     57                    59      the   \n",
       "12                     61                    63      day   \n",
       "13                     66                    68      and   \n",
       "14                     70                    72      the   \n",
       "15                     74                    79   lesser   \n",
       "16                     81                    85    light   \n",
       "17                     87                    88       to   \n",
       "18                     90                    93     rule   \n",
       "19                     95                    97      the   \n",
       "20                     99                   103    night   \n",
       "21                    106                   107       He   \n",
       "22                    109                   112     also   \n",
       "23                    114                   117     made   \n",
       "24                    119                   121      the   \n",
       "25                    123                   127    stars   \n",
       "\n",
       "    previous_character_index  \n",
       "0                        NaN  \n",
       "1                        3.0  \n",
       "2                        8.0  \n",
       "3                       12.0  \n",
       "4                       16.0  \n",
       "5                       22.0  \n",
       "6                       30.0  \n",
       "7                       34.0  \n",
       "8                       42.0  \n",
       "9                       48.0  \n",
       "10                      51.0  \n",
       "11                      56.0  \n",
       "12                      60.0  \n",
       "13                      65.0  \n",
       "14                      69.0  \n",
       "15                      73.0  \n",
       "16                      80.0  \n",
       "17                      86.0  \n",
       "18                      89.0  \n",
       "19                      94.0  \n",
       "20                      98.0  \n",
       "21                     105.0  \n",
       "22                     108.0  \n",
       "23                     113.0  \n",
       "24                     118.0  \n",
       "25                     122.0  "
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_word_index_list = []\n",
    "\n",
    "for index in first_character_index_list:\n",
    "    first_character = verse[index]\n",
    "    # Initializing the word started by this character with \n",
    "    # the starting character:\n",
    "    word = first_character\n",
    "    i = 1\n",
    "    while True:\n",
    "        next_character = verse[index + i]\n",
    "        if next_character.isalpha() == True: # \n",
    "            word += next_character\n",
    "            i += 1\n",
    "        else:\n",
    "            last_character_index = index + i -1\n",
    "            break\n",
    "    df_word_index_list.append({'first_character_index':index, \n",
    "        'last_character_index': last_character_index,\n",
    "        'word':word})\n",
    "    print(index, last_character_index, word)\n",
    "\n",
    "df_word_index_list = pd.DataFrame(df_word_index_list)\n",
    "df_word_index_list['previous_character_index'] = np.where(df_word_index_list['first_character_index'] != 0,  df_word_index_list['first_character_index'] - 1, np.NaN)\n",
    "df_word_index_list"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "def run_typing_test(verse_number, results_table, character_stats_table, test_type = 'v2'):\n",
    "    '''This function calculates how quickly the user types the characters\n",
    "    passed to the Bible verse represented by verse_number, then saves those \n",
    "    results to the DataFrame passed to results_table.'''\n",
    "\n",
    "    # Retrieving the verse to be typed:\n",
    "    # The index begins at 0 whereas the list of verse numbers begins at 1,\n",
    "    # so we'll need to subtract 1 from verse_number in order to obtain\n",
    "    # the verse's index.\n",
    "    verse = df_Bible.iloc[verse_number-1]['Verse']\n",
    "    book = df_Bible.iloc[verse_number-1]['Book_Name']\n",
    "    chapter = df_Bible.iloc[verse_number-1]['Chapter_Name']\n",
    "    verse_number_within_chapter = df_Bible.iloc[verse_number-1]['Verse_#']\n",
    "    verse_number_within_Bible = df_Bible.iloc[\n",
    "        verse_number-1]['Verse_Order']\n",
    "    \n",
    "    # I moved these introductory comments out of the following while loop\n",
    "    # in order to simplify the dialogue presented to users during retest\n",
    "    # attempts.\n",
    "    print(f\"Welcome to the typing test! Your verse to type is {book} \\\n",
    "{chapter}:{verse_number_within_chapter} (verse {verse_number_within_Bible} \\\n",
    "within the Bible .csv file).\\n\")\n",
    "    if run_on_notebook == False:\n",
    "        print(\"Press any key to begin typing!\")\n",
    "    else:\n",
    "        print(\"Press Enter to begin the test!\")\n",
    "    \n",
    "    complete_flag = 0\n",
    "    while complete_flag == 0:\n",
    "        print(f\"Here is the verse:\\n\\n{verse}\") \n",
    "\n",
    "        if run_on_notebook == False: # In this case, we can use getch()\n",
    "            # to begin the test.\n",
    "        # time.sleep(3) # I realized that players could actually begin typing\n",
    "        # during this sleep period, thus allowing them to complete the test\n",
    "        # faster than intended. Therefore, I'm now having the test start\n",
    "        # after the player hits a character of his/her choice. getch()\n",
    "        # accomplishes this task well.\n",
    "        # A simpler approach would be to add in an additional input block\n",
    "        # and have the player begin after he/she presses Enter, but that would\n",
    "        # cause the player's right hand to leave the default home row position,\n",
    "        # which could end up slowing him/her down. getch() allows any character\n",
    "        # to be pressed (such as the space bar) and thus avoids this issue.\n",
    "\n",
    "            start_character = getch() # See https://github.com/joeyespo/py-getch\n",
    "        \n",
    "        else: # When running the program within a Jupyter notebook, I wasn't\n",
    "            # able to enter input after getch() was called, so I created\n",
    "            # an alternative start method below that simply uses input().\n",
    "            input()\n",
    "\n",
    "        # The following line determines the width of the terminal just before\n",
    "        # the beginning of the typing test. This width will help determine\n",
    "        # when a line has been completed, which will in turn inform\n",
    "        # when to move the cursor up and how many lines to fill with\n",
    "        # blank spaces.\n",
    "\n",
    "        if run_on_notebook == False: # The following line crashed for me\n",
    "            # when running the program within a notebook.\n",
    "            column_width = os.get_terminal_size().columns\n",
    "        # get_terminal_size() is cross-platform. See\n",
    "        # https://docs.python.org/3.8/library/os.html?highlight=get_terminal_size#os.get_terminal_size\n",
    "        else:\n",
    "            column_width = 120 # The default column width for my\n",
    "            # terminal\n",
    "\n",
    "        # print(f\"Column width is {column_width}\")\n",
    "        print(\"Start!\")      \n",
    "        if test_type == 'v1': \n",
    "            # This is a simple typing test setup that receives input from\n",
    "            # the user when 'Enter' is pressed, then checks that input\n",
    "            # against the verse. Because it doesn't check the response\n",
    "            # for accuracy as the player types, the player might not realize\n",
    "            # a character was mistyped until the very end, which can get\n",
    "            # frustrating. Therefore, I've now added in a new version\n",
    "            # of the test (called 'v2') that can be used instead. \n",
    "            no_mistakes = np.NaN\n",
    "            backspaces_as_pct_of_length = np.NaN\n",
    "            incorrect_characters_as_pct_of_length = np.NaN\n",
    "            min_character_time = np.NaN\n",
    "            median_character_time = np.NaN\n",
    "            max_character_time = np.NaN\n",
    "            local_start_time = pd.Timestamp.now()\n",
    "            utc_start_time = pd.Timestamp.now(timezone.utc)\n",
    "            character_stats_for_latest_test = pd.DataFrame(\n",
    "                {'Character': {},\n",
    "                'Time Used to Type Last Character (ms)': {},\n",
    "                'Last 2 Characters': {},\n",
    "                'Time Used to Type Last 2 Characters (ms)': {}}\n",
    "                )\n",
    "\n",
    "            # I used to use ISO8601-compatible timestamps via the following\n",
    "            # lines, but decided to switch to a value that Pandas would \n",
    "            # immediately recognize as a datetime.\n",
    "            # local_start_time = datetime.now().isoformat()\n",
    "            # utc_start_time = datetime.now(timezone.utc).isoformat()\n",
    "\n",
    "            typing_start_time = time.time()\n",
    "            verse_response = input() \n",
    "            # The following code will execute once the player finishes typing and\n",
    "            # hits Enter. (Having the program evaluate the player's entry only after\n",
    "            # 'Enter' is pressed isn't the best option, as the time required to\n",
    "            # hit Enter will reduce the player's reported WPM. Version v2, \n",
    "            # shown below, stops the test right when the final correct\n",
    "            # character is typed, which will make the final WPM slightly faster.\n",
    "            typing_end_time = time.time()\n",
    "            typing_time = typing_end_time - typing_start_time\n",
    "\n",
    "        elif test_type == 'v2':\n",
    "            # This version of the test checks the player's input after\n",
    "            # each character is typed. If the player's input is correct\n",
    "            # so far, the text will be highlighted green; otherwise,\n",
    "            # it will be highlighted red. (This allows the player to be \n",
    "            # notified of an error without the need for a line break\n",
    "            # in the console, which could prove distracting.)\n",
    "            # This function has been tested on Windows, but not yet \n",
    "            # on Mac or Linux. The use of the Colorama library should\n",
    "            # make it cross-platform, however.\n",
    "            verse_response = '' # This string will store the player's \n",
    "            # response.\n",
    "            no_mistakes = 1 # This flag will get set to 0 if the player makes\n",
    "            # a mistake. If it remains at 1 throughout the race, then\n",
    "            # a mistake-free race will get logged in results_table.\n",
    "            previous_line_count = 1\n",
    "            backspace_count = 0\n",
    "            incorrect_character_count = 0\n",
    "            correct_consecutive_entries = 0 # Keeps track of the number\n",
    "            # of correct characters typed in a row. Both incorrect characters\n",
    "            # and backspace keypresses will reset this value to 0.\n",
    "            character_timestamp_list = []\n",
    "            character_time_list = []\n",
    "            character_stats_list = []\n",
    "            local_start_time = pd.Timestamp.now()\n",
    "            utc_start_time = pd.Timestamp.now(timezone.utc)\n",
    "            typing_start_time = time.time()\n",
    "            while True: # This while loop allows the player to enter\n",
    "                # multiple characters.\n",
    "                character = getch() # getch() allows each character to be \n",
    "                # checked, making it easier to identify mistyped words.\n",
    "                character_press_time = time.time()\n",
    "\n",
    "                if character == b'\\x08': \n",
    "                    # This will return True if the user hits backspace.\n",
    "                    # In this case, we'll want to remove the latest character\n",
    "                    # from verse_response in order to keep that value\n",
    "                    # in sync with what the player sees on the screen.\n",
    "                    # Calling print(character) after\n",
    "                    # hitting backspace revealed that b'\\x08' was the code\n",
    "                    # associated with the backspace key. \n",
    "                    backspace_count += 1\n",
    "                    verse_response = verse_response[:-1] # Trims the last\n",
    "                    # value off verse_response.\n",
    "                    correct_consecutive_entries = 0 # Resets this value\n",
    "                    # so that a correct entry followed by a backspace and\n",
    "                    # another correct entry won't be counted as two\n",
    "                    # correct entries in a row.\n",
    "                elif character == b'`':\n",
    "                    print(Style.RESET_ALL) # Resets the color of the text.\n",
    "                    verse_response += character.decode('ascii') # The presence\n",
    "                    # of this character within verse_response will instruct\n",
    "                    # the program to exit the user out of this test later on.\n",
    "                    # See https://pypi.org/project/colorama/\n",
    "                    break\n",
    "                else: \n",
    "                    # The following line adds the latest character typed\n",
    "                    # to verse_response.\n",
    "                    try:\n",
    "                        verse_response += character.decode('ascii')  \n",
    "                        # See https://stackoverflow.com/questions/17615414/how-to-convert-binary-string-to-normal-string-in-python3\n",
    "                    except: # Keys that fall out of the ascii subset, such as \n",
    "                        # arrow keys, would cause the above line to crash. Therefore,\n",
    "                        # when the above line fails to work, the following 'continue'\n",
    "                        # statement will allow the program to ignore the key and move\n",
    "                        # back to the beginning of the loop.\n",
    "                        continue\n",
    "\n",
    "                # Determining which color to use for the text:\n",
    "                if verse[0:len(verse_response)] == verse_response:\n",
    "                    text_color = Fore.GREEN\n",
    "                    # Adding the time it took to type the last character\n",
    "                    # to the list: (Note that the time it takes to \n",
    "                    # enter a backspace won't be included.)\n",
    "                    if character != b'\\x08':\n",
    "                        character_timestamp_list.append(character_press_time)\n",
    "                        correct_consecutive_entries += 1\n",
    "\n",
    "                        if correct_consecutive_entries >= 2:\n",
    "                            # Limiting the additions to character_time_list\n",
    "                            # to cases in which 2+ characters have been\n",
    "                            # typed correctly in a row will prevent the data \n",
    "                            # from getting skewed by incorrect results. \n",
    "                            character_time_list.append(\n",
    "                                character_timestamp_list[-1] - \n",
    "                                character_timestamp_list[-2])\n",
    "                        if correct_consecutive_entries >= 3:\n",
    "                            # We're using 3 as a threshold instead of 2 so\n",
    "                            # that our statistics on the time needed\n",
    "                            # to type the last 2 characters won't get skewed\n",
    "                            # by cases in which the 3rd-to-last character\n",
    "                            # was typed incorrectly.\n",
    "                            character_stats_list.append(\n",
    "                            {'Character': character.decode('ascii'),\n",
    "                            'Time Used to Type Last Character (ms)': 1000 * (\n",
    "                                character_timestamp_list[-1] - \n",
    "                                character_timestamp_list[-2]),\n",
    "                                'Last 2 Characters':verse_response[-2:],\n",
    "                                'Time Used to Type Last 2 Characters (ms)':\n",
    "                                1000 * (character_timestamp_list[-1] - \n",
    "                                character_timestamp_list[-3])}\n",
    "                            )\n",
    "\n",
    "                else:\n",
    "                    no_mistakes = 0 # This flag will remain at 0 for the \n",
    "                    # rest of the race.\n",
    "                    correct_consecutive_entries = 0\n",
    "                    text_color = Fore.RED \n",
    "                    if character != b'\\x08': # Backspaces won't be counted\n",
    "                        # towards the incorrect character count so that\n",
    "                        # players won't be double-penalized for mistyping\n",
    "                        # a character.\n",
    "                        incorrect_character_count += 1\n",
    "                \n",
    "                # Printing the player's response so far: \n",
    "                \n",
    "                # This process will involve printing the entirety of verse_response\n",
    "                # after each character is pressed than just the most recent character. \n",
    "                # This code is more complex than a regular print statement, but it has\n",
    "                # several advantages:\n",
    "                # 1. It allows the player to quickly determine when a typo has \n",
    "                # occurred (as the text will show up in red rather than in green).\n",
    "                # 2. It supports the use of backspace to correct responses on \n",
    "                # previous lines. (I wasn't able to navigate to a previous line \n",
    "                # using backspace when printing single characters at a time.)\n",
    "                # 3. It allows the cursor to always appear to the right of the most\n",
    "                # recent character. If the latest typed line takes up the entire\n",
    "                # width of the console, the cursor will appear on the left of \n",
    "                # the following line.\n",
    "                # The development of this code involved a decent amount of trial and \n",
    "                # error, but I'll try to explain the function of each line in order to\n",
    "                # make the final result more intuitive.\n",
    "\n",
    "\n",
    "                line_count = ((len(verse_response)) // column_width) + 1\n",
    "                # Calculates the number of lines on which the player's\n",
    "                # response appears. The inclusion of the max() function ensures\n",
    "                # that line_count will always be at least 1.\n",
    "                # 1 is added to verse_response because, if the response has extended\n",
    "                # to the right side of the terminal, another line will get added\n",
    "                # in (via code below) to make room for the cursor. Thus, line_count\n",
    "                # needs to be incremented by 1 in that case to reflect the terminal's\n",
    "                # output.\n",
    "\n",
    "                # The following code adjusts to changes in the response's line count.\n",
    "                # If the line count goes up (as indicated by line_count's exceeding\n",
    "                # previous_line_count), the response printout will be preceded\n",
    "                # by a newline so that more space is available to print the longer\n",
    "                # text. If the line count goes down (e.g. due to a backspace),\n",
    "                # the the printout will be preceded by an up cursor statement\n",
    "                # since less space will be needed to print the line.\n",
    "                if line_count > previous_line_count:\n",
    "                    line_change_shift_command = '\\n'\n",
    "                elif line_count < previous_line_count: \n",
    "                    line_change_shift_command = \"\\033[A\"\n",
    "                    # \"\\033[A\" is an ANSI escape code that moves the cursor \n",
    "                    # up by one line. See\n",
    "                    # at https://pypi.org/project/colorama/\n",
    "                else: # No command is necessary if the number of lines is the same \n",
    "                    # as before\n",
    "                    line_change_shift_command = ''\n",
    "\n",
    "                previous_line_count = line_count \n",
    "\n",
    "                # If more than one line is present, we'll need to move the cursor\n",
    "                # up by the number of lines -1. Otherwise, an extra line will get\n",
    "                # printed with each character.\n",
    "                if line_count > 1:\n",
    "                    up_command = f\"\\033[{line_count -1}A\"\n",
    "                # This ANSI escape code, based on Richard's response at\n",
    "                # https://stackoverflow.com/a/33206814/13097194 ,\n",
    "                # will move the cursor up line_count -1 times.\n",
    "                else:\n",
    "                    up_command = '' # If the response is still on the first line,\n",
    "                #     # there's no need to move the cursor up, as its vertical\n",
    "                #     # position won't shift in the process of writing the response.\n",
    "\n",
    "                clear_text_to_right_command = '\\033[0K' # Based on\n",
    "                # https://en.wikipedia.org/wiki/ANSI_escape_code\n",
    "                # and on https://pypi.org/project/colorama/\n",
    "\n",
    "                if column_width - (len(verse_response) % column_width) == 1:\n",
    "                    left_cursor_shift = ''\n",
    "                else:\n",
    "                    left_cursor_shift = '\\033[D'\n",
    "\n",
    "                # Printing out various variables related to\n",
    "                # the subsequent print statement can be useful for debugging.\n",
    "                # print(\"\\033A\",line_count, len(verse_response), column_width, column_width - (len(verse_response) % column_width) == 1)\n",
    "                print(f\"\\r{clear_text_to_right_command}{line_change_shift_command}{up_command}{text_color}{verse_response} {left_cursor_shift}\", end = '')\n",
    "                # For the use of Colorama to produce red and green text, see\n",
    "                # https://pypi.org/project/colorama/\n",
    "                # and https://stackoverflow.com/a/3332860/13097194\n",
    "                \n",
    "                if verse_response == verse: # Note that, unlike with version\n",
    "                    # v1, the player does not need to hit 'Enter' in order\n",
    "                    # to end the typing test after writing a completed\n",
    "                    # verse. This should speed up his/her WPM as a result.\n",
    "                    typing_end_time = time.time()\n",
    "                    typing_time = typing_end_time - typing_start_time\n",
    "                    print('\\n'*line_count+'Success!') # The cursor\n",
    "                    # needs to be moved past the lines already printed\n",
    "                    # so that 'Success' won't overwrite any of the words.\n",
    "                    print(Style.RESET_ALL)\n",
    "\n",
    "\n",
    "                    # Accuracy calculations:\n",
    "                    # Calculating backspaces as a percentage of verse length:\n",
    "                    backspaces_as_pct_of_length = (\n",
    "                        100 * backspace_count / len(verse)) # The 100* \n",
    "                        # multiplier converts these values from \n",
    "                        # proportions to percentages.\n",
    "\n",
    "                    # Calculating incorrect entries as a percentage of verse\n",
    "                    # length:\n",
    "                    incorrect_characters_as_pct_of_length = (\n",
    "                        100 * incorrect_character_count / len(verse))\n",
    "                \n",
    "\n",
    "                    # Calculating timing statistics at the character level:\n",
    "                    # Note that each value will be converted from\n",
    "                    # seconds to milliseconds.\n",
    "                    min_character_time = 1000*min(character_time_list)\n",
    "                    median_character_time = 1000*np.median(character_time_list)\n",
    "                    max_character_time= 1000*max(character_time_list)\n",
    "\n",
    "                    character_stats_for_latest_test = pd.DataFrame(\n",
    "                        character_stats_list)\n",
    "                    break\n",
    "\n",
    "        if verse_response == verse:\n",
    "            print(f\"Well done! You typed the verse correctly.\")\n",
    "            complete_flag = 1 # Setting this flag to 1 allows the player to exit\n",
    "            # out of the while statement.\n",
    "        elif (verse_response.lower() == 'exit') or ('`' in verse_response):\n",
    "            print(\"Exiting typing test.\")\n",
    "            return results_table, character_stats_table # Exits the function without saving the \n",
    "            # current test to results_table or df_Bible. This function has\n",
    "            # been updated to work with both versions of the typing\n",
    "            # test.\n",
    "        else:\n",
    "            print(\"Sorry, that wasn't the correct input.\")   \n",
    "            # Identifying incorrectly typed words:\n",
    "            verse_words = verse.split(' ')\n",
    "            verse_response_words = verse_response.split(' ')[0:len(verse_words)]\n",
    "            # I added in the [0:len(verse_words)] filter so that the following\n",
    "            # for loop would not attempt to access more words that were \n",
    "            # present in the original verse (which would cause the game\n",
    "            # to crash with an IndexError).\n",
    "            for i in range(len(verse_response_words)):\n",
    "                if verse_response_words[i] != verse_words[i]:\n",
    "                    print(f\"Word number {i} ('{verse_words[i]}') \\\n",
    "was typed '{verse_response_words[i]}'.\")\n",
    "                    # If the response has more or fewer words than the original\n",
    "                    # verse, some correctly typed words might appear within\n",
    "                    # this list also.\n",
    "            print(\"Try again!\") # complete_flag will still be 0 in this case,\n",
    "            # so the while loop will continue back to the beginning.\n",
    "\n",
    "    # Calculating typing statistics and storing them within a single-row\n",
    "    # DataFrame:\n",
    "\n",
    "    cps = len(verse) / typing_time # Calculating characters per second\n",
    "    wpm = cps * 12 # Multiplying by 60 to convert from characters to minutes, \n",
    "    # then dividing by 5 to convert from characters to words.\n",
    "    wpm\n",
    "\n",
    "    # print(min_character_time, median_character_time, max_character_time)\n",
    "\n",
    "    character_stats_table = pd.concat(\n",
    "        [character_stats_table, character_stats_for_latest_test]).reset_index(\n",
    "            drop=True)\n",
    "\n",
    "    # Creating a single-row DataFrame that stores the player's results:\n",
    "    df_latest_result = pd.DataFrame(index = [\n",
    "        len(results_table)+1], data = {'Unix_Start_Time':typing_start_time, \n",
    "    'Local_Start_Time':local_start_time,\n",
    "    'UTC_Start_Time':utc_start_time,\n",
    "    'Characters':len(verse),\n",
    "    'Seconds':typing_time, \n",
    "    'CPS': cps,\n",
    "    'WPM':wpm,\n",
    "    'Mistake_Free_Test':no_mistakes,\n",
    "    'Backspaces as % of Verse Length': backspaces_as_pct_of_length,\n",
    "    'Incorrect Characters as % of Verse Length': \\\n",
    "incorrect_characters_as_pct_of_length,\n",
    "    'Min Character Time (ms)': min_character_time,\n",
    "    'Median Character Time (ms)': median_character_time,\n",
    "    'Max Character Time (ms)': max_character_time,\n",
    "    'Book': book,\n",
    "    'Chapter': chapter,\n",
    "    'Verse #': verse_number_within_chapter,\n",
    "    'Verse':verse, \n",
    "    'Verse_Order':verse_number_within_Bible})\n",
    "    df_latest_result.index.name = 'Test_Number'\n",
    "    df_latest_result\n",
    "\n",
    "    # Adding this new row to results_table:\n",
    "    results_table = pd.concat([results_table, df_latest_result])\n",
    "    # Note: I could also have used df.at or df.iloc to add a new row\n",
    "    # to df_latest_result, but I chose a pd.concat() setup in order to ensure\n",
    "    # that the latest result would never overwrite an earlier result.\n",
    "    \n",
    "\n",
    "    # Rank and percentile data needs to be recalculated after each test,\n",
    "    # as later results can affect the rank and percentile of earlier results.\n",
    "    # I could compute these statistics later, but calculating them here\n",
    "    # allows the player to view his/her statistics after each test.\n",
    "\n",
    "    results_table['WPM_Rank'] = results_table['WPM'].rank(\n",
    "    ascending = False, method = 'min').astype('int')\n",
    "    results_table['WPM_Percentile'] = results_table['WPM'].rank(pct=True)*100\n",
    "    latest_rank = results_table.iloc[-1]['WPM_Rank']\n",
    "    # Note: These percentile results may differ from the results\n",
    "    # calculated by np.quartile later in this function, likely a result of\n",
    "    # different calculation methodologies. These differences should narrow\n",
    "    # as more tests are completed.\n",
    "\n",
    "    latest_percentile = results_table.iloc[-1]['WPM_Percentile'].round(3)\n",
    "    number_of_tests = len(results_table)\n",
    "    last_10_avg = results_table['WPM'].rolling(10).mean().iloc[-1]\n",
    "    \n",
    "    # The player's rolling 10-race average will be NaN until he/she has\n",
    "    # completed 10 tests. Therefore, the following if statement will \n",
    "    # return a blank last 10 races report unless at least 10 tests\n",
    "    # are present in results_table.\n",
    "    if len(results_table) >= 10:\n",
    "        last_10_report = f' You have averaged \\\n",
    "{last_10_avg.round(3)} WPM over your last 10 tests.' # The space\n",
    "    # space before 'You' separates this text from the rest of\n",
    "    # the print statement below.\n",
    "    else:\n",
    "        last_10_report = ''\n",
    "\n",
    "    print(f\"Your CPS and WPM were {round(cps, 3)} and {round(wpm, 3)}, \\\n",
    "respectively. Your WPM percentile was {latest_percentile} \\\n",
    "({latest_rank} out of {number_of_tests} tests).{last_10_report}\")  \n",
    "\n",
    "    # Updating df_Bible to store the player's results: (This will allow the\n",
    "    # player to track how much of the Bible he/she has typed so far)\n",
    "    df_Bible.at[verse_number-1, 'Typed'] = 1 # Denotes that this verse\n",
    "    # has now ben typed\n",
    "    df_Bible.at[verse_number-1, 'Tests'] += 1 # Keeps track of how \n",
    "    # many times this verse has been typed\n",
    "    fastest_wpm = df_Bible.at[verse_number-1, 'Fastest_WPM']\n",
    "    if ((pd.isna(fastest_wpm) == True) | (wpm > fastest_wpm)): \n",
    "        # In these cases, we should replace the pre-existing Fastest_WPM value\n",
    "        # with the WPM the player just achieved.\n",
    "        # I found that 5 > np.NaN returned False, so if I only checked for\n",
    "        # wpm > fastest_wpm, blank fastest_wpm values would never get overwritten.\n",
    "        # Therefore, I chose to also check for NaN values \n",
    "        # in the above if statement.\n",
    "        df_Bible.at[verse_number-1, 'Fastest_WPM'] = wpm\n",
    "\n",
    "    # Autosaving results as separate files: (That way, if the script crashes,\n",
    "    # the player won't lose all of his/her progress.)\n",
    "    try:\n",
    "        results_table.to_csv('df_results_autosave.csv', index = True)\n",
    "        df_Bible.to_csv('WEB_Catholic_Version_for_game_updated_autosave.csv', \n",
    "        index = False)\n",
    "        character_stats_table.to_csv('character_stats_autosave.csv', \n",
    "        index = False)\n",
    "    except:\n",
    "        print(\"At least one of the autosave files could not be saved. Close \\\n",
    "out of any open autosave files before starting the next test \\\n",
    "so that they can be updated.\")\n",
    "    return (results_table, character_stats_table)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# run_typing_test(1, results_table=df_results)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "def select_subsequent_verse(previous_verse_number):\n",
    "    '''This function allows the player to specify which verse to\n",
    "    type next, or, alternatively, to exit the game.'''\n",
    "    print(\"Press 0 to retry the verse you just typed; \\\n",
    "1 to type the next verse; 2 to type the next verse that hasn't yet been typed; \\\n",
    "3 to select a different verse; \\\n",
    "-1 to save your results and exit; \\\n",
    "and -2 to save your results without running the analysis \\\n",
    "portion of the script.\") # The analysis portion can take a decent amount of\n",
    "# time to run, which is why an option to save without running these analyses\n",
    "# was added in. These analyses can then get updated during a later session.\n",
    "    while True: \n",
    "            try:\n",
    "                response = int(input())\n",
    "            except: # The user didn't enter a number.\n",
    "                print(\"Please enter a number.\")      \n",
    "                continue\n",
    "            if response == 0:\n",
    "                return previous_verse_number\n",
    "            elif response == 1:\n",
    "                if previous_verse_number == 35379: # The verse order value\n",
    "                    # corresponding to the final verse of Revelation\n",
    "                    print(\"You just typed the last verse in the Bible, so \\\n",
    "there's no next verse to type! Please enter an option other than 1.\\n\")\n",
    "                    continue\n",
    "                else:\n",
    "                    return previous_verse_number + 1\n",
    "            elif response == 2:\n",
    "                # In this case, we'll retrieve a list of verses that haven't\n",
    "                # yet been typed; filter that list to include only verses\n",
    "                # greater than previous_verse_number; and then select\n",
    "                # the first verse within that list (i.e. the next \n",
    "                # untyped verse).\n",
    "                verses_not_yet_typed = list(df_Bible.query(\n",
    "                    \"Typed == 0\")['Verse_Order'].copy())\n",
    "                if len(verses_not_yet_typed) == 0:\n",
    "                    print(\"Congratulations! You have typed all verses from \\\n",
    "the Bible, so there are no new verses to type! Try selecting another option \\\n",
    "instead.\")\n",
    "                    continue\n",
    "                print(f\"{len(verses_not_yet_typed)} verses have not yet \\\n",
    "been typed.\")\n",
    "                verses_not_yet_typed.sort() \n",
    "                next_untyped_verses = [verse for verse in verses_not_yet_typed \n",
    "                if verse > previous_verse_number]\n",
    "                return next_untyped_verses[0]\n",
    "            elif response == 3:\n",
    "                return select_verse()\n",
    "            elif response in [-1, -2]:\n",
    "                return response\n",
    "            else: # A number other than -2, -1, 0, 1, 2, or 3 was passed.\n",
    "                print(\"Please enter either -2, -1, 0, 1, 2, or 3.\\n\")  "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "def calculate_current_day_results(df):\n",
    "    ''' This function reports the number of characters, total verses, and \n",
    "    unique verses that the player has typed so far today.'''\n",
    "    df_current_day_results = df[pd.to_datetime(\n",
    "        df['Local_Start_Time']).dt.date == datetime.today().date()].copy()\n",
    "    if len(df_current_day_results) == 0:\n",
    "        result_string = \"You haven't typed any Bible verses yet today.\"\n",
    "    else:\n",
    "        characters_typed_today = df_current_day_results['Characters'].sum()\n",
    "        total_verses_typed_today = len(df_current_day_results)\n",
    "\n",
    "        # Allowing for both singular and plural versions of 'verse' to \n",
    "        # be displayed:\n",
    "        if total_verses_typed_today == 1:\n",
    "            total_verses_string = 'verse'\n",
    "        else:\n",
    "            total_verses_string = 'verses'\n",
    "\n",
    "        unique_verses_typed_today = len(df_current_day_results[\n",
    "            'Verse_Order'].unique())\n",
    "\n",
    "        if unique_verses_typed_today == 1:\n",
    "            unique_verses_string = 'verse'\n",
    "        else:\n",
    "            unique_verses_string = 'verses'\n",
    "\n",
    "        average_wpm_today = round(df_current_day_results['WPM'].mean(), 3)\n",
    "        median_wpm_today = round(df_current_day_results['WPM'].median(), 3)\n",
    "        result_string = f\"So far today, you have typed \\\n",
    "{characters_typed_today} characters from {total_verses_typed_today} Bible \\\n",
    "{total_verses_string} (including {unique_verses_typed_today} unique \\\n",
    "{unique_verses_string}). Your mean and median WPM today are \\\n",
    "{average_wpm_today} and {median_wpm_today}, respectively.\"\n",
    "    return result_string"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "def run_game(results_table, character_stats_table):\n",
    "    '''This function runs Type Through the Bible by \n",
    "    calling various other functions. It allows users to select\n",
    "    verses to type, then runs typing tests and stores the results in\n",
    "    the DataFrame passed to results_table.'''\n",
    "    \n",
    "    print(\"Welcome to Type Through the Bible!\")\n",
    "    # The game will now share the player's progress for the current day:\n",
    "    print(calculate_current_day_results(results_table))\n",
    "\n",
    "    if run_on_notebook == True: # I haven't been able to get version\n",
    "        # v2 of the typing test to work within a Jupyter notebook, \n",
    "        # so the following line forces notebook-based runs to use version v1.\n",
    "        typing_test_version = 'v1'\n",
    "    else: # In this case, the user gets to choose whether to to use \n",
    "        # v1 or v2.\n",
    "        print(\"To switch to a simpler typing test method that doesn't \\\n",
    "check your input as you type, enter v1. Otherwise, to stick with the \\\n",
    "recommended version, press Enter.\")\n",
    "        response = input()\n",
    "        if (response == 'v1') or (run_on_notebook == True): # Version 2 likely\n",
    "            # won't work within Jupyter notebooks, \n",
    "            # so the version will always be kept as v1 for notebook users.\n",
    "            typing_test_version = 'v1'\n",
    "        else:\n",
    "            typing_test_version = 'v2'\n",
    "\n",
    "    # The method for exiting a test in progress differs by typing test\n",
    "    # version, so the game will now explain how the player can exit out of \n",
    "    # his/her version of the test.\n",
    "    if typing_test_version == 'v1':\n",
    "        print(\"Version 1 selected. Note that you can exit a test in \\\n",
    "progress by typing 'exit' and then hitting Enter.\")\n",
    "    if typing_test_version == 'v2':\n",
    "        print(\"Version 2 selected. Note that you can exit a test in progress \\\n",
    "by hitting the ` (backtick) key.\")\n",
    "              \n",
    "              \n",
    "\n",
    "    verse_number = select_verse()\n",
    "    \n",
    "\n",
    "    while True: # Allows the game to continue until the user exits\n",
    "        results_table, character_stats_table = run_typing_test(\n",
    "            verse_number=verse_number, \n",
    "        results_table=results_table, \n",
    "        character_stats_table=character_stats_table,\n",
    "        test_type = typing_test_version)\n",
    "        # The game will next share an updated progress report:\n",
    "        print(calculate_current_day_results(results_table))\n",
    "        \n",
    "        # The player will now be prompted to select a new verse number \n",
    "        # (or to save and quit). This verse_number, provided it is not -1,\n",
    "        # will then be passed back to run_typing_test().\n",
    "        verse_number = select_subsequent_verse(\n",
    "            previous_verse_number=verse_number)\n",
    "        if verse_number == -1: # In this case, the game will quit and the \n",
    "            # user's new test results will be saved to results_table.\n",
    "            run_analyses = 1\n",
    "            return (results_table, character_stats_table, run_analyses)\n",
    "        if verse_number == -2: # In this case, the game will quit and the \n",
    "            # user's new test results will be saved to results_table.\n",
    "            # However, the analysis portion of the script will be skipped \n",
    "            # in order to save time.\n",
    "            run_analyses = 0\n",
    "            return (results_table, character_stats_table, run_analyses)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_results, df_character_stats, run_analyses = run_game(results_table = df_results, character_stats_table=df_character_stats)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_results"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "If df_results is blank (e.g. because the player exited out of his/her first typing test during his/her first game), some of the following code will likely crash, because they are expecting results to be present within df_results. Therefore, the program will exit out early instead of continuing on."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "if len(df_results) == 0:\n",
    "    print(\"No results have been entered, so there is nothing to save or \\\n",
    "analyze. Exiting program in 5 seconds.\")\n",
    "    time.sleep(5) # Allows the user to view the above message\n",
    "    raise SystemExit # See https://stackoverflow.com/a/19747562/13097194"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Updating certain df_Bible columns to reflect new results:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_Bible['Characters_Typed'] = df_Bible['Characters'] * df_Bible['Typed']\n",
    "df_Bible['Total_Characters_Typed'] = df_Bible['Characters'] * df_Bible['Tests']\n",
    "df_Bible"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "characters_typed_sum = df_Bible['Characters_Typed'].sum()\n",
    "proportion_of_Bible_typed = characters_typed_sum / df_Bible['Characters'].sum()\n",
    "\n",
    "print(f\"You have typed {characters_typed_sum} characters so far, \\\n",
    "which represents {round(100*proportion_of_Bible_typed, 4)}% of the Bible.\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Adding in additional values and statistics to df_results:\n",
    "\n",
    "(The following cell was derived from [this script](https://github.com/kburchfiel/typeracer_data_analyzer/blob/master/typeracer_data_analyzer_v2.ipynb) that I wrote.)\n",
    "\n",
    "These statistics will get recreated whenever the script is run; this approach allows for the results to be revised as needed (e.g. if certain rows are removed from the dataset)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_results['Last 10 Avg'] = df_results['WPM'].rolling(10).mean()\n",
    "df_results['Last 100 Avg'] = df_results['WPM'].rolling(100).mean()\n",
    "df_results['Last 1000 Avg'] = df_results['WPM'].rolling(1000).mean()\n",
    "\n",
    "\n",
    "df_results['Local_Start_Year'] = df_results['Local_Start_Time'].dt.year\n",
    "df_results['Local_Start_Month'] = df_results['Local_Start_Time'].dt.month\n",
    "df_results['Local_Start_Date'] = df_results['Local_Start_Time'].dt.date\n",
    "df_results['Local_Start_Hour'] = df_results['Local_Start_Time'].dt.hour\n",
    "df_results['Local_Start_Minute'] = df_results['Local_Start_Time'].dt.minute\n",
    "df_results['Local_Start_10_Minute_Block'] = df_results[\n",
    "'Local_Start_Minute'] // 10 + 1\n",
    "df_results['Local_Start_15_Minute_Block'] = df_results[\n",
    "'Local_Start_Minute'] // 15 + 1\n",
    "df_results['Local_Start_30_Minute_Block'] = df_results[\n",
    "'Local_Start_Minute'] // 30 + 1\n",
    "\n",
    "df_results['Count'] = 1 # Useful for pivot tables that analyze test counts\n",
    "# by book, month, etc.\n",
    "\n",
    "# In order to more accurately calculate the largest number of characters \n",
    "# typed within a given block of time, we'll want to know the end time\n",
    "# of each test. This can be calculated as the sum of the local start time\n",
    "# and the number of seconds each test took.\n",
    "df_results['Local_End_Time'] = df_results[\n",
    "'Local_Start_Time'] + pd.to_timedelta(df_results['Seconds'], unit = 's')\n",
    "\n",
    "df_results['Local_End_Year'] = df_results['Local_End_Time'].dt.year\n",
    "df_results['Local_End_Month'] = df_results['Local_End_Time'].dt.month\n",
    "df_results['Local_End_Date'] = df_results['Local_End_Time'].dt.date\n",
    "df_results['Local_End_Hour'] = df_results['Local_End_Time'].dt.hour\n",
    "df_results['Local_End_Minute'] = df_results['Local_End_Time'].dt.minute\n",
    "df_results['Local_End_15_Minute_Block'] = df_results[\n",
    "'Local_End_Minute'] // 15 + 1\n",
    "df_results['Local_End_10_Minute_Block'] = df_results[\n",
    "'Local_End_Minute'] // 10 + 1\n",
    "df_results['Local_End_30_Minute_Block'] = df_results[\n",
    "'Local_End_Minute'] // 30 + 1\n",
    "\n",
    "# The following line uses a list comprehension to generate a cumulative average\n",
    "# of all WPM scores up until the current race. .iloc searches from 0 to i+1 for\n",
    "# each row so that that row is included in the calculation.\n",
    "df_results['cumulative_avg'] = [round(np.mean(df_results.iloc[0:i+1]['WPM']),\n",
    "3) for i in range(len(df_results))]\n",
    "df_results"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_character_stats['Count'] = 1 # Will be useful when analyzing character\n",
    "# statistics"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "print(\"Saving results:\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "def attempt_save(df, filename, index):\n",
    "    '''This function attempts to save the DataFrame passed to df to the file\n",
    "    specified by filename. It allows players to retry the save operation\n",
    "    if it wasn't initially successful (e.g. because the file was open at \n",
    "    the time), thus preventing them from losing their latest progress.\n",
    "    The index parameter determines whether or not the DataFrame's index\n",
    "    will be included in the .csv export. Set to True for results.csv\n",
    "    but False for Web_Catholic_Version_for_game_updated.csv.'''\n",
    "    while True:\n",
    "        try: \n",
    "            df.to_csv(filename, index = index)\n",
    "            return\n",
    "        except:\n",
    "            print(\"File could not be saved, likely because it is currently open. \\\n",
    "Try closing the file and trying again. Press Enter to retry.\")\n",
    "            input()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "attempt_save(df_results, 'results.csv', index = True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "attempt_save(df_Bible, 'WEB_Catholic_Version_for_game_updated.csv', index = False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "attempt_save(df_character_stats, 'character_stats.csv', index = False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "print(\"Successfully saved updated copies of the Results, Character Stats, \\\n",
    "and Bible .csv files.\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "if run_analyses == 0: # In this case, the analysis portion of the script will\n",
    "    # be skipped. These analyses can be updated when the game is next played.\n",
    "    print(\"Analyses won't be updated during this session. \\\n",
    "Exiting program in 3 seconds.\")\n",
    "    time.sleep(3) # Allows the user to view the above message\n",
    "    raise SystemExit # See https://stackoverflow.com/a/19747562/13097194"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Visualizing the player's progress in typing the entire Bible:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "analysis_start_time = time.time() # Allows us to determine how long the\n",
    "# analyses took\n",
    "print(\"Updating analyses:\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_Bible['Count'] = 1"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Creating a tree map within Plotly that visualizes the player's progress in typing the entire Bible:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# This code is based on https://plotly.com/python/treemaps/\n",
    "# It's pretty amazing that such a complex visualization can be created using\n",
    "# just one line of code. Thanks Plotly!\n",
    "fig_tree_map_books_chapters_verses = px.treemap(\n",
    "    df_Bible, path = ['Book_Name', 'Chapter_Name', 'Verse_#'], \n",
    "    values = 'Characters', color = 'Typed')\n",
    "# fig_verses_typed"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_tree_map_books_chapters_verses.write_html(\n",
    "    'Analyses/tree_map_books_chapters_verses.html')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# # A similar chart that doesn't use the Typed column for color coding:\n",
    "# (This chart, unlike fig_verses_typed above, won't change unless edits are \n",
    "# made to the code itself, so it can be \n",
    "# commented out after being run once.)\n",
    "# fig_Bible_verses.write_html('Bible_tree_map.html')\n",
    "# fig_Bible_verses = px.treemap(df_Bible, path = ['Book_Name', \n",
    "# 'Chapter_Name', 'Verse_#'], values = 'Characters')\n",
    "# fig_Bible_verses"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_Bible"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# This variant of the treemap shows chapters and verses rather than books,\n",
    "# chapters, and verses.\n",
    "if (run_on_notebook == True) & (extra_analyses == True):\n",
    "    fig_tree_map_chapters_verses = px.treemap(df_Bible, path = [\n",
    "        'Book_and_Chapter', 'Verse_#'], values = 'Characters', color = 'Typed')\n",
    "    fig_tree_map_chapters_verses.write_html(\n",
    "        'Analyses/tree_map_chapters_verses.html')\n",
    "    fig_tree_map_chapters_verses.write_image(\n",
    "        'Analyses/tree_map_chapters_verses.png', width = 7680, height = 4320)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# This variant of the treemap shows each verse as its own box, which results in \n",
    "# a very busy graph that takes a while to load within a web browser\n",
    "# (if it even loads at all).\n",
    "\n",
    "if (run_on_notebook == True) & (extra_analyses == True):\n",
    "    fig_tree_map_verses = px.treemap(df_Bible, path = ['Verse_Order'], \n",
    "                                     values = 'Characters', color = 'Typed')\n",
    "    fig_tree_map_verses.write_html('Analyses/tree_map_verses.html')\n",
    "    fig_tree_map_verses.write_image('Analyses/tree_map_verses_8K.png', \n",
    "                                    width = 7680, height = 4320) \n",
    "    fig_tree_map_verses.write_image('Analyses/tree_map_verses_16K.png', \n",
    "                                    width = 15360, height = 8640) \n",
    "# fig_tree_map_verses.write_image('Analyses/tree_map_verses.png', width = 30720, \n",
    "# height = 17280) # Didn't end up rendering successfully, probably \n",
    "# because the dimensions were absurdly large!"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Creating a bar chart that shows the proportion of each book that has been typed so far:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_characters_typed_by_book = df_Bible.pivot_table(index = ['Book_Order', \n",
    "'Book_Name'], values = ['Characters', 'Characters_Typed'], \n",
    "aggfunc = 'sum').reset_index()\n",
    "# Adding 'Book_Order' as the first index value allows for the pivot tables\n",
    "# and bars to be ordered by that value.\n",
    "df_characters_typed_by_book['proportion_typed'] = df_characters_typed_by_book[\n",
    "    'Characters_Typed'] / df_characters_typed_by_book['Characters']\n",
    "df_characters_typed_by_book.to_csv(\n",
    "    'Analyses/characters_typed_by_book.csv')\n",
    "df_characters_typed_by_book"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_proportion_of_each_book_typed = px.bar(df_characters_typed_by_book, \n",
    "x = 'Book_Name', y = 'proportion_typed')\n",
    "fig_proportion_of_each_book_typed.update_yaxes(range = [0, 1]) # Setting\n",
    "# the maximum y value as 1 better demonstrates how much of the Bible\n",
    "# has been typed so far\n",
    "fig_proportion_of_each_book_typed.write_html(\n",
    "    'Analyses/proportion_of_each_book_typed.html')\n",
    "fig_proportion_of_each_book_typed.write_image(\n",
    "    'Analyses/proportion_of_each_book_typed.png', \n",
    "    width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_proportion_of_each_book_typed"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Creating a chart that compares the number of characters in each book with the number that have been typed:\n",
    "\n",
    "This provides a clearer view of the player's progress in typing the Bible, as each bar's height is based on the number of characters. (In contrast, bars for fully typed small books will be just as high in fig_proportion_of_each_book_typed as those for fully typed large books.)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_characters_typed_in_each_book = px.bar(df_characters_typed_by_book, \n",
    "x = 'Book_Name', y = ['Characters', 'Characters_Typed'], barmode = 'overlay')\n",
    "fig_characters_typed_in_each_book.write_html(\n",
    "    'Analyses/characters_typed_by_book.html')\n",
    "fig_characters_typed_in_each_book.write_image(\n",
    "    'Analyses/characters_typed_by_book.png', \n",
    "    width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_characters_typed_in_each_book"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Creating charts that show both book- and chapter-level data:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_characters_typed_by_book_and_chapter = df_Bible.pivot_table(index = [\n",
    "'Book_Order', 'Book_Name', 'Book_and_Chapter'], values = [\n",
    "    'Characters', 'Characters_Typed'], aggfunc = 'sum').reset_index()\n",
    "df_characters_typed_by_book_and_chapter[\n",
    "'proportion_typed'] = df_characters_typed_by_book_and_chapter[\n",
    "'Characters_Typed'] / df_characters_typed_by_book_and_chapter['Characters']\n",
    "df_characters_typed_by_book_and_chapter.to_csv(\n",
    "    'Analyses/characters_typed_by_book_and_chapter.csv')\n",
    "df_characters_typed_by_book_and_chapter"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The following chart shows both books (as bars) and chapters (as sections of these bars). These sections are also color coded by the proportion of each chapter that has been typed."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_characters_typed_in_each_book_and_chapter = px.bar(\n",
    "df_characters_typed_by_book_and_chapter, x = 'Book_Name', y = [\n",
    "    'Characters'], color = 'proportion_typed')\n",
    "fig_characters_typed_in_each_book_and_chapter.write_html(\n",
    "    'Analyses/characters_typed_by_book_and_chapter.html')\n",
    "fig_characters_typed_in_each_book_and_chapter.write_image(\n",
    "    'Analyses/characters_typed_by_book_and_chapter.png', \n",
    "    width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_characters_typed_in_each_book_and_chapter"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Creating similar charts at the chapter level:\n",
    "\n",
    "These proved difficult to interpret due to the narrowness of the bars, so I'm commenting this code out for now."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# fig_proportion_of_each_chapter_typed = px.bar(df_characters_typed_by_chapter, \n",
    "# x = 'Book_and_Chapter', y = 'proportion_typed')\n",
    "# fig_proportion_of_each_chapter_typed.update_yaxes(range = [0, 1]) # Setting\n",
    "# # the maximum y value as 1 better demonstrates how much of the Bible\n",
    "# # has been typed so far\n",
    "# fig_proportion_of_each_chapter_typed.write_html(\n",
    "# 'Analyses/proportion_of_each_chapter_typed.html')\n",
    "# fig_proportion_of_each_chapter_typed\n",
    "\n",
    "# fig_characters_typed_in_each_chapter = px.bar(df_characters_typed_by_chapter, \n",
    "# x = 'Book_and_Chapter', y = ['Characters', 'Characters_Typed'], \n",
    "# barmode = 'overlay')\n",
    "# fig_characters_typed_in_each_chapter.write_html(\n",
    "# 'Analyses/characters_typed_by_chapter.html')\n",
    "# fig_characters_typed_in_each_chapter"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Endurance statistics (e.g. most characters/verses typed over a given time period):"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Calculating the dates with the most characters and verses typed:\n",
    "\n",
    "Note: In order to create more accurate analyses, I will filter the results to only include values with the same start and end periods. (For instance, if a given test began at 9:59 p.m. on 2023-11-17 but ended after 10 p.m., that test would get filtered out of a 'top hours by characters typed' report, since including it would extend the time frame analyzed beyond a 60-minute window.)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_top_dates_by_characters = df_results.pivot_table(\n",
    "    index = ['Local_Start_Date', 'Local_End_Date'], values = 'Characters', aggfunc = 'sum').reset_index(\n",
    "    ).sort_values('Characters', ascending = False)\n",
    "# By using both the start and end dates as pivot index values, we've already \n",
    "# separated results with different start and end dates from ones whose \n",
    "# start and end dates are the same. (This will prevent the tests included\n",
    "# in a given date's calculation from extending beyond just that date.)\n",
    "# We'll also filter the DataFrame to exclude any results whose start\n",
    "# and end dates differ:\n",
    "df_top_dates_by_characters = df_top_dates_by_characters.query(\"Local_Start_Date == Local_End_Date\").head(50).copy()\n",
    "df_top_dates_by_characters['Rank'] = df_top_dates_by_characters[\n",
    "    'Characters'].rank(ascending = False, method = 'min').astype('int')\n",
    "# Creating a column that shows both the rank and date: (This also prevents\n",
    "# Plotly from converting the x axis to a date range, which would interfere\n",
    "# with the order of the chart items)\n",
    "df_top_dates_by_characters['Rank and Date'] = '#'+df_top_dates_by_characters[\n",
    "    'Rank'].astype('str') + ': ' + df_top_dates_by_characters[\n",
    "        'Local_Start_Date'].astype('str')\n",
    "df_top_dates_by_characters.reset_index(drop=True,inplace=True)\n",
    "df_top_dates_by_characters.to_csv(\n",
    "    'Analyses/top_dates_by_characters.csv', index = False)\n",
    "df_top_dates_by_characters"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_top_dates_by_characters = px.bar(df_top_dates_by_characters, \n",
    "x = 'Rank and Date', y = 'Characters', text = 'Characters')\n",
    "fig_top_dates_by_characters.update_xaxes(tickangle = 90)\n",
    "fig_top_dates_by_characters.write_html('Analyses/top_dates_by_characters.html')\n",
    "fig_top_dates_by_characters.write_image(\n",
    "    'Analyses/top_dates_by_characters.png', \n",
    "    width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_top_dates_by_characters"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_top_dates_by_verses = df_results.pivot_table(\n",
    "    index = ['Local_Start_Date', 'Local_End_Date'], \n",
    "    values = 'Count', aggfunc = 'sum').reset_index(\n",
    "    ).rename(columns = {'Count':'Verses'}).sort_values(\n",
    "        'Verses', ascending = False)\n",
    "df_top_dates_by_verses = df_top_dates_by_verses.query(\n",
    "    \"Local_Start_Date == Local_End_Date\").head(50).copy()\n",
    "df_top_dates_by_verses['Rank'] = df_top_dates_by_verses['Verses'].rank(\n",
    "    ascending = False, method = 'min').astype('int')\n",
    "df_top_dates_by_verses['Rank and Date'] = '#'+df_top_dates_by_verses[\n",
    "    'Rank'].astype('str') + ': ' + df_top_dates_by_verses[\n",
    "        'Local_Start_Date'].astype('str')\n",
    "df_top_dates_by_verses.reset_index(drop=True,inplace=True)\n",
    "df_top_dates_by_verses.to_csv('Analyses/top_dates_by_verses.csv', index = False)\n",
    "df_top_dates_by_verses"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_top_dates_by_verses = px.bar(df_top_dates_by_verses, \n",
    "x = 'Rank and Date', y = 'Verses', text = 'Verses')\n",
    "fig_top_dates_by_verses.update_xaxes(tickangle = 90)\n",
    "fig_top_dates_by_verses.write_html('Analyses/top_dates_by_verses.html')\n",
    "fig_top_dates_by_verses.write_image(\n",
    "    'Analyses/top_dates_by_verses.png', \n",
    "    width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_top_dates_by_verses"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Performing similar analyses by month:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_top_months_by_characters = df_results.pivot_table(\n",
    "    index = ['Local_Start_Year', 'Local_End_Year', \n",
    "    'Local_Start_Month', 'Local_End_Month'], \n",
    "    values = 'Characters', aggfunc = 'sum').reset_index(\n",
    "    ).sort_values('Characters', ascending = False)\n",
    "df_top_months_by_characters = df_top_months_by_characters.query(\n",
    "    \"Local_Start_Year == Local_End_Year & \\\n",
    "Local_Start_Month == Local_End_Month\").head(50).copy()\n",
    "\n",
    "df_top_months_by_characters['Rank'] = df_top_months_by_characters[\n",
    "'Characters'].rank(ascending = False, method = 'min').astype('int')\n",
    "df_top_months_by_characters['Rank and Month'] = '#'+df_top_months_by_characters[\n",
    "    'Rank'].astype('str') + ': ' + df_top_months_by_characters[\n",
    "        'Local_Start_Year'].astype('str') + '-' + df_top_months_by_characters[\n",
    "            'Local_Start_Month'].astype('str')\n",
    "df_top_months_by_characters.reset_index(drop=True,inplace=True)\n",
    "df_top_months_by_characters.to_csv('Analyses/top_months_by_characters.csv', index = False)\n",
    "df_top_months_by_characters"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_top_months_by_characters = px.bar(df_top_months_by_characters, \n",
    "x = 'Rank and Month', y = 'Characters', text = 'Characters')\n",
    "fig_top_months_by_characters.update_xaxes(tickangle = 90)\n",
    "fig_top_months_by_characters.write_html(\n",
    "    'Analyses/top_months_by_characters.html')\n",
    "fig_top_months_by_characters.write_image(\n",
    "    'Analyses/top_months_by_characters.png', \n",
    "    width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_top_months_by_characters"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_top_months_by_verses = df_results.pivot_table(\n",
    "    index = ['Local_Start_Year', 'Local_Start_Month', \n",
    "    'Local_End_Year', 'Local_End_Month'], \n",
    "    values = 'Count', aggfunc = 'sum').reset_index(\n",
    "    ).rename(columns={'Count':'Verses'}).sort_values(\n",
    "        'Verses', ascending = False)\n",
    "df_top_months_by_verses = df_top_months_by_verses.query(\n",
    "    \"Local_Start_Year == Local_End_Year & \\\n",
    "Local_Start_Month == Local_End_Month\").head(50).copy()\n",
    "\n",
    "df_top_months_by_verses['Rank'] = df_top_months_by_verses['Verses'].rank(\n",
    "    ascending = False, method = 'min').astype('int')\n",
    "df_top_months_by_verses['Rank and Month'] = '#'+df_top_months_by_verses[\n",
    "    'Rank'].astype('str') + ': ' + df_top_months_by_verses[\n",
    "        'Local_Start_Year'].astype('str') + '-' + df_top_months_by_verses[\n",
    "            'Local_Start_Month'].astype('str')\n",
    "df_top_months_by_verses.reset_index(drop=True,inplace=True)\n",
    "df_top_months_by_verses.to_csv('Analyses/top_months_by_verses.csv', index = False)\n",
    "df_top_months_by_verses"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_top_months_by_verses = px.bar(df_top_months_by_verses, \n",
    "x = 'Rank and Month', y = 'Verses', text = 'Verses')\n",
    "fig_top_months_by_verses.update_xaxes(tickangle = 90)\n",
    "fig_top_months_by_verses.write_html('Analyses/top_months_by_verses.html')\n",
    "fig_top_months_by_verses.write_image(\n",
    "    'Analyses/top_months_by_verses.png', \n",
    "    width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_top_months_by_verses"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Performing similar analyses for hours and for 30-, 15-, and 10-minute blocks:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_top_hours_by_characters = df_results.pivot_table(index = ['Local_Start_Date', \n",
    "'Local_End_Date', 'Local_Start_Hour', 'Local_End_Hour'], values = 'Characters', \n",
    "aggfunc = 'sum').reset_index().sort_values('Characters', ascending = False)\n",
    "df_top_hours_by_characters = df_top_hours_by_characters.query(\n",
    "\"Local_Start_Date == Local_End_Date & \\\n",
    "Local_Start_Hour == Local_End_Hour\").head(100).copy()\n",
    "df_top_hours_by_characters['Hour'] = df_top_hours_by_characters[\n",
    "'Local_Start_Date'].astype('str') + ' ' + df_top_hours_by_characters[\n",
    "'Local_Start_Hour'].astype('str') \n",
    "df_top_hours_by_characters.to_csv('Analyses/top_hours_by_characters.csv', index = False)\n",
    "df_top_hours_by_characters"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_top_hours_by_characters = px.bar(df_top_hours_by_characters, \n",
    "x = 'Hour', y = 'Characters', text = 'Characters')\n",
    "fig_top_hours_by_characters.update_xaxes(type = 'category')\n",
    "fig_top_hours_by_characters.write_html('Analyses/top_hours_by_characters.html')\n",
    "fig_top_hours_by_characters.write_image(\n",
    "    'Analyses/top_hours_by_characters.png', \n",
    "    width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_top_hours_by_characters"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_top_30m_by_characters = df_results.pivot_table(index = ['Local_Start_Date', \n",
    "'Local_End_Date', 'Local_Start_Hour', 'Local_End_Hour', \n",
    "'Local_Start_30_Minute_Block', 'Local_End_30_Minute_Block'], \n",
    "values = 'Characters', aggfunc = 'sum').reset_index().sort_values(\n",
    "'Characters', ascending = False)\n",
    "df_top_30m_by_characters = df_top_30m_by_characters.query(\n",
    "\"Local_Start_Date == Local_End_Date & Local_Start_Hour == Local_End_Hour \\\n",
    "& Local_Start_30_Minute_Block == Local_End_30_Minute_Block\").head(100).copy()\n",
    "df_top_30m_by_characters['30-Minute Block'] = df_top_30m_by_characters[\n",
    "'Local_Start_Date'].astype('str') + ' ' + df_top_30m_by_characters[\n",
    "'Local_Start_Hour'].astype('str') + '_' + df_top_30m_by_characters[\n",
    "'Local_Start_30_Minute_Block'].astype('str')\n",
    "df_top_30m_by_characters.to_csv('Analyses/top_30m_by_characters.csv', index = False)\n",
    "df_top_30m_by_characters"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_top_30m_by_characters = px.bar(df_top_30m_by_characters, \n",
    "x = '30-Minute Block', y = 'Characters', text = 'Characters')\n",
    "fig_top_30m_by_characters.update_xaxes(type = 'category')\n",
    "fig_top_30m_by_characters.write_html(\n",
    "'Analyses/top_30m_blocks_by_characters.html')\n",
    "fig_top_30m_by_characters.write_image(\n",
    "    'Analyses/top_30m_blocks_by_characters.png', \n",
    "    width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_top_30m_by_characters"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_top_15m_by_characters = df_results.pivot_table(index = [\n",
    "'Local_Start_Date', 'Local_End_Date', 'Local_Start_Hour', 'Local_End_Hour', \n",
    "'Local_Start_15_Minute_Block', 'Local_End_15_Minute_Block'], \n",
    "values = 'Characters', aggfunc = 'sum').reset_index().sort_values(\n",
    "'Characters', ascending = False)\n",
    "# print(len(df_top_15m_by_characters))\n",
    "df_top_15m_by_characters = df_top_15m_by_characters.query(\n",
    "\"Local_Start_Date == Local_End_Date & Local_Start_Hour == Local_End_Hour & \\\n",
    "Local_Start_15_Minute_Block == Local_End_15_Minute_Block\").head(100).copy()\n",
    "df_top_15m_by_characters['15-Minute Block'] = df_top_15m_by_characters[\n",
    "'Local_Start_Date'].astype('str') + ' ' + df_top_15m_by_characters[\n",
    "'Local_Start_Hour'].astype('str') + '_' + df_top_15m_by_characters[\n",
    "'Local_Start_15_Minute_Block'].astype('str')\n",
    "# print(len(df_top_15m_by_characters))\n",
    "df_top_15m_by_characters.to_csv('Analyses/top_15m_by_characters.csv', index = False)\n",
    "df_top_15m_by_characters"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_top_15m_by_characters = px.bar(df_top_15m_by_characters, \n",
    "x = '15-Minute Block', y = 'Characters', text = 'Characters')\n",
    "fig_top_15m_by_characters.update_xaxes(type = 'category')\n",
    "fig_top_15m_by_characters.write_html(\n",
    "'Analyses/top_15m_blocks_by_characters.html')\n",
    "fig_top_15m_by_characters.write_image(\n",
    "    'Analyses/top_15m_blocks_by_characters.png', \n",
    "    width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_top_15m_by_characters"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_top_10m_by_characters = df_results.pivot_table(index = ['Local_Start_Date', \n",
    "'Local_End_Date', 'Local_Start_Hour', 'Local_End_Hour', \n",
    "'Local_Start_10_Minute_Block', 'Local_End_10_Minute_Block'], \n",
    "values = 'Characters', aggfunc = 'sum').reset_index().sort_values(\n",
    "'Characters', ascending = False)\n",
    "# print(len(df_top_10m_by_characters))\n",
    "df_top_10m_by_characters = df_top_10m_by_characters.query(\n",
    "\"Local_Start_Date == Local_End_Date & Local_Start_Hour == Local_End_Hour \\\n",
    "& Local_Start_10_Minute_Block == Local_End_10_Minute_Block\").head(100).copy()\n",
    "df_top_10m_by_characters['10-Minute Block'] = df_top_10m_by_characters[\n",
    "'Local_Start_Date'].astype('str') + ' ' + df_top_10m_by_characters[\n",
    "'Local_Start_Hour'].astype('str') + '_' + df_top_10m_by_characters[\n",
    "'Local_Start_10_Minute_Block'].astype('str')\n",
    "# print(len(df_top_10m_by_characters))\n",
    "df_top_10m_by_characters.to_csv('Analyses/top_10m_by_characters.csv', index = False)\n",
    "df_top_10m_by_characters"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_top_10m_by_characters = px.bar(df_top_10m_by_characters, \n",
    "x = '10-Minute Block', y = 'Characters', text = 'Characters')\n",
    "fig_top_10m_by_characters.update_xaxes(type = 'category')\n",
    "fig_top_10m_by_characters.write_html(\n",
    "'Analyses/top_10m_blocks_by_characters.html')\n",
    "fig_top_10m_by_characters.write_image(\n",
    "    'Analyses/top_10m_blocks_by_characters.png', \n",
    "    width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_top_10m_by_characters"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Analyzing WPM data:\n",
    "\n",
    "(Some of this section's code derives from my work in [this script](https://github.com/kburchfiel/typeracer_data_analyzer/blob/master/typeracer_data_analyzer_v2.ipynb).)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Top 20 WPM results:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_top_100_wpm = df_results.sort_values('WPM', ascending = False).head(\n",
    "    100).copy()\n",
    "df_top_100_wpm.insert(0, 'Rank', df_top_100_wpm['WPM'].rank(\n",
    "    ascending = False, method = 'min').astype('int'))\n",
    "# method = 'min' assigns the lowest rank to any rows that happen to have\n",
    "# the same WPM. See \n",
    "# https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.rank.html\n",
    "df_top_100_wpm.to_csv('Analyses/top_100_wpm.csv')\n",
    "df_top_100_wpm"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_top_100_wpm = px.bar(df_top_100_wpm, x = 'Rank', y = 'WPM', \n",
    "text_auto = '.6s')\n",
    "fig_top_100_wpm.write_html('Analyses/top_100_wpm.html')\n",
    "fig_top_100_wpm.write_image('Analyses/top_100_wpm.png', \n",
    "width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_top_100_wpm"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Top 'Last 10 Average' values:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "if len(df_results) >= 10: # If fewer than 10 tests are present in df_results,\n",
    "    # there won't be anything to graph (and the following code will raise\n",
    "    # an error), so this section should be skipped.\n",
    "    df_top_last_10_avg_results = df_results.sort_values(\n",
    "    'Last 10 Avg', ascending = False).head(20).copy()\n",
    "    df_top_last_10_avg_results.insert(0, 'Rank', \n",
    "    df_top_last_10_avg_results['Last 10 Avg'].rank(ascending = False, \n",
    "    method = 'min').astype('int'))\n",
    "    df_top_last_10_avg_results.to_csv('Analyses/top_last_10_avg_results.csv', index = False)\n",
    "    df_top_last_10_avg_results"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "if len(df_results) >= 10:\n",
    "    fig_top_last_10_average_wpm = px.bar(df_top_last_10_avg_results, x = 'Rank', \n",
    "    y = 'Last 10 Avg', text_auto = '.6s')\n",
    "    fig_top_last_10_average_wpm.write_html('Analyses/top_last_10_average_wpm.html')\n",
    "    fig_top_last_10_average_wpm.write_image('Analyses/top_last_10_average_wpm.png', \n",
    "    width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "    fig_top_last_10_average_wpm"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Showing WPM results and moving averages by test number:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_results"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_df_results_by_test_number = px.line(df_results, x = df_results.index, \n",
    "y = ['WPM', 'Last 10 Avg', 'Last 100 Avg', 'Last 1000 Avg', 'cumulative_avg'])\n",
    "fig_df_results_by_test_number.write_html('Analyses/results_by_test_number.html')\n",
    "fig_df_results_by_test_number.write_image('Analyses/results_by_test_number.png', \n",
    "width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_df_results_by_test_number"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Creating WPM histograms for (1) all tests and (2) the last 1000 tests:\n",
    "\n",
    "(Until you've taken more than 1,000 tests, these histograms will have the same appearance.)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_wpm_histogram = px.histogram(x = df_results['WPM'], nbins = 50, \n",
    "text_auto = True)\n",
    "fig_wpm_histogram.update_layout(bargroupgap = 0.1) # Adds a bit of space\n",
    "# in between histogram bars. See https://stackoverflow.com/a/62925197/13097194\n",
    "fig_wpm_histogram.write_html('Analyses/wpm_histogram.html')\n",
    "fig_wpm_histogram.write_image('Analyses/wpm_histogram.png', \n",
    "width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_wpm_histogram\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_wpm_histogram = px.histogram(x = df_results.tail(1000)['WPM'], nbins = 50, \n",
    "text_auto = True)\n",
    "fig_wpm_histogram.update_layout(bargroupgap = 0.1) # Adds a bit of space\n",
    "# in between histogram bars. See https://stackoverflow.com/a/62925197/13097194\n",
    "fig_wpm_histogram.write_html('Analyses/wpm_histogram_last_1000.html')\n",
    "fig_wpm_histogram.write_image('Analyses/wpm_histogram_last_1000.png', \n",
    "width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_wpm_histogram\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Evaluating average results by month:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_results_by_month = df_results.pivot_table(\n",
    "    index = ['Local_Start_Year', 'Local_Start_Month'], values = [\n",
    "'Count', 'WPM'], aggfunc = {'Count':'sum', 'WPM':'mean'}).reset_index()\n",
    "df_results_by_month['Year/Month'] = df_results_by_month[\n",
    "    'Local_Start_Year'].astype('str') + '-' + df_results_by_month[\n",
    "    'Local_Start_Month'].astype('str')\n",
    "df_results_by_month.to_csv('Analyses/results_by_month.csv', index = False)\n",
    "df_results_by_month"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_results_by_month = px.bar(df_results_by_month, x = 'Year/Month', \n",
    "y = 'WPM', color = 'Count', text_auto = '.6s')\n",
    "fig_results_by_month.update_xaxes(type = 'category') # This line, based on\n",
    "# Pracheta's response at https://stackoverflow.com/a/64424308/13097194,\n",
    "# updates the axes to show the date-month pairs as strings rather than \n",
    "# as Plotly-formatted date values. This will also prevent missing\n",
    "# months from appearing in the graph.\n",
    "fig_results_by_month.write_html('Analyses/results_by_month.html')\n",
    "fig_results_by_month.write_image('Analyses/results_by_month.png', \n",
    "width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_results_by_month"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Evaluating average results by hour of day:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_results_by_hour = df_results.pivot_table(index = ['Local_Start_Hour'], \n",
    "values = ['Count', 'WPM'], \n",
    "aggfunc = {'Count':'sum', 'WPM':'mean'}).reset_index()\n",
    "df_results_by_hour.to_csv('Analyses/results_by_hour.csv')\n",
    "df_results_by_hour"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_results_by_hour = px.bar(df_results_by_hour, x = 'Local_Start_Hour', \n",
    "y = 'WPM', color = 'Count', text_auto = '.6s')\n",
    "fig_results_by_hour.write_html('Analyses/results_by_hour.html')\n",
    "fig_results_by_hour.write_image('Analyses/results_by_hour.png', \n",
    "width = 1920, height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_results_by_hour"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Comparing mean WPMs by Bible books:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_wpm_by_book = df_results.pivot_table(index = 'Book', values = 'WPM', \n",
    "aggfunc = ['count', 'mean'], margins = True, \n",
    "margins_name = 'Total').reset_index()\n",
    "df_wpm_by_book.columns = 'Book', 'Tests', 'WPM'\n",
    "df_wpm_by_book.sort_values('WPM', ascending = False, inplace = True)\n",
    "df_wpm_by_book.reset_index(drop=True,inplace=True)\n",
    "df_wpm_by_book.to_csv('Analyses/mean_wpm_by_book.csv')\n",
    "df_wpm_by_book\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# The following chart will display a bar for each book for which at least one \n",
    "# test has been taken. It will also show a line that corresponds to the player's\n",
    "# overall WPM across all books. The bars are colored by test count, making\n",
    "# it easier to identify which bars might be skewed by a low number of results.\n",
    "# The 'Total' value in df_wpm_by_book is displayed as a line instead of as\n",
    "# a color so as not to interfere with the color gradient.\n",
    "\n",
    "# Retrieving the total mean WPM value in df_wpm_by_book:\n",
    "total_mean_wpm = df_wpm_by_book.query(\"Book == 'Total'\").iloc[0]['WPM']\n",
    "total_mean_wpm\n",
    "\n",
    "fig_mean_wpm_by_book = px.bar(df_wpm_by_book.query(\"Book != 'Total'\"), \n",
    "x = 'Book', y = 'WPM', color = 'Tests', text_auto = '.6s')\n",
    "fig_mean_wpm_by_book.add_shape(type = 'line', x0 = -0.5, \n",
    "x1 = len(df_wpm_by_book) -1.5, y0 = total_mean_wpm, y1 = total_mean_wpm)\n",
    "# See https://plotly.com/python/shapes/ for the add_shape() code.\n",
    "# The use of -0.5 and len() - 1.5 is based on gleasocd's answer at \n",
    "# https://stackoverflow.com/a/40408960/13097194 . len(df) - 0.5 would normally\n",
    "# work, except that I reduced the size of the DataFrame by 1 when excluding\n",
    "# the 'Total' book.\n",
    "fig_mean_wpm_by_book.write_html('Analyses/mean_wpm_by_book.html')\n",
    "fig_mean_wpm_by_book.write_image('Analyses/mean_wpm_by_book.png', width = 1920, \n",
    "height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_mean_wpm_by_book\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Comparing mean WPM for error-free and non-error free tests:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# We'll only create the graph if there is at least one mistake-free\n",
    "# result and one result with errors. (Otherwise, we won't be able to\n",
    "# compare these two outcomes.)\n",
    "if (len(df_results.query(\"Mistake_Free_Test == 0\")) >= 1) & (\n",
    "    len(df_results.query(\"Mistake_Free_Test == 1\")) >= 1):\n",
    "    df_wpm_by_mistake_free_status = df_results.pivot_table(index = 'Mistake_Free_Test', values = 'WPM', aggfunc = 'mean').reset_index()\n",
    "    df_wpm_by_mistake_free_status['Mistake_Free_Test'].replace({0:'No', 1:'Yes'}, inplace = True)\n",
    "    df_wpm_by_mistake_free_status.to_csv('Analyses/wpm_by_mistake_free_status.csv', index = False)\n",
    "    df_wpm_by_mistake_free_status"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# We'll only create the graph if there is at least one mistake-free\n",
    "# result and one result with errors. (Otherwise, we won't be able\n",
    "# to compare these two outcomes.)\n",
    "if (len(df_results.query(\"Mistake_Free_Test == 0\")) >= 1) & (\n",
    "    len(df_results.query(\"Mistake_Free_Test == 1\")) >= 1):\n",
    "    fig_wpm_by_mistake_free_status = px.bar(df_wpm_by_mistake_free_status, x = 'Mistake_Free_Test', y = 'WPM', text_auto = '.6s')\n",
    "    fig_wpm_by_mistake_free_status.write_html('Analyses/mean_wpm_by_mistake_free_status.html')\n",
    "    fig_wpm_by_mistake_free_status.write_image('Analyses/mean_wpm_by_mistake_free_status.png', width = 1920, \n",
    "    height = 1080, engine = 'kaleido', scale = 2)\n",
    "    fig_wpm_by_mistake_free_status"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_wpm_by_percentile = df_results['WPM'].quantile(q = np.arange(0, 1.05, 0.05)).transpose().reset_index()\n",
    "df_wpm_by_percentile.columns = ['Percentile', 'WPM']\n",
    "df_wpm_by_percentile['Percentile'] = (\n",
    "df_wpm_by_percentile['Percentile']*100).astype('int')\n",
    "# Some of the WPM values had additional decimal values (e.g. 15.000000000000002,\n",
    "# might currently have additional decimal values, so rounding them as integers\n",
    "# helps simplify them.\n",
    "df_wpm_by_percentile.to_csv('Analyses/wpm_by_percentile.csv', index = False)\n",
    "df_wpm_by_percentile"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_wpm_by_percentile = px.bar(df_wpm_by_percentile, x = 'Percentile', y = 'WPM', text_auto = '.6s')\n",
    "fig_wpm_by_percentile.update_xaxes(type = 'category')\n",
    "fig_wpm_by_percentile.write_html('Analyses/wpm_by_percentile.html')\n",
    "fig_wpm_by_percentile.write_image('Analyses/wpm_by_percentile.png', width = 1920, \n",
    "height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_wpm_by_percentile"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Analyzing character statistics:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Calculating the fastest keypresses (in ms):\n",
    "# Note: This analysis will only include characters that were preceded by at \n",
    "# least two correctly typed characters. (This is due to the code underlying\n",
    "# the construction of the source table.)\n",
    "\n",
    "df_fastest_keypresses = df_character_stats.sort_values('Time Used to Type Last Character (ms)').head(50).copy().reset_index(drop=True)\n",
    "df_fastest_keypresses['Rank'] = df_fastest_keypresses.index + 1\n",
    "df_fastest_keypresses.to_csv('Analyses/fastest_keypresses.csv')\n",
    "df_fastest_keypresses"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_fastest_keypresses = px.bar(df_fastest_keypresses, x = 'Rank', y = 'Time Used to Type Last Character (ms)', text_auto = '.3s', title = 'Fastest Keypresses (ms)<br><i>(Note: these values only include characters that were immediately preceded by<br>at least 2 correct keypresess)')\n",
    "fig_fastest_keypresses.write_html('Analyses/fastest_keypresses.html')\n",
    "fig_fastest_keypresses.write_image('Analyses/fastest_keypresses.png', width = 1920, \n",
    "height = 1080, engine = 'kaleido', scale = 2)\n",
    "\n",
    "fig_fastest_keypresses"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_character_durations = df_character_stats.pivot_table(index = 'Character', values = ['Time Used to Type Last Character (ms)', 'Count'], aggfunc = {'Time Used to Type Last Character (ms)':np.median, 'Count':sum}).reset_index().sort_values('Time Used to Type Last Character (ms)').reset_index(drop=True)\n",
    "df_character_durations['Character'] = df_character_durations['Character'].replace(' ', '_')\n",
    "df_character_durations.to_csv('Analyses/median_character_durations.csv', index = False)\n",
    "df_character_durations"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_character_durations = px.bar(df_character_durations, x = 'Character', y = 'Time Used to Type Last Character (ms)', color = 'Count')\n",
    "fig_character_durations.write_html('Analyses/median_character_durations.html')\n",
    "fig_character_durations.write_image('Analyses/median_character_durations.png', width = 1920, \n",
    "height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_character_durations"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_last_2_character_durations = df_character_stats.pivot_table(index = 'Last 2 Characters', values = ['Time Used to Type Last 2 Characters (ms)', 'Count'], aggfunc = {'Time Used to Type Last 2 Characters (ms)':np.median, 'Count':sum}).reset_index().sort_values('Time Used to Type Last 2 Characters (ms)').reset_index(drop=True)\n",
    "df_last_2_character_durations.to_csv('Analyses/median_last_2_character_durations.csv', index = False)\n",
    "# Replacing spaces with underscores to make them more visible:\n",
    "df_last_2_character_durations['Last 2 Characters'] = \\\n",
    "df_last_2_character_durations['Last 2 Characters'].str.replace(' ', '_')\n",
    "df_last_2_character_durations"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "fig_last_2_character_durations = px.bar(df_last_2_character_durations, x = 'Last 2 Characters', y = 'Time Used to Type Last 2 Characters (ms)', color = 'Count')\n",
    "fig_last_2_character_durations.write_html('Analyses/median_character_pair_durations.html')\n",
    "fig_last_2_character_durations.write_image('Analyses/median_character_pair_durations.png', width = 1920, \n",
    "height = 1080, engine = 'kaleido', scale = 2)\n",
    "fig_last_2_character_durations"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "analysis_end_time = time.time()\n",
    "analysis_time = analysis_end_time - analysis_start_time\n",
    "print(f\"Finished updating analyses in {round(analysis_time, 3)} seconds. \\\n",
    "Enter any key to exit.\") # Allows the console to stay open when the\n",
    "# .py version of the program is run\n",
    "\n",
    "input()"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "ga15pyd",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.10.9"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}