Bible_csv_generator.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Bible CSV Generator:\n",
    "\n",
    "A Python script for converting a folder with .txt files for each Bible chapter into a single .csv file\n",
    "\n",
    "By Kenneth Burchfiel\n",
    "\n",
    "Script released under the MIT license; original .txt files and resulting .csv file are both in the public domain"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import time\n",
    "start_time = time.time()\n",
    "from datetime import datetime, timezone\n",
    "import pandas as pd\n",
    "import numpy as np\n",
    "import os"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Note: The original source of the files in the Bible_Chapters folder was https://ebible.org/Scriptures/details.php?id=eng-web-c; this link contains various downloadable versions of the World English Bible (Catholic Edition). I downloaded the 'Plain text canon only chapter files' as a .zip file and then extracted the contents. \n",
    "\n",
    "I noticed that Genesis was missing, so I downloaded an additional version of the World English Bible from https://ebible.org/find/show.php?id=eng-web and then copied the Genesis chapters into the Catholic World English Bible chapters folder. These files start with 'eng-web_' instead of 'eng-web-c'.\n",
    "\n",
    "Some of the verses produced by this script are quite long. Esther in particular has four verses with over 1,000 characters. I checked an XML version of the Word English Bible for comparison purposes and found this note:\n",
    "\n",
    "*\"The book of Esther in the Greek Septuagint contains 5 additions that the traditional Hebrew text doesn’t have. These additions are recognized as Deuterocanonical Scripture by the Roman Catholic, Greek Orthodox, and Russian Orthodox Churches. Those additions are enclosed in [square brackets]. Because the additions by themselves make little sense without the broader context of the book, we present here a translation of the whole book of Esther from the Greek. \n",
    "We have chosen not to distract the reader with confusing out-of-order chapter numbers that would result from using the KJV versification, but rather merge these 5 additions as extensions at the beginning of 1:1 and after 3:13, 4:17, 8:12, and 10:3. This makes some verses (1:1, 5:1, and 8:12) really long, but it also makes the verses line up with the same verse numbers in Esther as translated from the traditional Hebrew text. Some of the proper names in this book have been changed to the more familiar Hebrew form instead of the direct transliteration from the Greek.\"*\n",
    "\n",
    "Although these verses will take some time to type, I think they present a fun challenge!"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'eng-web-c_003_EXO_01_read.txt'"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "bible_chapters_folder = os.listdir('eng-web-c_readaloud_with_additions/Bible_Chapters')\n",
    "bible_chapters_folder.sort()\n",
    "bible_chapters_folder[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "def bible_chapter_txt_file_to_df(i):\n",
    "    '''This function converts a .txt file containing two header lines and \n",
    "    the verses of a Bible chapter into a DataFrame that stores both those\n",
    "    verses and information about their corresponding book and chapter.\n",
    "    i represents the index of the file within the Bible Chapters folder\n",
    "    that this function will open.'''\n",
    "\n",
    "    # The file names contain book, book order, and chapter information, so we'll\n",
    "    # extract that data here for use within our .csv file:\n",
    "\n",
    "    book_order = int(bible_chapters_folder[i].split('_')[1])\n",
    "    book_name = bible_chapters_folder[i].split('_')[2]\n",
    "    chapter_name = bible_chapters_folder[i].split('_')[3]\n",
    "    # print(i, book_order, book_name, chapter_name)\n",
    "\n",
    "    with open (('eng-web-c_readaloud_with_additions/Bible_Chapters')+'/'+bible_chapters_folder[i]) as file:\n",
    "        chapter = file.readlines()[2:].copy() # [2:] excludes the 1st two lines \n",
    "        # (as these don't include actual verses):\n",
    "    # Removing extra spaces and linebreaks:\n",
    "    chapter = [verse.strip() for verse in chapter]\n",
    "    chapter\n",
    "\n",
    "    # Creating a DataFrame that contains both the chapter's verses and \n",
    "    # information about the book and chapter:\n",
    "\n",
    "    df_chapter = pd.DataFrame(data = {'Book_Order':book_order-1, \n",
    "    'Book_Name':book_name, 'Chapter_Name': chapter_name, \n",
    "    'Verse_#':np.arange(1, len(chapter)+1), 'Verse':chapter})\n",
    "    df_chapter # I'm assuming\n",
    "    # that each line in the original text files represents its own verse,\n",
    "    # and some quick spot checks indicated that this was the case. However,\n",
    "    # these may not actually be the real verse numbers of each chapter.\n",
    "\n",
    "    # I also subtract 1 from the book order values because they appeared\n",
    "    # to be 1 higher than the actual values. (For instance, Genesis had an \n",
    "    # order of 2 rather than 1.)\n",
    "    return df_chapter"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The following cell calls bible_chapter_txt_file_to_df() for each file within the Bible Chapters folder, then concatenates the resulting DataFrames into a single DataFrame."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Book_Order</th>\n",
       "      <th>Book_Name</th>\n",
       "      <th>Chapter_Name</th>\n",
       "      <th>Verse_#</th>\n",
       "      <th>Verse</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2</td>\n",
       "      <td>EXO</td>\n",
       "      <td>01</td>\n",
       "      <td>1</td>\n",
       "      <td>Now these are the names of the sons of Israel,...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>EXO</td>\n",
       "      <td>01</td>\n",
       "      <td>2</td>\n",
       "      <td>Reuben, Simeon, Levi, and Judah,</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2</td>\n",
       "      <td>EXO</td>\n",
       "      <td>01</td>\n",
       "      <td>3</td>\n",
       "      <td>Issachar, Zebulun, and Benjamin,</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>2</td>\n",
       "      <td>EXO</td>\n",
       "      <td>01</td>\n",
       "      <td>4</td>\n",
       "      <td>Dan and Naphtali, Gad and Asher.</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2</td>\n",
       "      <td>EXO</td>\n",
       "      <td>01</td>\n",
       "      <td>5</td>\n",
       "      <td>All the souls who came out of Jacob’s body wer...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>50</td>\n",
       "      <td>22</td>\n",
       "      <td>Joseph lived in Egypt, he, and his father’s ho...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>50</td>\n",
       "      <td>23</td>\n",
       "      <td>Joseph saw Ephraim’s children to the third gen...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>50</td>\n",
       "      <td>24</td>\n",
       "      <td>Joseph said to his brothers, “I am dying, but ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>50</td>\n",
       "      <td>25</td>\n",
       "      <td>Joseph took an oath from the children of Israe...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>50</td>\n",
       "      <td>26</td>\n",
       "      <td>So Joseph died, being one hundred ten years ol...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>35379 rows × 5 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "    Book_Order Book_Name Chapter_Name  Verse_#  \\\n",
       "0            2       EXO           01        1   \n",
       "1            2       EXO           01        2   \n",
       "2            2       EXO           01        3   \n",
       "3            2       EXO           01        4   \n",
       "4            2       EXO           01        5   \n",
       "..         ...       ...          ...      ...   \n",
       "21           1       GEN           50       22   \n",
       "22           1       GEN           50       23   \n",
       "23           1       GEN           50       24   \n",
       "24           1       GEN           50       25   \n",
       "25           1       GEN           50       26   \n",
       "\n",
       "                                                Verse  \n",
       "0   Now these are the names of the sons of Israel,...  \n",
       "1                    Reuben, Simeon, Levi, and Judah,  \n",
       "2                    Issachar, Zebulun, and Benjamin,  \n",
       "3                    Dan and Naphtali, Gad and Asher.  \n",
       "4   All the souls who came out of Jacob’s body wer...  \n",
       "..                                                ...  \n",
       "21  Joseph lived in Egypt, he, and his father’s ho...  \n",
       "22  Joseph saw Ephraim’s children to the third gen...  \n",
       "23  Joseph said to his brothers, “I am dying, but ...  \n",
       "24  Joseph took an oath from the children of Israe...  \n",
       "25  So Joseph died, being one hundred ten years ol...  \n",
       "\n",
       "[35379 rows x 5 columns]"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_Bible = pd.concat([bible_chapter_txt_file_to_df(i) for i in range(len(bible_chapters_folder))])\n",
    "df_Bible"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Book_Order</th>\n",
       "      <th>Book_Name</th>\n",
       "      <th>Chapter_Name</th>\n",
       "      <th>Verse_#</th>\n",
       "      <th>Verse</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>In the beginning, God created the heavens and ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>The earth was formless and empty. Darkness was...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "      <td>God said, “Let there be light,” and there was ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>4</td>\n",
       "      <td>God saw the light, and saw that it was good. G...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>5</td>\n",
       "      <td>God called the light “day”, and the darkness h...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>17</td>\n",
       "      <td>The Spirit and the bride say, “Come!” He who h...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>18</td>\n",
       "      <td>I testify to everyone who hears the words of t...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>19</td>\n",
       "      <td>If anyone takes away from the words of the boo...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>20</td>\n",
       "      <td>He who testifies these things says, “Yes, I am...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>21</td>\n",
       "      <td>The grace of the Lord Jesus Christ be with all...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>35379 rows × 5 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "    Book_Order Book_Name  Chapter_Name  Verse_#  \\\n",
       "0            1       GEN             1        1   \n",
       "1            1       GEN             1        2   \n",
       "2            1       GEN             1        3   \n",
       "3            1       GEN             1        4   \n",
       "4            1       GEN             1        5   \n",
       "..         ...       ...           ...      ...   \n",
       "16          95       REV            22       17   \n",
       "17          95       REV            22       18   \n",
       "18          95       REV            22       19   \n",
       "19          95       REV            22       20   \n",
       "20          95       REV            22       21   \n",
       "\n",
       "                                                Verse  \n",
       "0   In the beginning, God created the heavens and ...  \n",
       "1   The earth was formless and empty. Darkness was...  \n",
       "2   God said, “Let there be light,” and there was ...  \n",
       "3   God saw the light, and saw that it was good. G...  \n",
       "4   God called the light “day”, and the darkness h...  \n",
       "..                                                ...  \n",
       "16  The Spirit and the bride say, “Come!” He who h...  \n",
       "17  I testify to everyone who hears the words of t...  \n",
       "18  If anyone takes away from the words of the boo...  \n",
       "19  He who testifies these things says, “Yes, I am...  \n",
       "20  The grace of the Lord Jesus Christ be with all...  \n",
       "\n",
       "[35379 rows x 5 columns]"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_Bible['Chapter_Name'] = df_Bible['Chapter_Name'].astype('int')\n",
    "# Now that chapter names are in integer form, we can use Book_Order,\n",
    "# Chapter_Name, and Verse_# values to sort the DataFrame:\n",
    "df_Bible.sort_values(['Book_Order', 'Chapter_Name'], inplace = True)\n",
    "df_Bible"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Book_Order</th>\n",
       "      <th>Book_Name</th>\n",
       "      <th>Chapter_Name</th>\n",
       "      <th>Book_and_Chapter</th>\n",
       "      <th>Verse_#</th>\n",
       "      <th>Verse</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>In the beginning, God created the heavens and ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>2</td>\n",
       "      <td>The earth was formless and empty. Darkness was...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>3</td>\n",
       "      <td>God said, “Let there be light,” and there was ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>4</td>\n",
       "      <td>God saw the light, and saw that it was good. G...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>5</td>\n",
       "      <td>God called the light “day”, and the darkness h...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>17</td>\n",
       "      <td>The Spirit and the bride say, “Come!” He who h...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>18</td>\n",
       "      <td>I testify to everyone who hears the words of t...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>19</td>\n",
       "      <td>If anyone takes away from the words of the boo...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>20</td>\n",
       "      <td>He who testifies these things says, “Yes, I am...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>21</td>\n",
       "      <td>The grace of the Lord Jesus Christ be with all...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>35379 rows × 6 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "    Book_Order Book_Name  Chapter_Name Book_and_Chapter  Verse_#  \\\n",
       "0            1       GEN             1            GEN 1        1   \n",
       "1            1       GEN             1            GEN 1        2   \n",
       "2            1       GEN             1            GEN 1        3   \n",
       "3            1       GEN             1            GEN 1        4   \n",
       "4            1       GEN             1            GEN 1        5   \n",
       "..         ...       ...           ...              ...      ...   \n",
       "16          95       REV            22           REV 22       17   \n",
       "17          95       REV            22           REV 22       18   \n",
       "18          95       REV            22           REV 22       19   \n",
       "19          95       REV            22           REV 22       20   \n",
       "20          95       REV            22           REV 22       21   \n",
       "\n",
       "                                                Verse  \n",
       "0   In the beginning, God created the heavens and ...  \n",
       "1   The earth was formless and empty. Darkness was...  \n",
       "2   God said, “Let there be light,” and there was ...  \n",
       "3   God saw the light, and saw that it was good. G...  \n",
       "4   God called the light “day”, and the darkness h...  \n",
       "..                                                ...  \n",
       "16  The Spirit and the bride say, “Come!” He who h...  \n",
       "17  I testify to everyone who hears the words of t...  \n",
       "18  If anyone takes away from the words of the boo...  \n",
       "19  He who testifies these things says, “Yes, I am...  \n",
       "20  The grace of the Lord Jesus Christ be with all...  \n",
       "\n",
       "[35379 rows x 6 columns]"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# A column that stores both book and chapter information will prove \n",
    "# useful when visualizing data by chapter:\n",
    "df_Bible.insert(3, 'Book_and_Chapter', df_Bible['Book_Name'] + ' ' + df_Bible['Chapter_Name'].astype('str'))\n",
    "\n",
    "df_Bible"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Adding in the position of each chapter relative to all Bible chapters:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Book_Order</th>\n",
       "      <th>Book_Name</th>\n",
       "      <th>Chapter_Name</th>\n",
       "      <th>Book_and_Chapter</th>\n",
       "      <th>Chapter_Order</th>\n",
       "      <th>Verse_#</th>\n",
       "      <th>Verse</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>In the beginning, God created the heavens and ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>The earth was formless and empty. Darkness was...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "      <td>God said, “Let there be light,” and there was ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>4</td>\n",
       "      <td>God saw the light, and saw that it was good. G...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>5</td>\n",
       "      <td>God called the light “day”, and the darkness h...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>17</td>\n",
       "      <td>The Spirit and the bride say, “Come!” He who h...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>18</td>\n",
       "      <td>I testify to everyone who hears the words of t...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>19</td>\n",
       "      <td>If anyone takes away from the words of the boo...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>20</td>\n",
       "      <td>He who testifies these things says, “Yes, I am...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>21</td>\n",
       "      <td>The grace of the Lord Jesus Christ be with all...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>35379 rows × 7 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "    Book_Order Book_Name  Chapter_Name Book_and_Chapter  Chapter_Order  \\\n",
       "0            1       GEN             1            GEN 1              1   \n",
       "1            1       GEN             1            GEN 1              1   \n",
       "2            1       GEN             1            GEN 1              1   \n",
       "3            1       GEN             1            GEN 1              1   \n",
       "4            1       GEN             1            GEN 1              1   \n",
       "..         ...       ...           ...              ...            ...   \n",
       "16          95       REV            22           REV 22           1328   \n",
       "17          95       REV            22           REV 22           1328   \n",
       "18          95       REV            22           REV 22           1328   \n",
       "19          95       REV            22           REV 22           1328   \n",
       "20          95       REV            22           REV 22           1328   \n",
       "\n",
       "    Verse_#                                              Verse  \n",
       "0         1  In the beginning, God created the heavens and ...  \n",
       "1         2  The earth was formless and empty. Darkness was...  \n",
       "2         3  God said, “Let there be light,” and there was ...  \n",
       "3         4  God saw the light, and saw that it was good. G...  \n",
       "4         5  God called the light “day”, and the darkness h...  \n",
       "..      ...                                                ...  \n",
       "16       17  The Spirit and the bride say, “Come!” He who h...  \n",
       "17       18  I testify to everyone who hears the words of t...  \n",
       "18       19  If anyone takes away from the words of the boo...  \n",
       "19       20  He who testifies these things says, “Yes, I am...  \n",
       "20       21  The grace of the Lord Jesus Christ be with all...  \n",
       "\n",
       "[35379 rows x 7 columns]"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# We can calculate these chapter positions via pd.factorize().\n",
    "df_Bible.insert(4, 'Chapter_Order', pd.factorize(df_Bible['Book_and_Chapter'])[0]+1)\n",
    "df_Bible"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "## Adding in the position of each verse relative to all Bible verses:\n",
    "\n",
    "This idea came from a World English Bible .csv file that I downloaded from [Bible Supersearch](https://www.biblesupersearch.com/bible-downloads/). I ultimately opted not to use that .csv file, however, because I also wanted to include the books found in the WEB's Catholic edition.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Book_Order</th>\n",
       "      <th>Book_Name</th>\n",
       "      <th>Chapter_Name</th>\n",
       "      <th>Book_and_Chapter</th>\n",
       "      <th>Chapter_Order</th>\n",
       "      <th>Verse_#</th>\n",
       "      <th>Verse</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Verse_Order</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>In the beginning, God created the heavens and ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>The earth was formless and empty. Darkness was...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "      <td>God said, “Let there be light,” and there was ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>4</td>\n",
       "      <td>God saw the light, and saw that it was good. G...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>5</td>\n",
       "      <td>God called the light “day”, and the darkness h...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35375</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>17</td>\n",
       "      <td>The Spirit and the bride say, “Come!” He who h...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35376</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>18</td>\n",
       "      <td>I testify to everyone who hears the words of t...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35377</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>19</td>\n",
       "      <td>If anyone takes away from the words of the boo...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35378</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>20</td>\n",
       "      <td>He who testifies these things says, “Yes, I am...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35379</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>21</td>\n",
       "      <td>The grace of the Lord Jesus Christ be with all...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>35379 rows × 7 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "             Book_Order Book_Name  Chapter_Name Book_and_Chapter  \\\n",
       "Verse_Order                                                        \n",
       "1                     1       GEN             1            GEN 1   \n",
       "2                     1       GEN             1            GEN 1   \n",
       "3                     1       GEN             1            GEN 1   \n",
       "4                     1       GEN             1            GEN 1   \n",
       "5                     1       GEN             1            GEN 1   \n",
       "...                 ...       ...           ...              ...   \n",
       "35375                95       REV            22           REV 22   \n",
       "35376                95       REV            22           REV 22   \n",
       "35377                95       REV            22           REV 22   \n",
       "35378                95       REV            22           REV 22   \n",
       "35379                95       REV            22           REV 22   \n",
       "\n",
       "             Chapter_Order  Verse_#  \\\n",
       "Verse_Order                           \n",
       "1                        1        1   \n",
       "2                        1        2   \n",
       "3                        1        3   \n",
       "4                        1        4   \n",
       "5                        1        5   \n",
       "...                    ...      ...   \n",
       "35375                 1328       17   \n",
       "35376                 1328       18   \n",
       "35377                 1328       19   \n",
       "35378                 1328       20   \n",
       "35379                 1328       21   \n",
       "\n",
       "                                                         Verse  \n",
       "Verse_Order                                                     \n",
       "1            In the beginning, God created the heavens and ...  \n",
       "2            The earth was formless and empty. Darkness was...  \n",
       "3            God said, “Let there be light,” and there was ...  \n",
       "4            God saw the light, and saw that it was good. G...  \n",
       "5            God called the light “day”, and the darkness h...  \n",
       "...                                                        ...  \n",
       "35375        The Spirit and the bride say, “Come!” He who h...  \n",
       "35376        I testify to everyone who hears the words of t...  \n",
       "35377        If anyone takes away from the words of the boo...  \n",
       "35378        He who testifies these things says, “Yes, I am...  \n",
       "35379        The grace of the Lord Jesus Christ be with all...  \n",
       "\n",
       "[35379 rows x 7 columns]"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_Bible.sort_values(['Book_Order', 'Chapter_Name', 'Verse_#'], inplace = True)\n",
    "if 'Verse_Order' not in df_Bible.columns:\n",
    "    df_Bible['Verse_Order'] = np.arange(1, len(df_Bible) +1)\n",
    "df_Bible.set_index('Verse_Order', inplace = True)\n",
    "df_Bible"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Replacing curly quotes with straight quotes:\n",
    "df_Bible['Verse'] = df_Bible['Verse'].str.replace('“', '\"')\n",
    "df_Bible['Verse'] = df_Bible['Verse'].str.replace('”', '\"')\n",
    "df_Bible['Verse'] = df_Bible['Verse'].str.replace('‘', \"'\")\n",
    "df_Bible['Verse'] = df_Bible['Verse'].str.replace('’', \"'\")\n",
    "df_Bible['Verse'] = df_Bible['Verse'].str.replace('’', \"'\")\n",
    "# Replacing em dashes (which appear in 338 verses) with double hyphens:\n",
    "df_Bible['Verse'] = df_Bible['Verse'].str.replace('—', \"--\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "# df_Bible[df_Bible['Verse'].str.contains('—')]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "# df_Bible[df_Bible['Verse'].str.contains('–')] # Didn't see any en dashes"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Confirming that the replace operation was successful (at least for instances of '’'):"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "\"The earth was formless and empty. Darkness was on the surface of the deep and God's Spirit was hovering over the surface of the waters.\""
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_Bible.iloc[1]['Verse']"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Calculating the number of characters in each verse:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Book_Order</th>\n",
       "      <th>Book_Name</th>\n",
       "      <th>Chapter_Name</th>\n",
       "      <th>Book_and_Chapter</th>\n",
       "      <th>Chapter_Order</th>\n",
       "      <th>Verse_#</th>\n",
       "      <th>Verse</th>\n",
       "      <th>Characters</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Verse_Order</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>In the beginning, God created the heavens and ...</td>\n",
       "      <td>56</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>The earth was formless and empty. Darkness was...</td>\n",
       "      <td>135</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "      <td>God said, \"Let there be light,\" and there was ...</td>\n",
       "      <td>52</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>4</td>\n",
       "      <td>God saw the light, and saw that it was good. G...</td>\n",
       "      <td>85</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>5</td>\n",
       "      <td>God called the light \"day\", and the darkness h...</td>\n",
       "      <td>119</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35375</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>17</td>\n",
       "      <td>The Spirit and the bride say, \"Come!\" He who h...</td>\n",
       "      <td>160</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35376</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>18</td>\n",
       "      <td>I testify to everyone who hears the words of t...</td>\n",
       "      <td>159</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35377</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>19</td>\n",
       "      <td>If anyone takes away from the words of the boo...</td>\n",
       "      <td>174</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35378</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>20</td>\n",
       "      <td>He who testifies these things says, \"Yes, I am...</td>\n",
       "      <td>89</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35379</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>21</td>\n",
       "      <td>The grace of the Lord Jesus Christ be with all...</td>\n",
       "      <td>64</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>35379 rows × 8 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "             Book_Order Book_Name  Chapter_Name Book_and_Chapter  \\\n",
       "Verse_Order                                                        \n",
       "1                     1       GEN             1            GEN 1   \n",
       "2                     1       GEN             1            GEN 1   \n",
       "3                     1       GEN             1            GEN 1   \n",
       "4                     1       GEN             1            GEN 1   \n",
       "5                     1       GEN             1            GEN 1   \n",
       "...                 ...       ...           ...              ...   \n",
       "35375                95       REV            22           REV 22   \n",
       "35376                95       REV            22           REV 22   \n",
       "35377                95       REV            22           REV 22   \n",
       "35378                95       REV            22           REV 22   \n",
       "35379                95       REV            22           REV 22   \n",
       "\n",
       "             Chapter_Order  Verse_#  \\\n",
       "Verse_Order                           \n",
       "1                        1        1   \n",
       "2                        1        2   \n",
       "3                        1        3   \n",
       "4                        1        4   \n",
       "5                        1        5   \n",
       "...                    ...      ...   \n",
       "35375                 1328       17   \n",
       "35376                 1328       18   \n",
       "35377                 1328       19   \n",
       "35378                 1328       20   \n",
       "35379                 1328       21   \n",
       "\n",
       "                                                         Verse  Characters  \n",
       "Verse_Order                                                                 \n",
       "1            In the beginning, God created the heavens and ...          56  \n",
       "2            The earth was formless and empty. Darkness was...         135  \n",
       "3            God said, \"Let there be light,\" and there was ...          52  \n",
       "4            God saw the light, and saw that it was good. G...          85  \n",
       "5            God called the light \"day\", and the darkness h...         119  \n",
       "...                                                        ...         ...  \n",
       "35375        The Spirit and the bride say, \"Come!\" He who h...         160  \n",
       "35376        I testify to everyone who hears the words of t...         159  \n",
       "35377        If anyone takes away from the words of the boo...         174  \n",
       "35378        He who testifies these things says, \"Yes, I am...          89  \n",
       "35379        The grace of the Lord Jesus Christ be with all...          64  \n",
       "\n",
       "[35379 rows x 8 columns]"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_Bible['Characters'] = df_Bible['Verse'].str.len()\n",
    "# This approach is much faster than the following list comprehension:\n",
    "# [len(df_Bible.iloc[i]['Verse']) for i in range(len(df_Bible))]\n",
    "\n",
    "df_Bible"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "4508151"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Finding the total number of characters in this version of the Bible:\n",
    "# (Note that the switch from em dashes to hyphens slightly increased\n",
    "# this copy of the Word English Bible).\n",
    "df_Bible['Characters'].sum()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Exporting this DataFrame to a .csv file:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_Bible.to_csv('WEB_Catholic_Version.csv')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Creating a copy of this DataFrame that will be useful for our 'Type the Bible' game:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Book_Order</th>\n",
       "      <th>Book_Name</th>\n",
       "      <th>Chapter_Name</th>\n",
       "      <th>Book_and_Chapter</th>\n",
       "      <th>Chapter_Order</th>\n",
       "      <th>Verse_#</th>\n",
       "      <th>Verse</th>\n",
       "      <th>Characters</th>\n",
       "      <th>Typed</th>\n",
       "      <th>Tests</th>\n",
       "      <th>Fastest_WPM</th>\n",
       "      <th>Characters_Typed</th>\n",
       "      <th>Total_Characters_Typed</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Verse_Order</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>In the beginning, God created the heavens and ...</td>\n",
       "      <td>56</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>The earth was formless and empty. Darkness was...</td>\n",
       "      <td>135</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "      <td>God said, \"Let there be light,\" and there was ...</td>\n",
       "      <td>52</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>4</td>\n",
       "      <td>God saw the light, and saw that it was good. G...</td>\n",
       "      <td>85</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>1</td>\n",
       "      <td>GEN</td>\n",
       "      <td>1</td>\n",
       "      <td>GEN 1</td>\n",
       "      <td>1</td>\n",
       "      <td>5</td>\n",
       "      <td>God called the light \"day\", and the darkness h...</td>\n",
       "      <td>119</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35375</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>17</td>\n",
       "      <td>The Spirit and the bride say, \"Come!\" He who h...</td>\n",
       "      <td>160</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35376</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>18</td>\n",
       "      <td>I testify to everyone who hears the words of t...</td>\n",
       "      <td>159</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35377</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>19</td>\n",
       "      <td>If anyone takes away from the words of the boo...</td>\n",
       "      <td>174</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35378</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>20</td>\n",
       "      <td>He who testifies these things says, \"Yes, I am...</td>\n",
       "      <td>89</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35379</th>\n",
       "      <td>95</td>\n",
       "      <td>REV</td>\n",
       "      <td>22</td>\n",
       "      <td>REV 22</td>\n",
       "      <td>1328</td>\n",
       "      <td>21</td>\n",
       "      <td>The grace of the Lord Jesus Christ be with all...</td>\n",
       "      <td>64</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>35379 rows × 13 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "             Book_Order Book_Name  Chapter_Name Book_and_Chapter  \\\n",
       "Verse_Order                                                        \n",
       "1                     1       GEN             1            GEN 1   \n",
       "2                     1       GEN             1            GEN 1   \n",
       "3                     1       GEN             1            GEN 1   \n",
       "4                     1       GEN             1            GEN 1   \n",
       "5                     1       GEN             1            GEN 1   \n",
       "...                 ...       ...           ...              ...   \n",
       "35375                95       REV            22           REV 22   \n",
       "35376                95       REV            22           REV 22   \n",
       "35377                95       REV            22           REV 22   \n",
       "35378                95       REV            22           REV 22   \n",
       "35379                95       REV            22           REV 22   \n",
       "\n",
       "             Chapter_Order  Verse_#  \\\n",
       "Verse_Order                           \n",
       "1                        1        1   \n",
       "2                        1        2   \n",
       "3                        1        3   \n",
       "4                        1        4   \n",
       "5                        1        5   \n",
       "...                    ...      ...   \n",
       "35375                 1328       17   \n",
       "35376                 1328       18   \n",
       "35377                 1328       19   \n",
       "35378                 1328       20   \n",
       "35379                 1328       21   \n",
       "\n",
       "                                                         Verse  Characters  \\\n",
       "Verse_Order                                                                  \n",
       "1            In the beginning, God created the heavens and ...          56   \n",
       "2            The earth was formless and empty. Darkness was...         135   \n",
       "3            God said, \"Let there be light,\" and there was ...          52   \n",
       "4            God saw the light, and saw that it was good. G...          85   \n",
       "5            God called the light \"day\", and the darkness h...         119   \n",
       "...                                                        ...         ...   \n",
       "35375        The Spirit and the bride say, \"Come!\" He who h...         160   \n",
       "35376        I testify to everyone who hears the words of t...         159   \n",
       "35377        If anyone takes away from the words of the boo...         174   \n",
       "35378        He who testifies these things says, \"Yes, I am...          89   \n",
       "35379        The grace of the Lord Jesus Christ be with all...          64   \n",
       "\n",
       "             Typed  Tests  Fastest_WPM  Characters_Typed  \\\n",
       "Verse_Order                                                \n",
       "1                0      0          NaN                 0   \n",
       "2                0      0          NaN                 0   \n",
       "3                0      0          NaN                 0   \n",
       "4                0      0          NaN                 0   \n",
       "5                0      0          NaN                 0   \n",
       "...            ...    ...          ...               ...   \n",
       "35375            0      0          NaN                 0   \n",
       "35376            0      0          NaN                 0   \n",
       "35377            0      0          NaN                 0   \n",
       "35378            0      0          NaN                 0   \n",
       "35379            0      0          NaN                 0   \n",
       "\n",
       "             Total_Characters_Typed  \n",
       "Verse_Order                          \n",
       "1                                 0  \n",
       "2                                 0  \n",
       "3                                 0  \n",
       "4                                 0  \n",
       "5                                 0  \n",
       "...                             ...  \n",
       "35375                             0  \n",
       "35376                             0  \n",
       "35377                             0  \n",
       "35378                             0  \n",
       "35379                             0  \n",
       "\n",
       "[35379 rows x 13 columns]"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_Bible_for_game = df_Bible.copy()\n",
    "df_Bible_for_game['Typed'] = 0 \n",
    "df_Bible_for_game['Tests'] = 0\n",
    "df_Bible_for_game['Fastest_WPM'] = np.NaN\n",
    "df_Bible_for_game['Characters_Typed'] = 0\n",
    "df_Bible_for_game['Total_Characters_Typed'] = 0\n",
    "df_Bible_for_game\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_Bible_for_game.to_csv('WEB_Catholic_Version_for_game.csv')\n",
    "# I manually created a copy of this file called 'WEB_Catholic_Version_for_game_updated.csv'\n",
    "# in order to store the player's actual game data. That way, running this script\n",
    "# won't overwrite any progress the player has already made within that file."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "2023-12-08T13:35:57.118330+00:00\n",
      "Finished running script in 23.068 seconds.\n"
     ]
    }
   ],
   "source": [
    "end_time = time.time()\n",
    "runtime = end_time - start_time\n",
    "print(datetime.now(timezone.utc).isoformat())\n",
    "# To show the current UTC time, you can instead use:\n",
    "# print(datetime.now(timezone.utc).isoformat())\n",
    "print(f\"Finished running script in {round(runtime, 3)} seconds.\")"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "ga15pyd",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.10.9"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}