6- RulerCatalogue.ipynb

{"nbformat":4,"nbformat_minor":0,"metadata":{"colab":{"provenance":[],"authorship_tag":"ABX9TyM6LWT+sYxPHTQOe56yXc4J"},"kernelspec":{"name":"python3","display_name":"Python 3"},"language_info":{"name":"python"}},"cells":[{"cell_type":"markdown","metadata":{"id":"tWVN4o0UvT30"},"source":["#RulerCatalogue\n","\n","Notebook by Melinee Her\n","\n","Cleans the megacatalogue to get and export a dataframe titled, \"RulerCatalogue\" that captures data like ruler, eponym, year and month.\n"]},{"cell_type":"markdown","source":["## The workflow from [Megacatalogue](https://colab.research.google.com/drive/17bsHjB8_o8ydYjdbTsafZDGNpBj-gDTi?usp=sharing) accomplished:\n","\n","The creation of a large dataframe of ORACC catalogue data.\n","\n","##Next Steps:\n","\n","1. Resolving duplicate fields\n","  * lowercase all fields and merge duplicates (as long as there are no merge conflicts)\n","2. Resolving date fields\n","  * cross-validate & harmonize the date fields between ORACC projects:\n","  1. `ruler`\n","  2. `date_of_origin`\n","  3. `date`\n","  4. `long_date`\n","  5. `date_gen`\n","  6. `day`\n","  7. `long_date_gen`\n","  8. `month`\n","  9. `year`\n","  10. `eponym`\n","  11. `regnal_dates`\n","  12. `ancient_year`\n","  13. `date_bce`\n","  14. `months_recorded`\n","  15. `date_comments`\n","  16. `proposed_date`\n","  17. `eponym_title`\n","  18. `astron_date`\n","  19. `Reg_year`\n","  20. `Reg_no`\n","  21. `Ruler`\n","  22. `Day`\n","  23. `Month`\n","  24. `Year`\n","  25. `dynastic_seat`\n","  26. `date remarks`\n","  27. `year_name_eponym`\n","  28. `ancient_date`\n","  29. `century`\n","  30. `modern_converted_date`\n","  31. `accounting_period`\n","  * We can use this Chronology notebook to check against the CDLI dates: https://colab.research.google.com/drive/1ZYWIapSC6za-WJd6EOA7xjSm6o6CPKPu?usp=sharing\n","\n","3. Harmonizing with the CDLI catalogue\n","  1. [GitHub repo cdli_cat.csv](https://github.com/cdli-gh/data/blob/master/cdli_cat.csv)\n","  * [Zenodo](https://zenodo.org/record/6975724) (should be same as above)\n","  2. Processed & cleaned CDLI catalogue subset: https://github.com/ancient-world-citation-analysis/CDLI2LoD\n","\n","4. Formatting for LOD in FactGrid\n","  * Example from ORACC: http://oracc.museum.upenn.edu/epsd2/admin/ur3/P123456\n","    * Dates Referenced: SH44 - 01 - 26\n","    * SH = Šulgi\n","\n","|id_text|Ruler|Year_number|Month|Day|Earliest_P41|Latest_P43|\n","|--|--|--|--|--|--|--|\n","|P123456|Šulgi|44|01|26|Earliest|Latest|\n","\n"],"metadata":{"id":"16Tv8-FlIz11"}},{"cell_type":"markdown","metadata":{"id":"8o9WOYlYRbH5"},"source":["# Mount Google Drive folder + imports"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"elapsed":1673,"status":"ok","timestamp":1692899002996,"user":{"displayName":"Melinee Her","userId":"06864672402504422512"},"user_tz":420},"outputId":"236fd2bd-31a3-4ec1-ab85-0c2e9abba1ab","id":"tPFA-xKbpLVH"},"outputs":[{"output_type":"stream","name":"stdout","text":["Drive already mounted at /content/drive; to attempt to forcibly remount, call drive.mount(\"/content/drive\", force_remount=True).\n"]}],"source":["from google.colab import drive\n","drive.mount('/content/drive')"]},{"cell_type":"code","execution_count":null,"metadata":{"id":"348qpPX4pLVI"},"outputs":[],"source":["#any necessary imports\n","import pandas as pd\n","import zipfile\n","from zipfile import ZipFile\n","import json\n","import requests\n","from tqdm import tqdm\n","import os\n","import errno\n","import re\n","import random\n","import numpy as np\n","import sys\n","import copy\n","import networkx as nx\n","from pathlib import Path\n","\n","#Set folder for remote drive\n","#folder = '/content/drive/My Drive/FactGrid Cuneiform (AWCA)/people/Melinee'\n","folder = '/content/drive/MyDrive/Melinee/'\n","\n","#importing utils for the method which downloads the current text json files\n","os.chdir(folder + 'network/utils/')\n","from utils import oracc_download\n","\n","# This is a user defined module that searches through the texts to find the entities in the text that\n","# are people and places, to be imported as nodes into the network\n","os.chdir(folder + 'network/')\n","import rank_parser4 as rp"]},{"cell_type":"markdown","source":["Retrieving the megacatalogue from drive"],"metadata":{"id":"jwfltgQ5PFGv"}},{"cell_type":"code","source":["path = '/content/drive/MyDrive/Melinee/ORACC_DFS/megacatalogue.csv'\n","megacatalogue = pd.read_csv(path, low_memory=False, index_col=False)\n","print(megacatalogue.shape)"],"metadata":{"id":"DGTxTrXeBRu2","executionInfo":{"status":"ok","timestamp":1692899027233,"user_tz":420,"elapsed":21065,"user":{"displayName":"Melinee Her","userId":"06864672402504422512"}},"colab":{"base_uri":"https://localhost:8080/"},"outputId":"6306884b-0fa1-4104-bf52-b211eb0e2cc6"},"execution_count":null,"outputs":[{"output_type":"stream","name":"stdout","text":["(171145, 405)\n"]}]},{"cell_type":"markdown","source":["# Cleaning the Megacatalogue\n","1. Drop any columns with all null values\n","2. Attempt to remove duplicates"],"metadata":{"id":"0rReDIZGB8HB"}},{"cell_type":"code","source":["#drops any columns with all null values\n","nonullmegacat = megacatalogue.dropna(axis='columns', how = 'all')"],"metadata":{"id":"qzuJfH9qGm6U"},"execution_count":null,"outputs":[]},{"cell_type":"code","source":["#drops any duplicates\n","megacatalogue = nonullmegacat.T.drop_duplicates().T"],"metadata":{"id":"ryQZhDaaGzkd"},"execution_count":null,"outputs":[]},{"cell_type":"code","source":["print(megacatalogue.shape)\n","megacatalogue.head(3)"],"metadata":{"colab":{"base_uri":"https://localhost:8080/","height":279},"id":"bEAzsZarj-pG","executionInfo":{"status":"ok","timestamp":1692899134635,"user_tz":420,"elapsed":8,"user":{"displayName":"Melinee Her","userId":"06864672402504422512"}},"outputId":"53e7fb02-df41-4314-c741-5144354a9a70"},"execution_count":null,"outputs":[{"output_type":"stream","name":"stdout","text":["(171145, 339)\n"]},{"output_type":"execute_result","data":{"text/plain":["  Unnamed: 0  id_text       langs    project id_text.1 primary_publication  \\\n","0          0  P522592  0x08000000  tilbarsip   P522592       Til-Barsip 01   \n","1          1  P522593  0x08000000  tilbarsip   P522593       Til-Barsip 02   \n","2          2  P522594  0x08000000  tilbarsip   P522594       Til-Barsip 03   \n","\n","               provenience pleiades_id            pleiades_coord  \\\n","0  Tell Ahmar (Til Barsip)    658410.0  [38.1191944, 36.6749623]   \n","1  Tell Ahmar (Til Barsip)    658410.0  [38.1191944, 36.6749623]   \n","2  Tell Ahmar (Til Barsip)    658410.0  [38.1191944, 36.6749623]   \n","\n","  excavation_no  ... Delnero_subgenre_no deity museum_URL Delnero_remarks  \\\n","0          T 01  ...                 NaN   NaN        NaN             NaN   \n","1          T 02  ...                 NaN   NaN        NaN             NaN   \n","2          T 03  ...                 NaN   NaN        NaN             NaN   \n","\n","  Cohen_balag external_URL_name external_URL google_earth_provenience  \\\n","0         NaN               NaN          NaN                      NaN   \n","1         NaN               NaN          NaN                      NaN   \n","2         NaN               NaN          NaN                      NaN   \n","\n","  alternative_years oracc_id  \n","0               NaN      NaN  \n","1               NaN      NaN  \n","2               NaN      NaN  \n","\n","[3 rows x 339 columns]"],"text/html":["\n","  <div id=\"df-77f5f99c-39d6-4673-8ddc-143db84c87da\" class=\"colab-df-container\">\n","    <div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>Unnamed: 0</th>\n","      <th>id_text</th>\n","      <th>langs</th>\n","      <th>project</th>\n","      <th>id_text.1</th>\n","      <th>primary_publication</th>\n","      <th>provenience</th>\n","      <th>pleiades_id</th>\n","      <th>pleiades_coord</th>\n","      <th>excavation_no</th>\n","      <th>...</th>\n","      <th>Delnero_subgenre_no</th>\n","      <th>deity</th>\n","      <th>museum_URL</th>\n","      <th>Delnero_remarks</th>\n","      <th>Cohen_balag</th>\n","      <th>external_URL_name</th>\n","      <th>external_URL</th>\n","      <th>google_earth_provenience</th>\n","      <th>alternative_years</th>\n","      <th>oracc_id</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>0</td>\n","      <td>P522592</td>\n","      <td>0x08000000</td>\n","      <td>tilbarsip</td>\n","      <td>P522592</td>\n","      <td>Til-Barsip 01</td>\n","      <td>Tell Ahmar (Til Barsip)</td>\n","      <td>658410.0</td>\n","      <td>[38.1191944, 36.6749623]</td>\n","      <td>T 01</td>\n","      <td>...</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>1</th>\n","      <td>1</td>\n","      <td>P522593</td>\n","      <td>0x08000000</td>\n","      <td>tilbarsip</td>\n","      <td>P522593</td>\n","      <td>Til-Barsip 02</td>\n","      <td>Tell Ahmar (Til Barsip)</td>\n","      <td>658410.0</td>\n","      <td>[38.1191944, 36.6749623]</td>\n","      <td>T 02</td>\n","      <td>...</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>2</th>\n","      <td>2</td>\n","      <td>P522594</td>\n","      <td>0x08000000</td>\n","      <td>tilbarsip</td>\n","      <td>P522594</td>\n","      <td>Til-Barsip 03</td>\n","      <td>Tell Ahmar (Til Barsip)</td>\n","      <td>658410.0</td>\n","      <td>[38.1191944, 36.6749623]</td>\n","      <td>T 03</td>\n","      <td>...</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","  </tbody>\n","</table>\n","<p>3 rows × 339 columns</p>\n","</div>\n","    <div class=\"colab-df-buttons\">\n","\n","  <div class=\"colab-df-container\">\n","    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-77f5f99c-39d6-4673-8ddc-143db84c87da')\"\n","            title=\"Convert this dataframe to an interactive table.\"\n","            style=\"display:none;\">\n","\n","  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n","    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n","  </svg>\n","    </button>\n","\n","  <style>\n","    .colab-df-container {\n","      display:flex;\n","      gap: 12px;\n","    }\n","\n","    .colab-df-convert {\n","      background-color: #E8F0FE;\n","      border: none;\n","      border-radius: 50%;\n","      cursor: pointer;\n","      display: none;\n","      fill: #1967D2;\n","      height: 32px;\n","      padding: 0 0 0 0;\n","      width: 32px;\n","    }\n","\n","    .colab-df-convert:hover {\n","      background-color: #E2EBFA;\n","      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n","      fill: #174EA6;\n","    }\n","\n","    .colab-df-buttons div {\n","      margin-bottom: 4px;\n","    }\n","\n","    [theme=dark] .colab-df-convert {\n","      background-color: #3B4455;\n","      fill: #D2E3FC;\n","    }\n","\n","    [theme=dark] .colab-df-convert:hover {\n","      background-color: #434B5C;\n","      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n","      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n","      fill: #FFFFFF;\n","    }\n","  </style>\n","\n","    <script>\n","      const buttonEl =\n","        document.querySelector('#df-77f5f99c-39d6-4673-8ddc-143db84c87da button.colab-df-convert');\n","      buttonEl.style.display =\n","        google.colab.kernel.accessAllowed ? 'block' : 'none';\n","\n","      async function convertToInteractive(key) {\n","        const element = document.querySelector('#df-77f5f99c-39d6-4673-8ddc-143db84c87da');\n","        const dataTable =\n","          await google.colab.kernel.invokeFunction('convertToInteractive',\n","                                                    [key], {});\n","        if (!dataTable) return;\n","\n","        const docLinkHtml = 'Like what you see? Visit the ' +\n","          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n","          + ' to learn more about interactive tables.';\n","        element.innerHTML = '';\n","        dataTable['output_type'] = 'display_data';\n","        await google.colab.output.renderOutput(dataTable, element);\n","        const docLink = document.createElement('div');\n","        docLink.innerHTML = docLinkHtml;\n","        element.appendChild(docLink);\n","      }\n","    </script>\n","  </div>\n","\n","\n","<div id=\"df-ce66c30e-519f-41ce-a1fa-6b79c4f44c25\">\n","  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-ce66c30e-519f-41ce-a1fa-6b79c4f44c25')\"\n","            title=\"Suggest charts.\"\n","            style=\"display:none;\">\n","\n","<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n","     width=\"24px\">\n","    <g>\n","        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n","    </g>\n","</svg>\n","  </button>\n","\n","<style>\n","  .colab-df-quickchart {\n","    background-color: #E8F0FE;\n","    border: none;\n","    border-radius: 50%;\n","    cursor: pointer;\n","    display: none;\n","    fill: #1967D2;\n","    height: 32px;\n","    padding: 0 0 0 0;\n","    width: 32px;\n","  }\n","\n","  .colab-df-quickchart:hover {\n","    background-color: #E2EBFA;\n","    box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n","    fill: #174EA6;\n","  }\n","\n","  [theme=dark] .colab-df-quickchart {\n","    background-color: #3B4455;\n","    fill: #D2E3FC;\n","  }\n","\n","  [theme=dark] .colab-df-quickchart:hover {\n","    background-color: #434B5C;\n","    box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n","    filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n","    fill: #FFFFFF;\n","  }\n","</style>\n","\n","  <script>\n","    async function quickchart(key) {\n","      const charts = await google.colab.kernel.invokeFunction(\n","          'suggestCharts', [key], {});\n","    }\n","    (() => {\n","      let quickchartButtonEl =\n","        document.querySelector('#df-ce66c30e-519f-41ce-a1fa-6b79c4f44c25 button');\n","      quickchartButtonEl.style.display =\n","        google.colab.kernel.accessAllowed ? 'block' : 'none';\n","    })();\n","  </script>\n","</div>\n","    </div>\n","  </div>\n"]},"metadata":{},"execution_count":9}]},{"cell_type":"markdown","source":["As we can see there are no \"perfectly\" duplicated columns. The column \"id_text.1\" has around 9000 different values that \"id_text\", and it's mostly null. \"primary_publication\" and \"designation\" are very similary as well.\n","\n","also note that column \"has_date\" is unreliable for most projects.\n"],"metadata":{"id":"mW7uxd5gn9iP"}},{"cell_type":"markdown","source":["#Creating the Ruler Catalogue\n","1. Filter for columns related to rulers and date information\n","2. Sort and export\n","\n","First get a subset of the megacatalogue with these columns:\n","\n","    'id_text', 'ruler', 'year', 'month', 'day', 'eponym', 'regnal_dates', 'provenience', 'eponym_title', 'proposed_date', 'date',\n","    'date_of_origin','long_date', 'date_gen', 'long_date_gen', 'ancient_year', 'date_bce', 'months_recorded', 'date_comments',\n","    'astron_date', 'Reg_year', 'Reg_no', 'dynastic_seat', 'ancient_date'\n","\n","Columns in final rulercatalogue:\n","\n","    'id_text', 'ruler', 'year', 'month', 'day', 'eponym', 'regnal_dates', 'provenience', 'eponym_title', 'proposed_date', 'date',\n","    'date_of_origin', 'long_date', 'date_gen', 'long_date_gen','astron_date', 'dynastic_seat'"],"metadata":{"id":"s4tU8rtG1ufm"}},{"cell_type":"code","source":["#gets subset of metacatalogue with ruler and date information\n","datemegacat = megacatalogue[['id_text', 'ruler', 'year', 'month', 'day', 'eponym', 'regnal_dates', 'provenience', 'eponym_title', 'proposed_date', 'date', 'date_of_origin','long_date', 'date_gen', 'long_date_gen', 'ancient_year', 'date_bce', 'months_recorded', 'date_comments', 'astron_date', 'Reg_year', 'Reg_no', 'dynastic_seat', 'ancient_date']]"],"metadata":{"id":"nn0Qhb8N6Fbf"},"execution_count":null,"outputs":[]},{"cell_type":"code","source":["print(datemegacat.shape)\n","datemegacat.head(3)"],"metadata":{"colab":{"base_uri":"https://localhost:8080/","height":279},"id":"QvJCwMuy6OiA","executionInfo":{"status":"ok","timestamp":1692899143753,"user_tz":420,"elapsed":7,"user":{"displayName":"Melinee Her","userId":"06864672402504422512"}},"outputId":"1b4f0477-6163-4974-d0b3-6af802426949"},"execution_count":null,"outputs":[{"output_type":"stream","name":"stdout","text":["(171145, 24)\n"]},{"output_type":"execute_result","data":{"text/plain":["   id_text         ruler   year month    day              eponym  \\\n","0  P522592           NaN    NaN   NaN    NaN                 NaN   \n","1  P522593           NaN  [...]   VII  [...]                 NaN   \n","2  P522594  Ashurbanipal    650   VII     01  Bēl-Harrān-šaddû’a   \n","\n","     regnal_dates              provenience eponym_title proposed_date  ...  \\\n","0             NaN  Tell Ahmar (Til Barsip)          NaN           NaN  ...   \n","1             NaN  Tell Ahmar (Til Barsip)          NaN           NaN  ...   \n","2  668–ca. 631 BC  Tell Ahmar (Til Barsip)          NaN           NaN  ...   \n","\n","                                long_date_gen ancient_year date_bce  \\\n","0                                         NaN          NaN      NaN   \n","1             Tašrītu ...th, [eponymy of ...]          NaN      NaN   \n","2  Tašrītu 1st, eponymy of Bēl-Harrān-šaddû’a          NaN      NaN   \n","\n","  months_recorded date_comments astron_date Reg_year Reg_no dynastic_seat  \\\n","0             NaN           NaN         NaN      NaN    NaN           NaN   \n","1             NaN           NaN         NaN      NaN    NaN           NaN   \n","2             NaN           NaN         NaN      NaN    NaN           NaN   \n","\n","  ancient_date  \n","0          NaN  \n","1          NaN  \n","2          NaN  \n","\n","[3 rows x 24 columns]"],"text/html":["\n","  <div id=\"df-e00bd3fe-8747-4b03-a809-c7b0b2209ace\" class=\"colab-df-container\">\n","    <div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>id_text</th>\n","      <th>ruler</th>\n","      <th>year</th>\n","      <th>month</th>\n","      <th>day</th>\n","      <th>eponym</th>\n","      <th>regnal_dates</th>\n","      <th>provenience</th>\n","      <th>eponym_title</th>\n","      <th>proposed_date</th>\n","      <th>...</th>\n","      <th>long_date_gen</th>\n","      <th>ancient_year</th>\n","      <th>date_bce</th>\n","      <th>months_recorded</th>\n","      <th>date_comments</th>\n","      <th>astron_date</th>\n","      <th>Reg_year</th>\n","      <th>Reg_no</th>\n","      <th>dynastic_seat</th>\n","      <th>ancient_date</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>P522592</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>Tell Ahmar (Til Barsip)</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>...</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>1</th>\n","      <td>P522593</td>\n","      <td>NaN</td>\n","      <td>[...]</td>\n","      <td>VII</td>\n","      <td>[...]</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>Tell Ahmar (Til Barsip)</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>...</td>\n","      <td>Tašrītu ...th, [eponymy of ...]</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>2</th>\n","      <td>P522594</td>\n","      <td>Ashurbanipal</td>\n","      <td>650</td>\n","      <td>VII</td>\n","      <td>01</td>\n","      <td>Bēl-Harrān-šaddû’a</td>\n","      <td>668–ca. 631 BC</td>\n","      <td>Tell Ahmar (Til Barsip)</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>...</td>\n","      <td>Tašrītu 1st, eponymy of Bēl-Harrān-šaddû’a</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","  </tbody>\n","</table>\n","<p>3 rows × 24 columns</p>\n","</div>\n","    <div class=\"colab-df-buttons\">\n","\n","  <div class=\"colab-df-container\">\n","    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-e00bd3fe-8747-4b03-a809-c7b0b2209ace')\"\n","            title=\"Convert this dataframe to an interactive table.\"\n","            style=\"display:none;\">\n","\n","  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n","    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n","  </svg>\n","    </button>\n","\n","  <style>\n","    .colab-df-container {\n","      display:flex;\n","      gap: 12px;\n","    }\n","\n","    .colab-df-convert {\n","      background-color: #E8F0FE;\n","      border: none;\n","      border-radius: 50%;\n","      cursor: pointer;\n","      display: none;\n","      fill: #1967D2;\n","      height: 32px;\n","      padding: 0 0 0 0;\n","      width: 32px;\n","    }\n","\n","    .colab-df-convert:hover {\n","      background-color: #E2EBFA;\n","      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n","      fill: #174EA6;\n","    }\n","\n","    .colab-df-buttons div {\n","      margin-bottom: 4px;\n","    }\n","\n","    [theme=dark] .colab-df-convert {\n","      background-color: #3B4455;\n","      fill: #D2E3FC;\n","    }\n","\n","    [theme=dark] .colab-df-convert:hover {\n","      background-color: #434B5C;\n","      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n","      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n","      fill: #FFFFFF;\n","    }\n","  </style>\n","\n","    <script>\n","      const buttonEl =\n","        document.querySelector('#df-e00bd3fe-8747-4b03-a809-c7b0b2209ace button.colab-df-convert');\n","      buttonEl.style.display =\n","        google.colab.kernel.accessAllowed ? 'block' : 'none';\n","\n","      async function convertToInteractive(key) {\n","        const element = document.querySelector('#df-e00bd3fe-8747-4b03-a809-c7b0b2209ace');\n","        const dataTable =\n","          await google.colab.kernel.invokeFunction('convertToInteractive',\n","                                                    [key], {});\n","        if (!dataTable) return;\n","\n","        const docLinkHtml = 'Like what you see? Visit the ' +\n","          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n","          + ' to learn more about interactive tables.';\n","        element.innerHTML = '';\n","        dataTable['output_type'] = 'display_data';\n","        await google.colab.output.renderOutput(dataTable, element);\n","        const docLink = document.createElement('div');\n","        docLink.innerHTML = docLinkHtml;\n","        element.appendChild(docLink);\n","      }\n","    </script>\n","  </div>\n","\n","\n","<div id=\"df-9e9af8fa-7459-448b-8d7c-f69c12def47f\">\n","  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-9e9af8fa-7459-448b-8d7c-f69c12def47f')\"\n","            title=\"Suggest charts.\"\n","            style=\"display:none;\">\n","\n","<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n","     width=\"24px\">\n","    <g>\n","        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n","    </g>\n","</svg>\n","  </button>\n","\n","<style>\n","  .colab-df-quickchart {\n","    background-color: #E8F0FE;\n","    border: none;\n","    border-radius: 50%;\n","    cursor: pointer;\n","    display: none;\n","    fill: #1967D2;\n","    height: 32px;\n","    padding: 0 0 0 0;\n","    width: 32px;\n","  }\n","\n","  .colab-df-quickchart:hover {\n","    background-color: #E2EBFA;\n","    box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n","    fill: #174EA6;\n","  }\n","\n","  [theme=dark] .colab-df-quickchart {\n","    background-color: #3B4455;\n","    fill: #D2E3FC;\n","  }\n","\n","  [theme=dark] .colab-df-quickchart:hover {\n","    background-color: #434B5C;\n","    box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n","    filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n","    fill: #FFFFFF;\n","  }\n","</style>\n","\n","  <script>\n","    async function quickchart(key) {\n","      const charts = await google.colab.kernel.invokeFunction(\n","          'suggestCharts', [key], {});\n","    }\n","    (() => {\n","      let quickchartButtonEl =\n","        document.querySelector('#df-9e9af8fa-7459-448b-8d7c-f69c12def47f button');\n","      quickchartButtonEl.style.display =\n","        google.colab.kernel.accessAllowed ? 'block' : 'none';\n","    })();\n","  </script>\n","</div>\n","    </div>\n","  </div>\n"]},"metadata":{},"execution_count":11}]},{"cell_type":"code","source":["#makes a catalogue from megacatalogue of where 'ruler' is identified and drops any all NaN columns.\n","rulercatalogue = datemegacat[~datemegacat['ruler'].isna()]\n","rulercatalogue = rulercatalogue.dropna(axis='columns', how='all', inplace=False)\n","print(rulercatalogue.shape)\n","rulercatalogue.head(10)"],"metadata":{"colab":{"base_uri":"https://localhost:8080/","height":1000},"id":"n4Zyr0-OsuLY","executionInfo":{"status":"ok","timestamp":1692899151912,"user_tz":420,"elapsed":6,"user":{"displayName":"Melinee Her","userId":"06864672402504422512"}},"outputId":"003e34db-8b86-478d-dbfe-c1a47fd42909"},"execution_count":null,"outputs":[{"output_type":"stream","name":"stdout","text":["(25158, 17)\n"]},{"output_type":"execute_result","data":{"text/plain":["     id_text            ruler          year month  day              eponym  \\\n","2    P522594     Ashurbanipal           650   VII   01  Bēl-Harrān-šaddû’a   \n","3    P522595     Ashurbanipal           650   VII   01  Bēl-Harrān-šaddû’a   \n","5    P522597     Ashurbanipal          640*    IX  NaN  Šarru-mētu-uballiṭ   \n","12   P522604     Ashurbanipal          643*    II   21    Aššur-šarru-uṣur   \n","13   P522605     Ashurbanipal           658    XI   07          Ša-Nabû-šû   \n","14   P522606      Sennacherib           683     X   01       Mannu-kī-Adad   \n","18   P522610     Ashurbanipal           649   III   02           Ahu-ilā’ī   \n","819  P223391        uncertain           NaN   NaN  NaN                 NaN   \n","820  P250657       Esarhaddon           684   III   11            Manzernê   \n","821  P250905  Sîn-šarru-iškun  621* or 619*    II   26                 NaN   \n","\n","       regnal_dates              provenience eponym_title  proposed_date  \\\n","2    668–ca. 631 BC  Tell Ahmar (Til Barsip)          NaN            NaN   \n","3    668–ca. 631 BC  Tell Ahmar (Til Barsip)          NaN            NaN   \n","5    668–ca. 631 BC  Tell Ahmar (Til Barsip)          NaN            NaN   \n","12   668–ca. 631 BC  Tell Ahmar (Til Barsip)          NaN            NaN   \n","13   668–ca. 631 BC  Tell Ahmar (Til Barsip)          NaN            NaN   \n","14       704–681 BC  Tell Ahmar (Til Barsip)          NaN            NaN   \n","18   668–ca. 631 BC  Tell Ahmar (Til Barsip)          NaN            NaN   \n","819             NaN    Qalat Sherqat (Assur)          NaN  (7th century)   \n","820      680–669 BC    Qalat Sherqat (Assur)          NaN            NaN   \n","821  ca. 626–612 BC    Qalat Sherqat (Assur)          NaN            NaN   \n","\n","                         date                                date_of_origin  \\\n","2                  650-VII-01   Assurbanipal.limu Bel-Harran-shaddu’a.07.01   \n","3                  650-VII-01   Assurbanipal.limu Bel-Harran-shaddu’a.07.01   \n","5                     640*-IX  Assurbanipal.limu Shamash-metu-uballit.09.00   \n","12                 643*-II-21     Assurbanipal.limu Assur-sharru-usur.02.21   \n","13                  658-XI-07          Assurbanipal.limu Sha-Nabu-shu.11.07   \n","14                   683-X-01          Sennacherib.limu Mannu-ki-Adad.10.01   \n","18                 649-III-02             Assurbanipal.limu Ahu-ila’i.03.02   \n","819                       NaN                                  00.000.00.00   \n","820                684-III-11                Esarhaddon.limu Manzerne.03.11   \n","821  621*-II-26 or 619*-II-26                   Sin-sharru-ishkun.000.02.26   \n","\n","                                             long_date            date_gen  \\\n","2       Tašrītu 1[st], eponymy of Bēl-Harrān-šadd[û’a]          650-VII-01   \n","3         Tašrītu 1st, eponymy of Bēl-Harrān-šadd[û’a]          650-VII-01   \n","5    Kislīmu, eponymy after that of Aššur-garu’a-[n...             640*-IX   \n","12          Ayyāru 21st, eponymy of Šamaš-da[’’in]anni          643*-II-21   \n","13                   Šabāṭu 7th, eponymy of Ša-Nabû-šû           658-XI-07   \n","14                Kanūnu 1st, eponymy of Mannu-kī-Adad            683-X-01   \n","18   Simānu 2nd, eponymy after that of Bēl-Harrān-š...          649-III-02   \n","819                                                NaN                 NaN   \n","820  Simānu 11th, [eponymy of] Manzarnia, governor ...          684-III-11   \n","821                   Ayyāru 26th, eponymy of Bel-iqbi  621* or 619*-II-26   \n","\n","                                  long_date_gen astron_date dynastic_seat  \n","2    Tašrītu 1st, eponymy of Bēl-Harrān-šaddû’a         NaN           NaN  \n","3    Tašrītu 1st, eponymy of Bēl-Harrān-šaddû’a         NaN           NaN  \n","5        Kislīmu, eponymy of Šarru-mētu-uballiṭ         NaN           NaN  \n","12     Ayyāru 21st, eponymy of Aššur-šarru-uṣur         NaN           NaN  \n","13            Šabāṭu 7th, eponymy of Ša-Nabû-šû         NaN           NaN  \n","14         Kanūnu 1st, eponymy of Mannu-kī-Adad         NaN           NaN  \n","18             Simānu 2nd, eponymy of Ahu-ilā’ī         NaN           NaN  \n","819                                         NaN         NaN           NaN  \n","820            Simānu 11th, eponymy of Manzernê         NaN           NaN  \n","821                                 Ayyāru 26th         NaN           NaN  "],"text/html":["\n","  <div id=\"df-ef2e8bed-076d-4546-9a23-edb24869ffea\" class=\"colab-df-container\">\n","    <div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>id_text</th>\n","      <th>ruler</th>\n","      <th>year</th>\n","      <th>month</th>\n","      <th>day</th>\n","      <th>eponym</th>\n","      <th>regnal_dates</th>\n","      <th>provenience</th>\n","      <th>eponym_title</th>\n","      <th>proposed_date</th>\n","      <th>date</th>\n","      <th>date_of_origin</th>\n","      <th>long_date</th>\n","      <th>date_gen</th>\n","      <th>long_date_gen</th>\n","      <th>astron_date</th>\n","      <th>dynastic_seat</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>2</th>\n","      <td>P522594</td>\n","      <td>Ashurbanipal</td>\n","      <td>650</td>\n","      <td>VII</td>\n","      <td>01</td>\n","      <td>Bēl-Harrān-šaddû’a</td>\n","      <td>668–ca. 631 BC</td>\n","      <td>Tell Ahmar (Til Barsip)</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>650-VII-01</td>\n","      <td>Assurbanipal.limu Bel-Harran-shaddu’a.07.01</td>\n","      <td>Tašrītu 1[st], eponymy of Bēl-Harrān-šadd[û’a]</td>\n","      <td>650-VII-01</td>\n","      <td>Tašrītu 1st, eponymy of Bēl-Harrān-šaddû’a</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>3</th>\n","      <td>P522595</td>\n","      <td>Ashurbanipal</td>\n","      <td>650</td>\n","      <td>VII</td>\n","      <td>01</td>\n","      <td>Bēl-Harrān-šaddû’a</td>\n","      <td>668–ca. 631 BC</td>\n","      <td>Tell Ahmar (Til Barsip)</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>650-VII-01</td>\n","      <td>Assurbanipal.limu Bel-Harran-shaddu’a.07.01</td>\n","      <td>Tašrītu 1st, eponymy of Bēl-Harrān-šadd[û’a]</td>\n","      <td>650-VII-01</td>\n","      <td>Tašrītu 1st, eponymy of Bēl-Harrān-šaddû’a</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>5</th>\n","      <td>P522597</td>\n","      <td>Ashurbanipal</td>\n","      <td>640*</td>\n","      <td>IX</td>\n","      <td>NaN</td>\n","      <td>Šarru-mētu-uballiṭ</td>\n","      <td>668–ca. 631 BC</td>\n","      <td>Tell Ahmar (Til Barsip)</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>640*-IX</td>\n","      <td>Assurbanipal.limu Shamash-metu-uballit.09.00</td>\n","      <td>Kislīmu, eponymy after that of Aššur-garu’a-[n...</td>\n","      <td>640*-IX</td>\n","      <td>Kislīmu, eponymy of Šarru-mētu-uballiṭ</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>12</th>\n","      <td>P522604</td>\n","      <td>Ashurbanipal</td>\n","      <td>643*</td>\n","      <td>II</td>\n","      <td>21</td>\n","      <td>Aššur-šarru-uṣur</td>\n","      <td>668–ca. 631 BC</td>\n","      <td>Tell Ahmar (Til Barsip)</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>643*-II-21</td>\n","      <td>Assurbanipal.limu Assur-sharru-usur.02.21</td>\n","      <td>Ayyāru 21st, eponymy of Šamaš-da[’’in]anni</td>\n","      <td>643*-II-21</td>\n","      <td>Ayyāru 21st, eponymy of Aššur-šarru-uṣur</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>13</th>\n","      <td>P522605</td>\n","      <td>Ashurbanipal</td>\n","      <td>658</td>\n","      <td>XI</td>\n","      <td>07</td>\n","      <td>Ša-Nabû-šû</td>\n","      <td>668–ca. 631 BC</td>\n","      <td>Tell Ahmar (Til Barsip)</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>658-XI-07</td>\n","      <td>Assurbanipal.limu Sha-Nabu-shu.11.07</td>\n","      <td>Šabāṭu 7th, eponymy of Ša-Nabû-šû</td>\n","      <td>658-XI-07</td>\n","      <td>Šabāṭu 7th, eponymy of Ša-Nabû-šû</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>14</th>\n","      <td>P522606</td>\n","      <td>Sennacherib</td>\n","      <td>683</td>\n","      <td>X</td>\n","      <td>01</td>\n","      <td>Mannu-kī-Adad</td>\n","      <td>704–681 BC</td>\n","      <td>Tell Ahmar (Til Barsip)</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>683-X-01</td>\n","      <td>Sennacherib.limu Mannu-ki-Adad.10.01</td>\n","      <td>Kanūnu 1st, eponymy of Mannu-kī-Adad</td>\n","      <td>683-X-01</td>\n","      <td>Kanūnu 1st, eponymy of Mannu-kī-Adad</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>18</th>\n","      <td>P522610</td>\n","      <td>Ashurbanipal</td>\n","      <td>649</td>\n","      <td>III</td>\n","      <td>02</td>\n","      <td>Ahu-ilā’ī</td>\n","      <td>668–ca. 631 BC</td>\n","      <td>Tell Ahmar (Til Barsip)</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>649-III-02</td>\n","      <td>Assurbanipal.limu Ahu-ila’i.03.02</td>\n","      <td>Simānu 2nd, eponymy after that of Bēl-Harrān-š...</td>\n","      <td>649-III-02</td>\n","      <td>Simānu 2nd, eponymy of Ahu-ilā’ī</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>819</th>\n","      <td>P223391</td>\n","      <td>uncertain</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>Qalat Sherqat (Assur)</td>\n","      <td>NaN</td>\n","      <td>(7th century)</td>\n","      <td>NaN</td>\n","      <td>00.000.00.00</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>820</th>\n","      <td>P250657</td>\n","      <td>Esarhaddon</td>\n","      <td>684</td>\n","      <td>III</td>\n","      <td>11</td>\n","      <td>Manzernê</td>\n","      <td>680–669 BC</td>\n","      <td>Qalat Sherqat (Assur)</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>684-III-11</td>\n","      <td>Esarhaddon.limu Manzerne.03.11</td>\n","      <td>Simānu 11th, [eponymy of] Manzarnia, governor ...</td>\n","      <td>684-III-11</td>\n","      <td>Simānu 11th, eponymy of Manzernê</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>821</th>\n","      <td>P250905</td>\n","      <td>Sîn-šarru-iškun</td>\n","      <td>621* or 619*</td>\n","      <td>II</td>\n","      <td>26</td>\n","      <td>NaN</td>\n","      <td>ca. 626–612 BC</td>\n","      <td>Qalat Sherqat (Assur)</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>621*-II-26 or 619*-II-26</td>\n","      <td>Sin-sharru-ishkun.000.02.26</td>\n","      <td>Ayyāru 26th, eponymy of Bel-iqbi</td>\n","      <td>621* or 619*-II-26</td>\n","      <td>Ayyāru 26th</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>\n","    <div class=\"colab-df-buttons\">\n","\n","  <div class=\"colab-df-container\">\n","    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-ef2e8bed-076d-4546-9a23-edb24869ffea')\"\n","            title=\"Convert this dataframe to an interactive table.\"\n","            style=\"display:none;\">\n","\n","  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n","    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n","  </svg>\n","    </button>\n","\n","  <style>\n","    .colab-df-container {\n","      display:flex;\n","      gap: 12px;\n","    }\n","\n","    .colab-df-convert {\n","      background-color: #E8F0FE;\n","      border: none;\n","      border-radius: 50%;\n","      cursor: pointer;\n","      display: none;\n","      fill: #1967D2;\n","      height: 32px;\n","      padding: 0 0 0 0;\n","      width: 32px;\n","    }\n","\n","    .colab-df-convert:hover {\n","      background-color: #E2EBFA;\n","      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n","      fill: #174EA6;\n","    }\n","\n","    .colab-df-buttons div {\n","      margin-bottom: 4px;\n","    }\n","\n","    [theme=dark] .colab-df-convert {\n","      background-color: #3B4455;\n","      fill: #D2E3FC;\n","    }\n","\n","    [theme=dark] .colab-df-convert:hover {\n","      background-color: #434B5C;\n","      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n","      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n","      fill: #FFFFFF;\n","    }\n","  </style>\n","\n","    <script>\n","      const buttonEl =\n","        document.querySelector('#df-ef2e8bed-076d-4546-9a23-edb24869ffea button.colab-df-convert');\n","      buttonEl.style.display =\n","        google.colab.kernel.accessAllowed ? 'block' : 'none';\n","\n","      async function convertToInteractive(key) {\n","        const element = document.querySelector('#df-ef2e8bed-076d-4546-9a23-edb24869ffea');\n","        const dataTable =\n","          await google.colab.kernel.invokeFunction('convertToInteractive',\n","                                                    [key], {});\n","        if (!dataTable) return;\n","\n","        const docLinkHtml = 'Like what you see? Visit the ' +\n","          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n","          + ' to learn more about interactive tables.';\n","        element.innerHTML = '';\n","        dataTable['output_type'] = 'display_data';\n","        await google.colab.output.renderOutput(dataTable, element);\n","        const docLink = document.createElement('div');\n","        docLink.innerHTML = docLinkHtml;\n","        element.appendChild(docLink);\n","      }\n","    </script>\n","  </div>\n","\n","\n","<div id=\"df-3bb1bd12-1b68-4bb5-b804-9e1502815a70\">\n","  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-3bb1bd12-1b68-4bb5-b804-9e1502815a70')\"\n","            title=\"Suggest charts.\"\n","            style=\"display:none;\">\n","\n","<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n","     width=\"24px\">\n","    <g>\n","        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n","    </g>\n","</svg>\n","  </button>\n","\n","<style>\n","  .colab-df-quickchart {\n","    background-color: #E8F0FE;\n","    border: none;\n","    border-radius: 50%;\n","    cursor: pointer;\n","    display: none;\n","    fill: #1967D2;\n","    height: 32px;\n","    padding: 0 0 0 0;\n","    width: 32px;\n","  }\n","\n","  .colab-df-quickchart:hover {\n","    background-color: #E2EBFA;\n","    box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n","    fill: #174EA6;\n","  }\n","\n","  [theme=dark] .colab-df-quickchart {\n","    background-color: #3B4455;\n","    fill: #D2E3FC;\n","  }\n","\n","  [theme=dark] .colab-df-quickchart:hover {\n","    background-color: #434B5C;\n","    box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n","    filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n","    fill: #FFFFFF;\n","  }\n","</style>\n","\n","  <script>\n","    async function quickchart(key) {\n","      const charts = await google.colab.kernel.invokeFunction(\n","          'suggestCharts', [key], {});\n","    }\n","    (() => {\n","      let quickchartButtonEl =\n","        document.querySelector('#df-3bb1bd12-1b68-4bb5-b804-9e1502815a70 button');\n","      quickchartButtonEl.style.display =\n","        google.colab.kernel.accessAllowed ? 'block' : 'none';\n","    })();\n","  </script>\n","</div>\n","    </div>\n","  </div>\n"]},"metadata":{},"execution_count":13}]},{"cell_type":"code","source":["#Notice that there are rulers under \"uncertain\", should we remove this?\n","#Here's a closer look at the uncertain rulers\n","uncertains = rulercatalogue[rulercatalogue['ruler'].str.contains('uncertain')]\n","uncertains.head(10)"],"metadata":{"colab":{"base_uri":"https://localhost:8080/","height":556},"id":"crCJDZgU3P0r","executionInfo":{"status":"ok","timestamp":1692899154657,"user_tz":420,"elapsed":317,"user":{"displayName":"Melinee Her","userId":"06864672402504422512"}},"outputId":"a3531618-4ac3-4921-d966-cb98a91a520e"},"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/plain":["     id_text      ruler year month  day eponym regnal_dates  \\\n","819  P223391  uncertain  NaN   NaN  NaN    NaN          NaN   \n","824  P282261  uncertain  NaN   NaN  NaN    NaN          NaN   \n","825  P282609  uncertain  NaN   NaN  NaN    NaN          NaN   \n","826  P282610  uncertain  NaN   NaN  NaN    NaN          NaN   \n","827  P285502  uncertain  NaN   NaN  NaN    NaN          NaN   \n","828  P285503  uncertain  NaN   NaN  NaN    NaN          NaN   \n","830  P285525  uncertain  NaN   NaN  NaN    NaN          NaN   \n","832  P285555  uncertain  NaN   NaN  NaN    NaN          NaN   \n","843  P336141  uncertain  NaN   NaN  NaN    NaN          NaN   \n","844  P336142  uncertain  NaN   NaN  NaN    NaN          NaN   \n","\n","               provenience eponym_title      proposed_date     date  \\\n","819  Qalat Sherqat (Assur)          NaN      (7th century)      NaN   \n","824  Qalat Sherqat (Assur)          NaN      (7th century)      NaN   \n","825  Qalat Sherqat (Assur)          NaN  (9th-7th century)      NaN   \n","826  Qalat Sherqat (Assur)          NaN      (7th century)      NaN   \n","827  Qalat Sherqat (Assur)          NaN          (719-662)  719-662   \n","828  Qalat Sherqat (Assur)          NaN          (872-659)  872-659   \n","830  Qalat Sherqat (Assur)          NaN      (7th century)      NaN   \n","832  Qalat Sherqat (Assur)          NaN      (8th century)      NaN   \n","843  Qalat Sherqat (Assur)          NaN  (9th-7th century)      NaN   \n","844  Qalat Sherqat (Assur)          NaN      (7th century)      NaN   \n","\n","    date_of_origin long_date date_gen long_date_gen astron_date dynastic_seat  \n","819   00.000.00.00       NaN      NaN           NaN         NaN           NaN  \n","824   00.000.00.00       NaN      NaN           NaN         NaN           NaN  \n","825   00.000.00.00       NaN      NaN           NaN         NaN           NaN  \n","826   00.000.00.00       NaN      NaN           NaN         NaN           NaN  \n","827   00.000.00.00       NaN      NaN           NaN         NaN           NaN  \n","828   00.000.00.00       NaN      NaN           NaN         NaN           NaN  \n","830   00.000.00.00       NaN      NaN           NaN         NaN           NaN  \n","832   00.000.00.00       NaN      NaN           NaN         NaN           NaN  \n","843   00.000.00.00       NaN      NaN           NaN         NaN           NaN  \n","844   00.000.00.00       NaN      NaN           NaN         NaN           NaN  "],"text/html":["\n","  <div id=\"df-b0c41f20-20e1-4c4b-882d-80b3140196e5\" class=\"colab-df-container\">\n","    <div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>id_text</th>\n","      <th>ruler</th>\n","      <th>year</th>\n","      <th>month</th>\n","      <th>day</th>\n","      <th>eponym</th>\n","      <th>regnal_dates</th>\n","      <th>provenience</th>\n","      <th>eponym_title</th>\n","      <th>proposed_date</th>\n","      <th>date</th>\n","      <th>date_of_origin</th>\n","      <th>long_date</th>\n","      <th>date_gen</th>\n","      <th>long_date_gen</th>\n","      <th>astron_date</th>\n","      <th>dynastic_seat</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>819</th>\n","      <td>P223391</td>\n","      <td>uncertain</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>Qalat Sherqat (Assur)</td>\n","      <td>NaN</td>\n","      <td>(7th century)</td>\n","      <td>NaN</td>\n","      <td>00.000.00.00</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>824</th>\n","      <td>P282261</td>\n","      <td>uncertain</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>Qalat Sherqat (Assur)</td>\n","      <td>NaN</td>\n","      <td>(7th century)</td>\n","      <td>NaN</td>\n","      <td>00.000.00.00</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>825</th>\n","      <td>P282609</td>\n","      <td>uncertain</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>Qalat Sherqat (Assur)</td>\n","      <td>NaN</td>\n","      <td>(9th-7th century)</td>\n","      <td>NaN</td>\n","      <td>00.000.00.00</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>826</th>\n","      <td>P282610</td>\n","      <td>uncertain</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>Qalat Sherqat (Assur)</td>\n","      <td>NaN</td>\n","      <td>(7th century)</td>\n","      <td>NaN</td>\n","      <td>00.000.00.00</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>827</th>\n","      <td>P285502</td>\n","      <td>uncertain</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>Qalat Sherqat (Assur)</td>\n","      <td>NaN</td>\n","      <td>(719-662)</td>\n","      <td>719-662</td>\n","      <td>00.000.00.00</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>828</th>\n","      <td>P285503</td>\n","      <td>uncertain</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>Qalat Sherqat (Assur)</td>\n","      <td>NaN</td>\n","      <td>(872-659)</td>\n","      <td>872-659</td>\n","      <td>00.000.00.00</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>830</th>\n","      <td>P285525</td>\n","      <td>uncertain</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>Qalat Sherqat (Assur)</td>\n","      <td>NaN</td>\n","      <td>(7th century)</td>\n","      <td>NaN</td>\n","      <td>00.000.00.00</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>832</th>\n","      <td>P285555</td>\n","      <td>uncertain</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>Qalat Sherqat (Assur)</td>\n","      <td>NaN</td>\n","      <td>(8th century)</td>\n","      <td>NaN</td>\n","      <td>00.000.00.00</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>843</th>\n","      <td>P336141</td>\n","      <td>uncertain</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>Qalat Sherqat (Assur)</td>\n","      <td>NaN</td>\n","      <td>(9th-7th century)</td>\n","      <td>NaN</td>\n","      <td>00.000.00.00</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>844</th>\n","      <td>P336142</td>\n","      <td>uncertain</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>Qalat Sherqat (Assur)</td>\n","      <td>NaN</td>\n","      <td>(7th century)</td>\n","      <td>NaN</td>\n","      <td>00.000.00.00</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>\n","    <div class=\"colab-df-buttons\">\n","\n","  <div class=\"colab-df-container\">\n","    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-b0c41f20-20e1-4c4b-882d-80b3140196e5')\"\n","            title=\"Convert this dataframe to an interactive table.\"\n","            style=\"display:none;\">\n","\n","  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n","    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n","  </svg>\n","    </button>\n","\n","  <style>\n","    .colab-df-container {\n","      display:flex;\n","      gap: 12px;\n","    }\n","\n","    .colab-df-convert {\n","      background-color: #E8F0FE;\n","      border: none;\n","      border-radius: 50%;\n","      cursor: pointer;\n","      display: none;\n","      fill: #1967D2;\n","      height: 32px;\n","      padding: 0 0 0 0;\n","      width: 32px;\n","    }\n","\n","    .colab-df-convert:hover {\n","      background-color: #E2EBFA;\n","      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n","      fill: #174EA6;\n","    }\n","\n","    .colab-df-buttons div {\n","      margin-bottom: 4px;\n","    }\n","\n","    [theme=dark] .colab-df-convert {\n","      background-color: #3B4455;\n","      fill: #D2E3FC;\n","    }\n","\n","    [theme=dark] .colab-df-convert:hover {\n","      background-color: #434B5C;\n","      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n","      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n","      fill: #FFFFFF;\n","    }\n","  </style>\n","\n","    <script>\n","      const buttonEl =\n","        document.querySelector('#df-b0c41f20-20e1-4c4b-882d-80b3140196e5 button.colab-df-convert');\n","      buttonEl.style.display =\n","        google.colab.kernel.accessAllowed ? 'block' : 'none';\n","\n","      async function convertToInteractive(key) {\n","        const element = document.querySelector('#df-b0c41f20-20e1-4c4b-882d-80b3140196e5');\n","        const dataTable =\n","          await google.colab.kernel.invokeFunction('convertToInteractive',\n","                                                    [key], {});\n","        if (!dataTable) return;\n","\n","        const docLinkHtml = 'Like what you see? Visit the ' +\n","          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n","          + ' to learn more about interactive tables.';\n","        element.innerHTML = '';\n","        dataTable['output_type'] = 'display_data';\n","        await google.colab.output.renderOutput(dataTable, element);\n","        const docLink = document.createElement('div');\n","        docLink.innerHTML = docLinkHtml;\n","        element.appendChild(docLink);\n","      }\n","    </script>\n","  </div>\n","\n","\n","<div id=\"df-f534aab4-0e3c-4390-8cb1-c35f86cce84f\">\n","  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-f534aab4-0e3c-4390-8cb1-c35f86cce84f')\"\n","            title=\"Suggest charts.\"\n","            style=\"display:none;\">\n","\n","<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n","     width=\"24px\">\n","    <g>\n","        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n","    </g>\n","</svg>\n","  </button>\n","\n","<style>\n","  .colab-df-quickchart {\n","    background-color: #E8F0FE;\n","    border: none;\n","    border-radius: 50%;\n","    cursor: pointer;\n","    display: none;\n","    fill: #1967D2;\n","    height: 32px;\n","    padding: 0 0 0 0;\n","    width: 32px;\n","  }\n","\n","  .colab-df-quickchart:hover {\n","    background-color: #E2EBFA;\n","    box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n","    fill: #174EA6;\n","  }\n","\n","  [theme=dark] .colab-df-quickchart {\n","    background-color: #3B4455;\n","    fill: #D2E3FC;\n","  }\n","\n","  [theme=dark] .colab-df-quickchart:hover {\n","    background-color: #434B5C;\n","    box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n","    filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n","    fill: #FFFFFF;\n","  }\n","</style>\n","\n","  <script>\n","    async function quickchart(key) {\n","      const charts = await google.colab.kernel.invokeFunction(\n","          'suggestCharts', [key], {});\n","    }\n","    (() => {\n","      let quickchartButtonEl =\n","        document.querySelector('#df-f534aab4-0e3c-4390-8cb1-c35f86cce84f button');\n","      quickchartButtonEl.style.display =\n","        google.colab.kernel.accessAllowed ? 'block' : 'none';\n","    })();\n","  </script>\n","</div>\n","    </div>\n","  </div>\n"]},"metadata":{},"execution_count":14}]},{"cell_type":"code","source":["#Sorting the rulercatalogue by year ascending\n","sorted = rulercatalogue.sort_values(by='year', ascending=True)\n","sorted"],"metadata":{"colab":{"base_uri":"https://localhost:8080/","height":704},"id":"2xq4ULuy3lHg","executionInfo":{"status":"ok","timestamp":1692899156803,"user_tz":420,"elapsed":288,"user":{"displayName":"Melinee Her","userId":"06864672402504422512"}},"outputId":"3ae35108-c74f-4a91-e56b-d24a1f2ab55c"},"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/plain":["        id_text              ruler  year month  day           eponym  \\\n","28835   P527165  Nebuchadnezzar II   600     I   10              NaN   \n","28834   P527164  Nebuchadnezzar II   603   XII  NaN              NaN   \n","28833   P527163  Nebuchadnezzar II   603    XI   10              NaN   \n","28832   P527162  Nebuchadnezzar II   603  VIII  NaN              NaN   \n","28526   P527428   Aššur-uballiṭ II  610*  VIII   15  Nabû-šarru-uṣur   \n","...         ...                ...   ...   ...  ...              ...   \n","169218  Q004773    Adad-nerari III   NaN   NaN  NaN              NaN   \n","169219  Q004774    Adad-nerari III   NaN   NaN  NaN              NaN   \n","169220  Q004775    Adad-nerari III   NaN   NaN  NaN              NaN   \n","169221  Q004776    Adad-nerari III   NaN   NaN  NaN              NaN   \n","169222  Q004777    Adad-nerari III   NaN   NaN  NaN              NaN   \n","\n","       regnal_dates                       provenience eponym_title  \\\n","28835           NaN  Tell Sheikh Hamad (Dur-Katlimmu)          NaN   \n","28834           NaN  Tell Sheikh Hamad (Dur-Katlimmu)          NaN   \n","28833           NaN  Tell Sheikh Hamad (Dur-Katlimmu)          NaN   \n","28832           NaN  Tell Sheikh Hamad (Dur-Katlimmu)          NaN   \n","28526           NaN               Tell Halaf (Guzana)          NaN   \n","...             ...                               ...          ...   \n","169218          NaN                               NaN          NaN   \n","169219          NaN                               NaN          NaN   \n","169220          NaN                               NaN          NaN   \n","169221          NaN                               NaN          NaN   \n","169222          NaN                               NaN          NaN   \n","\n","       proposed_date           date                  date_of_origin  \\\n","28835            NaN       600-I-10           Nebuchadnezzar2.01.10   \n","28834            NaN  603-XII-[...]           Nebuchadnezzar2.12.00   \n","28833            NaN      603-XI-10           Nebuchadnezzar2.11.10   \n","28832            NaN       603-VIII           Nebuchadnezzar2.08.00   \n","28526            NaN   610*-VIII-15  00.limu Nabu-sharru-usur.08.15   \n","...              ...            ...                             ...   \n","169218           NaN            NaN                             NaN   \n","169219           NaN            NaN                             NaN   \n","169220           NaN            NaN                             NaN   \n","169221           NaN            NaN                             NaN   \n","169222           NaN            NaN                             NaN   \n","\n","                                                long_date      date_gen  \\\n","28835   Nisannu 10th, year 5 of Nebuchadnezzar (II), k...      600-I-10   \n","28834   Addaru, year 2 of Nebuchadnezzar (II), king of...       603-XII   \n","28833   Šabāṭu 10th, year 2 of Nebuchadnezzar (II), ki...     603-XI-10   \n","28832   Arahsamna, year 2 of Nebuchadnezzar (II), king...      603-VIII   \n","28526   Arahsamna 15th, eponymy of Nabû-šarru-uṣur, ch...  610*-VIII-15   \n","...                                                   ...           ...   \n","169218                                                NaN           NaN   \n","169219                                                NaN           NaN   \n","169220                                                NaN           NaN   \n","169221                                                NaN           NaN   \n","169222                                                NaN           NaN   \n","\n","                                     long_date_gen astron_date dynastic_seat  \n","28835                                 Nisannu 10th         NaN           NaN  \n","28834                                       Addaru         NaN           NaN  \n","28833                                  Šabāṭu 10th         NaN           NaN  \n","28832                                    Arahsamna         NaN           NaN  \n","28526   Arahsamna 15th, eponymy of Nabû-šarru-uṣur         NaN           NaN  \n","...                                            ...         ...           ...  \n","169218                                         NaN         NaN           NaN  \n","169219                                         NaN         NaN           NaN  \n","169220                                         NaN         NaN           NaN  \n","169221                                         NaN         NaN           NaN  \n","169222                                         NaN         NaN           NaN  \n","\n","[25158 rows x 17 columns]"],"text/html":["\n","  <div id=\"df-acaf6b21-a8a5-4971-b2d4-84b820832274\" class=\"colab-df-container\">\n","    <div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>id_text</th>\n","      <th>ruler</th>\n","      <th>year</th>\n","      <th>month</th>\n","      <th>day</th>\n","      <th>eponym</th>\n","      <th>regnal_dates</th>\n","      <th>provenience</th>\n","      <th>eponym_title</th>\n","      <th>proposed_date</th>\n","      <th>date</th>\n","      <th>date_of_origin</th>\n","      <th>long_date</th>\n","      <th>date_gen</th>\n","      <th>long_date_gen</th>\n","      <th>astron_date</th>\n","      <th>dynastic_seat</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>28835</th>\n","      <td>P527165</td>\n","      <td>Nebuchadnezzar II</td>\n","      <td>600</td>\n","      <td>I</td>\n","      <td>10</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>Tell Sheikh Hamad (Dur-Katlimmu)</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>600-I-10</td>\n","      <td>Nebuchadnezzar2.01.10</td>\n","      <td>Nisannu 10th, year 5 of Nebuchadnezzar (II), k...</td>\n","      <td>600-I-10</td>\n","      <td>Nisannu 10th</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>28834</th>\n","      <td>P527164</td>\n","      <td>Nebuchadnezzar II</td>\n","      <td>603</td>\n","      <td>XII</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>Tell Sheikh Hamad (Dur-Katlimmu)</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>603-XII-[...]</td>\n","      <td>Nebuchadnezzar2.12.00</td>\n","      <td>Addaru, year 2 of Nebuchadnezzar (II), king of...</td>\n","      <td>603-XII</td>\n","      <td>Addaru</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>28833</th>\n","      <td>P527163</td>\n","      <td>Nebuchadnezzar II</td>\n","      <td>603</td>\n","      <td>XI</td>\n","      <td>10</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>Tell Sheikh Hamad (Dur-Katlimmu)</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>603-XI-10</td>\n","      <td>Nebuchadnezzar2.11.10</td>\n","      <td>Šabāṭu 10th, year 2 of Nebuchadnezzar (II), ki...</td>\n","      <td>603-XI-10</td>\n","      <td>Šabāṭu 10th</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>28832</th>\n","      <td>P527162</td>\n","      <td>Nebuchadnezzar II</td>\n","      <td>603</td>\n","      <td>VIII</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>Tell Sheikh Hamad (Dur-Katlimmu)</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>603-VIII</td>\n","      <td>Nebuchadnezzar2.08.00</td>\n","      <td>Arahsamna, year 2 of Nebuchadnezzar (II), king...</td>\n","      <td>603-VIII</td>\n","      <td>Arahsamna</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>28526</th>\n","      <td>P527428</td>\n","      <td>Aššur-uballiṭ II</td>\n","      <td>610*</td>\n","      <td>VIII</td>\n","      <td>15</td>\n","      <td>Nabû-šarru-uṣur</td>\n","      <td>NaN</td>\n","      <td>Tell Halaf (Guzana)</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>610*-VIII-15</td>\n","      <td>00.limu Nabu-sharru-usur.08.15</td>\n","      <td>Arahsamna 15th, eponymy of Nabû-šarru-uṣur, ch...</td>\n","      <td>610*-VIII-15</td>\n","      <td>Arahsamna 15th, eponymy of Nabû-šarru-uṣur</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>...</th>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","    </tr>\n","    <tr>\n","      <th>169218</th>\n","      <td>Q004773</td>\n","      <td>Adad-nerari III</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>169219</th>\n","      <td>Q004774</td>\n","      <td>Adad-nerari III</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>169220</th>\n","      <td>Q004775</td>\n","      <td>Adad-nerari III</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>169221</th>\n","      <td>Q004776</td>\n","      <td>Adad-nerari III</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","    <tr>\n","      <th>169222</th>\n","      <td>Q004777</td>\n","      <td>Adad-nerari III</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","      <td>NaN</td>\n","    </tr>\n","  </tbody>\n","</table>\n","<p>25158 rows × 17 columns</p>\n","</div>\n","    <div class=\"colab-df-buttons\">\n","\n","  <div class=\"colab-df-container\">\n","    <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-acaf6b21-a8a5-4971-b2d4-84b820832274')\"\n","            title=\"Convert this dataframe to an interactive table.\"\n","            style=\"display:none;\">\n","\n","  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\" viewBox=\"0 -960 960 960\">\n","    <path d=\"M120-120v-720h720v720H120Zm60-500h600v-160H180v160Zm220 220h160v-160H400v160Zm0 220h160v-160H400v160ZM180-400h160v-160H180v160Zm440 0h160v-160H620v160ZM180-180h160v-160H180v160Zm440 0h160v-160H620v160Z\"/>\n","  </svg>\n","    </button>\n","\n","  <style>\n","    .colab-df-container {\n","      display:flex;\n","      gap: 12px;\n","    }\n","\n","    .colab-df-convert {\n","      background-color: #E8F0FE;\n","      border: none;\n","      border-radius: 50%;\n","      cursor: pointer;\n","      display: none;\n","      fill: #1967D2;\n","      height: 32px;\n","      padding: 0 0 0 0;\n","      width: 32px;\n","    }\n","\n","    .colab-df-convert:hover {\n","      background-color: #E2EBFA;\n","      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n","      fill: #174EA6;\n","    }\n","\n","    .colab-df-buttons div {\n","      margin-bottom: 4px;\n","    }\n","\n","    [theme=dark] .colab-df-convert {\n","      background-color: #3B4455;\n","      fill: #D2E3FC;\n","    }\n","\n","    [theme=dark] .colab-df-convert:hover {\n","      background-color: #434B5C;\n","      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n","      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n","      fill: #FFFFFF;\n","    }\n","  </style>\n","\n","    <script>\n","      const buttonEl =\n","        document.querySelector('#df-acaf6b21-a8a5-4971-b2d4-84b820832274 button.colab-df-convert');\n","      buttonEl.style.display =\n","        google.colab.kernel.accessAllowed ? 'block' : 'none';\n","\n","      async function convertToInteractive(key) {\n","        const element = document.querySelector('#df-acaf6b21-a8a5-4971-b2d4-84b820832274');\n","        const dataTable =\n","          await google.colab.kernel.invokeFunction('convertToInteractive',\n","                                                    [key], {});\n","        if (!dataTable) return;\n","\n","        const docLinkHtml = 'Like what you see? Visit the ' +\n","          '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n","          + ' to learn more about interactive tables.';\n","        element.innerHTML = '';\n","        dataTable['output_type'] = 'display_data';\n","        await google.colab.output.renderOutput(dataTable, element);\n","        const docLink = document.createElement('div');\n","        docLink.innerHTML = docLinkHtml;\n","        element.appendChild(docLink);\n","      }\n","    </script>\n","  </div>\n","\n","\n","<div id=\"df-b0f2483b-19d0-4804-8277-2fab4a7e7f06\">\n","  <button class=\"colab-df-quickchart\" onclick=\"quickchart('df-b0f2483b-19d0-4804-8277-2fab4a7e7f06')\"\n","            title=\"Suggest charts.\"\n","            style=\"display:none;\">\n","\n","<svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n","     width=\"24px\">\n","    <g>\n","        <path d=\"M19 3H5c-1.1 0-2 .9-2 2v14c0 1.1.9 2 2 2h14c1.1 0 2-.9 2-2V5c0-1.1-.9-2-2-2zM9 17H7v-7h2v7zm4 0h-2V7h2v10zm4 0h-2v-4h2v4z\"/>\n","    </g>\n","</svg>\n","  </button>\n","\n","<style>\n","  .colab-df-quickchart {\n","    background-color: #E8F0FE;\n","    border: none;\n","    border-radius: 50%;\n","    cursor: pointer;\n","    display: none;\n","    fill: #1967D2;\n","    height: 32px;\n","    padding: 0 0 0 0;\n","    width: 32px;\n","  }\n","\n","  .colab-df-quickchart:hover {\n","    background-color: #E2EBFA;\n","    box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n","    fill: #174EA6;\n","  }\n","\n","  [theme=dark] .colab-df-quickchart {\n","    background-color: #3B4455;\n","    fill: #D2E3FC;\n","  }\n","\n","  [theme=dark] .colab-df-quickchart:hover {\n","    background-color: #434B5C;\n","    box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n","    filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n","    fill: #FFFFFF;\n","  }\n","</style>\n","\n","  <script>\n","    async function quickchart(key) {\n","      const charts = await google.colab.kernel.invokeFunction(\n","          'suggestCharts', [key], {});\n","    }\n","    (() => {\n","      let quickchartButtonEl =\n","        document.querySelector('#df-b0f2483b-19d0-4804-8277-2fab4a7e7f06 button');\n","      quickchartButtonEl.style.display =\n","        google.colab.kernel.accessAllowed ? 'block' : 'none';\n","    })();\n","  </script>\n","</div>\n","    </div>\n","  </div>\n"]},"metadata":{},"execution_count":15}]},{"cell_type":"markdown","source":["We can see that there is a lot of missing data for year, month, and date, despite the ruler being identified in a given text. I think this data is stil useful because identifying rulers is important. However identifying their time period given just the refined ORACC data is not enough right now.\n","\n","For the \"uncertain\" rulers, most have a provenience and proposed date, and some have have date data not split into year, month, and date. This information may be useful if another datasource has similar information with a ruler identified / suspected."],"metadata":{"id":"9ieqK2pG4wj0"}},{"cell_type":"markdown","source":["##Exporting the rulercatalogue as a CSV file"],"metadata":{"id":"f_LnckwE20MX"}},{"cell_type":"code","source":["#exports ruler catalogue to the folder ORACC_DFS\n","rulercatalogue.to_csv(folder + 'ORACC_DFS/RulerCatalogue.csv')"],"metadata":{"id":"muigdl4O7SRa"},"execution_count":null,"outputs":[]},{"cell_type":"markdown","source":["End of Notebook."],"metadata":{"id":"cs3HMHotJODF"}}]}