1_production_databases/07_postgres_internals.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Optimizing Postgres Databases: Exploring Postgres Internals\n",
    "#### These are exercises done as part of <a href = \"www.dataquest.io\"> DataQuest</a>'s Data Engineer Path\n",
    "This is not replicated for commercial use; strictly personal development.<br>\n",
    "All exercises are (c) DataQuest, with slight modifications so they use my PostGres server on my localhost"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "> We learn about Postgres schemas and how to build a database description from scratch. Using internal tables, we were able to describe metadata associated with our Postgres database. The metadata included data types, table names, created schemas, and plenty of other useful information.\n",
    ">\n",
    ">DataQuest"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Exploring Postgres Internals Mission\n",
    "<b>1.  </b>Instructions:\n",
    "- Import the `psycopg2` library.\n",
    "- Connect to the `dq` database with the user `hud_admin` and the password `eRqg123EEkl` using the keyword arguments.\n",
    "- Use the `print` function to display the Connection object."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<connection object at 0x1061afe60; dsn: 'dbname=valenbisi2018 password=xxx user=stormadmin', closed: 0>\n"
     ]
    }
   ],
   "source": [
    "import psycopg2\n",
    "conn = psycopg2.connect(dbname=\"valenbisi2018\", user=\"stormadmin\", password=\"admin123\")\n",
    "print(conn)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<font color = 'blue'>This seems to let any user get into any db, and it allows any password to fly. Resources to fix this:</font><br>\n",
    "- https://stackoverflow.com/questions/21054549/postgres-accepts-any-password\n",
    "- https://dba.stackexchange.com/questions/17790/created-user-can-access-all-databases-in-postgresql-without-any-grants"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<b>2.  </b>Instructions:\n",
    "- Use the provided `cur` object.\n",
    "- Using the `SELECT` query, grab the `table_name` column from the `information_schema.tables` table with the `ORDER BY` option on the `table_name` column.\n",
    "- Fetch all the results and assign them to the variable `table_names`.\n",
    "- Loop through `table_names`:\n",
    "- Print each `table_name` from the query."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<font color = 'blue'>If you don't know the table names in your schema, you can fetch them by doing the following. Here is a list of tables in the `information_schema`:</font>\n",
    "\n",
    ">|Name|Data Type|Description|\n",
    ">|------|------|------|\n",
    "|`table_catalog`|`sql_identifier`|Name of the database that contains the table (always the current database)|\n",
    "|`table_schema`|`sql_identifier`|Name of the schema that contains the table|\n",
    "|`table_name`|`sql_identifier`|Name of the table|\n",
    "|`table_type`|`character_data`|Type of the table: BASE TABLE for a persistent base table (the normal table type), VIEW for a view, FOREIGN TABLE for a foreign table, or LOCAL TEMPORARY for a temporary table|\n",
    "|`self_referencing_column_name`|`sql_identifier`|Applies to a feature not available in PostgreSQL|\n",
    "|`reference_generation`|`character_data`|Applies to a feature not available in PostgreSQL|\n",
    "|`user_defined_type_catalog`|`sql_identifier`|If the table is a typed table, the name of the database that contains the underlying data type (always the current database), else null.|\n",
    "|`user_defined_type_schema`|`sql_identifier`|If the table is a typed table, the name of the schema that contains the underlying data type, else null.|\n",
    "|`user_defined_type_name`|`sql_identifier`|If the table is a typed table, the name of the underlying data type, else null.|\n",
    "|`is_insertable_into`|`yes_or_no`|YES if the table is insertable into, NO if not (Base tables are always insertable into, views not necessarily.)|\n",
    "|`is_typed`|`yes_or_no`|YES if the table is a typed table, NO if not|\n",
    "|`commit_action`|`character_data`|If the table is a temporary table, then PRESERVE, else null. (The SQL standard defines other commit actions for temporary tables, which are not supported by PostgreSQL.)|\n",
    ">\n",
    "><a href = \"https://www.postgresql.org/docs/9.1/static/infoschema-tables.html\">PostgreSQL Documentation: Information Schema</a>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "('_pg_foreign_data_wrappers',)\n",
      "('_pg_foreign_servers',)\n",
      "('_pg_foreign_table_columns',)\n",
      "('_pg_foreign_tables',)\n",
      "('_pg_user_mappings',)\n",
      "('administrable_role_authorizations',)\n",
      "('applicable_roles',)\n",
      "('attributes',)\n",
      "('character_sets',)\n",
      "('check_constraint_routine_usage',)\n",
      "('check_constraints',)\n",
      "('collation_character_set_applicability',)\n",
      "('collations',)\n",
      "('column_domain_usage',)\n",
      "('column_options',)\n",
      "('column_privileges',)\n",
      "('column_udt_usage',)\n",
      "('columns',)\n",
      "('constraint_column_usage',)\n",
      "('constraint_table_usage',)\n",
      "('data_type_privileges',)\n",
      "('domain_constraints',)\n",
      "('domain_udt_usage',)\n",
      "('domains',)\n",
      "('element_types',)\n",
      "('enabled_roles',)\n",
      "('foreign_data_wrapper_options',)\n",
      "('foreign_data_wrappers',)\n",
      "('foreign_server_options',)\n",
      "('foreign_servers',)\n",
      "('foreign_table_options',)\n",
      "('foreign_tables',)\n",
      "('information_schema_catalog_name',)\n",
      "('key_column_usage',)\n",
      "('parameters',)\n",
      "('pg_aggregate',)\n",
      "('pg_am',)\n",
      "('pg_amop',)\n",
      "('pg_amproc',)\n",
      "('pg_attrdef',)\n",
      "('pg_attribute',)\n",
      "('pg_auth_members',)\n",
      "('pg_authid',)\n",
      "('pg_available_extension_versions',)\n",
      "('pg_available_extensions',)\n",
      "('pg_cast',)\n",
      "('pg_class',)\n",
      "('pg_collation',)\n",
      "('pg_config',)\n",
      "('pg_constraint',)\n",
      "('pg_conversion',)\n",
      "('pg_cursors',)\n",
      "('pg_database',)\n",
      "('pg_db_role_setting',)\n",
      "('pg_default_acl',)\n",
      "('pg_depend',)\n",
      "('pg_description',)\n",
      "('pg_enum',)\n",
      "('pg_event_trigger',)\n",
      "('pg_extension',)\n",
      "('pg_file_settings',)\n",
      "('pg_foreign_data_wrapper',)\n",
      "('pg_foreign_server',)\n",
      "('pg_foreign_table',)\n",
      "('pg_group',)\n",
      "('pg_hba_file_rules',)\n",
      "('pg_index',)\n",
      "('pg_indexes',)\n",
      "('pg_inherits',)\n",
      "('pg_init_privs',)\n",
      "('pg_language',)\n",
      "('pg_largeobject',)\n",
      "('pg_largeobject_metadata',)\n",
      "('pg_locks',)\n",
      "('pg_matviews',)\n",
      "('pg_namespace',)\n",
      "('pg_opclass',)\n",
      "('pg_operator',)\n",
      "('pg_opfamily',)\n",
      "('pg_partitioned_table',)\n",
      "('pg_pltemplate',)\n",
      "('pg_policies',)\n",
      "('pg_policy',)\n",
      "('pg_prepared_statements',)\n",
      "('pg_prepared_xacts',)\n",
      "('pg_proc',)\n",
      "('pg_publication',)\n",
      "('pg_publication_rel',)\n",
      "('pg_publication_tables',)\n",
      "('pg_range',)\n",
      "('pg_replication_origin',)\n",
      "('pg_replication_origin_status',)\n",
      "('pg_replication_slots',)\n",
      "('pg_rewrite',)\n",
      "('pg_roles',)\n",
      "('pg_rules',)\n",
      "('pg_seclabel',)\n",
      "('pg_seclabels',)\n",
      "('pg_sequence',)\n",
      "('pg_sequences',)\n",
      "('pg_settings',)\n",
      "('pg_shadow',)\n",
      "('pg_shdepend',)\n",
      "('pg_shdescription',)\n",
      "('pg_shseclabel',)\n",
      "('pg_stat_activity',)\n",
      "('pg_stat_all_indexes',)\n",
      "('pg_stat_all_tables',)\n",
      "('pg_stat_archiver',)\n",
      "('pg_stat_bgwriter',)\n",
      "('pg_stat_database',)\n",
      "('pg_stat_database_conflicts',)\n",
      "('pg_stat_progress_vacuum',)\n",
      "('pg_stat_replication',)\n",
      "('pg_stat_ssl',)\n",
      "('pg_stat_subscription',)\n",
      "('pg_stat_sys_indexes',)\n",
      "('pg_stat_sys_tables',)\n",
      "('pg_stat_user_functions',)\n",
      "('pg_stat_user_indexes',)\n",
      "('pg_stat_user_tables',)\n",
      "('pg_stat_wal_receiver',)\n",
      "('pg_stat_xact_all_tables',)\n",
      "('pg_stat_xact_sys_tables',)\n",
      "('pg_stat_xact_user_functions',)\n",
      "('pg_stat_xact_user_tables',)\n",
      "('pg_statio_all_indexes',)\n",
      "('pg_statio_all_sequences',)\n",
      "('pg_statio_all_tables',)\n",
      "('pg_statio_sys_indexes',)\n",
      "('pg_statio_sys_sequences',)\n",
      "('pg_statio_sys_tables',)\n",
      "('pg_statio_user_indexes',)\n",
      "('pg_statio_user_sequences',)\n",
      "('pg_statio_user_tables',)\n",
      "('pg_statistic',)\n",
      "('pg_statistic_ext',)\n",
      "('pg_stats',)\n",
      "('pg_subscription',)\n",
      "('pg_subscription_rel',)\n",
      "('pg_tables',)\n",
      "('pg_tablespace',)\n",
      "('pg_timezone_abbrevs',)\n",
      "('pg_timezone_names',)\n",
      "('pg_transform',)\n",
      "('pg_trigger',)\n",
      "('pg_ts_config',)\n",
      "('pg_ts_config_map',)\n",
      "('pg_ts_dict',)\n",
      "('pg_ts_parser',)\n",
      "('pg_ts_template',)\n",
      "('pg_type',)\n",
      "('pg_user',)\n",
      "('pg_user_mapping',)\n",
      "('pg_user_mappings',)\n",
      "('pg_views',)\n",
      "('referential_constraints',)\n",
      "('role_column_grants',)\n",
      "('role_routine_grants',)\n",
      "('role_table_grants',)\n",
      "('role_udt_grants',)\n",
      "('role_usage_grants',)\n",
      "('routine_privileges',)\n",
      "('routines',)\n",
      "('schemata',)\n",
      "('sequences',)\n",
      "('sql_features',)\n",
      "('sql_implementation_info',)\n",
      "('sql_languages',)\n",
      "('sql_packages',)\n",
      "('sql_parts',)\n",
      "('sql_sizing',)\n",
      "('sql_sizing_profiles',)\n",
      "('stormdata',)\n",
      "('table_constraints',)\n",
      "('table_privileges',)\n",
      "('tables',)\n",
      "('transforms',)\n",
      "('triggered_update_columns',)\n",
      "('triggers',)\n",
      "('udt_privileges',)\n",
      "('usage_privileges',)\n",
      "('user_defined_types',)\n",
      "('user_mapping_options',)\n",
      "('user_mappings',)\n",
      "('view_column_usage',)\n",
      "('view_routine_usage',)\n",
      "('view_table_usage',)\n",
      "('views',)\n"
     ]
    }
   ],
   "source": [
    "conn = psycopg2.connect(dbname=\"dq_exercises\", user=\"nmolivo\")\n",
    "cur = conn.cursor()\n",
    "cur.execute('SELECT table_name FROM information_schema.tables ORDER BY table_name')\n",
    "table_names = cur.fetchall()\n",
    "for name in table_names:\n",
    "    print(name)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "> In the output, you would have noticed many tables that started with the prefix `pg_*`. Each one of these tables is part of the `pg_catalog` group of internal tables. These are the system catalog tables. \n",
    ">\n",
    "> DataQuest"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<b>3.  </b>Instructions:\n",
    "- Use the provided `cur` object.\n",
    "- Using the `SELECT` query, grab the `table_name` column from the `information_schema.tables` table.\n",
    "    - Find user created by filtering the query on the `table_schema` column.\n",
    "    - `ORDER BY` the `table_name` again.\n",
    "- Loop through `cur.fetchall()` and print each `table_name` from the query."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "> In Postgres, schemas are used as a namespace for tables, with the distinct purpose of seperating them into isolated groups or sets within a single database.\n",
    ">\n",
    "> DataQuest"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "cur = conn.cursor()\n",
    "conn = psycopg2.connect(dbname=\"dq_exercises\", user=\"nmolivo\")\n",
    "cur = conn.cursor()\n",
    "cur.execute(\"SELECT table_name FROM information_schema.tables WHERE table_schema='public' ORDER BY table_name\")\n",
    "table_names = cur.fetchall()\n",
    "for table_name in cur.fetchall():\n",
    "    name = table_name[0]\n",
    "    print(name)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<b>4.  </b>Instructions:\n",
    "- Import `AsIs` from `psycopg2.extensions`.\n",
    "- Within the loop for `cur.fetchall()` for each table name:\n",
    "    - Run a `SELECT` query with the table variable using `AsIs`.\n",
    "    - Print the `cur.description` attribute.\n",
    "    - Print a black space to seperate the descriptions at the end of each loop."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(Column(name='fid', type_code=1043, display_size=None, internal_size=32, precision=None, scale=None, null_ok=None), Column(name='btid', type_code=1042, display_size=None, internal_size=4, precision=None, scale=None, null_ok=None), Column(name='name', type_code=1042, display_size=None, internal_size=9, precision=None, scale=None, null_ok=None), Column(name='lat', type_code=1700, display_size=None, internal_size=4, precision=4, scale=2, null_ok=None), Column(name='long', type_code=1700, display_size=None, internal_size=7, precision=7, scale=4, null_ok=None), Column(name='wind_kts', type_code=23, display_size=None, internal_size=4, precision=None, scale=None, null_ok=None), Column(name='pressure', type_code=23, display_size=None, internal_size=4, precision=None, scale=None, null_ok=None), Column(name='cat', type_code=1042, display_size=None, internal_size=2, precision=None, scale=None, null_ok=None), Column(name='basin', type_code=1042, display_size=None, internal_size=15, precision=None, scale=None, null_ok=None), Column(name='shape_len', type_code=1700, display_size=None, internal_size=9, precision=9, scale=7, null_ok=None), Column(name='date', type_code=1114, display_size=None, internal_size=8, precision=None, scale=None, null_ok=None)) \n",
      "\n"
     ]
    }
   ],
   "source": [
    "from psycopg2.extensions import AsIs\n",
    "\n",
    "conn = psycopg2.connect(dbname=\"dq_exercises\", user=\"nmolivo\")\n",
    "cur = conn.cursor()\n",
    "cur.execute(\"SELECT table_name FROM information_schema.tables WHERE table_schema='public'\")\n",
    "for table in cur.fetchall(): \n",
    "     table = table[0]\n",
    "     cur.execute(\"SELECT * FROM %s LIMIT 0\", [AsIs(table)])\n",
    "     print(cur.description, \"\\n\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<b>5.  </b>Instructions:\n",
    "- Use the provided `cur` object.\n",
    "- Using `execute()`, `SELECT` from the `pg_catalog.pg_type`, choose two columns that can map an integer type code to a human - readable string.\n",
    "- Create a dict and assign it to the variable `type_mappings`.\n",
    "- Loop through the returned `SELECT` query and map the integer type code to the string."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "conn = psycopg2.connect(dbname=\"dq_exercises\", user=\"nmolivo\")\n",
    "cur = conn.cursor()\n",
    "cur.execute(\"SELECT oid, typname FROM pg_catalog.pg_type\")\n",
    "type_mappings = {\n",
    "    int(oid): typname\n",
    "    for oid, typname in cur.fetchall()\n",
    "}"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    ">One interesting thing to note about <a href = \"https://www.postgresql.org/docs/9.6/static/catalog-pg-type.html\">`pg_catalog.pg_type`</a> is that it can be used to create your own Postgres types from scratch.\n",
    ">\n",
    ">DataQuest"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{16: 'bool',\n",
       " 17: 'bytea',\n",
       " 18: 'char',\n",
       " 19: 'name',\n",
       " 20: 'int8',\n",
       " 21: 'int2',\n",
       " 22: 'int2vector',\n",
       " 23: 'int4',\n",
       " 24: 'regproc',\n",
       " 25: 'text',\n",
       " 26: 'oid',\n",
       " 27: 'tid',\n",
       " 28: 'xid',\n",
       " 29: 'cid',\n",
       " 30: 'oidvector',\n",
       " 32: 'pg_ddl_command',\n",
       " 71: 'pg_type',\n",
       " 75: 'pg_attribute',\n",
       " 81: 'pg_proc',\n",
       " 83: 'pg_class',\n",
       " 114: 'json',\n",
       " 142: 'xml',\n",
       " 143: '_xml',\n",
       " 194: 'pg_node_tree',\n",
       " 199: '_json',\n",
       " 210: 'smgr',\n",
       " 325: 'index_am_handler',\n",
       " 600: 'point',\n",
       " 601: 'lseg',\n",
       " 602: 'path',\n",
       " 603: 'box',\n",
       " 604: 'polygon',\n",
       " 628: 'line',\n",
       " 629: '_line',\n",
       " 650: 'cidr',\n",
       " 651: '_cidr',\n",
       " 700: 'float4',\n",
       " 701: 'float8',\n",
       " 702: 'abstime',\n",
       " 703: 'reltime',\n",
       " 704: 'tinterval',\n",
       " 705: 'unknown',\n",
       " 718: 'circle',\n",
       " 719: '_circle',\n",
       " 774: 'macaddr8',\n",
       " 775: '_macaddr8',\n",
       " 790: 'money',\n",
       " 791: '_money',\n",
       " 829: 'macaddr',\n",
       " 869: 'inet',\n",
       " 1000: '_bool',\n",
       " 1001: '_bytea',\n",
       " 1002: '_char',\n",
       " 1003: '_name',\n",
       " 1005: '_int2',\n",
       " 1006: '_int2vector',\n",
       " 1007: '_int4',\n",
       " 1008: '_regproc',\n",
       " 1009: '_text',\n",
       " 1010: '_tid',\n",
       " 1011: '_xid',\n",
       " 1012: '_cid',\n",
       " 1013: '_oidvector',\n",
       " 1014: '_bpchar',\n",
       " 1015: '_varchar',\n",
       " 1016: '_int8',\n",
       " 1017: '_point',\n",
       " 1018: '_lseg',\n",
       " 1019: '_path',\n",
       " 1020: '_box',\n",
       " 1021: '_float4',\n",
       " 1022: '_float8',\n",
       " 1023: '_abstime',\n",
       " 1024: '_reltime',\n",
       " 1025: '_tinterval',\n",
       " 1027: '_polygon',\n",
       " 1028: '_oid',\n",
       " 1033: 'aclitem',\n",
       " 1034: '_aclitem',\n",
       " 1040: '_macaddr',\n",
       " 1041: '_inet',\n",
       " 1042: 'bpchar',\n",
       " 1043: 'varchar',\n",
       " 1082: 'date',\n",
       " 1083: 'time',\n",
       " 1114: 'timestamp',\n",
       " 1115: '_timestamp',\n",
       " 1182: '_date',\n",
       " 1183: '_time',\n",
       " 1184: 'timestamptz',\n",
       " 1185: '_timestamptz',\n",
       " 1186: 'interval',\n",
       " 1187: '_interval',\n",
       " 1231: '_numeric',\n",
       " 1248: 'pg_database',\n",
       " 1263: '_cstring',\n",
       " 1266: 'timetz',\n",
       " 1270: '_timetz',\n",
       " 1560: 'bit',\n",
       " 1561: '_bit',\n",
       " 1562: 'varbit',\n",
       " 1563: '_varbit',\n",
       " 1700: 'numeric',\n",
       " 1790: 'refcursor',\n",
       " 2201: '_refcursor',\n",
       " 2202: 'regprocedure',\n",
       " 2203: 'regoper',\n",
       " 2204: 'regoperator',\n",
       " 2205: 'regclass',\n",
       " 2206: 'regtype',\n",
       " 2207: '_regprocedure',\n",
       " 2208: '_regoper',\n",
       " 2209: '_regoperator',\n",
       " 2210: '_regclass',\n",
       " 2211: '_regtype',\n",
       " 2249: 'record',\n",
       " 2275: 'cstring',\n",
       " 2276: 'any',\n",
       " 2277: 'anyarray',\n",
       " 2278: 'void',\n",
       " 2279: 'trigger',\n",
       " 2280: 'language_handler',\n",
       " 2281: 'internal',\n",
       " 2282: 'opaque',\n",
       " 2283: 'anyelement',\n",
       " 2287: '_record',\n",
       " 2776: 'anynonarray',\n",
       " 2842: 'pg_authid',\n",
       " 2843: 'pg_auth_members',\n",
       " 2949: '_txid_snapshot',\n",
       " 2950: 'uuid',\n",
       " 2951: '_uuid',\n",
       " 2970: 'txid_snapshot',\n",
       " 3115: 'fdw_handler',\n",
       " 3220: 'pg_lsn',\n",
       " 3221: '_pg_lsn',\n",
       " 3310: 'tsm_handler',\n",
       " 3361: 'pg_ndistinct',\n",
       " 3402: 'pg_dependencies',\n",
       " 3500: 'anyenum',\n",
       " 3614: 'tsvector',\n",
       " 3615: 'tsquery',\n",
       " 3642: 'gtsvector',\n",
       " 3643: '_tsvector',\n",
       " 3644: '_gtsvector',\n",
       " 3645: '_tsquery',\n",
       " 3734: 'regconfig',\n",
       " 3735: '_regconfig',\n",
       " 3769: 'regdictionary',\n",
       " 3770: '_regdictionary',\n",
       " 3802: 'jsonb',\n",
       " 3807: '_jsonb',\n",
       " 3831: 'anyrange',\n",
       " 3838: 'event_trigger',\n",
       " 3904: 'int4range',\n",
       " 3905: '_int4range',\n",
       " 3906: 'numrange',\n",
       " 3907: '_numrange',\n",
       " 3908: 'tsrange',\n",
       " 3909: '_tsrange',\n",
       " 3910: 'tstzrange',\n",
       " 3911: '_tstzrange',\n",
       " 3912: 'daterange',\n",
       " 3913: '_daterange',\n",
       " 3926: 'int8range',\n",
       " 3927: '_int8range',\n",
       " 4066: 'pg_shseclabel',\n",
       " 4089: 'regnamespace',\n",
       " 4090: '_regnamespace',\n",
       " 4096: 'regrole',\n",
       " 4097: '_regrole',\n",
       " 6101: 'pg_subscription',\n",
       " 10000: 'pg_attrdef',\n",
       " 10001: 'pg_constraint',\n",
       " 10002: 'pg_inherits',\n",
       " 10003: 'pg_index',\n",
       " 10004: 'pg_operator',\n",
       " 10005: 'pg_opfamily',\n",
       " 10006: 'pg_opclass',\n",
       " 10130: 'pg_am',\n",
       " 10131: 'pg_amop',\n",
       " 10841: 'pg_amproc',\n",
       " 11253: 'pg_language',\n",
       " 11254: 'pg_largeobject_metadata',\n",
       " 11255: 'pg_largeobject',\n",
       " 11256: 'pg_aggregate',\n",
       " 11257: 'pg_statistic_ext',\n",
       " 11258: 'pg_statistic',\n",
       " 11259: 'pg_rewrite',\n",
       " 11260: 'pg_trigger',\n",
       " 11261: 'pg_event_trigger',\n",
       " 11262: 'pg_description',\n",
       " 11263: 'pg_cast',\n",
       " 11483: 'pg_enum',\n",
       " 11484: 'pg_namespace',\n",
       " 11485: 'pg_conversion',\n",
       " 11486: 'pg_depend',\n",
       " 11487: 'pg_db_role_setting',\n",
       " 11488: 'pg_tablespace',\n",
       " 11489: 'pg_pltemplate',\n",
       " 11490: 'pg_shdepend',\n",
       " 11491: 'pg_shdescription',\n",
       " 11492: 'pg_ts_config',\n",
       " 11493: 'pg_ts_config_map',\n",
       " 11494: 'pg_ts_dict',\n",
       " 11495: 'pg_ts_parser',\n",
       " 11496: 'pg_ts_template',\n",
       " 11497: 'pg_extension',\n",
       " 11498: 'pg_foreign_data_wrapper',\n",
       " 11499: 'pg_foreign_server',\n",
       " 11500: 'pg_user_mapping',\n",
       " 11501: 'pg_foreign_table',\n",
       " 11502: 'pg_policy',\n",
       " 11503: 'pg_replication_origin',\n",
       " 11504: 'pg_default_acl',\n",
       " 11505: 'pg_init_privs',\n",
       " 11506: 'pg_seclabel',\n",
       " 11507: 'pg_collation',\n",
       " 11508: 'pg_partitioned_table',\n",
       " 11509: 'pg_range',\n",
       " 11510: 'pg_transform',\n",
       " 11511: 'pg_sequence',\n",
       " 11512: 'pg_publication',\n",
       " 11513: 'pg_publication_rel',\n",
       " 11514: 'pg_subscription_rel',\n",
       " 11515: 'pg_toast_2604',\n",
       " 11516: 'pg_toast_2606',\n",
       " 11517: 'pg_toast_2609',\n",
       " 11518: 'pg_toast_1255',\n",
       " 11519: 'pg_toast_2618',\n",
       " 11520: 'pg_toast_3596',\n",
       " 11521: 'pg_toast_2619',\n",
       " 11522: 'pg_toast_3381',\n",
       " 11523: 'pg_toast_2620',\n",
       " 11524: 'pg_toast_2396',\n",
       " 11525: 'pg_toast_2964',\n",
       " 11526: 'pg_toast_3592',\n",
       " 11528: 'pg_roles',\n",
       " 11532: 'pg_shadow',\n",
       " 11536: 'pg_group',\n",
       " 11539: 'pg_user',\n",
       " 11542: 'pg_policies',\n",
       " 11546: 'pg_rules',\n",
       " 11550: 'pg_views',\n",
       " 11554: 'pg_tables',\n",
       " 11558: 'pg_matviews',\n",
       " 11562: 'pg_indexes',\n",
       " 11566: 'pg_sequences',\n",
       " 11570: 'pg_stats',\n",
       " 11574: 'pg_publication_tables',\n",
       " 11578: 'pg_locks',\n",
       " 11581: 'pg_cursors',\n",
       " 11584: 'pg_available_extensions',\n",
       " 11587: 'pg_available_extension_versions',\n",
       " 11590: 'pg_prepared_xacts',\n",
       " 11594: 'pg_prepared_statements',\n",
       " 11597: 'pg_seclabels',\n",
       " 11601: 'pg_settings',\n",
       " 11606: 'pg_file_settings',\n",
       " 11609: 'pg_hba_file_rules',\n",
       " 11612: 'pg_timezone_abbrevs',\n",
       " 11615: 'pg_timezone_names',\n",
       " 11618: 'pg_config',\n",
       " 11621: 'pg_stat_all_tables',\n",
       " 11625: 'pg_stat_xact_all_tables',\n",
       " 11629: 'pg_stat_sys_tables',\n",
       " 11633: 'pg_stat_xact_sys_tables',\n",
       " 11636: 'pg_stat_user_tables',\n",
       " 11640: 'pg_stat_xact_user_tables',\n",
       " 11643: 'pg_statio_all_tables',\n",
       " 11647: 'pg_statio_sys_tables',\n",
       " 11650: 'pg_statio_user_tables',\n",
       " 11653: 'pg_stat_all_indexes',\n",
       " 11657: 'pg_stat_sys_indexes',\n",
       " 11660: 'pg_stat_user_indexes',\n",
       " 11663: 'pg_statio_all_indexes',\n",
       " 11667: 'pg_statio_sys_indexes',\n",
       " 11670: 'pg_statio_user_indexes',\n",
       " 11673: 'pg_statio_all_sequences',\n",
       " 11677: 'pg_statio_sys_sequences',\n",
       " 11680: 'pg_statio_user_sequences',\n",
       " 11683: 'pg_stat_activity',\n",
       " 11687: 'pg_stat_replication',\n",
       " 11691: 'pg_stat_wal_receiver',\n",
       " 11694: 'pg_stat_subscription',\n",
       " 11697: 'pg_stat_ssl',\n",
       " 11700: 'pg_replication_slots',\n",
       " 11704: 'pg_stat_database',\n",
       " 11707: 'pg_stat_database_conflicts',\n",
       " 11710: 'pg_stat_user_functions',\n",
       " 11714: 'pg_stat_xact_user_functions',\n",
       " 11718: 'pg_stat_archiver',\n",
       " 11721: 'pg_stat_bgwriter',\n",
       " 11724: 'pg_stat_progress_vacuum',\n",
       " 11728: 'pg_user_mappings',\n",
       " 11732: 'pg_replication_origin_status',\n",
       " 12989: 'cardinal_number',\n",
       " 12991: 'character_data',\n",
       " 12992: 'sql_identifier',\n",
       " 12994: 'information_schema_catalog_name',\n",
       " 12996: 'time_stamp',\n",
       " 12997: 'yes_or_no',\n",
       " 13000: 'applicable_roles',\n",
       " 13004: 'administrable_role_authorizations',\n",
       " 13007: 'attributes',\n",
       " 13011: 'character_sets',\n",
       " 13015: 'check_constraint_routine_usage',\n",
       " 13019: 'check_constraints',\n",
       " 13023: 'collations',\n",
       " 13027: 'collation_character_set_applicability',\n",
       " 13031: 'column_domain_usage',\n",
       " 13035: 'column_privileges',\n",
       " 13039: 'column_udt_usage',\n",
       " 13043: 'columns',\n",
       " 13047: 'constraint_column_usage',\n",
       " 13051: 'constraint_table_usage',\n",
       " 13055: 'domain_constraints',\n",
       " 13059: 'domain_udt_usage',\n",
       " 13063: 'domains',\n",
       " 13067: 'enabled_roles',\n",
       " 13070: 'key_column_usage',\n",
       " 13074: 'parameters',\n",
       " 13078: 'referential_constraints',\n",
       " 13082: 'role_column_grants',\n",
       " 13085: 'routine_privileges',\n",
       " 13089: 'role_routine_grants',\n",
       " 13092: 'routines',\n",
       " 13096: 'schemata',\n",
       " 13099: 'sequences',\n",
       " 13103: 'sql_features',\n",
       " 13105: 'pg_toast_13102',\n",
       " 13108: 'sql_implementation_info',\n",
       " 13110: 'pg_toast_13107',\n",
       " 13113: 'sql_languages',\n",
       " 13115: 'pg_toast_13112',\n",
       " 13118: 'sql_packages',\n",
       " 13120: 'pg_toast_13117',\n",
       " 13123: 'sql_parts',\n",
       " 13125: 'pg_toast_13122',\n",
       " 13128: 'sql_sizing',\n",
       " 13130: 'pg_toast_13127',\n",
       " 13133: 'sql_sizing_profiles',\n",
       " 13135: 'pg_toast_13132',\n",
       " 13138: 'table_constraints',\n",
       " 13142: 'table_privileges',\n",
       " 13146: 'role_table_grants',\n",
       " 13149: 'tables',\n",
       " 13153: 'transforms',\n",
       " 13157: 'triggered_update_columns',\n",
       " 13161: 'triggers',\n",
       " 13165: 'udt_privileges',\n",
       " 13169: 'role_udt_grants',\n",
       " 13172: 'usage_privileges',\n",
       " 13176: 'role_usage_grants',\n",
       " 13179: 'user_defined_types',\n",
       " 13183: 'view_column_usage',\n",
       " 13187: 'view_routine_usage',\n",
       " 13191: 'view_table_usage',\n",
       " 13195: 'views',\n",
       " 13199: 'data_type_privileges',\n",
       " 13203: 'element_types',\n",
       " 13207: '_pg_foreign_table_columns',\n",
       " 13211: 'column_options',\n",
       " 13214: '_pg_foreign_data_wrappers',\n",
       " 13217: 'foreign_data_wrapper_options',\n",
       " 13220: 'foreign_data_wrappers',\n",
       " 13223: '_pg_foreign_servers',\n",
       " 13227: 'foreign_server_options',\n",
       " 13230: 'foreign_servers',\n",
       " 13233: '_pg_foreign_tables',\n",
       " 13237: 'foreign_table_options',\n",
       " 13240: 'foreign_tables',\n",
       " 13243: '_pg_user_mappings',\n",
       " 13247: 'user_mapping_options',\n",
       " 13251: 'user_mappings',\n",
       " 16627: '_stormdata',\n",
       " 16628: 'stormdata'}"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "type_mappings"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    ">Let's put all this together and create our own table descriptions. We want to rewrite the description attributes from a list of tuples towards something human readable. In the following exercise, we will assemble output from the previous exercises into a dictionary.\n",
    ">\n",
    ">DataQuest\n",
    "\n",
    "<b>6.  </b>Instructions:\n",
    "- Use the provided `cur`, `type_mappings`, and `table_names` objects.\n",
    "- Create a dict and assign it to the variable `readable_description`.\n",
    "- Loop through the `table_names` with the table variable and do the following:\n",
    "    - Get the description attribute for the given table.\n",
    "    - Map the name of the table to a dictionary with a columns key.\n",
    "    - Recreate the columns list from the screen example by iterating through the description, and mapping the appropriate types.\n",
    "- Print the `readable_description` dictionary at the end."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{('stormdata',): {'columns': [{'length': 32, 'name': 'fid', 'type': 'varchar'}, {'length': 4, 'name': 'btid', 'type': 'bpchar'}, {'length': 9, 'name': 'name', 'type': 'bpchar'}, {'length': 4, 'name': 'lat', 'type': 'numeric'}, {'length': 7, 'name': 'long', 'type': 'numeric'}, {'length': 4, 'name': 'wind_kts', 'type': 'int4'}, {'length': 4, 'name': 'pressure', 'type': 'int4'}, {'length': 2, 'name': 'cat', 'type': 'bpchar'}, {'length': 15, 'name': 'basin', 'type': 'bpchar'}, {'length': 9, 'name': 'shape_len', 'type': 'numeric'}, {'length': 8, 'name': 'date', 'type': 'timestamp'}]}}\n"
     ]
    }
   ],
   "source": [
    "from psycopg2.extensions import AsIs\n",
    "conn = psycopg2.connect(dbname=\"dq_exercises\", user=\"nmolivo\")\n",
    "cur = conn.cursor()\n",
    "# You have `table_names` and `type_mappings` provided for you.\n",
    "\n",
    "readable_description = {}\n",
    "#for table in table_names:\n",
    "    #cur.execute(\"SELECT * FROM %s LIMIT 0\", [AsIs(table)])\n",
    "cur.execute(\"SELECT * FROM stormdata LIMIT 0\")\n",
    "readable_description[table] = dict(\n",
    "    columns=[\n",
    "        dict(\n",
    "            name=col.name,\n",
    "            type=type_mappings[col.type_code],\n",
    "            length=col.internal_size\n",
    "        )\n",
    "        for col in cur.description\n",
    "    ]\n",
    ")\n",
    "print(readable_description)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "> Let's provide our description with the number of rows in the table.\n",
    ">\n",
    "> DataQuest\n",
    "\n",
    "<b>7.  </b>Instructions:\n",
    "- Use the provided `cur` object and `AsIs` class.\n",
    "- Loop through the `readable_description` keys:\n",
    "    - Fetch the value of each table's row count and assign it to a `total` key for that table.\n",
    "- Print the `readable_description` dictionary at the end."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "from psycopg2.extensions import AsIs\n",
    "conn = psycopg2.connect(dbname=\"dq_exercises\", user=\"nmolivo\")\n",
    "cur = conn.cursor()\n",
    "\n",
    "#for table in readable_description.keys():\n",
    "    #cur.execute(\"SELECT COUNT(*) FROM %s\", [AsIs(table)])\n",
    "cur.execute(\"SELECT COUNT(*) FROM stormdata\")\n",
    "readable_description[table][\"total\"] = cur.fetchone()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{('stormdata',): {'columns': [{'length': 32, 'name': 'fid', 'type': 'varchar'},\n",
       "   {'length': 4, 'name': 'btid', 'type': 'bpchar'},\n",
       "   {'length': 9, 'name': 'name', 'type': 'bpchar'},\n",
       "   {'length': 4, 'name': 'lat', 'type': 'numeric'},\n",
       "   {'length': 7, 'name': 'long', 'type': 'numeric'},\n",
       "   {'length': 4, 'name': 'wind_kts', 'type': 'int4'},\n",
       "   {'length': 4, 'name': 'pressure', 'type': 'int4'},\n",
       "   {'length': 2, 'name': 'cat', 'type': 'bpchar'},\n",
       "   {'length': 15, 'name': 'basin', 'type': 'bpchar'},\n",
       "   {'length': 9, 'name': 'shape_len', 'type': 'numeric'},\n",
       "   {'length': 8, 'name': 'date', 'type': 'timestamp'}],\n",
       "  'total': (118456,)}}"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "readable_description"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    ">Finally, let's add some sample rows the readable_description dictionary.\n",
    ">\n",
    ">DataQuest\n",
    "\n",
    "<b>8.  </b>Instructions:\n",
    "- Use the provided `cur` object and `AsIs` class.\n",
    "- Loop through the `readable_description` keys and run the following:\n",
    "    - Select the first 100 rows with `SELECT ... LIMIT` using `execute()` and `AsIs`.\n",
    "    - Fetch the all the rows and assign it to the `readable_description` dictionary for the given table using the `sample_rows` key.\n",
    "- Print the `readable_description` dictionary at the end."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "from psycopg2.extensions import AsIs\n",
    "conn = psycopg2.connect(dbname=\"dq_exercises\", user=\"nmolivo\")\n",
    "cur = conn.cursor()\n",
    "\n",
    "#for table in readable_description.keys():\n",
    "#    cur.execute(\"SELECT * FROM %s LIMIT 100\", [AsIs(table)])\n",
    "cur.execute(\"SELECT * FROM stormdata LIMIT 100\")\n",
    "readable_description[table][\"sample_rows\"] = cur.fetchall()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{('stormdata',): {'columns': [{'length': 32, 'name': 'fid', 'type': 'varchar'},\n",
       "   {'length': 4, 'name': 'btid', 'type': 'bpchar'},\n",
       "   {'length': 9, 'name': 'name', 'type': 'bpchar'},\n",
       "   {'length': 4, 'name': 'lat', 'type': 'numeric'},\n",
       "   {'length': 7, 'name': 'long', 'type': 'numeric'},\n",
       "   {'length': 4, 'name': 'wind_kts', 'type': 'int4'},\n",
       "   {'length': 4, 'name': 'pressure', 'type': 'int4'},\n",
       "   {'length': 2, 'name': 'cat', 'type': 'bpchar'},\n",
       "   {'length': 15, 'name': 'basin', 'type': 'bpchar'},\n",
       "   {'length': 9, 'name': 'shape_len', 'type': 'numeric'},\n",
       "   {'length': 8, 'name': 'date', 'type': 'timestamp'}],\n",
       "  'sample_rows': [('2001',\n",
       "    '63  ',\n",
       "    'NOTNAMED ',\n",
       "    Decimal('22.50'),\n",
       "    Decimal('-140.0000'),\n",
       "    50,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.1401750'),\n",
       "    datetime.datetime(1957, 8, 8, 0, 0)),\n",
       "   ('2002',\n",
       "    '116 ',\n",
       "    'PAULINE  ',\n",
       "    Decimal('22.10'),\n",
       "    Decimal('-140.2000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.1661900'),\n",
       "    datetime.datetime(1961, 10, 3, 0, 0)),\n",
       "   ('2003',\n",
       "    '124 ',\n",
       "    'C        ',\n",
       "    Decimal('18.00'),\n",
       "    Decimal('-140.0000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('2.1023800'),\n",
       "    datetime.datetime(1962, 8, 29, 0, 0)),\n",
       "   ('2004',\n",
       "    '168 ',\n",
       "    'DENISE   ',\n",
       "    Decimal('16.60'),\n",
       "    Decimal('-139.5000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('2.1213200'),\n",
       "    datetime.datetime(1967, 7, 14, 0, 0)),\n",
       "   ('2005',\n",
       "    '251 ',\n",
       "    'DIANA    ',\n",
       "    Decimal('18.50'),\n",
       "    Decimal('-139.8000'),\n",
       "    70,\n",
       "    0,\n",
       "    'H1',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.7029390'),\n",
       "    datetime.datetime(1972, 8, 16, 0, 0)),\n",
       "   ('2006',\n",
       "    '312 ',\n",
       "    'DIANA    ',\n",
       "    Decimal('18.60'),\n",
       "    Decimal('-139.8000'),\n",
       "    30,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.6000000'),\n",
       "    datetime.datetime(1976, 7, 22, 0, 0)),\n",
       "   ('2007',\n",
       "    '342 ',\n",
       "    'KRISTY   ',\n",
       "    Decimal('21.40'),\n",
       "    Decimal('-140.2000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.3038400'),\n",
       "    datetime.datetime(1978, 8, 26, 0, 0)),\n",
       "   ('2008',\n",
       "    '371 ',\n",
       "    'KAY      ',\n",
       "    Decimal('20.50'),\n",
       "    Decimal('-140.2000'),\n",
       "    75,\n",
       "    0,\n",
       "    'H1',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.2206560'),\n",
       "    datetime.datetime(1980, 9, 24, 0, 0)),\n",
       "   ('2009',\n",
       "    '223 ',\n",
       "    'MAGGIE   ',\n",
       "    Decimal('14.90'),\n",
       "    Decimal('-139.4000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.9219540'),\n",
       "    datetime.datetime(1970, 8, 23, 0, 0)),\n",
       "   ('2010',\n",
       "    '381 ',\n",
       "    'GREG     ',\n",
       "    Decimal('18.70'),\n",
       "    Decimal('-140.2000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.9219540'),\n",
       "    datetime.datetime(1981, 8, 21, 0, 0)),\n",
       "   ('2011',\n",
       "    '223 ',\n",
       "    'MAGGIE   ',\n",
       "    Decimal('15.10'),\n",
       "    Decimal('-140.3000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.9219540'),\n",
       "    datetime.datetime(1970, 8, 23, 0, 0)),\n",
       "   ('2012',\n",
       "    '384 ',\n",
       "    'JOVA     ',\n",
       "    Decimal('19.70'),\n",
       "    Decimal('-140.0000'),\n",
       "    60,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.7464250'),\n",
       "    datetime.datetime(1981, 9, 18, 0, 0)),\n",
       "   ('2013',\n",
       "    '233 ',\n",
       "    'DENISE   ',\n",
       "    Decimal('14.00'),\n",
       "    Decimal('-135.7000'),\n",
       "    100,\n",
       "    0,\n",
       "    'H3',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.6763050'),\n",
       "    datetime.datetime(1971, 7, 10, 0, 0)),\n",
       "   ('2014',\n",
       "    '393 ',\n",
       "    'DANIEL   ',\n",
       "    Decimal('18.10'),\n",
       "    Decimal('-140.0000'),\n",
       "    35,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.6278820'),\n",
       "    datetime.datetime(1982, 7, 16, 0, 0)),\n",
       "   ('2015',\n",
       "    '437 ',\n",
       "    'DOUGLAS  ',\n",
       "    Decimal('18.10'),\n",
       "    Decimal('-140.0000'),\n",
       "    30,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.3152950'),\n",
       "    datetime.datetime(1984, 7, 3, 0, 0)),\n",
       "   ('2016',\n",
       "    '522 ',\n",
       "    'HECTOR   ',\n",
       "    Decimal('18.60'),\n",
       "    Decimal('-140.0000'),\n",
       "    40,\n",
       "    1005,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.4035670'),\n",
       "    datetime.datetime(1988, 8, 9, 0, 0)),\n",
       "   ('2017',\n",
       "    '233 ',\n",
       "    'DENISE   ',\n",
       "    Decimal('14.50'),\n",
       "    Decimal('-137.3000'),\n",
       "    100,\n",
       "    0,\n",
       "    'H3',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.9313210'),\n",
       "    datetime.datetime(1971, 7, 10, 0, 0)),\n",
       "   ('2018',\n",
       "    '534 ',\n",
       "    'ERICK    ',\n",
       "    Decimal('17.20'),\n",
       "    Decimal('-139.5000'),\n",
       "    30,\n",
       "    1012,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('2.7459060'),\n",
       "    datetime.datetime(1989, 7, 21, 0, 0)),\n",
       "   ('2019',\n",
       "    '250 ',\n",
       "    'CELESTE  ',\n",
       "    Decimal('15.40'),\n",
       "    Decimal('-137.5000'),\n",
       "    75,\n",
       "    0,\n",
       "    'H1',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.8944270'),\n",
       "    datetime.datetime(1972, 8, 11, 0, 0)),\n",
       "   ('2020',\n",
       "    '590 ',\n",
       "    'GEORGETTE',\n",
       "    Decimal('17.50'),\n",
       "    Decimal('-139.4000'),\n",
       "    30,\n",
       "    1007,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('2.1023800'),\n",
       "    datetime.datetime(1992, 7, 24, 0, 0)),\n",
       "   ('2021',\n",
       "    '250 ',\n",
       "    'CELESTE  ',\n",
       "    Decimal('15.00'),\n",
       "    Decimal('-138.3000'),\n",
       "    75,\n",
       "    0,\n",
       "    'H1',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.8062260'),\n",
       "    datetime.datetime(1972, 8, 11, 0, 0)),\n",
       "   ('2022',\n",
       "    '598 ',\n",
       "    'ORLENE   ',\n",
       "    Decimal('22.60'),\n",
       "    Decimal('-140.0000'),\n",
       "    40,\n",
       "    1002,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.5132750'),\n",
       "    datetime.datetime(1992, 9, 12, 0, 0)),\n",
       "   ('2023',\n",
       "    '607 ',\n",
       "    'YOLANDA  ',\n",
       "    Decimal('16.20'),\n",
       "    Decimal('-140.2000'),\n",
       "    25,\n",
       "    1011,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.6000000'),\n",
       "    datetime.datetime(1992, 10, 22, 0, 0)),\n",
       "   ('2024',\n",
       "    '250 ',\n",
       "    'CELESTE  ',\n",
       "    Decimal('14.60'),\n",
       "    Decimal('-139.0000'),\n",
       "    80,\n",
       "    0,\n",
       "    'H1',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.8062260'),\n",
       "    datetime.datetime(1972, 8, 12, 0, 0)),\n",
       "   ('2025',\n",
       "    '613 ',\n",
       "    'EUGENE   ',\n",
       "    Decimal('19.20'),\n",
       "    Decimal('-139.8000'),\n",
       "    40,\n",
       "    997,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('2.2203600'),\n",
       "    datetime.datetime(1993, 7, 22, 0, 0)),\n",
       "   ('2026',\n",
       "    '250 ',\n",
       "    'CELESTE  ',\n",
       "    Decimal('14.20'),\n",
       "    Decimal('-139.7000'),\n",
       "    80,\n",
       "    0,\n",
       "    'H1',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.8062260'),\n",
       "    datetime.datetime(1972, 8, 12, 0, 0)),\n",
       "   ('2027',\n",
       "    '250 ',\n",
       "    'CELESTE  ',\n",
       "    Decimal('13.80'),\n",
       "    Decimal('-140.4000'),\n",
       "    85,\n",
       "    0,\n",
       "    'H2',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.0198040'),\n",
       "    datetime.datetime(1972, 8, 12, 0, 0)),\n",
       "   ('2028',\n",
       "    '615 ',\n",
       "    'FERNANDA ',\n",
       "    Decimal('18.30'),\n",
       "    Decimal('-139.6000'),\n",
       "    85,\n",
       "    973,\n",
       "    'H2',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.6278820'),\n",
       "    datetime.datetime(1993, 8, 14, 0, 0)),\n",
       "   ('2029',\n",
       "    '250 ',\n",
       "    'CELESTE  ',\n",
       "    Decimal('13.60'),\n",
       "    Decimal('-141.4000'),\n",
       "    85,\n",
       "    0,\n",
       "    'H2',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.2041590'),\n",
       "    datetime.datetime(1972, 8, 12, 0, 0)),\n",
       "   ('2030',\n",
       "    '635 ',\n",
       "    'KRISTY   ',\n",
       "    Decimal('16.20'),\n",
       "    Decimal('-139.8000'),\n",
       "    60,\n",
       "    992,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.5033300'),\n",
       "    datetime.datetime(1994, 8, 31, 0, 0)),\n",
       "   ('2031',\n",
       "    '250 ',\n",
       "    'CELESTE  ',\n",
       "    Decimal('13.50'),\n",
       "    Decimal('-142.6000'),\n",
       "    85,\n",
       "    0,\n",
       "    'H2',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.3152950'),\n",
       "    datetime.datetime(1972, 8, 13, 0, 0)),\n",
       "   ('2032',\n",
       "    '636 ',\n",
       "    'LANE     ',\n",
       "    Decimal('21.40'),\n",
       "    Decimal('-140.0000'),\n",
       "    25,\n",
       "    1010,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.4035670'),\n",
       "    datetime.datetime(1994, 9, 10, 0, 0)),\n",
       "   ('2033',\n",
       "    '666 ',\n",
       "    'DOLORES  ',\n",
       "    Decimal('21.00'),\n",
       "    Decimal('-140.0000'),\n",
       "    30,\n",
       "    1008,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.4422210'),\n",
       "    datetime.datetime(1997, 7, 11, 0, 0)),\n",
       "   ('2034',\n",
       "    '272 ',\n",
       "    'KATHERINE',\n",
       "    Decimal('14.60'),\n",
       "    Decimal('-136.0000'),\n",
       "    50,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.3341660'),\n",
       "    datetime.datetime(1973, 10, 6, 0, 0)),\n",
       "   ('2035',\n",
       "    '272 ',\n",
       "    'KATHERINE',\n",
       "    Decimal('14.30'),\n",
       "    Decimal('-137.3000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.4317820'),\n",
       "    datetime.datetime(1973, 10, 6, 0, 0)),\n",
       "   ('2036',\n",
       "    '698 ',\n",
       "    'DORA     ',\n",
       "    Decimal('15.50'),\n",
       "    Decimal('-139.7000'),\n",
       "    100,\n",
       "    960,\n",
       "    'H3',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('2.0000000'),\n",
       "    datetime.datetime(1999, 8, 14, 0, 0)),\n",
       "   ('2037',\n",
       "    '272 ',\n",
       "    'KATHERINE',\n",
       "    Decimal('14.00'),\n",
       "    Decimal('-138.7000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.4317820'),\n",
       "    datetime.datetime(1973, 10, 6, 0, 0)),\n",
       "   ('2038',\n",
       "    '708 ',\n",
       "    'DANIEL   ',\n",
       "    Decimal('17.50'),\n",
       "    Decimal('-139.6000'),\n",
       "    90,\n",
       "    968,\n",
       "    'H2',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.7720050'),\n",
       "    datetime.datetime(2000, 7, 28, 0, 0)),\n",
       "   ('2039',\n",
       "    '272 ',\n",
       "    'KATHERINE',\n",
       "    Decimal('13.70'),\n",
       "    Decimal('-140.1000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.5297060'),\n",
       "    datetime.datetime(1973, 10, 6, 0, 0)),\n",
       "   ('2040',\n",
       "    '724 ',\n",
       "    'BARBARA  ',\n",
       "    Decimal('16.80'),\n",
       "    Decimal('-140.1000'),\n",
       "    30,\n",
       "    1006,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.2083050'),\n",
       "    datetime.datetime(2001, 6, 22, 0, 0)),\n",
       "   ('2041',\n",
       "    '272 ',\n",
       "    'KATHERINE',\n",
       "    Decimal('13.40'),\n",
       "    Decimal('-141.6000'),\n",
       "    40,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.8062260'),\n",
       "    datetime.datetime(1973, 10, 7, 0, 0)),\n",
       "   ('2042',\n",
       "    '272 ',\n",
       "    'KATHERINE',\n",
       "    Decimal('13.30'),\n",
       "    Decimal('-142.4000'),\n",
       "    40,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.9055390'),\n",
       "    datetime.datetime(1973, 10, 7, 0, 0)),\n",
       "   ('2043',\n",
       "    '736 ',\n",
       "    'NARDA    ',\n",
       "    Decimal('16.30'),\n",
       "    Decimal('-139.6000'),\n",
       "    35,\n",
       "    1002,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.6031220'),\n",
       "    datetime.datetime(2001, 10, 23, 0, 0)),\n",
       "   ('2044',\n",
       "    '282 ',\n",
       "    'IONE     ',\n",
       "    Decimal('12.40'),\n",
       "    Decimal('-135.6000'),\n",
       "    30,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.0049880'),\n",
       "    datetime.datetime(1974, 8, 23, 0, 0)),\n",
       "   ('2045',\n",
       "    '759 ',\n",
       "    'GUILLERMO',\n",
       "    Decimal('16.30'),\n",
       "    Decimal('-139.8000'),\n",
       "    25,\n",
       "    1008,\n",
       "    'L ',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.7117240'),\n",
       "    datetime.datetime(2003, 8, 12, 0, 0)),\n",
       "   ('2046',\n",
       "    '282 ',\n",
       "    'IONE     ',\n",
       "    Decimal('12.30'),\n",
       "    Decimal('-136.6000'),\n",
       "    30,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.0049880'),\n",
       "    datetime.datetime(1974, 8, 23, 0, 0)),\n",
       "   ('2047',\n",
       "    '762 ',\n",
       "    'JIMENA   ',\n",
       "    Decimal('17.30'),\n",
       "    Decimal('-139.8000'),\n",
       "    85,\n",
       "    973,\n",
       "    'H2',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.5000000'),\n",
       "    datetime.datetime(2003, 8, 30, 0, 0)),\n",
       "   ('2048',\n",
       "    '282 ',\n",
       "    'IONE     ',\n",
       "    Decimal('12.40'),\n",
       "    Decimal('-137.6000'),\n",
       "    30,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.8062260'),\n",
       "    datetime.datetime(1974, 8, 23, 0, 0)),\n",
       "   ('2049',\n",
       "    '775 ',\n",
       "    'GEORGETTE',\n",
       "    Decimal('21.70'),\n",
       "    Decimal('-140.2000'),\n",
       "    15,\n",
       "    1011,\n",
       "    'L ',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.6155490'),\n",
       "    datetime.datetime(2004, 9, 2, 0, 0)),\n",
       "   ('2050',\n",
       "    '282 ',\n",
       "    'IONE     ',\n",
       "    Decimal('12.50'),\n",
       "    Decimal('-138.4000'),\n",
       "    65,\n",
       "    0,\n",
       "    'H1',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.9219540'),\n",
       "    datetime.datetime(1974, 8, 23, 0, 0)),\n",
       "   ('2051',\n",
       "    '797 ',\n",
       "    'BUD      ',\n",
       "    Decimal('23.00'),\n",
       "    Decimal('-139.8000'),\n",
       "    20,\n",
       "    1012,\n",
       "    'L ',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.5811390'),\n",
       "    datetime.datetime(2006, 7, 16, 0, 0)),\n",
       "   ('2052',\n",
       "    '282 ',\n",
       "    'IONE     ',\n",
       "    Decimal('12.70'),\n",
       "    Decimal('-139.3000'),\n",
       "    75,\n",
       "    0,\n",
       "    'H1',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.8246210'),\n",
       "    datetime.datetime(1974, 8, 24, 0, 0)),\n",
       "   ('2053',\n",
       "    '830 ',\n",
       "    'ELIDA    ',\n",
       "    Decimal('16.90'),\n",
       "    Decimal('-140.0000'),\n",
       "    25,\n",
       "    1009,\n",
       "    'L ',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.5132750'),\n",
       "    datetime.datetime(2008, 7, 21, 0, 0)),\n",
       "   ('2054',\n",
       "    '282 ',\n",
       "    'IONE     ',\n",
       "    Decimal('12.90'),\n",
       "    Decimal('-140.1000'),\n",
       "    100,\n",
       "    0,\n",
       "    'H3',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.9486830'),\n",
       "    datetime.datetime(1974, 8, 24, 0, 0)),\n",
       "   ('2055',\n",
       "    '12  ',\n",
       "    'NOTNAMED ',\n",
       "    Decimal('19.10'),\n",
       "    Decimal('-140.3000'),\n",
       "    75,\n",
       "    0,\n",
       "    'H1',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.8246210'),\n",
       "    datetime.datetime(1950, 8, 29, 0, 0)),\n",
       "   ('2056',\n",
       "    '282 ',\n",
       "    'IONE     ',\n",
       "    Decimal('13.20'),\n",
       "    Decimal('-141.0000'),\n",
       "    90,\n",
       "    0,\n",
       "    'H2',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.6324560'),\n",
       "    datetime.datetime(1974, 8, 24, 0, 0)),\n",
       "   ('2057',\n",
       "    '12  ',\n",
       "    'NOTNAMED ',\n",
       "    Decimal('19.30'),\n",
       "    Decimal('-141.1000'),\n",
       "    75,\n",
       "    0,\n",
       "    'H1',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.9219540'),\n",
       "    datetime.datetime(1950, 8, 30, 0, 0)),\n",
       "   ('2058',\n",
       "    '282 ',\n",
       "    'IONE     ',\n",
       "    Decimal('13.40'),\n",
       "    Decimal('-141.6000'),\n",
       "    90,\n",
       "    0,\n",
       "    'H2',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.5000000'),\n",
       "    datetime.datetime(1974, 8, 24, 0, 0)),\n",
       "   ('2059',\n",
       "    '12  ',\n",
       "    'NOTNAMED ',\n",
       "    Decimal('19.50'),\n",
       "    Decimal('-142.0000'),\n",
       "    75,\n",
       "    0,\n",
       "    'H1',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.0198040'),\n",
       "    datetime.datetime(1950, 8, 30, 0, 0)),\n",
       "   ('2060',\n",
       "    '282 ',\n",
       "    'IONE     ',\n",
       "    Decimal('13.70'),\n",
       "    Decimal('-142.0000'),\n",
       "    90,\n",
       "    0,\n",
       "    'H2',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.5000000'),\n",
       "    datetime.datetime(1974, 8, 25, 0, 0)),\n",
       "   ('2061',\n",
       "    '62  ',\n",
       "    'KANOA    ',\n",
       "    Decimal('17.90'),\n",
       "    Decimal('-140.5000'),\n",
       "    75,\n",
       "    0,\n",
       "    'H1',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.3038400'),\n",
       "    datetime.datetime(1957, 7, 23, 0, 0)),\n",
       "   ('2062',\n",
       "    '62  ',\n",
       "    'KANOA    ',\n",
       "    Decimal('18.00'),\n",
       "    Decimal('-141.8000'),\n",
       "    75,\n",
       "    0,\n",
       "    'H1',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.1401750'),\n",
       "    datetime.datetime(1957, 7, 23, 0, 0)),\n",
       "   ('2063',\n",
       "    '282 ',\n",
       "    'IONE     ',\n",
       "    Decimal('14.00'),\n",
       "    Decimal('-142.4000'),\n",
       "    90,\n",
       "    0,\n",
       "    'H2',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.5830950'),\n",
       "    datetime.datetime(1974, 8, 25, 0, 0)),\n",
       "   ('2064',\n",
       "    '282 ',\n",
       "    'IONE     ',\n",
       "    Decimal('14.30'),\n",
       "    Decimal('-142.9000'),\n",
       "    90,\n",
       "    0,\n",
       "    'H2',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.5656850'),\n",
       "    datetime.datetime(1974, 8, 25, 0, 0)),\n",
       "   ('2065',\n",
       "    '62  ',\n",
       "    'KANOA    ',\n",
       "    Decimal('18.30'),\n",
       "    Decimal('-142.9000'),\n",
       "    75,\n",
       "    0,\n",
       "    'H1',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.1401750'),\n",
       "    datetime.datetime(1957, 7, 23, 0, 0)),\n",
       "   ('2066',\n",
       "    '66  ',\n",
       "    'NOTNAMED ',\n",
       "    Decimal('15.80'),\n",
       "    Decimal('-140.5000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.1180340'),\n",
       "    datetime.datetime(1957, 9, 9, 0, 0)),\n",
       "   ('2067',\n",
       "    '291 ',\n",
       "    'ROSALIE  ',\n",
       "    Decimal('13.50'),\n",
       "    Decimal('-136.0000'),\n",
       "    35,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.5830950'),\n",
       "    datetime.datetime(1974, 10, 23, 0, 0)),\n",
       "   ('2068',\n",
       "    '66  ',\n",
       "    'NOTNAMED ',\n",
       "    Decimal('16.30'),\n",
       "    Decimal('-141.5000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.9848860'),\n",
       "    datetime.datetime(1957, 9, 9, 0, 0)),\n",
       "   ('2069',\n",
       "    '291 ',\n",
       "    'ROSALIE  ',\n",
       "    Decimal('13.20'),\n",
       "    Decimal('-136.5000'),\n",
       "    35,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.5385160'),\n",
       "    datetime.datetime(1974, 10, 23, 0, 0)),\n",
       "   ('2070',\n",
       "    '291 ',\n",
       "    'ROSALIE  ',\n",
       "    Decimal('13.00'),\n",
       "    Decimal('-137.0000'),\n",
       "    35,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.0049880'),\n",
       "    datetime.datetime(1974, 10, 23, 0, 0)),\n",
       "   ('2071',\n",
       "    '66  ',\n",
       "    'NOTNAMED ',\n",
       "    Decimal('16.70'),\n",
       "    Decimal('-142.4000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.6708200'),\n",
       "    datetime.datetime(1957, 9, 10, 0, 0)),\n",
       "   ('2072',\n",
       "    '291 ',\n",
       "    'ROSALIE  ',\n",
       "    Decimal('12.90'),\n",
       "    Decimal('-138.0000'),\n",
       "    25,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.0049880'),\n",
       "    datetime.datetime(1974, 10, 23, 0, 0)),\n",
       "   ('2073',\n",
       "    '66  ',\n",
       "    'NOTNAMED ',\n",
       "    Decimal('17.00'),\n",
       "    Decimal('-143.0000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.5830950'),\n",
       "    datetime.datetime(1957, 9, 10, 0, 0)),\n",
       "   ('2074',\n",
       "    '311 ',\n",
       "    'CELESTE  ',\n",
       "    Decimal('12.50'),\n",
       "    Decimal('-135.7000'),\n",
       "    25,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('2.2561030'),\n",
       "    datetime.datetime(1976, 7, 18, 0, 0)),\n",
       "   ('2075',\n",
       "    '93  ',\n",
       "    'DOT      ',\n",
       "    Decimal('15.70'),\n",
       "    Decimal('-141.2000'),\n",
       "    60,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.6082760'),\n",
       "    datetime.datetime(1959, 8, 1, 0, 0)),\n",
       "   ('2076',\n",
       "    '93  ',\n",
       "    'DOT      ',\n",
       "    Decimal('15.80'),\n",
       "    Decimal('-141.8000'),\n",
       "    90,\n",
       "    0,\n",
       "    'H2',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.1045360'),\n",
       "    datetime.datetime(1959, 8, 2, 0, 0)),\n",
       "   ('2077',\n",
       "    '311 ',\n",
       "    'CELESTE  ',\n",
       "    Decimal('13.00'),\n",
       "    Decimal('-137.9000'),\n",
       "    25,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.2369320'),\n",
       "    datetime.datetime(1976, 7, 19, 0, 0)),\n",
       "   ('2078',\n",
       "    '93  ',\n",
       "    'DOT      ',\n",
       "    Decimal('15.70'),\n",
       "    Decimal('-142.9000'),\n",
       "    100,\n",
       "    0,\n",
       "    'H3',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.1045360'),\n",
       "    datetime.datetime(1959, 8, 2, 0, 0)),\n",
       "   ('2079',\n",
       "    '311 ',\n",
       "    'CELESTE  ',\n",
       "    Decimal('13.30'),\n",
       "    Decimal('-139.1000'),\n",
       "    25,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.4472140'),\n",
       "    datetime.datetime(1976, 7, 19, 0, 0)),\n",
       "   ('2080',\n",
       "    '124 ',\n",
       "    'C        ',\n",
       "    Decimal('17.90'),\n",
       "    Decimal('-142.1000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.8062260'),\n",
       "    datetime.datetime(1962, 8, 29, 0, 0)),\n",
       "   ('2081',\n",
       "    '314 ',\n",
       "    'FERNANDA ',\n",
       "    Decimal('12.10'),\n",
       "    Decimal('-136.3000'),\n",
       "    35,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.7000000'),\n",
       "    datetime.datetime(1976, 7, 29, 0, 0)),\n",
       "   ('2082',\n",
       "    '124 ',\n",
       "    'C        ',\n",
       "    Decimal('17.80'),\n",
       "    Decimal('-142.9000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.1045360'),\n",
       "    datetime.datetime(1962, 8, 29, 0, 0)),\n",
       "   ('2083',\n",
       "    '314 ',\n",
       "    'FERNANDA ',\n",
       "    Decimal('12.10'),\n",
       "    Decimal('-137.0000'),\n",
       "    35,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.6324560'),\n",
       "    datetime.datetime(1976, 7, 29, 0, 0)),\n",
       "   ('2084',\n",
       "    '314 ',\n",
       "    'FERNANDA ',\n",
       "    Decimal('12.30'),\n",
       "    Decimal('-137.6000'),\n",
       "    30,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.6324560'),\n",
       "    datetime.datetime(1976, 7, 29, 0, 0)),\n",
       "   ('2085',\n",
       "    '154 ',\n",
       "    'CONNIE   ',\n",
       "    Decimal('17.60'),\n",
       "    Decimal('-140.8000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.9055390'),\n",
       "    datetime.datetime(1966, 8, 12, 0, 0)),\n",
       "   ('2086',\n",
       "    '314 ',\n",
       "    'FERNANDA ',\n",
       "    Decimal('12.50'),\n",
       "    Decimal('-138.2000'),\n",
       "    30,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.9486830'),\n",
       "    datetime.datetime(1976, 7, 30, 0, 0)),\n",
       "   ('2087',\n",
       "    '154 ',\n",
       "    'CONNIE   ',\n",
       "    Decimal('17.70'),\n",
       "    Decimal('-141.7000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.9055390'),\n",
       "    datetime.datetime(1966, 8, 12, 0, 0)),\n",
       "   ('2088',\n",
       "    '154 ',\n",
       "    'CONNIE   ',\n",
       "    Decimal('17.80'),\n",
       "    Decimal('-142.6000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.7000000'),\n",
       "    datetime.datetime(1966, 8, 13, 0, 0)),\n",
       "   ('2089',\n",
       "    '314 ',\n",
       "    'FERNANDA ',\n",
       "    Decimal('12.80'),\n",
       "    Decimal('-139.1000'),\n",
       "    30,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.9486830'),\n",
       "    datetime.datetime(1976, 7, 30, 0, 0)),\n",
       "   ('2090',\n",
       "    '168 ',\n",
       "    'DENISE   ',\n",
       "    Decimal('16.30'),\n",
       "    Decimal('-141.6000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('2.4083190'),\n",
       "    datetime.datetime(1967, 7, 14, 0, 0)),\n",
       "   ('2091',\n",
       "    '181 ',\n",
       "    'RAMONA   ',\n",
       "    Decimal('15.80'),\n",
       "    Decimal('-140.5000'),\n",
       "    25,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.6082760'),\n",
       "    datetime.datetime(1967, 10, 29, 0, 0)),\n",
       "   ('2092',\n",
       "    '314 ',\n",
       "    'FERNANDA ',\n",
       "    Decimal('13.10'),\n",
       "    Decimal('-140.0000'),\n",
       "    30,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.2041590'),\n",
       "    datetime.datetime(1976, 7, 30, 0, 0)),\n",
       "   ('2093',\n",
       "    '314 ',\n",
       "    'FERNANDA ',\n",
       "    Decimal('13.20'),\n",
       "    Decimal('-141.2000'),\n",
       "    30,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.4035670'),\n",
       "    datetime.datetime(1976, 7, 30, 0, 0)),\n",
       "   ('2094',\n",
       "    '181 ',\n",
       "    'RAMONA   ',\n",
       "    Decimal('15.90'),\n",
       "    Decimal('-141.1000'),\n",
       "    25,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.8000000'),\n",
       "    datetime.datetime(1967, 10, 29, 0, 0)),\n",
       "   ('2095',\n",
       "    '181 ',\n",
       "    'RAMONA   ',\n",
       "    Decimal('15.90'),\n",
       "    Decimal('-141.9000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.7071070'),\n",
       "    datetime.datetime(1967, 10, 29, 0, 0)),\n",
       "   ('2096',\n",
       "    '314 ',\n",
       "    'FERNANDA ',\n",
       "    Decimal('13.30'),\n",
       "    Decimal('-142.6000'),\n",
       "    30,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('1.5033300'),\n",
       "    datetime.datetime(1976, 7, 31, 0, 0)),\n",
       "   ('2097',\n",
       "    '181 ',\n",
       "    'RAMONA   ',\n",
       "    Decimal('16.00'),\n",
       "    Decimal('-142.6000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.4123110'),\n",
       "    datetime.datetime(1967, 10, 30, 0, 0)),\n",
       "   ('2098',\n",
       "    '320 ',\n",
       "    'KATE     ',\n",
       "    Decimal('13.40'),\n",
       "    Decimal('-141.1000'),\n",
       "    30,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.2828430'),\n",
       "    datetime.datetime(1976, 9, 22, 0, 0)),\n",
       "   ('2099',\n",
       "    '181 ',\n",
       "    'RAMONA   ',\n",
       "    Decimal('16.10'),\n",
       "    Decimal('-143.0000'),\n",
       "    45,\n",
       "    0,\n",
       "    'TS',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.3162280'),\n",
       "    datetime.datetime(1967, 10, 30, 0, 0)),\n",
       "   ('2100',\n",
       "    '320 ',\n",
       "    'KATE     ',\n",
       "    Decimal('13.60'),\n",
       "    Decimal('-141.3000'),\n",
       "    30,\n",
       "    0,\n",
       "    'TD',\n",
       "    'Eastern Pacific',\n",
       "    Decimal('0.3162280'),\n",
       "    datetime.datetime(1976, 9, 22, 0, 0))],\n",
       "  'total': (118456,)}}"
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "readable_description"
   ]
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python [conda root]",
   "language": "python",
   "name": "conda-root-py"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}