week3_ann_user_representations.ipynb

{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "a424b415-b8ef-47b3-84ee-7c40332e01ef",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "a424b415-b8ef-47b3-84ee-7c40332e01ef",
    "outputId": "806eb166-961b-401d-a64b-a3b523f67eee"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Looking in indexes: https://pypi.org/simple, https://us-python.pkg.dev/colab-wheels/public/simple/\n",
      "Requirement already satisfied: faiss-cpu in /usr/local/lib/python3.7/dist-packages (1.7.2)\n"
     ]
    }
   ],
   "source": [
    "!pip install faiss-cpu --no-cache"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "837dcaa9-cc0b-4345-bbee-3a09683decf9",
   "metadata": {
    "id": "837dcaa9-cc0b-4345-bbee-3a09683decf9"
   },
   "outputs": [],
   "source": [
    "import pickle\n",
    "import faiss\n",
    "import numpy as np"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "41f1f7cb-9441-4fe1-962e-9e4cb3e3c192",
   "metadata": {
    "id": "41f1f7cb-9441-4fe1-962e-9e4cb3e3c192"
   },
   "source": [
    "# **Welcome to week 3 project!**\n",
    "\n",
    "Congratulations on making it to week 3! 👏 In the first week of this course, we covered the basics of how to design personalized recommendation systems. We then provided some system design examples for large scale recommenders from corporations like Spotify and YouTube, as well as techniques for candidate generation, specifically the two-tower model being used at Twitter and Pinterest.\n",
    "\n",
    "Last week, we covered details of ML approaches for recommendations: including multi-task recommenders and contextual bandits.\n",
    "\n",
    "In week 3, we covered various techniques for learning user representations.\n",
    "\n",
    "In this week's project, we will touch upon two key aspects related to representations:\n",
    "1. How do we query large amount of vectors in efficient time.\n",
    "2. How can we infer various user representations and see what their impact is on downstream task.\n",
    "\n",
    "Lets begin with Part A, which tells us how we could handle a large number of candidate items or user representations in an efficient manner. \n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "d0e01328-6834-4b11-85c1-03867e1d4860",
   "metadata": {
    "id": "d0e01328-6834-4b11-85c1-03867e1d4860"
   },
   "source": [
    "# Part A: Approximate nearest neighbor search\n",
    "\n",
    "Often we are interested in finding nearest neighbors in a large space of vectors. To store embeddings for 400 million users and over 100 million items and querying them in real time is a challenging task. This is where approximate nearest neighbor approaches step in to help. Annoy, Faiss, ScaNN are typical libraries that are used for efficient vector similarity search at scale. They implement algorithms that search in sets of vectors of any size, up to ones that possibly do not fit in RAM.\n",
    "\n",
    "In the first part of this week's project, we will simulate embeddings of 1 million items and try to find k-nearest neighbours for an item of interest. We will implement a vanilla search function to fetch the top-k nearest neighbors and estimate the time it takes for us to do so. We will then compare this with FAISS -- Facebook's nearest neighbour search library, and compare the time it takes for us to get nearest neighbours from FAISS versus our own implementation."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "3fa2b438-be53-4f39-b990-859046a4a560",
   "metadata": {
    "id": "3fa2b438-be53-4f39-b990-859046a4a560"
   },
   "source": [
    "Lets first generate a simulated dataset of embeddings of 1 million items."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 124,
   "id": "8c36fc8b-a032-4b48-bbeb-3bff46624615",
   "metadata": {
    "id": "8c36fc8b-a032-4b48-bbeb-3bff46624615"
   },
   "outputs": [],
   "source": [
    "d = 64                           # dimension\n",
    "nb = 1000000                     # database size\n",
    "nq = 10000                       # nb of queries\n",
    "np.random.seed(1234)             # make reproducible\n",
    "xb = np.random.random((nb, d)).astype('float32')\n",
    "xq = np.random.random((nq, d)).astype('float32')"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "142c00a5-f36b-4a5f-9e27-4a3e38b467d7",
   "metadata": {
    "id": "142c00a5-f36b-4a5f-9e27-4a3e38b467d7"
   },
   "source": [
    "Now that we have these items, lets take up the goal of finding the top-5 items closest to this specific item. Your goal is to implement your function to estimate the top-5 items and print the average distance of these top 5 items to the query item."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 125,
   "id": "b2dd70b9-8d2c-4134-b866-ab09af43a47d",
   "metadata": {
    "id": "b2dd70b9-8d2c-4134-b866-ab09af43a47d"
   },
   "outputs": [],
   "source": [
    "k=100\n",
    "query_vector = xb[2:3]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 126,
   "id": "84a94ee2-3131-44c5-ba95-ec67aa675048",
   "metadata": {
    "id": "84a94ee2-3131-44c5-ba95-ec67aa675048"
   },
   "outputs": [],
   "source": [
    "def find_top_k_nn(query_vector,k):\n",
    "    \"\"\"\n",
    "    in this function, implement your definition of top-k nearest neighbours, and return the distances\n",
    "    and indices of the these top-k items.\n",
    "    \"\"\"\n",
    "    diff = (xb - query_vector)\n",
    "    \n",
    "    distances = np.sum(np.power(diff,2),axis=1)\n",
    "    \n",
    "    nearest_ind = distances.argsort()[:k]\n",
    "    nearest_dist = distances[nearest_ind]    \n",
    "    return nearest_dist, nearest_ind"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "b8a895ce-4f0b-41a5-8243-90f18bff8d7b",
   "metadata": {
    "id": "b8a895ce-4f0b-41a5-8243-90f18bff8d7b"
   },
   "source": [
    "With your top-k NN function implemented, call this function to get the top-k nearest neighbor items for the query_vector and print the average distance. Also, print the time it takes to run this function:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 127,
   "id": "0df9e9f8-a854-4896-9ebd-fd74bad21690",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "0df9e9f8-a854-4896-9ebd-fd74bad21690",
    "outputId": "8a437d97-3687-4a39-b350-b8bf4306ea91"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "distances from the k nearest neighbor fetched: [0.        4.220494  4.385453  4.693385  4.986585  5.023638  5.039115\n",
      " 5.0635023 5.1817183 5.19837   5.2019987 5.2107935 5.2181077 5.2549696\n",
      " 5.3355985 5.371022  5.4094386 5.411251  5.4133472 5.4412184 5.4437838\n",
      " 5.4525437 5.465001  5.4682126 5.475479  5.48162   5.485236  5.488901\n",
      " 5.4919424 5.4974623 5.510071  5.5101943 5.5154295 5.523851  5.5310755\n",
      " 5.534624  5.5422916 5.5487666 5.5584583 5.55914   5.5605493 5.561209\n",
      " 5.5622663 5.5672035 5.567475  5.5880833 5.5930023 5.595544  5.595991\n",
      " 5.599178  5.610838  5.621844  5.6310005 5.633049  5.633503  5.6383133\n",
      " 5.641781  5.6424046 5.645651  5.648133  5.663582  5.665924  5.6689262\n",
      " 5.669259  5.677083  5.681033  5.687221  5.689271  5.690996  5.6941824\n",
      " 5.7027645 5.7045503 5.7089496 5.7158055 5.7182493 5.7182817 5.7209415\n",
      " 5.72406   5.727923  5.728325  5.7391577 5.7402463 5.742808  5.74842\n",
      " 5.774626  5.7848635 5.792692  5.7957134 5.8006477 5.8007984 5.806692\n",
      " 5.8072014 5.818973  5.819042  5.8229065 5.824873  5.8256235 5.825795\n",
      " 5.830673  5.834903 ]\n",
      "indices from the k nearest neighbor fetched: [     2 379284 539651 400245 409413 281290 463047 859123 417313 492428\n",
      " 105194 779234 289833 777570  54374 614812 595754  53702 177280 265741\n",
      " 801477 751466 511353 244364 301464 588486 403997 910114  44158 328539\n",
      " 288144 366113 324299 627336 574762 436711 823565  51506 201405  49254\n",
      "  57660 402131 652444 271530 630840 240209 997524 639258 855669 433700\n",
      " 429051 773811  24115 604200 400943 791938 873120  74082 912114 853492\n",
      " 642391    304  28648 703885   5103 161493 640242 265808 391607 628203\n",
      " 675772 773377 169619 140758 102880  80567  97440 694707 950346 804117\n",
      " 370576 942717 799821 972764 558164 377113 585351 216913 385875 628785\n",
      " 428333 755221 547667 653456 820557 884156 427071 570906 658257 784655]\n",
      "average distance of the k- nearest neighbors fetched:  5.491751\n",
      "CPU times: user 1.64 s, sys: 2.99 ms, total: 1.64 s\n",
      "Wall time: 1.63 s\n"
     ]
    }
   ],
   "source": [
    "%%time\n",
    "D, I = find_top_k_nn(query_vector, k)\n",
    "print(\"distances from the k nearest neighbor fetched:\",D)\n",
    "print(\"indices from the k nearest neighbor fetched:\",I)\n",
    "print(\"average distance of the k- nearest neighbors fetched: \",D.mean())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 128,
   "id": "w6hFDucN2dB6",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "w6hFDucN2dB6",
    "outputId": "fe64d7b2-e3b7-4650-c928-92ba9e0c5381"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "([{'name': 'Brute Force', 'recall@100': 1, 'wall_time_ms': '1690'}],\n",
       " array([     2, 379284, 539651, 400245, 409413, 281290, 463047, 859123,\n",
       "        417313, 492428, 105194, 779234, 289833, 777570,  54374, 614812,\n",
       "        595754,  53702, 177280, 265741, 801477, 751466, 511353, 244364,\n",
       "        301464, 588486, 403997, 910114,  44158, 328539, 288144, 366113,\n",
       "        324299, 627336, 574762, 436711, 823565,  51506, 201405,  49254,\n",
       "         57660, 402131, 652444, 271530, 630840, 240209, 997524, 639258,\n",
       "        855669, 433700, 429051, 773811,  24115, 604200, 400943, 791938,\n",
       "        873120,  74082, 912114, 853492, 642391,    304,  28648, 703885,\n",
       "          5103, 161493, 640242, 265808, 391607, 628203, 675772, 773377,\n",
       "        169619, 140758, 102880,  80567,  97440, 694707, 950346, 804117,\n",
       "        370576, 942717, 799821, 972764, 558164, 377113, 585351, 216913,\n",
       "        385875, 628785, 428333, 755221, 547667, 653456, 820557, 884156,\n",
       "        427071, 570906, 658257, 784655]))"
      ]
     },
     "execution_count": 128,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import pandas as pd\n",
    "\n",
    "def recall(gt, preds):\n",
    "\n",
    "    i = set(preds).intersection(set(gt))\n",
    "    return round(len(i)/len(gt),2)\n",
    "\n",
    "algos_results  = []\n",
    "gt_indices = I.copy()\n",
    "alg_name = 'name'\n",
    "time_col = 'wall_time_ms'\n",
    "recall_col = f'recall@{k}'\n",
    "algo_result_dict = {alg_name:'Brute Force',time_col:1690,recall_col:1}\n",
    "algos_results.append(algo_result_dict) \n",
    "\n",
    "\n",
    "\n",
    "algos_results, gt_indices"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "bd4452f5-ce17-43df-95f2-e9b58e8cad5e",
   "metadata": {
    "id": "bd4452f5-ce17-43df-95f2-e9b58e8cad5e"
   },
   "source": [
    "Now lets switch to using Faiss https://github.com/facebookresearch/faiss\n",
    "\n",
    "Faiss is a library for efficient similarity search and clustering of dense vectors. It contains algorithms that search in sets of vectors of any size, up to ones that possibly do not fit in RAM. "
   ]
  },
  {
   "cell_type": "markdown",
   "id": "b6427be9-53b2-446c-851b-b2f6b7db9fa6",
   "metadata": {
    "id": "b6427be9-53b2-446c-851b-b2f6b7db9fa6"
   },
   "source": [
    "### Similarity search in Faiss\n",
    "\n",
    "Given a set of vectors x_i in dimension d, Faiss builds a data structure in RAM. After the structure is constructed, when given a new vector x in dimension d it performs efficiently the operation:\n",
    "\n",
    "$i = argmin_i ||x - x_i||$\n",
    "\n",
    "where ||.|| is the Euclidean distance (L2).\n",
    "\n",
    "In Faiss terms, the data structure is an index, an object that has an add method to add x_i vectors. Note that the x_i's are assumed to be fixed. Computing the argmin is the search operation on the index.\n",
    "\n",
    "### Indexes used by Faiss\n",
    "\n",
    "1. The inverted file from “Video google: A text retrieval approach to object matching in videos.”, Sivic & Zisserman, ICCV 2003. This is the key to non-exhaustive search in large datasets. Otherwise all searches would need to scan all elements in the index, which is prohibitive even if the operation to apply for each element is fast\n",
    "\n",
    "\n",
    "2. The product quantization (PQ) method from “Product quantization for nearest neighbor search”, Jégou & al., PAMI 2011. This can be seen as a lossy compression technique for high-dimensional vectors, that allows relatively accurate reconstructions and distance computations in the compressed domain.\n",
    "\n",
    "\n",
    "3. The three-level quantization (IVFADC-R aka IndexIVFPQR) method from \"Searching in one billion vectors: re-rank with source coding\", Tavenard & al., ICASSP'11."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "3e63810d-fd22-49ca-b4bd-423ebf348c5f",
   "metadata": {
    "id": "3e63810d-fd22-49ca-b4bd-423ebf348c5f"
   },
   "source": [
    "We will implement these three indexes from faiss and use each of these three to search the index, and get the top-k nearest neighbour vectors, and estimate the average distance.\n",
    "\n",
    "Lets first construct the three indexes: index1, index2, index3 based on Flat index, Inverted index and product quantization techniques:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 129,
   "id": "76487ec4-a020-4ccd-aa33-f6ef25869048",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "76487ec4-a020-4ccd-aa33-f6ef25869048",
    "outputId": "4264b8dc-76fa-4048-85e0-4f57f53d40a5"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "total number of vectors indexed =  1000000\n",
      "CPU times: user 88.4 ms, sys: 1.01 ms, total: 89.4 ms\n",
      "Wall time: 87.6 ms\n"
     ]
    }
   ],
   "source": [
    "%%time\n",
    "index1 = faiss.IndexFlatL2(d)   # build the index\n",
    "index1.add(xb)                  # add vectors to the index\n",
    "print(\"total number of vectors indexed = \",index1.ntotal)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 130,
   "id": "55447035-57e2-4938-837b-9bf20bf66ff6",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "55447035-57e2-4938-837b-9bf20bf66ff6",
    "outputId": "c25a7161-1ce0-4b96-f4a3-237e2e5f642f"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "total number of vectors indexed =  1000000\n",
      "CPU times: user 3.05 s, sys: 201 ms, total: 3.25 s\n",
      "Wall time: 885 ms\n"
     ]
    }
   ],
   "source": [
    "%%time\n",
    "nlist = 100\n",
    "quantizer = faiss.IndexFlatL2(d)  # the other index\n",
    "index2 = faiss.IndexIVFFlat(quantizer, d, nlist, faiss.METRIC_L2)\n",
    "index2.train(xb)\n",
    "index2.add(xb)\n",
    "print(\"total number of vectors indexed = \",index2.ntotal)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 131,
   "id": "f04ebe3c-705d-49b2-aa7b-3602c111c754",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "f04ebe3c-705d-49b2-aa7b-3602c111c754",
    "outputId": "75d23288-f382-462c-c4be-500b7c45bf97"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "total number of vectors indexed =  1000000\n",
      "CPU times: user 55 s, sys: 170 ms, total: 55.1 s\n",
      "Wall time: 14.1 s\n"
     ]
    }
   ],
   "source": [
    "%%time\n",
    "nlist = 100\n",
    "m = 8\n",
    "quantizer = faiss.IndexFlatL2(d)  # this remains the same\n",
    "index3 = faiss.IndexIVFPQ(quantizer, d, nlist, m, 8)\n",
    "                                  # 8 specifies that each sub-vector is encoded as 8 bits\n",
    "index3.train(xb)\n",
    "index3.add(xb)\n",
    "print(\"total number of vectors indexed = \",index3.ntotal)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "047a6682-f771-4672-8998-307f4cfad5f5",
   "metadata": {
    "id": "047a6682-f771-4672-8998-307f4cfad5f5"
   },
   "source": [
    "Now that we have these three indexes, let us query these to fetch the top-k nearest neghbour for our query_vector and compute the average distance we obtain for each.\n",
    "\n",
    "We will also time these commands, to find out the trade-off between accuracy and latency."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 132,
   "id": "K9dpFuaE7Oka",
   "metadata": {
    "id": "K9dpFuaE7Oka"
   },
   "outputs": [],
   "source": [
    "k=100"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 133,
   "id": "2e54dc7d-5d15-47b2-85e4-c583f92d52a8",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "2e54dc7d-5d15-47b2-85e4-c583f92d52a8",
    "outputId": "8bdc8d07-3eec-49dc-b12d-5f4e900efb95"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "distances from the k nearest neighbor fetched: [[0.        4.2204943 4.3854527 4.6933837 4.986585  5.0236387 5.039115\n",
      "  5.0635023 5.181718  5.1983695 5.202     5.2107935 5.218108  5.25497\n",
      "  5.335598  5.371022  5.409438  5.411251  5.4133463 5.44122   5.443784\n",
      "  5.4525437 5.465     5.4682117 5.475479  5.4816194 5.485237  5.4889007\n",
      "  5.4919424 5.497461  5.5100703 5.5101943 5.5154295 5.5238504 5.531076\n",
      "  5.5346236 5.542292  5.548766  5.5584583 5.55914   5.5605493 5.56121\n",
      "  5.5622673 5.567204  5.5674753 5.5880833 5.593002  5.5955434 5.5959907\n",
      "  5.599178  5.610837  5.621843  5.631002  5.633048  5.6335015 5.638313\n",
      "  5.641781  5.642405  5.645651  5.648133  5.6635823 5.665924  5.668926\n",
      "  5.66926   5.677084  5.6810336 5.6872215 5.689271  5.6909966 5.6941814\n",
      "  5.702764  5.7045507 5.7089496 5.715806  5.7182493 5.718281  5.720941\n",
      "  5.7240605 5.727922  5.728325  5.7391562 5.740246  5.7428083 5.7484207\n",
      "  5.774625  5.784863  5.7926927 5.7957125 5.800647  5.800799  5.806691\n",
      "  5.8072023 5.8189726 5.819043  5.822906  5.824873  5.825624  5.825796\n",
      "  5.8306737 5.8349037]]\n",
      "indices from the k nearest neighbor fetched: [[     2 379284 539651 400245 409413 281290 463047 859123 417313 492428\n",
      "  105194 779234 289833 777570  54374 614812 595754  53702 177280 265741\n",
      "  801477 751466 511353 244364 301464 588486 403997 910114  44158 328539\n",
      "  288144 366113 324299 627336 574762 436711 823565  51506 201405  49254\n",
      "   57660 402131 652444 271530 630840 240209 997524 639258 855669 433700\n",
      "  429051 773811  24115 604200 400943 791938 873120  74082 912114 853492\n",
      "  642391    304  28648 703885   5103 161493 640242 265808 391607 628203\n",
      "  675772 773377 169619 140758 102880  80567  97440 694707 950346 804117\n",
      "  370576 942717 799821 972764 558164 377113 585351 216913 385875 628785\n",
      "  428333 755221 547667 653456 820557 884156 427071 570906 658257 784655]]\n",
      "average distance of the k- nearest neighbors fetched:  5.4917507\n",
      "[[     2 379284 539651 400245 409413 281290 463047 859123 417313 492428\n",
      "  105194 779234 289833 777570  54374 614812 595754  53702 177280 265741\n",
      "  801477 751466 511353 244364 301464 588486 403997 910114  44158 328539\n",
      "  288144 366113 324299 627336 574762 436711 823565  51506 201405  49254\n",
      "   57660 402131 652444 271530 630840 240209 997524 639258 855669 433700\n",
      "  429051 773811  24115 604200 400943 791938 873120  74082 912114 853492\n",
      "  642391    304  28648 703885   5103 161493 640242 265808 391607 628203\n",
      "  675772 773377 169619 140758 102880  80567  97440 694707 950346 804117\n",
      "  370576 942717 799821 972764 558164 377113 585351 216913 385875 628785\n",
      "  428333 755221 547667 653456 820557 884156 427071 570906 658257 784655]]\n",
      "CPU times: user 70 ms, sys: 1.01 ms, total: 71 ms\n",
      "Wall time: 68.9 ms\n"
     ]
    }
   ],
   "source": [
    "%%time\n",
    "D, I = index1.search(query_vector, k)\n",
    "print(\"distances from the k nearest neighbor fetched:\", D)\n",
    "print(\"indices from the k nearest neighbor fetched:\", I)\n",
    "print(\"average distance of the k- nearest neighbors fetched: \", D.mean())\n",
    "print(I)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 134,
   "id": "MwMaYzIq5Dge",
   "metadata": {
    "id": "MwMaYzIq5Dge"
   },
   "outputs": [],
   "source": [
    "\n",
    "algo_result_dict = {alg_name:'Flat Index',time_col:69,recall_col:recall(gt_indices,I[0])}\n",
    "algos_results.append(algo_result_dict) "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 135,
   "id": "be8f1b17-6108-41fd-814c-caa996fb731d",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "be8f1b17-6108-41fd-814c-caa996fb731d",
    "outputId": "19f006b7-a203-4ecf-b635-7801cdde3f75"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "distances from the k nearest neighbor fetched: [[0.        5.0635023 5.4133463 5.642405  5.66926   5.727922  5.854366\n",
      "  5.8810287 5.9096484 5.910324  5.986183  6.027997  6.061438  6.0735326\n",
      "  6.1380477 6.1491523 6.153688  6.1672106 6.172823  6.2601676 6.2688937\n",
      "  6.3065596 6.319533  6.3269286 6.3280187 6.3373003 6.347822  6.354624\n",
      "  6.3610773 6.3630986 6.374719  6.3772717 6.3869863 6.4082885 6.4120708\n",
      "  6.4231205 6.4246716 6.429863  6.4478626 6.4533987 6.4611216 6.468713\n",
      "  6.478479  6.483938  6.5040917 6.506431  6.5115666 6.512746  6.5191336\n",
      "  6.5486064 6.548811  6.5528483 6.5559263 6.5776215 6.5792847 6.594167\n",
      "  6.5986567 6.6041617 6.606336  6.621651  6.6272483 6.635232  6.6546855\n",
      "  6.654972  6.671098  6.676214  6.6794834 6.6798515 6.6844215 6.685588\n",
      "  6.69498   6.707263  6.717023  6.722185  6.7244697 6.7349005 6.742467\n",
      "  6.7523446 6.7672343 6.7683268 6.7701    6.775819  6.777635  6.7792664\n",
      "  6.7804804 6.7823205 6.7853923 6.8036547 6.8048887 6.815564  6.818999\n",
      "  6.8190804 6.826333  6.8312182 6.838818  6.8425536 6.843633  6.845588\n",
      "  6.851152  6.856256 ]]\n",
      "indices from the k nearest neighbor fetched: [[     2 859123 177280  74082 703885 950346 783023 264734 335413 880161\n",
      "  237512 460300 923202 203454 887321  21027 503310 228323 513310 872794\n",
      "  694969 870456 846764 265296 887285 348422 433136 599395 918001 275940\n",
      "  488369 250853 838147 741632 464002 204559 928274 568852 686319  84509\n",
      "  841943 435935    837 642831 158022 477819 916718 800085 765101 800436\n",
      "  757535 921132 321031 697543 474526 547558 742137 807162 543179 299992\n",
      "  351653 620749 531823  44915 967575 363427 614156 908910 941815 110100\n",
      "  895206  30422 572959 508671 420769  46232 469574 111717 820874 364682\n",
      "  188020 763086 126027 471045 191256 433906 487939 438877 379507 495743\n",
      "   52585  49655 355563  40846 726177 935538 970171 764242 492586 757170]]\n",
      "average distance of the k- nearest neighbors fetched:  6.4077716\n",
      "CPU times: user 3.86 ms, sys: 0 ns, total: 3.86 ms\n",
      "Wall time: 3.19 ms\n"
     ]
    }
   ],
   "source": [
    "%%time\n",
    "D, I = index2.search(query_vector, k)\n",
    "print(\"distances from the k nearest neighbor fetched:\", D)\n",
    "print(\"indices from the k nearest neighbor fetched:\", I)\n",
    "print(\"average distance of the k- nearest neighbors fetched: \", D.mean())\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 136,
   "id": "qHC26TKV5VHm",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "qHC26TKV5VHm",
    "outputId": "03d03472-3e8d-4c34-dbfb-eeb572f56465"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(array([     2, 859123, 177280,  74082, 703885, 950346, 783023, 264734,\n",
       "        335413, 880161, 237512, 460300, 923202, 203454, 887321,  21027,\n",
       "        503310, 228323, 513310, 872794, 694969, 870456, 846764, 265296,\n",
       "        887285, 348422, 433136, 599395, 918001, 275940, 488369, 250853,\n",
       "        838147, 741632, 464002, 204559, 928274, 568852, 686319,  84509,\n",
       "        841943, 435935,    837, 642831, 158022, 477819, 916718, 800085,\n",
       "        765101, 800436, 757535, 921132, 321031, 697543, 474526, 547558,\n",
       "        742137, 807162, 543179, 299992, 351653, 620749, 531823,  44915,\n",
       "        967575, 363427, 614156, 908910, 941815, 110100, 895206,  30422,\n",
       "        572959, 508671, 420769,  46232, 469574, 111717, 820874, 364682,\n",
       "        188020, 763086, 126027, 471045, 191256, 433906, 487939, 438877,\n",
       "        379507, 495743,  52585,  49655, 355563,  40846, 726177, 935538,\n",
       "        970171, 764242, 492586, 757170]),\n",
       " array([     2, 379284, 539651, 400245, 409413, 281290, 463047, 859123,\n",
       "        417313, 492428, 105194, 779234, 289833, 777570,  54374, 614812,\n",
       "        595754,  53702, 177280, 265741, 801477, 751466, 511353, 244364,\n",
       "        301464, 588486, 403997, 910114,  44158, 328539, 288144, 366113,\n",
       "        324299, 627336, 574762, 436711, 823565,  51506, 201405,  49254,\n",
       "         57660, 402131, 652444, 271530, 630840, 240209, 997524, 639258,\n",
       "        855669, 433700, 429051, 773811,  24115, 604200, 400943, 791938,\n",
       "        873120,  74082, 912114, 853492, 642391,    304,  28648, 703885,\n",
       "          5103, 161493, 640242, 265808, 391607, 628203, 675772, 773377,\n",
       "        169619, 140758, 102880,  80567,  97440, 694707, 950346, 804117,\n",
       "        370576, 942717, 799821, 972764, 558164, 377113, 585351, 216913,\n",
       "        385875, 628785, 428333, 755221, 547667, 653456, 820557, 884156,\n",
       "        427071, 570906, 658257, 784655]))"
      ]
     },
     "execution_count": 136,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "I[0], gt_indices"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 137,
   "id": "9pVdIhcN5FCY",
   "metadata": {
    "id": "9pVdIhcN5FCY"
   },
   "outputs": [],
   "source": [
    "\n",
    "algo_result_dict = {alg_name:'Inverted Index',time_col:2.16,recall_col:recall(gt_indices,I[0])}\n",
    "algos_results.append(algo_result_dict) "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 138,
   "id": "2b230291-517c-49c5-a634-f9d4d331e241",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "2b230291-517c-49c5-a634-f9d4d331e241",
    "outputId": "9c13427c-506d-4bbb-944a-18230708d902"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "distances from the k nearest neighbor fetched: [[1.1111705 5.027693  5.1296997 5.1854224 5.254571  5.2913146 5.2916803\n",
      "  5.3909717 5.4220757 5.461261  5.477116  5.504705  5.5168166 5.535221\n",
      "  5.538763  5.5475025 5.5592566 5.565252  5.5666323 5.5838213 5.6232944\n",
      "  5.6298604 5.630932  5.6431193 5.644653  5.673264  5.7022367 5.717231\n",
      "  5.7451    5.774563  5.793782  5.7944636 5.801092  5.8095055 5.8147345\n",
      "  5.820806  5.8514605 5.8553085 5.858291  5.8617344 5.862078  5.8625593\n",
      "  5.867205  5.8733206 5.8764663 5.8877106 5.894153  5.895195  5.899698\n",
      "  5.9166737 5.9183903 5.9284925 5.930323  5.931334  5.937811  5.9440746\n",
      "  5.9471164 5.953898  5.9564433 5.9583793 5.960458  5.9667172 5.976976\n",
      "  5.979692  5.98024   5.9812007 5.996601  6.0052037 6.0079594 6.012891\n",
      "  6.0160375 6.035487  6.0409837 6.041004  6.0461397 6.0473747 6.0534797\n",
      "  6.0542564 6.0556717 6.056331  6.0583277 6.058645  6.0620766 6.062077\n",
      "  6.063703  6.06542   6.0844564 6.100461  6.1006675 6.104231  6.108195\n",
      "  6.112049  6.117606  6.131611  6.132495  6.1334105 6.137003  6.1393046\n",
      "  6.1588798 6.1607847]]\n",
      "indices from the k nearest neighbor fetched: [[     2 351653 703885 841943 348422 950346 933621 807162 887285 190641\n",
      "    7515 765101 880706 229007 464002 554385 887321 460300 265296 505627\n",
      "  838147 495743  74082 921132 788837 364682 880161 469574 870456 488616\n",
      "  146573 677620 243028 478679 619099 563343 474526 908910 669470 172699\n",
      "   86069 984573 859123 324441 835142 801241 438877 824016    837 237512\n",
      "   49655 392482 203454 158022 488369 913943 432055  46232 160930 533737\n",
      "  166710 538993 941117 433136 483508 445093  21027 461082 786475 553811\n",
      "  670877 742137 426136 652840 846764 115177 631170 204559 177669 649930\n",
      "  152512 828899 509174 119825 156984 363427 648535 542969 800428 839897\n",
      "   30422 335413 918001 987148 420769 958336 512381 487939 654427 415281]]\n",
      "average distance of the k- nearest neighbors fetched:  5.796538\n",
      "CPU times: user 7.19 ms, sys: 3.99 ms, total: 11.2 ms\n",
      "Wall time: 8.58 ms\n"
     ]
    }
   ],
   "source": [
    "%%time\n",
    "D, I = index3.search(query_vector, k)\n",
    "print(\"distances from the k nearest neighbor fetched:\", D)\n",
    "print(\"indices from the k nearest neighbor fetched:\", I)\n",
    "print(\"average distance of the k- nearest neighbors fetched: \", D.mean())\n",
    "\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 139,
   "id": "huixxSX_5Gb6",
   "metadata": {
    "id": "huixxSX_5Gb6"
   },
   "outputs": [],
   "source": [
    "\n",
    "algo_result_dict = {alg_name:'Product Quantization Index',time_col:2.18,recall_col:recall(gt_indices,I[0])}\n",
    "algos_results.append(algo_result_dict) "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 147,
   "id": "BDGqrqQa6-ar",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 175
    },
    "id": "BDGqrqQa6-ar",
    "outputId": "0fcc4924-ffc6-4ede-90fb-33ad00d18d70"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "\n",
       "  <div id=\"df-4faf138b-089a-4fb8-acdd-fa0c5d074e5b\">\n",
       "    <div class=\"colab-df-container\">\n",
       "      <div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>name</th>\n",
       "      <th>wall_time_ms</th>\n",
       "      <th>recall@100</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Brute Force</td>\n",
       "      <td>1690.00</td>\n",
       "      <td>1.00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Flat Index</td>\n",
       "      <td>69.00</td>\n",
       "      <td>1.00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Inverted Index</td>\n",
       "      <td>2.16</td>\n",
       "      <td>0.06</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Product Quantization Index</td>\n",
       "      <td>2.18</td>\n",
       "      <td>0.05</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>\n",
       "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-4faf138b-089a-4fb8-acdd-fa0c5d074e5b')\"\n",
       "              title=\"Convert this dataframe to an interactive table.\"\n",
       "              style=\"display:none;\">\n",
       "        \n",
       "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
       "       width=\"24px\">\n",
       "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
       "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
       "  </svg>\n",
       "      </button>\n",
       "      \n",
       "  <style>\n",
       "    .colab-df-container {\n",
       "      display:flex;\n",
       "      flex-wrap:wrap;\n",
       "      gap: 12px;\n",
       "    }\n",
       "\n",
       "    .colab-df-convert {\n",
       "      background-color: #E8F0FE;\n",
       "      border: none;\n",
       "      border-radius: 50%;\n",
       "      cursor: pointer;\n",
       "      display: none;\n",
       "      fill: #1967D2;\n",
       "      height: 32px;\n",
       "      padding: 0 0 0 0;\n",
       "      width: 32px;\n",
       "    }\n",
       "\n",
       "    .colab-df-convert:hover {\n",
       "      background-color: #E2EBFA;\n",
       "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
       "      fill: #174EA6;\n",
       "    }\n",
       "\n",
       "    [theme=dark] .colab-df-convert {\n",
       "      background-color: #3B4455;\n",
       "      fill: #D2E3FC;\n",
       "    }\n",
       "\n",
       "    [theme=dark] .colab-df-convert:hover {\n",
       "      background-color: #434B5C;\n",
       "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
       "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
       "      fill: #FFFFFF;\n",
       "    }\n",
       "  </style>\n",
       "\n",
       "      <script>\n",
       "        const buttonEl =\n",
       "          document.querySelector('#df-4faf138b-089a-4fb8-acdd-fa0c5d074e5b button.colab-df-convert');\n",
       "        buttonEl.style.display =\n",
       "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
       "\n",
       "        async function convertToInteractive(key) {\n",
       "          const element = document.querySelector('#df-4faf138b-089a-4fb8-acdd-fa0c5d074e5b');\n",
       "          const dataTable =\n",
       "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
       "                                                     [key], {});\n",
       "          if (!dataTable) return;\n",
       "\n",
       "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
       "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
       "            + ' to learn more about interactive tables.';\n",
       "          element.innerHTML = '';\n",
       "          dataTable['output_type'] = 'display_data';\n",
       "          await google.colab.output.renderOutput(dataTable, element);\n",
       "          const docLink = document.createElement('div');\n",
       "          docLink.innerHTML = docLinkHtml;\n",
       "          element.appendChild(docLink);\n",
       "        }\n",
       "      </script>\n",
       "    </div>\n",
       "  </div>\n",
       "  "
      ],
      "text/plain": [
       "                         name  wall_time_ms  recall@100\n",
       "0                 Brute Force       1690.00        1.00\n",
       "1                  Flat Index         69.00        1.00\n",
       "2              Inverted Index          2.16        0.06\n",
       "3  Product Quantization Index          2.18        0.05"
      ]
     },
     "execution_count": 147,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "results_df = pd.DataFrame(algos_results)\n",
    "results_df.wall_time_ms = results_df.wall_time_ms.astype('float')\n",
    "results_df"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "c2c902e3-c9bf-408e-9052-11af5a3b069f",
   "metadata": {
    "id": "c2c902e3-c9bf-408e-9052-11af5a3b069f"
   },
   "source": [
    "Running all these, we observe that the product quantization based index is an order of magnitude faster than the inverted index. In terms of accuracy, if we assume that the lower the distance the more accurate the result, FlatIndex gives us the least distance."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "044a818f-19ab-4c26-8532-922c9aa1d673",
   "metadata": {
    "id": "044a818f-19ab-4c26-8532-922c9aa1d673"
   },
   "source": [
    "### Goal 1 for this week: Implement your k-NN function and time it\n",
    "\n",
    "The main goal for this part of the project is to implement your vanilla nearest neighbor function and fetch the closest k nearest neighbours to the query vector. Important to note that your implementation will give an exact result, i.e., your implementation will find the exact closest k vectors that will give the minimum distance to the query_vector.\n",
    "\n",
    "Please compile the results in a table, and compare the average distance obtained and the time it took to query the 1 million vectors. A nice 2D plot would also give you a good idea of the speed-accuracy trade-off involved."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 148,
   "id": "2e69dd09-6a21-49a8-8ca8-4d5164a7e674",
   "metadata": {
    "id": "2e69dd09-6a21-49a8-8ca8-4d5164a7e674"
   },
   "outputs": [],
   "source": [
    "import matplotlib.pyplot as plt\n",
    "import seaborn as sns\n",
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 169,
   "id": "5cve1ME_727A",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 654
    },
    "id": "5cve1ME_727A",
    "outputId": "7c3e212b-497d-4073-fd49-1da48ad49014"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Text(0, 0.5, 'Time ms (log scale)')"
      ]
     },
     "execution_count": 169,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAABJsAAAJrCAYAAABHtZI+AAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAgAElEQVR4nOzdebh153w//vcnIkFwxFRqaKIh5lQ9qCGEoPTrETVUqCHlJyiKVmueqlVaSg3lG19EqsRUw2MmkzEqxiAiQYQMiMRJTBnv3x9rnWTnZJ9hn2ed5zz7nNfrus51zl7DXp+991prn/3e932vaq0FAAAAAIaww1oXAAAAAMD6IWwCAAAAYDDCJgAAAAAGI2wCAAAAYDDCJgAAAAAGI2wCAAAAYDDCJoAVqKp9qqpV1YvmTT+yqtoqbXO3fpsHr8b9D22h52i9q6rLV9WLq+qEqjq3fw4esNZ1TZshjqWqOqB//g8YqKwNadrOPSysqq5TVW+rqp9U1YX963q1ta5rJSZ5H16L9+yVqqqTquqkta4DYGsJm4CpVFW37f9x/NIC8x/Wz29VtfuY+Vesqt9V1W+qaufVr/gy2z9ypL7l/By8rWtkxf4uyQuSnJrkFUlenOS7a1rRAHwAGk5V3auqXllVh1XVL/pj/HPLWO/mVfXuqvpZf/46vg82r7jIOneqqo9W1ZlV9duq+mZVPa2qLjfA4zi4r323rb2vjax/Do/cRps7OMkjkxyV5J/SnZ9+t9gKK91fGY7gHJhGO651AQAr9LUkZyW5bVVdtbV29rz5+yZpSSrJPZK8ed78OyfZOcmnWmvnrnaxYxyc5Mh50x6QZK8kH0zy9Xnzvp7klCQ3SzK7yrUN5X/T1XvGWheyjd0vya+S3Ku1dt5aFzPFHpXkSlt5H+9PcnSS07a+nEE9Kcl+6T7kn5jk6kutUFV3SHJ4kssneW+SH6c7t70gyb5Vte/8c1lV7Zfkff123pXkzCSbk7wq3TnwIcusd9rOPYxRVTsluVeST7fW/nKCVSfeX7eRId5jhjjPDG3ftS4AYAjCJmAqtdYu6r8J/vMkd0uyZd4i90gX5tw648Ome/S/D1u9KhfWWjt4/rS+dcBeST4wbn5valrItNZ+kymqd0C/n+QXgqat01o7eYD7mM32GZC8PMlz0x0fN0jyw8UW7lshvTXdh+L9Wmsf6qfvkOTdSR6U5OlJXjayzlWTvCnJhUn2aa0d009/frrQ6sFVtX9r7dClim2tnZ+NeSyvN9dJ16vh1AnXm2h/3VaGeI8Z4jwztNba99e6BoAh6EYHTLO5oOgeoxP70Gb3fv5RSe4+Zt1LhU1VdZOqellVHVNVP+/H2vlRVR1UVddfleontNC4KSNdWXavqidX1Xf6LjYnVdVzqqr65R5SVf9bVb/uu+G8bqHuN1V10/5+f1xV51XVT6vqHVW15wT1LjpGRlXt2Nc3N7bRj6vq5f2378vdxqCPvar2rqot1Y1ncm5VnV5VR1fVC5dbS7p97w9GukCeNG+5v6iqz1TVbN+t6diqenaN6c7ZP46TquqqVfXv/d/nz39Ox6x38b7S79vv6h/3RVW1z8hyf1pdF6sz+sf7/ar6txoZw2XudUzyB/Me16X2xf72kdWNCfP/quqU6saEOWBkmTtU1Xv75/W8/jX/v1X1+2Mew6XGUqmq/fttvGqBx7xzVZ1VVadV1Y79tLFdT0ae1136x3ty//hPrKpnzu0389apqnrqyD52Sr8fzdSEXQxba19srX27tXbhMle5W7oWHJ+ZC5r6+7koyT/0N58wr+4HJ7lWkkPngqZ+nd8leV5/84nL2XiNOff0r82j+5s/XGR/v3pV/UtVHdfv77PVdce695jtXPx6Vdd167NV9avqzslvndsvq+o2VfXh/vX+VVV9qMZ05auqG1V3Dj+x3/aZ/fH2xqq6xnIee38/+1bVx/v1z62q71X3fjEzZtkF94WqelH/+PYZfbz97LvNO7ZetMzablxVh/T743lVdWp/+8bz60ryo/7mo8cdwwtZwf66WL1zx96Vq+pV/Tngt1X19erHtqvuveG51b03/K6689KTx9zXVo8LOP88MzJ9h6p6QlV9ud/Hft3//cTqQt75y8+d/67Z73On9fvKt6vqryas6VL7UHVfrL21v/nWefvJbiPL7VhVf13de9bZ1Q0T8LXq3ht3mLeN0feIP6zuvPyLqjqnqj5ZVbfsl7vWyOP5Xf8cXOZ/qqq6SlU9v6q+1W/7nP51e1dV3XaSxw+sH1o2AdPs8P73/Cbn+47Mn03ywKq6eWvtO8nF3/hvStcN76v9sg9M8oQkRyT5QpLzktwiyf+XZHNVbWqtnbJaD2Qgr0iyT7pWXp9Mcv8k/5xkp6o6M12rhw8k+Wy6rhRPSnK5zPvAWVX3SfI/6brrbEnXbeL66Z6j/1NVd2+tfTVb7x1J9k7ysSRnJ/mzdB+cr51kon/OM8Bj7x/3R/paPpSu69DV033I/+t0Y5ss5gNJTkrytP72q/vfvxzZxkuTPDtdt493pOtud98kL03yp1V17zEtonZKty9fvX9sZ2f5LQv+MMmXknwvyX8nuWK/fqoL0F6UrmvVh5P8LF1LwGck+bOqumPfPfWk/rHPf1zJZbt7Xj1dt7VfpduHLkry0357j0lyUJJz0z2/P05y41xyjP3JEq0MPpDueH54Vf19a+2CefP3S3K1JK8cM2+cyyf5RLqWaB9LckG6rqwvS3KFXPb1fn26/eXU/nGcl24/u31/X+cvY5srNReOf3z+jNbaD6rqe0lukuRGSb6/1DpJPpPkN0nuVFU7r7Ar8YtzSdff/8gl+/no/v4H6VqY7pbu2Pt4kl3SdTX9eFU9vrX2pjH3ff9+mQ8neWOSOyU5IMluVfXsdF8SfDZdi9VbpesaeKOqunUfwKWqrpvky0mumuSj6boTXiFdGPzIJK9L8oulHmRVPT7JG5L8Osl70h0n+yR5Zrr99s6ttV8ufA+L+nq65/GF6YKgg0fmHbmM2m6X5NNJrpLumPpOkpsmeUSS/arqnq21L/eLvzrd6/DUJN9IdzzN1bCtXT7Jp9KdLz6Y7hz3sCTvqy6E/Oskd0h3XJ6brrvna6vq5621d22jGv8rycPTnaf+X7pu+X+e5D+T3CXJuG6IV0vy+XTnhvem66r/kCRvqaqLWmtvW2EtB6c7rvbLZbvZ/zLpLkyR7v3vT5Mcn+795Xfpvmx7bbrn85Fj7nu3dO8Rx/Xb2S3d4zyyqu6Y7pg9O1033Ksn2T/Jx6rqJnPn66qqfrk7JfliuufrgnT/N9w93bH6lRU+dmCatdb8+PHjZ2p/0n3wuyjJtUam/XeSc9IF6rdI90/ik0fmb+6n/c/ItOsl2XnM/d87XTeUN8ybvk9/Hy+aN/3I7tS6osdycH+fBywwf7d+/sELrHdSkuuNTL9aulDj10l+nuRmI/N2TvfB5Nwk1x6Zvmu6EO6MJDeft51bpgsRvrrMx7Poc5Tun8+rj0zfJV2wdWGS60z4nA3x2N/X39deY7ZzzQlex5OSnDRm+h37+z959PH1++mWft5zxtxXS/eBcpcJapjbV1qSl46Zf/d+3heSXG3evAP6ea9azuMamT+3vUOS7Dhv3k3SfQA7cfR16uft27/m71/qWEryf/tt3G/M9j/Sz7vVmMdywJjH0tKFEFccmX7tdB/efpnk8iPT9+6XP370+Ur3Ifkzc/vgcl+fBV6rzy2yzHv6ZR60wPwP9/PvOzLty/202y6wzrf6+TeboMaFzj27LbDekenOz/vPm361dB+Yf5vk98a8XhckudvI9B3ShRMtXTj6l/Pu7839vP1Gpj2ln/bUMXXtMvq6L/K4/yDdeeLsJDedN+8/+/s/aLnHSbpwt6Xr1jj/2Dlywv2m0gUEbczz8dB++neT7LDU6zj0/rrE+nPH3paMvOeOHGNn9vvu6HF2o3Tnj6/Nu699ssz34QmXfVi/7FeTXHnefnNMP+/hY17Dli5oudzI9Jv3+/N3JnyOTpo3be7YOGCJfeu187Z/uQWOj91Gan7uvPt6/shr8cZ5+9AjM+/9IV3g2zLvHN7P2yHJrivd3/z48TPdP7rRAdPusHT/dI826757ks+21i5orX073TfRo13tLjNeU2vtlDbm2/3W2ieTfDvdt4Xbu5e0kdZXrfu2/UPpxnl5Q2vtuJF556b7pnKndC135jwq3QfBF7a+JdjIOt9KNwbMbarq5gPU+8zW2pkj9//rdEHhDulank1iiMc+57fzJ7TWhhjk/DH9739qrZ0+ct8XpLuC3UXpWvmM83f98zOpn2Z8i6y/6X8/rs1rldG68cK+nvHf3C/lvCTPaJdtWfTEdK0ZntrmtRBsrR2W7rXaXFVXWeL+51oGPHp0YlVdJ90x+rXW2rET1Ps3rbWLX+/W2s/StRyYSTLaZXRue/88+ny1rhXasyfY3krNdddaaPypuemjl7BfyTqDqaq90nX/e1+bNy5U/xy+MF1LoweNWf2drbWjRpa/KF1LkyT5Vmvtv+ctf0j/+4/G3Ne44/nXo6/7Ih6R7jzxutba/LGBnpvuS41H1hpc0TRdK5KbJvni/Oejda1/PpduH77LGtS2HE8bfc9trX02XYvNXdO9N4weZz9I12LoljXAVRSXYe5c/azW2q9G6vh1uhZtyfhz9W+S/G0b6W7Yv49+PsnNqurKq1Fs30XuKUlOT/L0edu/MN37S8v4c/pJGRnrrTd3nt05yd/3x9+cd6QLz5Z7rF3UWjtreY8EWG90owOm3eHpPhDcI8m7q+pmSa6b7mpLc45Mcq+q2qH/p+kyYVPfDPwv0317uFe6f3hH/6mdhsGejxkzbW4g2HFN2Oc+9I+OSXXH/vdeC4yDcZP+983StQ7aGuPq/XH/e9cB7mvSx/7f6boKfqmq3pWuS+XnW2s/mbCWhfxx//vw+TNaa9+rqp8k2b2qZlo3sPWc3yX55gq3+Y1xIWq61/n8JA+pqnFXJNspybWq6hqttSW7Go04qQ9sxm0v6calud2Y+ddOd7zdJIt0t2itfaHvMra5qnYd+RDzl/36B09Q62xr7cQx08ftg7fpf4+73PvR6T58cWlzr/nMAueSa/W/xwW+QxzPH0rXPfX1VfWn6bpMfj5dC5O2SN2jFjtmz6qqryW5a7rQ5xvLvM+hLFjbyPS7pNt3P7NNKlq+X7bxg2Cfmq6b40Kv8Y7pBjlf7S7tf5wu/D9yzLyj0rXEvM2YeSe0y14ZN7n0OeVXY+ZvrZuk6+J2QpLn1WWHnEu6IGjcsfb1dtmxuOaOte+11s4ZndFau7CqfppLH2vfSfcFxcP6rrMfTHeuPKa5UAZsaMImYNrNBUb7zvs9+g/4kUn+Il2LnJPTNfk+Zd431f+ebkya09J9KDkll3xLd0C67hTbu3EtGC5YxrzLj0ybGzT3cUtsa6u/oZ3fomZeTZN+e73Vj7219j9Vdb903wI/Jsnjk6SqvpLk2a21T01Y03xzLU1OW2D+aUlumK6lyWjNP5vgw/F8py8w/Rrp/gd44RLrXznLGNdmmdtLkr9fxvaW8rZ043Htn24snaRreXR+um/dl2uhcXbG7YNzr91P5y/cf/ia5Dlaibn94TIDUs+bPvqYVrLOkOZe83v1PwsZ95oPcTz/qKpun6570X3SBclJ8uOqekVr7TWL1DRnOcdsskqtw5awPde2lIVa212QXHwVybHzcun3q9Uyk+TMcUFJa+2CqjojXUA+3yTnlCHNHWs3zuLn9GUda/1jHDuvd0EufaxdWFX3SPKCdBcmeHk/65yqelu698/VCNmA7ZxudMBUa90Ald9PskdV3SBdq6VfJvnayGJH9L/vka6LXeXSrZquna5b0beS7Nlae0Rr7ZmttRe11l6UbsyOjWLun8u9Wmu1yM9KBzrdrrXWPtJau0e6b6D3TddC7hZJPjxA18G55/Y6C8y/7rzlLi5rK7a50LqzSc5a4jWu1tqPFlh/JdtLkpkltnfUAuuP+q90rQ4enXRXJksXIH90oO6O48y1Vvi9+TP6bj3LvrLZCh3f/77JAvPnrjz2veWsU93V+nZP96HxB0MUOMbca/7UJV7zSS8GsGytteNaaw9N9/psSvKsdP/7/kdVPXYZd7GSY/aiLPxl7pDBz0rPJyxtNsnV+0G3L6U/dq6ZS84J24O51/j9Sxxru69WAa21s1prT2+t3SCXXPjhu0menEu+FAA2GGETsB7MBUf3TDcI6FGjYwz0LZhOTxc2XaYLXbrBR3dI8sn5Tcar6vr9/I3i6P733mtaxRrrx3Q5vLX2t+m64uyU7qpxW2MuAN1n/oyq2iNdt4QfLtDia2hHJ9m1qm4xwToXZuXfzA+2X7XWfpyu5eIdqmrPXDKe0moGoHOv3bjxb/4kq99SfK6l5n3mz6iqG6ULlH6USwdHC66TruvXlZJ8YYFulss11/1m3H6x3ZxLWjd+31daay9PN/hz0l1JbymLHbNXSzduze/SDdQ956wkvzcuqMjCY9FdlMmPrQVr682NYzjElUM3mq+l+5/grmPm3TXda7Wtn9fFjrXvpvuS7U8W2O+2qdbaia21N6cbs+1X6a6iB2xAwiZgPZj7UPX0dC1SjhizzBHpPvTcu789Gjad1P++y+jgo/1gnm/Kxupy/NZ0/7S+sO+CcilVtUNV7bPNq9oGququ/bfW8821ZvnNVm7iLf3v51XV3Hg1cy1jXpHuPfnNW7mN5Zob0+xNVfX782dW1S5V9SfzJv8i3ThOV1zB9l6Xrpvbq6pqXEubnapqklDi4P73Y9OFB2ekuyLbapkbgPq5VXVxt7Sq2ildGLnajkoXaNy1qu4/sv0dckmXlTfO62753nTPy/5VtWlknSsk+af+5ta2OJjrPnjD+TNaa8eku+T5A6vqMfPn97Xcqm9ZOriquu3oazVikuP57en226f0gfColyS5apK3zwvs/jfde8alWmxV1QFJ7rzAdn6R5AbLqGfU59O1XrtLVT143rYenO797nsZP84Yi5s7V/9LVV1pbmL/99xg2tvqXD1nsWPtgnRXobtukteMO0dX1XUHurDHZVTV7n3oPd+u6QYZX85g/MA6tJE+QAHr1+HpL3k+cnu+I9J9KN09yfHt0lcuO72qDk03BszXq+qT6cZsuFe6b62/nvFXXll3Wmu/6D+ovD/J0VV1WLqr8bV0H4bumK5LyhXWrspV85ok16uqz6cLIM9Lctt0reF+lOTQhVddWj+49b8m+Yck36qq9yb5dboWU7dM96Hw37ZmGxPUclhVPSvJvyQ5oao+mu5KUFdONz7Z3fp6RlvFHJbkdkk+XlWfSde99ButtS3L2N53+8DhLUm+XVUfT/dB+PLpPjztneTn6QZaXo73p+vG8rT+Pl7bWjt/metOrLV2VFUdlOTAdPW/L10IsTldF5ZT07VOWZaquksuuZrV3DgqN66qg0e2ecDI3xdW1V+lO7e9t993Tk7X1XNTuuBh9KIIaa2dXVWPSxc6Hdmf485Mcv90Vyl7b7qrMm6Nw9KNw/Wm/jk5J93gz6/r5z+8r/nNVfU3Sb6ULsy+fpJbp9vv75juiqFDe2SSx1fV59J1tT4ryR+me83OTfLqpe6gtXZSVT0tyeuTfLWq3p1uP71bX/d3c8nVyea8Nl3Q9Iaq2jfd4NB/1C//4ST3G7Opw9KFglvStZg5P8lnWmsLDuzdWmtV9egkn0ryrqr6YF/PnulabZ2T5FHzriS2IpPur9OutfaOqtov3ViP366qD6R7D3xAuv8h3tUue0XE1fbFdAHp06rqGrlkfLzX9mNcvSTdxU2ekO4CCoenG3vy2um6td053RUUt/bCHuPsleR/qurL6ULxU9NdAGC/dOfnly+yLrCOCZuAqdda+3lVHZvuw8sZ6cZemm+0tdNhY+Y/Nl0XlIcmeVK6DxQfSjfg5fsGLXg71wcRt07yjHSXk987XfByaroPjuv1+Xhpkj9P9+H9nunCg5P76a9uA1y+ubX2zP4KVk9O8qh0/4h/P8nzkrxyW165p7X28j5Y+5t03cP2SxecnJLkoFx2sO1/SjfmzOZ0H1wul67r2pJhU7+9t1fVN9INwH73dK0Mf51uv5oo+Git/aaq3pPuuE1WtwvdnCem+zD/+HQf6H6RLvR6TpKfpHsdl2uPXNL9b8615007YHRma+1L/ZX8XpzuubtKuhD0H5O8bFx3uNbaB6rqbuk+ZD4oXUh8YpK/TfKarRh4fu7+P1FVf5fuggJPS9fd9EfpWrKltfaTqrptusuyPyiXXDXw9HQfel+b5NitqWER70zXquJO6ULjK6bbtw9Nd6yNe5+4jNbaf1bVienOhw9K1/3wx+mC4ZfO7/baWvtOVd0z3Xljc7pxsT6bLmx6YMaHTU9NF2bsm+TP0rVyfHGWuIrcyD7xvHTnrM3p3gPfmeQlrbXjF1t/AhPvr+vAw9K1KLz4YhHpgpRXZg3GIGrd1Q8flG4A8AOS7NLPenu6K2ueX1UPSHd13gPS7WdXTve/zA+TPD/dFVdXwzHpWnzdLd0XFLv22/1KuvPMx1Zpu8B2rrby/wwAgA2rqm6crpXWoa21hy21PADARmDMJgCAJVTVdfoxkkanXSmXdMd6/7avCgBg+6QbHQDA0p6W5GFVdWSS09Jdcn7fdOMPfSzJe9auNACA7YuwCQBgaZ9KNxDuvZNcPd1YPN9LN7D8q7d2/CMAgPXEmE0AAAAADMaYTQAAAAAMZt13o7vmNa/Zdtttt7UuAwAAAGDd+MpXvnJGa+1a4+at+7Bpt912yzHHHLPWZQAAAACsG1X1o4Xm6UYHAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMZt2GTVW1uaoOmp2dXetSAAAAADaMdRs2tda2tNYOnJmZWetSAAAAADaMdRs2AQAAALDtCZsAAAAAGIywCQAAAIDBCJsAAAAAGIywCQAAAIDBCJsAAAAAGIywCQAAAIDBCJsAAAAAGIywCQAAAIDBCJsAAAAAGIywCQAAAIDB7LjWBaw3t/37Q9a6BNiQvvJvj1rrEgAAAIiWTQAAAAAMSNgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCmKmyqqptV1Rur6r1V9cS1rgcAAACAS1vzsKmq3lJVP6uqb82bfp+qOr6qTqyqZyVJa+241toTkvxFkjuvRb0AAAAALGzNw6YkBye5z+iEqrpcktcnuW+Smyd5WFXdvJ93/yQfSfLRbVsmAAAAAEtZ87CptfaZJGfOm3z7JCe21n7QWjsvyaFJ9uuX/1Br7b5J/nLbVgoAAADAUnZc6wIWcL0kPx65/ZMkd6iqfZI8MMnOWaRlU1UdmOTAJLnhDW+4elUCAAAAcCnba9g0VmvtyCRHLmO5g5IclCSbNm1qq1sVAAAAAHPWvBvdAk5JcoOR29fvpwEAAACwHdtew6YvJ7lxVe1eVTsl2T/Jh9a4JgAAAACWsOZhU1W9M8kXk+xZVT+pqse21i5I8uQkn0hyXJJ3t9a+vZZ1AgAAALC0NR+zqbX2sAWmfzSLDAIOAAAAwPZnzVs2AQAAALB+CJsAAAAAGMy6DZuqanNVHTQ7O7vWpQAAAABsGOs2bGqtbWmtHTgzM7PWpQAAAABsGOs2bAIAAABg2xM2AQAAADAYYRMAAAAAgxE2AQAAADAYYRMAAAAAgxE2AQAAADCYdRs2VdXmqjpodnZ2rUsBAAAA2DDWbdjUWtvSWjtwZmZmrUsBAAAA2DDWbdgEAAAAwLYnbAIAAABgMMImAAAAAAYjbAIAAABgMMImAAAAAAYjbAIAAABgMMImAAAAAAYjbAIAAABgMOs2bKqqzVV10Ozs7FqXAgAAALBhrNuwqbW2pbV24MzMzFqXAgAAALBhrNuwCQAAAIBtT9gEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGDWbdhUVZur6qDZ2dm1LgUAAABgw1i3YVNrbUtr7cCZmZm1LgUAAABgw1i3YRMAAAAA256wCQAAAIDBCJsAAAAAGIywCQAAAIDBCJsAAAAAGIywCQAAAIDBCJsAAAAAGIywCQAAAIDBCJsAAAAAGIywCQAAAIDBCJsAAAAAGMy6DZuqanNVHTQ7O7vWpQAAAABsGOs2bGqtbWmtHTgzM7PWpQAAAABsGOs2bAIAAABg2xM2AQAAADAYYRMAAAAAgxE2AQAAADAYYRMAAAAAgxE2AQAAADAYYRMAAAAAgxE2AQAAADAYYRMAAAAAgxE2AQAAADAYYRMAAAAAgxE2AQAAADAYYRMAAAAAgxE2AQAAADAYYRMAAAAAg1m3YVNVba6qg2ZnZ9e6FAAAAIANY92GTa21La21A2dmZta6FAAAAIANY92GTQAAAABse8ImAAAAAAYjbAIAAABgMMImAAAAAAYjbAIAAABgMMImAAAAAAYjbAIAAABgMMImAAAAAAYjbAIAAABgMMImAAAAAAYjbAIAAABgMMImAAAAAAYjbAIAAABgMMImAAAAAAYjbAIAAABgMMImAAAAAAYjbAIAAABgMMImAAAAAAYjbAIAAABgMOs2bKqqzVV10Ozs7FqXAgAAALBhrNuwqbW2pbV24MzMzFqXAgAAALBhrNuwCQAAAIBtT9gEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRn53d8IAACAASURBVNgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMZsdJV6iqmya5YZJrJvltkp8lOba1dvbAtQEAAAAwZZYVNlXVPZI8Nsk904VM811UVV9L8t4kb2mtnTFciQAAAABMi0XDpqp6YJJ/TnKTJJXklCQfTHJ6kjOTXDHJNZLcNMkfJdmU5MVVdUiSF7TWfrp6pQMAAACwvVkwbKqqzyS5S5Ljkjw7yaGttZMXWX6nJHdP8ugkj0iyf1U9srX2oWFLBgAAAGB7tVjLpqsmecByw6LW2nlJPpHkE1V17STPSbLn1pcIAAAAwLRYMGxqrf3RSu+0tfazJE9b6foAAAAATKcd1roAAAAAANaPFYVNVbVLVd2mqvYeuqChVNXmqjpodnZ2rUsBAAAA2DAmCpuq6vpV9b4kZyU5JskRI/PuUlXfqap9hi1xZVprW1prB87MzKx1KQAAAAAbxrLDpqq6bpIvJdkvyYeTfDFJjSzypSTXTvLQIQsEAAAAYHpM0rLphenCpHu11h6Y5FOjM1tr5yf5bJI7D1ceAAAAANNkkrDpz5J8qLV2xCLLnJzk97euJAAAAACm1SRh0+8lOWGJZc5PssvKywEAAABgmk0SNp2Z5AZLLHOTJKevvBwAAAAAptkkYdPnk9y/qq4zbmZV3TjJfTJyhToAAAAANpZJwqZ/S3KFJEdV1X2TXClJqmqX/vaWJBcleeXgVQIAAAAwFXZc7oKttS9V1eOTvCHJh0dmnd3/viDJY1pr3x6wPgAAAACmyLLDpiRprb2lqj6b5K+T/EmSaySZTXJ0kte11o4fvkQAAAAApsVEYVOStNZOSPL0VagFAAAAgCk3yZhNAAAAALCoBVs2VdUNV3qnrbWTV7ouAAAAANNrsW50JyVpK7jPtsT9AgAAALBOLRYKHZKVhU0AAAAAbFALhk2ttQO2YR0AAAAArAMGCAcAAABgMMImAAAAAAYz8UDeVXW7JH+a5HpJdh6zSGutPXZrCwMAAABg+iw7bKqqSnJwkkckqXSDh9fIIm1kurAJAAAAYAOapBvdk5M8Msl/JdmULlh6dZI7JXlOknOSHJrkRgPXCAAAAMCUmKQb3aOTHD93lbquoVN+2Vo7OsnRVfWJJEcn+VSStw5cJwAAAABTYJKWTTdNcvi8aReHVa21ryX5cJK/HqAuAAAAAKbQpFejmx35+9dJrj5v/gnpQikAAAAANqBJwqZT0l2Bbs4Pktx23jI3ThdCAQAAALABTRI2/W8uHS59LMntq+r5VXWLqnpSkv3SjdsEAAAAwAY0Sdj0viSXq6rd+9v/muRHSV6c5JtJXpvkl0meNWiFAAAAAEyNZV+NrrX2gSQfGLl9ZlXdJsnjkvxhkpOSHNJaO23oIgEAAACYDssOm8Zprc0mecVAtQAAAAAw5Sa9Gh0AAAAALGjZYVNVPaGqvl9Vv7/A/Ov18x87XHkAAAAATJNJWjY9PMlprbVTx81srZ2S5CdJHjFEYQAAAABMn0nCpj2TfGOJZb6Z5KYrLwcAAACAaTZJ2DST5JdLLHN2kl1XXg4AAAAA02ySsOm0JLdeYplbJ/n5yssBAAAAYJpNEjYdkeQ+VXWXcTOrau8k901y2BCFAQAAADB9JgmbXp7kvCSfrqp/r6p7V9Ut+t+vSvKpJOf2ywEAAACwAe243AVba8dX1V8keUeSpyV56sjsSjde08Nba8cNWyIAAAAA02LZYVOStNY+UlU3SnJAkjskuVq6QcOPTvK21tovBq8QAAAAgKkxUdiUJH2g9MpVqAUAAACAKTfJmE0Lqqpdq2qXIe4LAAAAgOm17LCpqvatqn+tql1Hpl27qo5KckaSM6vq31ejSAAAAACmwyQtm56S5IGttbNGpr0iyd5Jvp/kF0me2g8iDgAAAMAGNEnYtFeSz83dqKorJnlwkk+11m6SZM8kP07yhEErBAAAAGBqTBI2XTvJqSO375DkCkkOTpLW2jlJPpwudAIAAABgA5okbDo3yRVHbu+dpCX5zMi0s5NcfYC6AAAAAJhCk4RNP0xyj5HbD0pyQmvtlJFpN0g3WDgAAAAAG9AkYdPbktyqqr5UVZ9Ncqsk75i3zK2THD9UcfNV1QOq6k1V9a6quvdqbQcAAACAlZkkbHpDkkOTbEpy53TjM718bmZV3TJdAHXkJAVU1Vuq6mdV9a150+9TVcdX1YlV9awkaa19oLX2uHSDkD90ku0AAAAAsPqWHTa11s5vrT08ya5JZlpr+7XWzh1Z5PQkt0ny2glrODjJfUYnVNXlkrw+yX2T3DzJw6rq5iOLPK+fDwAAAMB2ZMdJV2itnb3A9DOygvGaWmufqard5k2+fZITW2s/SJKqOjTJflV1XJKXJflYa+2rk24LAAAAgNU1STe6bel6SX48cvsn/bSnJLlnkgdX1RMWWrmqDqyqY6rqmJ///OerWykAAAAAF5u4ZdNaaq29JslrlrHcQUkOSpJNmza11a4LAAAAgM722rLplCQ3GLl9/X4aAAAAANux7TVs+nKSG1fV7lW1U5L9k3xojWsCAAAAYAlrHjZV1TuTfDHJnlX1k6p6bGvtgiRPTvKJJMcleXdr7dtrWScAAAAAS1vzMZtaaw9bYPpHk3x0G5cDAAAAwFZY85ZNAAAAAKwfy27ZVFUvWMZiFyU5O13Xt6Naa+ettLCtVVWbk2zeY4891qoEAAAAgA1nkm50L0rSRm7XyN/zp7ckv6iqp7TW3rXy8lautbYlyZZNmzY9bi22DwAAALARTdKN7u5JPpjk/CRvTnJAkvv2v9/ST/9AkockeVmSKyR5e1XtPVy5AAAAAGzPJmnZ9AdJ7pXkdq21Y+fNO6SqXpfk80ne31p7blUdmuQrSZ6R5LODVAsAAADAdm2Slk1PT/LuMUFTkqS19o0k70nyt/3tY5N8JMkdt7ZIAAAAAKbDJGHTnklOX2KZU/vl5pyQ5GqTFgUAAADAdJokbDonS7dSulOSX43c3qVfDwAAAIANYJKw6aNJ7lZVL62qXUZnVNUuVfUvSe7aLzfnlklO2uoqAQAAAJgKkwwQ/ux0V6R7ZpInVNU3k/w0ye8luXW67nInJ3lOklTVdZPskeSNQxYMAAAAwPZr2WFTa+30qrpdkpcl2T9dK6Y5v01ycJJntdZ+1i9/WpLrDVfqZKpqc5LNe+yxx1qVAAAAALDhTNKNLq21n7fWHpuuFdOtk+ydZK8kV2utPWYuaNoetNa2tNYOnJmZWetSAAAAADaMSbrRXay1dn6Sbw1cCwAAAABTbkVhU1XdJclt0rVwmk3y1dba54YsDAAAAIDpM1HYVFW3TfJfSfacm5Sk9fOOT/Ko1toxg1YIAAAAwNRYdthUVXskOSzJVZN8LsnhSU5Lct0k90hylySfqqrbt9ZOWIVaAQAAANjOTdKy6flJrpLkoa2198yb96KqenCSQ5M8L8mjB6oPAAAAgCkyydXo7pnk/WOCpiRJa+29ST7YLwcAAADABjRJ2HTNJN9dYpnv9ssBAAAAsAFNEjb9PMnNl1jmpknOWHk5AAAAAEyzScKmw5Pcv6r2Hzezqh6UZL8knx6isK1VVZur6qDZ2dm1LgUAAABgw5hkgPB/TBcm/XdVPSnJEemuRnedJPukuxrdOUn+aeAaV6S1tiXJlk2bNj1urWsB2Fon/+Ot1roE2JBu+IJj17oEAICps+ywqbV2YlXdM8khSe7c/7Qk1S9yfJJHt9ZOGLxKAAAAAKbCJC2b0lr7cpKbVdWdkvxxkpkks0m+1lr7/CrUBwAAAMAUmShsmtNa+0KSLwxcCwAAAABTbpIBwgEAAABgUQu2bKqqF6zwPltr7SUrXBcAAACAKbZYN7oXrfA+WxJhEwAAAMAGtFjYdPdtVgUAAAAA68KCYVNr7ahtWQgAAAAA088A4QAAAAAMZsGwqaquuLV3PsR9AAAAADA9FmvZ9MOqempV7TzpnVbVXlX1wSTPWHlpW6eqNlfVQbOzs2tVAgAAAMCGs1jY9Ikk/57ktKp6Q1XdfbGWSlV1o6p6YlV9MclXk+yV5Ihhy12+1tqW1tqBMzMza1UCAAAAwIaz2ADhj66q1yX55yQH9j8XVtVxSU5LclaSKyS5RpI9k1wzSSX5WZLnJnlVa+3c1S0fAAAAgO3JgmFTkrTWvpzk3lV14ySPTbJvkj9Kcqt5i/48yf8keV+S97XWzl+FWgEAAADYzi0aNs1prZ2Q5FlJUlVXSnK9dC2afpvkZ62101atQgAAAACmxrLCplGttd8kOaH/AQAAAICLLTZAOAAAAABMRNgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMRtgEAAAAwGCETQAAAAAMZsflLlhVl0uyc2vtN/Om3yPJfkl+k+Sg1toPhy1xZapqc5LNe+yxx1qXAgAAALBhTNKy6RVJzqyqmbkJVbV/kk8leUqSZyb536q6wbAlrkxrbUtr7cCZmZmlFwYAAABgEJOETXdNckRrbXZk2guT/DLJo5L8Q5KrJfnb4coDAAAAYJpMEjbdIMmJczeq6kZJ9kzy2tba21trr0jysST3GbZEAAAAAKbFJGHTVZOcPXL7zklako+PTPt2kusPUBcAAAAAU2iSsOm0JLuP3L5nkt8m+crItCsnuWCAugAAAACYQsu+Gl2So5Pcv6rul+R3SR6c5LDW2vkjy+ye5JQB6wMAAABgikzSsuml/fIfTPKJJDsl+ee5mVV1hSR7J/nSkAUCAAAAMD2W3bKptXZsVd0hyaP7Se9qrX15ZJHbJDk8yTsHrA8AAACAKTJJN7q01o5N8owF5n0xyZ8PURQAAAAA02mSbnQAAAAAsKiJWjYlSVXdOsleSa6f5PJjFmmttZdsbWEAAAAATJ9lh01VdfUk/5XkPnOTFli0JRE2AQAAAGxAk7RsenWS+yb5dJK3JzklyQWrURQAAAAA02mSsOl+Sb7QWrv3ahUDAAAAwHSbZIDwyyX5wmoVAgAAAMD0myRs+mqSG61WIQAAAABMv0nCppckuV9V3WW1ihlSVW2uqoNmZ2fXuhQAAACADWPZYza11g6vqv2TvL+qPpyupdPYJKe1dshA9a1Ya21Lki2bNm163FrXAgAAALBRLDtsqqqdkuyXZNckj+5/2vzF+mlrHjYBAAAAsO1NcjW6f0kXMH0nybuSnJrkgtUoCgAAAIDpNEnYtH+SY5PcrrV23irVAwAAAMAUm2SA8Ksl+aSgCQAAAICFTBI2HZfkuqtVCAAAAADTb5Kw6ZVJHlBVN1mtYgAAAACYbpOM2XRKko8n+VJV/UeSrySZHbdga+0zA9QGAAAAwJSZJGw6MklLUkle0P+9kMttRU0AAAAATKlJwqZ/zOIBEwAAAAAb3LLDptbai1axDgAAAADWgUkGCAcAAACARQmbAAAAABiMsAkAAACAwQibAAAAABiMsAkAAACAwQibAAAAABiMsAkAAACAwaw4bKqqXavqBkMWAwAAAMB0myhsqqorV9Urq+r0JGck+eHIvDtU1Uer6o+HLhIAAACA6bDssKmqZpJ8McnTk5ya5LgkNbLIsUn2TvKwIQtcqaraXFUHzc7OrnUpAAAAABvGJC2bnpvkFkkOaK39cZL3jM5srf0myVFJ9h2uvJVrrW1prR04MzOz1qUAAAAAbBiThE0PTPKJ1tohiyzzoyTX27qSAAAAAJhWk4RN10/yzSWW+VUSTYkAAAAANqhJwqZzklx7iWV2TzdwOAAAAAAb0CRh05eT3K+qrjJuZlVdN8mfJfncEIUBAAAAMH0mCZv+I8k1kny0qm42OqO//Z4kV0jymuHKAwAAAGCa7LjcBVtrn6iqFyd5YZJvJTk/SarqjCS7Jqkkz2ytfWE1CgUAAABg+zdJy6a01l6cZN8kH0pyVpILk7QkH01yz9bavw1eIQAAAABTY9ktm+a01o5IcsQq1AIAAADAlJuoZRMAAAAALGbilk1JUlWV5DpJLj9ufmvt5K0pCgAAAIDpNFHYVFUPSfKsJLdcZN026f0CAAAAsD4sOxSqqicleU2SC5J8Pskp/d8AAAAAkGSyFkhPT/KzJHdqrf1wleoBAAAAYIpNMkD49ZK8R9AEAAAAwEImCZt+nGTn1SoEAAAAgOk3Sdj0tiT3raqrrFYxAAAAAEy3ScKmlyX5cpJPV9XdhE4AAAAAzLfssKm1dmGS1yfZI8nhSX5ZVReO+XGFOgAAAIANatlXo6uq/ZK8N8nlkvwwyalJBEsAAAAAXGzZYVOSFyX5TZL/01r73OqUAwAAAMA0m2TMpj2TvFPQBAAAAMBCJgmbzkhy3moVAgAAAMD0myRsel+Se1XV5VerGAAAAACm2yRh0/OSnJXkPVW126pUAwAAAMBUm2SA8GOTXD7JHZJsrqpfJpkds1xrrf3hEMUBAAAAMF0mCZt2SHJBkpNHptWY5cZNAwAAAGADWHbY1FrbbRXrAAAAAGAdmGTMJgAAAABY1LoNm6pqc1UdNDs7blgpAAAAAFbDgt3oqupR/Z/vb62dM3J7Sa21Q7a6sq3UWtuSZMumTZset9a1AAAAAGwUi43ZdHCSluToJOeM3F5M9cusedgEAAAAwLa3WNj0mHTB0Wn97b9a/XIAAAAAmGYLhk2ttYP7rnO7J/lma+1t264sAAAAAKbRUgOEvzXJA7ZFIQD8/+3deZRlZ1kv4N+bhNFIISQgiBBkEmQIEFGIQILohYsBgygEFMJgExFELhFwMQVcyKhcCSq3BQxwCSARhICCCCRAZMzEPF0TQIYwVxjCkOS9f+xdyaFS1VXdvatPd/XzrNXrnNrje071+Wqf3/m+7wAAAOz51gqbapdUAQAAAMCmsFbYBAAAAADrJmwCAAAAYDLb+ja6JVetqutuz0G7+/M7WA8AAAAAe7D1hE2PHv+tV6/zuAAAAABsMusJhc5P8u2NLgQAAACAPd96wqbnd/fTN7wSAAAAAPZ4JggHAAAAYDLCJgAAAAAmI2wCAAAAYDLCJgAAAAAms80JwrtbGAUAAADAugmTAAAAAJiMsAkAAACAyQibAAAAAJiMsAkAAACAyQibAAAAAJiMsAkAAACAyQibAAAAAJiMsAkAAACAyQibAAAAAJiMsAkAAACAyQibAAAAAJiMsAkAAACAyQibAAAAAJiMsAkAAACAyQibAAAAAJiMsAkAAACAyQibAAAAAJiMsAkAAACAyQibAAAAAJiMsAkAAACAyQibAAAAAJiMsAkAAACAyQibAAAAAJiMsAkAAACAyQibAAAAAJiMsAkAAACAyQibAAAAAJiMsAkAAACAyQibAAAAAJjMHhU2VdUvVNVLquqkedcCAAAAwGXNPWyqqpdW1Ver6qPLlt+tqj5VVZ+tqickSXf/V3c/dD6VAgAAALCWuYdNSU5IcrfZBVW1b5K/TXL3JDdLclRV3WzXlwYAAADA9ph72NTd70ryzWWLb5fks2NPph8leXWSe+3y4gAAAADYLnMPm1bxc0m+MPPzfyf5uaq6elW9KMmtq+rPV9u5qrZU1Yeq6kNf+9rXNrpWAAAAAEb7zbuA7dHd30hyzDq225pka5IccsghvdF1AQAAADDYXXs2fTHJz8/8fJ1xGQAAAAC7sd01bPpgkhtV1fWr6vJJ7pfkjXOuCQAAAIA1zD1sqqpXJXlvkptU1X9X1UO7+8Ikj0zy1iSfSPJP3f2xedYJAAAAwNrmPmdTdx+1yvJ/TfKvu7gcAAAAAHbC3Hs2AQAAALB5CJsAAAAAmMymDZuq6oiq2rq4uDjvUgAAAAD2Gps2bOruk7t7y8LCwrxLAQAAANhrbNqwCQAAAIBdT9gEAAAAwGSETQAAAABMRtgEAAAAwGSETQAAAABMRtgEAAAAwGSETQAAAABMZtOGTVV1RFVtXVxcnHcpAAAAAHuNTRs2dffJ3b1lYWFh3qUAAAAA7DU2bdgEAAAAwK4nbAIAAABgMsImAAAAACYjbAIAAABgMsImAAAAACYjbAIAAABgMsImAAAAACYjbAIAAABgMps2bKqqI6pq6+Li4rxLAQAAANhrbNqwqbtP7u4tCwsL8y4FAAAAYK+xacMmAAAAAHY9YRMAAAAAkxE2AQAAADAZYRMAAAAAkxE2AQAAADAZYRMAAAAAkxE2AQAAADAZYRMAAAAAkxE2AQAAADCZTRs2VdURVbV1cXFx3qUAAAAA7DU2bdjU3Sd395aFhYV5lwIAAACw19i0YRMAAAAAu56wCQAAAIDJCJsAAAAAmIywCQAAAIDJCJsAAAAAmIywCQAAAIDJCJsAAAAAmIywCQAAAIDJCJsAAAAAmIywCQAAAIDJCJsAAAAAmIywCQAAAIDJbNqwqaqOqKqti4uL8y4FAAAAYK+xacOm7j65u7csLCzMuxQAAACAvcamDZsAAAAA2PWETQAAAABMRtgEAAAAwGSETQAAAABMRtgEAAAAwGSETQAAAABMRtgEAAAAwGSETQAAAABMRtgEAAAAwGSETQAAAABMRtgEAAAAwGSETQAAAABMRtgEAAAAwGSETQAAAABMZtOGTVV1RFVtXVxcnHcpAAAAAHuNTRs2dffJ3b1lYWFh3qUAAAAA7DU2bdgEAAAAwK4nbAIAAABgMsImAAAAACYjbAIAAABgMsImAAAAACYjbAIAAABgMsImAAAAACYjbAIAAABgMsImAAAAACYjbAIAAABgMsImAAAAACYjbAIAAABgMsImAAAAACYjbAIAAABgMsImAAAAACYjbAIAAABgMsImAAAAACYjbAIAAABgMsImAAAAACYjbAIAAABgMps2bKqqI6pq6+Li4rxLAQAAANhrbNqwqbtP7u4tCwsL8y4FAAAAYK+xacMmAAAAAHY9YRMAAAAAkxE2AQAAADAZYRMAAAAAkxE2AQAAADAZYRMAAAAAkxE2AQAAADAZYRMAAAAAkxE2AQAAADAZYRMAAAAAkxE2AQAAADAZYRMAAAAAkxE2AQAAADAZYRMAAAAAkxE2AQAAADAZYRMAAAAAkxE2AQAAADAZYRMAAAAAkxE2AQAAADAZYRMAAAAAkxE2AQAAADCZ/eZdAAAAAJvHqXe687xLgL3Snd916rxLuISwCQBgL3Xo8YfOuwTYK532qNPmXQLAhjKMDgAAAIDJCJsAAAAAmIywCQAAAIDJCJsAAAAAmIywCQAAAIDJbNqwqaqOqKqti4uL8y4FAAAAYK+xacOm7j65u7csLCzMuxQAAACAvcamDZsAAAAA2PWETQAAAABMRtgEAAAAwGSETQAAAABMRtgEAAAAwGSETQAAAABMRtgEAAAAwGSETQAAAABMRtgEAAAAwGSETQAAAABMRtgEAAAAwGSETQAAAABMRtgEAAAAwGSETQAAAABMRtgEAAAAwGSETQAAAABMRtgEAAAAwGSqu+ddw4aqqq8l+dy862CPcECSr8+7CGDT0bYAG0HbAmwEbQvb43rdfeBKKzZ92ATrVVUf6u5D5l0HsLloW4CNoG0BNoK2hakYRgcAAADAZIRNAAAAAExG2ASX2jrvAoBNSdsCbARtC7ARtC1MwpxNAAAAAExGzyYAAAAAJiNsYrdWVRdV1VlVdXZVnVFVd9iBYxxdVdfezn2Oq6ovjuc+q6qetb3nBfYcM23N0r+DquqwqnrTGvsdXFX/c5V1a+6/wj7HVdWx27MPsOtU1Xd3wTl25LrloKr66HqXr+P8L9yefWAzmLkW+GhVvbaqrrwTxzqlqrb7G92q6qpV9YhtrL9OVb2hqj5TVf9VVS+sqivsaJ3bOM9hs++7quqYqnrgvI6zwnG1bXsAYRO7uwu6++DuvlWSP0/yzOUbVNV+axzj6CTbddE2ev547oO7+wnr2WEdtQC7pwtmXu8Hd/e569zv4CQrhk0A26uq9s2OX7cAO2fpWuDmSX6U5JjZlbvoOv+qSVYMm6qqkrwuyb90942S3CjJlZI8ZwPqOCzJJSFRd7+ou18+x+OwBxI2sSe5SpJvJZek5O+uqjcm+fjydLuqjh17CNwnySFJXjl+UnGlqrptVZ1aVadX1Vur6lrrOXkNnjt+2vGRqrrvKrXsW1XPG7f7cFU9atxuh84LzF9V3a6q3ltVZ1bVf1bVTarq8kmenuS+Y/ty323sf1xVvXT8pPO/qupPZtY9sao+XVXvSXKTmeU3qKq3jG3Gu6vqF6tqv6r6YFUdNm7zzKp6xsY9cmAl49/+U6rqpKr6ZFW9crxOuFtVvXbZdm8a7//m2I6cMfaa2H9cfm5VPbuqzkhyVNZ53TIuP7uqzk7yx+uo+eiqet3Yrnymqp4zs+7BYzv0gSSHziw/sKr+eWx3PlhVh47L37DUO6GqHl5Vr5zgaYXdybuT3HCF6/wrVtU/ju8Fzqyqw5NkfK2+uqo+UVWvzxACZVz33Zn796mqE8b716yq1y+9jmvoAfSsJDcYX//PXVbTXZL8oLv/MUm6+6Ikj0nywKrav5b13KmqN81cL/x9VX2oqj5WVU+b2ebcqnra2C59ZLzWOChD0PaYsY47jtcxx1bVtesne4JfVFXXq6ojqur943PyH+NjW/U447kPrqr31fB+6fVV9TPj8lPGNvEDY7t0x239orRtuy+9MNjdXamqzkpyxSTXytDILrlNkpt39zljY3YZ3X1SVT0yybHd/aGqulyS45Pcq7u/VsObw2ckecgKuz+mqn5/vP/4JPtn6MVwqyQHJPlgVb1rhVr+KMlBSQ7u7gur6mrbeV5g11tqa5LknO4+ctn6Tya54/iavmuSv+zu36mqpyQ5pLsfuY5z/GKSw5P8dJJPVdXfJ7ll6CBXVwAAEBNJREFUkvtlaFv2S3JGktPH7bcmOaa7P1NVv5Lk77r7LlV1dJKTagiy75bkV3b0QQM75dZJfinJl5KcluGNzH8k2VpVP9Xd30ty3ySvrqoDkjwpyV27+3tV9fgk/ytDYJ0k3+ju2yRJVT0s67tu+cckj+zud63wpnQ1B491/zBDO3R8kguTPC3JbZMsJnlnkjPH7f8mQ0/v91TVdZO8NclNk2xJclpVnZPksUl+dfueOth91dCD6e5J3jIumr3Of2yS7u5bVNUvJvn3qrpxkj9K8v3uvmlV3TLD3/O1vCDJqd19ZA29GvdP8oTxXAevsP0v5dJrhGQo5PyqOjfJDdc41xO7+5vjed5eVbfs7g+P677e3bepYfjesd39sKp6UZLvdvfzxufk18fzfSlDO5Kq+uMkd+7uz1XV+Ul+tbt7bMMe192PXe04o5cneVR3n1pVT0/y1CR/Oq7br7tvV8NUBU9Nctc1Hp+2bTckbGJ3d8FSY1tVt0/y8qq6+bjuA919znYe7yZJbp7kbVWVJPsm+fIq2z5/qWEcz//8JK8aP0U4r6pOTfLLSc5fVstdk7youy9MkrFhv/l2nBfY9S5Y5cJuyUKSl1XVjZJ0ksvtwDne3N0/TPLDqvpqkmsmuWOS13f395Okhk9OU0OPhzskee3YZiTJFZKkuz9WVa9I8qYkt+/uH+1ALcDO+0B3/3eSjGH1QeMbl7ckOaKqTkpyjySPS3LnJDfL8CYmSS6f5L0zx3rNKudY8bqlqq6a5KrdvfSh1ysyvDley9u7e3Gs+eNJrpfhA7RTuvtr4/LXJLnxuP1dk9xsph26SlXt393njWH7O5Mc2d3fXMe5YXc3+8HTu5O8JMPf4tnr/F/LEACnuz9ZVZ/L8Hq5U4bwKN394ar6cNZ2lyQPHPe5KMniUu+eDfB7VbUlw/v/a2Voj5ZqfN14e3qSe6/nYGNPoD/M8HwkyXWSvKaGnpeXT7LN92hVtZChDTt1XPSyJK+d2WS2poPWUZK2bTckbGKP0d3vHT8ZPHBc9L2Z1RfmJ4eFXnGVw1SSj3X37Scu73trrN+o8wK7xl8keef46eNBSU7ZgWP8cOb+Rdn23+B9knx7GwHYLZJ8O8k1dqAOYBqrvaZfneSRSb6Z5EPd/Z0a3tG8rbuPWuVYq11HrHj9MIZNU9a8mn0y9Fb4wQrrbpHkGzG/FJvHZT54GsOIta7z19Iz91d7j7IeH09yn9kFVXWVJD+b5FMZgunLvB+qqusnOTbJL3f3t2oYxjdbx1K7sJ42IWOg9JIk9+zupSGCxyf56+5+Yw1D947bnge2gu2qKdq23ZI5m9hjjF1V983w4l/uvCTXqKqr1/CNDL81s+47GYatJENDfODYSypVdbmq+qV1lvDuDHOz7FtVB2b4BOMDK2z3tiQPH7vgpqqutpPnBeZvIckXx/tHzyyfbV92xLuS/HYNcz38dJIjkqFbfJJzqup3k0vmjLvVeP/eSa6WoQ06fifedAIb49QMw27+MEPwlCTvS3JoVd0wSarqp8ahNytZ87qlu7+d5NtVtdSr4AE7Ue/7k9x5vIa6XJLfnVn370ketfRDVS31Nr9dhp5Ut05y7PhmFvYG7874ehtfw9fN8Dp9V5L7j8tvnmGY/JLzquqmVbVPktlh+m/PMPwu4/uLhWz7uuLtSa5cl84ptG+Sv0rywu6+IMm5SQ6uqn2q6ueT3G7c7yoZArPFqrpm1tcLcsU6xjbitUke392fnlk1e530oLWOM/ZC+lZdOh/TH2RoO6ekbZszYRO7uyvVOAFdhi7mDxq7mf6E7v5xhnkPPpAh7PnkzOoTkrxoPMa+GT4ReHYNE2qelZlvSFjD6zN0Nz07yTsyjEX+ygrbvTjJ55N8eDzH/cdhLjt6XmD+npPkmVV1Zn7y07J3ZuiGvc0JwlfT3WdkaNvOTvJvST44s/oBSR46thkfS3KvsXfns5I8bLzIe2GGeQeA3cR4nfKmDG9Y3jQu+1qGoPpV4/Ca92aYx20lJ2R91y0PTvK343a10oHWWe+XM/RCeG+Guac+MbP6T5IcUsMEvh9Pcsz4od4/JHnIOH/LY5O8tGbGo8Am9ndJ9qmqj2T4+330OET+75PsX1WfyPCeZHZupSdkaAv+Mz85jcajkxw+Huv0JDfr7m9kGG770Vo2F1t3d4aw6j5V9ZkMH8Bf3N1LXxRyWobhax/PMKTvjHG/szPMVfTJJCeO263l5CRHjtc3sxN03yHDlxg8rS6dJPzaGdqQ11bV6Um+vo7jJEMo9dyxTTw4l85hNwlt2/zV8H8WAAAA2BPU8O11r8owt9B6JiSHXUrYBAAAAMBkDKMDAAAAYDLCJgAAAAAmI2wCAAAAYDLCJgAAAAAmI2wCAOaqqo6rqq6qw+Zdy3JVdcJY20Hbsc9h4z7HbVhhAAC7MWETALAhquqJY+jSVXWTedczlao6aHxMJ8y7lu1VVUfP/E6es8o2S2HZ/93V9QEAm4OwCQCYXFVVkocl6XHRH86xnJ3x50lumuSL8y5kA/xJVV1v3kUAAJuPsAkA2Ai/meSgJC9L8pUkD6qqy8+1oh3Q3V/u7k9294/nXcvEPpvkCkn+ct6FAACbj7AJANgISz2Z/iHJK5MckOTI7T1IVT2gqs6oqguq6qtV9YqqunZVnVJVvcL2+1TVMVX1war6blV9b7z/R1V1meuecbjYKVX1s1X14qr6YlVdVFVHj+t/Ys6mcR6mc8bdHzQzJK2X9ll2/IOr6s1V9e2q+n5VnVpVd1hhu0vmraqqo6rq9HH7L1XVX1fVFcbt7jLWe35VfWt8Pq6+vc9rkn9KcmaSo6rqkPXsMD7vT6mq06rqK1X1o7G+E6vqZitsf8lww6q6QVWdVFXfqKrvVNW/V9XNx+0OrKqtVfXlqvrB+Ps6fJUa9quqR1TV+8bn4PtVdWZVPXKl3y8AMB/7zbsAAGBzqaprJrlnkk93939W1flJHptkS5LXbMdxHpfk2Um+laGH1GKS30hy2nh/Ja9Icv8kX0jy4gzD+I5M8ndJfi3JA1bY52pJ3pfku0lel+TiJOetcvxTklw1yaOTnJ3kX2bWnbVs20OSPC7Je8darpvkd5K8vaoO7u5PrXD8RyW5+3jcUzL0EHtMkqtV1RuSvDrJm5NsTXKHJL+fIci7+yr1rqaTHJvk7Umel+SwdexzpyRPSPLOJP+c4fm6UZL7JLlnVR3a3WevsN9BSd6f5BNJThh/PjLJKVV1+yRvSXJ+hv8bV0tyvyT/VlU37u7PLx2kqi6X5OQk/yPJp5KcmOQHSQ5PcnySX0nyB+t7+ADARhI2AQBTe3CSy2UIFtLdH62q05McXlU37O7PrnWAqvqFJM9I8vUkt+nuL4zLn5AhZLjfCvsclSFoOjPJnbr7u+PyJyU5Ncn9q+rN3X3isl1vkSGkekh3X7iturr7lKo6N0PYdFZ3H7eNze+R5MHdfcJMjQ9P8qJx/0essM9dk9y2uz8xbn+FJGdkCFGOSPKb3X3quG6fJG9NcrcxvFoedm1Td7+jqt6c5B5Vdc/ufuMau7wjyTW7+zuzC6vqVhkCwGdl5dDrzkme1N3PmNnnyUmeniGE+qckj+jui8d1b0vy8gwh22NmjvPEDEHTC5P8aXdfNG6/b4bw7SFVdVJ3v2FdTwAAsGF0NwYAJjMzMfjFGQKDJSckqax/ovD7Z/hQ7PiloClJursz9K65aIV9HjLePmEpaBr3+V6Sx48/PmyF/X6U5Ni1gqYdcNps0DR6aZILk9xulX1esBQ0JUl3/zBDj599krx5KWga112cZOkb4261gzU+LsNz+eyq2uaHkN391eVB07j87AxB1OFj76Plzs0QRM162Xh7hSR/thQ0jU7M8BwdvLRgDNYelWH+r8csBU3j+S/K0HOus3LPNQBgF9OzCQCY0l2S3CDJW7t79hvcTkzyV0mOrqonrWPC7VuPt+9ZvqK7P1dVX8gwHGvWbTKEXKescLxTM4Qqt15h3bnd/dU16tkRH1q+oLt/XFXnJfmZ9e6T5Evj7ekrrFt6jq+z/eUl3f3xqnpJhiGOWzIMN1xVVd0jyTEZhggekMteSx6Q5MvLlp01Gw6Nlh7Tp5cHWN190fgczT6mG2cYYveZJE8aMs3LuCDDNwcCAHMmbAIAprRlvD1hdmF3f7OqTs4wZ9G9kpy0xnEWxtvV5k46L5cNmxaSfLO7f7R84+6+sKq+nuQaKxzrK2vUsqO+vcryC5Psu8q6leaiunAd61bqUbReT8nQk+ypVfWK1Taqqkcn+d8Z5tB6W5LPJ/l+hh5Fv52hd9UVVtj1MnWPv48V140uzE8+pqVJ0G+U5KnbeCz7b2MdALCLCJsAgElU1YEZQockeVVVvWqVTbdk7bDp/PH2mkk+tsL6a66wbDHDRNqXW95zahwidsDMcWdd5lvt9ibdfV5VPTfJ0zIMUXzb8m3G5++4DMHcbbr7y8vW336Dy1wKpV7f3ffe4HMBADtJ2AQATOVBSS6fYbjXapNV3zPJXavq+t19zjaOdWaGbyz7tQzzAV2iqq6X5OdX2efXM3xr2tuXrbtTht5EZ6zxGNZjaUjYar2T9kTPS/LwDBNyf2KF9Qdk+Ba+160QNO2fYQjjRvpkhp5iv7pSmAgA7F5MEA4ATGVp8u9HdPfDVvqX5P9kmCh8pYm6Zy1NEv2oqrokWBonIH9mVg56XjrePrOqrjyzz5Vz6QTVL9nuR3VZ38rQG+q6Exxrt9Dd30/y5CRXysrD1L6aYcjcbcdwKUkyTgj+NxnCqI2s78Ikxye5VpIXVNWVlm9TVdeqqpttZB0AwPro2QQA7LSqOizDJM4f6e4PbGPTl2T4CvsHV9VTV/sGuO7+f1X1lCR/meTsqnpNhqFUv5Fhouizk9xy2T4nVtW9kvxeko9V1b/k0vmErp/kNd39yp14mEvn+W5VvT/JHavqlUk+naG30xu7+8M7e/w5OiHJnya5xfIV3X1xVb0gwzC7j1TVGzL0Yjs8w+/jneP9jfQXGeaFOibJEVX1jgwTpF8jw1xOh2b4v/XxDa4DAFiDnk0AwBSWejW9eFsbdfe5Sf4jQw+VI9bY9plJHpjkc0kenOShGYZ4HZrhA7OV5l86KskfJ/lGhmFhx2ToifTIDJNgT+UPkrw5yd0y9AT6i2z8ULIN1d0XJ/mzbWzy5CSPzfCtbw9Pcu8M3553uwyThW90fT/OEBw+MMmnkvzWWM/dMlzTPjnJToeJAMDOq+69ek5MAGAPU1VXyfBtdGd190ZPTA0AwHbSswkA2C1V1YHjnECzy/ZL8ldJrpjk9XMpDACAbdKzCQDYLVXVMUmenmHY3RcyzA10pwxzQ52V5A7dfcH8KgQAYCUmCAcAdlfvT/KeDAHT1cdl5yR5RpJnC5oAAHZPejYBAAAAMBlzNgEAAAAwGWETAAAAAJMRNgEAAAAwGWETAAAAAJMRNgEAAAAwGWETAAAAAJP5/8Fq0edUePaCAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 1440x720 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.figure(figsize=(20,10))\n",
    "\n",
    "ax = sns.barplot(data = results_df, x='name',y='wall_time_ms')\n",
    "ax.set_yscale(\"log\")\n",
    "plt.title('Wall Time in ms for retreiving 100 items out of 1 million items', fontsize=20)\n",
    "plt.xlabel('Algorithm Name', fontsize=20)\n",
    "plt.ylabel('Time ms (log scale)', fontsize=20)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 167,
   "id": "dXl_UjTP-Q1q",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 870
    },
    "id": "dXl_UjTP-Q1q",
    "outputId": "02fdb9d6-cae6-497d-de75-0fe0223bbe11"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "([<matplotlib.axis.XTick at 0x7fd1c8aec1d0>,\n",
       "  <matplotlib.axis.XTick at 0x7fd1c8bcbf90>,\n",
       "  <matplotlib.axis.XTick at 0x7fd1c8c97610>,\n",
       "  <matplotlib.axis.XTick at 0x7fd1c8cd79d0>],\n",
       " <a list of 4 Text major ticklabel objects>)"
      ]
     },
     "execution_count": 167,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAABLMAAAL8CAYAAAAbXPfhAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAgAElEQVR4nOzdd5gb1dnG4efd5t4brrh3excwnQSbEjAdxwVSSSGdBJsSTDWhY7DzhZAAaYQkJLYhBtM7mNBt2HXvvfdetp3vj5kFIWu7ds9K+t3XpUvWzNHMo5kj2Xo958iccwIAAAAAAAASQZrvAAAAAAAAAEBFUcwCAAAAAABAwqCYBQAAAAAAgIRBMQsAAAAAAAAJg2IWAAAAAAAAEgbFLAAAAAAAACQMilkAkOLM7Aozc2Z2RdTyVWa2yk8q1CVm1jXsI4/X8n5j9s0y2k8I2w+t2WTAF/isrNsS/fz4+vwFgLqOYhYAVFP4j8zIW5GZ7TCzt8Mv4+Y7Y11kZo+Hx6trJZ+XaWa/MrO/mVmumeWH2/lhBZ77XTP72Mz2mdnu8BxdUEb7dDMba2ZzzOxgeF5fNLNTKpM53sxsaPiaJ/jMkSjCY/W27xyARH+s63ycH/oEAFRehu8AAJBEbg/vMyX1lHSppNMlDZH0C1+hklAjSb8N/7xZ0iZJnct7kpk9IOkaSesk/UlSlqTLJD1nZlc5534f1d4k/UfSSEmLJf1eUktJYyTNNLOvO+eejcsrqvvWS+onabfvIOX4vYJztsZ3EAAAANQcilkAECfOuQmRj83sVEkzJf3MzB50zq30Eiz5HJB0nqRc59zG8Oqk28p6Qngl1TWSlks63jm3M1w+UdJsSQ+Y2fPOuVURT7tMQSHrfUlnOucOhc95RNL/JP3JzN50zu2N54uri5xzBZIW+c5RHufcNknbfOcAAABAzWKYIQDUEOfcewoKACbpuOj1ZnaimT1lZpvCoXJrzexRM+sQa3tm1tLM7jKzeWZ2IBwml2dm95pZo4h2x5nZ/4XrdpjZITNbamYPmlmLmnq9ZnaJmf3TzJaY2f7wNtvMfmlmaVFtnaTvhg9XRgzRXFXefpxz+c65l5xzGysR7yfh/V0lhaxwW6skPSypnqTvRT3np+H9zSWFrPA5n0iaIqmNgmJXuSLncjKzb5jZR+FQx1URbRqa2fhw6OT+cP0HZnZ51LYel/RW+PC2qCGuQ8M2n881ZWbnhsMpd4fHvWQ7GWb2MzP70Mz2hH3qMzP7RYzzdcScLWb2crgsu5TXPCZc/0DEshrtmxY1Z1bJcQhXnx51rCZEPbfC78fweDoLhrzeambLw9ey2MyujGj3EzOba8EQ1XVmdnv0sQ3bXWRmb5jZRjM7bGYbzOwdM/tZJV//mHA7Jcd2lZn928yGRLWrZ2Y3hNkOhOf/XTMbHWObn597M+sRHqPtZrbXzF41s4FhuzZm9lj4Gg6Z2SdmNizG9iLfC98N+9xBM9tiZn81s6NiPKdS/Sbe/T9sb+G6+eH+15vZ782sWSXOT2X642gzmxnmPhieq/FmVq+i+wu3096CIdlbwu3khsc95lDliL6dFfbtxWGffDyizXFm9nS4zcNmttrM/mBm7WPs/+3I4x7reFgp8zWaWSMzm2hma8L9LDOzX5sdOXS/ts5P1Puht5lNCY9DsX3xuVPqHF1Wjc+oiP3/x8y2ha9zlpUxVB4AkhlXZgFA7SiIfGBm35f0mKTDkmZIWiupl6QfSrrQzE5yzq2JaN9NQQHjaAVXEv1RwX9I9JY0VtIjkvaHza9UMMTxHUmvh+2OkzRO0nAzO7GGria6V1KxpI8UDEtrJukMSf8n6XhJ345oe7ukSyRlh+t3hct3qWacEd6/HGPdS5JuCdvcJklmVl/SKQquAnu3lOd8O3zO3yqR4xpJZ0t6TsH5bBbur7mkNyUdI+lTSX9VcN7OkfSkmQ1wzt0cbuOZ8P67Cs7x2xHbXxW1v5GSzg3zPqKg/8jMMsMM5ygYQvmkpEOShkl6SNKJ+vL5iuXv4fO/E76uaCXFyscjltV238xV0Nduk7Q6KsvbJX+o7Psxwn8UHKsXFbzHR0p6zMwKJA1WcAyel/SGpIsk3aqgT90Xse8fSXpUwXDZ5xRcWdY2fP73JP2hvBcZfrn/W7i/bZL+K2mrpE4KzuliSbPCtlmSXlEwBHqRgmJuwzD7FDPLcc7dGGM3XRW8txcqOI5dFZzLt83sZAXvrT0KCr0tFVzZ+JKZ9S7l2I2V9LWw/cuSTgtf79CwH2yNaFvVfhPP/v9bSb+UtFFBXymQdHHYNktSfoz9R6tof7xb0ngF5/JJSfskDZd0t6RzzOxrzrly92dmbSV9EL7umQquMj1KQZ96tZynP63gc/slBZ85W8JtXhCuM0lPha/jOAXF/4vN7LQ4XYWcqaCfdggzFCr4O+NeSfX1xbD+ErV2fkI9FLwflkj6l6QGCvp/ZVVmn0dL+ljSCkn/0BfD3p81s7Occ28JAFKJc44bN27cuFXjJskFH6dHLP+qpCIFX5DbRyzvreAf1sskdYx6zpnhc6ZHLX8/3M/4GPtpLal+xOOjJaXHaPeDcBu/jlp+Rbj8iqjlqyStqsRx6BFjWZqCooeTdGLUusfD5V2refwnhNv5YSnrG4Xr95ayvnW4fnPEsgHhsrmlPGdIuP6jSmbcL+mYGOtLjsX1UcvrK/iiXywpJ2L50LD9hFL2V3JOiyWdW0aehyL7iqR0SX8J110csbxruOzxqGy7FBRhMqK2f5SCL5+zo5bHpW9W4DgPjVruJL1dynOq8n58O9zmJ5KaRyzvHm5rp6SVkduT1FxBcWJr5PFSUJw+LKltrL5Zwdf9ozDPx5KaRa1L15c/f8aHbV+MytFWwXveSTolxrl3km6K2vYt4fIdCopFaRHrvh2um1zKOcpX1HtB0uRw3V/i1G/i1f9PCZctk9Qy6j3wQbhuVUXOVQX648nh+jWSjopYnqGgAOck3VjB/ZS8lvuilmeHfe6Iz5CIvj0nuv9Jaixpu4L3xFei1v06fN6rsbZXSr6S83RF1PKSfviipAZRfXRXeMv0dH666ov3w92ltFlV2v5Utc+oyH3eFrXunJJjVdHXx40bN27JcmOYIQDESTh8YIIFQwGnKLiCwCRd6748JO6nCv7X+VfOufWR23DOvaHgypALzaxJuN3jFHzByVXEFR0Rz9nmvjwMbrVzrihGxL8q+J/jc6rzOkvjnFseY1mxgiuvVFP7rYCSYSalTV5esrx5NZ9TEY855z6LXGBmrSR9S9Is59z9kevC8/prBf3oG5XclyQ965z70tVoFgyhukpBEWpsZF8J/3yNgi9H3yxrw2G2qZLa6chz+y0FhYG/Rz3HS98sR6Xej1FucM7timi/QsF8as0l3RG5vbDdcwqKpx2jtlOoqKs3w+dUdP6vq8L7HzvnvtRnnXNFUZ8/31dwfsc55woj2m2RdEf4MNYvg65ScFVMpJLzW0/SdeH7vcSTCl5XTimZ/xH9XlDwRX+3pG9EDqerRr+JV/8vGYJ8l3NuR0T7QwqKg/H0/fD+Tufcpoh9FYbZihX7/HxJeAXe5QqO552R65xzeZKeKGcTt8TofxcruBpoinMu+orVBxX0kbPNrEt5+Srol865gyUPwj76rILP5z4R7Wrz/JTYrCOvDqtpq3XkuXxFQeHzhFrOAgDeMcwQAOLntqjHTtIPnHN/i1p+cnh/upkdH2M7bRUUAnoruGrjpHD5K1FfFmMKh9D8WMEwn/4K/uEf+Z8X0V+k4yIsylynYHL27gquiIpUI/tNMB/HWHa8gvMdc44UBYUWKfg1wXjsr7eCL6RLJd0cY/oZSTpYwf09rmAI2HclvRCx/LsKijNPRjb21TfLUdn3Y6RZMdpvCO+j20rB8FspGP63OvzzvxQUAhaY2X8UDKV7z315mF2pLJgvb6CCKwuji0PRbZso+KXV9c65WBP6vxneHxNjXW6MglLJa13ioob5OeeKzGyzgtcayzvRC5xzu80sV8EQyH4KCvjV6Tfx6v/HlpZZQfEyVqGtqkr29Wb0CufcEjNbJ6mbmTWLLlxG6aNg6Nus6HMT+p/KLorFOnZlZSs0s5kKriI6RtX/RdHdzrllMZavDe8j50qrzfNTIs85d7gGtluWWO9BKTgmJ8dYDgBJjWIWAMSJc86kz79cnqxgiMcjZrbaORf5j/9W4f115WyycXhfcvXP+tIaRpmiYH6ZFQr+F3uTgiElknS1gqso4iqc8+kTSd0UfAl6QsHQo0IF+X9VE/utoJIvfKVNBFyyPHK+rqo8pyI2xVhW0h+OD2+laVzGuqrsr5fK/hXIcvfnnHvfzJZIusjMWjjndprZsQqKK8/EuLKj1vtmBVT2/fi5UooJJVc7lbWupEAp59wkM9sm6WcK5vy5WkFh8x0FVzvFKphFqsznQ0m/Le3HE0qWx7ri8IjXExYwYq4LFSritUbZXMrykj4b+d6rar+JV/8vyXJE5vAYxPMXNCtyjrooOEdlFbNKzVzO8hKxjl11+k9llfbZWvIeSo9YVpvnp0Ss41PTyjomjLYBkHIoZgFAnDnn9kt63cwuVDCZ99/NrI9z7kDY5PNCiXOuIhPGlvwDttyrViz41bJLFQxxHB45jCgcXnN9BV9GZf1QQSHrdufchKhMJysoZnnhnNtvZusldTSz9u7IX0HsFd4viVi2XMH/5nc3s4zI41jGcyoUJ8aykv4w2Tk3rpLbq87+pjvnRsRhH08oGPoyRsG8Sd8Nl39piKHHvlmeyr4f484594SkJ8Ki8CkKjtP3Jb1iZn3LuUqrwp8P+uK1HvGLgaH2Ue1qUrtSlpdk2y1Vu9/Eq/+XPKedgoLa58wsQ8HQ0XUV3FZF93WUgs+haBU9RyV9ubTjXNpySeEkV2VniyVWtmIpOE4xPkfjUfSK3F9tnJ8SsY5PiWIFk87HEq/XDAApjyo+ANQQ59wcSX9SMMxmbMSqD8P7r1RwUyXtz7EYPxkfpWd4PyPGF4cTFAw7qQkl+306xrrTS3lOyXCJ9FLWx1PJlXHnxlg3PKpNyVwr7yv4lbdY5+mI51TDxwq+/FS0P0jVO3aLFBRATgqHb1XXEwryfzfc3uUKJjp/Iaqdr76pMF9px6qy78ca45zb5Zx70Tl3pYIhnC0V/JBEWc/ZL2mepHZmFmt4YGTbvQoKJB3NrFeMJsPC+08rm70KjvhcMLNmCubYOqTgVxOl+PebqvT/kuMR67PsNFX+fVhWfywZKjo0eoWZ9VTw98nKyLnaSrFIwXDJwaXM93ZaxaJWOFuGvngPRfafneF95xjbG1KFDLHU5vmpiJ0K3o+x+ldpr7m6+wSAlEMxCwBq1p0KhsNca2Ylc3z8XsF8QpPNrHf0E8wsy8w+/2LtnJutoLCSo2Ay8Oj2rcysfvhwVXg/NKpNW0kPV+uVlK20/R6j0ifg3R7ex2uy4LI8Et7fFHEeZGZdJf1cwTmKntvsj+H9nRHHV+G8SmMU/CpdrOJdpYSTGv9L0hAzu8XMjvhCY2Y9zKxbxKIqH7uwIPCQgqsofmdmRxQDzKy9mfWv4PbWKijqnaTgCrw2kp50zkVPaL4qvB8ata+a7ptScLxifZmWKvl+jDczG2axJ25qG94fiLEu2u/C+0fDglDk9tPMrH3Eor8q+EGBiZF9zcxaK/h1wpI2Ne3bMYpvExQMGft3xHxEq8L7oZENq9pvqtj/Hw/vbzKzlhHt6ku6p7IZVHZ/LDn2N5tZm4h9pUt6QMG/3f9S3g6cc/kKhmc2k3Rz5Dozy5b0ncrH1jMKho9fbmYnRa27WsHVua875yLnyyqZe+vKqAxnKih8x8Pj4X1tnJ+K+FjB6JfvRS40sysknVpD+wSAlMMwQwCoQc659Wb2iIIv+ddLGu+cW2Rm31fwpWW+mb2sYLhapoLixFcUFEr6RmzqWwp+4vxuM/t6+GdTMNzta2HbVQrmrXpP0ggze1/B5LftFFxJtFhfTNgcb08omHPot2Y2TMHkyr0kXSDpvwqKP9HeCJ/zJzN7WtJeSbucc78vb2dmdoO+OD4lv5b2PTMrudrgf865P5e0D+d2miRpnKQ5ZvaUgmEgYxRc/XKVc25V1G7+I2mEpJGSPjOz5xTMtzNGwf+gXxnHYWm/UHC8fqPgS/7/FMz/0kHBRNTHK/jitzJsv1jBHEmXmVmBgsnEnYJfiFut8t0hKVvSTxT8Ut+b4fbahjlOlXSTpAUVzP93SWdJujvicTRffVMK+tpl4Tn8VEHxaqZzbmYV34/xNF3SPjP7UMF72MJ9Hq9gEvnXK7CNP4fP+bakpWb2rILMHSSdoeC1TQjbPqDgmF8sKc/MXlRwBeIoBef/fufc/+LxwsrxkqT3zGyqgrmWTgtvqyTdENGuJvpNpfq/c+49M3tIwa8gzgs/PwoUHMOdKn0OqdKU1R/fN7P7Ffx9UbKv/eHrHRi+/okV3M8NCs7/9WZ2ooL/FGkvabSkFyVdonAYYEU45/aF75Vpkt4xs2kKJno/TsHfQ5sUTNQf6W8KPufHh0W0BQom4R+uoO9/vaL7LyNXrZ2fCj7/IQWFrD+GRbu1Cv6eOlnS8wr+Xoz3PgEg9TjnuHHjxo1bNW4KigiujPXtFHwZ2S+pXcTyQQr+R3m1giuDdigYLvSopDNibKeVpPsUfIE7pGCoTK6kuyQ1jGjXUtIfFHwpPKRgWNHdCr6wrpK0Kmq7V4Sv4Yqo5Ue0Lec49Jc0Q9KW8LXOVjCXVtdw+4/HeM44BcOJDodtKrQ/BcU8V8btiH1FvNZPwnx7Ffz61QVl7CdDwRDRuQqG7OxU8CXwlEr2kQlhrqFltMlSUNR6X8EcMIcVfFF8Q8FVD62i2h8frtut4Avp59sv7ZxGPd8UFD/eCPtevoIv9P+TdKOkzhFtSz2H4fqGYQ4naW4Z+4xL36zscVZQpHhSQYGwKGwzIapNhd+PJf2vlAyPh9vvWpF8Cgoq0xXM9XMg3O9nCooZTSrZz74Z9und4fFdqeCqv2Oj2tUPz/G8sF/vDc/75TG2Wd65d5LeLmVdrHP6+TEIz29umGGrgsJH+9roN6pE/49o/wt98Xm1QcGVYc1iZSjnPFWkP14WZtkbvub5Cgps9SvZJzoqKC5vDY9zroJ57UaG+726on07os3xYZ/dGh63NQquZO1QSvsBCj4390raF+7j9NLOU1nHU6W/x2vl/Kic90PENk6TNFPBe3qPgmHXg8vIX+V9VuSccePGjVsy3sy5suYvBAAAAOLDzCYo+BXBYc65t/2mSV1mdpeCot25zrlXfOcBAKCymDMLAAAASEJm1iHGskGSfqngirR3aj0UAABxwJxZAAAAQHKaZWbLFAwp3a9gTrDzFfyH9o9d8MutAAAkHIpZAAAAQHJ6VMFE75dLaqJgrsVXJD3AME8AQCJjziwAAAAAAAAkDObMAgAAAAAAQMJIymGGrVu3dl27dvUdAwAAAAAAIGnMnj17m3Ouje8cSVnM6tq1q2bNmuU7BgAAAAAAQNIws9W+M0gMMwQAAAAAAEACoZgFAAAAAACAhEExCwAAAAAAAAmDYhYAAAAAAAASBsUsAAAAAAAAJAyKWQAAAAAAAEgYFLMAAAAAAACQMChmAQAAAAAAIGFQzAIAAAAAAEDCoJgFAAAAAACAhEExCwAAAAAAAAmDYhYAAAAAAAASBsUsAAAAAAAAJAyKWQAAAAAAAEgYFLMAAAAAAACQMChmAQAAAAAAIGFQzAIAAAAAAEDCoJgFAAAAAACAhEExCwAAAAAAAAnDazHLzP5qZlvMbF4p683Mfmdmy8xsjpkdW9sZAQAAAAAAUHf4vjLrcUnnlrF+uKRe4e1Hkv5YC5nqhOJip617D2v9zgPauvewioud70gAkFD4HAUAAACSU4bPnTvnZppZ1zKaXCzpCeeck/ShmTU3s/bOuY21EtCT4mKnxZv36sonZmndzoPq1KKBHvnWcWrRMFMFRXwZA4DyZKabdh4o0E/+Ofvzz9E/fWeI+rRrorQ08x0PAAAAQDV4LWZVQEdJayMerwuXJXUxa/v+/M8LWZK0budB/eSfs3XLBf3143/M9pwOAOq+R799nO54fsGXPkevfGKWpv/sVLVpUs9zOgAAAADVUdeLWRVmZj9SMBRRXbp08ZymevILiz7/AlZi3c6D6t66kSaPyfaUCgASR7fWjWJ+juYXFnlKBAAAACBe6noxa72kzhGPO4XLjuCce0zSY5I0ZMiQhB6Ll5WRrk4tGnzpi1inFg3UvGGWLj2mk8dkAJAYtu49HPNzNCsj3WMqAAAAAPHgewL48syQ9J3wVw1PkrQ72efLkqRWjbL0p+8MUacWDSTp87leWjXK8pwMABJDrM/RiSOz1SiLYhYAAACQ6CyYW93Tzs3+LWmopNaSNku6TVKmJDnnHjEzk/R7Bb94eEDS95xzs8rb7pAhQ9ysWeU2q9OKi522789XfmGRsjLS1apRFpMWA0AlRH6OHi4s1jVT8zSgY1Pdeckg39EAAACAhGRms51zQ3zn8P1rhpeXs95J+nktxalT0tKMSYoBoBqiP0ePO7qF/vy/lTqrXzsN7dPWYzIAAAAA1VHXhxkCABAX157TR73bNdb1T83Rzv35vuMAAAAAqCKKWQCAlFA/M12TRudo54F83fzsPPkcZg8AAACg6ihmAQBSxsCOzXT1Wb31wpyNmpG3wXccAAAAAFVAMQsAkFJ+/NXuOrZLc93yzDxt3H3QdxwAAAAAlUQxCwCQUjLS0zRpdI4Ki52unZan4mKGGwIAAACJhGIWACDldG3dSDed30/vLduuv3+wynccAAAAAJVAMQsAkJK+cUIXDevTRve+tEjLtuz1HQcAAABABVHMAgCkJDPTfSMHq2FWusZOyVNBUbHvSAAAAAAqgGIWACBltW1SX3dfOkhz1+/WQ28u8x0HAAAAQAVQzAIApLThg9prxDEd9fBby5S7dpfvOAAAAADKQTELAJDyJlw8QO2a1NO4Kbk6mF/kOw4AAACAMlDMAgCkvKb1M/XAqGyt2LZf97y00HccAAAAAGWgmAUAgKRTerbW90/tpic+WK2ZS7b6jgMAAACgFBSzAAAIXX9uH/Vs21jXPZWnXQfyfccBAAAAEAPFLAAAQvUz0/XbMTnavi9ftzw733ccAAAAADFQzAIAIMLAjs30qzN76bm8DZqRt8F3HAAAAABRKGYBABDlp0N76JguzXXz9LnatPuQ7zgAAAAAIlDMAgAgSkZ6miaNzlFBkdN1T+XJOec7EgAAAIAQxSwAAGLo1rqRbjy/n95duk3/+HC17zgAAAAAQhSzAAAoxbdO7KLTe7fR3S8u1PKt+3zHAQAAACCKWQAAlMrMdP/Iwaqfma5xU/NUWFTsOxIAAACQ8ihmAQBQhnZN6+vOSwYqb+0uPfzWct9xAAAAgJRHMQsAgHJcMLiDLs7poN+9uVRz1u3yHQcAAABIaRSzAACogN9cNFBtGtfT2Cm5OlRQ5DsOAAAAkLIoZgEAUAHNGmbqgVHZWr51v+59aZHvOAAAAEDKopgFAEAFndarta44pasef3+V3l261XccAAAAICVRzAIAoBJuGN5XPdo00nXT5mj3gQLfcQAAAICUQzELAIBKqJ+ZrsljcrRt32HdOmOe7zgAAABAyqGYBQBAJQ3u1FxXndFLz+Zu0PNzNviOAwAAAKQUilkAAFTBz4f1UHbn5rpp+jxt3nPIdxwAAAAgZVDMAgCgCjLS0zR5dLYOFxbpuqfmyDnnOxIAAACQEihmAQBQRd3bNNaN5/XTzCVb9c+P1viOAwAAAKQEilkAAFTDt086Wl/p1Vp3v7BQK7ft9x0HAAAASHoUswAAqAYz08SR2crKSNPYKbkqLCr2HQkAAABIahSzAACopqOa1dcdlwxU7tpd+uPby33HAQAAAJIaxSwAAOLgouwOujC7g/7vjaWau2637zgAAABA0qKYBQBAnNxx8QC1apylsVNzdaigyHccAAAAIClRzAIAIE6aN8zSxJHZWrZln+5/ebHvOAAAAEBSopgFAEAcfbV3G33n5KP11/dW6v1l23zHAQAAAJIOxSwAAOJs/PB+6t66ka6dlqfdBwt8xwEAAACSCsUsAADirEFWuiaNydHmvYd1+4z5vuMAAAAASYViFgAANSCnc3P9fFhP/fez9Xpp7kbfcQAAAICkQTELAIAactUZPTW4UzPdOH2utuw55DsOAAAAkBQoZgEAUEMy09M0aXSODuQX6ddPz5FzznckAAAAIOFRzAIAoAb1bNtY44f31VuLt+rfH6/1HQcAAABIeBSzAACoYd85uatO69ladzy/QKu27fcdBwAAAEhoFLMAAKhhaWmmiaMGKzPdNG5qrgqLin1HAgAAABIWxSwAAGpB+2YNdMclA/Xpml16dOYK33EAAACAhEUxCwCAWnJRdgedP7i9Jr+2RPPW7/YdBwAAAEhIFLMAAKglZqa7Lhmolo2yNHZKrg4VFPmOBAAAACQcilkAANSi5g2zdP/IwVq6ZZ8eeGWx7zgAAABAwqGYBQBALRvap62+dVIX/eW9lfpg+XbfcQAAAICEQjELAAAPbjyvn7q2aqRrp+Vpz6EC33EAAACAhEExCwAADxpmZejB0dnauPugbp+xwHccAAAAIGFQzAIAwJNju7TQz4f11NOfrtPL8zb5jgMAAAAkBIpZAAB49Msze2lgx6a6cfpcbdl7yHccAAAAoM6jmAUAgEeZ6WmaPDpH+w4XavzTc+Wc8x0JAAAAqNMoZgEA4Fmvdk3063P76o1FWzTlk7W+4wAAAAB1GsUsAADqgO+d0lWn9GilO55foDXbD/iOAwAAANRZFLMAAKgD0tJME0dlK81M46bmqqiY4YYAAABALBSzAACoIzo2b6DbLx6gWat36rGZK3zHAQAAAOokilkAANQhlx7TUcMHHqVJry3Wgg17fMcBAAAA6hyKWQAA1CFmprsuHaRmDbI0bmquDhcW+Y4EAAAA1CkUswAAqGNaNsrSxJGDtWjTXk16dYnvOAAAAECdQjELAIA6aFjftvrGiV302Lsr9NGK7b7jAAy0kqEAACAASURBVAAAAHUGxSwAAOqom87rpy4tG2rc1DztPVTgOw4AAABQJ1DMAgCgjmpUL0OTRudo4+6D+s1zC3zHAQAAAOoEilkAANRhxx3dQj8d2kPTZq/Tq/M3+Y4DAAAAeEcxCwCAOu5XZ/bWgA5NNf6/c7Vt32HfcQAAAACvKGYBAFDHZWWkafKYHO09XKgbnp4r55zvSAAAAIA3FLMAAEgAvds10fXn9NHrCzdr2qx1vuMAAAAA3lDMAgAgQXz/1G46qXtL3f7cfK3dccB3HAAAAMALilkAACSItDTTA6OylWama6bmqaiY4YYAAABIPRSzAABIIJ1aNNRtFw3Qx6t26M/vrvAdBwAAAKh1FLMAAEgwXz+2o84Z0E4PvrpECzfu8R0HAAAAqFUUswAASDBmprsvHaSmDTI1dkquDhcW+Y4EAAAA1BqKWQAAJKBWjevpvq8P0qJNezX5taW+4wAAAAC1hmIWAAAJ6sx+7XTZ8Z316Mzl+mTVDt9xAAAAgFpBMQsAgAR28wX91alFA42bmqt9hwt9xwEAAABqHMUsAAASWON6GZo0Okfrdh7Unc8v8B0HAAAAqHEUswAASHDHd22pH3+1h/7zyVq9vmCz7zgAAABAjaKYBQBAEhh7di/1PaqJbvjvHG3fd9h3HAAAAKDGUMwCACAJ1MtI128vy9Geg4W6cfpcOed8RwIAAABqBMUsAACSRN+jmurac3rrlfmb9fSn633HAQAAAGoExSwAAJLID07rrhO6tdSEGfO1dscB33EAAACAuKOYBQBAEklPMz04KluSdO20PBUXM9wQAAAAyYViFgAASaZzy4a69cL++mjlDv3lfyt9xwEAAADiimIWAABJaNRxnXR2/3aa+MpiLd6013ccAAAAIG4oZgEAkITMTPeMGKSmDTJ09ZRc5RcW+44EAAAAxAXFLAAAklTrxvV0z4jBWrhxj377+hLfcQAAAIC4oJgFAEASO7t/O40e0kmPvLNcs1fv8B0HAAAAqDaKWQAAJLlbLuivDs0baOyUPO0/XOg7DgAAAFAtFLMAAEhyTepnatLoHK3deUB3vrDQdxwAAACgWihmAQCQAk7o1lI/+kp3/fvjNXpz0WbfcQAAAIAqo5gFAECKGPe13up7VBNd/9Rc7dif7zsOAAAAUCXei1lmdq6ZLTazZWZ2Q4z1XczsLTP7zMzmmNl5PnICAJDo6mWka9LoHO0+mK+bps+Vc853JAAAAKDSvBazzCxd0sOShkvqL+lyM+sf1exmSVOdc8dIukzSH2o3JQAAyaN/h6Yad3YfvTRvk6Z/tt53HAAAAKDSfF+ZdYKkZc65Fc65fEn/kXRxVBsnqWn452aSNtRiPgAAks6Pvtpdx3dtoduena/1uw76jgMAAABUiu9iVkdJayMerwuXRZog6Vtmtk7Si5Kuqp1oAAAkp/Q004OjclTsnK6dmqfiYoYbAgAAIHH4LmZVxOWSHnfOdZJ0nqR/mNkRuc3sR2Y2y8xmbd26tdZDAgCQSLq0aqhbLuivD1Zs19/eX+U7DgAAAFBhvotZ6yV1jnjcKVwW6QeSpkqSc+4DSfUltY7ekHPuMefcEOfckDZt2tRQXAAAkseY4zvrrH5tdd/Li7R0817fcQAAAIAK8V3M+kRSLzPrZmZZCiZ4nxHVZo2kMyXJzPopKGZx6RUAANVkZrpnxGA1rpehsVNzlV9Y7DsSAAAAUC6vxSznXKGkX0h6RdJCBb9aON/MfmNmF4XNrpF0pZnlSfq3pCscvyUOAEBctGlST/eMGKR56/fooTeX+o4DAAAAlCvDdwDn3IsKJnaPXHZrxJ8XSDq1tnMBAJAqzhlwlEYe10kPv7VMw/q21bFdWviOBAAAAJTK9zBDAABQB9x2YX+1b9ZA46bk6kB+oe84AAAAQKkoZgEAADWpn6kHR2dr9Y4DuuuFhb7jAAAAAKWimAUAACRJJ3VvpR+e1k3/+miN3lq8xXccAAAAICaKWQAA4HPXfK2P+rRrouufmqOd+/N9xwEAAACOQDELAAB8rn5muiaNydauA/m6+Zl54geEAQAAUNdQzAIAAF8yoEMzXX1Wb70wd6Oezd3gOw4AAADwJRSzAADAEX5yeg8dd3QL3fLsPG3YddB3HAAAAOBzFLMAAMAR0tNMk0Znq6jY6bqn8lRczHBDAAAA1A0UswAAQExHt2qkm8/vr/eWbdffP1jlOw4AAAAgiWIWAAAow+UndNYZfdvq3pcWadmWvb7jAAAAABSzAABA6cxM9359kBpmpWvslDwVFBX7jgQAAIAURzELAACUqW2T+rr70kGau363Hnpzme84AAAASHEUswAAQLmGD2qvEcd01MNvLVPu2l2+4wAAACCFUcwCAAAVMuHiAWrXpJ7GTcnVwfwi33EAAACQoihmAQCACmlaP1MPjMrWim37dc9LC33HAQAAQIqimAUAACrslJ6t9f1Tu+mJD1Zr5pKtvuMAAAAgBVHMAgAAlXL9uX3Uq21jXfdUnnYdyPcdBwAAACmGYhYAAKiU+pnpmjwmR9v35euWZ+f7jgMAAIAUQzELAABU2sCOzXT1Wb30XN4Gzcjb4DsOAAAAUgjFLAAAUCU/Ob2HjunSXDdPn6tNuw/5jgMAAIAUQTELAABUSUZ6miaPzlFBkdN1T+WpuNj5jgQAAIAUQDELAABUWdfWjXTT+f307tJt+seHq33HAQAAQAqgmAUAAKrlmyd20dA+bXTPSwu1fOs+33EAAACQ5ChmAQCAajEz3f/1waqfma5xU3JVUFTsOxIAAACSGMUsAABQbW2b1tddlwxS3rrdevitZb7jAAAAIIlRzAIAAHFx/uD2uiSngx56c5ny1u7yHQcAAABJimIWAACIm9svHqi2Tepp7NRcHcwv8h0HAAAASYhiFgAAiJtmDTL1wKhsrdi6X/e9vMh3HAAAACQhilkAACCuTu3ZWlec0lWPv79K7y7d6jsOAAAAkgzFLAAAEHc3DO+rHm0a6bppc7T7QIHvOAAAAEgiFLMAAEDc1c9M1+QxOdq277BunTHPdxwAAAAkEYpZAACgRgzu1FxXndFLz+Zu0PNzNviOAwAAgCRBMQsAANSYnw/roezOzXXT9HnavOeQ7zgAAABIAhSzAABAjclIT9Pk0dk6XFik656aI+ec70gAAABIcBSzAABAjereprFuPK+fZi7Zqn9+tMZ3HAAAACQ4ilkAAKDGffuko/XV3m109wsLtXLbft9xAAAAkMAoZgEAgBpnZpo4crCyMtI0dkquCouKfUcCAABAgqKYBQAAakW7pvV15yUDlbt2l/749nLfcQAAAJCgKGYBAIBac2F2B12U3UH/98ZSzV2323ccAAAAJCCKWQAAoFbdcfFAtW5cT2On5upQQZHvOAAAAEgwFLMAAECtatYwUxNHDdayLft038uLfMcBAABAgqGYBQAAat1XerXRd08+Wn97b5XeW7bNdxwAAAAkEIpZAADAixuG91P3No107bQ87T5Y4DsOAAAAEgTFLAAA4EWDrHRNHp2jLXsPa8KM+b7jAAAAIEFQzAIAAN5kd26uXwzrqemfrdeLczf6jgMAAIAEQDELAAB49Yszempwp2a6cfpcbdlzyHccAAAA1HEUswAAgFeZ6WmaNDpHB/OLdP3Tc+Sc8x0JAAAAdRjFLAAA4F3Pto01fnhfvb14q578eI3vOAAAAKjDKGYBAIA64Tsnd9VpPVvrzucXatW2/b7jAAAAoI6imAUAAOqEtDTTxFGDlZluGjc1V4VFxb4jAQAAoA6imAUAAOqM9s0a6I5LBurTNbv06MwVvuMAAACgDqKYBQAA6pSLsjvo/MHtNfm1JZq3frfvOAAAAKhjKGYBAIA6xcx01yUD1bJRlsZOydWhgiLfkQAAAFCHUMwCAAB1TvOGWbp/5GAt3bJPD7yy2HccAAAA1CEUswAAQJ00tE9bffuko/WX91bqg+XbfccBAABAHUExCwAA1Fnjz+urrq0a6dppedpzqMB3HAAAANQBFLMAAECd1TArQ5NGZ2vTnkO6fcYC33EAAABQB1DMAgAAddoxXVro50N76OlP1+nleZt8xwEAAIBnFLMAAECdd9WZvTSoYzPdOH2utuw95DsOAAAAPKKYBQAA6rzM9DRNHpOt/YcLNf7puXLO+Y4EAAAATyhmAQCAhNCzbRP9+ty+emPRFv3nk7W+4wAAAMATilkAACBhXHFKV53as5XueH6BVm/f7zsOAAAAPKCYBQAAEkZammniyGylp5mumZqnomKGGwIAAKQailkAACChdGjeQL+5eIBmrd6pR2cu9x0HAAAAtYxiFgAASDiX5HTUeYOO0uTXlmj+ht2+4wAAAKAWUcwCAAAJx8x01yWD1LxhlsZNydOhgiLfkQAAAFBLKGYBAICE1KJRlu4fOViLN+/VpNeW+I4DAACAWkIxCwAAJKxhfdrqGyd20Z/eXaEPV2z3HQcAAAC1gGIWAABIaDed109dWjbUNVPztPdQge84AAAAqGEUswAAQEJrVC9Dk0bnaOPug/rNcwt8xwEAAEANo5gFAAAS3nFHt9BPh/bQtNnr9Or8Tb7jAAAAoAZRzAIAAEnhV2f21oAOTTX+v3O1bd9h33EAAABQQyhmAQCApJCVkabJY3K093Chbnh6rpxzviMBAACgBlDMAgAASaN3uya6/pw+en3hZk2btc53HAAAANQAilkAACCpfP/Ubjq5eyvd/tx8rd1xwHccAAAAxBnFLAAAkFTS0kwPjM5WmpmumZqnomKGGwIAACQTilkAACDpdGzeQBMuGqCPV+3Qn99d4TsOAAAA4ohiFgAASEojju2ocwccpQdfXaKFG/f4jgMAAIA4oZgFAACSkpnp7hGD1LRBpsZOydXhwiLfkQAAABAHFLMAAEDSatkoS/ePHKRFm/Zq8mtLfccBAABAHFDMAgAASe2Mvu10+Qmd9ejM5fp45Q7fcQAAAFBNFLMAAEDSu/n8/urcoqGumZarfYcLfccBAABANVDMAgAASa9RvQxNGp2t9TsP6o7nFviOAwAAgGqgmAUAAFLCkK4t9ePTe2jKrLV6bcFm33EAAABQRRSzAABAyhh7Vm/1a99U4/87R9v3HfYdBwAAAFVAMQsAAKSMrIw0/XZMjvYcLNT4/86Vc853JAAAAFQSxSwAAJBS+hzVRNee01uvLtisp2av8x0HAAAAlUQxCwAApJwfnNZdJ3RrqdufW6C1Ow74jgMAAIBKoJgFAABSTnqa6cFR2ZKka6flqbiY4YYAAACJgmIWAABISZ1bNtStF/bXRyt36C//W+k7DgAAACqIYhYAAEhZo47rpLP7t9PEVxZr8aa9vuMAAACgAihmAQCAlGVmumfEIDVtkKGrp+Qqv7DYdyQAAACUg2IWAABIaa0b19O9IwZr4cY9+u3rS3zHAQAAQDkoZgEAgJR3Vv92GjOksx55Z7lmr97hOw4AAADKQDELAABA0i0X9lfHFg00dkqe9h8u9B0HAAAApfBezDKzc81ssZktM7MbSmkz2swWmNl8M3uytjMCAIDk17hehh4claO1Ow/ozhcW+o4DAACAUngtZplZuqSHJQ2X1F/S5WbWP6pNL0njJZ3qnBsg6epaDwoAAFLCCd1a6kdf7a5/f7xGby7a7DsOAAAAYvB9ZdYJkpY551Y45/Il/UfSxVFtrpT0sHNupyQ557bUckYAAJBCxp3dW32PaqLrn5qrHfvzfccBAABAFN/FrI6S1kY8Xhcui9RbUm8ze8/MPjSzc2stHQAASDn1MtI1eUyO9hws0E3T58o55zsSAAAAIvguZlVEhqRekoZKulzSn8yseXQjM/uRmc0ys1lbt26t5YgAACCZ9GvfVOO+1lsvzduk6Z+t9x0HAAAAEXwXs9ZL6hzxuFO4LNI6STOccwXOuZWSligobn2Jc+4x59wQ59yQNm3a1FhgAACQGq78Sned0LWlbnt2vtbvOug7DgAAAEK+i1mfSOplZt3MLEvSZZJmRLV5RsFVWTKz1gqGHa6ozZAAACD1pKeZHhydrWLndO3UPBUXM9wQAACgLvBazHLOFUr6haRXJC2UNNU5N9/MfmNmF4XNXpG03cwWSHpL0nXOue1+EgMAgFTSuWVD3Xphf32wYrv++t5K33EAAAAgyZJxUtMhQ4a4WbNm+Y4BAACSgHNOVz4xSzOXbtPzV52m3u2a+I4EAADghZnNds4N8Z3D9zBDAACAOs3MdM+IwWpSL0Njp+Qqv7DYdyQAAICURjELAACgHG2a1NPdIwZp/oY9+t0bS33HAQAASGkUswAAACrgnAFHaeRxnfSHt5dp9uqdvuMAAACkLIpZAAAAFXTbhf3VvlkDXTM1VwfyC33HAQAASEkUswAAACqoSf1MPTg6W6t3HNBdLyz0HQcAACAlUcwCAACohJO6t9IPT+umf320Rm8t3uI7DgAAQMqhmAUAAFBJ13ytj/q0a6Lrn5qjnfvzfccBAABIKRSzAAAAKql+Zromj8nRrgP5uvmZeXLO+Y4EAACQMihmAQAAVEH/Dk019uzeemHuRj2bu8F3HAAAgJSRUV4DM1tRxW0751yPKj4XAACgzvvxV3vozYVbdMuz83RCt5bq0LyB70gAAABJryJXZqVJsircuOoLAAAktfQ004Ojs1VU7HTdU3kqLma4IQAAQE0r98os51zXWsgBAACQkI5u1Ui3XNBf4/87V3//YJW+d2o335EAAACSGldPAQAAVNNlx3fWmX3b6t6XFmnZlr2+4wAAACQ1ilkAAADVZGa65+uD1DArXWOn5KmgqNh3JAAAgKRVkQngv1PVjTvnnqjqcwEAABJJ2yb1dc+IQfrJPz/VQ28u07ize/uOBAAAkJTKLWZJelxSZWcztfA5FLMAAEDKOHdge404tqMefmuZhvVpo2O6tPAdCQAAIOlUpJj1vRpPAQAAkCQmXDRAH63YoXFT8/TCL09Tw6yK/HMLAAAAFVWRXzP8e20EAQAASAZN62dq4qjB+safPtI9Ly7SHZcM9B0JAAAgqTABPAAAQJyd0qO1fnBaN/3jw9V6Z8lW33EAAACSCsUsAACAGnDdOX3Uq21jXTctT7sO5PuOAwAAkDSqVMwys0Zmdp2ZvW5mC81sRYzb8niHBQAASBT1M9M1eUyOduzP183PzPMdBwAAIGlUuphlZs0lfSTpPklDJPWR1EJSO0ldw1tWVbYNAACQTAZ2bKarz+ql5+ds1LO5633HAQAASApVKTjdLKm/pB8oKGJJ0mRJjSWdIulTScsl9YtHQAAAgET2k9N76JguzXXLM/O0cfdB33EAAAASXlWKWRdJmumc+5tzzpUsdIEPJZ0nqa+km+KUEQAAIGFlpKdp8ugcFRQ5Xf/UHBUXu/KfBAAAgFJVpZjVWdLsiMfFkuqVPHDObZH0kqTLqhcNAAAgOXRt3Ug3nd9P7y7dpn98uNp3HAAAgIRWlWLWAQUFrBK7JR0V1WazpI5VDQUAAJBsvnliFw3t00b3vLRQy7fu8x0HAAAgYVWlmLVWwdVZJRZI+qqZRW7rNEmbqhMMAAAgmZiZ7v/6YDXITNe4KbkqKCou/0kAAAA4QlWKWe9IOt3MLHw8RVIPSS+a2c/NbJqkkyS9GKeMAAAASaFt0/q669JBylu3Ww+/tcx3HAAAgISUUYXn/F1SlqROCq7SekTSGZIukfS1sM17Cn71EAAAABHOG9Relx7TUQ+9uUzD+rRVdufmviMBAAAklEpfmeWc+9Q591Pn3NrwcaFzboSk4yVdLulkSac753bFNyoAAEBymHDRALVtUk9jp+bqYH6R7zgAAAAJpSrDDGNyzs12zk1xzn3knGMSCAAAgFI0a5CpB0Zla8XW/brv5UW+4wAAACSUShezzKyBmXUxs6xS1tcL19evfjwAAIDkdGrP1vreqV31+Pur9O7Srb7jAAAAJIyqXJl1q6TFkhqXsr6RpEWSbqxqKAAAgFTw63P7qmfbxrpu2hztPlDgOw4AAEBCqEoxa7ik151zO2KtDJe/LumC6gQDAABIdvUz0zV5dI627TusW2fM8x0HAAAgIVSlmNVV0pJy2iwJ2wEAAKAMgzo10y/P7KVnczfo+TkbfMcBAACo86pSzMqUVN4E704Sc2YBAABUwM+G9lBO5+a6afo8bdp9yHccAACAOq0qxawVkk4vp81QSaursG0AAICUk5Gepkmjs3W4sEjXPz1HzjnfkQAAAOqsqhSzZkg6zsyuj7XSzG6QdKykZ6oTDAAAIJV0b9NYN53XTzOXbNU/P+T/BAEAAEqTUYXnPCDpm5LuMbPRkl6VtF5SR0nnSMqRtEbS/fEKCQAAkAq+ddLRem3hFt314kKd2rO1urcp7cejAQAAUlelr8xyzu1UMIzwIwVXYN0g6Xfh/TGSPpA0LGwHAACACjIzTRw5WPUy0jV2ap4Ki8qbphQAACD1VGWYoZxzq5xzp0gaIukXkm4J74c4505zzq2KX0QAAIDU0a5pfd15yUDlrd2lP7y93HccAACAOqcqwww/55z7VNKnccoCAAAASRdmd9BrCzbrd28s1bA+bTWoUzPfkQAAAOqMKl2ZVcLMGpnZMWb2lXgFAgAAgHTHxQPVunE9XT3lMx0qKPIdBwAAoM6oUjHLzDqZ2dOSdkqaJemtiHWnmdkCMxsan4gAAACpp1nDTE0cNVjLt+7XfS8v8h0HAACgzqh0McvM2iuY/P1iSc8rmPDdIpp8JKmtpDHxCAgAAJCqvtKrja44pav+9t4qvbdsm+84AAAAdUJVrsy6TUGx6mzn3AhJr0WudM4VSHpX0qnVjwcAAJDafn1uX3Vv00jXTsvT7oMFvuMAAAB4V5Vi1nmSZjjn3iqjzRpJHaoWCQAAACUaZKVr8ugcbdl7WBNmzPcdBwAAwLuqFLPaSVpaTpsCSY2qsG0AAABEye7cXFed0VPTP1uvF+du9B0HAADAq6oUs3ZI6lxOm96SNlVh2wAAAIjh58N6KrtTM904fa627DnkOw4AAIA3VSlmvSfpIjM7KtZKM+sl6VxF/MIhAAAAqiczPU2TxuToUEGRrn96jpxzviMBAAB4UZVi1kRJ9SW9Y2bDJTWUJDNrFD5+TlKxpAfjlhIAAADq0aaxxg/vp7cXb9WTH6/xHQcAAMCLjMo+wTn3kZn9WNIf9f/s3XeUXXW9/vH3Zya9UZIQIKGXQEhI1IAKgg0VRJpAQK8d27VcaSJVvSIdghevXhHxZ9ckiIiCIGBBFJSWECAEEnpoAUJISJ2Zz++PvQdPhgTSZvacmfdrraxk9tlz5klW1j7nPPtb4Pc1D71Y/t4EfCIzXaFUkiRpPfvwm7bi+hlP883fz2DP7Yaw9RCXKZUkSd3L2ozMIjN/CIwGLgL+BcwG7gC+C+yamT9fbwklSZL0soaG4LzDxtKzMTh28lSamluqjiRJktSh1qrMAsjMBzLzmMx8c2bumJm7ZeYXM3MmQEQMXX8xJUmS1GrTDfpw+sGjuePRF7j4xgerjiNJktSh1rrMWpWI2CAizqQYrSVJkqR2cNC44bxv18248Lr7uXvO/KrjSJIkdZg1KrMiYquIeH9EHBARw9o81iciTgIeBE5c0+eWJEnSmvnmwaMZPKAXx0yaypLlzVXHkSRJ6hCrXThFxEUUo62mAFcAD0fE58rH3gbMBL5Jsbvh/wDbru+wkiRJ+rcN+/Xi3MPG8sAzCznv2plVx5EkSeoQq1VmRcRHgS+UX84of/UELiofuwbYHLgY2K5cS+uZdsgrSZKkGm/dcSgfftNWXHrTQ/xj9rNVx5EkSWp3qzsy62PAMmCvzBydmaOBdwDNwKXAU8DrM/NzmflEuySVJEnSSp303p3YZkh/jp88jReXLK86jiRJUrta3TJrV+A3mXlz64HMvJFiumEAn8jM6e2QT5IkSa+hX68eTJwwlqcXLOXrV95TdRxJkqR2tbpl1gbArJUcf6D8/eaVPCZJkqQO8rotN+Lzb9uOy++YwzV3P1l1HEmSpHazumVWA7CyMevLATJz8XpLJEmSpLXyxXfuwJjhG3DS5dN5ZsGSquNIkiS1i9XezRDIdkshSZKkddazsYELjxjLomXNnPjr6WT69k2SJHU9a1JmfT0immt/AV8FaHu8/NXUPpElSZK0KttvMpAT99uJP933DL+69bGq40iSJK13a1JmxRr+WpPnliRJ0nry0TdvzZ7bD+b039/LI8+9VHUcSZKk9Wq1CqfMbFibX+0dXpIkSa/U0BCcd9hYGhuC4yZPo7nF6YaSJKnrsHCSJEnqgjbfsC+nHzSa2x6Zx8U3zq46jiRJ0npjmSVJktRFHTRuc/YfsxkXXnc/9zwxv+o4kiRJ64VlliRJUhcVEXzz4NFs1K8Xx06axpLlzVVHkiRJWmeWWZIkSV3YRv17cc5huzLz6QVMvO7+quNIkiStM8ssSZKkLu7tIzfhP964JZf87UFuefC5quNIkiStE8ssSZKkbuCU/Xdmq437cdzkaSxYsrzqOJIkSWvNMkuSJKkb6NerBxOPGMeT8xfzjd/dW3UcSZKktWaZJUmS1E28fsuN+NzbtmfK7Y/zx3ueqjqOJEnSWrHMkiRJ6kb+6507sMvmgzjp8uk8u3Bp1XEkSZLWmGWWJElSN9KrRwPfOmIcC5Y2ceKvp5OZVUeSJElaI5ZZkiRJ3cwOwwZywntGcv2Mp5l822NVx5EkSVojllmSJEnd0Cf23IY3bzuYb/zuXh59blHVcSRJklabZZYkSVI31NAQnD9hLA0RHDdlKs0tTjeUJEn1wTJLkiSpmxq+YV++fuAu3PrwPC7524NVx5EkSVotllmSJEnd2PtfP5x9d9mUiX+8nxlPvlh1HEmSpNdkmSVJktSNRQRnvn8Mg/r25JhJU1na1Fx1JEmSpFdlmSVJktTNaaSzcwAAIABJREFUbdy/F+ceNob7nlrAxOvurzqOJEnSq7LMkiRJEu/YaRgf2H1Lvn/jg/zroeerjiNJkrRKllmSJEkC4NT9d2bLjftx3JSpLFzaVHUcSZKklbLMkiRJEgD9e/dg4oSxzJm3mNN/d2/VcSRJklbKMkuSJEkve8NWG/PZt27HpNse47p7n646jiRJ0itYZkmSJGkFR++zI6M2G8RJl9/FcwuXVh1HkiRpBZZZkiRJWkGvHg1ceMQ4XlzcxEmXTyczq44kSZL0MsssSZIkvcLITQfy5feM5I/3Ps1ltz9edRxJkqSXWWZJkiRppY56yza8cZuN+e/f3ctjzy+qOo4kSRJgmSVJkqRVaGgILpgwFoDjp0yjpcXphpIkqXqWWZIkSVqlERv142sHjOKfDz3PpTc9VHUcSZIkyyxJkiS9usPeMIJ3jxrGedfOZOZTC6qOI0mSujnLLEmSJL2qiOCs949hUN8eHD1pKsuaWqqOJEmSurHKy6yI2DciZkbErIg48VXOOzQiMiLGd2Q+SZIkweABvTn7/bsy48kX+db191cdR5IkdWOVllkR0Qh8B9gPGAV8ICJGreS8gcCXgH92bEJJkiS12mfUMI4YvwXf++tsbnv4+arjSJKkbqrqkVm7A7My88HMXAb8CjhoJeedDpwDLOnIcJIkSVrRaQeMYvhGfTl28jQWLm2qOo4kSeqGqi6zhgOP1Xz9eHnsZRHxemCLzLyqI4NJkiTplQb07sEFh4/jsXmLOOOqe6uOI0mSuqGqy6xXFRENwETguNU499MRcVtE3DZ37tz2DydJktRN7b7Nxnx672355b8e44YZT1cdR5IkdTNVl1lzgC1qvh5RHms1EBgN/CUiHgbeBFy5skXgM/P7mTk+M8cPHTq0HSNLkiTp2HftyE6bDuQrv57OcwuXVh1HkiR1I1WXWbcCO0TENhHRCzgSuLL1wcycn5lDMnPrzNwauAU4MDNvqyauJEmSAHr3aOTCI8bx4uLlnPKbu8nMqiNJkqRuotIyKzObgC8A1wIzgMmZeU9EfCMiDqwymyRJkl7dzpsN4rh378g19zzF5XfMee1vkCRJWg+iK95FGz9+fN52m4O3JEmS2ltzS/KB79/CjCdf5Jpj9mb4hn2rjiRJktpJRNyema9Y+qmjVT3NUJIkSXWssSG4YMJYWjI5fvI0Wlq63o1SSZLUuVhmSZIkaZ1ssXE/vnbALtz84HP88O8PVR1HkiR1cZZZkiRJWmeHjx/BPjsP49xrZ3L/0wuqjiNJkrowyyxJkiSts4jg7EPHMLB3D46ZNJVlTS1VR5IkSV2UZZYkSZLWiyEDenPW+8dwzxMvctEND1QdR5IkdVGWWZIkSVpv3r3Lphz+hhF89y+zuP2ReVXHkSRJXZBlliRJktarrx4wis037Mtxk6eyaFlT1XEkSVIXY5klSZKk9Wpgn55ccPhYHnl+EWdcNaPqOJIkqYuxzJIkSdJ698ZtB/Opvbbl5/98lD/PfKbqOJIkqQuxzJIkSVK7OPZdOzJy2EBOuOwu5r20rOo4kiSpi7DMkiRJUrvo07ORC48YxwuLlnHqFXeTmVVHkiRJXYBlliRJktrNqM0Hccy7duSq6U/y26lPVB1HkiR1AZZZkiRJalef2Xs7xm+1Eaf99m6eeGFx1XEkSVKds8ySJElSu2psCC6YMJbmluT4KdNoaXG6oSRJWnuWWZIkSWp3Ww3uz2nvG8U/Zj/Hj/7xcNVxJElSHbPMkiRJUoc4crcteOdOm3DONfcx65kFVceRJEl1yjJLkiRJHSIiOOvQMfTv3YNjJk1jeXNL1ZEkSVIdssySJElSh9lkYB/OPGQM0+fM59s3PFB1HEmSVIcssyRJktSh9h29KYe+fgTf+cts7nx0XtVxJElSnbHMkiRJUof72oGj2HRQH46dPI1Fy5qqjiNJkuqIZZYkSZI63KA+PTn/8LE8/NxLnHX1fVXHkSRJdcQyS5IkSZV483aDOWrPbfjpLY/w1/vnVh1HkiTVCcssSZIkVeb494xkx2ED+PKUabywaFnVcSRJUh2wzJIkSVJl+vRsZOKEccxbtIxTr7i76jiSJKkOWGZJkiSpUqOHb8DR++zI7+96kt9OnVN1HEmS1MlZZkmSJKlyn9l7W16/5YacdsXdPDl/cdVxJElSJ2aZJUmSpMr1aGxg4oRxNLUkJ1x2Fy0tWXUkSZLUSVlmSZIkqVPYekh/Ttl/Z/72wLP89JZHqo4jSZI6KcssSZIkdRof3H1L3j5yKGf9YQaz5y6sOo4kSeqELLMkSZLUaUQE5xy6K317NnLspKksb26pOpIkSepkLLMkSZLUqWwyqA9nHDKGaY/P5zt/nlV1HEmS1MlYZkmSJKnTee+YzTjkdcP59p9mMe2xF6qOI0mSOhHLLEmSJHVKXz9wFzYZ2JtjJk1l8bLmquNIkqROwjJLkiRJndIGfXty/uFjefDZlzj7DzOqjiNJkjoJyyxJkiR1WntuP4SP77k1P775Ef72wNyq40iSpE7AMkuSJEmd2lf23YntNxnAl6fcxfxFy6uOI0mSKmaZJUmSpE6tT89GvnXEOJ5duJTTfnt31XEkSVLFLLMkSZLU6Y0evgFfeucOXDntCX437Ymq40iSpApZZkmSJKku/OfbtuN1W27IqVfczVPzl1QdR5IkVcQyS5IkSXWhR2MDEyeMY1lTCyf8+i4ys+pIkiSpApZZkiRJqhvbDOnPyfvvzI33z+VntzxSdRxJklQByyxJkiTVlQ+9cUveuuNQzrh6Bg/OXVh1HEmS1MEssyRJklRXIoJzD9uVPj0bOWbyNJqaW6qOJEmSOpBlliRJkurOsEF9+ObBo5n22At89y+zq44jSZI6kGWWJEmS6tL7dt2cg8ZtzkU3PMD0x+dXHUeSJHUQyyxJkiTVrW8cOJohA3pz9KQ7WbK8ueo4kiSpA1hmSZIkqW5t0K8n5x8+ltlzX+Kca+6rOo4kSeoAllmSJEmqa2/ZYQgf22Nr/t/fH+bvs56tOo4kSWpnllmSJEmqe1/Zdye2Hdqf46dMY/7i5VXHkSRJ7cgyS5IkSXWvb69GLpwwjmcWLOXrV95TdRxJktSOLLMkSZLUJYzdYkO++I7t+c2dc7h6+pNVx5EkSe3EMkuSJEldxuffvj1jR2zAyb+ZzjMvLqk6jiRJageWWZIkSeoyejY2MPGIcSxZ3swJv76LzKw6kiRJWs8ssyRJktSlbDd0ACfttzN/mTmXn//z0arjSJKk9cwyS5IkSV3Oh9+0FXvtMIQzrprBQ8++VHUcSZK0HllmSZIkqctpaAjOO2wsvXo0cOzkqTQ1t1QdSZIkrSeWWZIkSeqSNt2gD6cfPJo7H32B7/11dtVxJEnSemKZJUmSpC7rwLGbc8DYzfnW9Q9w95z5VceRJEnrgWWWJEmSurTTD9qFwQN6ccykqSxZ3lx1HEmStI4ssyRJktSlbdivF+cdNpYHnlnIedfOrDqOJElaR5ZZkiRJ6vL23nEoH3nzVlx600P8Y/azVceRJEnrwDJLkiRJ3cJJ++3MtkP6c/zkaby4ZHnVcSRJ0lqyzJIkSVK30LdXIxOPGMfTC5by9SvvqTqOJElaS5ZZkiRJ6jbGbbEhn3/79lx+xxyuufvJquNIkqS1YJklSZKkbuWL79ieXUdswEmXT+eZBUuqjiNJktaQZZYkSZK6lZ6NDUycMI5Fy5o58dfTycyqI0mSpDVgmSVJkqRuZ/tNBnDifjvxp/ue4Ve3PlZ1HEmStAYssyRJktQtffTNW7Pn9oM5/ff38shzL1UdR5IkrSbLLEmSJHVLDQ3BeYeNpbEhOG7yNJpbnG4oSVI9sMySJElSt7X5hn05/aDR3PbIPC6+cXbVcSRJ0mqwzJIkSVK3dtC4zdl/zGZceN393PPE/KrjSJKk12CZJUmSpG4tIvjmwaPZqF8vjp00jSXLm6uOJEmSXoVlliRJkrq9jfr34pzDdmXm0wu44I8zq44jSZJehWWWJEmSBLx95CZ86E1b8oObHuKWB5+rOo4kSVoFyyxJkiSpdPJ7d2brwf05bvI0FixZXnUcSZK0EpZZkiRJUqlfrx5cMGEsT85fzH//7t6q40iSpJWwzJIkSZJqvH7Ljfj827fnstsf59p7nqo6jiRJasMyS5IkSWrjv965A6OHD+Kky6czd8HSquNIkqQallmSJElSGz0bG7hwwjgWLm3ipMvvIjOrjiRJkkqWWZIkSdJK7DBsIF/Zdyeun/EMk297rOo4kiSpZJklSZIkrcLH99iaPbYbzDd+dy+PPreo6jiSJAnLLEmSJGmVGhqC8w4fS0MEx02ZSnOL0w0lSaqaZZYkSZL0KoZv2Jf/PmgXbn14Hpf87cGq40iS1O1ZZkmSJEmv4ZDXDWe/0Zsy8Y/3M+PJF6uOI0lSt2aZJUmSJL2GiOCMQ8YwqG9Pjpk0laVNzVVHkiSp27LMkiRJklbDxv17ce5hY7jvqQVMvO7+quNIktRtWWZJkiRJq+kdOw3jA7tvyfdvfJB/PfR81XEkSeqWLLMkSZKkNXDq/juz5cb9OG7KVBYubao6jiRJ3Y5lliRJkrQG+vfuwcQJY5kzbzGn/+7equNIktTtWGZJkiRJa+gNW23MZ9+6HZNue4zr7n266jiSJHUrllmSJEnSWjh6nx0ZtdkgTrr8Lp5buLTqOJIkdRuWWZIkSdJa6NWjgQuPGMeLS5o46fLpZGbVkSRJ6hYssyRJkqS1NHLTgZzwnpH88d6nmXL741XHkSSpW7DMkiRJktbBJ/bchjdtuzHf+N29PPb8oqrjSJLU5VlmSZIkSeugoSE4//CxBHDclGk0tzjdUJKk9lR5mRUR+0bEzIiYFREnruTxYyPi3oi4KyJuiIitqsgpSZIkrcqIjfrxtQN34V8PPc+lNz1YdRxJkrq0SsusiGgEvgPsB4wCPhARo9qcdicwPjN3BS4Dzu3YlJIkSdJrO/T1w3nPLsM4/9r7ue+pF6uOI0lSl1X1yKzdgVmZ+WBmLgN+BRxUe0Jm/jkzWxcfuAUY0cEZJUmSpNcUEZx5yBgG9e3JMZOmsbSpuepIkiR1SVWXWcOBx2q+frw8tipHAX9o10SSJEnSWho8oDfnHDqGGU++yLeuf6DqOJIkdUlVl1mrLSI+BIwHzlvF45+OiNsi4ra5c+d2bDhJkiSp9M6dh3Hkbltw8V9nc9vDz1cdR5KkLqfqMmsOsEXN1yPKYyuIiH2AU4ADM3Ppyp4oM7+fmeMzc/zQoUPbJawkSZK0Ok593yiGb9SXYydPY+HSpqrjSJLUpVRdZt0K7BAR20REL+BI4MraEyLidcDFFEXWMxVklCRJktbIgN49mDhhHI/NW8QZV91bdRxJkrqUSsuszGwCvgBcC8wAJmfmPRHxjYg4sDztPGAAMCUipkbElat4OkmSJKnT2G3rjfnM3tvxy389xg0znq46jiRJXUZkZtUZ1rvx48fnbbfdVnUMSZIkdXNLm5o56H//zrMLl3Ht0XsxeEDvqiNJkrTWIuL2zBxfdY6qpxlKkiRJXVbvHo1868hxvLh4Oaf85m664o1kSZI6mmWWJEmS1I522nQQx717R6655ykuv+MVex1JkqQ1ZJklSZIktbNP7rUtu2+9MV+/8h7mvLC46jiSJNU1yyxJkiSpnTU2BBdMGEtLJsdPnkZLi9MNJUlaW5ZZkiRJUgfYYuN+fO2AXbj5wef44d8fqjqOJEl1yzJLkiRJ6iCHjx/BPjsP49xrZ3L/0wuqjiNJUl2yzJIkSZI6SERw9qFjGNi7B8dMmsqyppaqI0mSVHcssyRJkqQONGRAb84+dFfueeJFLrrhgarjSJJUdyyzJEmSpA72rlHDmDB+BN/9yyxuf+T5quNIklRXLLMkSZKkCpz2vlFsvmFfjp08jZeWNlUdR5KkumGZJUmSJFVgYJ+eTJwwjkefX8QZV8+oOo4kSXXDMkuSJEmqyO7bbMyn99qWX/zzUf583zNVx5EkqS5YZkmSJEkVOvbdO7LTpgM54dd38fxLy6qOI0lSp2eZJUmSJFWod49GJk4YxwuLlnHqFdPJzKojSZLUqVlmSZIkSRUbtfkgjn3XSK6e/hRXTJ1TdRxJkjo1yyxJkiSpE/j03tuy29Yb8dXf3sMTLyyuOo4kSZ2WZZYkSZLUCTQ2BBccPo6WluT4KdNoaXG6oSRJK2OZJUmSJHUSWw7ux2nvG8U/Zj/Hj/7xcNVxJEnqlCyzJEmSpE7kiN22YJ+dN+Gca+5j1jMLqo4jSVKnY5klSZIkdSIRwVnv35X+vXtwzKRpLG9uqTqSJEmdimWWJEmS1MkMHdibMw8Zw/Q58/n2DQ9UHUeSpE7FMkuSJEnqhPYdvSmHvn4E3/nLbO58dF7VcSRJ6jQssyRJkqRO6msHjmLTQX04dvI0Fi1rqjqOJEmdgmWWJEmS1EkN6tOT8w8fy8PPvcRZV99XdRxJkjoFyyxJkiSpE3vzdoM5as9t+Oktj/DX++dWHUeSpMpZZkmSJEmd3PHvGcmOwwbw5SnTeGHRsqrjSJJUKcssSZIkqZPr07ORC48Yx7xFyzj1irurjiNJUqUssyRJkqQ6sMvmG3D0Pjvy+7ue5LdT51QdR5KkylhmSZIkSXXis2/djjdstRGnXXE3T85fXHUcSZIqYZklSZIk1YnGhmDihLE0tSRfnnIXLS1ZdSRJkjqcZZYkSZJUR7Ya3J9T9x/FTbOe5Sc3P1x1HEmSOpxlliRJklRnPrD7Frxjp0046w/3MeuZhVXHkSSpQ1lmSZIkSXUmIjj70DH069XIsZOnsry5pepIkiR1GMssSZIkqQ5tMrAPZx4yhrsen8///mlW1XEkSeowllmSJElSndpvzGa8/3XD+d8/z2LqYy9UHUeSpA5hmSVJkiTVsa8ftAvDBvbm2ElTWbysueo4kiS1O8ssSZIkqY4N6tOT8w8fy4PPvsTZf5hRdRxJktqdZZYkSZJU5/bYfgif2HMbfnzzI/ztgblVx5EkqV1ZZkmSJEldwAn7jmT7TQbw5Sl3MX/R8qrjSJLUbiyzJEmSpC6gT89GvnXEOJ5duJTTfnt31XEkSWo3llmSJElSFzF6+AZ86Z07cOW0J/jdtCeqjiNJUruwzJIkSZK6kP9823a8bssNOfWKu3lq/pKq40iStN5ZZkmSJEldSI/GBiZOGMeyphZO+PVdZGbVkSRJWq8ssyRJkqQuZpsh/Tl5/5258f65/OyWR6qOI0nSemWZJUmSJHVBH3rjlrx1x6GccfUMHpy7sOo4kiStN5ZZkiRJUhcUEZx32K706dnIMZOn0dTcUnUkSZLWC8ssSZIkqYvaZFAfzjh4DNMee4Hv/mV21XEkSVovLLMkSZKkLmz/XTfj4HGbc9END3DX4y9UHUeSpHVmmSVJkiR1cf990GiGDuzNMZOmsmR5c9VxJElaJ5ZZkiRJUhe3Qd+enH/4WGbPfYmz/3Bf1XEkSVonllmSJElSN7Dn9kP42B5b86N/PMxNDzxbdRxJktaaZZYkSZLUTZy4305sN7Q/X75sGvMXL686jiRJa8UyS5IkSeom+vRs5MIjxjF3wVK+9tu7q44jSdJascySJEmSupFdR2zIF9+xA1dMfYKr7nqy6jiSJK0xyyxJkiSpm/n827dj7BYbcsoV03nmxSVVx5EkaY1YZkmSJEndTI/GBi6cMJYly5s54dd3kZlVR5IkabVZZkmSJEnd0LZDB3Dye3fmLzPn8vN/Plp1HEmSVptlliRJktRNffhNW7HXDkM446oZPPTsS1XHkSRptVhmSZIkSd1URHDeYWPp1aOBYydPpam5pepIkiS9JsssSZIkqRvbdIM+nH7waO589AW+99fZVceRJOk1WWZJkiRJ3dyBYzfngLGb863rH+DuOfOrjiNJ0quyzJIkSZLE6QftwuABvThm0lSWLG+uOo4kSatkmSVJkiSJDfv14rzDxvLAMws579qZVceRJGmVLLMkSZIkAbD3jkP56Ju34tKbHuIfs5+tOo4kSStlmSVJkiTpZSfutzPbDu3P8ZOn8eKS5VXHkSTpFSyzJEmSJL2sb69GLpwwjk036MPMpxYwZ94i5i5YSktLVh1NkiQAelQdQJIkSVLnMmb4Bpy6/yj+61d38vi8xYzYqC8Xf+gNDB3UG4AeDQ00NgQ9GmKF3yOi4uSSpO7AMkuSJEnSCp57adnLRRbA4/MW85mf3c5p7xvFZ356+yq/r7EhaIyagquxtvBasQBrbAh6NAaNDQ2vKMVWLMraFGeNqzjeUDxXYwMrPmfjio+3/VltM6zbz7fQk6SOYJklSZIkaQXLmppfLrJaPT5vMdsM7s83Dx5Nc0vS1JK0lL83t7SUv+e/f29exfHW85uTllzx/KbmZMny5pWcnzS1tNDc/MrjzTWPd4aZkA3RZuTaGhZ6jdG2gFuzQq1hZcXdGhR6Dev48y30JHUEyyxJkiRJK+jVo5ERG/VdodAasVFfNurfiw+9aasKk726lpakOWvKruayBFtZmVYWaG0LtZeLs1UUcG2Pr2uh11ybufx6aVM3LvRiZQXc6hdqK46sW/NCb338/B4WelK7s8ySJEmStILB/XtxyUfG86mf3PbymlmXfGQ8g/v3qjraq2poCBoIejZWnaQ6VRR6zS0tNLdgoVdjbQu9xtrvW4tCrWGF89e80GuIWKefb6G3opaW5LmXlrGsqZlePRoZ3L8XDQ3+u6wPllmSJEmSVtDQEIwcNpDffG5PP4TVGQu9tSv0VlaodXSh19RSFotrWeg1tbTQ0kJ9F3rR5vE1LNReuebdmhV6jW1/zlr8/NbHGoD7n1n4ipsCI4cN9Fq6HlhmSZIkSXqFhoZg6MDeVceQ1piFXnWF3opTb7t3oXfxh9/A6b+/d4WNND71k9v4zef29Nq6HlhmSZIkSZLUhVjorX2h17ZQW9tCb8uN+q10I41lTc0V/Yt0LZZZkiRJkiSpS6m60Ju7YOlKN9Lo1aMbN4zrUUPVASRJkiRJkrqS1o00RmzUF6BuNtKoF47MkiRJkiRJWo/cSKN9WWZJkiRJkiStZ26k0X6cZihJkiRJkqS6YZklSZIkSZKkumGZJUmSJEmSpLphmSVJkiRJkqS6YZklSZIkSZKkumGZJUmSJEmSpLphmSVJkiRJkqS6YZklSZIkSZKkumGZJUmSJEmSpLphmSVJkiRJkqS6YZklSZIkSZKkumGZJUmSJEmSpLphmSVJkiRJkqS6YZklSZIkSZKkumGZJUmSJEmSpLphmSVJkiRJkqS6YZklSZIkSZKkumGZJUmSJEmSpLphmSVJkiRJkqS6YZklSZIkSZKkuhGZWXWG9S4i5gKPVJ1jPRkCPFt1CEmqY15HJWndeB2VpHXTla6jW2Xm0KpDdMkyqyuJiNsyc3zVOSSpXnkdlaR143VUktaN19H1z2mGkiRJkiRJqhuWWZIkSZIkSaobllmd3/erDiBJdc7rqCStG6+jkrRuvI6uZ66ZJUmSJEmSpLrhyCxJkiRJkiTVDcssSZIkSZIk1Q3LLEmSJEmSJLWriGh4ta/XhGWWJEmrKSIaa/7sa6gkdYDaa68kqX5lZgtARBwUEQNav14bvhHvplb1piAioqOzSFK9yMxmgIi4CBhbcRxJ6hZqrr3HRMRw369KUv2KiAOBXwDrtBuhZVY3FBGNNW8K9oyI90fEyIgYkpnpaANJWrWI2Bz4JLBD+bUfqiSpnUXEm4ELgA3S7dglqZ7dV/4+Zl2epMd6CKI6EhFRU2RNAvYAhgBzgQci4rjMnFqe5xsFSd1eRDTUDIluABYCzwLbAXitlKT2VV575wIvAIMrjiNJWk2176NrLAOaKG4M37K2z+0InG6m9UNXRJwP7A58FtgeOAroD/wrIob74UySXr4B8PILcGa2ZOaLwM3AruU53hiSpPWo7SyB8to7C5gD7L+ycyRJnU/NDeEPR8R/RMQOFGXW1cBubc9fk2u7b8C7oYgYQDEi61LgusxcFhF9gJ2Ay4B5Nec6QktSt1VzA+AS4A3AdIoX302AjSOiV2YuqzCiJHU5NR9+LgYWU5RY/6IYGTuw9pzyPN+vSlInFREjgfOA5cBQipG2w4E7I+IDwKPAo5n5GMWAq9VaFN4yqxtYyQt8f2Ab4KmyyNoFuBG4FvhkZi6KiA8Df8zMpyuILEmdRkQMAWYBQfHCew7FdXQw8NeIuAe4i2L+/2PA45m5oKK4ktQllO9PNwRGAx8EngZ2Ad4YEYuBl4Ary+OLgOcriipJqtG2f8jMmRGxHcV76d2BQcDRwN7A8cDrgDkRMQ+YFREfBJa+1k2K8CZG19Zmsff+mflS+ec7KT58fRmYAdwAHJWZCyLiLcAxwAWZ+Y+KoktSJWqvm6t4fAuKGwI/o7iT9BzFaNe+FB+q3piZz3ZEVknqKlaxrkrrlJNewEhgP+BM4G6gNzCM4kPRn4BDM3N+xyWWJLXVZq3ZYcASoDEzn29z3tuBKcCBFOtnbQm8C/hNZl6zOj/LkVldWJsi6zSgZ0RckZl3AN+mGF3wIYptMT9S7mS4McUuXcOA2RVFl6RKtLluvpviWngfMDczHy5Pm1P+PhD4WmbeEBEDKUZr9bTIkqQ10+baO5pi5OsM4IVyKvcSYFq5LMb9wBGZOSMixgKbAQ9aZElStWrXmo2IU4D3ASOARyLie5n5s5rTX6LoozIz/0Uxlfyymud5zVFXllldVJtdC6dQLK72bYoduACuoRjidyDFG4QNyhFZh5fH9nKKoaTupM11czLF0OcGoB9wU0RcmplTyhfpxyLiXuA9EfEnYJFTCyVpzZV38VuvvT8H3kQx+nUGMDUi/rPceAOKImsYsFf5+PTMnFZBbElSGzVrzZ4GnAB8E2ikmDL+k4gYBZydmS9m5r8i4kllE31+AAAgAElEQVTgLcDNEdEItGRpdX6eZVYXVfMf6WSK0uoDwO2ZubR80/BERJwJPAJ8HjgEeBF4AnhrZt5dUXRJqkTNdfMsYDzFyNVbga2B8ylehB/KzNvKb3kUGF9+3yqnJUqSVq3mLv53gD0p1k+ZDbweOAm4tRyBtZRiB6zZFOsXrrAIvCSpehGxJXAwcDLwg8xcHBEbAF8AxgBZMxVxGcVaiLzaEh+rYpnVxaxkSN5uwO3A1MxcCsULfzmc+9GIOA/4Tnnew8C8tvNZJakrap3WEhEBRZlVrs3yRuBy4KbMXBIRz1CMFPgFcG/NU9wNjCp3iH3JnbQkae1ExKYURdY5wJXlBkVLKUZh/Z5ind8EXoqIh4G3lNfr1b6DL0lavyLik8D1NUtxQLHsxs7AE2WR1Ru4GbgT+Gy5RvcOwAPAH4C/re3Pb1jr5Op0yg9mrSMLxpWHRwPPlTsURuu5Nc3nNuUwvxsyc7ZFlqTuoHxhvT0iPtE6nDkielAMg96ZYnvgJeVw6HuAq4EvltfSD0bEVhQfsCZk5kI/TEnSa4uIvhExpbyG1uoHbAU8WRZZoyg+4FxFsUHR4og4tJyGch3whcxs8dorSdWIiHcB3weOjYgRNQ/1AOYDL5T9w50UM8AmZOaciHgH8H/lbuFfz8yranuKNWGZ1YXUrDfwK+CrEbERRdu5T0S8vvyw9vJ/lIjYB/hURAytJrEkVWYYxWjUSyLiSIDMbCoL/duBA8ubAjcC1wOfLIusPYEJwA6ZOS0zZ1YTX5Lq0vbA24Ar2nz4eZ5iGuGOETEIuIlip+1PldfedwJHAttl5sWZOaODc0uSamTmdcBnKJYsOrGcXkhmTqeYyfAdik2UngfeXxZZA4F3l0/ROzOXlN+zVjcmLLO6gHKYdeuf9wHGARMzcx5wbfnQf0XEmJqRWxsDH6MYubW0YxNLUrUy81HgOOBnwC9aC62y8L+cYoTAv4AbM3NCOSR6Y+AoYFOK0VqSpDUzg2J3q97AH1sLrcx8Afg/4ESKzYqupNhpe0FEDKZ4z7oRxYciSVKFytkMZOYlFNfnzwGfi4jty1O+TDEaa3vguHK97s0p3nt/DrggM+e84onXkGtmdQE1C2eeATRRzEm9uXzsqojYCTgG2Cki/h/FPNY9gbdTLPb+4kqfWJK6oIjomZnLM3N2RPyA4gPSLyJiSWZeERG/oLgpcHB5/vbA64AD+Pdur09WlV+S6lHrtRf4Z0R8ApgE/DIiPpiZjwG/AcZS7CR7D7A0IvaiuInwXmDvzHx2FU8vSeoA5eLtTeWfPwMsBxZR9A29I+K8zLwjIk4BzgN+FxEPAglsC3wiM/+wkrW+1zyLU827hogYBvyJYq2Xa4CDgKaakVj/QTE15j3AkxQ7wRztroWSupPaF86IuIRiBNbGFLtmAXw4M38eEX2BL1FcS8cCc4DHgC+Vw6clSaupZucqIuJ8YATwBmA7iqndh2Tm4xGxG/ARigLreWAJxd39j2fmtErCS5JeISL+G/gv4EKKXb1HUuwE/l3g9Mx8ulzn8HPAEIrlPaZm5p21my+tUwbLrPrU5gNZ6zpYOwPnUtzROigz/9zmzUMjsAmwgOL/zksVRJekykXEBRQvuJ8AbgPGA58F9qeY2vKz8prZg2I69qPAssycX1FkSap75WjY/Si2bJ9FMUvgk8BCYN+y0OoHbAHsCjxEsSHHMxVFliS1ERFbUAyk+SlwVjnqloj4AnAR8L/AhZn5ULvmsMyqP63bya/s64jYEfgRMJyi0JraWnytj6F8klTvIqIPxQvwvZn5yZrjo4CvAYcDh2Xm5eXxFa65kqQ1V374uQ74YWaeWx7rDbwJ+AFFoXVAZj5eXUpJ0mspl+C4h2KDpJ/WjrSKiG9Q3LA4h+J6P7u9crgAfJ1pU1wdV66BdWVEfCwihmXm/cCHKaYSXhER41oLLIssSQKghWJ9wR7w8qhVMrN15xWAyyLiQ+VxiyxJWncLKdZt7dd6IDOXUqzzeg7FlO4fR8RW1cSTJL2amhlhjwF3APtGxKCyZ2jtli6jWEPrJODY8qZFu7DMqhOtOxbWFFmXUaznsg3FG4MfUmwxv0fZfrYWWpdFxPhqUktStWp3e22VmcuAqcD+EbF1ZjZHRM/ysRsptoN/FPh2RAyqeeGWJK2GttfN8lrcTLFmyu7l7rCty2Yso1j8/UGKaYeTWnfKkiRVp+376JpBMkuBmyg2lTs4IgbU3PxN4I8UZdbV5bntk8/BOp1b2WQ2t+4YUB47CjgbeD9wa2YuiYj9KQqtO4AvZuascsrhbyjePOzWnv+RJKmzaTOSdQOA1jWvImJD4K8Uo7T2zcyny+PbAJeUv/6UmXOryC5J9arNtbdPZi6peWwf4A/A+cA3W9dvjYixFO9tJwL3Z+YjHZ9cktSqzRrdR1Ds9D0LuK11Q46I+BOwA3AxxcLv/Sk28DgQeEtmLmrPpY4sszqxiBgE3AhcnJn/V3P8TOB9wLjMbGl90xAR76bYyfCUzDyrvCu2HcWuhg9X8FeQpMpFxPeA3YBhFFNZfp2ZT0TEW4HvUUx5+RbF1sJ7ArtTvAA/WVFkSapLbTYeOhPYheLa+r/A7Zm5ICK+BFwATKaYjvIC8NHy3H0z89lKwkuSXiEiTgeOAZ4ANgOmAxMz87Ly8Z8DewGbU+z+vSnwwcz8dbtns8zqnMoiaxrFLi4faB01UD52CsV/qO0yc3653ktkZlNEfAd4F7B7Zr5QRXZJqlKbUQHfB94DXA4MptjB8IcUWwY/Ui5IPJGi7OpPMT37I5k5tZLwklSn2hRZPwXeTTENZTzFGoXnAz8oC62Dgf8BBpbfvhA40GuvJFWrzYiskcClFDckrgT2Bo4FRlC8l/5led4eFOseJjA1M2/piM3nnI/eCZVF1lSKIus/aous0h3AMuDTEfG98k1B69oEy8vH3D5eUrfTpsgaBswFPgtcU+6wch3wY6BXRHwjM2cBh0fEthTXzsWZ+VxV+SWp3pRrqmRNkdWb4ubABODG8tp7GcWN2F4RcXFmXhER/6K4yz8QmOloWEmqXk2RdTQwiOK99A2ZuQi4JiIWAycCXy37ql9l5j+Af3R0VsusTiYi+gK3UxRZBwJLWu90lYthDs7MP5QfyE4AFkbEL8oRWkMoWtIHgT4RscQdDCV1dRHRBxiTmbfWFFmnAV+nGBJ9WflhqqHcPrgJ+DmQEXFmZs7MzAcr+wtIUh0qS6so125toLim/oBiJNZ8YHbNYsGHRcSvgM8X3xrfy8wnKK7RkqQKRcTlwLWZeXH5dQPwNoo+Ygbw8qYemfnXiEiKBd5PKUdg/bLtc3ZED+Fuhp3PgcBQoCUzX8rM5rLI6k2x4Np/AmTmR4E/AycD10fETyjWHdgHODkzF1tkSerqymnWPwJ+EBFvr3loJnA9MIR/T2PpUfOC+x/AB4Ezy1FZkqTVVO4AOwm4IiL6le9VBwD3AhtT7Lbdene/N0BmHklx5/5TwDERMXClTy5J6jARMZRidtd3I+IjAOVI2yOAbwM7U8xi6Nv6PeXu32cAzwGnR8SmVez+bZnV+VxNMWxvZERcXXP8VuAZ4NLWLTIzcwJwJnAPsD3FiKw9MvPujo0sSdUoR2L9luJF+NSIeGd5fDLFC/AMYHJE7Fhu/15baH0KeCewZOXPLklahQDuB7aguJnQPzMXAj8BTgc2BM6DYgv3iOhV/vlI4D7gEKBXFcElSf9W7tx9AvB94EcR8dHy+FLgeIrr+rnAoeVsiNbvuwn4KsX63k9VMZDGBeA7kdZF0iKiP/AR4BSK3QK2AJ6nWJT44fLcl9eFKb/uTbFrYfMrn1mSup42C1QeDHwNmAecmZnXl8f3p3ihHQzsn5kzyxEFTeX1dlBmvljRX0GS6k7N+9U+FB90PgzcCRyVmS9FxMbA4RS7xE7KzI+V39ervKlARAzPzDnV/A0kSW1FxFYUUwc/DXw8M39cHu9BsXnSoRTr0E7JzE5xI9g1szqR8o1BlG8EflIe/hKwJcVWxY+3rp/VtrQqm1NJ6jZqrplZLiYcFMXVyRFBZl6fmVeVo1lPAa6OiP0y8/6y0FoOLKjy7yBJ9aZmDcIlEXE+xSitD1HMHjgqM5+PiCnl6d8qr8cfy8xlrYWWRZYkdS7lLt9nUVzT/1957f5xZjZFxCfK074N9CzX7K680HJkVidUc8drAPBR4CvA9Mzcv3y8R2Y2VRpSkjqJNiO0DqEotOYBZ2XmdeXxAyiupbsAu5W7GEqS1lLNBkV9gC9TFForG6F1HnBdZh5aYVxJ0mooR2idTLEcR9sRWr+kWON7m3ITj0o5MqsTqhltsDAifgS0UIw0uCoz9y/bUQstSeIVI7R+U64/+VXgpPKu0nWZ+btyzZbPVptWkupLzU3Wl28cQLFAcM0IrfPKw21HaE0G+gJfiYjNO8OHH0nSqpUjtM4sv2w7QusDwC6d5VruyKxObCVraJ0M3JGZB1UcTZIqERG9a6dVtxmVtaoRWmdk5g3l8QHlIsWSpNdQ7l51IfC9zJzattAqz3mtEVobAmTmCx2dX5K0dmpGaH0c+HxmXtLm8Ve8HnQ0dzOsSOuOhK92rHYNLYpdBL4JvCsiJnVQTEmqXEQ0RsTbIqJPa5EVEZ+KiCFtRglk67bAmfkb4BvAQODciHhbedwiS5JW377A+4CzI2KX2utsq9oRWhRTCn8GjKbYSbZfZr5gkSVJ1VpZ//BqxzPzEeAMiqmFF0fE8Nrrf9VFFjgyqxK1OxFGxM7l4ecz8+lVnF+7htYE4G+Z+UAHxZWkSkXESOBsoFdm7h8RvwW2ptid8PGVnF87QusI4HMUu8E+0oGxJalLKBf+/SLwHHB0Zt69GiO0vgbsAxzsYu+SVK3W63P557dTLPK+KDNvafv4Sr53K2BgZt7dYYFXk2VWB2vzH+lHwF7AIIp1sb4J/DYzH13J9610vQJJ6uoioh9wFMXurr3Lw/sAD7zKC29toeXUQklaQ7XTuiPiPymuw/Moppvc/xqFVm+KDz/PdnxySdLKlGthfYZiLcP5wI8z88TysVUWWjXf36m6CMusikTEJcC7KdYWmA/sCPwP8FPgZO9iSdK/lcOa/wmMB/4GvPO1NsPobC+4klQv2tx8/RownGIHq02A6ylGaN37aoVWh4eWJK2gzbV8D4qli75K0T/sAZwAXJqZn217fj1wzawKRMQIYDeK9VyuyMxrgUvLh58HvIslSaVyLv9mFB+gzgdGAJdHRK/WQmtl32eRJUlrp80sgqOAW4APAhcBI4GLXm0NrQ6OK0laiZpr+XuA9wA3U8wEu4riPfWxwMcj4uLW81e1hlZntNIPAFq/IqJnZi6vObQpsCswKzOXletm/R24DDglM5dGxK6ZeVcVeSWparVrC5YvxE8AJ5dTDucA/0VRaB1aXjMbKeb/983MBZUFl6QuIiK2oJjSfUFm/rA8/KeImAkcDXwrIr6QmTMdCStJnU95s2E0cCXFoJkrys3lyMx5EfGT8tTzI6I5Mz9XTzck6qZ1qzfl7ls7A7QWWWUjCvA48BCwTUSMoiiyrgM+kZmLIuJw4MxyBJckdSttNsnYOyI+HBF7RMQWmbmIYiTrt4GdgCkR0ZOiyDoD+HpZbEmS1lL5AagXsBHwVHmsD0Bm/h8wCXgnRaE1ziJLkjqfLEwHPgb0BA6IiLfUPD6fYurhMcBnI+IHlQRdS66Z1U4iYnfgdOCPmXlBRFwJ9AcOp1g88xpgZ2AAxdSZI4EEBgPnAsOAD2XmvAriS1Il2szt/xnwRopNMp4BHgFOzcyp5e6un6RYFD6B6RRbyO/mqFZJWjOrGlkVEVOBJzLzveXXfTNzcTlKdgbFLI9bKXbbXm6pJUnVeY1dCT8AfAv4C3BuZt5e89iGwEcoNlf6Q0dkXR+cZth+5gIPA1+JiI8AGwMHAAvK9QWOpBiNNQKYQrGjwEiKqTPvA/a2yJLUnZQfplqLrEuANwOfzczrImIScDAwtJzWcmt5zhzgEIq7Ta/LzHuryi9J9ah2NGz5de3GGucCEyPi/Mw8PjMXl8d3pXifeyVwWWYu69DQkqQVtLkhvB9Fz9APuCMz/5aZvyx3mj2rOCXOaS20MvOFiPhOZjbX07RxR2a1o3KtgZuALYCLMvPo8nivcq2szSjeBGxAsTvMwxTbzh+ZmdOqSS1JHSciegGDM/PJmmP7AF8HzszMqyPiOOBs4P+AtwGLgU9n5rSabeD7ZOaSjv8bSFL9ajOt+yyK6dvbUkw7uRp4gOL6eyTFshinApsDHyrPO7B1/RVJUvXKa/lnKXYsHAE8DdyQ/7+9O4/Xfaz3P/5627YdkhQ5mtSplE7naHaiSadQyJAG1SkklahEqTQgQ9Jk6qRwNJBEkqNJiZMGlalZnX6UhJJh27bYw+f3x3XdulvWZm97uNda+/V8PPZjrfv7vb73vu6112Ptdb+/1/X5VL2qn9+RFmh9B/hYVf1oRFNdbIZZS9iYXwoeTftGAdgYOKyqPtTPDQKtabS2mI+iLde+YvhNnSRNRb0eyzTgQuBS2vbBP/RzTwOeRVsR8HLgE8DrqurEJPvQfq7+ANirqn44ivlL0lSS5BTaativ0mplbUxrvHEgcAFt+8netBu0twCzgC2r6uKRTFiSdKct4kleQasruytwHjAH2Ad4BW2F1jZD444BvgHsVFUzl/XclwTDrKUkyauBz/WleuvT6rpsRwu0DutjVnJZtqTlWZJ30gq3H0XrmPX7fnytqvpLkm8BvwHeXlWzep2WX9AamPyW9mbKFVmSdA8l2Y5WR+XlwIW9JtZraW909quqA5KsSAu5NgNupNVV+ePIJi1JupMkhwGbAM+tqhv7sfvQwq0301Zifbgf/09aTcRvj2q+i8tuhktB/6XgaOBTSaZX1a9oCenpwN59y0wfmn2T7DyquUrSspZktb7Ciqo6BNgD2J328/Hh/fhfkqxJ28by16qa1S9/Cq0j7IG0DrAGWZK0CJKM/f3/QcDfgF/2IOtRwMHA54EP9TFrV9Xsqjq9qr5jkCVJo5PkrOHOg0OdvB8IzBsKslbsq64+RVtt+8zBNVX12ar6dt8tMSlZAH7p+BbtDtf2tEDrtVX1iySH9/PvTvJkYC6tu+ETRjRPSVqm+t2hnwIXJVm9qm6qqqP7/6NH9jGHVdUfquq6JL8Btk1yen+KlwKzgROravYoXoMkTTaDrSgL6HR1L+ABVXV9r+d6AfBNWm3C2UleA6yU5Dh3FEjSaPUi7scAdzQ9Gmri8WXg5CQvrqovAvN7GaSbkpwPbJFk1eFah5Ol2Pt4DLMW09gOMABVNTPJB/rDlwLHJtmlqn6Z5CPA1bQth9cDT+0rtyRpSutB1sXA74A39v9YU83R/c7QEX3sR6vq/9EKWJ4B/ITWJTbApgZZkrRIXppkvao6ACDJ/wA/rap3Ad8H/pLkaNpWw68Bb6iqW5I8iNZJ1t9VJWkCqKrbkpzZb1C8Fdi2qp7RT/8QOAU4KMnsqjoLoJfpeCjtZ/mUuSlhmLWYhoq97w58tb/5otd2+QBQwA7AJ5K8vqouS3IocCiwUlXdNKq5S9KykmQ14BLgMtrd/quHOhGuUFXzq+qoJMU/rtC6IsmGtOLDM4ELqurykb0QSZpk+rbCW4H9eji1DrABsH8fcgEt0HoD7YbDHv1mwwOBA4B/BfZ0VZYkjVbfNjh3aDXVDcATk5xRVVtX1ZVJjgNWA05KckQfsy6wNbBNVc0ZzeyXPAvA30NjuhY+klag+DRg70EB435udeBw2huxY4A3TaVvIEm6O71w8GnAVrStLNclmdHvLM2gdVk5rqqu6uPfSAu0jgY+YnglSYun/xzeDjiZdmPgeVX146HthysBnwaeSKurciXtzc9jgM2q6pIRTV2SlntJNqftCPxGf3ww8GPgK8BLgI8D36+qLfr5DWg/83cF5gNXAQdV1RljOyBOZhaAvwf6N8AgyDoYeADwPFqHlw8lWXdo3E3Ae2gFi3egb6GRpOXIvWj/4f6R9p/tYIn0qrT6WdsBswYFKKvqaFpR+N2A9yZ5yEhmLUmTXA+xqKq5wKq0Qu/3om3hpgdZK/ZVV68CDqF1ir0PcA6wsUGWJI1OkunAesDXkmyT5BBgL+D2nkmcAbwR2CjJWQBVdWlVvQ94LPA44PmDIGs0r2LpcGXWIhqzIutwYEvg1VV1fk9MTwO+Smsjf3kftzmwN/Bd4LODrYiStLzo9bJ2pq3COgd4JW3b4SzgpYPOWMPFiZPsTbsZsF5VXTuSiUvSFJDkS8D5/c/6wH/RuhW+tm/3vlMNWEnSxJBkLeDtwJtpTeS2HazS6udXBral7Wr4XlVt2Y8PSnpMmdVYw6yZtYiGgqyH0L5+B9DqDFBVX0/yIuCLwMpJPkor9r4NcAXwwaq6dRTzlqRR6o0xju8P96GtDvgJ8ALg5qFxwzW0PtS7Z90wgilL0qQ15ubrJsBTgI/Qfu5eTNudcTStqcbOVTWvbzXcvqpOGtG0JUnjqKq/JLmalj9Mo9U+BO7YDXZr7/xdwOFJzqmq5wxuEE/FIAsMs+6RJO8ADgauA84YbnHcA63NaW0xT6e9YZsHbG6QJWl5NhRoBdgduGnQBGNQ0LKPG76DdOPoZixJk9NQkHUALbj6CvCD/jvr/CQn0970HJ1kGnA8rZPhjkn+d7BaVpI0Wr2JRwHfptWffT5wbBKq6oTBuB5ofRmYTms+9+Sq+sko5rysGGbdhb4/9eG0oml/raob+j7TL9MKZG4P/EuSbw/90rBCVX0vyeOBTWjfTOdawFiS/iHQKmCfJF+sqhdX1dzhlQSDO0hT9U6SJC1tSZ5E29L9EODYweqrqrq9v+n5AjAH+CTwXNrWlQ0NsiRptIbLbgwtnLkUuDTJRbQbw8f1m7//3a8J8MCq+kySs6vq6pFMfhmyZtYC9Dbyp9DCrLVpdbAOq6pL+jfKI2jdtp4MvLCqfjB0rXUHJOkujKmhdX5Vvbgf9+enJN0DY2ui9N9XXwK8FXgk8MSq+v3wStg+7qHAvwIXV9WflvW8JUl/N6Z+7IuBJwErA5dW1fH9+AOBd9GaeewCnE1rNrcfsH5VXdnHTclaWQOGWePob7IuonXeOo4WXG3bj72pqm7u4x5Ju5u1Pq0I2w9HM2NJmnyGAq29gF9W1WYjnpIkTUpjbwQMHvdAaxvgUFrZi+dW1VWDQGuqv9GRpMlk+GdykoOA19AyiJnA1sBHqmrffv6BtJvCewC/oC3C2aWqTh7F3EfBMGuMviLrUuAy4HVV9Yd+/FDaUu1/rqrb+rHQvmmOAx4DbF1VPxrJxCVpEuqB1huBV9PeZLm9RZIWwZhi7/vQWrHPBb47qKeSZGta06JpwGbDgdaIpi1JWoAkbwTeDby5qk5J8krgM/30MVX1hj5uBrAl8GhaaaPv94xiuSjVYZg1JMmKwGm0wmoPqKrrkqxaVbckeQGt6Pt3gBnA2VV1er/uEbQWx88CNp7qhdYkaUnqNxGmV9X1o56LJE1WSU4Fngr8lFaXcDNayYz3V9VlSbYD3tuHbzXYhiJJmjiSrAV8GPhtVb2/34w4HdgfuI2WSXy4qt42dM3wiq7lZsXtCqOewARzL+DHtO2FHwfoQdaqwMf6+UfT6g6clmTfft3/o3Xm+jptCaAkaSFV1c0GWZJ0zyV5NS3IeiXwoqraCtiN1qHw3wGq6ku0N0NrAF9IMm1wB1+SNBq9o+zg81Wr6i+08OrEJOsDxwCHVNX+wInAb4C9knxicN1weLW8BFngyqw7GVOU+BzaLwWXALOB/6yq/0uyBvAO4G3As6rqu/1al2tLkiRpmUpyCG2HwCZVdVuSRwP/S9tRsGNV/a2PC20Hws+r6v+NbMKSpLHF3t8IPIh202FaVc1OsgewK2017RV93KeAJwAb0Bp7/Gwkk58AXJk1RlXNBI6nFcp8DvA3YBbwfOCKPuYG4HPAzbRvpMG1BlmSJElaasbcxR+srFoBuFcPsh4B/IAWZL2mqv6W5IAk21bzFYMsSRqtMUHWocCRtO6Ea1bV7D5sdeA+9Nwmyf2AtYBPAQ9ZnoMsMMwa11Cg9UHalsObqurG3vVleh82DbgWsIWxJEmSlomhYu/vBx7WD18OPCrJzsAFwLeA1/ZyGQ+htXbfoNeHlSSNSJrhIOswWjOkvWmLaB4yNPwntK3heyfZFXgL8HTgx1V1zeD5luX8JxK3Gd6FJKsDO9G2HJ5fVS/ux9cADgM2Ap5XVVeNbpaSJElaniS5P+2G6ieq6s392JnAFrQyGdtW1c1J1gEOBJ5J62LoiixJmiB6kLUb8BJacPU74OVV9ZWhMW8A9gVWoYVde1bVaSOY7oTj3Zm7UFU3JTm+P9wnyRdpNbT2B3YANjLIkiRJ0jJ2Pe3G6guSbFBVlwJ7AnNpZTLe1TvFPhzYEPgPgyxJGp0kJwFfqqpT++NtgD2AFwPfAFYCbgLu28+vUFXzq+q/knyzn5/Ta3gvNx0L74ph1t2oqplDgdZbgT/Tvm5P7784SJIkSUtFkmlDWwvT615VklNp3bQ3BS6l3dF/Ke2m6/q0uioXAHtV1a9HM3tJUm/KMZO2+gqAqvpykg2HMoW5Sa4FHtfPz0+yEvAU4HdV9buha5f7IAvcZrjQepfD3YHtgJ2r6qcjnpIkSZKWE0keWVX/N+bY/sAbaN21fzV0fDowH5jvmx5JGr0kM3qTjtcDK1XVEUPn0m9SnANcXVWv6DUO30H7Gb9pVf1iRFOfsCwAv5B6UfijaN9IBlmSJElaJpLsCfwmyVFJthw69RXatpTn93HTAapqTlXNM8iSpNFKMgOgB1n3BV4G7Jnk1UPDBk3mfgbcP8kKtLrd+wNvN8gan2HWIqiqmVV1/ajnIUmSpKlrnO5UX6K1bP934BNJPi/ywlQAABjFSURBVJ/kKVV1IXA68JYk96qqOctzZytJmiiS/HuSNavqtv54B2Aarb7hhcC7k+wEUFW398v+CDwSeC/wfmCHqjrRn+vjM8ySJEmSJoheI6v656sBVNXvq+qTwMtp7dufDJyc5DTgu7Q3SO/uY12NJUkjlOSBwE7AWf3xwcDhwEOr6mLgA8DPac06dhq69Hrgn2lh1suq6hSDrAWzZpYkSZI0AQy6V/XPDwSeCPwV+CLwtaqa08/NAHYBtgee1S//JrBdVc1e5hOXJN2hbxN8JbAXsAZwf2BL4Pyhn+NPBvalFXw/pKqO7z/bzwKO6gXiA96kWBDDLEmSJGnEhlutJzkBeAFwHvA04Fbgs7Q3PHPGXLcTsDXwzuEi8JKk0UpyCu2mw2XAJlV1TZLp4wRajwaOrKr/Gpw3yLp7hlmSJEnSiAyvxuqPHwD8N/DhqjqnF3U/gbZK6zRg//5GZ1pVzevX3Kuq/jaC6UuSxuidCFemrcxahdakYxawbQ+0VhrUyUryJOBgWqD1dOAqA6yFY5glSZIkLWODNu3982lVNS/JcbQ3NHOAl1fV1f386sARwIa0LYcH9EBrxaqaO6KXIEnqxt6YGD4OvIoWbM2ibQe/eswKrfWA1XpTDy0kC8BLkiRJy1C/a39Wkm8B9CDrXsBFwGNogdYafey0qroJ2AO4ANgGOLS/ETLIkqQR69vEB/UOt0+yf5KXJ1m/H/8M8BFgVeC03uVwTpI3JfkM8HuDrEVnmCVJkiQtWzOA7wCP6TVV6NsEPwO8BVgd2Kuv3prX7/jPpAVav6VtRbnvaKYuSRo2VO/wQNo28VcDxwCfSLJ5D7Q+DXwUWA34RZLPAR8Dzhis0tWicZuhJEmStIwluQ+wM7AP8L2q2r4fXxV4KfBfwHHAnlV122ALS5LVaNtR/jSquUuS7tS447HA8bSA6ixgU9oNiPsB76qq/+lbDl8AvBhYk1b0/evDz6OFZ5glSZIkjcBdBFqrAC/j74HWW6rq9gXVZJEkjU6S3YF7A08Gdq2q6/vxzYC3A2sD+1TVWUPXrFpVt9i18J5bcdQTkCRJkpZHVTUzyfH94T5JTq2q7atqdpKT+/EjgHsn2WXQ/UqSNDEkmUarZfgc4FLgjhsOVfWNJPNpNywO6k07zujnbukfDbHuIWtmSZIkSSPSa2EdDxwKbJzk1H58NnAy7a7+prStKpKkCaJvD5wHvJBWK2sDYLskMwZjqups4APArbTmHWsNVmNp8bjNUJIkSRqxu9lyOL13NJQkjchdbfVOsjLwOdoKrdcA/zO8mrZvObyxqi5YJpNdDhhmSZIkSRPAUKC1F/Crqtp0xFOSJPGPQVaSrYHH0joTfrWqzu/HZ9BW1D4b2AU40+3hS4/bDCVJkqQJYGjL4ceBhyZ58IinJEnLvb6dcBBkHQQcSdta+G/A/yZ5VR9zG615x7m0Bh7bJllpRNOe8lyZJUmSJE0gSVajbS28ftRzkSQ1Sd4EvBvYvapOSfIK4LO0ou9vraoj+rgZwFeAjYBHVtW1o5rzVGY3Q0mSJGkCqaqbRz0HSdLfJXkQrRnHYT3I2ooWZO0HrAF8NMltwLFVdVuSFwKPM8haelyZJUmSJEmS1A1qZPXtg9WbcWwN/ARYBTiHtt3wIOARwDeABwD7DFZoDT1XyuBlibNmliRJkiRJUjfUtXDD/ng2rUPhb4EtgN8An6yqOVX1a1rIdR3wsSQPH/NcBllLgWGWJEmSJEnSkCSbAd9P8g74hy3g9wPWAWb3cf8ErATsDqxbVZePYLrLHWtmSZIkSZIk/aPLgWOAtyeZW1Uf6sd/CcwD9k3yPWAD4InAFVV1Jbi1cFmwZpYkSZIkSVpuDWpkjXP8EcCewKuAA6vqg/34kcCWtDpZNwFvqqpTl+GUl3uGWZIkSZIkabmX5NnAb6vqqqFjCwq0NgSmATdU1a9cjbVsGWZJkiRJkqTlVpIVgI2B84DDgI9V1dVD59cDDga2A/aoqqNHMlHdwQLwkiRJkiRpuZFkWpK1ktwPWvfCqvoucBCwN7BHknUG46vqN8CRwC3AkUneOYp56+8sAC9JkiRJkpYLST4A/BvwFGBWkrOBr1fVl6rqPUnmA+9pQ3PU0JbDABcCPwd+Moq56+8MsyRJkiRJ0pTXg6sHAV8Dvg08GHgFsHmSp1fVW6vqfUmgBVorJTkW+CPwLOC3wH5VdZ01skbLmlmSJEmSJGlKS3I4sCnwEuCXVTWvH38UbXvhJsAXqmr3fvydtC2HtwB/BdYHXlJVXxnB9DWGYZYkSZIkSZqyktyXthrrzKo6eOj4tKqal+RBwCHA82gdC4/u57cEngqsDpxeVee6ImtiMMySJEmSJElTVpLHABfTVladOQix+rlUVSVZlxZ4/RnYoqpuGed5AmCYNXp2M5QkSZIkSVPZTcBcYD2AQZDVP68kK1TV74GDgWcCTxrvSapbBvPV3TDMkiRJkiRJU1JfTXUr8FNgu74Ca6xBQPWL/nGdfq1N8yYowyxJkiRJkjQl9cVUNwKfBZ4GvDjJvQfn+6qsQZh1X+A64KplP1MtClNGSZIkSZI0JQ1qYlXVJ5I8EXg/cFuSU6rq2qqa38etDGwJrAkcneQG4LwkB1bVnNG9Ao3HMEuSJEmSJE1JY2pc7QtMBw4HNkryReDrtBpZmwO7Ax8E1gDuD5xqkDUx2c1QkiRJkiRNeklWqqrbhx6vMFh5NXRsGvB2WnC1DvBXYA5te+F7q+rLfVws9j5xGWZJkiRJkqRJK8kzgAuranZ/vDPw7d6hcEHXPJoWZq0P/Ay4qqouTzJtuNuhJibDLEmSJEmSNCklWQv4EPDUqlo/yYHAG4HNqupH44x3xdUUYM0sSZIkSZI0Wd0AnAI8I8nVwH2ALYCLxhs8Nsgy3JqcVhj1BCRJkiRJkhZVD6LmVtVZwPeAtYG/ABdU1dwkd7uAxyBrcjLMkiRJkiRJk0ov7l798/sAPwLeAxTw4yQr90Br+ijnqaXDmlmSJEmSJGnSGO5SmORV/fCPgcuAFwBHALNpdbRm9w6G84HVqmrmKOasJcuVWZIkSZIkadIYCrIOBj4MPAmY349/HXgzsApwQZKVaUHW7sCJSVZJktHMXEuKBeAlSZIkSdKkkuQ1wG7AzsB3quqGQQ2tJF+jbTf8KPBH4DvAtsDLqmr2yCatJcYwS5IkSZIkTTZPA84Hzq6qm6EVc+9bEOcm+TpwLfAGWofDF1TVN+xeODVYM0uSJEmSJE1YYwOoJCsB3wf+UFXbLWDM/arq+v75qlV1y2B7oWHW5GfNLEmSJEmSNCENh1RJBhlGAZcAj0zyKPjHgCrJ04FXJVmjn7tlMMYga2owzJIkSZIkSRPSUJD1OuAjSWZU1RzgDOBxwGuTrDMYn2QVYDtgG2D6CKasZcCaWZIkSZIkacJKMh3YFNgAmJXkwKo6M8nbgMOAdZOcBswCng+8BnhpVf15ZJPWUmXNLEmSJEmSNGGMV6Q9yWrAx4CNgdOB/arqtiQ7AvsCDwJuBa4B9q2qL1vsfeoyzJIkSZIkSRPCmBpZ06pqXu9QOL8HWkfQOhl+CTigqv6W5MHAav0pbqyqqy32PrUZZkmSJEmSpJFKskZV3TD0eB/g34Cd+wqs4UDraOC5wKeAg6vqttHMWqNiAXhJkiRJkjQySY4Cfj4o5J5kGjATeBl/L/o+vwdaNwO7AX8FdgYOTjJjVHPXaBhmSZIkSZKkkejbAb8E3AycmWSdqpoHHE8Lq14DHD4UaKWqZgE/7E/xAuBhI5i6RsgwS5IkSZIkjUQ159BCq+nAV3ugdRvweeANwI60QGu1qqq+EquAPYHtq+qyEU1fI2LNLEmSJEmStMwN6mD1zzcCngAcCZwLvKIXcp9B2274CeBbwPeB+wO7Ak+rql+MYu4aLcMsSZIkSZI0Mkk+AGwD/BpYF9gAuAjYaqgz4SbAMcAqwG3AXlV1+oimrBEzzJIkSZIkSSORZEvgZNpKq/8BbgW2BQ4BbgK2qKqr+9jVgFWBFarqTz3kogw2ljvWzJIkSZIkSaPyMFqAdW5VzayqOcDpwOuAhwCnDLocVtXNVXVNVf2pPy6DrOWTYZYkSZIkSVqmBquqgL8Cc4F1Bud6oPW/tC6HGwNnJXngMp+kJizDLEmSJEmStFQl+Yf8YWhF1cW0rYM7JZkxtHXwduDntILvqwKPXIbT1QS34qgnIEmSJEmSpq4xXQv/GVgDuA64oap+neTNwLHAjcDRwNVJVgUeDfwAOKCqbh7N7DURGWZJkiRJkqSlIkmGgqz9gFcCDwWuB36VZJeq+u8kqwOHAZskubpf/kLgBQZZGstthpIkSZIkaakYbCdMshfwVuAo4D+AI2grtC5I8piq+hjwPOAK4EG0rYXbVdW3huprSQDEwv+SJEmSJGlp6LWyVgfOBC4A3ja0UutpwIeBtYFnVNWfksyoqtuS3LuqZg3V0DK80B1cmSVJkiRJkpaY4WLvVTW/qm4A/gmYU1Xzk0zvpy+ghVmrA8/px+b0j7f068sgS2MZZkmSJEmSpCVmaOXVJ5Oc2A9fBTy5n5+TZKUedJ1GC7CeNHytAZbuimGWJEmSJElabMMrspI8A9iE1o0Q4EDg6UkOA6iq2/u4tYFrgD8s29lqMrOboSRJkiRJWmxDK7I2p20bvBj4dD99AXAIsE+StYBDgdWAzYD1+nlpoVgAXpIkSZIk3SNJHgusCVwKzAbWBX4J3AScVVU7Do19ALAl8AFgOjAfuBV4S1WdumxnrsnMMEuSJEmSJC2yJJ8BnkELsK4CDquqI5JsDRxPK230oqo6Z8x1a/XrZgF/rKpf2rVQi8IwS5IkSZIkLZIk59FWZH0Q+DOwE/Ai4HVVdWySFwNHAecDh1TVT/p106pq3oimrSnCMEuSJEmSJC20JGcDD6bVu7pysJoqyRnA44F/qapZSXYAPkILtA4dCrTiCiwtDrsZSpIkSZKkhZJkK2AjWoj1h6qqJKv001+jFXV/EEBVfR7YC3g6sFeSDftxgywtFsMsSZIkSZK0sM4H3gX8S5IvAlTV7H7uIcAcWvF3+rmTgD2BrWidDO+zbKerqWjFUU9AkiRJkiRNDlV1Q5L/BkILp06tqu37iq13Aq+sqmuGC7pX1clJpgHXVNXMEU5fU4Q1syRJkiRJ0iLpK6x2pgVYVwJPoG0pPHx4G+HY+ljWy9KSYJglSZIkSZIWWQ+0XgPsBsytqvX7cTsWaqmyZpYkSZIkSVpkfcvg8cDHgfsO1dCal8SyRlpqXJklSZIkSZLusaEth/sA51XVy0Y8JU1xhlmSJEmSJGmx9EBrR+Bg4JtVtd1oZ6SpzGV/kiRJkiRpsVTVzCSfpuUMl456PpraXJklSZIkSZKWiEHxd7sWamkyzJIkSZIkSdKkYTdDSZIkSZIkTRqGWZIkSZIkSZo0DLMkSZIkSZI0aRhmSZIkSZIkadIwzJIkSZIkSdKkYZglSZKWuST7Jakkzx71XMZKckKf28MW4Zpn92v2W2oTkyRJEmCYJUmSlqAk+/ZQp5I8etTzWVKSPKy/phNGPZdFlWTHoX+TDy5gzCCM+9yynp8kSdKiMsySJElLRJIAuwDVD712hNNZHO8E1geuGvVEloI3JVl31JOQJElaHIZZkiRpSdkUeBjwaeAa4NVJVhrpjO6Bqrq6qn5dVXNGPZcl7P+AGcDBo56IJEnS4jDMkiRJS8pgJdangBOBNYFtF/VJkrwiyUVJbk3y5ySfTfLAJOcmqXHGr5Dk9Ul+nGRWklv6529Icqffdfp2unOT/FOSY5NclWRekh37+X+omdXrYF3eL3/10Ja9Glwz5vkfn+SsJDcmmZ3kvCQbjTPujrphSXZIcmEf/6ckH0kyo497Tp/vzCQ39K/H/Rf16wqcAlwM7JDkyQtzQf+6vzfJ95Jck+T2Pr+Tkjx2nPF3bMdM8ogkpyb5a5Kbk3wzyeP6uLWSfDLJ1Un+1v+9NlnAHFZMsluSH/avwewkFyfZfbx/X0mSNPWtOOoJSJKkyS/J2sALgd9U1feTzAT2AnYFvrAIz/N24FDgBtoKr5uA5wHf65+P57PAy4ErgWNp2xy3BT4OPB14xTjX3A/4ITAL+BIwH7h2Ac9/LnBf4M3ApcCXh85dMmbsk4G3Az/oc3ko8CLg20keX1WXjfP8ewDP7897Lm2F257A/ZKcAZwMnAV8EtgIeCUtKHz+Aua7IAXsDXwb+BDw7IW45pnAO4DvAKfRvl6PArYHXphk46q6dJzrHgZcAPwKOKE/3hY4N8nTgK8DM2nfG/cDXgZ8Lcl6VfWHwZMkmQ6cCWwGXAacBPwN2AQ4EtgQ+M+Fe/mSJGmqMMySJElLwk7AdFpwQVX9PMmFwCZJHllV/3d3T5Dkn4GDgOuAJ1bVlf34O2ghxsvGuWYHWpB1MfDMqprVj78bOA94eZKzquqkMZf+Ky0E27mq5t7VvKrq3CRX0MKsS6pqv7sYvgWwU1WdMDTH1wGf6NfvNs41zwWeVFW/6uNnABfRQpqtgE2r6rx+bgXgG8DmPRwbG6bdpao6J8lZwBZJXlhVX7mbS84B1q6qm4cPJtmAFjB+gPFDtWcB766qg4aueQ9wAC3kOgXYrarm93NnA5+hhXh7Dj3PvrQg6yjgLVU1r4+fRgv3dk5yalWdsVBfAEmSNCW4NFuSJC2WocLv82mBxMAJQFj4QvAvp91oO3IQZAFUVdFWB80b55qd+8d3DIKsfs0twD794S7jXHc7sPfdBVn3wPeGg6zueGAu8NQFXHPEIMgCqKrbaCuWVgDOGgRZ/dx8YNBxcIN7OMe3076Whya5yxubVfXnsUFWP34pLejapK+eGusKWtA17NP94wzgbYMgqzuJ9jV6/OBAD+72oNVf23MQZPW/fx5t5V8x/so7SZI0hbkyS5IkLa7nAI8AvlFVwx0ATwI+DOyY5N0LUVD9Cf3j+WNPVNXvk1xJ26427Im0EO3ccZ7vPFpo84Rxzl1RVX++m/ncEz8Ze6Cq5iS5FlhjYa8B/tQ/XjjOucHX+MGLPj2oql8mOY62BXRX2nbMBUqyBfB62hbKNbnz749rAlePOXbJcPjUDV7Tb8YGZFU1r3+Nhl/TerQtiL8F3t0y0zu5ldZ5UpIkLUcMsyRJ0uLatX88YfhgVV2f5ExazaitgVPv5nlW7x8XVLvqWu4cZq0OXF9Vt48dXFVzk1wHPGCc57rmbuZyT924gONzgWkLODdeLbC5C3FuvBVRC+u9tJVw70vy2QUNSvJm4GO0GmZnA38AZtNWRG1DWx02Y5xL7zTv/u8x7rluLv/4mgZF7h8FvO8uXsu97+KcJEmaggyzJEnSPZZkLVqoAfD5JJ9fwNBdufswa2b/uDbwi3HOrz3OsZtohdKnj1351bfQrTn0vMPu1BVxeVJV1yY5DNiftoXz7LFj+tdvP1rw98SqunrM+act5WkOQq/Tq2q7pfx3SZKkScQwS5IkLY5XAyvRtsMtqBj5C4HnJnl4VV1+F891Ma3j3dNp9ZjukGRd4CELuOY/aF33vj3m3DNpq6EuupvXsDAGW+YWtLpqMvoQ8DpawfVfjXN+TVoXxy+NE2Tdm7bFc2n6NW2l27+PF1ZKkqTllwXgJUnS4hgUd9+tqnYZ7w9wDK0Q/HiF2IcNioDvkeSO4KoXmD+E8YOk4/vHQ5KsMnTNKvy9APlxi/yq7uwG2mquhy6B55oQqmo28B5gZcbfxvdn2pbCJ/XwCoBe8P1wWti1NOc3FzgSWAc4IsnKY8ckWSfJY5fmPCRJ0sTjyixJknSPJHk2rUj3z6rqR3cx9DhgX2CnJO9bUAfBqvpdkvcCBwOXJvkCbavZ82iFwC8F/m3MNScl2Rp4CfCLJF/m7/WcHg58oapOXIyXOfh7ZiW5AHhGkhOB39BWa32lqn66uM8/QicAbwH+deyJqpqf5AjaNsSfJTmDtgpvE9q/x3f650vT+2l1uV4PbJXkHFoB/AfQamltTPve+uVSnockSZpAXJklSZLuqcGqrGPvalBVXQF8i7bCZqu7GXsI8Crg98BOwGtoW+A2pt2EG6/+1Q7AG4G/0rbNvZ62kmp3WpHzJeU/gbOAzWkrmd7P0t9qt1RV1XzgbXcx5D3AXrSuga8DtqN1X3wqrRj80p7fHFow+SrgMmDLPp/Nab/HvgdY7LBSkiRNLqlaruufSpKkSSDJfWjdDC+pqqVdeFySJEkTmCuzJEnShJFkrV6TafjYisCHgXsBp49kYpIkSZowXJklSZImjCSvBw6gbUu8klab6Zm02lyXABtV1a2jm6EkSZJGzQLwkiRpIrkAOJ8WYN2/H7scOAg41CBLkiRJrsySJEmSJEnSpGHNLEmSJEmSJE0ahlmSJEmSJEmaNAyzJEmSJEmSNGkYZkmSJEmSJGnSMMySJEmSJEnSpGGYJUmSJEmSpEnj/wNHhBpr/ilvewAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 1440x720 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.figure(figsize=(20,10))\n",
    "\n",
    "ax = sns.lineplot(data = results_df, x='name',y='recall@100', marker='o')\n",
    "plt.title('Recall at 100 retreival items compared to ground truth', fontsize=20)\n",
    "plt.xlabel('Algorithm Name', fontsize=20)\n",
    "plt.ylabel('Recall', fontsize=20)\n",
    "plt.xticks(results_df.name, fontsize=15, rotation=45)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "e127987e-44f9-43b3-9219-1036edd0d14c",
   "metadata": {
    "id": "e127987e-44f9-43b3-9219-1036edd0d14c"
   },
   "source": [
    "# Part B: User representations"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "13c18e33-3a62-4afe-95af-9d33ef87917c",
   "metadata": {
    "id": "13c18e33-3a62-4afe-95af-9d33ef87917c"
   },
   "source": [
    "In the second part of this week's project, we wish to understand few ways of estimating user representations, and how it impacts the performance of downstream tasks.\n",
    "\n",
    "To this end, we will work on top of our H&M dataset, and develop a few different ways of representing users.\n",
    "\n",
    "The broader framework here will be -- we fix the article representations, and fix the downstream task, and then vary the user representations and see how the performance of the downstream task changes based on different user representation techniques.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "251abdd1-1cd4-41f9-af70-23d22a1aa455",
   "metadata": {
    "id": "251abdd1-1cd4-41f9-af70-23d22a1aa455"
   },
   "outputs": [],
   "source": [
    "import numpy as np # linear algebra\n",
    "import pandas as pd # data processing, CSV file I/O (e.g. pd.read_csv)\n",
    "import random\n",
    "import gc\n",
    "from sklearn.model_selection import train_test_split\n",
    "from sklearn.model_selection import StratifiedKFold\n",
    "from sklearn.model_selection import GroupShuffleSplit\n",
    "from sklearn.model_selection import GroupKFold\n",
    "from sklearn.preprocessing import LabelEncoder\n",
    "\n",
    "from sklearn.feature_extraction.text import TfidfVectorizer\n",
    "from sklearn.decomposition import TruncatedSVD\n",
    "import lightgbm as lgb\n",
    "import datetime\n",
    "import itertools\n",
    "import os\n",
    "from contextlib import redirect_stdout\n",
    "from tqdm.notebook import tqdm"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "219f3784-220e-4889-ae88-09c80f556479",
   "metadata": {
    "id": "219f3784-220e-4889-ae88-09c80f556479"
   },
   "source": [
    "While we have used neural models so far, lets try a tree based model for this task. We use LightGBM library to train the main model. Lets set up few parameters for the lightgbm model, and specify some additional parameters:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "21e76b18-8d9e-4a1b-bf84-a929c8f16c6f",
   "metadata": {
    "id": "21e76b18-8d9e-4a1b-bf84-a929c8f16c6f"
   },
   "outputs": [],
   "source": [
    "rand = 64\n",
    "lgb_params = {\n",
    "    \"objective\": \"binary\",\n",
    "    \"boosting\": \"gbdt\",\n",
    "    \"max_depth\": -1,\n",
    "    \"num_leaves\": 40,\n",
    "    \"subsample\": 0.8,\n",
    "    \"subsample_freq\": 1,\n",
    "    \"bagging_seed\": rand,\n",
    "    \"learning_rate\": 0.05,\n",
    "    \"feature_fraction\": 0.6,\n",
    "    \"min_data_in_leaf\": 100,\n",
    "    \"lambda_l1\": 0,\n",
    "    \"lambda_l2\": 0,\n",
    "    \"random_state\": rand,\n",
    "    \"metric\": \"auc\",#\"binary_logloss\",\n",
    "    \"verbose\": -1\n",
    "}\n",
    "\n",
    "tran_dtypes = {\"t_dat\":\"str\",\n",
    "               \"customer_id\":\"str\",\n",
    "               \"article_id\":\"int\",\n",
    "               \"product_code\":\"int\",\n",
    "               \"price\":\"float\",\n",
    "               \"sales_channel_id\":\"int\"}\n",
    "art_dtypes = {\"article_id\":\"int\",\n",
    "              \"product_code\":\"int\",\n",
    "              \"product_type_no\":\"int\",\n",
    "              \"graphical_appearance_no\":\"int\",\n",
    "              \"colour_group_code\":\"int\",\n",
    "              \"department_no\":\"int\",\n",
    "              \"index_code\":\"str\",\n",
    "              \"index_group_no\":\"int\",\n",
    "              \"section_no\":\"int\",\n",
    "              \"garment_group_no\":\"int\"}\n",
    "cust_dtypes = {\"customer_id\":\"str\"}\n",
    "\n",
    "obj = \"class\" # \"class\" or \"rank\"\n",
    "N = 15000\n",
    "n_iter = 2 # num of iteration\n",
    "idx_file = \"exp1\"\n",
    "n_round = 2000\n",
    "n_splits = 1\n",
    "nobuy = 20 # num of negative samples"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "3df9c2e0-af9e-406d-a9c6-c38a87347728",
   "metadata": {
    "id": "3df9c2e0-af9e-406d-a9c6-c38a87347728"
   },
   "source": [
    "While we vary the user represnetations, we will keep the article representation fixed. The code below reads the article.csv file and extracts a number of features to represent articles."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "id": "IGmrdyRYAD3u",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "IGmrdyRYAD3u",
    "outputId": "d46e6094-00e0-4726-ea25-3b156a9a3982"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Drive already mounted at /content/drive/; to attempt to forcibly remount, call drive.mount(\"/content/drive/\", force_remount=True).\n",
      "Archive:  /content/drive/MyDrive/hm/hmdata.zip\n",
      "replace hmdata/customers.csv.zip? [y]es, [n]o, [A]ll, [N]one, [r]ename: y\n",
      "  inflating: hmdata/customers.csv.zip  \n",
      "replace __MACOSX/hmdata/._customers.csv.zip? [y]es, [n]o, [A]ll, [N]one, [r]ename: A\n",
      "  inflating: __MACOSX/hmdata/._customers.csv.zip  \n",
      "  inflating: hmdata/articles.csv.zip  \n",
      "  inflating: __MACOSX/hmdata/._articles.csv.zip  \n",
      "  inflating: hmdata/transactions_train.csv.zip  \n",
      "\n",
      "\n",
      "  inflating: __MACOSX/hmdata/._transactions_train.csv.zip  \n",
      "  inflating: hmdata/sample_submission.csv.zip  \n",
      "  inflating: __MACOSX/hmdata/._sample_submission.csv.zip  \n"
     ]
    }
   ],
   "source": [
    "from google.colab import drive\n",
    "drive.mount('/content/drive/')\n",
    "!unzip /content/drive/MyDrive/hm/hmdata.zip"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "Y3qxVV43AVza",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "Y3qxVV43AVza",
    "outputId": "32ab926d-d3fc-48f3-a72b-904948134d93"
   },
   "outputs": [],
   "source": [
    "ls hmdata"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "id": "QZUG8oeTDT49",
   "metadata": {
    "id": "QZUG8oeTDT49"
   },
   "outputs": [],
   "source": [
    "def construct_article_representation(path=\"hmdata/articles.csv.zip\"):\n",
    "\n",
    "    df = pd.read_csv(\"hmdata/articles.csv.zip\")\n",
    "\n",
    "    ## Find categorical columns\n",
    "    ohe_columns = []\n",
    "    total = 0\n",
    "\n",
    "    for col in df.columns:\n",
    "        if df[col].dtype == \"int64\" and len(df[col].unique()) <= 500:\n",
    "            ohe_columns.append(col)\n",
    "            total += len(df[col].unique())\n",
    "            \n",
    "    ## Do one hot encoding of the above categorical variables\n",
    "    V = pd.get_dummies(df[ohe_columns], columns=ohe_columns).values\n",
    "\n",
    "\n",
    "    ## Get article features\n",
    "    tfidf = TfidfVectorizer(min_df=3)\n",
    "    V_desc = tfidf.fit_transform(df[\"detail_desc\"].fillna(\"nodesc\"))\n",
    "\n",
    "    ## Represent articles as vector of size 512\n",
    "    EMB_SIZE = 512\n",
    "    V = np.hstack([V.astype(\"float32\"), V_desc.todense()])\n",
    "    svd = TruncatedSVD(n_components=EMB_SIZE, random_state=0)\n",
    "    svd.fit(V)\n",
    "    V = svd.transform(V)\n",
    "\n",
    "    np.save(\"articles.npy\", V)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "id": "3kpWPfWGb_c0",
   "metadata": {
    "id": "3kpWPfWGb_c0"
   },
   "outputs": [],
   "source": [
    "path=\"hmdata/\"\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "id": "fb93a7cd-a637-4960-9577-08449a57b55d",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "id": "fb93a7cd-a637-4960-9577-08449a57b55d",
    "outputId": "d8592730-d8cc-4c86-c11d-ad4f820e1da9"
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/Users/omar.mohamed.2/miniforge3/envs/py38/lib/python3.8/site-packages/sklearn/utils/validation.py:727: FutureWarning: np.matrix usage is deprecated in 1.0 and will raise a TypeError in 1.2. Please convert to a numpy array with np.asarray. For more information see: https://numpy.org/doc/stable/reference/generated/numpy.matrix.html\n",
      "  warnings.warn(\n",
      "/Users/omar.mohamed.2/miniforge3/envs/py38/lib/python3.8/site-packages/sklearn/utils/validation.py:727: FutureWarning: np.matrix usage is deprecated in 1.0 and will raise a TypeError in 1.2. Please convert to a numpy array with np.asarray. For more information see: https://numpy.org/doc/stable/reference/generated/numpy.matrix.html\n",
      "  warnings.warn(\n"
     ]
    }
   ],
   "source": [
    "df = pd.read_csv(\"hmdata/articles.csv.zip\")\n",
    "\n",
    "## Find categorical columns\n",
    "ohe_columns = []\n",
    "total = 0\n",
    "\n",
    "for col in df.columns:\n",
    "    if df[col].dtype == \"int64\" and len(df[col].unique()) <= 500:\n",
    "        ohe_columns.append(col)\n",
    "        total += len(df[col].unique())\n",
    "        \n",
    "## Do one hot encoding of the above categorical variables\n",
    "V = pd.get_dummies(df[ohe_columns], columns=ohe_columns).values\n",
    "\n",
    "\n",
    "## Get article features\n",
    "tfidf = TfidfVectorizer(min_df=3)\n",
    "V_desc = tfidf.fit_transform(df[\"detail_desc\"].fillna(\"nodesc\"))\n",
    "\n",
    "## Represent articles as vector of size 512\n",
    "EMB_SIZE = 512\n",
    "V = np.hstack([V.astype(\"float32\"), V_desc.todense()])\n",
    "svd = TruncatedSVD(n_components=EMB_SIZE, random_state=0)\n",
    "svd.fit(V)\n",
    "V = svd.transform(V)\n",
    "\n",
    "np.save(\"articles.npy\", V)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "id": "64a3715e-de70-49d4-b057-e0b674ca65ff",
   "metadata": {
    "id": "64a3715e-de70-49d4-b057-e0b674ca65ff"
   },
   "outputs": [],
   "source": [
    "def item_representation_1():\n",
    "    df_art = pd.read_csv(path+\"articles.csv.zip\",dtype=art_dtypes)\n",
    "    le = LabelEncoder()\n",
    "    le.fit(df_art[\"index_code\"].unique())\n",
    "    df_art[\"index_code\"] = le.transform(df_art[\"index_code\"])\n",
    "    \n",
    "    dict_vec = {}\n",
    "    vec_art = np.load(\"articles.npy\")\n",
    "    df_vec = pd.concat([df_art[\"article_id\"],pd.DataFrame(vec_art)],axis=1)\n",
    "    for i in range(len(vec_art)):\n",
    "        dict_vec[df_art[\"article_id\"][i]] = vec_art[i]\n",
    "    del vec_art,df_vec\n",
    "    \n",
    "    return df_art, dict_vec\n",
    "    "
   ]
  },
  {
   "cell_type": "markdown",
   "id": "7cbe5f64-354c-451e-a9e0-eb114440f8f0",
   "metadata": {
    "id": "7cbe5f64-354c-451e-a9e0-eb114440f8f0"
   },
   "source": [
    "Taken together, the two cells above give us all the features we want to represent articles."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "f0c3082e-1da7-466f-8b9f-c777c8ef63cd",
   "metadata": {
    "id": "f0c3082e-1da7-466f-8b9f-c777c8ef63cd"
   },
   "source": [
    "Now lets define some functions to extract user representations. The different functions will contain different ways of representing users.\n",
    "\n",
    "We bootstrap by providing a simple set of features to represent users in user_representation_1(). This function returns the dataframe of user features."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "id": "5de63a95-ef6c-4796-8e59-0cb33b9b948e",
   "metadata": {
    "id": "5de63a95-ef6c-4796-8e59-0cb33b9b948e"
   },
   "outputs": [],
   "source": [
    "def user_representation_1():\n",
    "    df_cust = pd.read_csv(path+\"customers.csv.zip\",dtype=cust_dtypes)\n",
    "    df_cust[\"age\"] = df_cust[\"age\"].fillna(df_cust[\"age\"].mean())\n",
    "    df_cust[[\"FN\",\"Active\"]] = df_cust[[\"FN\",\"Active\"]].fillna(0)\n",
    "    df_cust[\"club_member_status\"] = df_cust[\"club_member_status\"].apply(lambda x:1 if x == \"ACTIVE\" else 0)\n",
    "    df_cust[\"fashion_news_frequency\"] = df_cust[\"fashion_news_frequency\"].apply(lambda x:0 if x == \"NONE\" else 1)\n",
    "    df_cust = df_cust.drop([\"postal_code\"], axis=1)\n",
    "    return df_cust"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "bf20f25a",
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "id": "65dbcef5-701a-4999-b696-3d871ccb485d",
   "metadata": {
    "id": "65dbcef5-701a-4999-b696-3d871ccb485d"
   },
   "outputs": [],
   "source": [
    "recent_items_per_user = 200\n",
    "\n",
    "def user_representation_2():\n",
    "    \"\"\"\n",
    "    TODO -- compute user representations as the average\n",
    "    of the embeddings of the recently purchased articles\n",
    "    return user representation\n",
    "\n",
    "    Hint: You may find pd.DataFrame(item_representation_1()[1]).transpose() useful\n",
    "    \"\"\"\n",
    "    \n",
    "    df_art, dict_vec = item_representation_1()\n",
    "    trans_df = pd.read_csv(path+'transactions_train.csv.zip')\n",
    "    trans_df = trans_df[(trans_df.t_dat < '2019-09-23') & (trans_df.t_dat > '2019-09-16')]\n",
    "    trans_df = trans_df.sort_values('t_dat').reset_index(drop=True)\n",
    "\n",
    "    article_to_embed = pd.DataFrame(dict_vec).transpose()\n",
    "    ## to show progress with apply\n",
    "    tqdm.pandas()\n",
    "    customer_to_articles = trans_df.groupby('customer_id').article_id.progress_apply(lambda k: k.values[:recent_items_per_user])\n",
    "\n",
    "    customer_to_embed = {}\n",
    "    for customer in tqdm(customer_to_articles.index):\n",
    "\n",
    "        customer_articles = customer_to_articles[customer]\n",
    "        avg_embeddings = article_to_embed.loc[customer_articles].mean(axis=0).values\n",
    "        customer_to_embed[customer] = avg_embeddings\n",
    "    customer_embeddings = np.array([v for k,v in tqdm(customer_to_embed.items())])\n",
    "    customer_ids = np.array([k for k in customer_to_embed])\n",
    "    cust_embed_df = pd.DataFrame(customer_embeddings)\n",
    "    cust_embed_df.columns = [f'embed_{i}' for i in range(512)]\n",
    "    cust_embed_df['customer_id'] = customer_ids\n",
    "    cust_embed_df = cust_embed_df[['customer_id'] + [f'embed_{i}' for i in range(512)]]\n",
    "    \n",
    "    return cust_embed_df\n",
    "\n",
    "def user_representation_3():\n",
    "    \"\"\"\n",
    "    OPTIONAL -- compute user representations as the output\n",
    "    of the doc2vec model.\n",
    "    https://cs.stanford.edu/~quocle/paragraph_vector.pdf\n",
    "    Doc2vec model is an embedding learning method\n",
    "    that enables us to learn representations of a document.\n",
    "    We treat each user as a document, and the set of articles\n",
    "    the user has purchased as the set of words in the document.\n",
    "    \"\"\"\n",
    "    return None"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "d39b7430-bf43-4f16-b7a8-a6edbd078e1d",
   "metadata": {
    "id": "d39b7430-bf43-4f16-b7a8-a6edbd078e1d"
   },
   "source": [
    "As part of the goal for part B of this week's project, please use the above two functions to implement the two user representation techniques mentioned in the project jumpstart.\n",
    "\n",
    "You can run the rest of the notebook for now, and come back to these functions, implement them and re-run some of the code below and use user_representation_2() (and optionally user_representation_3()) to get the appropriate user features to use to train the model for the downstream task.\n",
    "\n",
    "Lets write a function that would read the transactions data and return the dataframes for the transactions within the dates we want to consider, along with the dataframes for articles features: df_art and dict_vec."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "id": "55c3e4dd-ce84-4199-9215-06490305db3c",
   "metadata": {
    "id": "55c3e4dd-ce84-4199-9215-06490305db3c"
   },
   "outputs": [],
   "source": [
    "path = \"hmdata/\"\n",
    "def read_data(day_oldest):\n",
    "    df_trans = pd.read_csv(path+\"transactions_train.csv.zip\",dtype=tran_dtypes)\n",
    "    df_trans[\"t_dat\"] = pd.to_datetime(df_trans[\"t_dat\"],format=\"%Y-%m-%d\")\n",
    "\n",
    "    df_trans = df_trans.query(f\"t_dat >= '{day_oldest}'\").copy()\n",
    "    df_trans = df_trans.drop_duplicates([\"customer_id\",\"article_id\",\"t_dat\"])\n",
    "    df_art,dict_vec = item_representation_1()\n",
    "    df_trans = df_trans.merge(df_art[[\"article_id\",\"product_code\",\"product_type_no\",\"graphical_appearance_no\",\"colour_group_code\",\"department_no\",\"index_code\",\"index_group_no\",\"section_no\",\"garment_group_no\"]],how=\"left\",on=\"article_id\")\n",
    "\n",
    "    return df_trans, df_art, dict_vec"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "4128aa41-0a7c-405c-a2c2-02a3e19678f2",
   "metadata": {
    "id": "4128aa41-0a7c-405c-a2c2-02a3e19678f2"
   },
   "source": [
    "Now we have all the ingredients we need -- we have a basic version of user representations and we have the article representations, and transactions data on which we can train our downstream task.\n",
    "\n",
    "The downstream task we consider is the task of predicting whether or not a user will purchase an article. This is the same task that we have been dealing with in the past 2 weeks.\n",
    "\n",
    "Lets define a train() function that will consider the start and end dates and split data based on these, generate the training data, do random negative sampling and train the model."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "id": "5e0c7a4f-8e4d-42f7-b379-1ebc870375d9",
   "metadata": {
    "id": "5e0c7a4f-8e4d-42f7-b379-1ebc870375d9"
   },
   "outputs": [],
   "source": [
    "def train(user_representation_fn):\n",
    "    #### Transaction start date say it is from 2019/9/23 and say we take 1 week data\n",
    "    day_start = datetime.datetime(2019,9,23) - datetime.timedelta(days=6)\n",
    "    #### Transaction end date\n",
    "    day_end = datetime.datetime(2019,9,23) - datetime.timedelta(days=0)\n",
    "    \n",
    "    ######## Splitting data based on date ###########################\n",
    "    ####### Train date ###########################################\n",
    "    ## Let's consider the training data for 1 year\n",
    "    day_start_hist = day_start - datetime.timedelta(days=366)\n",
    "    day_end_hist = day_start - datetime.timedelta(days=1)\n",
    "    \n",
    "    df_trans, df_art, dict_vec = read_data(day_oldest = datetime.datetime(2018,9,23))\n",
    "\n",
    "    df_cust = user_representation_fn()\n",
    "\n",
    "    query_date = f\"((t_dat >= '{day_start}') and (t_dat <= '{day_end}'))\"\n",
    "    top_art_all = df_trans.query(query_date ).groupby(\"article_id\")[\"t_dat\"].count().sort_values(ascending = False).index[:N].tolist()\n",
    "\n",
    "    \n",
    "    \n",
    "    \n",
    "    ############### Create training data #################################################################################\n",
    "    \n",
    "    \n",
    "    list_df_buy = []\n",
    "    list_cust =[]\n",
    "    \n",
    "    # make positive samples\n",
    "    list_df_buy = df_trans.query(f\"(t_dat >= '{day_start}') and (t_dat <= '{day_end}') and (article_id in @top_art_all)\").drop_duplicates([\"customer_id\",\"article_id\"])[[\"customer_id\",\"article_id\"]].copy()\n",
    "    list_df_buy[\"target\"] = 1\n",
    "    list_cust = list_df_buy[\"customer_id\"].unique().tolist()\n",
    "        \n",
    "        \n",
    "    # make negative samples (random selection)\n",
    "    \n",
    "    list_df_nobuy = pd.concat([pd.DataFrame({\"customer_id\":x,\"article_id\":random.sample(top_art_all,nobuy)}) for x in list_cust])\n",
    "    list_df_nobuy[\"target\"] = 0\n",
    "    list_train = pd.concat([list_df_buy,list_df_nobuy]).drop_duplicates([\"customer_id\",\"article_id\"])\n",
    "    del list_df_nobuy\n",
    "\n",
    "    # add feature\n",
    "    df_train = pd.DataFrame()\n",
    "    \n",
    "    ########## Merging item features with the transactions data ###################################################\n",
    "    list_train = list_train.merge(df_art[[\"article_id\",\"product_code\",\"product_type_no\",\"graphical_appearance_no\",\"colour_group_code\",\"department_no\",\"index_code\",\"index_group_no\",\"section_no\",\"garment_group_no\"]],how=\"left\",on=\"article_id\")\n",
    "    \n",
    "    ######### Merging customer data with the above data ######################################\n",
    "    list_train = list_train.merge(df_cust, how=\"left\", on=\"customer_id\")\n",
    "    df_train = df_train.append(list_train)\n",
    "    del list_train\n",
    "    gc.collect()\n",
    "    \n",
    "    \n",
    "    # now that we have all the data in place, lets train the lgbm model\n",
    "\n",
    "    # train lgbm\n",
    "    X_train = df_train.drop([\"customer_id\",\"product_code\",\"product_type_no\",\"department_no\",\"target\"],axis=1)\n",
    "    y_train = df_train[\"target\"]\n",
    "    del df_train\n",
    "    \n",
    "    X_tr, X_va, y_tr, y_va = train_test_split(X_train,y_train,stratify = y_train)\n",
    "    d_tr = lgb.Dataset(X_tr, label=y_tr,  free_raw_data=False)\n",
    "    d_va = lgb.Dataset(X_va, label=y_va,  free_raw_data=False)\n",
    "    lgbm_model = lgb.train(lgb_params, train_set=d_tr, num_boost_round=n_round, valid_sets=[d_tr,d_va], verbose_eval=500, early_stopping_rounds=100)\n",
    "    \n",
    "    # save model\n",
    "    pd.to_pickle(lgbm_model,\"lgbm_model.pkl\")\n",
    "    del X_train, y_train, X_tr, X_va, y_tr, y_va, d_tr, d_va\n",
    "    gc.collect()\n",
    "    del df_trans, df_art, df_cust\n",
    "    gc.collect()\n",
    "    return lgbm_model"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "id": "afb1b72d-7f50-4dc8-a44c-95dcf9c537d2",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 318
    },
    "id": "afb1b72d-7f50-4dc8-a44c-95dcf9c537d2",
    "outputId": "59168fff-3ffd-4e93-dd67-8aa967b677a8"
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/var/folders/md/3y3mq4_d7_z2mk6_2zh4lgxc0000gq/T/ipykernel_69229/2779737634.py:50: FutureWarning: The frame.append method is deprecated and will be removed from pandas in a future version. Use pandas.concat instead.\n",
      "  df_train = df_train.append(list_train)\n",
      "/Users/omar.mohamed.2/miniforge3/envs/py38/lib/python3.8/site-packages/lightgbm/engine.py:181: UserWarning: 'early_stopping_rounds' argument is deprecated and will be removed in a future release of LightGBM. Pass 'early_stopping()' callback via 'callbacks' argument instead.\n",
      "  _log_warning(\"'early_stopping_rounds' argument is deprecated and will be removed in a future release of LightGBM. \"\n",
      "/Users/omar.mohamed.2/miniforge3/envs/py38/lib/python3.8/site-packages/lightgbm/engine.py:239: UserWarning: 'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.\n",
      "  _log_warning(\"'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. \"\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Training until validation scores don't improve for 100 rounds\n",
      "[500]\ttraining's auc: 0.810131\tvalid_1's auc: 0.80496\n",
      "[1000]\ttraining's auc: 0.824526\tvalid_1's auc: 0.815477\n",
      "[1500]\ttraining's auc: 0.833428\tvalid_1's auc: 0.821069\n",
      "[2000]\ttraining's auc: 0.839758\tvalid_1's auc: 0.824454\n",
      "Did not meet early stopping. Best iteration is:\n",
      "[2000]\ttraining's auc: 0.839758\tvalid_1's auc: 0.824454\n"
     ]
    }
   ],
   "source": [
    "manual_feats_model = train(user_representation_fn = user_representation_1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "id": "nCAumCf2I8nH",
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 113,
     "referenced_widgets": [
      "75402bb748c94bb28c46f0300fd62c06",
      "72efc0e1a2424b319956188ba771228a",
      "88f2237695f7488183ab3ec9d519940d",
      "5efb645f5a744074b3b9c5556ca9ce1d",
      "f23e2d8072ca4d0c99a6a331f8803277",
      "1ffcdb087bce47e0835bd0e81aad9d1c",
      "c4eb31d66dbe40c0915320365a858406",
      "aef28352b3614bafa87d7f0e5832d6f3",
      "962df1c3f61a4bbf8b20379c620edb17",
      "79aeaf2a0d2440f2adcd71d15958d1e0",
      "e07098df7efe4b8595656eec08d29101",
      "9c35e0839cc7416bafd0ed68411d0812",
      "b3bc7ddeee0347678f9cefe54e645cfb",
      "034fea7267f740a1806f824177b2a194",
      "abbb81ffe11b43bbac4a9f052a728504",
      "f93ec2b19fb441a7b896fe190f33181a",
      "529c3f03c0a245dca7a8089b8b19786c",
      "dda9b4e97afe44ce872fbc3a5c4b04b5",
      "c9f535c00ab047b1bd542b741553654d",
      "ecb424cb3302481f8a39e261013481de",
      "5d252e76c6494d4a990237b246739515",
      "1f8bcd0170b34bc4a78e7ed22bb51538",
      "4a975783fa1641bca4b8ba8df7fbf901",
      "48e3addf97e54b469517f72704487b1e",
      "1ae87ed5984b4a1babdc0fd611d1642a",
      "c070568483b041f292a4cf98729e5e9c",
      "81dc7c6c42d04748b11527f667e73d36",
      "0bfc933b38c8451aadf8fa25a8f722f1",
      "eecd81d8153142d6b979fff3f84308be",
      "204bba63d10d40e5b6625f9e42450353",
      "525fb797babb4546bb2183f1c8258584",
      "2deb287f8a864fd78a53a6dd6bce2e2e",
      "08014c03513d40c48ee99b5e09e5bc15"
     ]
    },
    "id": "nCAumCf2I8nH",
    "outputId": "f88f5030-5027-4cb4-f30c-b8aaaa5ed0de"
   },
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "ad47e57211194bc7925a08a9c7207cc3",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "  0%|          | 0/57021 [00:00<?, ?it/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "4f5bc22eebf448d9bd4bb916239b51dc",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "  0%|          | 0/57021 [00:00<?, ?it/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "cf7c62d430cd48f89c3be6c1a57f1a2c",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "  0%|          | 0/57021 [00:00<?, ?it/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/var/folders/md/3y3mq4_d7_z2mk6_2zh4lgxc0000gq/T/ipykernel_69229/2779737634.py:50: FutureWarning: The frame.append method is deprecated and will be removed from pandas in a future version. Use pandas.concat instead.\n",
      "  df_train = df_train.append(list_train)\n",
      "/Users/omar.mohamed.2/miniforge3/envs/py38/lib/python3.8/site-packages/lightgbm/engine.py:181: UserWarning: 'early_stopping_rounds' argument is deprecated and will be removed in a future release of LightGBM. Pass 'early_stopping()' callback via 'callbacks' argument instead.\n",
      "  _log_warning(\"'early_stopping_rounds' argument is deprecated and will be removed in a future release of LightGBM. \"\n",
      "/Users/omar.mohamed.2/miniforge3/envs/py38/lib/python3.8/site-packages/lightgbm/engine.py:239: UserWarning: 'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. Pass 'log_evaluation()' callback via 'callbacks' argument instead.\n",
      "  _log_warning(\"'verbose_eval' argument is deprecated and will be removed in a future release of LightGBM. \"\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Training until validation scores don't improve for 100 rounds\n",
      "[500]\ttraining's auc: 0.967163\tvalid_1's auc: 0.964\n",
      "[1000]\ttraining's auc: 0.976427\tvalid_1's auc: 0.971393\n",
      "[1500]\ttraining's auc: 0.981142\tvalid_1's auc: 0.974275\n",
      "[2000]\ttraining's auc: 0.984348\tvalid_1's auc: 0.976012\n",
      "Did not meet early stopping. Best iteration is:\n",
      "[2000]\ttraining's auc: 0.984348\tvalid_1's auc: 0.976012\n"
     ]
    }
   ],
   "source": [
    "tfidf_model = train(user_representation_fn = user_representation_2)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "2a4b63a5-56ee-4bd2-b7b8-2aebb5299b31",
   "metadata": {
    "id": "2a4b63a5-56ee-4bd2-b7b8-2aebb5299b31"
   },
   "source": [
    "We have now trained a light gbm model using user_representation_1() function as the user representation technique. The key goals for part B of this week's project are to implement user_representation_2(), where we represent the user as the average of embeddings of their recently purchased articles.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "4940f48d-08e5-4130-be2c-d15622012620",
   "metadata": {
    "id": "4940f48d-08e5-4130-be2c-d15622012620"
   },
   "source": [
    "Once you have implemented the function, please note to change the line:\n",
    "\n",
    "df_cust = user_representation_1()\n",
    "\n",
    "to the appropriate function name and run re-train the model. Please report the performance numbers with each of the two user representations.\n",
    "\n",
    "## Performance Report\n",
    "\n",
    "\n",
    "- User Representation 1:\n",
    "    - Train AUC 83.9\n",
    "    - Valid AUC 82.4\n",
    "- User Representation 2:\n",
    "    - Train AUC 98.4\n",
    "    - Valid AUC 97.6\n",
    "\n",
    "This should complete the week 3 project!"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "ydLW7dPiuw-E",
   "metadata": {
    "id": "ydLW7dPiuw-E"
   },
   "source": [
    "### Optional task 1: training a Doc2Vec model\n",
    "\n",
    "If you want an extra challenge, you can try implementing Doc2vec representations in user_representation_3(). The Doc2vec model is an embedding learning method\n",
    "    that enables us to learn representations of a document.\n",
    "    We treat each user as a document, and the set of articles\n",
    "    the user has purchased as the set of words in the document."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "ce141145-f5af-4f2d-9d94-f4bb50e6208f",
   "metadata": {
    "id": "ce141145-f5af-4f2d-9d94-f4bb50e6208f"
   },
   "source": [
    "### Optional task 2: training a sequential LSTM model\n",
    "\n",
    "Another optional task here would be to implement user_representation_4() where user representations are learnt by a sequential LSTM model. The LSTM model will need to be trained on a task -- the task itself could be the downstream task of predicting whether or not a user would purchase a given article given a sequence of previous articles. The final hidden layer of the lstm model can be used as the user representation."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "88eb3b58-062c-4c96-b3f0-2db4407ce1b3",
   "metadata": {
    "id": "88eb3b58-062c-4c96-b3f0-2db4407ce1b3"
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "colab": {
   "collapsed_sections": [],
   "machine_shape": "hm",
   "name": "week3-ann-user-representations.ipynb",
   "provenance": []
  },
  "environment": {
   "kernel": "python3",
   "name": "tf2-gpu.2-6.m89",
   "type": "gcloud",
   "uri": "gcr.io/deeplearning-platform-release/tf2-gpu.2-6:m89"
  },
  "gpuClass": "standard",
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.13"
  },
  "widgets": {
   "application/vnd.jupyter.widget-state+json": {
    "034fea7267f740a1806f824177b2a194": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_c9f535c00ab047b1bd542b741553654d",
      "max": 170519,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_ecb424cb3302481f8a39e261013481de",
      "value": 170519
     }
    },
    "050a72aedfe1460fafc6e66fa1204939": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_cedc87883d174417ae6ee3da845fe5d5",
      "placeholder": "​",
      "style": "IPY_MODEL_1e31ae49a19d4981a3375ea29bc36132",
      "value": "100%"
     }
    },
    "08014c03513d40c48ee99b5e09e5bc15": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "0aca0e87926c4d6d8cc9908996d362a7": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "0bfc933b38c8451aadf8fa25a8f722f1": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "1128a266700749e89c31d33afc2b7caa": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "13c4f41635894674ad5573d38c380077": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "1ae87ed5984b4a1babdc0fd611d1642a": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_204bba63d10d40e5b6625f9e42450353",
      "max": 170519,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_525fb797babb4546bb2183f1c8258584",
      "value": 170519
     }
    },
    "1e31ae49a19d4981a3375ea29bc36132": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "1f8bcd0170b34bc4a78e7ed22bb51538": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "1ffcdb087bce47e0835bd0e81aad9d1c": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "204bba63d10d40e5b6625f9e42450353": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "2d15ba0b8b42450fbd27d74c55a9686f": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "2deb287f8a864fd78a53a6dd6bce2e2e": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "2ea4173e43344f8eae149cdd944edd6a": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "3a20ee485cfe4e4f945fb14d7bc49fe1": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "3f75b066499f475194dc0c057356ac84": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "405afb5949284b5e83aa82775da6438a": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "48a130bf4b7c4bdd935143718c08923d": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_050a72aedfe1460fafc6e66fa1204939",
       "IPY_MODEL_f8c3adb0544b4f29adf26c0c732e7e8f",
       "IPY_MODEL_95a54b51cee84b609bc8a161eabb1c3b"
      ],
      "layout": "IPY_MODEL_fa10ca78705a4f3d9bbe6b0b89eecd99"
     }
    },
    "48e3addf97e54b469517f72704487b1e": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_0bfc933b38c8451aadf8fa25a8f722f1",
      "placeholder": "​",
      "style": "IPY_MODEL_eecd81d8153142d6b979fff3f84308be",
      "value": "100%"
     }
    },
    "4a975783fa1641bca4b8ba8df7fbf901": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_48e3addf97e54b469517f72704487b1e",
       "IPY_MODEL_1ae87ed5984b4a1babdc0fd611d1642a",
       "IPY_MODEL_c070568483b041f292a4cf98729e5e9c"
      ],
      "layout": "IPY_MODEL_81dc7c6c42d04748b11527f667e73d36"
     }
    },
    "4f9e6c2b29014d0daef96cb065a30c1c": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_3a20ee485cfe4e4f945fb14d7bc49fe1",
      "placeholder": "​",
      "style": "IPY_MODEL_2ea4173e43344f8eae149cdd944edd6a",
      "value": "100%"
     }
    },
    "51b8f70f57a74b318795a2a651a1df21": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "525fb797babb4546bb2183f1c8258584": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "529c3f03c0a245dca7a8089b8b19786c": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "579d8630c24d4d40a0d020c708afae93": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_fc6e955d5d4d4052b8100978d3ea1ec7",
      "placeholder": "​",
      "style": "IPY_MODEL_87248b50a4f040d197c402009e2301bd",
      "value": "100%"
     }
    },
    "5a53470c3ba148cfae0e190467070635": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "5d252e76c6494d4a990237b246739515": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "5efb645f5a744074b3b9c5556ca9ce1d": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_79aeaf2a0d2440f2adcd71d15958d1e0",
      "placeholder": "​",
      "style": "IPY_MODEL_e07098df7efe4b8595656eec08d29101",
      "value": " 170519/170519 [00:03&lt;00:00, 56968.60it/s]"
     }
    },
    "5f38c2755787464793cf9498944db4a3": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "603429be8e394c0586ff7f9ae1172d4d": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_2d15ba0b8b42450fbd27d74c55a9686f",
      "max": 170519,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_ed2498819a7348f0b84068929ddca259",
      "value": 170519
     }
    },
    "6454fe01789946608406ad22f46ef905": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "72efc0e1a2424b319956188ba771228a": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_1ffcdb087bce47e0835bd0e81aad9d1c",
      "placeholder": "​",
      "style": "IPY_MODEL_c4eb31d66dbe40c0915320365a858406",
      "value": "100%"
     }
    },
    "749d4c3f40854cc99b463a1d61644d09": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_579d8630c24d4d40a0d020c708afae93",
       "IPY_MODEL_c12b4c218fdc44f6aaca1ec73b8468a4",
       "IPY_MODEL_a1c1f323dd2f4975a3db717fa4806b55"
      ],
      "layout": "IPY_MODEL_405afb5949284b5e83aa82775da6438a"
     }
    },
    "75402bb748c94bb28c46f0300fd62c06": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_72efc0e1a2424b319956188ba771228a",
       "IPY_MODEL_88f2237695f7488183ab3ec9d519940d",
       "IPY_MODEL_5efb645f5a744074b3b9c5556ca9ce1d"
      ],
      "layout": "IPY_MODEL_f23e2d8072ca4d0c99a6a331f8803277"
     }
    },
    "79aeaf2a0d2440f2adcd71d15958d1e0": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "81dc7c6c42d04748b11527f667e73d36": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "87248b50a4f040d197c402009e2301bd": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "88f2237695f7488183ab3ec9d519940d": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_aef28352b3614bafa87d7f0e5832d6f3",
      "max": 170519,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_962df1c3f61a4bbf8b20379c620edb17",
      "value": 170519
     }
    },
    "8a89afcafa9143f197293375d90d80e6": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "95a54b51cee84b609bc8a161eabb1c3b": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_8a89afcafa9143f197293375d90d80e6",
      "placeholder": "​",
      "style": "IPY_MODEL_eecd3ffb72d2479596d9baa1d58c9768",
      "value": " 170519/170519 [00:00&lt;00:00, 1022554.99it/s]"
     }
    },
    "962df1c3f61a4bbf8b20379c620edb17": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "9bad489c395f4f62bfb7d88a5e3e57d6": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_4f9e6c2b29014d0daef96cb065a30c1c",
       "IPY_MODEL_603429be8e394c0586ff7f9ae1172d4d",
       "IPY_MODEL_cc40df08b7aa4c64a97e1bc95de66e1d"
      ],
      "layout": "IPY_MODEL_5a53470c3ba148cfae0e190467070635"
     }
    },
    "9c35e0839cc7416bafd0ed68411d0812": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_b3bc7ddeee0347678f9cefe54e645cfb",
       "IPY_MODEL_034fea7267f740a1806f824177b2a194",
       "IPY_MODEL_abbb81ffe11b43bbac4a9f052a728504"
      ],
      "layout": "IPY_MODEL_f93ec2b19fb441a7b896fe190f33181a"
     }
    },
    "a1c1f323dd2f4975a3db717fa4806b55": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_6454fe01789946608406ad22f46ef905",
      "placeholder": "​",
      "style": "IPY_MODEL_5f38c2755787464793cf9498944db4a3",
      "value": " 170519/170519 [05:45&lt;00:00, 513.08it/s]"
     }
    },
    "abbb81ffe11b43bbac4a9f052a728504": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_5d252e76c6494d4a990237b246739515",
      "placeholder": "​",
      "style": "IPY_MODEL_1f8bcd0170b34bc4a78e7ed22bb51538",
      "value": " 170519/170519 [05:27&lt;00:00, 514.40it/s]"
     }
    },
    "aef28352b3614bafa87d7f0e5832d6f3": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "b3bc7ddeee0347678f9cefe54e645cfb": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_529c3f03c0a245dca7a8089b8b19786c",
      "placeholder": "​",
      "style": "IPY_MODEL_dda9b4e97afe44ce872fbc3a5c4b04b5",
      "value": "100%"
     }
    },
    "c070568483b041f292a4cf98729e5e9c": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_2deb287f8a864fd78a53a6dd6bce2e2e",
      "placeholder": "​",
      "style": "IPY_MODEL_08014c03513d40c48ee99b5e09e5bc15",
      "value": " 170519/170519 [00:00&lt;00:00, 1073433.25it/s]"
     }
    },
    "c12b4c218fdc44f6aaca1ec73b8468a4": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_3f75b066499f475194dc0c057356ac84",
      "max": 170519,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_1128a266700749e89c31d33afc2b7caa",
      "value": 170519
     }
    },
    "c4eb31d66dbe40c0915320365a858406": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "c9f535c00ab047b1bd542b741553654d": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "cc40df08b7aa4c64a97e1bc95de66e1d": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_13c4f41635894674ad5573d38c380077",
      "placeholder": "​",
      "style": "IPY_MODEL_0aca0e87926c4d6d8cc9908996d362a7",
      "value": " 170519/170519 [00:02&lt;00:00, 61167.20it/s]"
     }
    },
    "cedc87883d174417ae6ee3da845fe5d5": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "d3b34ee4d6cd406692cc490863f87542": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "dda9b4e97afe44ce872fbc3a5c4b04b5": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "e07098df7efe4b8595656eec08d29101": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "ecb424cb3302481f8a39e261013481de": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "ed2498819a7348f0b84068929ddca259": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "eecd3ffb72d2479596d9baa1d58c9768": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "eecd81d8153142d6b979fff3f84308be": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "f23e2d8072ca4d0c99a6a331f8803277": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "f8c3adb0544b4f29adf26c0c732e7e8f": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_d3b34ee4d6cd406692cc490863f87542",
      "max": 170519,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_51b8f70f57a74b318795a2a651a1df21",
      "value": 170519
     }
    },
    "f93ec2b19fb441a7b896fe190f33181a": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "fa10ca78705a4f3d9bbe6b0b89eecd99": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "fc6e955d5d4d4052b8100978d3ea1ec7": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    }
   }
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}