Clase 07 - Boosting, Stacking.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Boosting\n",
    "\n",
    "### Julián D. Arias Londoño\n",
    "\n",
    "Profesor Asociado  \n",
    "Departamento de Ingeniería de Sistemas  \n",
    "Universidad de Antioquia, Medellín, Colombia  \n",
    "julian.ariasl@udea.edu.co"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Como vimos en la clase anterior, en Machine Learning los métodos de ensamble sigen la idea de entrenar múltiples modelos simples y combinar sus respuestas para producir un mejor resultado. A diferencia del Bagging en Boosting la combinación se hace de manera secuencial y no paralela:\n",
    "\n",
    "![alt text](./Images/Boosting1.png \"Boosting1\")\n",
    "\n",
    "La idea central de los métodos de Boosting es entrenar modelos secuencialmente haciendo que los modelos subsiguientes se enfoquen en las muestras que no han podido ser modeladas correctamente por los modelos anteriores. Cada modelo tiene un peso diferente dentro de la decisión final. La forma de asignar el peso a las muestras y a los clasificadores dependen del método de Boosting particular.\n",
    "\n",
    "![alt text](./Images/Boosting2.png \"Boosting2\")\n",
    "\n",
    "Imágenes tomadas de: https://quantdare.com/what-is-the-difference-between-bagging-and-boosting/"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Los dos métodos reducen el error por varianza; boosting es mejor para reducir el bias pero puede presentar problemas de sobreajuste, razón por la cual algunos métodos de boosting requieren un ajuste cuidados de parámetros de regularización."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Adapting Boosting (Adaboost)\n",
    "\n",
    "En Adaboost el modelo de ensamble se define como una suma sopesada de $M$ modelos débiles:\n",
    "\n",
    "$$F({\\bf{x}}) = \\sum_{m=1}^M \\alpha_m f_m({\\bf{x}})$$\n",
    "\n",
    "donde $\\alpha_m$ son los pesos y $f_m(\\cdot)$ son los modelos base.\n",
    "\n",
    "El algoritmo de entrenamiento consiste en adicionar clasificadores débiles uno a la vez, en un proceso de optimización iterativo, tratando de encontrar en cada iteración el mejor par $(\\alpha_m, f_m)$ para adicional al ensamble actual. \n",
    "\n",
    "Dado un conjunto de muestras de entrenamiento $\\mathcal{D} = \\{({\\bf{x}}_i,y_i)\\}_{i=1}^N$\n",
    "\n",
    "***\n",
    "\n",
    "**Algoritmo AdaBoost**\n",
    "\n",
    "* Inicialice los pesos de las muestras $w_m(i) = 1/N$\n",
    "\n",
    "* Para $m$ desde 1 hasta $M$\n",
    "    * Entrene un clasificador $f_m: \\mathbb{R}^d \\rightarrow \\{-1,+1\\}$ teniendo en cuenta los pesos $w_m$\n",
    "    * Estime el error $\\epsilon_m = \\sum_{i:f_m({\\bf{x}}_i) \\neq y_i} w_m(i)$\n",
    "    * Estime el peso del clasificador $\\alpha_m = \\log\\frac{1 - \\epsilon_m}{\\epsilon_m}$\n",
    "    * Actualice los pesos $w_{m+1}(i) = w_{m}(i)\\exp(-\\alpha_m y_i f_m({\\bf{x}}_i))$\n",
    "* El modelo obtenido será igual a $F({\\bf{x}}) = \\text{sign}\\left(\\sum_{m=1}^M \\alpha_m f_m({\\bf{x}})\\right)$\n",
    "\n",
    "\n",
    "![alt text](./Images/AdaBoostAlgorithm2.png \"AdaBoost\")\n",
    "\n",
    "Imagen tomada de: https://towardsdatascience.com/understanding-adaboost-2f94f22d5bfe"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Los pesos de cada una de las muestras dentro del algoritmo AdaBoost pueden ser tenidos en cuenta de dos formas:\n",
    "\n",
    "* Los pesos de cada muestra se pueden usar para establecer una nueva distribución $D_{m+1}(i) = \\frac{D_{m}(i)\\exp(-\\alpha_m y_i f_m({\\bf{x}}_i))}{Z_m}$, donde $Z_m$ es un factor de normalización que garantiza que la distribución cumplea la restricción estocástica $\\sum_{\\forall i} D_{m}(i) = 1$. Se puede usar un proceso de muestreo sobre la distribución $D_{m+1}$ en la cual tendrán mayor probabilidad de aparición las muestras sobre las que el modelo ha cometido más errores. Dicho muestreo se puede realizar fácilmente usando una distribución multinomial (numpy.random.multinomial).\n",
    "\n",
    "* Los pesos de cada muestra se pueden usar con clasificadores base que puedan tratar cada muestra con una importancia diferente. En el caso de los árboles de decisión, se puede, por ejemplo, usar el peso de cada muestra para medir la ganancia de información. Cuando se estima la probabilidad de quedar a cada lado de una partición $a$, en lugar de contar 1 por cada muestra, se usa el peso de dicha muestra (sample_weight)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAXwAAAEICAYAAABcVE8dAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjMsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+AADFEAAAgAElEQVR4nOydeXxU1fn/38+d7AlrQEAgBBAVBUQFqVJX3OqGa12CQtVGxVpbu9nm91Vrm9ZqbbUqUOpGIa221rXSWnfFHRdcQGUxCYHIEtaQhCQz5/fHvbNlZpKZZDIzmTzv1yuvzNxz7r3n3jv3c5/7nOc8R4wxKIqiKOmPlewGKIqiKIlBBV9RFKWXoIKvKIrSS1DBVxRF6SWo4CuKovQSVPAVRVF6CSr4vRgR+UxEjkvCfs8RkfUiUi8ihyZ43x0es4gUOW1zJahZShSIyP0i8otkt6MnIxqHn1xEpBIYAriBFuBN4GpjzPpktqs7EZG1wA3GmKcilBugATDAXuAjYKEx5tHEtTK+iEgRsDJgUT7+YwT4ljHm9W7cfwb278u7zx3A34GfGWM83bVfJbVQCz81ONMYUwAMAzYB9yS5Pd3NKOCzDuoc4pyTA4CHgXtF5Obublh3YYypNsYUeP+cxYcELAsR+256wzjY2f8JwKXA7HjvQEQsEVFtSUH0oqQQxpgm4DHgIO8yETldRD4UkV2OG+SWwHVE5DIRqRKROhH5PxGpFJETnbJcEVkkIttFZJWI/FREagLWDax7i4j8Q0T+KiK7HdfHlIC6hznt2C0i/xSRR0Xk1+GOw7nh/5/Trs3ONvuJSLaI1AMuYIVj6Xd0TrYaYxYD1wA/F5FCZx/9ROQBEakVkQ0i8utAgRSR7zrHvFtEVorIYWGO+QgRWe6c200i8gdnebGIGMcqRkT2FZGnRWSbiKwRke8G7Kfd8xYLIrJERO4Tkf+KyB7gaBHJEZE/ONd+k4jME5GcgHXOEpEVIrJDRJaJyIRo9mWM+RL7bXJywLb6i8hDzjmtEZFbvcItIi4Rucv5na0TkeucNzHvustE5Fci8hawByjqYHv7i8hrIrJTRLaKyN+c5ZaI/Mn53ewUkY9F5KCA83NLwD6vdq5HnYg8KSLDnOUZzvW7yinfLiJ/6sw1STuMMfqXxD+gEjjR+ZwHLAL+GlB+HDAR++E8CfsN4Gyn7CCgHvgmkAX8Hvu13bu924BXgQHACOBjoCbCvm8BmoDTsAX5t8DbTlkWUAVcD2QC5wLNwK8jHNPlwBpgDFAAPA4sDig3wH7tnJOQcme/rdiuD4AngD9ju0b2Ad4FrnLKLgA2AFMBAfYDRoU55reAS53PBcA3nM/FThsynO+vAfOAHGyB3AKc0NF56+C6hzvGJcB24Ejnemdjv+094VzDvsBS4FdO/anO72Gqs+/LgbVAVpj9ZTj7LHa+j3fWvS6gzjPOceZhuxnfB65wyr4HfAoMBwYCLwMmYN1lzrkd71yrjA6290/gZ85x5gDTneWnO9eyn1N2EDA04Pzc4nw+GdjsXI8cZz8vtTnWp5ztFAPbvNe9N/8lvQG9/c+5SeqxfaotwEZgYjv17wL+6Hy+Cfh7QFkethB7BW0dcEpA+ZW0L/gvBJQdBDQ6n4/BFlAJKF9GZMF/EZgb8P0A59i8Ahqz4DvLvwZKHPHYC+QGlF0MvOx8fg64vp3z7T3m14BfAoPa1Cl22pABjMTuX+kTUP5b4OGOzlsH1z2S4D8Y8N3CfpiMClh2NLDa+fwX4OY221iLI55tlntFcBe2BW6c/WU55cOBRiA7YJ1LgecDztUVAWWnEir4NwV872h7fwPmA8PbtPNk4HNgGmCFOT+3OJ8XAb8JKOvrXKcRAcf6jYDyx4Efd9d93FP+1KWTGpxtjOmPbal8D3hVRIYCiMg0EXlZRLaIyE7gamCQs96+gK9z1xjTANQFbDeovM3ncHwd8LkByHHcGvsCG4xz50SxrX2x3wi8VGHfhEM62H9ERCQTGIxtqY3CtiJrHVfGDmxrfx+n+khs4euIK4D9gc9F5D0ROSNMnX2BbcaY3QHLqrAFzUuk89YZAs/rUGwrf0XAcf4b/3GOAn7mLXPKh7VpW1smAX2AS7DfJPIDtpUNbArY1n34r1k0v6XAZR1t70fY13C5iHwiIrMBjDH/AxZgPww2icgCEekTZl9BvzFjzC7st6P2rksBvRwV/BTCGOM2xjyObal801n8N+BpYKQxph/2zSBOWS22RQPYPnugMGCTQeXYQtgZaoHhIiIBy9rb1kbsG95LEbY7ZlMn9w8w09nGu9jCshfbMu/v/PU1xhzs1F0PjO1og8aY1caYi7EF9HfAYyKS36baRmBgG9Epwn7j6Q4CH6qbsN/YDgg4zn7O7wDs4/xlQFl/Y0yeMeYf7e7AGI8x5u/AcqAsYFsNwMA253SSUx7Nb6mtQRBxe8aYWmPMlcaYYcC1wEIRGe2U3WWMOQyYgP3GdEOYfQX9xpzrM4Duuy5pgQp+CiE2M7F/uKucxX2wLcwmETkC2zLz8hhwpogcJSJZ2O6FQFH+B3ZH5wARGY799tAZ3sJ+CH3P6RCbCRzRTv2/Az8UkdEiUgD8BnjUGNMa645FZKCIlGBbh78zxtQZY2qB/wF3ikhfp6NvrIgc66x2P/BjETncOaf7icioMNueJSKDjR2WuMNZHBSiaOzw2DeB3zodqJOw3wyWxHossWKMcWMfy10iMtg5lhEicrJT5S/AtSIy1SkrEJEzwzy0InEbcLVzDtZj9/f8PuCc7icixzh1/wH8QOwO7AHATzpoe7vbE5FvO79JsM+9Adxid6Qf4bwh7cF+4IULG/07cIWITBKRbGw32+vGmJowdRUHFfzU4Bmxo1d2AeXAbGOMN2xxLnCriOzG9tn7rDenznXAI9gWWD12R9Zep8qtQA3wFfAC9gPCWxY1xphm7I7aK7BvzlnYroVI23oQWIzt9/0K2w99XYy7XeGckzXYfQ8/NMbcFFB+GXZn8krsV/nHsN0ZGGP+iX0e/wbsBp7E7mhsy6nAZ85+7gYuMsY0hql3MbZffyN2B+rNxpgXYjyezvIjbNfFu8BO7AfdOABjzNvY0Uvzsc/Bl9jXJiqMMR9iP8x/7Cyahe3i8Z7Tf2K7lXD28QrwCXbn67PYYtwe7W1vGvCe2NFIjwPXGmOqgf7AA9i/s0rs3/UfwrT9v9i/7yecOkXY/TtKO+jAqzTCsaZ3AOOMMV+FKb8GW9SODVk59n29AywwxjzU1W0pPQ8RORO4yxjToetMSR3Uwu/hOK/wec5r/O+xLbBKp2yYiEx3XqcPwLYWn+jkfo4VkaGOS2c2dufff+NzFEqqIyL5InKqc/1HYL9tduq3pCQPFfyez0xsV8NG7Ff9iwKiabKwo1d2Ay9hxyXP6+R+DgBWYL9B/Ag43/GlK70DwXaT7cB26XyMHdKq9CDUpaMoitJLUAtfURSll9DZwSEJYdCgQaa4uDjZzVAURekxvP/++1uNMYPDlaW04BcXF7N8+fJkN0NRFKXHICJVkcrUpaMoitJLUMFXFEXpJajgK4qi9BJS2oevKEpyaWlpoaamhqampmQ3RWlDTk4OI0aMIDMzM+p1VPAVRYlITU0Nffr0obi4mOBkqUoyMcZQV1dHTU0No0ePjnq9uLh0RORBsack+zRC+XFiT1f2kfN3U7h6SnRUVFRQXFyMZVkUFxdTUVGR7CYpaUpTUxOFhYUq9imGiFBYWBjzm1e8LPyHgXuBv7ZT53VjTLgJJpQYqKiooLS0lIaGBgCqqqooLS0FoKREkwUq8UfFPjXpzHWJi4VvjHkNeyYipZspKyvzib2XhoYGysrKIqyhKIpik8gonSNFZIWI/EdEDo5USURKRWS5iCzfsmVLApvXM6iuro5puaL0dC6//HL22WcfJkyYELR827ZtnHTSSYwbN46TTjqJ7du3d3lfv/nNb4K+H3XUUV3eJsArr7zCm2++GZdtdYVECf4H2BMxHwLcgz0hRViMMQuNMVOMMVMGDw47OrhXU1RUFNNyRenpzJkzh//+NzQT92233caMGTNYvXo1M2bM4LbbbuvyvtoKfrxEujOC39oa8wRxHZIQwTfG7DLG1DuflwKZIjKog9WUMJSXl5OXlxe0LC8vj/Ly8iS1SFG6l2OOOYaBA0MnLHvqqaeYPXs2ALNnz+bJJ0PtSLfbzU9+8hOmTp3KpEmT+POf/wxAbW0txxxzDJMnT2bChAm8/vrr3HjjjTQ2NjJ58mRff1hBgT3v+SuvvMKxxx7LzJkzGTNmDDfeeCMVFRUcccQRTJw4kbVr1wLwzDPPMG3aNA499FBOPPFENm3aRGVlJQsWLOCPf/wjkydP5vXXX6eyspITTjiBSZMmMWPGDN8b+pw5c7j66quZNm0aP/3pT3n11VeZPHkykydP5tBDD2X37t1dOpcJCcsUkaHAJmOMceZltYC6ROw73fD+EMvKyqiurqaoqIjy8nLtsFW6nV8+8xkrN+6K6zYP2rcvN58Z0cPbLps2bWLYsGEADB06lE2bNoXUeeCBB+jXrx/vvfcee/fuZfr06Zx88sk8/vjjnHLKKZSVleF2u2loaODoo4/m3nvv5aOPPgq7vxUrVrBq1SoGDhzImDFjuPLKK3n33Xe5++67ueeee7jrrrv45je/ydtvv42IcP/993P77bdz5513cvXVV1NQUMCPf2zPJnnmmWcye/ZsZs+ezYMPPsj3v/993wOrpqaGN998E5fLxZlnnsl9993H9OnTqa+vJycnp1PnyktcBF9E/g4cBwwSkRrgZiATwBizADgfuEZEWoFGgifpUGKkpKREBV5RAhCRsFEr//vf//j444957LHHANi5cyerV69m6tSpXH755bS0tHD22WczefLkDvcxdepU3wNm7NixnHyyPZf8xIkTefnllwFbrC+88EJqa2tpbm6OGCP/1ltv8fjjjwNw6aWX8tOf/tRXdsEFF+ByuQCYPn06N9xwAyUlJZx77rmMGDEi2lMSlrgIvjHm4g7K78UO21QUpYfSWUu8uxgyZAi1tbUMGzaM2tpa9tlnn5A6xhjuueceTjnllJCy1157jWeffZY5c+Zwww03cNlll7W7v+zsbN9ny7J83y3L8vnbr7vuOm644QbOOussXnnlFW655ZaYjys/P9/3+cYbb+T0009n6dKlTJ8+neeee44DDzww5m362t3pNRVF6XZ0kF1kzjrrLBYtWgTAokWLmDlzZkidU045hfnz59PS0gLAl19+yZ49e6iqqmLIkCF897vf5corr+SDDz4AIDMz01e3M+zcuZPhw4f72uSlT58+Qf73o446ikceeQSwr/HRRx8ddntr165l4sSJ/OxnP2Pq1Kl8/vnnnW4bqOArSsriHWRXVVWFMcY3yK63if7FF1/MkUceyRdffMGIESN44IEHANv6ff755xk3bhwvvPACN954Y8i6V155JQcddBCHHXYYEyZM4KqrrqK1tZVXXnmFQw45hEMPPZRHH32U66+/HoDS0lImTZrUaZfpLbfcwgUXXMDhhx/OoEH+uJQzzzyTJ554wtdpe8899/DQQw8xadIkFi9ezN133x12e3fddRcTJkxg0qRJZGZm8q1vfatT7fKS0nPaTpkyxegEKEpvpbi4mHxXMxccsW/Q8tzcHI459tiw61giHHTgePocEZ8+nlWrVjF+/Pi4bEuJP+Guj4i8b4yZEq6+Jk9TlBSlurqaJdccyiWDV4cWfvVJ5BXXAZPOgJx+3dY2pWeigq8oKUpRURFZLviqtZDxd9T4lo8aOZIVn3wcUn9vq4e7b/s5N2UuBnfn/dBK+qI+fEVJUcrLy8mwwG0s9ja3sLe5BVdGJjf98lZycvND/nJz82kiy17ZE/9RmkrPRwVfUVKUkpISCgcOwIiFiDBq1CgWLlwYsUPREnB7b2mPO4EtVXoK6tJRlBQmPzeXTLLxeDwd1nVZEiD4auEroaiFrygpjBg3nihvUxHBbVTwlcio4CtxRQcKxRsPRqK/TY3lcj50/EbQE1i/fj3HH388Bx10EAcffHBQvLqmR44dFXwlbuhAofgjxmCIfmYjT5q5dDIyMrjzzjtZuXIlb7/9Nvfddx8rV64END1yZ1DB72l8vhTe/Yv/b+XTyW6RD52NK/6IceMRV9T1PeJ0y6VJp+2wYcM47LDDADs9wfjx49mwYQOg6ZE7g3ba9iQad8AjYfLU/Xg1FIQmjko0OhtX/BFitfCdh0N3WPj/uRG+bmfAV2cYOhG+FZ1lXllZyYcffsi0adMATY/cGVTwexJNO+3/p94GEy+AlU/Csz+CvbtTQvCLioqoqqoKu1zpHGI8EIMPH68PP00sfC/19fWcd9553HXXXfTt2zekXNMjR4cKfk+iud7+32co5A+CfEfkWxoir5NAysvLKS0tDXLr6GxcXUOMJyYL3+19OJhuEPwoLfF409LSwnnnnecTPS+aHjl21Iffk9jrCH5WH/t/pjPVYUtjctrThpKSEhYuXMioUaOiGiikRIMnJh8+0o0unSRgjOGKK65g/Pjx3HDDDUFlmh45dlTwk0isIYzuJvsH84MnVnPSH17lhie+AKClaU+3tzVaSkpKqKysxOPxUFlZqWLfRWyXTvQWvpH0cum88cYbLF68mJdeesnXebl06VJA0yN3Bk2PnCS8IYxt3R/tWcS73n+Mvs9cwbV978EMOZiczR/zh50/YOuZixh0+NmJarqSQFaWH4WxMjn4569GVf/KX/2J+93/B5c+CWOP7/L+NT1yahNremS18JNEZ0IY3U32BNLfOnw/5pUczhmHjwGgNYUsfCW+WCbGgVdpZuEr8UUFP0l0JoTR3Wi7dFw5fZ3/dudO697U6LRV4o/gwcRwm/oEvzs6bZUejwp+kogUqtheCKPH8eFbOXanbWaOPSjE06wWftoSY1im6YZO21R2+/ZmOnNdVPCTRHl5OXl5eUHLOgphNHt302xcZGXnApCZba/vUQs/bbHw4OlMLp04uXRycnKoq6tT0U8xjDHU1dXFPBArLnH4IvIgcAaw2RgzIUy5AHcDpwENwBxjzAfx2HdPxdsxW1ZWRnV1NUVFRZSXl7cbHWD21rOHXLIzbQHIclw6nubkCX5FRYXvGAYOHAjAdw7YzW0zcrAs8UeQ5/SDa9+xxxAoUSPGEJNdFmcLf8SIEdTU1LBly5a4bE+JHzk5OTEPxIrXwKuHgXuBv0Yo/xYwzvmbBsx3/vdqSkpKog//8rjpv+FltpJDdoZ9U+dkZ7HXZGISGIdfUVHB9ddfT11dXUiZd9l54/NYt93NY18IZ5xxOhOLCuGjJbDlc+gzNGQbhYWF3H333RrCGQbBg0liWGZmZmbE0aJKzyMuLh1jzGvAtnaqzAT+amzeBvqLyLB47LvX8NVr5OzZwF6TSY5j4edkWjSShYmzhR9pfEBFRQXf+c53QsT+sGEWsw/JZPYhmcyZnMlhw1w8tqqVXzxfz5l/eBuOdgbM7KoNu426ujouv/xyzaoZBguPX8SjwGM5Npx22iphSFRqheHA+oDvNc6y2rYVRaQUKAXNwRLEbvtUXddyHX/yWviZLhrJjutI27bjA7wpjsF2PwWOQsy04NlL8jhpbOjP6H9rbZdCdXW1342zu5aysj+FHcnY3NxMWVmZWvltiDmXjqRXemQlvqRcLh1jzEJgIdgDr5LcnNRhz1YAqswQsjMcCz/DRZ3JQlrjZ+G3Nz6gbcjo4fu6OGlsBm+tb+XSJxppdebcaGqFTXvsS1dUVARZ+ZDdD3bXtht2qlk1QxFMjHH46ZUeWYkviRL8DcDIgO8jnGVKtDTU4ZZM9pBDTqZt4WdnWjSRTd+mrdDQnkctAFcWZBdELG5vfEBRURHVVVUMyLV9yscX2+0459FGn8AHEhR11Gco7Khm0rgRrF9fE1K3scWwz3B9o2uLhQdiSJ7WHWGZSvqQKMF/GvieiDyC3Vm70xgT4s5R2qFhK01ZA6BRfFE62RkWL3kO5Xs7n4Tbo+xYc2XB+Q/CmPDD7g8cMzJI9D0GGlvxRRG1PlbK7EP8P5t12z0+sS8sLATsqedCoo76jYAv/8tHFwP0CdlvfbPhuQN+GrI8HHPnzmXhwoW43W5cLhelpaXMmzcvqnV7GvZI2xiSp1lq4SuRiVdY5t+B44BBIlID3AxkAhhjFgBLsUMy12CHZX4nHvvtVTRsoyGjP2C7csDOAT5fLmTEmMmcfUBee2v7ee8BeHRWxOKVswCC842XLnVz7PW2eH9dcxfrar/kj2/Z/Qaf7y5gyZIlHfveT/kNfGXng3lv+Xv861//Ys8ee8DY8IH53DjNw3kT8gKEyrFqJfj/3LlzmT9/vm+zbrfb9z0dRV8wnfPha6etEoa4CL4xJsw0TEHlBrg2HvvqtezZSkNGf0Qg0+V/xc/KzOD9vidx9jR7+ENgXHzY2P4DT4fPnoB2BtJ88OEH/Oc//2XHju3ccVIO35t1JpOcbQzdZzAMGcI9d/07tvbvc6D9B0yddhVTr73fX2YM3DURnrne/muHefvAvJv74nHabwzMX97C9xcsYOnSpVGPaegpSMyTmHstfHXpKKGkXKet0oYPK+DjR2HTZ9T3OYrsDCtoZp+cTBeNLbY1116ETZBr5ajr2t3lYdPhsO85X345gEkTAsbSGY9/VqV4IQLnLoTKNwDnQWRMm88AhltvvdW3CsClkzKZNMTyTZoO9nHPmjWLK6+8kvvvv79HC79FjKkV0nTGKyU+qOCnOu8/BFtXw9CJfJxxPDk7gsU2J9NFU4ubiooKZs+ejdsdfKN7I2w6LXpiBbsHnDDBNZt3s25LPHP4jIFBY8KWZLiEo8YOIifTxa0n3RR0jEeNcJEd4Vfc1NTEnDlzAHqs6FsxunREO22VdlDBT3V2b4L9T4Vz/8xHj31MdsbmoOLG+l08/c5G/lm7lsJzbwq7iUbgsgff7dTuH/AI23Y2MsT57vF4+OLrek7/42t4Ehg0e+vMg7nsyGJKS0uDfPge034MS2tra4+O75cYLXyPpkdW2kEFP5UxBuq/hj5DMMbwQfV2X1oFsF04a178N5mjp2Dl5EfcTHZWNrsaOzdtm9tAdV29T/CbmlvYtNswfEAu911yGFYMw/47y/kL3mT9NttN5e2Y9UbpGCAzo30XU0+O7481H75laXpkJTIq+KlM43ZwN0PBUN75ahurN9czepBf2MvKyqirqoJlj0TchH8WremdakLDzZY92tOhpbUVDxnce/FhTBrRv1PbjJUhfXP4etde3/d58+b5I3IWn8vWmrXAxxHX78kjtmN16ViWhRsLl7p0lDBoeuRUZvfX9v8+Q/l6ZxMAvz13oq+4I8vV5XJ1eRJxN5btt3dobXXjxmJY/9jSsnaFIX1z2OQcfwhiMahwIDNmzAhbnJGREZRyOtZ5hJNNrGGZliV4sNSlo4RFLfxk0rwHXr8TIiU/273R/t9nKDtqmgHYf4h/0FJRUZEvMqUtHc2PGy0GCXIPtLpbEbEYlJ/dpe3GwtC+OXy0fkf4QrEfSC+88DJz585lwYIFvtztBQUFLFiwwHcOoopiSjFcMfrwLQE3LjLVwlfCoIKfTKretAU/q8Cfx7wNuzMKOfrki6gc/E36f7OEfz/xTy6bZYtTeXl5yEToEN90wx4kxMLPyszAsrrfd+9lSN9svt7ZxH0vrwkpO62ugSHSQh6Oq+e6b8HoYyGnb0jd9vIEpargx9pp6xLBLS618JWwqOAnkwYnRfBVr0Hh2KCitjnjB4zsg6epnmuuKsUlwbn0Y5lEJVYMVtAgLY/H3WEnabw5ZGR/WjxfccdzX4SU7Z/ZgGQ3UgywY709ini/k2DWYyF1OzOPcLKJPSzTcelop60SBhX8ZOIV/LyBQYvbuh4ArJwC3E31IRZpTJOodIK2Fn7MQ/3jwBmT9uWUg4eGHRz80R332qFE4G/X1+E7cCO5wFK1U9cYE7PguyzbpaNx+Eo4tNM2mTRss2/m7H5Bi8O5HqycAjyN9iTmibRIjbQRfOOxrf4Ek+myyMoI/cMS+yEE/uG3jeH9/Z2ZRziZeEzsE6BYInZHu7p0lDCo4CeTxm2QOxCs4MsQTtCt3D549tYDibVIPQSHZdoWfuL89x0j/vZ5/7v3hq1ZUlLCwoULGTVqFCLCqFGj4tKx3V14jMHCg1ixRemo4CuRUJdOkqjZ3kDDV1UUmgIu/OFdfPDBB/YNLsKg479Dc0tzUP3MAfvSVLUi4Rapp01YpmXc/tGcKYARy2/hB7QzEt3tAosnbo8hU2IMyxRRl44SERX8JHHfy2s5c3MtO8lideYY+kwLziOTG2adjF0bEm6RmhTw4bdPbILfkzAe53hieMC6xDt2Qi18JRQV/ASxbPVWXv7Cnwdn2Tvv8tvclTz1eQvVj84MqS8i9gxTgdE3ty9JZJMBx6VDoODHOMdqN2Mk0KWTXjNiur1uGbXwlTiROndumnPXC1/y8JuVPPreeha9/iUl8h8A3t0Y3hIzxlBZWYnH46GysjJpbgiDgCew09bYy1IGSYiFn4wRuh6v4Mfow28hAz57Eiou6KaWKT0VFfwEsbuplQMK9lK/6CrW3n4O+238D+9vdPOb15vD1ne5UsNPbifuSmULP9ClE2Dhv/DLuO3DGyZbVVXly7tfWlra7aLvaXWs9JiidOA+16UwdALUruimlik9FXXpJIhN23ay45PXGJ+5gQnjMjhsmIt/rYqcwdI75D/Z2FE6fiEVTEzZG7sf8bucAix89+rncZ14s79a3Vp/bqJI5A+GwfuHLE7WCF2P82YlMcXhC6/IoTCiFlY+1V1NU3ooKvgJYt/GL/nbuH9x0GR/HPhb60PdOak2KbdBkIAOQAtPTALU7Yj/gbRnbzP5QKVnCCM2rcS9dw+4smF3Ldb8o5DWCAnYHIy48FzzFgy0Rz27nPQRNeursYSQ/P/dPR7CK/jEkMZCROzpHy2XdtwqIajgJwBjDHfmPcR4ayc3PNfEa1WttHjgk03BPudrrrkmZYTeiz3IKjAs02OHaqYIRvw+/KbmFvKBNZn7U+zeBL/d11evxbi4tuWH7Ez3HpUAACAASURBVCb8ZO/ZtDA/8y5y5x0RUtb6f3bCus82u5kw3z/LV3ePhzBu26UjMUXpiP1gEldQ34uigAp+QmjcvpHx1nruWDOaP74d6ldNNas+EI9IiEsnlk7E7sYEhGV6wxgzxp/GW01TocXvhqnL348Jhce1u63nto9kyO7PAPhs404KsjO4aGoRK1asoO6Dpzmh2EWGBa2exIzQdXst9BjmELbEjt9XC18Jhwp+d2MMOfOnAvD85gFBRfFKYdydmDYDr2x/eeoIPuIPG/W6QDKyczny/JvbWysC43yfHl68nMqtDVx07DEcciwsv/cK2PoYfbOFPvsEJ6mrqKjolgR2phM+fMtyXDqio22VUFTwu5uGOqyWPbzvGcfks67myy+/6rbMlt2BCUxdQOzZG7udAJeO8Vq0cRgJ3Dcnk11N/k71KUcdC08/Rt3GSujvd+V0Z459j9s78Cq2OHyPWvhKBOJy54rIqSLyhYisEZEbw5TPEZEtIvKR83dlPPabaoSN1d5eCcC81rM4ZcZxKRFbHwuhYZmpmEvHEXxHIGPJPROJvrmZwfMAZxXY/518Rl7ai+DpKsYZPCUxuHRcVqAPXwVfCabLFr7YPUr3AScBNcB7IvK0MWZlm6qPGmO+19X9pSqRLL1Rd5byTWC92YeC7J73QtU2eZqVwnH4HhNHwc/JZE+zm1a3hwyXBdnOTGPNwYLfnTn23e7YR9qKgFujdJQIxEOBjgDWGGPWAYjII8BMoK3gpzXXX389DQ0NCHDuYYPom5cFwLbl/4IRUGMGU5DT8wQfaevS8aRWHL5Y9kOIQJ93199A+uXa12pXUysD87MCLPzdQfW6M8e+73hieIC5ROwpHr3XyONJqU52JbnE45cwHFgf8L3GWdaW80TkYxF5TERGRtqYiJSKyHIRWb5ly5Y4NK97qaioYNCgQb6ZqY48eDiPndnMgzPqeXBGPWeN2MlXniG0uHIZ0jdxE3/Hi8AoGEi9KJ3A1ArG+2CKhw8/NxPA79bJdgS/jYUfKcf+aaed1uVUDP7UCjHmw/cY/zlQK18JIFF37jNAsTFmEvA8sChSRWPMQmPMFGPMlMGDByeoeZ3D68apq6sjw4LxgyxGD7In977i40M46KlxHL1sGltLXuDdX5zIoILETfwdL0LSI6dklE5wWGY8LPy+OY7geztuvS6dNj78cDn2Z8+ezaJFi4JSMcyaNYtBgwbFJPzeTujYo3TwP5TVj68EEA8fwwYg0GIf4SzzYYypC/h6P3B7HPabHLat8+UoeWPhTzh9PyFr8MFce0AdRw5uALYCsK5qI6s+WsuSJUuYekBqTqEXDUYsOzLHwYWJiwUdNwIF33kwWTFYxJHwWviPf7CBFet3kN28nW9DiIUPoTn2i4uLQzpyAerq6mKK4OlclI6zLi77sawWvhJAPAT/PWCciIzGFvqLgEsCK4jIMGNMrfP1LGBVHPabHB6ZBZvtwTnzjgdwAevxGGF500im5NjerVaPobCwsEdE4rSHwcLyioYTDROPTtG4IfgeSJ5OdHJGYuTAXLJcFg+/WQlAFi18Owf27NpOfgfrttdhG0sOHuNY55Yr+tvU5bzd+PpZ0myOAKVrdFnwjTGtIvI94Dls9XvQGPOZiNwKLDfGPA18X0TOAlqBbcCcru43Keysgc2fsSz/W/z4HyvZu7eZ/sdcinvXVrbVN3H+uFamON0ZGa4M7r777iQ3uOsYEWibfjiFwjKDRtrGMUpnWL9cPrzpJBpbbNGt3LqH5odcvPzJOt6q/ySkfkFOBtccO5b+eVkRO3K9RBvB4/Phx3C+LauN4KtLRwkgLmEjxpilwNI2y24K+Pxz4Ofx2FdS+eo1AH617Vi+nnEpANuBumX3YOX2xTN+qK/qnMuv6PHWPTiC2nbO2BSL0pE2UTq3334H/zrh7C4PbsvPziDfCaUtzM+i3pXP3t3beO6z0Kyb2/Y08866bYwf1pepc/9A42uv0doafhKSPgV9+PnjwQ+NfrmZ/Ojk/cl0+c+tP0ontk5bwD/xuVr4SgA9ME4weZhNK2k2maxYVcmOD+bbCz2t7N34BfkHH4cHf7Kubx59bJJaGWcCwzI7MQNTtxPQx/Deu+8wBqjbtj0obz10fdSriNBn5ETOa93Ged89KaR80ZuV3PfyGjbsaAT6MnjyDHbt2uXPeBmwnYJ+/Xhh1SbfMrfHsG1PM0eNLeSY/f2BCl4LP6ZOW58PXy18JRQV/BjY+/UqvjLDyKnfyN71wRaau34brfgtMStFJjDpKiYg/TBxDHuMGwGpFZ7997+58EiCRDaueetHTIW37oNV/w556M0eCLPPC1ziAgbwyquvsmTJYrZs2cLgwYOZNetSjjv2WF559XmWLFnMtq1buejwAeSPPoQn37uVva3+tm+r2c7BxD7SFgJ9+Cr4ih8V/BjYu3Ela0wRl19wBr976/GgSIzM1gZ78miHWDraUhkTOKdtqrp0nAfSjp07gG7MWz/6aHjjLng0+ofHccBxMwDygD1QuwAeWRCwPBdoAt5h4afv8N1P/AFtB8tXXJgN+U6IaDR4XTpq4SvhSA9VSgA7d9XTp6mWteYbXFtyNmMLWoMyJN5060189vnHvvrpZOFbjtAb47Zns02pKB3xuXQKBw4A6uzkYQHELW/92Blw7bvQ0tilzZx+xhnU1tb6vg8psPhPSR5DVzxA+V9e9y3P2dIHnoRRhX2i3naGyxZ8NzrwSglFBT9KVny+imPEcOI3DqewIDsk9hrg2YqtsNr+bFnRW2UpTUCcu9vtIYPYfMrdj4UldvtOOfUU2LbGTg/sENe89SIw+IAub+Y/H2200x84DM6zP2fVfcGE4f38FY0zgjcGl06G8zD2aJSOEoZUunNTkpc+38SB//cf7nvSjtDZf1zkGz4/J8v32XKlx6k1AXPGdmaO1W7H56s2TJ50CAADBg70jXpNxfkG2r5xbG0wNLsN44f3D67YiTDYDMeH32okeBuKggp+CG1THC9euoymFg8lB9kvQ1kDI7sHxPK/MLky0sjCd0TD40y5l1rJ0wKEzXFf3Hbb71I6BXXb/DsG+LoeDh83LOi397/n/mtXiOF8e1066sNXwqEunQDCpThe+sKrDDz0JM4qNrAG6LtvxPUDBT9tfPgBA5t8YYIp5cP3jyg1ju/eSqX2hcH7EArsA2rJdXGoax3vXWCAfKCOzDW/hxwBK4aRtj4LX6N0lFBU8AMIN5nF1AE7+b38GN7YC9l9/Um0wiABkTlWDDdpKhOUb94Tvxml4oUEWPieTswBmyza9gFdetRwvjGgJaSeldOHa4YfHvV2vQO31MJXwpEeqhQnwoXvnTzwa8a6NsOYmTByWrvrBybtcmWkx6m1o3Rs0fBGv6SShW8CfPi+5Gmp5HKKkoq3a1liTJiSJq7N6RP1qGG18JX26Hl3RpwJ9NmHcwWMzq2nuqUfXPAwfOOadrclrsCBV+kh+IFROvFMThY3nLYY4/ZZs6n0QIqW9kJHA0cNd5ReOdMXlqkWvhJKz7sz4ojXZ+/NW+6bUi6A0Vk72JkzIqrtBbp0XGniwycgSsekoqA6gu/x+H34sYxMTRXCTaTSlmjmynU518YZMaFROkoQaWKGdo5wPnuA2adMYljfDPJycxnt+pLP9zkqqu25rEALPz2idIzlz1XjdibVTiUL3+vD93j8UTqp3mkbjrYduSase6fjUcOZbV06auErAfRqwQ938xQN6c/D36gMXjhialTbkwCRTxcfPgTk0vFa0CnUaRtk4ccxPXIyCOzILS4u7tRcuV4fvtsXh6+Cr/jpmXdGF+jIZz9kQC4Ab0/+Hbt+sI49P6ri8DNKo9p2oN/elVZROraQun3ZG1MnH77Ph+/xBExxmEIPpE4Saa7cjkYNZzhROr6BV2rhKwH0KsGPxmc/fKA9n1HGwJH07V9Ifp/+IXUiERSWmSYjbe30w8E+/JQKe/RZ+G6fG6QnunTaEm6u3GhGDfs6bTVKRwlDepihUVBRUcHs2bODRN7KzKa4uAjLsvB4DFnZ2Vx6wYmw4wEy+sQ+gborlYQwXgTkm/d0YkKO7sbnwzfG30GZBoIPobH60eB16bRoagUlDOlxZ3TA3LlzufTSS0Ms+ge+O5m1l2xi9UW1rL3ka145bzcHFduzVmX3jV3wrbTx2/sJdOn4Z2BKRZeO2yduVoq4nNqm6egopDIeeAdetXqjdDwq+Iqf9FOoNjy0uIK/VPwLq2AQWS7D8ALoO3wsNx2Xw8ycD/n39iJe35DB+d88kKk7lrJnyyd4jJDTpzDmfaVLZE4QQRa+14efOha+T/Dd/k7bVAiJDZemI16zb7WHv9NWXTpKKGkv+L9dtoPJ19xJJm4WZf2OcdYGYBUAT24ZyfVPbuY3t/+BHYX58PZSBm5dzk7ygzJfRksqCE3cCbLwY59yr7vxu3Q8nZoDtrsIF/Ib19m3IpDpuLNaPBqWqYSS9oL/+OB5TMio8X3/xSdFbNyTweovv+Sd6s9ZtGgRJSUlvPDB5wD037uRtWYYQ7NjPzVpa+GbYB9+KuXS8Y+09fvwUyGKKFK8fNxm34qAyzfSVsMylVDSXvCHWjt5Y+dg/vp6NavrPLxc+Slgi8LixYt91lZB/8G84zmQQ621LDcH8O2s2EXNlZFCQhgnDKFROlYK+fC94m48gakVkn8dioqKOhVH31W8A6+aPRqWqYQSl3dzETlVRL4QkTUicmOY8mwRedQpf0dEiuOx32hwiWFV40AWvt/Cy5X+OPKrr7466NV6YH4WFzbfxNFZj/Ara26nrERXGlr4YoVG6aRSWKZx3jY8JjAsM/nt62wcfVdRH77SHl0WfLF78O4DvgUcBFwsIge1qXYFsN0Ysx/wR+B3Xd1vtFhiGDFiZFA88+LFi5k3b15Qvf55tlhv2rWXvE5Y95BGCdMCCIzSIYV85F78Fr7fpZMKYyA6G0ffVbwDr5qNRukoocRDoY4A1hhj1gGIyCPATGBlQJ2ZwC3O58eAe0VETKSEIXFEjGHAwEIqKyvbrdc/199JW9AJ/z2kUzqFAAKjdEzqJU+TwJG2vlw6qfFA6kwcfVfxD7xSH74SSjzu3OHA+oDvNc6ysHWMMa3ATiD2uMdOYGGiGoiTlWH5rPx+eZ1zzaSjhS/i8gl+Kkbp+EbaGk9Arp8Ual+C8Q+80igdJZSUUygRKQVKIT4dXIIn6jlY779sCms21zO5KPp0CoFkpKHgG7GwxNgTjLhTMDmZFWDhO66ndEit0Fm8YZnNXk+OWvhKAPFQqA3AyIDvI5xl4erUiEgG0A+oC7cxY8xCYCHAlClTuuzysa3T6ARgSvFAphQP7Py+0tKl44+C8Xh95CniMoFAH74HTM/Nhx8vLEsQ0fTISnjiYQq9B4wTkdEikgVcBDzdps7TwGzn8/nAS4nw34Mj+AmKy85Ixygd5+3I7Xb7k6elkMtEAix8X6dtCoWNJoNMy/KHZaqFrwTQZZPUGNMqIt8DngNcwIPGmM9E5FZguTHmaeABYLGIrAG2YT8UEoLgSZhAuTLTT/C9LhNPQPrh1LLwA7JlelIntUIycVlCq0ejdJRQ4qKExpilxpj9jTFjjTHlzrKbHLHHGNNkjLnAGLOfMeYIb0RPIrAt/OgOs6vJrjLS0qUTmH44taJggIBrGxCWmUrtSwIZLlELXwlLGiqUH2NM1IIfj2RXaWlZegc2edy+OWNTK/1wwEjbFEqtkEwyLFEfvhKWVLpz447xGDvCJArBby/ZVbS40lBogl0m9py2qWRBeztovbl0PEZ6dZQO2IOvmr09ZGrhKwGk9Z3hjSqJRvDjkewqHTsLjYTz4afOcUpgHL7x4EFSJh9+ssi0hGa35tJRQklvwfdEL/iRYv67O9lVquMbyep2B0wSnjoWvi9s1B0o+EluU5JxucQ/p20ECz8Zk7MoySfNBd8bRtixAiQr2VWq4w17PO64Y7n9d3YKpGXL3khmk4LwhWU6Fr7B6vU+/EzLosn2vtHa2sreVnfQ36LFFZRePZeqmg0Yy+Xrr1LRT3/Su9PWO6VhFPnbvR2zZWVlVFdXU1RURHl5ecJzoaQaVdXrmQbUfl3LwUPtt5158xeQ2W/flDg3gbl0vBZ+bycrw+Lfn27i3hyY99Ln/OF//21Toz+Dr/2b79uu955k+0v3M3u2PVQmFa5rT6CioqLH6UVaC34sFj4kJ9lVqvPRio/59jiYe9I49htg9wQ2NTV1+8xN0RJs4RsVfOCXZx3M8qrt7HmrkBOHGlwHHBBUXvaLX+Dt080bN438g45l+0sP4Ha7EzINYzqwZPFi5s6dS0NDA5YINevXc1XpVUBqn7teIfi9OZlWV1m1vg7GwU37rwagyWSyaVs9W7bvTnLLHNqkVjDp7aWMimljCpk2phDW7cdBrm0cdPx+QeV31L7rm5zFvWsLg878MSNv+Cfu+u3UPvx9Zs2aRVlZWY+wWJPBp288w4VrrmfWjyygwLd8XesgTkgRQygSaX13eJzsDdEmT+sqgT7QdOkI+7C6kf5/aGWfe2Cfe6Dw9no2b9uVMp3Z/rBMdemE0H8UbA+ddSuwv2rPF2+wY1kFDV+8SeaAYWQPHw+gfv12aKhdTaa4+dP6/fn16nH8evU4Xt8zijEZW1lfvb7jDSSRtLbw/VPedb/gewdulfzEPqWdGbiVipSXl1NaWsrO3bt8y1KpM9v39mbcTqetCr6PAcXw6WPw/qIgt2bJeBh7x2weePBBO5Kt4TFkbwYDJxp2HzuaJa0N1K//nIaGBvXrh8E7HuV3z6xh45YdAPzqksM5ehyMLk4NQygSaS34sYRldhX/wK2+vmXegVs9+WZJ9c5sb8y9d+CVCn4Aww6xRx8/8/2Qom8A3zgju83SB2AU9LlkDr//w1eYlr3t+vV7YqdlXHAEPyPTP2mS2+kUufnmm5LRoqhJc8FPXHZH7wCt9xpH8MH2XOD9oOU9mZTuzG4bpdPLQzKDGH8G/Hg1uJsjVnniiSe4/fY7qNlQA64MXr28H5fmvULdcWN48PlVgG24zJo1izfeeMM3NWg8UpH0VLxZY2/91a+5+dZyqquryczOBeDcc89JZtM6JL19+AkUfK9P+4jbV3L1X94PWa50EwEjgQWPdtq2pWAf6Dci4t85c67jrZXV3DZvMdv2ZvLX9+uZaFXywFEbKO4f/PCcP38+J554IhCfVCQ9FXF05ZzzzqOyshKPx8MJznlxu1N7ZHN63x0JnPJOB24lB1//jDEaltkFvJOu//r1Fn641bZSs1xC29k+X3zxRSoqKuKSiqSn4rXwXYEz3DljfYy7NRlNipr0dumYxFn4qe7rTlesMCNtlc7h/a2+9uJTAFw9JZMffiObFV+7WbPNn1fftfRallxYSLZ7DwCbGwzXLW3CbXrJG63jw3dl+J+G3mgxtwp+8vAm+0pUHH5K+7rTFP9IW43SiQclJSVsW/8JNMHYAbaIteBi/8H+0eoTBxugmdr6TFo8UNQX/vS+RfUuescbbTgL3/KnEU9l0lrwPV5/Wi9Pl5vWBFj4onH4cWHy+HHwIeQOGk6j2c75/R8OKr/XfTdnuN7hyszfUCg7+Su/Y/ycX3NJ8b6UlFyYnEYnEuNY+IFJBL3zRqS4Dz+tBd83YYeOtE1bxJsnyRhAR9rGg+xM+5zmFRTgYQd1/5sfVF6aYXFk4cFceNPpFO78FN6GAbKb4kO+kYzmJhzxuGkxLjJd/t+a5Vj77tbIEVGpQHoLvkncwCslOXhz83tz6RgNy+w6joE0sF8fPI1C/YfPBhXXA++PGsW/jiyGbcYR/Hq21ae22MUNjxtPW8PC69Jxp/YcwmmthJpLJ/3xXVuP7dJRC7/reM+pZdyAtB99ljsAgCGZjWzbszeRzUweppXWNr8z8fnwU7vTNq3vDuMbaZtCE3Yo8cXyznhlAPXhxwPvG7EY25JduHAho0aNQkQYNWoUCxcu9Acn5PQDcTEss4FtDS1JbHXi8J6XIKye4cNPb8H3TnHY26dASmMsXy4djzOJuV7rLiNewfdgRCgpKfENMKqsrAyORBOhycqF7VX886mlaZM0sF08btwEG5G+JH5q4ScPf1imWvhpi/dh7nH7BErpGl4L3zLuDt+YKioqqNq8mz6t27Hy+vWKLJti3HgkgksnxS38LnXaishA4FGgGKgEvm2M2R6mnhv4xPlabYw5qyv7jRbj8+GrCKQrlneEoxOlE/KqrXQC+36xcHfYJ1JWVsb9x7iZNmIDZTnLaJ4zBYCdr8/jq8n7Mfrgad3e2kQjYS18W0o9KT7wqqt3x43Ai8aYccCLzvdwNBpjJjt/CRF7AI/PpaMWfrritUZXrVrF5q9raWxq7h1uhW7E+0ZsGXeHA9mqq6v5yfNNuN2tXJn9PHOL1tl/Qz+l7rk7EtHcxGPCCL6rZwh+V8MyZwLHOZ8XAa8AP+viNuNHgkfaKonH+/b28ksvct7+Hgy9K3NjdyCOm8wK1znZhqKiIj6qqmLE7XVBy9+5cSIFezd1WxuTSbhO294SpTPEGFPrfP4aGBKhXo6ILBeRt0Xk7PY2KCKlTt3lW7Zs6VLjvJ22Kvjpi/dGO/8ADwfm78ZjbLHqLZkbuwXnnNounfYt/EhJA5tyh9CnpS7CWj0b8bhxt+kXtLxehBT34XeohCLygoh8GuZvZmA943WihmeUMWYKcAlwl4iMjbQ/Y8xCY8wUY8yUwYMHx3IsIXgnQNGBV+lL/8HDqXX34/g+69nXtYOPd/nnGO0NmRu7A6+B5Iqi09abZbNt2GZGYTEDPXVUVFRQXFyMZVlp42pr38JPbcHv0KVjjDkxUpmIbBKRYcaYWhEZBmyOsI0Nzv91IvIKcCiwtnNNjh6TwHz4SnLo028gExdbVFVtc5Zs85X1isyN3YDXTWbhxh2FEyBc0sBliz4nf0sTN1w3l83b7ekxq6qqmDVrFg899BAvvPBC/BueIGzBj9Bpm+YunaeB2c7n2cBTbSuIyAARyXY+DwKmAyu7uN/oUJdOr0DnIogv4nPpeELCD6PF6jsMgP32ybG35/1DePHFF5k7d268mptwxIS6dMTlzYef2qkVutppexvwDxG5AqgCvg0gIlOAq40xVwLjgT+LiAf7AXObMSYhgu+Lw9conbRG5yKIL14L32XcnR7X4BpxKM0fuXjjoiaaTH82mkIMwhZ3Aaf/dxBLln3JiR/UMHlkf8YMLuh4gymEmNBwVW/ytFQfeNUlwTfG1AEzwixfDlzpfH4TmNiV/XQWjcPvPehcBPEj0MLvbG6iQw+dxvm/msbUgs0Mym5hcNZeRuQ08o0BtUw6+Wq+MsO44R8rOGL0QP5x1ZHxbH63E87C9wt+D/fh92TsfmQ0Dl9RYsDXaUvnJ5TJyrC48MJZzJo1y7fs1P0y+E9JHi1P/oLazVmU3PkEX23dE5c2JxLLuDERRtqm+hSHae3cNpotU1FixhvV5qLjKJ32KCkpYcYMvwNgW6NtgPVt3c4VF57F8P65bG/oeSmV7Yl2wodlpnqUTloroS8O35XWh6koccVv4YdasrHywgsvcM011+ByuahrsO/Hb585g3nz5jEgL5OdjS24PZGiubufzoSNWrTiCXHpON9T3Ief1kqY6DltFSUd8I60dUWRWiEa5s2bR2trK2tqtgIw59v2EJ4B+VkYAzsbk5NWuaKigtLSUqqqqjDGRJ34zTLuUMG3eoYPP62V0Gfh68ArRYkeR8xcEucpI3P6AQKNdn7FgflZAElz65SVldHQ0BC0LJoR2mI8oYKfoYKffDQ9sqLEjBVgIMU13bTlgtz+0GAPjuuf5wj+nuQIfqSR2B2N0Ha1G5apgp80dE5bRYmdQBdoPFw6QeQOgK8/ho//wZiNzzJaanl+5Sa27E789IiRRmJ3NEJb8GCs8CNtU13we0VYpvrwFSV6JGCGuLjPETxgNKx9Eda/w0jg/qx9mfHaUOr3tlJ+TmKH65SXl1NaWhrk1olmhLYVJrWCdtqmAL6wTLXwFSVqAl2gcZ9B7KIKuO4D++/EWxgrG3mwz1/I/fq9sNW7M/lapMRvHQ3gs3Bj2riJXerSSQGMplZQlFgJvF/ibuFn5kLhWPvv8DkwZCLTW9/i6s2/8vn2vYSLopk1axaDBg2Km/C3O19vBCzjxljBzhHfOVPBTyKaPE1RYsYKdOl0Z1qS3AFwzTKWjriBQWYbPHxGUHG4KBqAurq6pM6ba5nQlBNq4acA3jh8S106ihI90o0Wfhg2jj6Xpe4jYPNnsMMfIdNetEwyJ7ixcId02loZmfYHk9qCn+adtk6qUg3LVJSoCbTwiXeUThiG9svj963f5jTXu9TMP5unBl/F5/lHUHTWD6h6+m7KSw7lwAFh0g4LvH/nOSGLd7sG0HT8Lzn1kJHd0l5XWB9+z3DppLXge106wT9gRVHaI7DTtrP58GNhSvEAcoYeyH17ruDavQ9w9MaHWZK5Hxw4gwOrl/GLsV+wydOXendW24aSVf950KIsmhlitvKD56Zy6iHXdEt7LeOJ2Gmrgp9ENB++osROsAu0+42lUYX5LL3+aOBo+F8+k95ZwBPn96fkwfc5Z+YUMF8w86ks3vl4nW+dvLy8oIiaiooKysrK2LNlPVt+UkDxrnfZ0XCFb3BXPAln4Vtq4acAOqetosRM4P0S94FXHTH6GHjzTwytOIEXswEDu0wec390M1/fdFPYCW680TzeDt6P6jL5QeHjcPvjMe9++cDTmfL9v7Vbxwoz8MrXaas+/OThy6WjPnxFiRrvdH32lwQbS2NnwMWPQPMePv96N2u37KH/yIO47OgTuOyyy8Ku0jaa55yKHcw+eQID+hZwxLRpUe+6/8bXOGD7q2AMtBOd5MKDkWDpVJdOKuCLw1cfvqJEixCYSyfBgm9ZcMC3ADhwCQuM+wAACzdJREFUIhwYxSpto3kqt7v55aMrEBE8C5dFvet//aWc8Rtuh8plMProyE3EY7czALEs3EZSPkonvX0dOvBKUWImKA4/0S6dTtDZnDht2TV4iv1h0RnhLfUd1bD6eTJoBQm1ld1YKW/hp7XgG1+Ujgq+okRLkA+/BwxaLC8vJy8vL2hZNDlx2qZteL9qF39vPd4u3BFmDMDfLoSK88nAQ1NG35BiD5Za+EnFO/CqB/xoFSVVkAQPvGpLrPlzOpMTJ1zahofm381j7mPsClu/DF6haRdsXgVTr+QCz29YPuTCkG16sBC18JOId+CVRukoStQEhWV2Z2qFMHR2FqpYc+KES9vg3rODNWY4AE/9uoSjijI4d+oInrv/V/DZ44CBcafwsWcMkpkZsk03ll9zYqA7E8S1Ja2V0O/SSevDVJS40q3J0zqgs7NQxUq4tA2tOzezkwLWeYYyc0wLb16ez+On7+aUmt/DM9fT6jEcftaVtLrduMI8CD1iIe2kRw4n7J19wHWWLkXpiMgFwC3AeOAIY8zyCPVOBe4GXMD9xpjburLfqFEfvqLEjBUoZgm28Ds7C1WsFBUVUVVVFbTMvXsLW5/9I2eeXs6E+rexWoIfPFuzhrHl9IOxjLBq5WdwanAMkQcXO3Zso7i42Dde4LTTTmPp0qVUVVUhIr45OrzCPnpQDvv1aYI+gQ/WJh6+48aoMnfGSlfDMj8FzgX+HKmC2A7B+4CTgBrgPRF52hizsov77hiN0lGUmBFX8gZehRNi7/J4Ul5ezqWXXuoTYC97Pn2RjQNHsHXIaKBPUJmnuYHWnf8Gj5uXt34KN5wXVN5qhKF7vuCqowcBg+xnZf27XH3MIIRBQPDzMy8Drh6xlgwpCGnfZrcJWRYPuiT4xphVANK+FXAEsMYYs86p+wgwE0ig4KtLR1GiJeiNOMEBD52dhSpWSkpKeOONN1iwYEGQ6IsIO15b1OH6O8No3pdNA5me+xWHjO14/x5jr//W3mLmr94HCBb4jKwcHu54MzGTiIFXw4H1Ad9rgIjD30SkFCiFrj/V1YevKLFjJTEs0+vGKCsrC5tGIZ7MmzeP6dOnB+3rtNNOY9GiRWHz8AcSTpuOvuPjIN02dGylFxbW0Ni4OuQBt3DhwugPJAY6FHwReQEYGqaozBjzVLwbZIxZCCwEmDJlStfea1TwFSVmrCR22oIt+t0h8NHua/r06Vx//fXU1dWFXSfSG0ckd1Qk8vLyuPvuu4HEPOAgiigdY8yJxpgJYf6iFfsNQGBi6hHOsu5HO20VJWaCUpEkuNM2FSgpKWHr1q0sWbKEUaNGAf589+3F+IcbANYWr/s7cDudmWaxsyTCpfMeME5ERmML/UXAJQnYL6LZMhUlZoKSDfbiQYuxvmmEc0d5o3QSYb1HQ1fDMs8B7gEGA8+KyEfGmFNEZF/s8MvTjDGtIvI94DnssMwHjTGfdbnlUeBNVaoWvqJET2BYZk/IpZNKJNId1Rm6GqXzBPBEmOUbgdMCvi8FlnZlX53C6X1XwVeU6LEsC48RLDE9IpeOEj1pdzUDR7O98/abgHbaKkosiIDHsew7CLlWehhppYRthyk3720C4G9//3uSW6YoPQcR8Ql+MqJ0lO4jra6mNw/HnXOm8KfLD+eEYQ24jcQ9D4eipDs+3726dNKKtJrxyptvY/bIjeRKMwAf7t2X6urP21tNUZQ2+AVfXTrpRFoJvnfgw6BfbQxYutUXS6soSnR4nJd/7bRNL9LqanZ25htFUYJRl056klZXszMz3yiKEorHF3+fVhLR60krlw6k/sAHRekJqIWfnujVVBQlBCPaaZuOqOArihKCv9NWBT+dUMFXFCUEdemkJ3o1FUUJweOTBpWIdEKvpqIoIaiFn57o1VQUJQQV/PREr6aiKCGo4KcnejUVRQlBBT890aupKEpkVPDTCr2aiqJERsPw0woVfEVRIhI0obnS41HBVxQlIjrSNr1QwVcUJSKiPvy0Qq+moiiRsVQi0okuXU0RuUBEPhMRj4hMaadepYh8IiIficjyruxTUZREooKfTnQ1H/6nwLnAn6Ooe7wxZmsX96coSgIQDKBTHKYbXRJ8Y8wqANGOHUVJS9SHn14k6moa4H8i8r6IlLZXUURKRWS5iCzfsmVLgpqnKEpYVPDTig4tfBF5ARgapqjMGPNUlPv5pjFmg4jsAzwvIp8bY14LV9EYsxBYCDBlyhQT5fYVRekGxNK393SiQ8E3xpzY1Z0YYzY4/zeLyBPAEUBYwVcUJfloLp30pNuvpojki0gf72fgZOzOXkVRUh0V/LSiq2GZ54hIDXAk8KyIPOcs31dEljrVhgDLRGQF8C7wrDHmv13Zr6Io3Ys3Skc7bdOLrkbpPAE8EWb5RuA05/M64JCu7EdRlCShgp9W6NVUFCWIiooK3G43AP/852NUVFQkuUVKvFDBVxTFR0VFBaWl/sjpnbt3U1paqqKfJqjgK4rio6ysjIaGBpqNnRbZGGhoaKCsrCzJLVPiQVdTKyiKkkZUV1cD8H/v5nPWAQN4/qOqoOVKz0YFX1EUH0VFRVRVVbHk+U9Z8nzwcqXnoy4dRVF8lJeXk5eXF7QsLy+P8vLyJLVIiScq+Iqi+CgpKWHhwoWMGjUKEWHUqFEsXLiQkpKSZDdNiQNiTOqmq5kyZYpZvlzT5yuKokSLiLxvjAk7P4la+IqiKL0EFXxFUZReggq+oihKL0EFX1EUpZeggq8oitJLSOkoHRHZAlR1cvVBQG+bNF2PuXegx9w76OwxjzLGDA5XkNKC3xVEZHmk0KR0RY+5d6DH3DvojmNWl46iKEovQQVfURSll5DOgr8w2Q1IAnrMvQM95t5B3I85bX34iqIoSjDpbOEriqIoAajgK4qi9BLSTvBF5FQR+UJE1ojIjcluTyIQkQdFZLOIfJrstiQCERkpIi+LyEoR+UxErk92m7obEckRkXdFZIVzzL9MdpsShYi4RORDEfl3stuSCESkUkQ+EZGPRCSu6YLTyocvIi7gS+AkoAZ4D7jYGLMyqQ3rZkTkGKAe+KsxZkKy29PdiMgwYJgx5gMR6QO8D5ydztdZRATIN8bUi0gmsAy43hjzdpKb1u2IyA3AFKCvMeaMZLenuxGRSmCKMSbuA83SzcI/AlhjjFlnjGkGHgFmJrlN3Y4x5jVgW7LbkSiMMbXGmA+cz7uBVcDw5LaqezE29c7XTOcvfay1CIjICOB04P5ktyUdSDfBHw6sD/heQ5oLQW9HRIqBQ4F3/n+79u+qcxiHcfx9LUrHYJHUoxhklcFyTAYhmQ1MysJgUv4J+QdsROpQSuGUsyhFpw4l/gBneSaZcRm+92A52/d+7rrv61VPz4/h2/Udnqu7z/fTNkl9ZbSxAyyBTdvd3zPwALgL/G0dZIUMvJW0LenmnBfurfBjIJIOABvAHdu/WuepzfYf26eABXBGUtfjO0mXgaXt7dZZVuys7dPAReBWGdnOorfC3wWO/vd9UX6LzpQ59gbw2Pbz1nlWyfZPYAu40DpLZevAlTLTfgqck/SobaT6bO+W9yXwgmlUPYveCv8TcELScUn7gKvAy8aZYmblAeZD4Jvt+63zrIKkQ5IOls/7mRYTvrdNVZfte7YXto8x/Zff2b7WOFZVktbKIgKS1oDzwGzbd10Vvu3fwG3gDdODvGe2v7ZNVZ+kJ8AH4KSkH5JutM5U2TpwnenEt1Nel1qHquwIsCXpC9PBZtP2EGuKgzkMvJf0GfgIvLL9eq6Ld7WWGRERe+vqhB8REXtL4UdEDCKFHxExiBR+RMQgUvgREYNI4UdEDCKFHxExiH8OUALSwgg2wgAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "from sklearn.ensemble import AdaBoostClassifier\n",
    "from sklearn.ensemble import AdaBoostRegressor\n",
    "import numpy as np\n",
    "import matplotlib.pyplot as plt\n",
    "# Create a random dataset\n",
    "rng = np.random.RandomState(1)\n",
    "X = np.sort(5 * rng.rand(80, 1), axis=0)\n",
    "y = np.sin(X).ravel()\n",
    "y[::5] += 3 * (0.5 - rng.rand(16))\n",
    "\n",
    "# Fit regression model\n",
    "from sklearn.tree import DecisionTreeRegressor\n",
    "clf_b = DecisionTreeRegressor(max_depth=5)\n",
    "clf_1 = AdaBoostRegressor(base_estimator=clf_b, n_estimators=10, random_state=0).fit(X, y)\n",
    "clf_2 = AdaBoostRegressor(base_estimator=clf_b, n_estimators=20, random_state=0).fit(X, y)\n",
    "# Predict\n",
    "X_test = np.arange(0.0, 5.0, 0.01)[:, np.newaxis]\n",
    "y_1 = clf_1.predict(X_test)\n",
    "y_2 = clf_2.predict(X_test)\n",
    "\n",
    "plt.plot(X,y,'o',color='black')\n",
    "plt.plot(X_test,y_1,label='10 estimators')\n",
    "plt.plot(X_test,y_2,label='20 estimators')\n",
    "# Plot the resu  et\")\n",
    "plt.title(\"Bagging of Decision Tree Regression\")\n",
    "plt.legend()\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Gradient Bossting\n",
    "\n",
    "Es un algoritmo de Boosting que aproxima el problema en poco diferente al caso anterior, en lugar de ajustar los pesos de las muestras, el Gradient Boosting se enfoca en la diferencia entre la predicción actual y el valor deseado (ground truth). El modelo global se define de la misma manera que en el caso anterior:\n",
    "\n",
    "$$F({\\bf{x}}) = \\sum_{m=1}^M \\gamma_m f_m({\\bf{x}})$$\n",
    "\n",
    "\n",
    "Sin embargo, en este caso el algoritmo minimiza el error a través de una forma de gradiente. En el paso inicial la función $F_0 = 0$.\n",
    "La función de salida en el paso $m = 1,...,M$ está dada por: \n",
    "\n",
    "$$F_m({\\bf{x}}) = F_{m-1}({\\bf{x}}) + \\gamma_m f_m({\\bf{x}})$$\n",
    "\n",
    "El nuevo modelo $f_m$ intenta minimizar la función de pérdida:\n",
    "\n",
    "$$f_m = \\underset{f}{\\mathrm{argmin}} \\sum_{i=1}^N L(y_i,F_{m-1}({\\bf{x}}_i) + f({\\bf{x}}_i))$$\n",
    "\n",
    "Es decir, debe entrenarse usando los valores objetivo dados por:\n",
    "\n",
    "$$r_m(i) = -\\frac{\\partial L(y_i,F_{m-1}({\\bf{x}}_i))}{\\partial F_{m-1}({\\bf{x}}_i)}$$\n",
    "\n",
    "Estos valores se conocen como los residuales del paso $m$. Por lo tanto el algoritmo de Gradient Boosting tiene forma de algoritmo de gradiente."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "La longitud del paso en el gradiente se estima como:\n",
    "\n",
    "\\begin{equation*}\n",
    "\\gamma_m = \\arg\\min_{\\gamma} \\sum_{i=1}^{N} L\\left(y_i, F_{m-1}({\\bf{x}}_i)) - \\gamma f_m({\\bf{x}}_i) \\right)\n",
    "\\end{equation*}\n",
    " \n",
    "\n",
    "Los algoritmos para clasificación y regresión sólo difieren en la función de opérdida $L$.\n",
    "\n",
    "![alt text](./Images/Gradient_Boosting3.png \"AdaBoost\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Aunque el Gradient Boosting puede ser implementado para cualquier clasificador base, el algoritmo más usado usa **árboles de decisión** como modelos base. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAXwAAAEICAYAAABcVE8dAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjMsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+AADFEAAAgAElEQVR4nO3deXxU1fn48c8zM1kIOyFAWDIRQWULQcKiuKHgVsGtbg0KdYlgq1grSr+oVfuLxfarwheLGlckadVat1bqLtVqXYKigmgFTMK+hJ0Qksyc3x/3zjBJZrJOMsnM83695pWZe8/cc+7M5Jkz555FjDEopZSKfo5IF0AppVTr0ICvlFIxQgO+UkrFCA34SikVIzTgK6VUjNCAr5RSMUIDfgSISJGITLLv/4+IPNFK+d4tIvmtkVcdZThZRL6PQL4iIk+LyG4R+ayV827QObfmZ0E1jIg4ReSAiKRFuizhoAG/BhG5XEQ+FZGDIrLdvn+DiEhL5GeMuc8Yc21zjyMi6SJiRMQVjnKFi12mQb7HxpgPjTHHRqAoJwGTgf7GmLE1d4rIDBHx2P/cB0TkR/sL4pjmZtzQcw7XZyGQ/SXiO6fyGue4Opx5hcj/2oA894nIlyJyTkvnGy7GGI8xppMxpiTSZQkHDfgBROTXwELgj0AfoDcwE5gAxId4jrPVCqiaww0UGWMO1pHmP8aYTkBXYBJwCFghIsNbo4Atwf4S6WSf10zsc7Rvw2qmb6EKw4d2/t2AJ4AXRKRzuDNpa5WdNskYozdrtHFX4CBwcT3pngEeAZbZ6ScBPwG+BPYBG4C7azznSqAYKAXmAUXAJHvf3UB+QNrxwMfAHuAr4LSAfcuB3wEfAfuBt4Ce9r4SwAAH7NsJQcp+N/Ai8Lz9/C+AkQH7h9h57AFWA1NrvD7PAjvsc7kDcNj7BgH/AvYCO4Hn7e0f2GU6aJfpMuA0YGPAcYuAW4Gv7ec/DyQG7L8N2AJsBq61jzcoxHvTF3gN2AWsBa6zt18DlAMeuxz3BHnuDODfQbb/A3ixge9PD+Bpu6y7gVfs7TXP+XZgk/0efA+cEeKzMNV+H/bY78uQhr5uIV6fWucIuOzX9Ab7NVtrbx8KvGO/lt8R8H8BJAIPYn3WtwGLQ+Vtv2fLAx53sfMbFbBtAvCJfZ4rgVMC9h0N/Jsjn/dHgGcCPncG+DnW5/+9BhzvGvu12w+sBy63tx+D9Xn1fYb/XOP1SbcfdwPysf4PioDfABJwrv8CHrLzXg+cGenYVu39iHQB2soNOBuoAlz1pHvG/lBMwPqFlGj/Q4+wH2fY/wQX2OmHYgWZU4AE+x+liiABH+iH9aVwrn2syfbjFHv/cmCd/eHsYD+eb+9Ltz+YIctv51UJ/BSIwwoYP9r347D+4f8H69fM6fY/xbH2c58FXgU623n9F7jG3vcXrC8y3+txUkCe1QI0wQP+Z1jBugewBpgZ8J5sBYYBSfY/Wl0B/wPs4ANk2v+Up9v7ZhAkoAc8N+h+4GpgWwPfn9exAm93+/U8teY5A8diBcq+Ae/b0UE+C8dgfVFOto91m/3+xNf3ujXmHDkS0N6wy90B6IT1hXSVvX+0fZ6+z8Ii4GU7fResys/vQuTpD/j2sWYDhzlSURlgH/ss+zU9GyvgJtv7Pwfux/pMnoL1mXzG3ucL+E/bn48OdR3PLuteYLD9/FRgqH3/r1hfxL7P8IQar0+6/fjPwEtY/wcD7fdkesC5VmJ9ZpzAjcCGSMe2au9HpAvQVm7ANGBrjW2+mtwh7FoCVsB/tp5jLQAesu/fBTwXsK8jUEHwgH87sLTGsd4M+EAtB+4I2HcD8IZ9P52GBfxPAh47sGrPJ9u3rdi1dnv/X+znOO0yDw3Yd33AP/KzQB5W+3jNPBsS8KcFPP4D8Kh9/yng9wH7BtU8XsC+AVg1+M4B237PkeAwg6YF/LOByvreH6zg4QW6BzmG/5ztc9iO9cswLsj74/ss3Am8UOO92oT9i6Ku160x58iRgBZYC84G3q+R7kmOfKmXA+6AfScDP4TI81qsCs4erGBYRvVfC/OAp2s85127DAOxvhw6BOx7jtoBP62Bx+til+NCavwiwQrkjwD9Qrw+6VhfvFXAMQH7fwG8E3Cu3wXs8/2a6VnX+9KaN23DP6IU6BnYDmiMOdEY083eF/habQh8ooiME5H3RWSHiOzFaivtae/uG5jeWG3IpSHK4AYuEZE9vhvWxcbUgDRbA+6XYdXGGiOwLF5go13Gvli1EW9A2mKsWm1PrA97cZB9YNU+BfhMRFaLyNWNLFOoc6r22tW4X1NfYJcxZn+IMjZVP6xmDaj7/Rlg57+7roMZY9YCN2MF9+0i8pyI9A2StC8Br7f9vmyocT7N/SwECnxt3cCEGud5GdZ59sH6pfpVwL5/AL3qOPa/7f+jHli/Bk6qkdcVNfIaz5HPZKkx5lCIcoYqe9DjGWP2AVdgBemtIvKPgIvyv8b6jBeKyDciMj1IPr2wKj+h/g+g9nsCzXtfwkoD/hH/wapNnN+AtKbG4z9jtR0PMMZ0BR7FCoBg1aAH+BKKSBLWz8tgNmDVILsF3DoaY+Y3oUyhBJbFAfTHanPeDAywt/mkYdUqd2LVztxB9mGM2WqMuc4Y0xer5r84sGdOM2yxy1er7EFsBnrUuBjoL2MzXAh8aN+v6/3ZYOffrb4DGmP+bIw5Cev1NFhNFjVtJuD1tnuJDaD55xOyWAH3NwDv1jjPTsaYX2I1V1ZgNe/49nW1P/d1Z2B9Gc8CrhGRjIC8ng7ymv4R6/1PFpHEgMPU+gwYuzrdgONhjPmnMWYS1pfXWuAxe/sWY8y1xphUrC+EPBE5qkZW27F+RQb9P2gPNODbjDF7gHuwgtVPRaSziDhEJBOrGaYunbFqd+UiMhb4WcC+F4HzROQkEYkH7iX0654PTBGRs+z+v4kicpqI9A+RPtAOrCaFgfWkGy0iF9m/ZG7G+pL7BPgUq0Zym4jEichpwBSs5igP8AKQa78ubuAWu7yIyCUBZdyNFTx8vxS2NaBMobwA/FxEhthflHeGSmiM2YDVBPd7+3XLwLpA1+hxB/Zrf5SILMJqjrnH3hXy/THGbAH+ifX56W6/hqcEOfaxInK6iCRgNY0c4shrVfPcfyIiZ4hIHFYN9LB9ji3tNWCYiPzMPo84ERkrIsfan4UngAUikiKW/iJyZkMObIzZgdVU53svlwIXisjkgNd0ooj0NcasA74Bfisi8SJyElYHibqEPJ6IpIrIFPuzVIF1jcQLICKXioivpr4H6zPsqVH2Sqz/5/tEpJP9hfArmvAZixQN+AGMMX/ACmS3YQWqbVg1gNup+x/tBuBeEdmP1Wb/QsAxV2PVGP6MVWPZjdWMEiz/DVi/MP4HK4BvAObQgPfJGFMG5AIf2T9lx4dI+irWz/PdWL2HLjLGVBpjKrAC/DlYNfrFwFXGmO/s592I9Q+yHqvXxJ+x/nEBxgCfisgBrGAx2xiz3t53N7DELtOl9Z1HjXP6J/B/wPtYtbFP7F2HQzzlCqy21s1YFxV/a4x5pxFZnmCfwz6s6yVdgDHGmG/s8tT3/lyJ9UvoO6za4M1B8kgA5mO9xluxmgl+UzORMeZ7rOtKi+y0U4Ap9vvUoowxe7Euek7D+sxuxboekmAn+TVWU8ZnWBdB3wIGNyKLh4CpIjLUGFOE9SvqTqzXtMQ+vu81vQLrYm0p8Fusi+Kh3n/qOZ4T6/3aYh/vRKz/TYBxwOcichDrouwvTPC+9zdgfVkUYfXIWYJ1Datd8HUnUqrNE5EhwCogwRhTFenyqNYnIn8DVhpjfhfpsrRHWsNXbZqIXCgiCSLSHaut++8a7GOH3ZR0lN28ei5wHvBKpMvVXmnAV23d9VjNI+uw2lRnRbY4qpX1xRpfsR+rKeg6XxObajxt0lFKqRihNXyllIoRbXqyoZ49e5r09PRIF0MppdqNFStW7DTGpATb16YDfnp6OoWFhZEuhlJKtRsiUhxqnzbpKKVUjNCAr5RSMUIDvlJKxYg23YavlIqsyspKNm7cSHl5eaSLompITEykf//+xMXFNfg5GvCVUiFt3LiRzp07k56ejrTMss6qCYwxlJaWsnHjRo46quaknqGFpUlHRJ4Sa8HvVSH2nyYie0VkpX27Kxz5xqqCggLS09NxOBykp6dTUFAQ6SKpKFVeXk5ycrIG+zZGREhOTm70L69w1fCfAR6m7lnjPjTGnBem/GJWQUEBOTk5lJVZaysUFxeTk5MDQHZ2diSLpqKUBvu2qSnvS1hq+MaYDziyKpBqQfPmzfMHe5+ysjLmzZsXoRIppdqL1uylc4KIfCUi/xSRYaESiUiOiBSKSOGOHTtasXjtQ0lJsCm6Q29Xqj3bsGEDEydOZOjQoQwbNoyFCxf69+3atYvJkyczePBgJk+ezO7dda4u2SD33Xdftccnnnhis48JsHz5cj7+uDXWrqlbawX8L7AWPR6JtaBDyOlNjTF5xpgsY0xWSkrQ0cExLS0trVHblWrPXC4XDzzwAN9++y2ffPIJf/rTn/j2228BmD9/PmeccQY//PADZ5xxBvPnN2Ql0LrVDPjhCtJNCfhVVeGfBbxVAr4xZp8x5oB9fxkQJyI963maCiI3N5ekpKRq25KSksjNzY1QiZRqOampqRx//PEAdO7cmSFDhrBpk7WE7Kuvvsr06dZa49OnT+eVV2rXIz0eD3PmzGHMmDFkZGTw2GOPAbBlyxZOOeUUMjMzGT58OB9++CFz587l0KFDZGZm+q+HdepkrT++fPlyTj31VM4//3wGDhzI3LlzKSgoYOzYsYwYMYJ169YB8Pe//51x48YxatQoJk2axLZt2ygqKuLRRx/loYceIjMzkw8//JCioiJOP/10MjIyOOOMM/y/0GfMmMHMmTMZN24ct912G//617/IzMwkMzOTUaNGsX///ma9nq3SLVNE+gDbjDHGXvPVgbXEmGok3wdx3rx5lJSUkJaWRm5url6wVS3unr+v5tvN+8J6zKF9u/DbKSFbeKspKiriyy+/ZNy4cQBs27aN1NRUAPr06cO2bdtqPefJJ5+ka9eufP755xw+fJgJEyZw5pln8tJLL3HWWWcxb948PB4PZWVlnHzyyTz88MOsXLkyaP5fffUVa9asoUePHgwcOJBrr72Wzz77jIULF7Jo0SIWLFjASSedxCeffIKI8MQTT/CHP/yBBx54gJkzZ9KpUyduvfVWAKZMmcL06dOZPn06Tz31FDfddJP/C2vjxo18/PHHOJ1OpkyZwp/+9CcmTJjAgQMHSExMDFq2hgpLwBeRv2At9txTRDZirT0ZB2CMeRT4KTBLRKqwFm2+3OhE/E2WnZ2tAV7FlAMHDnDxxRezYMECunTpUmu/iATttfLWW2/x9ddf8+KLLwKwd+9efvjhB8aMGcPVV19NZWUlF1xwAZmZmfWWYcyYMf4vmKOPPpozz7TWbR8xYgTvv/8+YAXryy67jC1btlBRURGyj/x//vMfXnrpJQCuvPJKbrvtNv++Sy65BKfTCcCECRO45ZZbyM7O5qKLLqJ///71lrMuYQn4xpgr6tn/MFa3TaVUO9XQmni4VVZWcvHFF/uDnk/v3r3ZsmULqampbNmyhV69etV6rjGGRYsWcdZZZ9Xa98EHH/D6668zY8YMbrnlFq666qo6y5GQkOC/73A4/I8dDoe/vf3GG2/klltuYerUqSxfvpy777670efbsWNH//25c+fyk5/8hGXLljFhwgTefPNNjjvuuEYf01/uJj9TKdXiYn2QnTGGa665hiFDhnDLLbdU2zd16lSWLFkCwJIlSzj//PNrPf+ss87ikUceobKyEoD//ve/HDx4kOLiYnr37s11113HtddeyxdffAFAXFycP21T7N27l379+vnL5NO5c+dq7e8nnngizz33HGC9xyeffHLQ461bt44RI0Zw++23M2bMGL777rsmlw004CvVZvkG2RUXF2OM8Q+yi6Wg/9FHH7F06VLee+89/8XLZcuWAVbt9+2332bw4MG88847zJ07t9bzr732WoYOHcrxxx/P8OHDuf7666mqqmL58uWMHDmSUaNG8fzzzzN79mwAcnJyyMjIaHKT6d13380ll1zC6NGj6dnzSL+UKVOm8PLLL/sv2i5atIinn36ajIwMli5dWq27aaAFCxYwfPhwMjIyiIuL45xzzmlSuXza9Jq2WVlZRhdAUbEqPT2d4uLaa1m43W6KiopapQxr1qxhyJAhrZKXarxg74+IrDDGZAVLrzV8pdooHWSnwk0DvlJtlA6yU+GmAV+pNkoH2alw04CvVBuVnZ1NXl4ebrcbEcHtdpOXl6djMFST6QIoSrVhOshOhZPW8JVSKkZowFdhFesDhVR4lZeXM3bsWEaOHMmwYcP47W9/69/3448/Mm7cOAYNGsRll11GRUVFs/Las2cPixcv9j/evHkzP/3pT5t1TJ9XXnnFP8tnJGnAV2GjA4VUuCUkJPDee+/x1VdfsXLlSt544w0++eQTAG6//XZ+9atfsXbtWrp3786TTz7ZrLxqBvy+ffv65+BprqYE/HY7PbKKDboalwo3EfFPUVxZWUllZSUigjGG9957z18DDzU98sGDB7n66qsZO3Yso0aN4tVXXwVg9erVjB07lszMTDIyMvjhhx+YO3cu69atIzMzkzlz5lBUVMTw4cMBeOaZZ7jggguYPHky6enpPPzwwzz44IOMGjWK8ePHs2uXteDf448/zpgxYxg5ciQXX3wxZWVlfPzxx7z22mvMmTOHzMxM1q1bx8qVKxk/fjwZGRlceOGF/sVbTjvtNG6++WaysrJYuHAhf/3rXxk+fDgjR47klFNOafbrqRdtVdjoQKEo98+5sPWb8B6zzwg4p+6FSzweD6NHj2bt2rX84he/YNy4cezcuZNu3brhclkhrH///v558gPl5uZy+umn89RTT7Fnzx7Gjh3LpEmTePTRR5k9ezbZ2dlUVFTg8XiYP38+q1at8k+PXHM086pVq/jyyy8pLy9n0KBB3H///Xz55Zf86le/4tlnn+Xmm2/moosu4rrrrgPgjjvu4Mknn+TGG29k6tSpnHfeef4vqIyMDBYtWsSpp57KXXfdxT333MOCBQsAqKiowDfDwIgRI3jzzTfp168fe/bsafrrbNMavgobHSikWoLT6WTlypVs3LiRzz77jFWrVjX4uW+99Rbz588nMzOT0047jfLyckpKSjjhhBO47777uP/++ykuLqZDhw71HmvixIl07tyZlJQUunbtypQpUwArKPu+HFatWsXJJ5/MiBEjKCgoYPXq1bWOs3fvXvbs2cOpp54KWL9OPvjgA//+yy67zH9/woQJzJgxg8cffxyPx9Pg8w5Fa/gqbHJzc8nJyanWrKMDhaJIPTXxltatWzcmTpzIG2+8wa9//Wv27NlDVVUVLpeLjRs3+mepDGSM4W9/+xvHHntste1Dhgxh3LhxvP7665x77rk89thjDBw4sM78GzI98owZM3jllVcYOXIkzzzzDMuXL2/0eQZOj/zoo4/y6aef8vrrrzN69GhWrFhBcnJyo4/pL3eTn6lUDTpQSIXbjh07/E0Zhw4d4u233+a4445DRJg4caL/ompd0yMvWrQI3ySRX375JQDr169n4MCB3HTTTZx//vl8/fXXtaYwbor9+/eTmppKZWVltc4Kgcfu2rUr3bt358MPPwRg6dKl/tp+TevWrWPcuHHce++9pKSksGHDhmaVTwN+BEVjF8bs7GyKiorwer0UFRVpsFfNsmXLFiZOnEhGRgZjxoxh8uTJnHfeeQDcf//9PPjggwwaNIjS0lKuueaaWs+/8847qaysJCMjg2HDhnHnnXcC8MILLzB8+HAyMzNZtWoVV111FcnJyUyYMIHhw4czZ86cJpX3d7/7HePGjWPChAnVFiq5/PLL+eMf/8ioUaNYt24dS5YsYc6cOWRkZLBy5UruuuuuoMebM2cOI0aMYPjw4Zx44omMHDmySeXy0emRI8TXhbFm84fWiFVbotMjt206PXI7oV0YlVKtTQN+hGgXRqVUa9OAHyHahVG1F2252TeWNeV90YAfITrXuWoPEhMTKS0t1aDfxhhjKC0tJTExsVHPC0s/fBF5CjgP2G6MGR5kvwALgXOBMmCGMeaLcOTdXvkuzM6bN4+SkhLS0tLIzc1tdxdsCwoK/OfQo0cPAHbt2tVuz0dV179/fzZu3MiOHTsiXRRVQ2JiIv3792/ck4wxzb4BpwDHA6tC7D8X+CcgwHjg04Ycd/To0Ua1Lfn5+SY5OdkA9d6SkpJMfn5+vcdITk4Omk4p1XhAoQkRU8PSpGOM+QDYVUeS84Fn7fJ8AnQTkdRw5K3CL9T4gIKCAn7+859TWlraoOME63UU7BilpaVcffXVUTEOQak2LdQ3QWNvQDqha/j/AE4KePwukBUibQ5QCBSmpaW11JegCiE/P98kJSUFram73e4G1ewDbyJS7fh1HcPtdkfmpJWKIrR0DT+cjDF5xpgsY0xWSkpKpIsTc+oaH9CULqM1ex3VdQztkqpUy2qtgL8JGBDwuL+9TbUxdY0PaGyX0WC9juo6hnZJVapltVbAfw24Sizjgb3GmC2tlLdqhLrGB+Tm5tIhIY5+nSXobXhaD4an9aB/Fwfjhgxg6Z/uJ/u802DvJv/twbtvJb1H7WMclRzPg3ffWi0tFWVBy3LDDTfgcrkQEVwuFzfccEMLviJKRY+wzKUjIn8BTgN6AtuA3wJxAMaYR+1umQ8DZ2N1y/y5MabeSXKieS6dtqq+OX5K/ngKaQe/ap3CJPWES56BhE7+Tb+fP7/WsnP/LfVy5TWzqi1Pp1SsqmsuHZ08LcoE9otval/4kMfwemC+GwaMgaEXtNAZ2LyV8NZdUHmw3qR//76S858vJy0trV2PaVAqHDTgx4hGzcC56QtY/37jMji0Gz5eBBc9DhmXhqHE9dj1I+z4rtqmKVOnVnt8x8kJxDvh+LzaXwyJiYk88cQTGvhVTKkr4OuKV1GioKCA6dOn4/F4uHSYi+NTnfYeD/tf+hX0+v5IYmOg8GmoaMJiD/GdIf3ksJS5Xj2Osm4B/rnOVFvq7bJhLk4cEPxjXF5ezowZMwA06CuF1vDbvYKCAmbPnk2vbvHMPy+VLq5KTutUzGGvEy/iT+d0Vr8+v9vZk//t+f/Y6erVqPy8OPGKs/6ELWTNmjXVVv35fe93uKDTKpJ/H3rcn9vtrrUgtVLRSmv4UaKqsoJvHphCl4ptAHg8HjIrK/lXTk/6uPYTLxtZd7g7f90/gl9vP48K++1NTEjg+OOPr31AL1DR2FIYoKo5p9EsaQMHU4WLbdu2YTCUJaXSOe7rOp+j/fuVsmjAb0e2b/qRUeWfsNY1iIMJvdm2bRtVHqu2/aNJ5IEP9rH8y++B74GPAKsN/4G8PLKzJ0Su4GF35FxeXnQrcaVeOrjgUIjvIe3fr5RFA347sm/HBvoCByfMZeTES3A4HHVOW+t0OqN+yUST0AWA8yadzF/f+LDWfpfLVW3wVzh6MSnVXrW5qRVUaGWl1uDkTsn9gLprrklJSSxZsiTqg5nYAf+FZ59g1qxZWEM+LJ06deKZZ57xvwa+XkzFxcUYYyguLiYnJ0cnbVMxQwN+Gxc4c+UrBU8A0K23NUtFsEVUAJKTk6O+Zu/j6NAVgKpDe1i8eDFer9c/UdT+/furvQa6jrCKdRrw26iCggJ69uzJtGnT/DXSrs5DVBkHy95aDlhdDfPy8nC73YgIbreb/Px8du7cGRPBHsCVZAX88v27602r6wirWKfdMtug/AfmkFDyL7xeb7XtWV33kCQVnLDUod0MbW++9y5nfXARFb0yiO8asMTCmGvhmDOrpU1PT6e4uLjWMbTbpoom2i2znTlh98v07raPUk/HWvte2ZJCScmXEShV2yTJA1nuGck4rxcOWN1V2b4G4jvWCvi5ublBRyLrOsIqVmjAb2MOHz6E21nKQ8VHc9uSFUFSFOF2u1u9XG1Vx46dya68nefOHc/4gcnWxsdOgYraUy1EyzrCSjWVtuG3AYHT/Y7PPBaXePl2a/ARUVojra5zolVnWblhD4VFuygs2sV+byKe8uDTRmRnZ1NUVITX66WoqEiDvYopWsOPsBtuuIFHHnmEx68fw6SepXRwVALw3ebaASs5OZmFCxdqkAqQ0jkBgPn/PDLJ2pNxFRzX6SD9IlUopdooDfgRcsMNN5CX9ziTxw5ixjkjubbP9xQe6sePZV3YXpZC4bdf4Xa7temhHqldO/CPG09id9mRX0SVz3XEWbk9gqVSqm3SgB8Bvlr9JROH88IpVpfACuPkkvztFG0u9afTniMNM7xf12qP30voRHz5obDmoSN0VTTQgN+KfEGjuLiYn005iV8M3cdub0fO+ZuLHXsPVgv2TmfkZqRs70xcRxLLwhfwa64z4BuhCzrtsmpf9KJtKwkc1j9q2EAKjv+aExOL+OvGZD79dgPrN1Wf3tcXUFTjmfhOJFIONcYxNJWO0FXRQmv4reCdV56h+MPnuPXSsQCMTz6I15Qy/Ikqvtu8qlpap9NJTk6Ors/aDI7ETjgwUFlWbT3cptIRuipaaMBvYVWVlZzy5S1M6uOptv2d3X1Zs7n68n2zZulC3OHgSOwMQHnZPhLDEPDT0tKCjtDVaZdVe6MBv4Xt3rWNFPGQ++NQ7vvLJ/7thyr3+e9rrT68XHbAP7hvD4nd+zb7eDpCV0ULDfgtbN/OLaQAR408CV78umELjKtmietgBfxDP35CBU1Yt7eGS04aRLcFv+Hxxx9n67at9Ondh+uuu47JJw2iovhT3n7r7Wr7rrl+FlN+fhs49BKZalt08rQW9s2Hf2fEu9NYc2YBX/y4V7v2tYKVH79J5luXRrQML3a7np/e/IeIlkHFphafPE1EzgYWAk7gCWPM/Br7ZwB/BDbZmx42xjwRjrzbkmB9tY/panUP7NgjlewTz9MA3wqGjpnEsl1P4Sk/0OJ5/e3FF9l/8Eg+Ajx7/Cr2//eDFs9bqcZqdg1fRJzAf4HJwEbgc+AKY8y3AWlmAFnGmF825kg0Wd8AAB1mSURBVNjtqYZfs682WE02T991FZce+jN7f7mGrj2b356s2pZgy0x+cvtwOssh+l6+EEdcAl2OOQVc8REqoYo1LV3DHwusNcastzN7Djgf+LbOZ0WZ2bNnU1ZWhjMunmvPH0/HeKv9NnnXCjyJQpfuvSJcQtUSgvXg+XhnJ37VvwRe/hkA34y5nxE/mRmJ4ilVTTiuKvUDNgQ83mhvq+liEflaRF4UkQGhDiYiOSJSKCKFO3bsCEPxWpZvZarSUmuU7AUnD+HRYSt5YPAXPDD4C87o8D2b492IU6+PR6Ngy0z+7u9F/GrfdC5fdRIAf39xqa6bq9qE1upG8Hcg3RiTAbwNLAmV0BiTZ4zJMsZkpaSktFLxmsbXjFO6Zx/iikdc8Uw+piPlJo7+Dx2k9//uJ+u5rgy4/bNIF1W1kGDLTF5+8YXkPfYkz7/0Bl4jxHkOM23aNHr27KmBX0VUOKqdm4DAGnt/jlycBcAYUxrw8AkgKrovzJs3j3NPHkHu2H3WyE5gkGMVHxwYwKZ91ik/eOfvwZUQyWKqFpadnV3tYnx6err/Ws5+Euliv/2lpaU6B4+KqHDU8D8HBovIUSISD1wOvBaYQEQCFhtlKrAmDPlGVEFBAcXFxUwfWkUvdvP1Ng9fb/PwTHEfZv51C2DNX6//2LEncMqFA95EOscfmdOnSXPweL2NuykVQrNr+MaYKhH5JfAmVrfMp4wxq0XkXqDQGPMacJOITAWqgF3AjObm29rWl2xk1advA/Dj+vV8+umnXDL1dMZ3+p43dvbmiryvqqVPSkpi4cKFkSiqirDAC7n7vfF0iasehBszB8/qv8xj2PcPNzi9Bwc/TlzMoFOvaPBzVOwIy5VEY8wyYFmNbXcF3P8N8Jtw5BUpW1+ex9TdrxzZkHHk7lvfd6iWVlemipy2MG994FQM+z1xdHZVD/iNmYOnakMh2+jOp92n1ptWjIcpe/LZWbSaQac2utgqBmjXkQZKqChli/Sm19V/4YQTTsDYbfYVVYZvtq31p8vPz9dAHyFtZd56X16zZ89mX5WL7q4jq3E1dg6eDhW72ZYwkKmz/6/etJWVFZCbD97KxhdaxQSd7KOB4qoOss/VHeeA0Wx39aVwUxWFm6r4epsH37Abt9utwT6C2tK89dnZ2ezcuZO4Lr3o4qry9+DxzZ1UUFBAeno6DoeD9PT0kL13Ont2U57Qo0F5Oh12/c3rqTuhillaw2+gBM8BKlzWpFw6e2Lb1BbnrU/o0ouue9biDbiY2phfIl3NXn5MTG5QXg6ngyrjAFMVptKraKM1/AZK9JRR6bLmVg/W91pnvYy8UG3jkZy33hvfiU7mABXFn/pvf134PwxPrmLsgHj/bUDS4Vq/RA4f2k8ShzFJPRucnwcnxqM1fBWc1vAbqIMpwxPX2f+4Zt9rFXlt8ZdXVVIKHaQCnj7Tv+2VcwESa6Ud/5fqzVF7d26lF+Ds1PBpOapwINqGr0LQgN9AHc1BvPHNXz1JtRzfF3Cke+kEOmbKLfzjg+Oq1bprzrDpEuGJUat5+ZJ4Ntw/3r/d6bFmWo3v2vCA7xEnok06KgQN+DUE69Z36aWX0lEOQ0Ln+g+gIqqt/fLqndyD8y6cVm3bvsOuWr9EUjufwYUDy/Hu82KMQURwObvy3/gJHDPs5Abn58GpF21VSBrwA4S6mFZ1+BDTARK6RLR8KjoE+yVS0fUYzn1wSdAV0U7r27/Bx/bgRLxaw1fB6UXbAKG69eU9YvWBdnTQgK/CIzs7m6KiIrxeL0VFRSxbtiwsXUqtgK81fBWc1vAD+LrvXfiTifTpcuSl6dfRCxTjSuoaoZKpaBeq62hxcTEOh6PB1yM84tRumSqkmA/4gW32DoeDAX1TeClrRdC0vfoPbuXSqVgRbCEVH2NMg0cNe3Hi0ICvQojpJh1fm31xcTHGGDweD8cNsEY1Tnu3O0ct3M/QvCpeSb8Xbv2BfsNPinCJVbQKtpBKTQ1p4vGItuGr0GI64Adrsz+mtzUR2r/X7sF0TWPeH/O4YMZsaERfaKUaq+ZgvlDqGzXswYUYbcNXwcV0k07Jps3EpRwFAf9fg3t1oNy4+HHTdsThjFzhVMwJ7FKanp4etImnvlHDXnFqwFchxVwNP3DSqjt+dgKHZu2ifOaR2y/7fE1JVQ8N9iqigjXxNGTUsFecOLRJR4UQUzX8mv3sp/YtpbiqO89/d+R7z+lyMfjUyzkmUoVUiqaPGvaiNXwVWswE/IKCAqZPn05yn76cOXEcIjAi/iseLU7jzle/wev12v9U93JhGxqpqWJXU0YNe0V76ajQojLgf160C6/X+B8/9NBDvPrqq7hSj+Ppn3Xh3A5Hul2+t2Y3Xq+32vS1SoVDJFbfMhrwVR2iMuAvf+oOjOfIjIHHd4HjrxyPAGe4XqKgqAd/Wr6ZQ5WGlZv34Xa7I1dYFZUitfqWx+HCVXW4xY6v2reoDPi3xL2E03Eo6L7DHvjDGyV8vc2q0Ud6+lwVnepafaslA74RJw60DV8FF5UB3/mbI32VExITMeZI847XgMd+6HQ6deES1SIitfqW1YavAV8FF53dMl3x/ltq/zQqvfhvvmAvIixZskSDvWoRkVp9y4hLA74KKSwBX0TOFpHvRWStiMwNsj9BRJ63938qIunhyLchgvVnFhFmzpypwV61mKb2o28uI06c6EVbFVyzA76IOIE/AecAQ4ErRGRojWTXALuNMYOAh4D7m5tvQwVbf3bp0qUsXry4tYqgYlCk1j02DhdOreGrECSwfbtJBxA5AbjbGHOW/fg3AMaY3wekedNO8x8RcQFbgRRTT+ZZWVmmsLCwWeVTKpZ89tBlDNi3gtTfro10UVSEiMgKY0xWsH3haNLpB2wIeLzR3hY0jTGmCtgLJIchb6VUIIdTa/gqpDZ30VZEckSkUEQKd+zYEeniKNWuGHHhRAcRquDCEfA3AQMCHve3twVNYzfpdAVKgx3MGJNnjMkyxmSlpKSEoXhKxQ7j0H74KrRwBPzPgcEicpSIxAOXA6/VSPMaWOuAAz8F3quv/V4p1QTiwqkBX4XQ7IFXxpgqEfkl8CbgBJ4yxqwWkXuBQmPMa8CTwFIRWQvswvpSUEqFm8OJS9vwVQhhacM3xiwzxhxjjDnaGJNrb7vLDvYYY8qNMZcYYwYZY8YaY9aHI99wC5wrPz09nYKCgkgXSalGMY44XFrDVyFE5dQKTRGpya6UCiuHNumo0NpcL51IqWuyK6XaDYcLpxiMV4O+qk0Dvi1Sk10pFVb20pxVVTq9gqpNA74tUpNdKRVWTquV1lNVWWcyvV4Vm7QN35abm1utDR90rnyfSKzcpJpGHNa/dMlLd+GISwiapqS4hE0rCrk+ywVZA/nrip16vSpGaMC3NXXR6GinF7Pbl6oex3DYuBj0w1Mh0wwETjvOuu8QQ9aANM5csIrp062hMvq+Nkx7rAg1e/K0lqSTp0Veeno6xcXFtba73W6Kiopav0CqTsYY1u04QKUn9P91Zmamf1Gg57J7kdVxG+5c6z1OSkrSRYEaoGZFCNrOa1fX5Gka8FWdHA4HwT4jIqILv7dTgV/iv7tyLHcM/I5O95dxsPzIhV63290uaqyR0pYrQi09W6ayReOFML2YHX0CF2dZtaUcgK9u7su7Nw4iwWWFBF/TXTR8hltCe+3VpwE/THw/8YqLizHGRM0/TKRWblItx7c4i9Pp5M0vNvDCgVFsl56c3mM744Yemdm8rKyM6dOnt/vPcEtotxUhY0ybvY0ePdq0F2632wC1bm63O9JFa7b8/HzjdruNiBi3223y8/MjXSQVBvn5+SYpKckApm9qL2N+28XMvTij1mc4KSkp6Hseq5+LssNV5tZFz5seo39iOo6Y7L91HTS6TbwGWHOYBY2p2oYfJtrWrdojX0+T4uJiSu5Ip49jDxXGya6qREY9vJPS/Yf9aWfNmuVfGrQtX7Rsae+99xb9l99MXI21g9eafky69z1EJEIls2gbfitotz/xVEzLzs6mqKiI/Px85nzl5vFdo1l2cAgD4vdz8ogB1dI+8sgjTJo0CYjtqUg6lH7DMY5N9Dgqk95DJtB7yAQ6duzEZOcXVHna9pQWGvDDRNu6VXuWnZ3NlMuu46ZHlnPdk18DcHxap1rp3n33XQoKCtrtRctwMB67Zn/egyRd8TRJVzzNj33OAqCqsu4RzpGmA6/CRAduqfbO91nNycnhx6pUrh+0nUk3Hw34GvStpgr54l4+uuVYqjxVGCMY4M+rPeS9sz4mftH6Ar7TFe/fJuKbw6gS6BCJYjWIBvwwys7O1gCv2jXf53fh649z8VFlSBJYIR2EI/edDgcOe0bO41yb6XB8D/I/jo1ftMZrBXyXK86/Tew5jNr6pHUa8JVS1WRnZ/PRRx9xyn2PhEzjG5g1b948Hr4wlWM77o+JC7ZwpIYfF3ck4ONo2KR1kaZt+EqpWhYvXswZZ5wRcn9JSYn/gm+K+zi6uSpjItgD4LGCujNIDd9TVRGRIjWUBnylVFDvvPMOycnJQfcFttV7ErrS2RxorWJFnK9Jx1erBxD/OgTaS0cp1U4tXLiw/t5nid1IlEoqD5cRE3wBX46ET4evhu/RJh2lVDvlm4bB7XYjIrjd7lpt9Y4O3QDYt2dnpIrZurxVVOKEgAFW4oyzd2nAV0q1Y762eq/XS1FRUa22+nWbtgMw8aTxUTNpYF2M14MHZ7VtvoVnqjTgK6WiVUFBAS+//g4A3TslRM2kgXXyVtUK+A77Aq63jY+0bVa3TBHpATwPpANFwKXGmN1B0nmAb+yHJcaYqc3JVynVNsybN48B3a3gd9WoJLL6HAXA28/cF7W9diRIwPddtI32bplzgXeNMYOBd+3HwRwyxmTaNw32KuyicS2C9qCkpIR1W/dRbuK4Jm0jD4wr5YFxpTxx4maqDh+KdPFahrcKj9So4dsXbb1RftH2fGCJfX8JcEEzj6dUo0XrWgTtQVpaGlu27iTl0URSl6aSujSVuT9k4BIve3ZujnTxWobXg7dmDd/fD79tj7RtbsDvbYzZYt/fCvQOkS5RRApF5BMRqfNLQURy7LSFO3bsaGbxVCyI5ZkbI803aeCB7ZvYuv57tq7/nuIdVp/8vTs2Rbh0LUNM7Rq+bxCWx9POA76IvCMiq4Lczg9MZ0+8H2pyfbc9P/PPgAUicnSo/IwxecaYLGNMVkpKSmPORcWoWJ65MdKCdds8a+qlAJTt2hyVTW0SpIbvsNvwve094BtjJhljhge5vQpsE5FUAPvv9hDH2GT/XQ8sB0aF7QxUzNO1CCKrZrfNyeddDMCaLz6q1dQ2bdo0/5z67ZWYKry12vB9vXTaecCvx2vAdPv+dODVmglEpLuIJNj3ewITgG+bma9SfroWQdvSvZe1Lm7xmi9qNbWBNaf+DTfc0NrFChuHt3bAd7qsNnzTxi/aNne2zPnACyJyDVAMXAogIlnATGPMtcAQ4DER8WJ9wcw3xmjAV2GjaxG0LUlJHdlrOjK9bxGTbx0YItWblMwfg9cRT8eLHybl6Pbzo1+MBxOiht/W2/CbFfCNMaVArSn1jDGFwLX2/Y+BEc3JR6n66FoEbcvHfaYRX/Ihxhl6zezKinjGeL/i0y/ebWcBvwqvVA+dvou2JpoDvlJKBXPOrD9QUFDAtGnTgu53Op0c2LMT/tdN1aF9rVy65nEYD15HzRp+lFy0VUqppsjOzg45p35OTg6JSV0A8Ja3r6mVrSad9lnD14CvlGox77zzDrNmzcJp14CdTiezZs1i8eLF4HBwkETM4f0RK19Tuo06jAfjCN4P3+tt2wFfm3SUUi1q8eLFVoAPolySkIrIBHzfCG1fTyLfCG2gzutBDuPBSHy1bU77oi1aw1dKqeDKHUk4Kw9GJG/fCG1X977+bQ0Zoe0I2qRj1fi1SUcppUKodHXEVRWZgF9SUkLCgBH0y8mj4/DTq22vi4PaTToul1Xjb+sXbbVJRykVMR5XR+IryiivbP155NOOOpq9A0YDkNB/GAdXvWdtr2eEttN4qq1nCwEDr7QNXymlgvPGdyRh/06Ou/ON1s/8kgV0te/G9z6aDoPGkpCQwLRf/IK3v90W8mlpQS7auny9dLxRvACKUko1R//evak8tJ7bTz8u6P6VK7/kzTfeZPeePXTv1o2zzj6LzMzwDdL6+stC0oueZ0mfbBIuvguA/GLIf7Yw5HPeja8CV/WLtr41bdEavlJKBdehU1c6OMqZdVrtCXQLCgrIn3ekF80+IO/NJ0hOTmbhwoXhGVndvRBefperMwazbdz/NOgpA56Px9Wra/WNYl0O1SYdpZQKJbELlJXCvcm1dl1aVcWltziBzgC8sLqKaS8forS0tEHdJxvkoDXBb0oHSOnXtZ7ENjHgq9H7+Nr0o3lNW6WUapbRM6xgaby1dv3xvvv8C2wM7ekgOyOOUakOjL0x7rNfwlBgVDOCfoU9m2dcUt3pAnmroEYbvj/gaw1fKaVC6J4Op98RdFfeNU9RXFwMQAcXLDjb0D1R/PsnpFXBF0uaF/DLSq2/jQnU3qpavXR8jw8dPsyaLc2fG8jlEAb37tzs49Q6btiPqJRSYZCbm+sfCXuoCq7/R3m1/Y9dnEJOt5Ww68faAbihdq2z/h7a3fDnBA34Vo1/7da93LTww6aVJUDPTgkU3hH+hWI04Cul2iRf+/zs2bMpLS2tti8pKYljJ0+HLXnwf5nNz6x8T8PTemv3w/ddtJ2a0Yuhw45vdnHiXS0zJlYDvlKqzfKtc1BQUFBrgZtTL78Mvh3Hfz58n2eXLOFwRYX/eQnx8Vw1fTonjB9ffybv58KhxgT8IG34IuBwMahnBwYNT234sVqZBnylVJsXcoGbET/liim3Ulxcc3qGSv657XWKiv5U/8G/XwZ7GrHgfbAmHbC26UVbpZRqOaHmvqlvThy/Dt1h3fvw58sblt5zuI6Ar90ylVKqxaSlpfl789Tc3iDHngPbVsG+TQ1L33cUHHVK7e3i1ICvlFItKbA3j09SUhK5ubl1Pi/YdYFmDeRyOLVJRymlGqOxgdi3rzHPCbb4yZVXXslHH30UcrGWejlcULoWvn21ac8P5EyAY89u/nFqEGNCryofaVlZWaawMPQkRkqp6FIzEINVW8/LywvP3Dm29PT0oM1AIsLMmTNZtmxZ42v+i0+A7d+Gp4Ade8GcH5r0VBFZYYzJCrpPA75Sqq0IFYjdbjdFRUVhy8fhcBAq9olIrX0OhwOv14vb7Q79BXBoN+zbHDLP119/nf/7v0Vs2bqF1D6p3HTTjQDcc889HCo/MqisQ2Iid959D1N+fmsTzqzugI8xpsk34BJgNeAFsupIdzbwPbAWmNvQ448ePdoopWKHiBig1k1EwpqP2+0Omk9DbklJSSY/Pz/ocfPz843b7TYiYtxut5k1a5Y/r5rnlpSUZJKTk4Pm4Xa7m3xuQKEJFYtD7WjIDRgCHAssDxXwASewDhgIxANfAUMbcnwN+ErFllCBuDkBMJj8/PyQXy4NuQUrT35+vklKSmryMcP1BVdXwG/W+F1jzBpjzPf1JBsLrDXGrDfGVADPAec3J1+lVHTKzc0lKan6zJUN6XHTWNnZ2cycORMRqba95uNQgvXx9y2KHg4N7lLaSK2xiHk/YEPA4432tqBEJEdECkWkcMeOHS1eOKVU25GdnU1eXh5utxsRwe12h/2Crc/ixYtZunRptbxmzpxZ6wsnmGABucEDvQIkJye3yhecX6iqvznSJPMOsCrI7fyANMsJ3aTzU+CJgMdXAg/Xl6/RJh2lVATk5+eHbFunjjb8xl4X8B2nZrt/qOsDDUVLteH7D1J3wD8BeDPg8W+A3zTkuBrwlVKR4gvEgHE6nf62+7ou2NbXhu+7bhCOwB5KXQG/NQZefQ4MFpGjgE3A5cDPWiFfpZRqspATttWRHqoPADv33HOb1qe/hTSrH76IXAgsAlKAPcBKY8xZItIXqxnnXDvducACrB47TxljGtRApf3wlVKqcerqh9+sGr4x5mXg5SDbNwPnBjxeBixrTl5KKaWapzV66bSqgoIC0tPTcTgcpKenU1BQEOkiKaVUmxBVk6cFmxApJycHIKLtZkop1RZEVQ0/2MCHsrIy5s2bF6ESKaVU2xFVAb/ZK98opVQUi6qAH2o4cksNU1ZKqfYkqgJ+a83DoZRS7VFUBfzWnIdDKaXaG10ARSmlokhdA6+iqoavlFIqNA34SikVIzTgK6VUjNCAr5RSMUIDvlJKxQgN+EopFSM04CulVIzQgK+UUjFCA75SSsUIDfhKKRUjNOArpVSM0ICvlFIxQgO+UkrFCA34SikVI5oV8EXkEhFZLSJeEQk6HaedrkhEvhGRlSKi8x0rpVQEuJr5/FXARcBjDUg70Rizs5n5KaWUaqJmBXxjzBoAEQlPaZRSSrWY1mrDN8BbIrJCRHLqSigiOSJSKCKFO3bsaKXiKaVU9Ku3hi8i7wB9guyaZ4x5tYH5nGSM2SQivYC3ReQ7Y8wHwRIaY/KAPLCWOGzg8ZVSStWj3oBvjJnU3EyMMZvsv9tF5GVgLBA04CullGoZLd6kIyIdRaSz7z5wJtbFXqWUUq2oud0yLxSRjcAJwOsi8qa9va+ILLOT9Qb+LSJfAZ8Brxtj3mhOvkoppRqvub10XgZeDrJ9M3CufX89MLI5+SillGo+HWmrlKqmoKCA9PR0HA4H6enpFBQURLpIKkyaO/BKKRVFCgoKyMnJoaysDIDi4mJycqye1NnZ2ZEsmgoDreErpfzmzZvnD/Y+ZWVlzJs3L0IlUuGkAV8p5VdSUtKo7ap90YCvlPJLS0tr1HbVvmjAV0r55ebmkpSUVG1bUlISubm5ESqRCicN+Eopv+zsbPLy8nC73YgIbrebvLw8vWAbJcSYtjtdTVZWliks1OnzlVKqoURkhTEm6PokWsNXSqkYoQFfKaVihAZ8pZSKERrwlVIqRmjAV0qpGNGme+mIyA6guIlP7wnE2qLpes6xQc85NjT1nN3GmJRgO9p0wG8OESkM1TUpWuk5xwY959jQEuesTTpKKRUjNOArpVSMiOaAnxfpAkSAnnNs0HOODWE/56htw1dKKVVdNNfwlVJKBdCAr5RSMSLqAr6InC0i34vIWhGZG+nytAYReUpEtovIqkiXpTWIyAAReV9EvhWR1SIyO9Jlamkikigin4nIV/Y53xPpMrUWEXGKyJci8o9Il6U1iEiRiHwjIitFJKzTBUdVG76IOIH/ApOBjcDnwBXGmG8jWrAWJiKnAAeAZ40xwyNdnpYmIqlAqjHmCxHpDKwALojm91lEBOhojDkgInHAv4HZxphPIly0FicitwBZQBdjzHmRLk9LE5EiIMsYE/aBZtFWwx8LrDXGrDfGVADPAedHuEwtzhjzAbAr0uVoLcaYLcaYL+z7+4E1QL/IlqplGcsB+2GcfYue2loIItIf+AnwRKTLEg2iLeD3AzYEPN5IlAeCWCci6cAo4NPIlqTl2U0bK4HtwNvGmKg/Z2ABcBvgjXRBWpEB3hKRFSKSE84DR1vAVzFERDoBfwNuNsbsi3R5WpoxxmOMyQT6A2NFJKqb70TkPGC7MWZFpMvSyk4yxhwPnAP8wm6yDYtoC/ibgAEBj/vb21SUsdux/wYUGGNeinR5WpMxZg/wPnB2pMvSwiYAU+027eeA00UkP7JFannGmE323+3Ay1hN1WERbQH/c2CwiBwlIvHA5cBrES6TCjP7AuaTwBpjzIORLk9rEJEUEelm3++A1THhu8iWqmUZY35jjOlvjEnH+l9+zxgzLcLFalEi0tHuiICIdATOBMLW+y6qAr4xpgr4JfAm1oW8F4wxqyNbqpYnIn8B/gMcKyIbReSaSJephU0ArsSq8a20b+dGulAtLBV4X0S+xqrYvG2MiYluijGmN/BvEfkK+Ax43RjzRrgOHlXdMpVSSoUWVTV8pZRSoWnAV0qpGKEBXymlYoQGfKWUihEa8JVSKkZowFdKqRihAV8ppWLE/wdudzdfHQj4eAAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "from sklearn.ensemble import GradientBoostingClassifier\n",
    "from sklearn.ensemble import GradientBoostingRegressor\n",
    "clf_1 = GradientBoostingRegressor(loss = 'lad', n_estimators=20, random_state=0).fit(X, y)\n",
    "clf_2 = GradientBoostingRegressor(loss = 'lad', n_estimators=30, random_state=0).fit(X, y)\n",
    "# Predict\n",
    "X_test = np.arange(0.0, 5.0, 0.01)[:, np.newaxis]\n",
    "y_1 = clf_1.predict(X_test)\n",
    "y_2 = clf_2.predict(X_test)\n",
    "\n",
    "plt.plot(X,y,'o',color='black')\n",
    "plt.plot(X_test,y_1,label='20 estimators')\n",
    "plt.plot(X_test,y_2,label='30 estimators')\n",
    "# Plot the resu  et\")\n",
    "plt.title(\"Gradient boosting of Decision Tree Regression\")\n",
    "plt.legend()\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sklearn.datasets import load_digits\n",
    "from sklearn.ensemble import GradientBoostingClassifier\n",
    "digits = load_digits()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAA1oAAAFwCAYAAAChCgrnAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi40LCBodHRwOi8vbWF0cGxvdGxpYi5vcmcv7US4rQAAIABJREFUeJzt3X/QXXdeF/DPlyzZaWdDEppusUtJytYtLtakThF1kCSKArLOk3WUQUZMgs76Y9Ak8mtQNHlQfsiwJhEc6TCQBHTB/cNt6u9VN4myiE47TVgEu3ZpspXWbtNtQtnW1g3HP55beDabfD/nPuf73Ofc7Os1w1D6ufecc7/3e77nfLhPz7t0XRcAAAC083lrfQAAAAC3Go0WAABAYxotAACAxjRaAAAAjWm0AAAAGtNoAQAANKbRAhiRUkpXSrlvFbb7m6WUL12F7d5fSjlfSnm5lPI3Wm9/JVqNYSnlSybjtq7FcbW2WnMFgDY0WgCNlVK+qpTyC6WUq6WUT5ZSPlxK+YoZ7v9sKeUvLf93Xde9peu6X1uF3X1XRJzpum5D13X/aBW2X3Wjz9pK13Ufn4zbtdXY/nKllIullK9ZpW1vmzRlb1qN7QNwYxotgIZKKV8QEf8qIn40Ir4wIt4WEYsR8dpaHtcq2hoR/+NmxbH+GgQAq02jBdDWOyIiuq772a7rrnVd92rXdR/suu6X3nhBKeVbSym/Wkp5qZTy70spW2+0oVLKm0spP1JK+Xgp5flSyo+XUm5bVl+Y/Nneb5RSPlZK+bpSyvdHxB+JiB+b/Nnbj01e+9t/ZlZK2VhK+elSygullEullO8tpXzepLavlPLzk/2+VEp5upTy9Tc5vg9FxO5l+3pHKeVkKeWflFL+TSnlUxGxu8f+PlxKOVpKuVJK+bVSyh+e/PtnSimfKKXsvcn+b/hZJ76mlPK/Jtv8x6WUsoLx/4xfgia/nv29yfG+XEr5YClly3WvfU8p5dlSynOllO9Ytq2TpZS/v+z/3lVK+d+Tf/6ZiPiSiPiXk8/xXTc5nu+cbPfZUsq3Xlf7hlLKE5O58Ewp5ciy8n+e/O8rk+3/oVLK20spHyqlvFhKuVxK+WellE032i8AK6PRAmjroxFxrZRyqpTy9aWUzcuLpZSFiPhbEfGnI+LOiPgvEfGzN9nWD8VS47YjIu6LpV/H/u5kO38gIn46Ir4zIjZFxFdHxMWu6/72ZJvfNvmzt2+7wXZ/NCI2RsSXRsTOiPgLEbF/Wf0rI+LJiNgSET8cET+5vFF5Q9d1f/S6fX10UvrmiPj+iNgQET/fc3+/FBF3RMT7IuLnIuIrJp/5z8dSI/WWG+y/9lnfNdnG74uIb4yIr52M2zTjfyPfPDn2t0bE+oj4juvquyPid0fEn4iI7+7z54Bd131LRHw8Iv7U5HP88PWvKaV83WRff3yy/eu3+6lYGtdNEfENEfFXSyl7JrWvnvzvTZPt/9eIKBHxgxFxd0T8noi4JyKOZMcKQH8aLYCGuq77jYj4qojoIuInIuKFUsqjpZS7Ji/5KxHxg13X/WrXdZ+OiB+IiB3X/6oyaWzeExGHuq77ZNd1L09e+02Tl/zFiPipruv+Q9d1v9V13a93Xfc/s+MrS3/K900R8T1d173cdd3FiHhvRHzLspdd6rruJyb/bdKpiPhdEXHXZ23s5k53Xffhrut+KyL+X4/9Pd113YnJ/v55LN30f1/Xda91XffBiHg9lpquafxQ13VXuq77eESciaVmNaLn+Fec6Lruo13XvRoR71+23Tcsdl33qa7rPhIRJyLiz0153DfzjZN9/3LXdZ+K65qiruvOdl33kclc+KVYah533mxjXdc9NZk7r3Vd90JE/MPa6wGYnkYLoLHJTfy+ruu+OCJ+byz9anBsUt4aEccnf9J2JSI+GUu/Lrztus3cGRG3R8Tjy1777yb/PmKpGfnYCg5vS0R8fkRcWvbvLl23//+z7LO8MvnHz/pFqeKZKff3/LJ/fnWy3+v/3TT7j1j2GSLilWXv7zv+0273Dcs/+6VY+u5buPsG2/5tpZSvLKWcmfx55tVYaii33GxjpZS7Sik/V0r59VLKb0TEP629HoDpabQAVtHkV6aTsdRwRSzdLP/lrus2Lfuf27qu+4Xr3no5lhqML1/2uo1d171l2XbefrPdVg7pciz9yrT8F5wviYhf7/+pUsv3v9r7q33WG+k7/it1z7J//pKIeHbyz5+Kpcb5DV903fuyz/HcDba93Psi4tGIuKfruo0R8eOx1EDebNs/MPn3D3Rd9wWx9Cean/XnoQCsnEYLoKFSypeVUr69lPLFk//7nlj687FfnLzkxyPie0opXz6pbyyl/NnrtzP5s7ufiIijpZS3Tl77tlLK105e8pMRsb+U8sdKKZ83qX3ZpPZ8LP33UJ9l8ud574+I7y+lbJj8ydzfjKVfNJqbwf5u+llvotf4D/B3Sim3T7a/P5b+FDIi4nxE/MlSyheWUr4oIg5e977sc7w/IvaVUt5ZSrk9Ig5fV98QEZ/suu7/Tv77vW9eVnshIn7ruu1viIjfjIirpZS3xdJ/6wdAQxotgLZejqWHO/y3svTUvV+MiF+OiG+PiOi67gMR8Q8i4ucmf7L1yxFxw6f6RcR3R8RTEfGLk9f+x4i4f7Kd/x5LN/JHI+JqRJyL3/nV6HhE/JnJU/VulG3112PpF5Zfi6WHVbwvIn5qwGfOrOb+ss/6GaYc/5U4F0vf2X+KiB+Z/DdmERE/ExEXIuJiRHwwfqcBe8MPRsT3Tv6k8foHbETXdf82lv789EOT7X/oupf8tYj4vlLKy7H0wJT3L3vvK7H0cJIPT7b/B2MpcuD3x9Lc+dcR8S9W+oEBuLHSddP+1QUAsFwpZVtEPB0Rnz95yAYAn+P8ogUAANCYRgsAAKAxfzoIAADQmF+0AAAAGtNoAQAANPamaV68ZcuWbtu2bSve2ZUrV6r1Z599tlrfsGFDuo+77767Wl+3bl26jZu5ePFiXL58eapAx6FjlnnyySer9WvXrqXbyMZs06ZNUx3TcmMcs5dffrla/9jHPpZu47bbbqvW77///qmO6XqPP/745a7r7uz7+qFj9vzzz1frzz33XLW+fv36dB/ZmAw5NyOmH7OI1Z9r2fn39NNPp9u47777Wh3OZ1mL8zNbs9785jdX66v5ffUxxjWtxXXgne98Z6vDuaG1OD+zdS0bl+yeJSLi1Vdfrdazde2BBx64ae3jH/94vPjiizOda88880y1no3JHXfcke7jrrvuqtbn7T7tqaeeqtazeTb0fmGotRizbEyyfuDFF19M9/GWt7ylWh96be27pk3VaG3bti0ee+yxFR/UI488Uq0fOXKkWt+1a1e6j2wbQ5qGhx56aOr3DB2zTDYmfS4Ui4uL1frCwsI0h/QZxjhmZ8+erdb37NmTbmPHjh2D9pEppVya5vVDx+zYsWPVenZe9Vlwz5w5U60POTcjph+ziNWfa9n5t2/fvnQb2bo5xFqcn9malc2lkydPrnjfLYxxTWtxHVjN44tYm/MzW9eycelz7l24cKFaz272auvi7t270/1fb+iYHTx4fY72Z8rGpM+alu1j3u7TsnuGbJ4NvV8Yai3GLBuT7J6jz3UgWxeHXlv7rmn+dBAAAKAxjRYAAEBjGi0AAIDGNFoAAACNabQAAAAam+qpg0NlTxG5ePFitd7nyUlDn1jV54lzY5I9nefcuXPpNrKnwQ156uBaOH/+fLWePclp48aN6T6yuTo22bmXPX0ne3pX9hSpiPx76fNU0XmTrTfZ0ytvRdm5k61Zp06dSvexdevWQccwNqdPn67WszE7fPhwy8O5ZWTXz2zd6/Oa7L6ldgxDIy9WIlunM32eBpc9ZW+tn8J3vWy9yM7PTCn5k9W3b99erQ/93mYtezplNqZ91rRsLmb1Pk/Q7MMvWgAAAI1ptAAAABrTaAEAADSm0QIAAGhMowUAANCYRgsAAKAxjRYAAEBjTXO0suf4Z1kEFy5cqNazbJSIPAcrO8ax5Whlx9sib+JWy/LJMqGyPIo+c2BxcXGqY1pr+/fvr9azHKws4yrLr+uzjXmUZeRkOR198seGZj71+W5mKcsuunTpUrXeJ+cum2tDso3WwtAcrLFd12alz/lVk+UPRuTn59gyoTLZ/cDQrNKI/PzKxmzW15I+Ga41O3furNb7rNHzNo+GZo/t3bu3Wu9zbmbf26yyx/yiBQAA0JhGCwAAoDGNFgAAQGMaLQAAgMY0WgAAAI1ptAAAABrTaAEAADTWNEcre2Z9ls/QJycrM2+ZUMeOHavWs6yAq1evDj6GWy3fKMtOyTIr+mSvLCwsTHNIay47t7LsoiwTo88cmrfsoj6yzJhs3Pbt25fuI5uP2bj1yRuZpez8y/IU+6x52XVg3uZadu5k2YDzdl3sK8sWGpo9lF2f+8hyHfusAbOUHc+DDz5YrffJ/cvOv7Fl/w09nmwO9Mm5G5rlNWtD19gW58VY1nm/aAEAADSm0QIAAGhMowUAANCYRgsAAKAxjRYAAEBjGi0AAIDGNFoAAACNzTRHaxZ5TfOW1ZNl5GRZAps3bx58DPOWz5Adb5Z9kmVa9JHlJ82bLGcry0bpkwOSvSb7Xtbi3D19+nS1fujQoWp97969g4/h+PHj1fqJEycG72OWsu85yz46f/58uo/se8n0ydKbpWzNy3J++uRBZefn2LKNIvJjyubK0JytiHw+z1tO5dD7gXPnzqWvefrpp6v1sc217NqT5dhl92kHDhxIjyGby9k1etZj2med/lzhFy0AAIDGNFoAAACNabQAAAAa02gBAAA0ptECAABoTKMFAADQmEYLAACgMY0WAABAY00Di7NQt6EBZn2C9LJ99AlW/VyTjdmOHTtmdCT9HDlypFrPAl4zfQKNxxZ8vdqyz9tnzLIQ2CxUNfveV8PGjRsH1U+dOlWttwh1vNXWtFkEvGbhnmOThY1mIbF9rp1ZyPMTTzxRra/FdSIbl2xdKqUMen/E/AUSZ2vO7t27q/XDhw9X633OraHh9WMLNM7GdBb3WNn1tc9cbmnoZ7p69Wq13qIfmNU9hV+0AAAAGtNoAQAANKbRAgAAaEyjBQAA0JhGCwAAoDGNFgAAQGMaLQAAgMaa5mjde++91Xr2TPvsOf8tcgCyrAHGb9++fdX62bNnq/ULFy5U631yiRYWFqr1/fv3D3r/rGV5EllWTJ9Mi+x7GWMe1NDPna15fTJ49u7dW63PW6bb6dOnq/Usm6xF9skY51pNtuZlGVh9coey/KPs+ju2vMWI/HqfzbWdO3e2PJxRyOZCNibZmPbJ0XrwwQer9ZMnT1bra5GpOER2bvS5L83GZNY5WZnsupSdW0ePHq3WP/CBDww+hlmtWX7RAgAAaEyjBQAA0JhGCwAAoDGNFgAAQGMaLQAAgMY0WgAAAI1ptAAAABprmqO1devWaj3LPsjqfZ55n2X1zJssByDLY8oyayLyMcsyXGYtmwdZdlFW75PRkY1rllUythytbJ61yJ/LsouOHTs2eB9jk43r1atX022M7fwb6syZM9X68ePHB+8jyx7rk182JtkcyLKLsgyeiHxM5i17LCK/tp06dapan7eMuj6yz5TNg82bN1frWQ5XRH79m7e80+x4s3uOFjmUY8yxq8lyv4aOaUS/dW8W/KIFAADQmEYLAACgMY0WAABAYxotAACAxjRaAAAAjWm0AAAAGtNoAQAANFa6ruv/4lJeiIhLq3c4o7e167o7p3mDMTNmKzTVuBmziDDXVsKYTc+YrYxxm54xm54xm54xW5le4zZVowUAAEDOnw4CAAA0ptECAABoTKMFAADQmEYLAACgMY0WAABAYxotAACAxjRaAAAAjWm0AAAAGtNoAQAANKbRAgAAaEyjBQAA0JhGCwAAoDGNFgAAQGMaLQAAgMY0WgAAAI1ptAAAABrTaAEAADSm0QIAAGhMowUAANCYRgsAAKAxjRYAAEBjGi0AAIDGNFoAAACNabQAAAAae9M0L96yZUu3bdu2VTqU3Ec+8pH0NevWravW77///hW//+LFi3H58uWSHsQyQ8fsypUr1frzzz9frd93333pPrIxG2I1xuz111+vvj8bkxdffLFa7zMemzZtqtbvuOOOav3222+v1h9//PHLXdfdmR7IxGqfm88++2y1/olPfCLdxgMPPFCtD52H045ZRD5uQ8+/a9euVeuvvvpqtd5HNq7r16+/aW0t1rTM2OfaWoxZNo+yedhnzLI1beh3vhrnZ+bixYvV+m233VatZ9eKiIgNGzZU6/fcc0+6jZtZi7mWfebs/Oyz72zMhliLMXvllVfSY6qprdFvyMbsrrvuSrdxM2O8DmT3eX36gcyQa2dE/zVtqkZr27Zt8dhjj03zlqb6fKnZxeLMmTMrfv9DDz2U7v96Q8fs9OnT1frRo0er9UceeSTdRzZmQ6zGmGWL1rFjx6r1kydPVut9xmPPnj3V+r59+6r1HTt2VOullEvpQSyz2ufmkSNHqvVszCOGnXt9TDtmEfm4DT3/skbtwoUL1Xofjz76aLVeWzfXYk3LjH2urcWYZfMoG5M+Y/aud72rWs/WzcxqnJ+Zoetwn8+8a9euar3P2N/MWsy17DNn5+fDDz+c7iMbsyHWYszOnz9frWfzsM+9bTZmBw8eTLdxM2O8DmT3effee+/gfQy5dkb0X9P86SAAAEBjGi0AAIDGNFoAAACNabQAAAAa02gBAAA0NtVTB1db9oSvS5fyB3xkr8me3rSaT+Bbib1791br2fH2eWrSkKfVrIXsaTRnz56t1rPPm82RiIjjx49X69n3kj3tatayz5zNoxaPeR3juXnixIlq/dy5c9X6xo0bq/XDhw+nx5A9bWotIzdWQ3b+9pkHY1vHM0OfWpatiX3GIxv3eZR97mzc+4xbtjZm15uxnb/Zk4qze6wWT2qcN9mTGLOny/Z5+mx2f5w9CXls8yyTrWnzxC9aAAAAjWm0AAAAGtNoAQAANKbRAgAAaEyjBQAA0JhGCwAAoDGNFgAAQGOjytE6cODA4G3s3LmzWp+3LIHseLPskyxbIWL+crSyDI4sGyXL+cgyMSLyfKQ+4z4mQ7PFsuyViHwuZ99rn320luWdZXMte3+fc2/eMqEy2Zhl2WRHjx5teTijkGUTDZ2HWQ5XxK2VW/OGbB0+duxYtd7nfiE7P+ftnmPoXDt16lS6j+waO7Yxy+6zsoyr7N62zz3H2LI3M9k9QzaP+oxJZiz9gF+0AAAAGtNoAQAANKbRAgAAaEyjBQAA0JhGCwAAoDGNFgAAQGMaLQAAgMaa5mhlz83PMmOyLJFbUZZdkmUnZBket2I2ylAt8piyDIix5YBkeTFZ9kmWXdTn8169erVan7eckIh8zRqajxRx653D2bmTmbeMuj4WFhaq9a1bt1brWY5PnzUvG9dsHo5tzYvIz69s3Pbu3ZvuI8tlnDfZfVqWKdVnHmT7WIvMxNWUXX/7mLf74+y8OHTo0GwOZAT8ogUAANCYRgsAAKAxjRYAAEBjGi0AAIDGNFoAAACNabQAAAAa02gBAAA01jRHK8vZyOpZVkifHIF5y+LJMieOHDkyaPt9xizLP8uyuuZNlmnRZw7NWw7I0CymLBOjRU7Igw8+OHgbrWXf89DsoP379w96/zzK1pvMvffem75m+/bt1fri4mK1nuVazdoszo0sSy9bQ7J8pbWQZYNl82Tfvn3pPm6162P2eVp8z9n3kmXtzfo+b9euXYPe3+Iea+fOndV6do0eei85rezamY3p0OzPiPFkUPpFCwAAoDGNFgAAQGMaLQAAgMY0WgAAAI1ptAAAABrTaAEAADSm0QIAAGhMowUAANBY08DiLEQuC7o7ffp0tZ6F3EXMJlh1lrJA1Ozzbty4Md3HrRa4mMnGNAtLjBg+14cGIE4rCyvMAhWzAOarV6+mx5AFko8tJDYiPzeyQNNsTetjbOGdQw0Nzjxw4MDgY8i2Meu5mJ1/hw8frtaz9aZPcGc2l/tcf+dNNm59PvMYg5rHLgtqz9aI7Ho0a9l9VvZ5+tyXZmtEdl8zNtl1q8XnGcuY+EULAACgMY0WAABAYxotAACAxjRaAAAAjWm0AAAAGtNoAQAANKbRAgAAaKxpjtZQfTKfMrdaJtTBgwer9ePHj1frfcY028eQLKHXX3893f+0sjyJc+fOVesvvfRStd4n0yLLjeqTWzNL2XeY5bFlY7558+b0GGadHdbC0Lm2d+/ean379u3pMcxbTlamRXZRZui6WTt/V2NNy87PLIcny8DK5nGffYzR0Gyh7P1jW8dnIRuTPjmTmaeffrpaz/IHZ31+ZrLzr0XuV/a93Go5dy0ysLLrc3Z+t8rh8osWAABAYxotAACAxjRaAAAAjWm0AAAAGtNoAQAANKbRAgAAaEyjBQAA0NiocrSyvJg+mTMXLlyo1rMsgrHlcGX5DFkOQJ8MnizjIRuTWj7Sa6+9lu5/Wtl3ePTo0eb7vN7CwkK1nn1v8ybLJeqT1zaPY5JlxmQ5WVneWot8lXmTrUnZXOuT95TlZGXnby0/Zf369en+Zy1bE+cxw66P7No0dFyyeXQryjIVDx06NHgf2b1cdn7Wvvd169at6JiGyNas7DqSZQtG5N/L2O5dh8rOzZ07d6bbyMZdjhYAAMCc0mgBAAA0ptECAABoTKMFAADQmEYLAACgMY0WAABAYxotAACAxkrXdf1fXMoLEXFp9Q5n9LZ2XXfnNG8wZsZshaYaN2MWEebaShiz6RmzlTFu0zNm0zNm0zNmK9Nr3KZqtAAAAMj500EAAIDGNFoAAACNabQAAAAa02gBAAA0ptECAABoTKMFAADQmEYLAACgMY0WAABAYxotAACAxjRaAAAAjWm0AAAAGtNoAQAANKbRAgAAaEyjBQAA0JhGCwAAoDGNFgAAQGMaLQAAgMY0WgAAAI1ptAAAABrTaAEAADSm0QIAAGhMowUAANCYRgsAAKAxjRYAAEBjb5rmxVu2bOm2bdu24p09++yz1fpzzz1Xrb/97W9P97Fp06apjmkaFy9ejMuXL5dp3pON2bVr16rvf/7556v1l19+uVp/9dVXq/WIiHXr1lXr2Xe+YcOGm9ZWY8xW25NPPpm+5t57763W169fP+gYHn/88ctd193Z9/VDxyz7zLXvuK9snt11112Dtj/tmEUMH7fs/M3GNXt/RL7u3X777ek2bmaM52d2nXjxxRcH7+P++++v1mvn71qM2cWLF6v1T3/609V6n3OrxTlesxbn5zPPPFOtZ9fPO+64I93H0HWrZoxzLRuz2267Ld3H3XffXa3P25r2+uuvV+tPPfVUtd7nvjUbsyFWY8yGjkmfe9ehNm7cWK3fd9991XrfNW2qRmvbtm3x2GOPTfOWz3DkyJFqfXFxsVp/73vfm+5jYWFhmkOaykMPPTT1e7Ixu3LlSvX9x44dq9bPnj1brZ8/f75aj8hP8ocffrha37Vr101rqzFmq632ed5w8uTJan3ojWgp5dI0rx86Ztln7jMmmWyeHTx4cND2px2ziOHjlp2/2bhl74+IeN/73let79ixI93GzYzx/MyuE9m518ejjz5ardfO37UYs3379lXr2Tzqc261OMdr1uL8zD53dv3Mxr3PPoYY41zLxqzPepSd4/O2pmXN6Z49ewbVI/IxG2I1xmzomFy4cGHqY5pWtuY98sgj1XrfNc2fDgIAADSm0QIAAGhMowUAANCYRgsAAKAxjRYAAEBjUz11MJM9+Sh7gkf2xMA+T2bpui59zZhkT2bJnhrY4mlx2VOEsqfdZO8fm+ypZdl3ErG6MQKrIZtH586dG1Tv87TP1X6q2VrIngqaPTlp+/bt6T7mba4NlT2xs888yq412ZPisvePTbYG91nThu5jjPM0W/ey8/PQoUPpPrL7krWMKrmR7Hs8depUtZ6tWX3u07LXZN/b2OZaNqbZPOvzhL1sHvV5QuYsDf3Me/furdbf/e53p8eQPb59yNMtp+EXLQAAgMY0WgAAAI1ptAAAABrTaAEAADSm0QIAAGhMowUAANCYRgsAAKCxpjlaWbZB9sz6LN+ozzPvs/yFWT03v6/seIbmuVy6dCl9TbaPseUzZLJMi/3791frR48eTfeR5Sdl2WOzlp2bW7durdbnLdeklSx/aHFxcdD2szUvYnw5PKstW2/6rEfZmM3bfB2aLdbnOpLtY2im4xhlmVB98o2y6828XT8z2Vzqs15l28jWxSwHb9Y2b95crWd5Ti3GbGzz7KWXXhr0/uzeOLtn6bONWfGLFgAAQGMaLQAAgMY0WgAAAI1ptAAAABrTaAEAADSm0QIAAGhMowUAANBY0xytTJZ9cOXKlWq9T6bF51rmTJaTleWERORZA2PLZ8hk8+zAgQOD3h8RUUqp1rN5OOsx7XPu1Jw7d65aX1hYGLT9scrWpMzOnTur9Vtxvcqyx7KMnCyvqc93kq2L8zbuWS5ftob3yQ0bmtU1Rtk6m2Uq9pF9N2O7fma5X5kW5042H++9997B+5il7PqXzZFDhw6l+8jW1bHJ1vFMnzHJnDhxolqf1bnpFy0AAIDGNFoAAACNabQAAAAa02gBAAA0ptECAABoTKMFAADQmEYLAACgsZnmaGVZH1l+UZZJE9EvL+RWsnXr1mq9T+ZFNu5jG9MshyfLjMrm4Z49e6Y9pM8ytuyULE8tyybKxiTLJouIOHbsWPqascnymDJZ9kmWTxYxfxll2fm5uLg4mwOpGNualp1/2XoyNCcvYnjuzRhl45bV+2QXZZlP2bhm16NbUZblNbbr51DZPVaf7M7sXm5s8yz7DrM1OMvt63M/kY2rHC0AAIA5pdECAABoTKMFAADQmEYLAACgMY0WAABAYxotAACAxjRaAAAAjWm0AAAAGptpYHEWqJYFXZ46darh0XxuyELfIiKOHDlSrbcI8G0pC5nbvHlztf6BD3ygWu8TUjlvsrDDLDA1G5MstDMiDw/sE649a1kgeCYLPG5xbp04caJan3X4Z7aeZPVMnzG71QJRs8/zxBNPVOvZtTUiH5M+27jV9FmTsrD2LFg8DaGcAAALtklEQVT1VhvX7FoSka+Ln4shzpns+pmtq4888kjDo8ll32FWz+ZRn3k2Fn7RAgAAaEyjBQAA0JhGCwAAoDGNFgAAQGMaLQAAgMY0WgAAAI1ptAAAABqbaY7W0MyYLCukz2uyYxhbfkOWwZFlCfTJTpinPII+FhYWBtX75Jrs379/mkMavSynJ6v3kWVxjTFHKzumLGcry4tpIZuv85YZleXFnD59Ot3G0aNHq/VNmzZNdUyrLTuerD40ozJifHmJLWTjkq1rfa6f2bqWrQG1/KPXX3893f+0smzNxcXFaj27X+iz3mzcuLFaH9v5OVQ2D/vcg2X3pocOHarWa/N0NeZZJjv3suvAhQsX0n1kGZOz4hctAACAxjRaAAAAjWm0AAAAGtNoAQAANKbRAgAAaEyjBQAA0JhGCwAAoLGZ5mhlz8XPMitaZPkM2ce1a9cG739aQ3O0ssyMiIjjx49Pc0i3vD6ZM4cPH179A5mhbJ5lOSAHDhxI99FnLo5NlueSrSfZmpeNa59juNXyj7Ix2b59e7qNecsOy2Sfp5bF1KfeZx/zqEVOVibL2svyj2rvX79+/QqOqC5bh7Ocyc2bN1frO3fuTI+hxb3cmGRZatmY98mQzO71+qyLs5SNye7du6v1LGutzz3YWNY0v2gBAAA0ptECAABoTKMFAADQmEYLAACgMY0WAABAYxotAACAxjRaAAAAjZWu6/q/uJQXIuLS6h3O6G3tuu7Oad5gzIzZCk01bsYsIsy1lTBm0zNmK2PcpmfMpmfMpmfMVqbXuE3VaAEAAJDzp4MAAACNabQAAAAa02gBAAA0ptECAABoTKMFAADQmEYLAACgMY0WAABAYxotAACAxjRaAAAAjWm0AAAAGtNoAQAANKbRAgAAaEyjBQAA0JhGCwAAoDGNFgAAQGMaLQAAgMY0WgAAAI1ptAAAABrTaAEAADSm0QIAAGhMowUAANCYRgsAAKAxjRYAAEBjGi0AAIDG3jTNi7ds2dJt27btpvUXX3yx+v7nn3++Wr/77rur9VdeeaVa7+Ouu+6q1tetW3fT2sWLF+Py5ctlmv1lYzbUlStXqvVnnnkm3cb9999fra9fv36qY1puNcYsmwcf/ehHq/W3vvWt0xzODb35zW+u1u+4445B23/88ccvd113Z9/XD51n2bn77LPPVusbNmxI95Gd30PmWcT0YxYxfNx+5Vd+pVq//fbbq/V77rkn3UdtTRpqLda07DqQyeZqRMSrr75arb/jHe+o1mvzeTXG7Nq1a9X3Z+ffJz7xiWr9tttuq9Yj8jUru3Zm1uL8fOqpp6r1N72pfgv02muvpfvI1rU+a+PNjPGeI7un6HN+PvDAA9X6kDVvjGOWefLJJ9PXZOffpk2bVrz/MY5Zi3mWrXvZvW+m75o2VaO1bdu2eOyxx25aP3nyZPX9x44dq9YXFxer9SeeeKJa7+PgwYPVem2yPvTQQ1PvLxuzoU6fPl2tHzhwIN3Go48+Wq0POZlWY8zOnz9fff+uXbuq9fe85z1TH9P1sjHZt2/foO2XUi5N8/qh8yw7d48cOVKtZ2PeZxtDF+1px+yNfQ4Ztx07dgyqZ2tixLALaGYt1rQ+n7kmm6sRERcuXKjWH3744Wq9Np9XY8yy/4dZdu4cP368Ws8ay4h8zcqunZm1OD/37NlTrWfn1sWLF9N9tFgbb2aM9xzZPOhzfp45c6ZaH7LmjXHMMn3myKFDh6r1hYWFFe9/jGPWYp5l19+zZ89OcUSfre+a5k8HAQAAGtNoAQAANKbRAgAAaEyjBQAA0JhGCwAAoLGpnjqYyZ7Qkz0JKntCUAur/bS41rKnUR0+fLhaz566EjH8aW+zlo3J1atXq/Xs6ZZ9bN++vVrPniI0tjEf+kSx7EmQEcOfANRnLreWPdUzW9OyudrnyUlDv5ux6fOZa/qMR7aPoU8ubS073kceeaRaz57i1mfMs33M4zzMzr/snqXPPNi9e3e1/tJLL1Xrq/lU0ZXI1uHsCZc7d+5M9zG2z7zasnl27ty5wfsY8tTBtZDNs+weKXvaZ8TwJ9y24hctAACAxjRaAAAAjWm0AAAAGtNoAQAANKbRAgAAaEyjBQAA0JhGCwAAoLGmOVpDs4EOHDhQrbfIhJp1PspQWb5CluOTZaPMo6EZHNk865MXM7YcrEyW45Flj+3du7da75PTk52/2TbWIhNj48aNg96f5fL1+UzzmF9Uk82DbMz6zLVsjRhbXmJ2vFkeVLbOnzp1Kj2Gecvh6SPL5szmUrZu9jFvmVHZmG3durVa73N+ZvvIMpLWIlOxJjs/W6w38zaPMtm9eIt79aF5iq3mmV+0AAAAGtNoAQAANKbRAgAAaEyjBQAA0JhGCwAAoDGNFgAAQGMaLQAAgMaa5mgNdfz48Wq9T6ZNn7yQefLSSy9V69mYZDlbEfOXCTU0TyKbZ31yQM6ePVutjy3nY+iYvfvd7171Y9i9e/fgfbSWnRtZpszi4uLgY8jm49gyoTLZmGbzIMt0i5i//MDsO8zyXrK8p6NHj6bHsBY5dastG9dDhw5V61k+UkTEmTNnpjmkNZddu7JMxWxM+2SPnT59ulrPrhV9rtEtZZ8pG5MsD7WPecvRyuZZtkZnn7dFxt2s7n39ogUAANCYRgsAAKAxjRYAAEBjGi0AAIDGNFoAAACNabQAAAAa02gBAAA01jRHK8sSyJ5Zn+U39MlPyfJCFhYW0m3MUpbTcfDgwWq9xZjt2rWrWs8yK2ad75DNo2wOtMjoyF4ztkyaod9RlhfVRzbXs8y4tZDNtSzfKKv3yXvK5tKePXuq9Vmfn9lnHpqBM+sMnTGYxXpy5MiRaj3LrRljHmN2/cz0OXey6+fYDM2Yy+bB0DGPyOfirGWZUNk8yca8xX3avBmam5vd+/aRfS+tMir9ogUAANCYRgsAAKAxjRYAAEBjGi0AAIDGNFoAAACNabQAAAAa02gBAAA0ptECAABorGlgcSYLXMuCLvsElO3YsWOaQ1pzWYhrFgKZvT8b04g88DQLDxxbOG8WmJiNWZ+wxDGGc9ZknzkLB7x06VK13meeZbJ5OEZZUGW25vUJoczWtFmFLvY19HiyuXT69On0GMYWTD8PsrmYhbbOep71kR1zFm7fIlC8RYBvS0Ov11nQbB9bt26t1sd2fc3mdlbPrr997m1bXGNnKVtPuq4btP0+cyQ7f2fVL/hFCwAAoDGNFgAAQGMaLQAAgMY0WgAAAI1ptAAAABrTaAEAADSm0QIAAGisaY5WlhWQ5Tdkz7zPsn4ixpnlUZNlAWRjtnv37mr95MmT6TFk39u8yXJ2Dhw4UK33GY8+WVtjkuU9ZTkeJ06cqNb7ZHxkuRrZMY5RNteeeOKJav3BBx9M95GNWzYXZ70mZsebrUnZmpiNacT85Whl50/2HWYZdH3mWXYM+/fvT7cxa1lOVmZoRl1EPp/HlqOVye45snV6cXEx3ce8XT+HanGPdfHixeEHMkey86ZPjtZYcnX9ogUAANCYRgsAAKAxjRYAAEBjGi0AAIDGNFoAAACNabQAAAAa02gBAAA01jRHK8vhyPIVspysPpkZY3lufitZJk2W85Hlq0Tk4z62bLIsk2Lv3r3VepYD0ievYh4zn2qOHj1arR86dKha75NblOWzzKPDhw8Pen+fMckyzrZv3z7oGFrL1uDs/D116lS1nmW6zaNszIZmk/XJg8r2sXPnznQbs5aNW1bPrm19snpuxXWtpkUmVDbXbjUtxuxWu7fNZPdhfe5tx8IvWgAAAI1ptAAAABrTaAEAADSm0QIAAGhMowUAANCYRgsAAKAxjRYAAEBjpeu6/i8u5YWIuLR6hzN6W7uuu3OaNxgzY7ZCU42bMYsIc20ljNn0jNnKGLfpGbPpGbPpGbOV6TVuUzVaAAAA5PzpIAAAQGMaLQAAgMY0WgAAAI1ptAAAABrTaAEAADSm0QIAAGhMowUAANCYRgsAAKAxjRYAAEBj/x8s2bt4D/LE/wAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 1080x576 with 55 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "real_data = digits.data[:44].reshape((4, 11, -1))\n",
    "fig, ax = plt.subplots(5, 11, subplot_kw=dict(xticks=[], yticks=[]),figsize=(15,8))\n",
    "for j in range(11):\n",
    "    ax[4, j].set_visible(False)\n",
    "    for i in range(4):\n",
    "        im = ax[i, j].imshow(real_data[i, j].reshape((8, 8)),\n",
    "                             cmap=plt.cm.binary, interpolation='nearest')\n",
    "        im.set_clim(0, 16)\n",
    "ax[0, 5].set_title('Selection from the input data')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Text(0,0.5,'Accuracy')"
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYsAAAEKCAYAAADjDHn2AAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi40LCBodHRwOi8vbWF0cGxvdGxpYi5vcmcv7US4rQAAIABJREFUeJzt3Xt8HVW5//HPN+mN9Aq9cGtLy52KXCMFBFFQLMjlUPVwFSpwkCOgIuiBoyKnHg9e0KMeUH8Fy10R8FYVLHdQQGgLtKVAS1tKSUtp0tLSJG3SJM/vj5mUTZp0h5LJ3km+79crr86smdn76WRnnr3WmllLEYGZmdmWlBQ6ADMzK35OFmZmlpeThZmZ5eVkYWZmeTlZmJlZXk4WZmaWl5OFmZnl5WRhZmZ5OVmYmVlevQodQEcZNmxYjBkzptBhmJl1KbNmzaqKiOH59us2yWLMmDHMnDmz0GGYmXUpkl5rz35uhjIzs7ycLMzMLC8nCzMzy8vJwszM8nKyMDOzvJwszMwsLycLMzPLq9s8Z2Gte3JRFf9ctKrVbXvuMJAT9tvpXWUVb9Xy5MJVfPrgkZSWaFP5mtp6fv3MUjbUNwKwTZ9enDF+NIO36f2+4nvm1dWUCMrHbPeu8rkVa1m2Zj0T9t3hfb2+mXUMJ4tu7PfPVnD53bNpCpDeva156vUFK9Zx6Sf2RBILV1Zz5o3/5M2363hyURXXfnZ/epWWUFVdx1k3Ps3LK9Ztep0I+Muc5dx23ni2699nq+JbU1vPeTfPoHZjIz859QBO3D9JXI8vqOSC22ayYWMTX/vkXlz0sd239hSYWQfJNFlImgD8FCgFboyI77XYvgswFRgOrAbOioiKdNto4EZgFBDA8RGxJMt4u5NfP72Ub/xxLofvNpQbzi6nrM+7f9WNTcF//n4uP3t4Ies3NnLKgSP53K+eRhLnfngsU594lbqGJv7z+H2YdNMzLFuzntvPG88RewwD4NH5K/nCbbM4bcpT3H7eeEYM6veeY/zlY4uprm9g350G8+U7n2PDxkaGlPXhojueZbcRA9h9xAB+OH0+6+sbuezYJKGZWWEomr9idvQLS6XAAuATQAUwAzg9Il7M2edu4C8RcYuko4HPR8Tn0m2PAt+NiAckDQCaIqK2rfcrLy8PD/eRuO2pJXzrT/M4eu8R/PzMg+jXu7TV/Zqagsl/eZGbn1xC71IxbEBf7jh/PLsOH8DUf7zK5L+8SO9S0bdXKVMnfYhDxr67qejJRVWcf8tMth/UjzvOH89OQ7bZtK2xKbj1qSVUvLUeAAEn7r8T+48aAsDKdRv4yA8e4ZMf2IHvTdyPC26byd9fqaK0ROy782Bu/fwhDOjXi2/8YS53znid844Yyzc/tY8ThlkHkzQrIsrz7pdhsjgMuDoiPpmuXwkQEdfk7DMPmBARryu5CqyNiEGSxgFTIuKI9r6fk0XijbXrOeqHj3LE7sP45VkH06fXlu9hiAh+/MACHp1fyc/PPIhR25Vt2nbnM0u58R+vcu1n9+eA9CLf0qzXVjNp6gwGbdOb3/zboYweWkZDYxOX3T2bPz2/nP59SpFEfUMTJSVww9nlHLnHcL79pxe4/emlPPTVoxgzrD91DY187e45vL1hI/93+oEM7Nd7U3yT//IiNz2xhDPHj+Y7J+9LSYkThllHKYZk8RmSRHB+uv45YHxEXJyzz6+BpyPip5ImAr8DhgFHAucD9cBY4EHgiohobOv9nCwSV/5+LvfMep1HLv8oI7cty39AB5hbsZbPTX2avr1KuOXcQ/jJA6/wt3kr3tXf0Nzvsbiyhm+dsA+T//Iinzl4JNdM3C/v60cEP5w+n58/uoiJB+3MDz69H71KfSOfWUdob7IodAf35cB1kiYBjwPLgEaSuI4EDgSWAr8FJgG/yj1Y0gXABQCjR4/urJiL1pKqGu6e+Tpnjh/daYkC4IMjB3PnBYdy1o3PcPxP/05TwFUnjOPcI8Zu2mfYgL7cecGhnDP1Gb71p3n0KS3hkqP3aNfrS+LrE/amrE8p196/gIq31rPrsP6b7Td4m9588WO7v687tCKCW55cwssr1m31a5h1tlHblWV+I0iWyWIZSed0s5Fp2SYRsRyYCJD2S3w6ItZIqgCej4jF6bY/AofSIllExBRgCiQ1i4z+H13GTx5cQK9ScdHRnX/30N47DOKuLxzK5XfP5tQPjeLUD22evIeU9eH288fztbvncODoIe/q42iPi4/egwF9ezHl8cW8tqpms+1V1fX8Y2HVVt+h1dQUXDXtBW7/51KGDejzrluHzYrZvjsNzvw9smyG6kXSwX0MSZKYAZwREfNy9hkGrI6IJknfBRoj4qq0c/xZ4OMRUSnpJmBmRFzf1vv19Gao+SvWMeGnj3PBR3blyuP2KXQ4BfHIyyu58PZZ7DK0jNvPH8+Ige2/Q6uxKfiP383hnlkVfOGoXbliwt7uTLceoeDNUBHRIOliYDrJrbNTI2KepMkkF/5pwEeBayQFSTPURemxjZIuBx5KO75nATdkFWtX19QUfO++lxjQpxcXfmS3QodTMB/bewQ3TfoQ5986k4k/f7LNTvnWLF+znmeXruHSj+/Jl47Z3YnCrIXMahadrafWLBoam/jaPXP4w3PL+Oan9uH8I3ctdEgFN+u11Vw97UVq6hvafUyJxJnjR/P5D4/Nv7NZN1LwmoVlr76hiS/f+Rz3vbCCy4/d04kidfAu2/HnS9p917WZtYOTRRe1YWMjX7zjWR5+eSXfOmEc5x3hb8Rmlh0niy6otr6Bf7t1Jk8uWsV3T9mXM8fvUuiQzKybc7LoYt7esJFzb5rBs0vf4kef3Z+JB40sdEhm1gM4WRS5DRsbufS3z7Oqph5I7tpZsXYD/3f6QXxqvx0LHJ2Z9RQeM6HIPfDim9z3wgo2NjZRIhgztD83nFPuRGFmnco1iyI3bfZyRgzsyz0XHu4nis2sYFyzKGJr12/ksfmVnLDfTk4UZlZQThZFbPq8FdQ3NnHSATvl39nMLENOFkXsz7OXs8vQMvYfmf0gYWZmW+JkUaQq19XxxMIqTtxvJ49TZGYF52RRpO6d+wZNgZugzKwoOFkUqWmzl7PX9gPZc/uBhQ7FzMzJohgtqaph1mtvuVZhZkXDyaII/ezhV+jbq4TPHOyhPMysODhZFJlX3lzHH59bxjmHj2H7Qe2f6c3MLEtOFkXmxw8soKxPLy48qufOeGdmxcfJoojMrVjLfS+s4NwjxrJd/z6FDsfMbBOPDVVgudPaXnv/fIaU9eb8Iz2RkZkVFyeLApqxZDVn3vA09Y1Nm8quOG5vBvXrXcCozMw252RRQI8vqKQxgi8fswcSlPUp5ezDxhQ6LDOzzThZFNDzr69hz+0Hcukn9ix0KGZmW+QO7gKJCOYuW+tBAs2sS8g0WUiaIGm+pIWSrmhl+y6SHpI0R9Kjkka22D5IUoWk67KMsxCWrq5lTe1G9h81pNChmJnllVmykFQKXA8cB4wDTpc0rsVu1wK3RsR+wGTgmhbbvwM8nlWMhfT862sA2M81CzPrArKsWRwCLIyIxRFRD9wJnNxin3HAw+nyI7nbJR0MbA/cn2GMBTOnYi19e5V4oEAz6xKyTBY7A6/nrFekZblmAxPT5VOAgZKGSioBfgRcnmF8BTWnYg377jyY3qXuNjKz4lfoK9XlwFGSngOOApYBjcAXgXsjomJLB0u6QNJMSTMrKyuzj7aDNDQ2MXfZWjdBmVmXkeWts8uAUTnrI9OyTSJiOWnNQtIA4NMRsUbSYcCRkr4IDAD6SKqOiCtaHD8FmAJQXl4edBGvrKxmw8YmDnDntpl1EVkmixnAHpLGkiSJ04AzcneQNAxYHRFNwJXAVICIODNnn0lAectE0ZXNqWju3HayMLOuIbNmqIhoAC4GpgMvAXdFxDxJkyWdlO72UWC+pAUkndnfzSqeYvL862sZ1K8XY4aWFToUM7N2yfQJ7oi4F7i3RdlVOcv3APfkeY2bgZszCK9g5lSsYf9RQ5BU6FDMzNql0B3cPc6GjY28vGKdO7fNrEtxsuhk85a/TWNTsL/7K8ysC3Gy6ETr6xv5yYMLKBEcMNrJwsy6Do8620mq6xo4/5YZPP3qar438YOMGOj5tc2s63Cy6ARr129k0k3PMKdiLT859QBOPqDlg+xmZsXNySJjq2vqOXvq08xfsY7rzziICfvuUOiQzMzeMyeLDK1ct4Gzbnya11bVMuXscj6214hCh2RmtlWcLDLyxtr1nHHD07z59gZumvQhDt99WKFDMjPbak4WGfn+fS/z5tsbuPXcQygfs12hwzEze19862wG1tc3cv+Lb3LyATs5UZhZt+BkkYEHX3qT2vpGTtx/p0KHYmbWIZwsMjBt9nJGDOzL+LFDCx2KmVmHcLLoYGvXb+Sx+ZWcsN9OlJZ4oEAz6x6cLDrY9HkrqG9s4qQD3ARlZt2Hk0UH+/Ps5Yzeroz9PaqsmXUjThYdqHJdHU8srOLE/Xf0XBVm1q04WXSge+e+QVPASft77Ccz616cLDrQtNnL2Wv7gey1w8BCh2Jm1qGcLDpIxVu1zHrtLXdsm1m35GTRQf48+w0ATtzPycLMuh8niw4ybfZyDhg1hNFDywodiplZh3Oy6AALV67jpTfe5iQP72Fm3ZSTRQeY9vxySgQn7LdjoUMxM8tEpslC0gRJ8yUtlHRFK9t3kfSQpDmSHpU0Mi0/QNJTkual207NMs73IyKYNns5h+46lBGDPK+2mXVPmSULSaXA9cBxwDjgdEnjWux2LXBrROwHTAauSctrgbMj4gPABOAnkoZkFev7MXfZWpasqnUTlJl1a1nWLA4BFkbE4oioB+4ETm6xzzjg4XT5kebtEbEgIl5Jl5cDK4HhGca61aY9v5zepeK4fd0EZWbdV5bJYmfg9Zz1irQs12xgYrp8CjBQ0rvG9ZZ0CNAHWJRRnO/Lw/NXcvhuwxhc1rvQoZiZZabQHdyXA0dJeg44ClgGNDZvlLQjcBvw+YhoanmwpAskzZQ0s7KysrNi3mTF2g0srqzhCM+vbWbdXJbJYhkwKmd9ZFq2SUQsj4iJEXEg8I20bA2ApEHAX4FvRMQ/W3uDiJgSEeURUT58eOe3Uj25qAqAw3bzJEdm1r1lmSxmAHtIGiupD3AaMC13B0nDJDXHcCUwNS3vA/yBpPP7ngxjfF+eWLiKbct6M27HQYUOxcwsU5kli4hoAC4GpgMvAXdFxDxJkyWdlO72UWC+pAXA9sB30/J/BT4CTJL0fPpzQFaxbo2I4MlFVRy221BKPCOemXVzvbJ88Yi4F7i3RdlVOcv3AJvVHCLiduD2LGN7v5asquWNtRu4aDf3V5hZ91foDu4u64mFSX/F4e6vMLMewMliKz21aBU7Du7H2GH9Cx2KmVnmnCy2QlNT0l9x+G7DPH2qmfUIThZb4aUVb/NW7UY3QZlZj5E3WUi6RNK2nRFMV/HUolUAfNgP45lZD9GemsX2wAxJd6WjyPb4dpfHFlSy6/D+7DDYo8yaWc+QN1lExDeBPYBfAZOAVyT9j6TdMo6tKM2tWMvfX6nyKLNm1qO0q88iIgJYkf40ANsC90j6QYaxFaVr75/PtmW9Oe+IsYUOxcys07Snz+LLkmYBPwCeAD4YEf8OHAx8OuP4isozr67msQWVXHjUbgzs51FmzaznaM8T3NsBEyPitdzCiGiSdEI2YRWfiODa6fMZMbAvZx82ptDhmJl1qvY0Q90HrG5ekTRI0niAiHgpq8CKzeOvVPHMktVccvTubNOntNDhmJl1qvYki18A1Tnr1WlZj3L9wwsZue02nPqh0YUOxcys07UnWSjt4AaS5icyHoCwGC1YuY6P7jWcPr38HKOZ9TztufItlvQlSb3Tny8Di7MOrJhsbGxiTe1Ghg3oW+hQzMwKoj3J4kLgcJJZ7iqA8cAFWQZVbN6qqQdwsjCzHitvc1JErCSZ5a7HqqpuThZ9ChyJmVlh5E0WkvoB5wEfADaNbxER52YYV1Gpqq4DYKhrFmbWQ7WnGeo2YAfgk8BjwEhgXZZBFZtVNWmy6O+ahZn1TO1JFrtHxLeAmoi4BfgUSb9Fj7GquRlqoGsWZtYztSdZbEz/XSNpX2AwMCK7kIpPVXU9fUpLGNi3x90xbGYGtO95iSnpfBbfBKYBA4BvZRpVkVlVXcfQAX08K56Z9VhbTBaSSoC3I+It4HFg106JqshUpcnCzKyn2mIzVPq09tc7KZaitaqm3s9YmFmP1p4+iwclXS5plKTtmn/a8+LpzHrzJS2UdEUr23eR9JCkOZIelTQyZ9s5kl5Jf855D/+nDrequp6h/Z0szKznak+fxanpvxfllAV5mqQklQLXA58gefJ7hqRpEfFizm7XArdGxC2SjgauAT6XJqNvA+Xpe81Kj32rPf+pjhQRVFXX+YE8M+vR2vME99ZOCXcIsDAiFgNIuhM4GchNFuOAr6bLjwB/TJc/CTwQEavTYx8AJgC/2cpYtlp1XQN1DU3uszCzHq09T3Cf3Vp5RNya59Cdgddz1pvHlco1G5gI/BQ4BRgoaWgbx+6cL9YsND9j4WYoM+vJ2tMM9aGc5X7AMcCzQL5k0R6XA9dJmkRyt9UyoLG9B0u6gHRQw9Gjs5lnovnpbT+QZ2Y9WXuaoS7JXZc0BLizHa+9DBiVsz4yLct97eUkNQskDQA+HRFrJC0DPtri2EdbiW0KMAWgvLw8Wm7vCFWbahZuhjKznmtrZvKpAdrTjzED2EPSWEl9SEaunZa7g6Rh6bMcAFcCU9Pl6cCxkrZNHwg8Ni3rdM2DCPrWWTPrydrTZ/FnkjuSIEku44C78h0XEQ2SLia5yJcCUyNinqTJwMyImEZSe7hGUpA0Q12UHrta0ndIEg7A5ObO7s7W3GexnWsWZtaDtafP4tqc5QbgtYioaM+LR8S9wL0tyq7KWb4HuKeNY6fyTk2jYFZV1zF4m96eTtXMerT2JIulwBsRsQFA0jaSxkTEkkwjKxJVNfW+bdbMerz2fF2+G2jKWW9My3qEqnV1DPNts2bWw7UnWfSKiPrmlXS5x3zVXuWahZlZu5JFpaSTmlcknQxUZRdScVlVXec7ocysx2tPn8WFwB2SrkvXK4BWn+rubhoam3irdqNrFmbW47XnobxFwKHpQ3NERHXmURWJ1TXpA3muWZhZD5e3GUrS/0gaEhHVEVGdPij3350RXKE1P709zM9YmFkP154+i+MiYk3zSjpM+PHZhVQ8PC6UmVmiPcmiVNKmq6WkbYAecfVc5XGhzMyA9nVw3wE8JOkmQMAk4JYsgyoWzeNCuc/CzHq69nRwf1/SbODjJGNETQd2yTqwYlBVXU/vUjGoX3tyqplZ99XeAY/eJEkUnwWOBl7KLKIisqq6jqH9+yKp0KGYmRVUm1+ZJe0JnJ7+VAG/BRQRH+uk2ApuVU09wwa6v8LMbEvtKy8DfwdOiIiFAJIu7ZSoikRVWrMwM+vpttQMNRF4A3hE0g2SjiHp4O4xVlV7XCgzM9hCsoiIP0bEacDewCPAV4ARkn4h6djOCrBQ1m3YyIq3NzByyDaFDsXMrODydnBHRE1E/DoiTiSZC/s54D8yj6zAnl68msam4NDdhhY6FDOzgntP079FxFsRMSUijskqoGLx5KJV9O1VwkGjty10KGZmBee5Qtvw5KIqysdsS7/epYUOxcys4JwsWlFVXcfLK9Zx+G7DCh2KmVlRcLJoxVOLVgFwuPsrzMwAJ4tWPbmoioF9e/HBnQcXOhQzs6LgZNGKJxauYvyuQ+lV6tNjZgYZJwtJEyTNl7RQ0hWtbB8t6RFJz0maI+n4tLy3pFskzZX0kqQrs4wz1+ura1m6upYP7+4mKDOzZpklC0mlwPXAccA44HRJ41rs9k3grog4EDgN+Hla/lmgb0R8EDgY+IKkMVnFmuud/gp3bpuZNcuyZnEIsDAiFkdEPXAncHKLfQIYlC4PBpbnlPeX1AvYBqgH3s4w1k2eWFTFsAF92XP7AZ3xdmZmXUKWyWJn4PWc9Yq0LNfVwFmSKoB7gUvS8nuAGpKxqZYC10bE6pZvIOkCSTMlzaysrHzfAUcETy5axeG7DfWw5GZmOQrdg3s6cHNEjCSZ1/s2SSUktZJGYCdgLHCZpF1bHpw+TV4eEeXDhw9/38HUNTRRua6OvXYY+L5fy8ysO8kyWSwDRuWsj0zLcp0H3AUQEU8B/YBhwBnA3yJiY0SsBJ4AyjOMFYCaugYABvT1zHhmZrmyTBYzgD0kjZXUh6QDe1qLfZYCxwBI2ockWVSm5Uen5f2BQ0nm18hUbX0jAGV9PMSHmVmuzJJFRDQAF5PM2f0SyV1P8yRNlnRSuttlwL+lc3z/BpgUEUFyF9UASfNIks5NETEnq1ib1dQnNYv+rlmYmb1LplfFiLiXpOM6t+yqnOUXgQ+3clw1ye2znaqmLqlZOFmYmb1boTu4i0pzn0V/N0OZmb2Lk0WO2rQZqqyPaxZmZrmcLHK80wzlmoWZWS4nixyuWZiZtc7JIkdNvWsWZmatcbLIUVvXgAT9ejlZmJnlcrLIUVPfSFnvUkpKPC6UmVkuJ4sctfUNfsbCzKwVThY5qusanSzMzFrhZJGjtq7B40KZmbXCySJHTX0D/X3brJnZZpwsctTWN1Lm22bNzDbjZJGjps41CzOz1jhZ5Kitb3SfhZlZK5wsctTU+dZZM7PWOFmkIsI1CzOzNjhZpOoammhoCtcszMxa4WSRap5/2xMfmZltzski1TxLXplrFmZmm3GySL1Ts3CyMDNryckiVdM88ZEfyjMz24yTRaq2zjULM7O2OFmkNtUs3MFtZraZTJOFpAmS5ktaKOmKVraPlvSIpOckzZF0fM62/SQ9JWmepLmS+mUZa/P827511sxsc5ldGSWVAtcDnwAqgBmSpkXEizm7fRO4KyJ+IWkccC8wRlIv4HbgcxExW9JQYGNWsUIylwV4/m0zs9ZkWbM4BFgYEYsjoh64Ezi5xT4BDEqXBwPL0+VjgTkRMRsgIlZFRGOGsVKb3jrrPgszs81lmSx2Bl7PWa9Iy3JdDZwlqYKkVnFJWr4nEJKmS3pW0tdbewNJF0iaKWlmZWXl+wq2Jr11dpverlmYmbVU6A7u04GbI2IkcDxwm6QSkuaxI4Az039PkXRMy4MjYkpElEdE+fDhw99XIM2z5JWU6H29jplZd5RlslgGjMpZH5mW5ToPuAsgIp4C+gHDSGohj0dEVUTUktQ6DsowVmrqGylzE5SZWauyTBYzgD0kjZXUBzgNmNZin6XAMQCS9iFJFpXAdOCDksrSzu6jgBfJUG19gzu3zczakNlX6YhokHQxyYW/FJgaEfMkTQZmRsQ04DLgBkmXknR2T4qIAN6S9GOShBPAvRHx16xiBaipc83CzKwtmV4dI+Jekiak3LKrcpZfBD7cxrG3k9w+2ylq6xs84qyZWRsK3cFdNDxLnplZ25wsUjX1je6zMDNrg5NFKrl11jULM7PWOFmkauob3WdhZtYGJ4tUbX2DZ8kzM2uDkwVQ39DExsZwzcLMrA1OFrwzPLn7LMzMWudkwTuDCPpuKDOz1jlZkDxjAZ74yMysLU4W5CQLN0OZmbXKyQKoTZuhPP+2mVnrnCxwM5SZWT5OFrhmYWaWj5MFUFPvmoWZ2ZY4WQC1da5ZmJltiZMF79Qs/FCemVnrnCxIOri36V1KaYkKHYqZWVFyssBzWZiZ5eNkgeeyMDPLx8mCpGbhzm0zs7Y5WZCMOuvbZs3M2uZkAdTUuWZhZrYlmSYLSRMkzZe0UNIVrWwfLekRSc9JmiPp+Fa2V0u6PMs4a+sbPIigmdkWZJYsJJUC1wPHAeOA0yWNa7HbN4G7IuJA4DTg5y22/xi4L6sYm9XUNVLmu6HMzNqUZc3iEGBhRCyOiHrgTuDkFvsEMChdHgwsb94g6V+AV4F5GcYIJA/lDXCfhZlZm7JMFjsDr+esV6Rlua4GzpJUAdwLXAIgaQDwH8B/ZRjfJrV1jb511sxsCwrdwX06cHNEjASOB26TVEKSRP43Iqq3dLCkCyTNlDSzsrJyqwKob2iivrGJ/u7gNjNrU5Zfp5cBo3LWR6Zluc4DJgBExFOS+gHDgPHAZyT9ABgCNEnaEBHX5R4cEVOAKQDl5eWxNUGubx6e3M1QZmZtyvIKOQPYQ9JYkiRxGnBGi32WAscAN0vaB+gHVEbEkc07SLoaqG6ZKDrSCfvtyO4jBmT18mZmXV5mySIiGiRdDEwHSoGpETFP0mRgZkRMAy4DbpB0KUln96SI2KoawtYaXNab6844qDPf0sysy1EnX5szU15eHjNnzix0GGZmXYqkWRFRnm+/Qndwm5lZF+BkYWZmeTlZmJlZXk4WZmaWl5OFmZnl5WRhZmZ5OVmYmVle3eY5C0mVwGtbcegwoKqDw+koxRqb43rvijW2Yo0Lije2Yo0Lti62XSJieL6duk2y2FqSZrbngZRCKNbYHNd7V6yxFWtcULyxFWtckG1sboYyM7O8nCzMzCwvJ4t0iPMiVayxOa73rlhjK9a4oHhjK9a4IMPYenyfhZmZ5eeahZmZ5dWjk4WkCZLmS1oo6YoCxjFK0iOSXpQ0T9KX0/KrJS2T9Hz6c3wBYlsiaW76/jPTsu0kPSDplfTfbQsQ11455+V5SW9L+kqhzpmkqZJWSnohp6zV86TEz9LP3RxJmU2o0kZcP5T0cvref5A0JC0fI2l9zrn7ZSfH1ebvTtKV6fmaL+mTWcW1hdh+mxPXEknPp+Wdec7auk50zucsInrkD8mETIuAXYE+wGxgXIFi2RE4KF0eCCwAxpHMRX55gc/TEmBYi7IfAFeky1cA3y+C3+UKYJdCnTPgI8BBwAv5zhPJfPP3AQIOBZ7u5LiOBXqly9/PiWtM7n4FOF+t/u7Sv4XZQF9gbPp3W9qZsbXY/iPgqgKcs7auE53yOevJNYtDgIURsTgi6oE7gZMLEUhEvBERz6bL64CXgJ0LEUs7nQzcki7fAvxLAWOBZGreRRGxNQ9ldoiIeBxY3aK4rfN0MnBrJP4JDJG0Y2fFFRH3R0RDuvpPYGQW7/1lhWs9AAAGvElEQVRe49qCk4E7I6IuIl4FFpL8/XZ6bJIE/Cvwm6zevy1buE50yuesJyeLnYHXc9YrKIILtKQxwIHA02nRxWkVcmohmntIpru9X9IsSRekZdtHxBvp8gpg+wLEles03v3HW+hz1qyt81RMn71zSb59Nhsr6TlJj0k6sgDxtPa7K6bzdSTwZkS8klPW6eesxXWiUz5nPTlZFB1JA4DfAV+JiLeBXwC7AQcAb5BUfzvbERFxEHAccJGkj+RujKS+W7Bb6iT1AU4C7k6LiuGcbabQ56k1kr4BNAB3pEVvAKMj4kDgq8CvJQ3qxJCK8nfXwum8+4tJp5+zVq4Tm2T5OevJyWIZMCpnfWRaVhCSepN8AO6IiN8DRMSbEdEYEU3ADWRY9W5LRCxL/10J/CGN4c3m6mz678rOjivHccCzEfEmFMc5y9HWeSr4Z0/SJOAE4Mz0AkPazLMqXZ5F0jewZ2fFtIXfXcHPF4CkXsBE4LfNZZ19zlq7TtBJn7OenCxmAHtIGpt+Oz0NmFaIQNJ20F8BL0XEj3PKc9sXTwFeaHlsxnH1lzSweZmkY/QFkvN0TrrbOcCfOjOuFt71Ta/Q56yFts7TNODs9G6VQ4G1Oc0ImZM0Afg6cFJE1OaUD5dUmi7vCuwBLO7EuNr63U0DTpPUV9LYNK5nOiuuHB8HXo6IiuaCzjxnbV0n6KzPWWf04hfrD8ndAgtIvg18o4BxHEFSdZwDPJ/+HA/cBsxNy6cBO3ZyXLuS3IUyG5jXfI6AocBDwCvAg8B2BTpv/YFVwOCcsoKcM5KE9QawkaRt+Ly2zhPJ3SnXp5+7uUB5J8e1kKQtu/mz9st030+nv+fngWeBEzs5rjZ/d8A30vM1Hzius3+XafnNwIUt9u3Mc9bWdaJTPmd+gtvMzPLqyc1QZmbWTk4WZmaWl5OFmZnl5WRhZmZ5OVlYtyPpovTBpS5N0gBJFxU6DjNwsrAuRFJI+lHO+uWSrm6xz1nA0Iio7uz42iLpZkmf2YpDv0tyO2RbrztJ0nXvMZaiOS/WtThZWFdSB0yUNGwL+5QC38nizdMneDuFpDLgHxFxf6FjMQMnC+taGkimjby05Ybmb+8RcUtERPM3aEkfTQd4+5OkxZK+J+lMSc8omadjt3S/4ZJ+J2lG+vPhtPxqSbdJegK4TVI/STelxz4n6WOtxCJJ1ymZe+FBYETOtoPTeGZJmq5WRgGVdCLwCPANSQ9K2r61WNLdR0l6VMlcBt/OeY2vSnoh/flKaydT0tfS/+scSf+VlvWX9FdJs9NjT23PL8a6P387sa7memCOpB+8h2P2B/YhGXZ6MXBjRByiZPKYS4CvAD8F/jci/iFpNDA9PQaSOQOOiIj1ki4jGa/tg5L2JhmRd8+I2JDzfqcAe6XHbQ+8CExNx/X5P+DkiKhML8TfJRn5Ndc/gEPTpPcFkqE5Lmsllkkk4yftC9QCMyT9leQp388D40me4n1a0mMR8VzzG0g6lmRoikPSfaYpGSRyOLA8Ij6V7jf4PZxn68acLKxLiYi3Jd0KfAlY387DZkQ6Jo6kRUBz085coLlm8HFgXDL8DgCDcjrJp0VE83sdQXLBJyJelvQaycBxc3Le7yPAbyKiEVgu6eG0fC+SC/sD6fuUkgwr0dJOwK1KZrArAypztuXGAvBApAPZSfo97wwJ8YeIqMkpPxJ4Lue4Y9Of5rIBJMnj78CPJH0f+EtE/L2V+KwHcrKwrugnJOPw3JRT1kDarCqphGT2w2Z1OctNOetNvPM3UELybT63hkB6Ua/poLgFzIuIw/Lsdx3JbGd/S5u5vp2zrWUsLcfrae/4PQKuiYj/t9mGZPrN44H/lvRQRExu52taN+Y+C+tyImI1cBfJ4HPNlgAHp8snAb3f48veT9IkBYCkA9rY7+/Amek+ewKjSQa3y/U4cKqk0rRPorn2Mh8YLumw9Pjekj7Qyntsyzu1iXNa2Z7rE0rmYN6GZIa0J9IY/0VSmZLRgk9Jy3JNB85trj1J2lnSCEk7AbURcTvwQ5LpRc1cs7Au60fAxTnrNwB/kjQb+BvvvTbwJeB6SXNI/i4eBy5sZb+fA7+QNJekNjMpIupa7PMH4GiSvoqlwFMAEVGf3kL7s7QvoBdJLWlei+MnA/dIWg08TDLPc1ueIZnfYCRwe0TMhKTDn3eG8b4xt78ijeV+SfsAT6W1p2rgLGB34IeSmkhGXf33Lby39SAeddbMzPJyM5SZmeXlZGFmZnk5WZiZWV5OFmZmlpeThZmZ5eVkYWZmeTlZmJlZXk4WZmaW1/8HCwQqE+mGatYAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "Performance = []\n",
    "N = digits.data.shape[0]\n",
    "ind = np.random.permutation(N)\n",
    "for i in range(1,200,2):\n",
    "    clf = GradientBoostingClassifier(n_estimators=i, max_depth=4, random_state=0)\n",
    "    clf = clf.fit(digits.data[ind[:int(N*0.7)],:], digits.target[ind[:int(N*0.7)]])\n",
    "    Performance.append(clf.score(digits.data[ind[int(N*0.7):],:], digits.target[ind[int(N*0.7):]]))\n",
    "Perform = np.array(Performance)\n",
    "plt.plot(np.arange(1,200,2),Perform)\n",
    "plt.xlabel(u'Número de árboles')\n",
    "plt.ylabel('Accuracy')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Stacking"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Staking es similar al primer algoritmo de ensamble descrito en la clase anterior, en el que se usan modelos base diferentes entrenados sobre el mismo conjunto de datos. Sin embargo, a diferencia del ensamble de modelos en el que la decisión final se toma en consenso entre los clasificadores base (**voting**), en Stacking la combinación de los modelos se realiza usando un modelo adicional (meta-modelo), en un areglo de dos capas. En la primera capa se entrenan los modelos base y en la segunda se entrena un nuevo modelo que toma como entradas las salidas de los modelos en la primera capa y produce la decisión final.\n",
    "\n",
    "<img src=\"./Images/Stacking.png\"\n",
    "     alt=\"Árbol de decisión\"\n",
    "     width=\"500px\" />"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAXwAAAEICAYAAABcVE8dAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjMsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+AADFEAAAgAElEQVR4nOydeXhTZfbHP2+S7hulZS9tyg5lqVAWURRkKyrgzmhRGHUQFAcdndEZ3Mf+xm0ccZRxGHepKC4oCpQdxQUBEdl32lJka4G20DXJ+/vjJm3aJm3aJk2bvp/n6UOae3Pfcy/Nueee95zvK6SUKBQKhcL30XnbAIVCoVA0DsrhKxQKRQtBOXyFQqFoISiHr1AoFC0E5fAVCoWihaAcvkKhULQQlMNXNGuEEO8KIZ51su0NIcTjXrCppxBiuxCiQAjxx0Ye+ykhxEIX990ghLjb0zYpmg7K4Ss8ghDiciHED0KIPCHEWSHE90KIwdZt04UQ33naBinlTCnl3z09jgP+AqyXUoZJKV/1wvgKhUOUw1e4HSFEOPA18G+gNdAJeBoo8aZdjUgcsNvbRigUVVEOX+EJegBIKRdJKc1SyiIp5Sop5Q4hRG/gDeBSIcQFIcR5ACHENUKIX4QQ+UKIY0KIp+wPaPfEcN66fXrVQYUQYUKI9UKIV4VGebpHCDFSCJEthHhICHFaCHFCCPF7u89GCSG+so6/RQjxbE1PIUKISUKI3VZ7NljPCyHEOmAU8Jr1/Ho4+OwG6/F/sO7zlXX8NLvxjXb7D7e+l2f9d7jdtnghxDfW9NFqILrKWMPsrtuvQoiRTs6nm/U4eUKIHCHEx87OXdF8UQ5f4QkOAGYhxHtCiAlCiEjbBinlXmAm8KOUMlRK2cq66SJwB9AKuAaYJYS4DkAIEQesQHtiaAMkAtvtBxRCRAFrge+llH+UjjVD2gMRaE8cdwGv29n2utWG9sA0649DrE58EfCA1Z7lwFdCCH8p5VXARmC29fwOODnM74DbrbZ0BX4E3kF7ItoLPGkdqzWwDHgViAJeBpZZzxfgQ+BnNEf/d3u7hRCdrJ991nrch4HPhBBtHNjzd2AVEAnEoF1rhY+hHL7C7Ugp84HLAQn8DzgjhFgqhGhXw2c2SCl3SiktUsodaA71Suvm24A11ieGMillrpTS3uF3BL4BPpFSPlaDaWXAM9ZjLAcuAD2FEHrgRuBJKWWhlHIP8F4Nx5kCLJNSrpZSlgEvAUHA8Bo+U5V3pJSHpZR5aDezw1LKNVJKE/AJcIl1v2uAg1LKD6SUJinlImAfMFEIEQsMBh6XUpZIKb8FvrIbYyqwXEq53HpdVwNbgaudXJs4oKOUslhK6fE5FkXjoxy+wiNIKfdKKadLKWOAvmhO+RVn+wshhlrTMWeEEHloTwG29ERn4HANw12D5nDfqMWsXKtDtVEIhKJF6QbgmN02+9dV6Qhk2n6RUlqs+3eqZXx7Ttm9LnLwe6ijsaxkWsfqCJyTUl6sss1GHHCzNZ1z3po+uxzo4MCevwAC2GxNVd1Zh3NRNBOUw1d4HCnlPuBdNMcPWuRflQ+BpUBnKWUEmvMW1m3H0NIezvgfkA4sF0KE1MPEM4AJLZVho3MN+/+G5kwBEEII6/7H6zF2bVQay0qsdawTQGSVc461e30M+EBK2cruJ0RK+VzVQaSUJ6WUf5BSdgTuAeYLIbq591QU3kY5fIXbEUL0sk6Oxlh/7wzcCmyy7nIKiBFC+Nt9LAw4K6UsFkIMQUvj2EgDxgghbhFCGKwTnIlVhp0N7EfLpQfVxV4ppRn4HHhKCBEshOiFNp/gjMXANUKI0UIIP+AhtAqkH+oyrossB3oIIW6znvsUoA/wtZQyEy1F87QQwl8IcTkw0e6zC9FSP+OFEHohRKB18jqm6iBCiJvt3j+HdlO2eOB8FF5EOXyFJygAhgI/CSEuojn6XWiOEWAdWtniSSFEjvW9e4FnhBAFwBNoThUAKWUWWt75IeAs2oTtAPsBrZO0M4Bs4EshRGAdbZ6NNqF7EvgAbQ7BYRmplHI/Wn7830AOmpOdKKUsreOYtSKlzAWuRTv3XLTUy7VSStt1uw3tWp9Fm+h93+6zx4DJwN/QnmKOAX/G8fd+MNr/1wW0J605Usoj7j4fhXcRagEUhaI6QojngfZSSqfVOgpFc0NF+AoF5Wmo/tb6/SFoZZtLvG2XQuFODN42QKFoIoShpXE6os0x/BP40qsWKRRuRqV0FAqFooWgUjoKhULRQmjSKZ3o6GhpNBq9bYZCoVA0G37++eccKaUj+Yym7fCNRiNbt271thkKhULRbBBCVO3MLkeldBQKhaKFoBy+QqFQtBCUw1coFIoWQpPO4SsUCt+nrKyM7OxsiouLvW1KsyIwMJCYmBj8/Pxc/oxy+AqFwqtkZ2cTFhaG0WhEEx5V1IaUktzcXLKzs4mPj3f5c25J6Qgh3rYuG7fLyfaR1qXTtlt/nnDHuC2VtLQ0jEYjOp0Oo9FIWlqat01SKOpNcXExUVFRytnXASEEUVFRdX4qcleE/y7wGnZKfQ7YKKW81k3jtVjS0tKYMWMGhYWFAGRmZjJjxgwAUlJSvGmaQlFvlLOvO/W5Zm6J8K1Lq511x7EUNTN37txyZ2+jsLCQuXPneskihULRXGjMKp1LhRC/CiFWCCESnO0khJghhNgqhNh65syZRjSveZCVlVWn9xUKhWukpqaSkJBA//79SUxM5KeffuKVV16pFmC5yrvvvsvs2bOrvf/GG2/w/vs1JUM8R2NN2m4D4qSUF4QQVwNfAN0d7SilXAAsAEhKSlLKblWIjY0lM7N6I11sbKyDvRUKhSv8+OOPfP3112zbto2AgABycnIoLS1lypQpTJ06leDgYLeNNXPmTLcdq640SoQvpcyXUl6wvl4O+Akhomv5mMIBqamp1f74goODSU1N9ZJFCkXz58SJE0RHRxMQEABAdHQ0n376Kb/99hujRo1i1KhRAMyaNYukpCQSEhJ48sknyz+/ZcsWhg8fzoABAxgyZAgFBQWVjr9s2TIuvfRScnJyeOqpp3jppZcAGDlyJI888ghDhgyhR48ebNy4EdDStLfccgt9+vTh+uuvZ+jQoW6RmWmUCF8I0R44JaWU1sUldGjLtSnqiG1idu7cuWRlZREbG0tqaqqasFX4BE9/tZs9v+W79Zh9Oobz5ESnWWQAxo0bxzPPPEOPHj0YM2YMU6ZM4Y9//CMvv/wy69evJzpai09TU1Np3bo1ZrOZ0aNHs2PHDnr16sWUKVP4+OOPGTx4MPn5+QQFVSyrvGTJEl5++WWWL19OZGRktbFNJhObN29m+fLlPP3006xZs4b58+cTGRnJnj172LVrF4mJVZdwrh9ucfhCiEXASCBaCJGNtramH4CU8g3gJmCWEMIEFAG/k0qIv96kpKQoB69QuJHQ0FB+/vlnNm7cyPr165kyZQrPPfdctf0WL17MggULMJlMnDhxgj179iCEoEOHDgwePBiA8PDw8v3XrVvH1q1bWbVqVaX37bnhhhsAGDRoEBkZGQB89913zJkzB4C+ffvSv39/t5ynWxy+lPLWWra/hla2qVAoFE6pLRL3JHq9npEjRzJy5Ej69evHe++9V2n70aNHeemll9iyZQuRkZFMnz691jr4rl27cuTIEQ4cOEBSUpLDfWxpJL1ej8lkcs/JOEFp6SgUTRjVZNc47N+/n4MHD5b/vn37duLi4ggLCyvPx+fn5xMSEkJERASnTp1ixYoVAPTs2ZMTJ06wZcsWAAoKCsodd1xcHJ999hl33HEHu3fvdtmeyy67jMWLFwOwZ88edu7c6ZbzVNIKCkUTRTXZNR4XLlzg/vvv5/z58xgMBrp168aCBQtYtGgRycnJdOzYkfXr13PJJZfQq1cvOnfuzGWXXQaAv78/H3/8Mffffz9FRUUEBQWxZs2a8mP36tWLtLQ0br75Zr766iuX7Ln33nuZNm0affr0oVevXiQkJBAREdHg82zSa9omJSVJtQCKoqViNBodluDGxcWV53p9gb1799K7d29vm9GkMJvNlJWVERgYyOHDhxkzZgz79+/H39+/0n6Orp0Q4mcppcP8kYrwFYomimqya7kUFhYyatQoysrKkFIyf/78as6+PiiHr1A0UVSTXcslLCzMI8u7qklbhaKJoprsFO5GOXyFoomSkpLCggULiIuLQwhBXFwcCxYsUBO2inqjUjoKRRNGNdkp3ImK8BUKhaKFoBy+wq2oRiFFc0Sv15OYmEhCQgIDBgzgn//8JxaLhZUrV5KYmEhiYiKhoaH07NmTxMRE7rjjDm+bXC9USkfhNlSjkKK5EhQUxPbt2wE4ffo0t912G/n5+Tz99NOMHz8e0JQtX3rpJacSCc0BFeEr3IZajUvhC7Rt25YFCxbw2muv0ZQbU+uDivAVbkM1CikazIpH4aR7dGPKad8PJlRXvqyJLl26YDabOX36NO3atXOvPV5ERfgKt+GsIUg1CikUTQMV4SvqTanJwuvrD3Eyr5gbBnYiNTW1Ug4fVKOQoo7UMRL3FEeOHEGv19O2bVtvm+JWlMNX1Jtnvt7Nwk1ZGHSCvKIy3rhdrcalaP6cOXOGmTNnMnv2bIQQ3jbHraiUjhdpriWM3xw4wwvp+1i4KYt7ruzCwNhIzhWWAlo1TkZGBhaLhYyMDOXsFc2CoqKi8rLMMWPGMG7cuEpr1voKKsL3Es21hPH4+SKmvb0ZgNG92vKX8b24N+1njuZc9LJlCkX9MZvNte6zYcMGzxviYVSE7yWaawnjyTxtSbcXb+rP/+5IQq8TtA7x51xhmZctUygUtaEcvpdoriWMuRdKAOjVPhydTstvtgr259zFUp+rWVYofA3l8L1Ecy1hzL2o5eqjQisWY2gd7I/JIiko8ewCzAqFomEoh+8lmqvWuS3Cbx1S4fBbBfsBcP5i46d1TGYLFot6slAoXMEtDl8I8bYQ4rQQYpeT7UII8aoQ4pAQYocQYqA7xm3ONFet89yLpYQFGAj00wPa5POf/zgLgKTLRxIdHd2oVUfD/rGWae9s9vg4CoUv4K4I/10guYbtE4Du1p8ZwH/cNG6zpjmWMP686wB5p48jhEAIwdSpUzmReQiAglILubm5SCnLq44cOf20tDSio6PLjxEdHV3nm4OUkvsX/ULOhVI2Hsxxy7kpFL6OWxy+lPJb4GwNu0wG3pcam4BWQogO7hhb4X6c9QekpaWx+dc9lF08V2l/S1EBAPqg8ErvO6o6SktL4/e//z25ubnl7+Xm5nLnnXe67PSllPxr9QG++vU3AHq1D6vbCSoUVQgNDa323lNPPUWnTp1ITEykT58+LFq0yAuWuZfGyuF3Ao7Z/Z5tfa8aQogZQoitQoitZ86caRTjFBXY+gMyMzOrRepz584FIZDmypOzlsI8AHRB1R1v1aqjuXPnUlZWPddfWlrqcknqmr2neXXdISKC/BhibE2wv97V01Mo6sSDDz7I9u3b+fLLL7nnnnsc/u02J5rcpK2UcoGUMklKmdSmTRtvm9PiqKk/ICsrC4QOqpRfWkoKkRZztQgfqlcd1VR2WltJqsUimTBvI7MW/kxEkB8bHh5JoL8eNWer8DTdu3cnODiYc+fO1b5zE6axOm2PA53tfo+xvqdoYtTUHxAbG0uxEGCp2pUosRQVoKvi8B1VHcX26k/xwBRKju3m/LfvVd5WS0nqucJS9p7IZ0T3aO4b1Y3IEH8EqPp/H+L5zc+z7+w+tx6zV+tePDLkkQYdY9u2bXTv3r3Zi6k1VoS/FLjDWq0zDMiTUp5opLEVdaCq0xUG//L3U1NTETq9QwdrLsonKCKaqKioGquOJs2cS2BMH8KH3lDpfX9//1pLUm09AAW/ruLyHu0QQpCevoKMzMw6n2dzIa+wjB8O5WAyW7xtSovkX//6FwkJCQwdOrTJd8G7glsifCHEImAkEC2EyAaeBPwApJRvAMuBq4FDQCHwe3eMq3A/9hLHgXEDaPe7VArW/4/UP95MSkoK/z38JUcOVERgUVFRzJs3jy8K4tHrEvlo8dOYLRKL9aZQVsVRGdp1h99sD3cCkOXHqK1KKcfaA5D+5Sfl2ifSYuH0mRzuvfde5s+fz6HTBZwp0G4MEuuNye7+1DcmgvBAv3pencZBSsk/Vx3g5qQYXl17iM+2ZXPToBheunmAt03zOA2NxN3Ngw8+yMMPP8zSpUu56667OHz4MIGBgd42q964xeFLKW+tZbsE7nPHWIqasU2u1lee2Lbv3LlzKRk5HYCrb76dlJQbAWgdFU3cqJF8sLBylP/N+1vZdCSX37+zme8P51JqqjkiFTo9uReKKzVw1UbuBc2R2yaJAZAWhBC88cYbLF+1DnnDCwid80ncrm1CeHpSX5KMkeW9BE2NnAulvLb+EB9tOUa0taP505+zeeya3rQKdv16KdzHpEmTeOutt3jvvfe45557vG1OvfFJtczPD35Or9a96N26d6PrWR8/X8SN83/gohdkBkrLyigq8ofrXyAGsAB/3Sp4ZvfX+PvVJaqNJmzaf8F6Dpf071u+RUqJzsE1HZfQnszcQn47X8w1/TrQtU2I06ObLJJX1hzkTEFJHR2+FuGbL56veFNKEDqklBw7eYrOOj35m5dQeOgn/P39+cuf/8zYsWMBOHzmInO/2MnUt35iaHxrbh2ipa+Gd42ibXjTidpsKbOcCyXkF5XRNiyA0wUlnCssUw7fQxQWFhITE1P++5/+9Kdq+zzxxBPcdttt/OEPf0Cna3L1Li7hcw6/sKyQf/z0D4rNxcSGxZIcn0yyMZnukd0bZfxjZws5mV/MhL7t6RAR1ChjAuzbt5eVK1chZfXIWhceTsqdd9X5mIF+OuZvOFypCkYCOgf30JsGxXDToJjqGxyw6UgucJCcCyX0xPUa+tyLpUiLGUvxhQp7pAWsNyAhtC9h2dlsSo7togR4evbtxL/7LikpKQztEsXwrlEs23mCF1fu56ejWuvIiO7RfHDXUJft8DQmuwtearYwKC6SFbtOcqFYaRV5Coul9jmSQYMGsX///kawxnP4nMMP9gtm9U2rWZO1hvSMdN7c+SYLdiyga0RXxsePJ9mYTHxEvMfGt+Wupw03MqxLlMfGsZGWlsacOXMqNTJV5bwQPLHkn/U6/v82Hik/J9DOz1GEXxfahAUAsG7faZ5aupu8osq1za2C/fhk5nAigvwwWyQPLd7O0dxCjp0tJAATVL2p2eyx/Wu33WQyMXfu3PJUlTE6hPtGdePGgTEUlZlZvPUY/9lwmF6Pr9AOgUAIaBceyIo5I7yS9jGZK653j3ahjOndjhW7TlJQ3LxrwBXex+ccPkCrwFbc1OMmbupxEzlFOazOXE360XTmb5/P/O3z6dW6F+ONmvOPCXMtKnUVKaETZwg5fwBORbj12FX5etkyXnn6KdrrimnfxvkjZseOHeHUnnqN0YNsWl+UcEpzop3LMmhTFginnKdsaqN9qYleumNs/P4Y0SH+XNOldfm2U3nF/Jx1ntwjQUREh5JbUMyeXzcTHx1CYodALhnSip1Ft/Lpp59gNltoHZjDb3pb07Z2DapWETkqNW0foaVw7hvVDT+doMRkKZ/b3XeygG8PnCH3YimdWjXeU5oNkzXanPe7RCYndmLXcW3OQqmRKhqKTzp8e6KDorm1163c2utWTl48yaqMVazMWMm8bfOYt20e/aL7Md44nvHG8bQPad/g8QLP7ef7wDlaIaqHuRa49vcGoHpbeGXy4T+X1muMZX7ATusPVhGkfBqkhhQCpNtS0SbgQJUdAoBPtJdtgVUBQIH1Jxuui4LH77EpjX7MBnmQUeAwwoea6/tDAwz8aVzPSu999nM23x4447VSSLM1paO35s7CArWvqS+ndKSUPrd+rKepT/+Jzzt8e9qHtOeOhDu4I+EOsguyWZmxkpUZK3lp60u8tPUlBrYdyHjjeMYZxxEdFF2vMQzFWmrlt0sepGO3RHeaX42bb7mlxv90nU7H7NmzuWLEiHqPMeej7VzZsw03XKIpYfx92V7ahQUw44ou9T5mTew9mc+raw/x0LgedGsTyp4T+fx73SEeHteDrm2q39iylz5D27ILjB49mm+2WsVa7a6JwWCoVN/vShWTn8E6F2D2TkOXbVxDucPXJtx9NaUTGBhIbm5ueQ+HonaklOTm5ta5RLRFOXx7YsJiuKvfXdzV7y4y8jJIz0hnZcZK/rH5Hzy/5XkGtxvM+PjxjIkdQ2RgpOsHturMXOh4GSSM9ZD1GlsudiTTSdNRcHAwCxYs4IoGKnCuEYG0aRXLDQl9APh2ZSTdwkIhYVCDjuuM/KBcVlg2MTVmKN26RXOg9DgrLFH8OeFKcODwz61YQGDZcdasWcO0+x7mGyh3+KGhobzxxhvlDt3VdYT9rI62ag9BY2GL8A3WSpCQAG0e4YKPpnRiYmLIzs5GaWfVjcDAwEqVRa7QYh2+PcYIIzMHzGTmgJkcOneI9Ix00jPSeebHZ0jdlMqwjsNINiZzVexVhPtX14uphFV2oKZa8LpQU0Rq3yRlj6uNTK6gE6JSlY47Jm1rwt8aXZdanW35ClshAQ73Nwl//KUW+T751FNc9c9vSEtbyOTE6tp8NekEVXL4es0Gk5cifFsOX6/XrnOAQY+/QeezOXw/Pz/i4z1XSKGooHkWk3qQbpHdmH3JbL667isWX7uYaQnTyMjL4PHvH2fkxyO5f939LDuyjItlFx1+Xkqbw2/YvdSmGT916lSHypXgeBGVhQsXkpOT4zZtfSGoVKUjZUWq3BPYnK2tcevsxRL0OlGex66KSeePv7Q2ZFnNdHZDcnUdYYPV0dpuOsfPF5F9rrDa5zyFyVI5pQMQHmjw6Ry+onFQEb4ThBD0jupN76jePDDwAXbm7CxP+2w4toEAfQBXxFxBsjGZETEjCDJYqzks1i+lvv6XtmrqwZ6qEWlKSopHF07R6USleQKtDt9zHj/AUNXhlxIZ7F++YHpVTDp//NEifJudzuyLjY11mAKrOqlbEeFrNjy2ZCdlZsnCuxunVt9krpzSAW1yee+JfD7fls2onm2JrEPDmkJhQzl8FxBC0L9Nf/q36c/DSQ/zy+lfSD+azqrMVazOXE2QIYiRnUeSbEwmzFysfagBKR1HqQd7apMRdicCHKR0PDeefxWHf+5iGa1DnHcJm3X++FM1wne8r6MUmCNFT5vDt02e5hWVUVhaVSHUc5Tn8PUVJ9K5dTAbD+awLes8s0d14+HxPZ19XKFwis87/IWbMtl+TGvFt1gkORdLefmWAUSHOs4J14ZO6BjUbhCD2g3ikSGPsPXUVtKPprMmaw0rjq4gWPgzJro1iQV7iLMMxE9Xd6Gu2hx6bTLC7kTL4bu38aomqubwC8vMBPs7/zM1iQD8MJXbBjit9LDXCaqpSsfmaMusufRSs4WCRkynlOfw7e5c/7sjiTMFJUx+/fvyeQ3QbowSSYChaeoCKZoWPu/wX1lzgMJSM5HB/hw/XwTA1oxzJPdteM29QWdgWIdhDOswjLnD5vLTiZ9I2ziPdSHFLD3wMq9mvs3o2NEkxyczuN1g9E6i/nvvvZcFCxZgNpvR6/WEhIRw4cIFh/s6ikg9iRDCXmwSi8W5Q3UHFdG15vSKS80E1dDtatYFEEgpyAqFzpqeQFxJgflXmbQtNVkatULGNq6fXUon0E9P59bBRAT5VSrPnPrWT+QUlLDu4ZGNZp+i+eLzDt9skdw0KIZnJvcl90IJg55dw4m8IreP46fz4/JOlxMasoM++1bx+YRX2Vaym+VHl/PZwc+ICoxibNxYkuOTuaTtJeisui/33nsv//lPRReT2WzmwoULGAwGTKbKTsad1TeuohOVGzxkI6d0CstMtAtzXmtstj1BmUvLy+8b+gRSHuFbbzo2h99YzUGmKo1X9oQGGCgoNrFwUyY5F0rYbNUDenPjEUICDOh1gvEJ7YkIatoS0Arv0CIcvs0BtA7xJ8Cg40ResecGtJjwB4ZFD+N3XadRZCpiY/ZG0jPSWXJoCR/t/4i2wW3xO+zHd299x8VDjqt9zGYzcXFx9ZY5dhc6IbDXlbJ4uErHFl2XWB1+UamZwBrWrDXrrKk5U3FFhN/A2jPbZKm9wzdbJCUmS6No6zjK4dsICzTwS9Y5vjlQuWb92WV7y19fKDZx5+WqzFFRHZ93+BZZEfEJIegQEchv590f4ZdjK8vUa44hyBDEOOM4xhnHcbHsIhuObeCFpS9wss1J4h+Lp/RMKXmb88j7KY/irIobkZSSjIwMz9npIroqZZkez+FXKcssLrPUmNIx6azVKqYSLFJ73dAo3L/KpK1tPqFX30SyDu72+A3YlsM3OIjwwwIN5FvnE9LuHsqlXaK4WGriYomZ4jIzI1/aUG6vQlGVFuDwJXq7iK9DRBB7TuTzydZjHhnPcCqPREA4mKz9YvEXzJ07l8zMTHTBOsIHhhMxJILo5GjaXNOGkpMl5P2kOX/TqaZRcy2qNF5JPJvD1+kEBp0oj66LymrO4VsqRfjaNW+odbbI2laWeaGwBBAcP3O2Uj8E4BGn76gs00aY3Wpd7cID0ekEYYF+hAX6UVymBRuWemisKFoGPu/w7VM6AD3bh/HjkVz+/OkOj4w3XZ/L9X6gqzJBW7W23lJo4fx35zn/3Xn0oXrCB4UTMTSCNhPb0HZyW4ILg3nj1zdINiZjjDB6xFZX0OkaN4cPWh6/PIdfaiK4hpSOSV8R4UupSS809AmkfOLYeqcrLi0Dgz86/wrlTEcduu6iXDzNSUrHhk1m2ka5dpzy9won+LzDt0hZqWnn8Wv7cJeH8psfbcmi+FtrvXaVxquaauvNF8yc++Yc5745h3+kPxPmTCBiSASvb3+d17e/Tu/WvTU55/hkOoVWlwzwJIKqZZmebbwCq8M3W7BYJMVlNefNK0f42suGO3zrpK3JgpQSqTcgABEQXGk/T/VD2MpB/RymdLQI36AThFfpPhbWZ5v6qCgqWgYtwOGD3s4B6HWCzq2Da/hE/YkM9uc02pdVVHH4rjiHWbNmMX/+/PLfT148Wa7o+cq2V3hl2yv0j+5fLufcLtIlhfQAACAASURBVKSde0/AATpB5bLMxojw9VqEb5u4Dapx0tYuh2+pvSzTFQy2skyLBZNFlq+kpfOv/HfjqX6IqvLI9ticfJCfvlpqzba7Rfl7hRN8XktHS+k0zlg6ITDYHH6VlE5NzkGv11dz9qDJOU9LmMaH13zI8huWM2fgHEotpby49UXGfjqWaSumsWjfInKKctx/MlaqiadZPF+a6Gd1+EXWnHSNOXx99Qi/ofaVR/hmWWkxdp1dhO/Jfoiacvjh1nLLcAdll7YnGxXgK5zh0w6/XFulkTy+ToAezUnp9JW/kKmpqQQHV44Qg4ODWbhwISaTqZqzr0rnsM7c3e9uPpn4CUuvW8qsxFnkleTxfz/9H6M/Gc3dq+7m0wOfcr74fI3HqSuNLZ4Gmp5OqdlCYak2cV1b4xVgzeG7J8L3syvLtHf40e1jykXqFixYUEl22Wg0otPpMBqN5eJ29aW8SsdBDn9s73ZMH27kkQm9qm0T5RG+8vgKx/h0Ssdc/ojfOA5frxPohfZlrTpp62pbvyvER8Qza8AsZg2YxcFzBzU556PpPP3j09XknMP8XV8k3BE6UVk8zdNlmVAxaWurOqkxpWM3aWux7tbQG7xOJ9DrBCazrFTi+Oe5T3Dfmvcr7euqxn5dqKnxKjLEn6cmJTj8nO3JRrl7hTPc4vCFEMnAPEAPvCmlfK7K9unAi8Bx61uvSSnfdMfYNWGWzr84nmDLli10x4JJ6hgyZAipTzxa6UvvCWXL7pHd6R7ZndmJs9l7dq+m6Hl0JY99/xh+P2rdv8nGZEZ2HkmwX93nLhw1XjVKlY7ZQlGpNYdf46St1eHv/pyO+m3M1B+jw85fIbtha9HO0u9n0LFIAkQkM/WHAUg4EgV+bSrtd2zR88y+xATYq1eaOLboIYg7Xa+xB2TkMFOfg/+mA3WuMf2D4SCBJbfXa1yF79Nghy+E0AOvA2OBbGCLEGKplLLqqtkfSylnN3S8uuCuVntXSEtLI23hxzw7LhwzOo4dy/JorXZVhBD0iepDn6g+PDjwQXbk7NAUPTNWsf7YegL1gYyIGcGE+AmM6DSCQINrS6NVS+nQCBF+1Rx+DRF+YUAb8mUw4Ts/oQvwqB/wc8NteFiP9tecbT0mwDHrjx2PJgE4upZFsOapeo19GXCZH7C27p+da4D1Z6KB+q1hrPBt3BHhDwEOSSmPAAghPgImA1UdfqNjdlPVhivMmTOH0k4D0ROKGT3IMgqLPFerXRNCCAa0GcCANgP48+A/s+3UNtIz0lmduZrVmasJNgQzsvNIJsRPYHjH4fjrnWurV2280qQVPJ/S+eFwLpuO/AhQYx1+qV8El5T8l8N/H8s3+88wY+HPLL7nUgbERDTIhmH/t4YJ/TpyS1IM183/AYDJAzrywk39K+3Xs1cvhxVYsbGx7N+3r15j/2v1ft78LoPdT4+v2wdNxfC8EZ2ltPZ9FS0Sdzj8TlSOe7IBRytF3CiEuAI4ADwopXTY6iqEmAHMgIaXvVkaIaWTlpbGnDlzyM3NJaSjRI8FEzqQWjqiMbXrHaETOpLaJ5HUPolHhzzKlpNbWJmxkjVZa1h+dDlhfmFcFXsVE+InMKTDkGpyztqla9zGq+nDjbQPD6R9RCARQX706+TceesEmNEjDYGY9AGU4I/wCwS/hqV0zIYgivGjRGjHBDhbqq903Oxzhcz823M8+eSTFBdXyGIEBgYyZMJ1GAeN4rcTJ+jYOozUJ/7q8o2/WARg1gfU/Rysq6wJqaQVFI5prEnbr4BFUsoSIcQ9wHvAVY52lFIuABYAJCUlNWj+yZZ79lREWm1lKosFPWYs6MonOhtTu742DDoDl3a8lEs7XsrcoXP58cSPrMxYydqstXx5+EtaBbRiTNwYko3JJLVLQq/TO1jT1vMpsnEJ7RmX4Jp8tc0Wi6x9icO64K/XVSvLvFBSIUu8MzuPia99B4TTeuq/qn1+I8DVV9IRsBRfYOodKcyZM8cltVOTWTosyawVoT0JCdl4i7UomhfucPjHgc52v8dQMTkLgJQy1+7XN4EX3DBurZRP2nrIP1XrnpUWDJgxoccWFTemdn1d8NP7cUXMFVwRcwUl5hK+O/4dK4+uZNmRZXx64FOig6IZGzeWUkNHzLKiBNAipcfLMuuCzRRpp4fvDvsMelGpLDMs0FBJE//g6QIAnp6UQFRo5ZTY7PtmcyZHU7MM6NSH8KRJGCLakZv7m0vzOmaLrN9TqfUmoRy+whnucPhbgO5CiHg0R/874Db7HYQQHaSUJ6y/TgL20gh4MqWTlpZWbX1UKSU6LJjRgZRERUV5RdK4rgToAxgdO5rRsaMpMhXxbfa3pB9N5/ODn1MSXMIZGcmLWyYy3ji+0TThXcVWgmmRta9pWxf89DprWabmPKNC/CstIm5TXJ0yuHM16YdJ339Rbou5IEdz+JEdMZ37zSUNHpPFUt78VVfKpF45fIVTGuzwpZQmIcRsYCVaWebbUsrdQohngK1SyqXAH4UQkwATcBaY3tBxXcHWau9uB2VL5VRDWjBYHX5QUCDz5s1z67iNQZAhqFy64WLZRSa//V+K/Lfx4b4PeX/P+4R0bc3P+Vey7+xt9Izs6XXnb99s5M6UjkEnyC8u41R+CaCtpZB1tuJp7vj5YqJC/B3q/Ngvll529jcA/CI7Ysvy1zavYzLXM8IHLOhUDl/hFLd02kopl0spe0gpu0opU63vPWF19kgp/yqlTJBSDpBSjpJS1q98oY54qg7fqRCatKAXZsxSz+uvvdYsovuaCPELoZVlGEbzbDbcsoGnLn0GS2k0Oy98yc1f3cykLybx+vbXOXz+sNdstJcTsD3RjR83tsFdryEBBjYezOGvn+8EoEOrIHIulNJj7gp6zF3Bos1ZBAc4rh6y76q2FOVjKS2i9ZgZ6MOigdrndUyWeubwATM6hEVF+ArH+HSnrS3i07s5CnUWoUlrhG9Cx2233urWMb2FENrkd0RABJO6Tuaht/25c3Q74mKPsDJjJf/99b+88esbdGvVjWRjMsnxycSFxzWafTq7CH/jxu+AEI4fP95g3fr/u74f24+dAzRRvF7twzFGBWORmormm98dpaTMcSRtG8tWvXXh15WED74O/zZGhLmw1nkds0U6lFVwBbPQqZSOwik+raVTkdJx73GdRWhto6PRY8GMvtEE2zyNtoi5dh1tEXSwoRW39LyFt8a/xdqb1/LokEcJ8w/jte2vce2Sa7nlq1t4e9fb/HbhN4/bV1GlI/l48WLtTbuUhi1nXld6tg9jyuBYpgyOZVxCe2Kjgvnz+F48ktyLx67tw6u3XsKCO5Kcfj4lJYWcnBwWLlxI+AmtE6xtXLdyDZ6a9HfKzJaGpXRQKR2FY3zb4XsopeNMCG3q1BT0mDGjazT9Hk+jLXGovXbUudwmuA0pvVN4f8L7rL5pNQ8nPYxe6PnXz/9i/GfjSVmewgd7PuDUxVMesc9ePyYn92xlQ614ohdi0oCOJHZuVet+KSkp7Pt1CwAPP/ZMubOfMWMGmZmZlZ5E0tLS+GTrMXZk5zlc3tAVzKgIX+Ecn3b4nhJPS0lJYcGCBcTFxVVST7xq1EjrpK2+SZUuNgR78bTyRcKdnJtNznnRtYvK5ZxLTCW8sOUFxn46lunp0/lo30fkFuU6PkA9KC/LtEB0dHTFL3Z4uxci0E9PeKCBMwXaBLCjOSDtSeQxHv9yF6cLihlsbF2vsSyoKh2Fc3w8h+85eWRHQmjr959GjxkTOq9Xr7gL+8arCr352j9nk3O+u9/dHMk7wsqjK0nPSCf1p1T+sfkfDGk/hGRjMmPixhARUH8ZBPsc/o033cxn2ZVXfPKkbn1daBMWwJkLmsN39sRxPK+YTmUW/nFDP24dUr+blIrwFTXh4w5f+9fdk7bO0AuBxILFhx6c7MXTLPWsc+8S0YVZibOYOWAmB88fJP1oOukZ6Tz141M8u+lZLu14KcnxyYzqPKrOcs4VdfiSoUOH8Vn2DmI6dSSr4EyDJKjdTZuwAPadKGDR5ixiR/6O3LNnq+0T1Wc4AN3bhtZ7HFWWqagJn3b49RFPS0tLq7dmveYIbZ22voF9hC8bKFUhhKBHZA96RPbg/kvuZ8/ZPeWR/9zv5uKv89fknOOTuTLmSpfknEX5pG3FDenHH3+gQ0TDtHTcTc92YWw6clYr8xySQlQN+w7rYySmbet63aws6NCpCF/hBJ92+HVN6TR0MQudAJ2wdtr6CEJUpEhs1TruyJAJIUiISiAhKoEHBj3AjjM7ytfvXXdsHYH6QK6IuYIJ8RO4vNPlTuWcbbZINzdeuZsnJyYwa2S38t8/X/I5Lzz/PMePH6dTp05cddVVLPlmG0TFYy4qIDOzoF4lpWaVw1fUgG87fGtE6qoDcD6Z5prEsU4n0GHBJH0rwpdVcvjudqg6oSOxbSKJbRN5OOlhtp3exsqMlazOXM2qzFUEG4IZFTuKCUZNztnPbvlInV2Vjju1dNyNTidoH1Fx07p3+m3cO71CgcRoNHI+MxP4tvy9uvzt2VApHUVN+LTDr+i0dW1/Z5Nprpb1aYuYmynGub58c0PnMIfvufH0Oj2D2w9mcPvBPDrkUTaf3KzJOWeuYdmRZYT5hzE6djQTjJqcs/2krW2qtilG+LXh7G8sMzMTnU7ncnrRohqvFDXg0w7flUlG+5y9TqfDbK7+ZXG1rE+vw9p45UspHfsqHc9oEznDoDMwvONwhncczmNDH+PHEz+SflRbyOWLQ18QGRBJfPAw9MExlFmudKt4WmNjr79Tlbp0DZvRqxy+wim+7fBrqcOvmrN35OzrUtYnrBG+b03a2uXw61CW6W6qyTlnf0d6RjprM9cRHFfC1JWfYwy8FH1QDDTDTtPU1NTKays4wJUUj+q0VdSE74SiDrBV6TjrtHUmgqbX6ys1VNWlSkfnY2WZWpVOw8oy3U2APoDRcaN58coX+XPvjyjKvo1ekf3Ykb+SYOMb3Lx8Ii9teYldObsq1eQ3Zao28zmjtvSiRagIX+Ec347wJfhhwr/kLFysvr0w5xjRwdW/XEJITp86XfHGxRyXxvMvzscfk7bEoY/gqPGqKekEBRoCMRX052+D/siy3Uf51/df0C3pOGn70nhvz3vEhMaQHJ9MsjGZHpE9mnRDnH0zn9FodJjiqS29aEGHXk3aKpzg4w5f8pn/k/T/5KjD7acfrqHB5cWudR6vD4AOtpvr/tkmi92krWzkHL4r2Iun+YtgTPmX8PKVj2LiIuuy1pGekc47u97hzZ1vYgw3MiF+AsnGZLq06uJly2vGUYrHlfSiBR1+qAhf4Rifd/gdRS4F7QYTNmgKW7Zs4cNFH1JaWur0M/7+/tx2620MHjy4zuOdyCti/obDbLAM4MaGGN6EsC/LdCSe5m2Eg7JMnRBE+Edwfffrub779ZwtPsuazDWkZ6Tzxq9v8J9f/0P3yO5MMGrOv3N45xpG8A62SL+uTYCqDl9REz7t8M0WbcnBosjeLD0YzLQ5bzucmNXr9VgslvIv1eB6tuLnnyzgg7Xf1r5jM8J+0rYxyjLrSuU1ba3vVbGvdWBrbul5C7f0vIXThadZnbma9KPpvPrLq7z6y6v0ierDBOMExhvH0yG0Q6PaXxOO9JpqwyJ06FRKR+EE30k2O8AiJTok2375hdtvv92hswewWCxYLBYyMjIapLvSlByhu3Ccw286J1qR0nGt8aptcFtSeqfwwdUfsOrGVTw06CEEgn/+/E/GfTaOqcunsnDPQk4XnnZ+EBepSfPeU6gqHUVN+HSEb7GADsnBQ4dqrNZwl3yuJ1Q5vY0j8bQm5O8rN17VsYqoQ2gHpvedzvS+08nKz2Jlhqbr8/yW53lhywsMajeoXNEzKqgm9ZvqNFSmo76oKh1FTfh0hG+WEoEsL890hDvlc5tS5OsuKufwm96kbbl4mqVhTyCx4bH8of8f+GzSZ3w5+UtmDphJbnEuz/70LKM/Gc2MVTP4/ODn5JXkuXS8mmQ6PIkST1PUhE87fItFc/jO/L1er69TnX1t+GCAX0VaoeK9poJ9hO+uOYYurbpwb+K9fDn5Sz6d+Cl39r2TYwXHePKHJxm5eCT3rb2Prw5/xYXSC06P0VCZjvqiUjqKmvDtlI7UUjqO5rCEELz33ntufbz21Qi/qTVe2WNvS8WkrXvsE0LQs3VPerbuqck55+4hPUPT8v82+1v8df6MiBlBsjGZK2KuqCTn7EwqwdOrb6mUjqIm3OLwhRDJwDxAD7wppXyuyvYA4H1gEJALTJFSZrhj7JowS61KR9ipK1rtYebMmW7PpfpuDl97LZtihG99RrXl8D1lmxCChOgEEqITeHDQg+w4s4P0jHRWZqxkbdZaggxBmpyzcQKXx1xe7zr6hmIRenQWFeErHNPglI4QQg+8DkxA6z26VQjRp8pudwHnpJTdgH8Bzzd0XFeQ1hz+iBEjKq0/+8EHHzB//ny3j9dYK2s1JqKSPHITzOFTuUqnMZ4+bHLOjw55lDU3reHt8W8zsctENp/YzAMbHuDKj69kV+wu/vLGX4jrElcvmY76YkGHTqV0FE5wR4Q/BDgkpTwCIIT4CJgM7LHbZzLwlPX1p8BrQgghPSx0otXhS7p370lGxmJPDgU0rcjXXTgST2tKKR1RKYff+LbZyzn/dehf2XxiM+kZ6azJWkOBpYBOz3bijtg7SI5PZkj7IR63RwodQnXaKpzgDoffCThm93s2MNTZPlJKkxAiD4gCXBOpqSe2xiuha5y56aYU+boLxzl8b1pUmfIFUKyTtt78LzDoDAzvNJzhnYbz+LDH+eG3H0jPSGdV5iqWHFpC68DWjIkdQ3J8MgPbDkSvc7+qqgU9epXDVzihyU3aCiFmADOg4RNcUoJeyEZz+M5UOZszjhqvmtJ9zb7xSnohwneGn96PKztfyZWdr6TYVMx3xzU556WHl7L4wGLaBLVhnHEcycZkBrQZ4LZgwSJUlY7COe5w+McBezGSGOt7jvbJFkIYgAi0ydtqSCkXAAsAkpKSGpTyMVsnr4RoHIfvg/7eSeNV0znRijVttTLcpvh/EGgIZEzcGMbEjaGwrJBvs79lxdEVfLL/E9L2ptEhpAPjjeNJNibTJ6pPg66vRK+kFRROcYfD3wJ0F0LEozn23wG3VdlnKTAN+BG4CVjn6fw9gMX6hy888OjsCF+s0nHUeNVUomiwa7zyUg6/rgT7BWtyzfHJXCi9wPpj61lxdAUL9yzk3d3v0jmsM8nGZMYbx9dLztkidOhVDl/hhAY7fGtOfjawEq0s820p5W4hxDPAVinlUuAt4AMhxCHgLNpNweNIq3ZO40X4TdvZ1AdB0268qjxp690cfl0J9Q9lYteJTOw6kbySPNZmrWXF0RW8test/rfzf8RHxGuibvHj6RLhmpyzVoevInyFY9ziCaWUy6WUPaSUXaWUqdb3nrA6e6SUxVLKm6WU3aSUQ2wVPZ7GYkvpuOihGip21ZQcobvQ6Zq2PHLFpK32BNJcn7IiAiK4ofsN/G/c/1h38zoeG/oYUYFR/OfX/zD5i8ncuPRG3tz5JscKjtV4HIle5fAVTmlyk7buRFodvk7UntJxh9hVU3KE7qI5iac1h5SOK0QFRTGl1xSm9JrC6cLTrMpYRXpGOvO2zWPetnkkRCUwIV6Tc24f0r7SZy1Ch06ldBRO8G0tHVt5mgtRnzvErnzB2VTFPoffFKUVhF2VjsWDnbbeom1wW6b2mcrCqxey8saV/GnQn5BIXtr6EmM/Hcvty28nbW8aZwrPAFodvlriUOEMn47wLWbXJ23dIXblm2WZ9kscau81pbOsqNLRIvymVEHkbjqGduT3fX/P7/v+nqz8rHJdn+c2P8fzm58nqX0S7QNzubRQ0sbbxiqaJD4d4UtrpKNzoQ7fWc1/XXoBfNDfO268akInWi2H33RM8yix4bHM6D+Dzyd9zheTv+CeAfdwpvAMX4UdYWxsB+5ZfQ9LDi5xKufsjcVZFN6nRTh8V6p0UlNTCQ4OrvReXcWufDG6FNbGK6PRyPjxyQCsXrXKy1ZVoKtUltk4WjpNja6tunJf4n0svW4ps84PYnpePpn5mTzxwxOMXDyS2WtnV5Jzts1XZWZmIqUsn69STt/38W2HX4eUTkpKCgsWLKgkstYYYldNnV07dwLaJLa0OtPnn3uuyTiHirJMfGbStr4IIWhrDueBc3msmPQli65ZREqvFPad3cffvvsbV358JQ+uf5AnP3ySIlNRpc8WFhYybdq0JvP/2hxojk9Jvp3Dl3Wrw6/PotG+zrq1a6DftWiZe82ZFhcXMXfu3CZxrZpzHb4nsAjtKy2w0De6L32j+/KnpD/x65lfST+qyTkH3RJE78m9yf8ln7zNeVzYeQFZJjGbzY2yDKMv4K0lLBuKT0b4F0tMXCwxUWrSHL4rOXyFY86fP6e9EKIiZSUtHl+5yVXsxdOakpaOt5C24MZSUZqpEzouaXsJfx36V9bevJbCdwo5/8N5QhNCiftjHL3m9aLT3Z0I7R9KUUkRU6dObTYRq7fw1hKWDcUnI/ykZ9dQVGYmmjz+GEijFY5rX5BWgJbzTk1NbdJ3e1doFRGhvRC6iusopcdXbnIVe/E0XyzLrCvS1nOy+HbQ+VXbrge+vbo9O3buoPTHcxxuHcSO9qHsHhpO5OWRBJWZSTh1EWNGPvfd2/QjVm/hrSUsG4pPOvyHx/fEbLEQVHIGvkdzVh7G9ojX5n5Nd7+5POLVxrixY1l1Cs3ZW69jQIA/qalPe9cwK5XE01SEz6GgvuzN70nvwrNO9+kUYSCwj5GjR4/SqaSEKzJLKMvKZXerIH6KDmV7h1C2xoQTk2jikdWPkCWzeCTlEXSNJFHSHPDWEpYNxScd/l2Xx2sv8oMazeHX9IjXnB3+wIGXsGrFPuLi4jhjvY5PPP44KSm3etkyDVGlSqeF+3syAnrzp/B/suKeETXuFwWkV8lDw0Ugh4kJftx/R2seOuVPxPAIPjR/yNL3l3Jd7+tIjk+mf3R/hBCkpaUxd+5csrKyiI2N9YknWlfx1hKWDcUnHX45to7DRnD4zfURrzZsEfTuPXv55sAZ7k3bxrXXXuNdo+ywn7SVLbQs0x77Fcpqw+ac586dWylaLS22MLawiOCPc9iSIwlLDCNiaARpljQW7l1Ix5COdC7szGf/9xnnM88DvvNE6yr216453fB8+xmtER2+Oxq3miIVa8bKJimtYLPlne8z+PFwbpOyzRsIUdER7QopKSlkZGSwcOHC8j6UYpO2LdAAlhILeT/lkfVqFrvv20349+F0adWFTaZNxPw1hu7PdaftDW0JiAloFpOW7sR27SwWCxkZGU3e2YPPO3ybFoDnT9MdjVtNEZv//GBTJum7TgJNq6O4Q0QgQ+Jbs+9kPucKy1p8SkcnBJK6LzVh60PR6/WVHL49liILP/zvBy4/dTn75+zn+NvHKcsto821bej+bHe6pXajKLGIo3lH3XAmCk/QMlI6jaD+Uv6Ip/UpERcX1ywe8WrDFjG/kL4fgLBAA1EhAd40qRKBfnoW33MpD3z0C19s/80nu53rgqZuWr/P2v5WX3tMS80EGhxfyzlz5tApqhOZ32Zy7ttz6MP1RCRFEDEkgjaT2zDpi0n0jOypLfRiTCYmLKZ+Bincjo9H+I2X0oHKucvm8ohXG/bR/NLZl7H9iXFEhvh7zyAnJHbWymEvlJR52RLvIoRwOYfviJSUFP72xDNA9QjfRm5uLldffXX5E60538zZdWc59eopZvvN5i+D/0KAIYB52+Yx4fMJ3Pr1rby3+z1OXjxZb7sU7sHHHX7jpXR8FXuhtLjWIU1WEXR83/aM69OOGSNcWxnKVxHULYfviInX3Qg4j/ABli9f7lCKZObUmdze53bSrk4j/cZ0Hhz0IGZpLpdzvmPFHaTtTSOnKKdhRirqRctI6bTwx/yGYJ8iCQ9qun8uHSKCWHBHkrfN8Dr26qb1xhAIQGLfXrz3606Hu2RlZdUqRdIptBN39r2TO/veSWZ+JulHK+ScX9jyAkntkhhvHM/YuLFEBkY2zGaFS/h26NvIKR1fxBbQRwT5tfj8eHNACOoxZVsFgzZH88DsWURFRTncpa7VZ3Hhcdwz4B6WTF7CkklL+EO/P3C68DR/3/R3Ri0exczVM1lycAn5pfkNtV5RA77tCZXDbzDhgVp7fv+YCC9bonAFd0b4mIqZN2+e26vPukV2Y/Yls1l63VI+mfgJ0xKmkZGfock5fzyS+9fez9dHvuZi2cWGnIXCAU33Gd0deMHhPzWxD7FRwbXv2Ey4pl8H4qKCMUaHeNsUhQvUtQ7fIXprFZapxKMNRkIIerXuRa/WvXhg4APsytlVvorXhuwNBOgDuCLmCsYbx3NFzBUEGYIaPGZLx7cdvu3hthFTEdMvi2+0sRoDnU7QP6aVt81QuIhANNzh63Sg9wdTMVC7bLg7JBaEEPRr049+bfrxUNJDbD+9nfSMdFZlrGJ15mqCDEGM7DySZGMyl3e6HH9906sUaw74tsNXKR1FC6Mu0go1YggEU0mtu3lCF14ndAxsN5CB7QbyyOBH2HpqK+kZ6azOXM2KoysI9QvlqtirSDYmM6zjMPwcqIIqHNMghy+EaA18DBiBDOAWKeU5B/uZAdt0f5aUclJDxnUZ5fAVLYyGNF5VwhBQHuHXhKdFA/U6PUM7DGVoh6H8bejf+OnET6QfTWdd1jqWHl5KREAEY2LHkByfTFK7JAw6345hG0pDPeGjwFopZXdgrfV3RxRJKROtP43j7EE5/BZEc1xuzhPUV1qhGi5G+I0pGuin8+PyTpfz7OXPsmHKBl4d9SqXdbyM5UeX84dVf2D0J6N5dtOzbD25FUt5l73CnobeDicDI62v3wM2AI808JjuQzVetQia63JzQ6fIRgAAFNpJREFUnsBtEb5dDr8mvKUL76/3Z1TsKEbFjqLIVMTG7I2kZ6TzxaEv+Hj/x7QNbsu4uHFMiJ9Av+h+qqTYSkM9YTsp5Qnr65NAOyf7BQohtgohNgkhrqvpgEKIGdZ9t545c6Zh1qnGqxZBc11uzhNo0gpuOJCLEX5TEA0MMgQxzjiOl0e+zDdTvuG5Ec/RJ6oPH+//mJTlKUz4fAIv//wye3L3uGd+oxlTq8MXQqwRQuxy8DPZfj+pXUlnVzNOSpkE3Aa8IoTo6mw8KeUCKWWSlDKpTZs2dTkXBwdTKZ2WgK+uRVAfNGkFd6R0XMvh21Q2q0os2J6sGjvVFuIXwjVdruHfV/2bDVM28Oxlz2KMMPLB7g+Y8vUUJn4xkX//8m8OnjvoUTuaKqIhfxxCiP3ASCnlCSFEB2CDlLJnLZ95F/haSvlpbcdPSkqSW7durbd9ZP4A70yA27+ArqPqfxxFk8ZoNDpMK8TFxZGRkdH4BnmRx7/YxbKdJ9j2+NiGHeidayDzuwYFSxYpkRYHuXQh0Ousx9UHwO2fQ9zweo/jCueLz7Mmaw3pR9PZcmoLFmmha0TXckVPY4TRo+M3JkKIn60BdjUamsNfCkwDnrP++6WDwSOBQilliRAiGrgMeKGB47qGyuG3CJrrcnOeQMvhuyHCH/04HFrToEO89u9/k5eX53DboEGDuHr0FbBpPueydnEhLLFBY9WOP0Ojr2Zo9NWcLc7l+xPr+Pa31by+/XVe3/46XcJ7cGWnsYzoOIb2wR1rPJJOJ+gYEVhtXqCo1EzOhdrTYK6g1wk6tnJ/o1lDHf5zwGIhxF1AJnALgBAiCZgppbwb6A38VwhhQUshPSel3NPAcV1DpXRaBM11uTlPoBMCiztmbWOHaT8N4IExTzhNL+m//QnT01/BpvnMS9/Ju8vWN2isuhMN3IowXI0hfAcHi3ZwJP913tn7OuaizpTl98eU3x9pciwp8sS1fbjz8spNltfP/559JwvcY11oAFsfG+OWY9nTIIcvpcwFRjt4fytwt/X1D0C/hoxTb5TDbzHU1g3aknDkYvOKynhr4xGiwwIY26cdHSI8L1PgrIIHwGw2l2v2hOjKePH6/h63xznagu/nSk+yJ28ju/O/5WTQMmi3jM7BCSSEX0Gf8MsI9WsNwNNf7eFoTmWdHyklR3IuMqpnG67u16HBFgX66Rt8DEf4dpeCcviKFobOSZXOxoNneHXdIQCe+HI3fx7fk/tGdfOoLampqUydOtXhNr1eX+Hw9WXcnNTZo7a4RmdgMPAnMvIySM9IZ2XGStJP/odVp/7L4HaDGR8/nujwYM4Wllb6ZGGpmVKThaFdoprIuTjGtz2hcviKFoYzaYWiUjMA70wfDOC21ENNpKSkMHp0tQQAgNYnodNRJvwJFiaP21JXjBFGZg6YyZLJS/h80ufc3e9uThae5JkfnyE36m9sK3mRLw59US7nfPaidgNo3QRXg7PHtz2hmrRVtDCcNV6VmLTgJ6FTOP1jIsgvapylINesWcOsWbO0iB4tsp81axbz588HoEz4EyS8tyylK2Wj3SO7c/8l9/PVdV+x+NrFdBDjKZK/8fj3j2tyzuvu56vDy0CU0Dq4aTv8FpLSUY1XipaBM2kFm8MPMOgJD/Qjv7jxnOz8+fPLHXxVTMKfIEodbvM0de3QFkLQO6o3A0OnsmbfWN6f0Y4VR1ewKmMVG45tILSHgQ8zLscSPJERMSOapJyzj4e+jS+PrFB4FacRvpbSCTDoCA8yUFDcNNIopboAr0X49e3Qjgzx5/zFMvpF9+ORIY+w+ubVTI9/kbLzgzmY9ysPffMQV358JY98+wjrs9ZTavbODc0RLSTC9/H7mkJhRedkjcOSMluEryMswK/RUjq1UYo/gV5y+PXt0I4K8cdkkfxjxT789FowuSM7kpJTk/nynnkcyPuV9KPprMlaw/KjywnzC9PknOOTGdphqFflnJXDVyh8CIHjxqsSkwV/gw4hRNOK8EUAgdI7EXB9hd/6doogyE/P298drfR+z3ZhRAYFMix4GMM6DGPusLls+m0T6RnprM1ay5eHv6RVQCtGx45mQvwEktolodd5pvzSGcrhKxQ+hJbDr06JyUyAQfsehAf6UVSmlRH6G7z73SjBjwDhHYdf3w7tYV2i2Pv35FqP76fzY0TMCEbEjKDEXML3x78nPSOd5UeX89nBz4gKjGJs3FiS45O5pO0l6BrBT/m2J1QOX9HCcCatUGKyEGDQosmwQC3OK2jEiVtnlOBfY4TvSfG12oTf3EmAPoCrYq/ihSte4Jsp3/DSlS8xsN1AlhxawvT06Yz9dCwvbHmBnWd2elTRU0X4CoUP4UweuaTMUhHhB2k55PxiE1GhAY1pXjVK8Cccxz0Bjqpopk6dypw5c5g37//bu/vYuur7juPvr2/s2E6cJuSJNE6ugbINUnW0OJk2ULXRQmiaBtpBH2KyP1bVEwGtU9GmTpa6VZ2lSasQFZuUuoxp1E7Qqi4CStRA1bSMdCNxaDLIQxkNdp6gScizHT/E97s/7r1+vNeO773nnvScz0u6iu+5597zPYr98c+/8zu/33dKEsxh3KFdM6OG1Q2rWd2wmp7BHnYc3cH2d7az5dAWvn/g+yydvZTVDat59LZHqUyUtr8/2kk4vOqNRulIPGS/08e3EvuvDDGzMv3jPrc2HSJ/ueWX5Swtpz6qqMozLDPXKBqA999/n+bm5kisajarchZrb1zLk594kp9/4ed8645v0TCngZ3Hd5Y87CHyga8bryReKjJDkMcPzRwY1aXzRzctoK56BkfPTgzTrPfO9/HKW6cYHAp2qcA+r2Sm555hcrLRMlFc4GZO1Rzu/9D9bLp7E1vWbgnkGNFOQgW+xExFpok/sYU/0qVTXZng4T++iXO9g/T05x6t88jm1/mzp3exff97gdZ72SupzNOHP9VomSgvcBPU0M2Y9OGrS0fiIfutPr6FP3qUDkD9vPSyhMfPXeZ3FtdN+Jx3z10GRuaICcplr6LK+6Hn9ITXvv3Nr/PYY4/Re/lyzvcuq6/P+b7QVM2Gyuqwq5hUTAJfLXyJh+yiHOOnV+i/kqKueqTVuDSzuMbRM705Az/rUp6/AErlks+kOtUL/zRx1dMHgAcenQHkq+98zveFpm4JfO3gNd3AVOCLRIgNd+mM3d4/mGLB7JGfg2XXpQP/y//eya/+4d7h/v2swcyfCPm6fEplM59iYX0D6z5y/aT77d69m+dfeJ6zZ84y77p5rPvMOlauXDn82uYtmxkYGPlrpKqqivVfWj+8T+AO/wwO/QgGemDm7PIcswAKfJEIyV60nRD447p0FtVVc9fvLeKnh05y4lwfNyyYNWb/bND39A8FWu/JoTr2Lv5T1q26ddL9Vq76Cisfacv52oOfb6W7u2fc1kG2HnuJrq7c7ym5ikQ68PsvXNOBH+0kVB++xEz2O338zVejb7zK+ouP3wjAsXGjdVIppzczf37QXToDQykqZxT381nonDglNXNO+t++C+U7ZgFiEvjRPk2RrOEW/rjt/TmmUVg6L92tc+zs2IuiPQMjIR90l87gUIqqRHE/n/lG80w1yqekqjNr3/Yr8MOjwJeYGRmlMzby+wbHdukAXD+nmkSFcXx84I/qxgmyhT+UclIOlUUGfmtrK7W1tWO2Xc2cOCWdtkEt/GuBxuFLvGRH6VwZGgn8vsEhLvZdYcHssasxzUhUsOQD1RO6dEaHfJAt/OxNXeMDf7pBXMicONlpG7q7u3F3uru72bBhAxs3bizsZKozgd9/vrD3l0m0k1A3XknM3LQwffH1wImRlma2yyY79n60pXNrJnbpZEK+KlER6EXbgeHAH+nDzxXEVzONQlNTE11dXaRSKbq6uqacHyfXtA3uzqZNm9i4ceP0W/7ZFn7/9NcKDnKCuPGinYTq0pGYaWy4jkSFsfPXIzckZVvw9fMmLrlXP682b+AvmjMz0C6dwcyyi6OvLRS6CtV05bugmw390b9wHnroIRKJBGaWP5Crp+7SyRXshf6CK1RRwzLN7EHg74FbgFXu3plnv3uB7wAJ4Cl3/8dijnvVNEpHYmb2zBnc+aEFfO+Vwyz5QDWfuGUx75xOD1nM1cKvn1fDby72jZkb/0JmcZTFc6p5672L/OLtYO5mPdObHjc/ukunXCNu8i1+AhOnpQBIpdJZknfd26rZgPHGnl/wmabHOXLkCMuXL2fNmjVs27aN7u7uzEymPuZzampq8v6CC2IWz2LH4b8JfA74br4dzCwB/AtwN3AM2G1mz7v7gSKPPTW18CWGnlz/UTa2v843ntvPN57bD0CiwlhUN3Eq5Pp5NbjDC/tOMDCUYv+J87yw713M4JYldezpPsv6p14LtN65NSN3ABe6CtV0tba2smHDhoLmns8ZyGYMVFTDoW389YpBWDET+A10/xsrVgArck25kAJ6gImvXRoIZg6jogLf3Q/CyIWiPFYBb7v74cy+zwL3AeULfE2PLDEyp7qSZ/58Fbu7zvDO6R5OXezn5sWzqaiY+HNwY6bP/7Ef7APS/fYrb5jHF1Yu555bF3PfbUtJ5VoVvUSqZlTwkfq5w88LXYVqupqamti5cyebNm0aE/qjW+GTyfUXx0u/vsIfLHI+f2vx97OeHQjonlh3L/oB/AxozPPaA6S7cbLPNwD/PMlnNQOdQOfy5cu9KK8+4f53c9z7Lhb3OSIRlUqlfOf/nfLXDr/vR8/0+OCVobBL8vb2dk8mk25mnkwmvb29vWzHevjhh722ttZJD/HL+0gmkxM+y8ymfN/4x/z58yccr7a2tqhzBjo9X77me8FHAvgnpLtuxj/u8wACf/Tj9ttvL/ik3d39vx5PB35/T3GfIyKx0d7e7vPnz88b0vkCOZlMTivss59T6l9wkwX+lJ3b7v5Jd/9wjsdzU7034ziwbNTz+sy24GlYpohMU1NTE6dPn6a9vZ1kMglAIpGelmKyMf65bgAbL9v9PfpzpjuktBjlmDxtN3Czmd1AOui/CKwvw3F10VZECjbd9W6z+7a0tEwYpZN93traWvY1dEcrdljmZ4EngYXAi2a2191Xm9kHSXfjrHH3K2b2KLCd9LDMp919f9GVXw218EWkjMJYFH06ih2lsxXYmmP7CWDNqOfbgG3FHKsgauGLiAyLXBKOvpvtiSceT2/UjVciItEK/PG3KV84n57IqGPz5pArExEJn3kBd5qVS2Njo3d25pytIaeGhga6u7tpvWsmlQm4c1mCVUsT3PTMdXR1dQVXqIjINcLM9rh7Y67XIrXEYfbut698rJLaynQ3zq7jQ+Vd+UZE5BoVqcDPzsOx6NuXxmzPjqUVEYmzSPXhF7ryjYhIHEQq8AtZ+UZEJC4iddFWRCTuJrtoG6kWvoiI5KfAFxGJCQW+iEhMKPBFRGJCgS8iEhMKfBGRmFDgi4jEhAJfRCQmFPgiIjGhwBcRiQkFvohITCjwRURiQoEvIhITCnwRkZgoKvDN7EEz229mKTPLOR1nZr8uM3vDzPaameY7FhEJQbFLHL4JfA747lXs+yfufrrI44mISIGKCnx3PwhgZqWpRkREAlOuPnwHXjKzPWbWPNmOZtZsZp1m1nnq1KkylSciEn1TtvDN7CfA9TleanH3567yOHe6+3EzWwS8bGaH3P2VXDu6exvQBuklDq/y80VEZApTBr67f7LYg7j78cy/J81sK7AKyBn4IiISjMC7dMxslpnVZb8G7iF9sVdERMqo2GGZnzWzY8AfAi+a2fbM9g+a2bbMbouBV81sH7ALeNHdf1zMcUVEZPqKHaWzFdiaY/sJYE3m68PA7xdzHBERKZ7utBWRMTo6OmhoaKCiooKGhgY6OjrCLklKpNgbr0QkQjo6Omhubqa3txeA7u5umpvTI6mbmprCLE1KQC18ERnW0tIyHPZZvb29tLS0hFSRlJICX0SGHTlyZFrb5beLAl9Ehi1fvnxa2+W3iwJfRIa1trZSW1s7ZlttbS2tra0hVSSlpMAXkWFNTU20tbWRTCYxM5LJJG1tbbpgGxHmfu1OV9PY2OidnZo+X0TkapnZHnfPuT6JWvgiIjGhwBcRiQkFvohITCjwRURiQoEvIhIT1/QoHTM7BXQX+PYFQNwWTdc5x4POOR4KPeekuy/M9cI1HfjFMLPOfEOTokrnHA8653gI4pzVpSMiEhMKfBGRmIhy4LeFXUAIdM7xoHOOh5Kfc2T78EVEZKwot/BFRGQUBb6ISExELvDN7F4z+5WZvW1mXw+7nnIws6fN7KSZvRl2LeVgZsvMbIeZHTCz/Wb21bBrCpqZVZvZLjPblznnb4ZdU7mYWcLMfmlmPwq7lnIwsy4ze8PM9ppZSacLjlQfvpklgLeAu4FjwG7gS+5+INTCAmZmHwcuAc+4+4fDridoZrYEWOLur5tZHbAHuD/K/89mZsAsd79kZpXAq8BX3f1/Qi4tcGb2NaARmOPua8OuJ2hm1gU0unvJbzSLWgt/FfC2ux929wHgWeC+kGsKnLu/ApwJu45ycfd33f31zNcXgYPA0nCrCpanXco8rcw8otNay8PM6oFPA0+FXUsURC3wlwJHRz0/RsSDIO7MrAH4KPBauJUEL9O1sRc4Cbzs7pE/Z+AJ4G+AVNiFlJEDL5nZHjNrLuUHRy3wJUbMbDbwQ+Cv3P1C2PUEzd2H3P02oB5YZWaR7r4zs7XASXffE3YtZXanu38M+BTwSKbLtiSiFvjHgWWjntdntknEZPqxfwh0uPt/hl1PObn7OWAHcG/YtQTsDmBdpk/7WeAuM2sPt6TgufvxzL8nga2ku6pLImqBvxu42cxuMLMq4IvA8yHXJCWWuYD5r8BBd3887HrKwcwWmtnczNc1pAcmHAq3qmC5+9+6e727N5D+Wf6puz8UclmBMrNZmYEImNks4B6gZKPvIhX47n4FeBTYTvpC3n+4+/5wqwqemW0B/hv4XTM7ZmZfDrumgN0BbCDd4tubeawJu6iALQF2mNn/km7YvOzusRimGDOLgVfNbB+wC3jR3X9cqg+P1LBMERHJL1ItfBERyU+BLyISEwp8EZGYUOCLiMSEAl9EJCYU+CIiMaHAFxGJif8HR9cck/GZq0UAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "from sklearn.ensemble import StackingClassifier\n",
    "from sklearn.ensemble import StackingRegressor\n",
    "from sklearn.linear_model import LinearRegression\n",
    "from sklearn.tree import DecisionTreeRegressor\n",
    "from sklearn.ensemble import RandomForestRegressor\n",
    "\n",
    "clf_a = DecisionTreeRegressor(max_depth=3)\n",
    "clf_b = DecisionTreeRegressor(max_depth=5)\n",
    "clf_c = LinearRegression()\n",
    "\n",
    "estimators = [('DT1', clf_a), ('DT2', clf_b), ('lr', clf_c)]\n",
    "\n",
    "clf = StackingRegressor(estimators=estimators, \n",
    "                        final_estimator=RandomForestRegressor(n_estimators=10, random_state=42)).fit(X, y)\n",
    "\n",
    "# Predict\n",
    "X_test = np.arange(0.0, 5.0, 0.01)[:, np.newaxis]\n",
    "y_1 = clf.predict(X_test)\n",
    "y_2 = clf.estimators_[0].predict(X_test)\n",
    "y_3 = clf.estimators_[2].predict(X_test)\n",
    "\n",
    "plt.plot(X,y,'o',color='black')\n",
    "plt.plot(X_test,y_1,label='Stacking')\n",
    "plt.plot(X_test,y_2,label='DT')\n",
    "plt.plot(X_test,y_3,label='LR')\n",
    "# Plot the resu  et\")\n",
    "plt.title(\"Stacking of models\")\n",
    "plt.legend()\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "StackingRegressor(cv=None,\n",
       "                  estimators=[('DT1',\n",
       "                               DecisionTreeRegressor(ccp_alpha=0.0,\n",
       "                                                     criterion='mse',\n",
       "                                                     max_depth=3,\n",
       "                                                     max_features=None,\n",
       "                                                     max_leaf_nodes=None,\n",
       "                                                     min_impurity_decrease=0.0,\n",
       "                                                     min_impurity_split=None,\n",
       "                                                     min_samples_leaf=1,\n",
       "                                                     min_samples_split=2,\n",
       "                                                     min_weight_fraction_leaf=0.0,\n",
       "                                                     presort='deprecated',\n",
       "                                                     random_state=None,\n",
       "                                                     splitter='best')),\n",
       "                              ('DT2',\n",
       "                               DecisionTreeRegressor...\n",
       "                  final_estimator=RandomForestRegressor(bootstrap=True,\n",
       "                                                        ccp_alpha=0.0,\n",
       "                                                        criterion='mse',\n",
       "                                                        max_depth=None,\n",
       "                                                        max_features='auto',\n",
       "                                                        max_leaf_nodes=None,\n",
       "                                                        max_samples=None,\n",
       "                                                        min_impurity_decrease=0.0,\n",
       "                                                        min_impurity_split=None,\n",
       "                                                        min_samples_leaf=1,\n",
       "                                                        min_samples_split=2,\n",
       "                                                        min_weight_fraction_leaf=0.0,\n",
       "                                                        n_estimators=10,\n",
       "                                                        n_jobs=None,\n",
       "                                                        oob_score=False,\n",
       "                                                        random_state=42,\n",
       "                                                        verbose=0,\n",
       "                                                        warm_start=False),\n",
       "                  n_jobs=None, passthrough=False, verbose=0)"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "clf"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Consultar\n",
    "\n",
    "* Stochastic Gradient Boosting Tree\n",
    "\n",
    "Modificaciones recientes de gran interés:\n",
    "\n",
    "* XGBoost\n",
    "* LightGBM\n",
    "* CatBoost\n",
    "\n",
    "[CatBoost vs. Light GBM vs. XGBoost](https://towardsdatascience.com/catboost-vs-light-gbm-vs-xgboost-5f93620723db)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.5"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}