07_Kalman_Filter_Math.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "[Table of Contents](http://nbviewer.ipython.org/github/rlabbe/Kalman-and-Bayesian-Filters-in-Python/blob/master/table_of_contents.ipynb)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Kalman Filter Math"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style>\n",
       "@import url('http://fonts.googleapis.com/css?family=Source+Code+Pro');\n",
       "@import url('http://fonts.googleapis.com/css?family=Vollkorn');\n",
       "@import url('http://fonts.googleapis.com/css?family=Arimo');\n",
       "\n",
       "    div.cell{\n",
       "        width: 850px;\n",
       "        margin-left: 0% !important;\n",
       "        margin-right: auto;\n",
       "    }\n",
       "    div.text_cell code {\n",
       "        background: transparent;\n",
       "        color: #000000;\n",
       "        font-weight: 600;\n",
       "        font-size: 11pt;\n",
       "        font-style: bold;\n",
       "        font-family:  'Source Code Pro', Consolas, monocco, monospace;\n",
       "   }\n",
       "    h1 {\n",
       "        font-family: 'Open sans',verdana,arial,sans-serif;\n",
       "\t}\n",
       "\t\n",
       "    div.input_area {\n",
       "        background: #F6F6F9;\n",
       "        border: 1px solid #586e75;\n",
       "    }\n",
       "\n",
       "    .text_cell_render h1 {\n",
       "        font-weight: 200;\n",
       "        font-size: 30pt;\n",
       "        line-height: 100%;\n",
       "        color:#c76c0c;\n",
       "        margin-bottom: 0.5em;\n",
       "        margin-top: 1em;\n",
       "        display: block;\n",
       "        white-space: wrap;\n",
       "    } \n",
       "    h2 {\n",
       "        font-family: 'Open sans',verdana,arial,sans-serif;\n",
       "    }\n",
       "    .text_cell_render h2 {\n",
       "        font-weight: 200;\n",
       "        font-size: 16pt;\n",
       "        font-style: italic;\n",
       "        line-height: 100%;\n",
       "        color:#c76c0c;\n",
       "        margin-bottom: 0.5em;\n",
       "        margin-top: 1.5em;\n",
       "        display: inline;\n",
       "        white-space: wrap;\n",
       "    } \n",
       "    h3 {\n",
       "        font-family: 'Open sans',verdana,arial,sans-serif;\n",
       "    }\n",
       "    .text_cell_render h3 {\n",
       "        font-weight: 200;\n",
       "        font-size: 14pt;\n",
       "        line-height: 100%;\n",
       "        color:#d77c0c;\n",
       "        margin-bottom: 0.5em;\n",
       "        margin-top: 2em;\n",
       "        display: block;\n",
       "        white-space: nowrap;\n",
       "    }\n",
       "    h4 {\n",
       "        font-family: 'Open sans',verdana,arial,sans-serif;\n",
       "    }\n",
       "    .text_cell_render h4 {\n",
       "        font-weight: 100;\n",
       "        font-size: 14pt;\n",
       "        color:#d77c0c;\n",
       "        margin-bottom: 0.5em;\n",
       "        margin-top: 0.5em;\n",
       "        display: block;\n",
       "        white-space: nowrap;\n",
       "    }\n",
       "    h5 {\n",
       "        font-family: 'Open sans',verdana,arial,sans-serif;\n",
       "    }\n",
       "    .text_cell_render h5 {\n",
       "        font-weight: 200;\n",
       "        font-style: normal;\n",
       "        color: #1d3b84;\n",
       "        font-size: 16pt;\n",
       "        margin-bottom: 0em;\n",
       "        margin-top: 0.5em;\n",
       "        display: block;\n",
       "        white-space: nowrap;\n",
       "    }\n",
       "    div.text_cell_render{\n",
       "        font-family: 'Arimo',verdana,arial,sans-serif;\n",
       "        line-height: 125%;\n",
       "        font-size: 120%;\n",
       "        text-align:justify;\n",
       "        text-justify:inter-word;\n",
       "    }\n",
       "    div.output_subarea.output_text.output_pyout {\n",
       "        overflow-x: auto;\n",
       "        overflow-y: scroll;\n",
       "        max-height: 50000px;\n",
       "    }\n",
       "    div.output_subarea.output_stream.output_stdout.output_text {\n",
       "        overflow-x: auto;\n",
       "        overflow-y: scroll;\n",
       "        max-height: 50000px;\n",
       "    }\n",
       "    div.output_wrapper{\n",
       "        margin-top:0.2em;\n",
       "        margin-bottom:0.2em;\n",
       "}\n",
       "\n",
       "    code{\n",
       "      font-size: 70%;\n",
       "    }\n",
       "    .rendered_html code{\n",
       "    background-color: transparent;\n",
       "    }\n",
       "    ul{\n",
       "        margin: 2em;\n",
       "    }\n",
       "    ul li{\n",
       "        padding-left: 0.5em; \n",
       "        margin-bottom: 0.5em; \n",
       "        margin-top: 0.5em; \n",
       "    }\n",
       "    ul li li{\n",
       "        padding-left: 0.2em; \n",
       "        margin-bottom: 0.2em; \n",
       "        margin-top: 0.2em; \n",
       "    }\n",
       "    ol{\n",
       "        margin: 2em;\n",
       "    }\n",
       "    ol li{\n",
       "        padding-left: 0.5em; \n",
       "        margin-bottom: 0.5em; \n",
       "        margin-top: 0.5em; \n",
       "    }\n",
       "    ul li{\n",
       "        padding-left: 0.5em; \n",
       "        margin-bottom: 0.5em; \n",
       "        margin-top: 0.2em; \n",
       "    }\n",
       "    a:link{\n",
       "       font-weight: bold;\n",
       "       color:#447adb;\n",
       "    }\n",
       "    a:visited{\n",
       "       font-weight: bold;\n",
       "       color: #1d3b84;\n",
       "    }\n",
       "    a:hover{\n",
       "       font-weight: bold;\n",
       "       color: #1d3b84;\n",
       "    }\n",
       "    a:focus{\n",
       "       font-weight: bold;\n",
       "       color:#447adb;\n",
       "    }\n",
       "    a:active{\n",
       "       font-weight: bold;\n",
       "       color:#447adb;\n",
       "    }\n",
       "    .rendered_html :link {\n",
       "       text-decoration: underline; \n",
       "    }\n",
       "    .rendered_html :hover {\n",
       "       text-decoration: none; \n",
       "    }\n",
       "    .rendered_html :visited {\n",
       "      text-decoration: none;\n",
       "    }\n",
       "    .rendered_html :focus {\n",
       "      text-decoration: none;\n",
       "    }\n",
       "    .rendered_html :active {\n",
       "      text-decoration: none;\n",
       "    }\n",
       "    .warning{\n",
       "        color: rgb( 240, 20, 20 )\n",
       "    } \n",
       "    hr {\n",
       "      color: #f3f3f3;\n",
       "      background-color: #f3f3f3;\n",
       "      height: 1px;\n",
       "    }\n",
       "    blockquote{\n",
       "      display:block;\n",
       "      background: #fcfcfc;\n",
       "      border-left: 5px solid #c76c0c;\n",
       "      font-family: 'Open sans',verdana,arial,sans-serif;\n",
       "      width:680px;\n",
       "      padding: 10px 10px 10px 10px;\n",
       "      text-align:justify;\n",
       "      text-justify:inter-word;\n",
       "      }\n",
       "      blockquote p {\n",
       "        margin-bottom: 0;\n",
       "        line-height: 125%;\n",
       "        font-size: 100%;\n",
       "      }\n",
       "</style>\n",
       "<script>\n",
       "    MathJax.Hub.Config({\n",
       "                        TeX: {\n",
       "                           extensions: [\"AMSmath.js\"]\n",
       "                           },\n",
       "                tex2jax: {\n",
       "                    inlineMath: [ ['$','$'], [\"\\\\(\",\"\\\\)\"] ],\n",
       "                    displayMath: [ ['$$','$$'], [\"\\\\[\",\"\\\\]\"] ]\n",
       "                },\n",
       "                displayAlign: 'center', // Change this to 'center' to center equations.\n",
       "                \"HTML-CSS\": {\n",
       "                    scale:85,\n",
       "                    styles: {'.MathJax_Display': {\"margin\": 4}}\n",
       "                }\n",
       "        });\n",
       "</script>\n"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "execution_count": 1,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#format the book\n",
    "%matplotlib inline\n",
    "%load_ext autoreload\n",
    "%autoreload 2\n",
    "from __future__ import division, print_function\n",
    "import matplotlib.pyplot as plt\n",
    "import book_format\n",
    "book_format.load_style()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "** author's note:** *the ordering of material in this chapter is questionable. I delve into solving ODEs before discussing the basic Kalman equations. If you are reading this while it is being worked on (so long as this notice exists), you may find it easier to skip around a bit until I organize it better.*\n",
    "\n",
    "\n",
    "If you've gotten this far I hope that you are thinking that the Kalman filter's fearsome reputation is somewhat undeserved. Sure, I hand waved some equations away, but I hope implementation has been fairly straightforward for you. The underlying concept is quite straightforward - take two measurements, or a measurement and a prediction, and choose the output to be somewhere between the two. If you believe the measurement more your guess will be closer to the measurement, and if you believe the prediction is more accurate your guess will lie closer it it. That's not rocket science (little joke - it is exactly this math that got Apollo to the moon and back!). \n",
    "\n",
    "Well, to be honest I have been choosing my problems carefully. For any arbitrary problem finding some of the matrices that we need to feed into the Kalman filter equations can be quite difficult. I haven't been *too tricky*, though. Equations like Newton's equations of motion can be trivially computed for Kalman filter applications, and they make up the bulk of the kind of problems that we want to solve. If you are a hobbyist, you can safely pass by this chapter for now, and perhaps forever. Some of the later chapters will assume the material in this chapter, but much of the work will still be accessible to you. \n",
    "\n",
    "But, I urge everyone to at least read the first section, and to skim the rest. It is not much harder than what you have done - the difficulty comes in finding closed form expressions for specific problems, not understanding the math in this chapter. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Bayesian Probability"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The title of this book is *Kalman and Bayesian Filters in Python* but to date I have not touched on the Bayesian aspect much. There was enough going on in the earlier chapters that adding this form of reasoning about filters could be a distraction rather than a help. I now wish to take some time to explain what Bayesian probability is and how a Kalman filter is in fact a Bayesian filter. This is not just a diversion. First of all, a lot of the Kalman filter literature uses this formulation when talking about filters, so you will need to understand what they are talking about. Second, this math plays a strong role in filtering design once we move past the Kalman filter. \n",
    "\n",
    "To do so we will go back to our first tracking problem - tracking a dog in a hallway. Recall the update step - we believed with some degree of precision that the dog was at position 7 (for example), and then receive a measurement that the dog is at position 7.5. We want to incorporate that measurement into our belief. In the *Discrete Bayes* chapter we used histograms to denote our estimates at each hallway position, and in the *One Dimensional Kalman Filters* we used Gaussians. Both are method of using *Bayesian* probability.\n",
    "\n",
    "Briefly, *Bayesian* probability is a branch of math that lets us evaluate a hypothesis or new data point given some uncertain information about the past. For example, suppose you are driving down your neighborhood street and see one of your neighbors at their door, using a key to let themselves in. Three doors down you see two people in masks breaking a window of another house. What might you conclude?\n",
    "\n",
    "It is likely that you would reason that in the first case your neighbors were getting home and unlocking their door to get inside. In the second case you at least strongly suspect a robbery is in progress. In the first case you would just proceed on, and in the second case you'd probably call the police.\n",
    "\n",
    "Of course, things are not always what they appear. Perhaps unbeknownst to you your neighbor sold their house that morning, and they were now breaking in to steal the new owner's belongings. In the second case, perhaps the owners of the house were at a costume event at the next house, they had a medical emergency with their child, realized they lost their keys, and were breaking into their own house to get the much needed medication. Those are both *unlikely* events, but possible. Adding a few additional pieces of information would allow you to determine the true state of affairs in all but the most complicated situations.\n",
    "\n",
    "These are instances of *Bayesian* reasoning. We take knowledge from the past and integrate in new information. You know that your neighbor owned their house yesterday, so it is still highly likely that they still own it today. You know that owners of houses normally have keys to the front door, and that the normal mode of entrance into your own house is not breaking windows, so the second case is *likely* to be a breaking and entering. The reasoning is not ironclad as shown by the alternative explanations, but it is likely."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Bayes' theorem"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "*Bayes' theorem* mathematically formalizes the above reasoning. It is written as\n",
    "\n",
    "$$P(A|B) = \\frac{P(B | A)\\, P(A)}{P(B)}\\cdot$$\n",
    "\n",
    "\n",
    "Before we do some computations, let's review what the terms mean. P(A) is called the *prior probability* of the event A, and is often just shortened to the *prior*. What is the prior? It is just the probability of A being true *before* we incorporate new evidence. In our dog tracking problem above, the prior is the probability we assign to our belief that the dog is positioned at 7 before we make the measurement of 7.5. It is important to master this terminology if you expect to read a lot of the literature.\n",
    "\n",
    "$P(A|B)$ is the *conditional probability* that A is true given that B is true. For example, if it is true that your neighbor still owns their house, then it will be very likely that they are not breaking into their house. In Bayesian probability this is called the *posterior*, and it denotes our new belief after incorporating the measurement/knowledge of B. For our dog tracking problem the posterior is the probability given to the estimated position after incorporating the measurement 7.5. For the neighbor problem the posterior would be the probability of a break in after you find out that your neighbor sold their home last week.\n",
    "\n",
    "What math did we use for the dog tracking problem? Recall that we used this equation to compute the new mean and probability distribution\n",
    "\n",
    "$$\n",
    "\\begin{aligned}\n",
    "N(estimate) * N(measurement) &= \\\\\n",
    "N(\\mu_1, \\sigma_1^2)*N(\\mu_2, \\sigma_2^2) &= N(\\frac{\\sigma_1^2 \\mu_2 + \\sigma_2^2 \\mu_1}{\\sigma_1^2 + \\sigma_2^2},\\frac{1}{\\frac{1}{\\sigma_1^2} + \\frac{1}{\\sigma_2^2}}) \\cdot\n",
    "\\end{aligned}\n",
    "$$ \n",
    "\n",
    "\n",
    "Here $N(\\mu_1, \\sigma_1^2)$ is the old estimated position, so $\\sigma_1$ is an indication of our *prior* probability. $N(\\mu_2, \\sigma_2^2)$ is the mean and variance of our measurement, and so the result can be thought of as the new position and probability distribution after incorporating the new measurement. In other words, our *posterior distribution* is \n",
    "\n",
    "$$\\frac{1}{{\\sigma_{estimate}}^2} + \\frac{1}{{\\sigma_{measurement}}^2}$$"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This is still a little hard to compare to Bayes' equation because we are dealing with probability distributions rather than probabilities. So let's cast our minds back to the discrete Bayes chapter where we computed the probability that our dog was at any given position in the hallway. It looked like this:\n",
    "\n",
    "    def update(pos_belief, measure, p_hit, p_miss):\n",
    "        for i in range(len(hallway)):\n",
    "            if hallway[i] == measure:\n",
    "                pos_belief[i] *= p_hit\n",
    "            else:\n",
    "                pos_belief[i] *= p_miss\n",
    "\n",
    "        pos_belief /= sum(pos_belief)\n",
    "\n",
    "Let's rewrite this using our newly learned terminology.\n",
    "\n",
    "    def update(prior_probability, measure, prob_hit, prob_miss):\n",
    "        posterior_probability = np.zeros(len(prior_probability))\n",
    "        for i in range(len(hallway)):\n",
    "            if hallway[i] == measure:\n",
    "                posterior_probability[i] = prior_probability[i] * p_hit\n",
    "            else:\n",
    "                posterior_probability[i] = prior_probability[i] * p_miss\n",
    "\n",
    "        return posterior_probability / sum(posterior_probability)\n",
    "\n",
    "         \n",
    "So what is this doing? It's multiplying the old belief that the dog is at position *i* (prior probability) with the probability that the measurement is correct for that position, and then dividing by the total probability for that new event.\n",
    "\n",
    "Now let's look at Bayes' equation again.\n",
    "\n",
    "$$P(A|B) = \\frac{P(B | A)\\, P(A)}{P(B)}\\cdot$$\n",
    "\n",
    "It's the same thing being calculated by the code. Multiply the prior ($P(A)$) by the probability of the measurement at each position ($P(B|A)$) and divide by the total probability for the event ($P(B)$).\n",
    "\n",
    "In other words the first half of the Discrete Bayes chapter developed Bayes' equation from a thought experiment. I could have just presented Bayes' equation and then given you the Python routine above to implement it, but chances are you would not have understood *why* Bayes' equation works. Presenting the equation first is the normal approach of Kalman filtering texts, and I always found it extremely nonintuitive. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Modeling a Dynamic System that Has Noise"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We need to start by understanding the underlying equations and assumptions that the Kalman filter uses. We are trying to model real world phenomena, so what do we have to consider?\n",
    "\n",
    "First, each physical system has a process. For example, a car traveling at a certain velocity goes so far in a fixed amount of time, and its velocity varies as a function of its acceleration. We describe that behavior with the well known Newtonian equations we learned in high school.\n",
    "\n",
    "$$\n",
    "\\begin{aligned}\n",
    "v&=at\\\\\n",
    "x &= \\frac{1}{2}at^2 + v_0t + d_0\n",
    "\\end{aligned}\n",
    "$$\n",
    "\n",
    "And once we learned calculus we saw them in this form:\n",
    "\n",
    "$$\n",
    "\\begin{aligned}\n",
    " \\mathbf{v} &= \\frac{d \\mathbf{x}}{d t}\\\\ \n",
    " \\quad \\mathbf{a} &= \\frac{d \\mathbf{v}}{d t}\\\\\n",
    " &= \\frac{d^2 \\mathbf{x}}{d t^2} \\,\\!\n",
    "\\end{aligned}\n",
    " $$\n",
    " \n",
    "A typical problem would have you compute the distance traveled given a constant velocity or acceleration. But, of course we know this is not all that is happening. First, we do not have perfect measures of things like the velocity and acceleration - there is always noise in the measurements, and we have to model that. Second, no car travels on a perfect road. There are bumps that cause the car to slow down, there is wind drag, there are hills that raise and lower the speed. If we do not have explicit knowledge of these factors we lump them all together under the term \"process noise\".\n",
    "\n",
    "Trying to model all of those factors explicitly and exactly is impossible for anything but the most trivial problem. I could try to include equations for things like bumps in the road, the behavior of the car's suspension system, even the effects of hitting bugs with the windshield, but the job would never be done - there would always be more effects to add and limits to our knowledge (how many bugs do we hit in an hour, for example). What is worse, each of those models would in themselves be a simplification - do I assume the wind is constant, that the drag of the car is the same for all angles of the wind, that the suspension act as perfect springs, that the suspension for each wheel acts identically, and so on.\n",
    "\n",
    "So control theory makes a mathematically correct simplification. We acknowledge that there are many factors that influence the system that we either do not know or that we don't want to have to model. At any time $t$ we say that the actual value (say, the position of our car) is the predicted value plus some unknown process noise:\n",
    "\n",
    "$$\n",
    "x(t) = x_{pred}(t) + noise(t)\n",
    "$$\n",
    "\n",
    "This is not meant to imply that $noise(t)$ is a function that we can derive analytically or that it is well behaved. If there is a bump in the road at $t=10$ then the noise factor will just incorporate that effect. Again, this is not implying that we model, compute, or even know the value of *noise(t)*, it is merely a statement of fact - we can *always* describe the actual value as the predicted value from our idealized model plus some other value. \n",
    "\n",
    "Let's express this with linear algebra. Using the same notation from previous chapters, we can say that our model of the system (without noise) is:\n",
    "\n",
    "$$ f(\\mathbf{x}) = \\mathbf{Fx}$$\n",
    "\n",
    "That is, we have a set of linear equations that describe our system. For our car, \n",
    "$\\mathbf{F}$ will be the coefficients for Newton's equations of motion. \n",
    "\n",
    "Now we need to model the noise. We will just call that *w*, and add it to the equation.\n",
    "\n",
    "$$ f(\\mathbf{x}) = \\mathbf{Fx} + \\mathbf{w}$$\n",
    "\n",
    "Finally, we need to consider inputs into the system. We are dealing with linear problems here, so we will assume that there is some input $u$ into the system, and that we have some linear model that defines how that input changes the system. For example, if you press down on the accelerator in your car the car will accelerate. We will need a matrix $\\mathbf{B}$ to convert $u$ into the effect on the system. We just add that into our equation:\n",
    "\n",
    "$$ f(\\mathbf{x}) = \\mathbf{Fx} + \\mathbf{Bu} + \\mathbf{w}$$\n",
    "\n",
    "And that's it. That is one of the equations that Kalman set out to solve, and he found a way to compute an optimal solution if we assume certain properties of $w$.\n",
    "\n",
    "However, we took advantage of something I left mostly unstated in the last chapter. We were able to provide a definition for $\\mathbf{F}$ because we were able to take advantage of the exact solution that Newtonian equations provide us. However, if you have an engineering background you will realize what a small class of problems that covers. If you don't, I will explain it next, and provide you with several ways to compute $\\mathbf{F}$ for arbitrary systems."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Walking Through the Kalman Filter Equations"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "I promised that you would not have to understand how to derive Kalman filter equations, and that is true. However, I do think it is worth walking through the equations one by one and becoming familiar with the variables. If this is your first time through the material feel free to skip ahead to the next section. However, you will eventually want to work through this material, so why not now? You will need to have passing familiarity with these equations to read material written about the Kalman filter, as they all presuppose that you are familiar with them. I will reiterate them here for easy reference.\n",
    "\n",
    "$$\n",
    "\\begin{aligned}\n",
    "\\text{Predict Step}\\\\\n",
    "\\mathbf{x^-} &= \\mathbf{F x} + \\mathbf{B u}\\;\\;\\;&(1) \\\\\n",
    "\\mathbf{P^-} &= \\mathbf{FP{F}}^\\mathsf{T} + \\mathbf{Q}\\;\\;\\;&(2) \\\\\n",
    "\\\\\n",
    "\\text{Update Step}\\\\\n",
    "\\textbf{y} &= \\mathbf{z} - \\mathbf{H x^-} \\;\\;\\;&(3)\\\\\n",
    "\\textbf{S} &= \\mathbf{HP^-H}^\\mathsf{T} + \\mathbf{R} \\;\\;\\;&(4)\\\\\n",
    "\\mathbf{K} &= \\mathbf{P^-H}^\\mathsf{T} \\mathbf{S}^{-1}\\;\\;\\;&(5) \\\\\n",
    "\\mathbf{x} &=\\mathbf{x^-} +\\mathbf{K\\textbf{y}} \\;\\;\\;&(6)\\\\\n",
    "\\mathbf{P} &= (\\mathbf{I}-\\mathbf{KH})\\mathbf{P^-}\\;\\;\\;&(7)\n",
    "\\end{aligned}\n",
    "$$\n",
    "\n",
    "Just a reminder: the superscript $^-$ is used to denote that the value is a prediction, not an estimate. But $\\mathbf{x}$ and $\\mathbf{x}^-$ are the same thing, the *state* of our system, just at different times of the algorithm. I am not entirely pleased with this notation for several reasons. First, it clutters the equations up, making them harder to read. More importantly, that aren't always correct. For example, consider a situation wherre we have no measurement for 1 or more time periods. In that case we just compute the predict step several times in a row without an intervening update step. Thus, $\\mathbf{x}$ is never computed, and the predict step is actually $\\mathbf{x}^-_t = \\mathbf{Fx}^-_{t-1} + \\mathbf{Bu}$. Alternatively, if you have several measurements for one time epoch (from different sensors, say) it is sometimes possible to perform the update once for each measurement instead of trying to incorporate all of the measurements at once. In that case the subsequent updates are not performing the computations on the predicted state, but on the partially updated state. The $^-$ notation does not capture any of these. For most of the book I will dispense with this notation unless I want to call out that I am computing a prediciton. \n",
    "\n",
    "I will start with the update step, as that is what we started with in the one dimensional Kalman filter case. The first equation is\n",
    "\n",
    "$$\n",
    "\\mathbf{y} = \\mathbf{z} - \\mathbf{H x}\\tag{3}\n",
    "$$\n",
    "\n",
    "On the right we have $\\mathbf{Hx}$. That should be recognizable as the measurement function. Multiplying $\\mathbf{H}$ with $\\mathbf{x}$ puts $\\mathbf{x}$ into *measurement space*; in other words, the same basis and units as the sensor's measurements. The variable $\\mathbf{z}$ is just the measurement; it is typical, but not universal to use $\\mathbf{z}$ to denote measurements in the literature ($\\mathbf{y}$ is also sometimes used). Do you remember this chart?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAtcAAAEjCAYAAAD5ZS3PAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzs3XlYVGX/BvD7DPs6AgKCCrgg5oK470oKpkJi5mtqpmJu\nqYWavUq9uaS/LC3LrNc2A1NTMdfUUFHAEEjBHXcB93FBQUFZ5/n9wcvkOMMAOuz357q49DznOed8\nz5mFew7POSMJIQSIiIiIiOiFySq7ACIiIiKimoLhmoiIiIhITxiuiYiIiIj0hOGaiIiIiEhPGK6J\niIiIiPSE4ZqIiIiISE8YromqITc3NzRq1Kiyy6gStB2L0NBQyGQyrF69upKqqt6ioqIgk8mwYMEC\ntXZvb2/IZLXz18b8+fMhk8lw8ODByi6lzGrz40ZUGfhqI9IzmUxW7C+y1NRUeHh4QCaTISgoCC9y\nm3lJkp572erAzc1NdSy1/cycORNA4XEo7lg82y6TyarMh5KxY8dq7JOFhQWaN2+OoKAg3Lp1q7JL\n1Dh+uo51aRR96Hk2tNdERYE2Ojq62D5Fgb0ijoc+3i+q0uuHqCozrOwCiGoibb/ITpw4gQEDBuD2\n7dtYvHgxZs+eXQmVVT/Tp09HnTp1NNq7dOkCADhw4ECZ1lfVPpQMHjwYXl5eAIA7d+4gPDwcK1as\nwIYNG/D333/Dzc2tcgt8yq+//oonT5688Hqq2mNQXkr7YaQ6HY/qVCtRZWG4JqoAkZGRGDx4MLKz\nsxEaGoq33nqrskuqFiRJwvTp0+Hi4lJsn+p+Jm3w4MEYPXq0ajo/Px+vvPIKIiMjsWjRIvz888+V\nWJ26hg0b6mU9teWLgWvLfhKROg4LISpnYWFh6N+/P4QQ+OOPPzSCdV5eHr799lsMHDgQrq6uMDU1\nha2tLXx8fLBr165Sb+fpP7knJCSgf//+kMvlsLW1xb/+9S/cuHEDAHD+/HkMHToUdevWhbm5Ofr0\n6YNTp05prO/ChQuYM2cOOnToAHt7e5iamsLNzQ0TJkzAtWvXNPoXjdMNDAxEamoqhg8fjrp168LM\nzAwdO3Ys076URWnGnxfVBhQOzXl6KEZgYKBa30uXLmH8+PGqx8LBwQFDhgzBsWPHNNZb9Gf91atX\nY/fu3ejVqxesra1ha2v73PtjaGiIyZMnAwAOHz6stp8ymQy5ubmYP38+3N3dYWJighkzZjxX7QBw\n+/ZtvP3223B0dIS5uTnatm2LX3/9tdjadI3d3bdvHwYNGgRHR0eYmpqiYcOG8Pf3x86dOwEUDoMZ\nN24cAGDBggVqj0FpxjFv27YNo0aNQrNmzWBpaQlLS0u0b98ey5cvh1Kp1OhfNOwmOjoav//+Ozp1\n6gQLCwvY2dlhxIgRuHnzptbtJCYmon///rCysoJcLoevry/i4+NLrE+fnn6sP/zwQ7i5ucHU1BTu\n7u5YtGgR8vLytC63YcMGtG/fHubm5nB0dMTo0aOL3c+yvO+U1+uHqKbimWuicrRixQpMnz4d9vb2\n2LVrF9q3b6/RJy0tDdOnT0f37t3xyiuvwN7eHjdv3sQff/yBV199Fd9//z0mTpxY6m0eOXIES5Ys\ngY+PDyZNmoT4+Hhs3rwZp06dwqZNm9CzZ0+0b98e48aNQ1JSEv7880/4+PggOTkZFhYWqvVs2bIF\nP/zwA/r06YMePXrA2NgYp0+fxi+//II//vgDiYmJqF+/vsb2r1y5gs6dO6NJkyYYM2YM0tLSsHHj\nRgQEBCAiIgLe3t5lOoalOftX0p+qGzVqhHnz5mHBggWQy+VqgbRoSAZQOMQkICAAubm58Pf3h7u7\nO65fv44tW7bgzz//xPbt29GvXz+N9W/atAl79uyBv78/pk6ditu3b5dhDzUVhUVt+1UUVAYMGIC6\ndeuqPliUtfZ79+6hW7duSElJQffu3dGrVy/cvHkT77zzDnx8fIqtTVtN8+bNw8KFC2FpaYnBgwfD\nxcUFt27dQnx8PH755Rf4+/vjtddeQ0ZGBrZv3w5vb2+154Grq2uJxyQ4OBgGBgbo2rUr6tevj4yM\nDOzfvx8zZszA4cOHsW7dOq3L/fe//8WOHTsQEBCAl19+GfHx8di4cSNOnDiB48ePw9jYWNU3NjYW\nPj4+yMvLw5AhQ+Du7o4TJ07A29sbffr0KbFGfRs6dCiOHj2KoUOHwsjICFu3bsXcuXORmJiIrVu3\nqvX96quv8P7776NOnToYPXo0bGxssGfPHnTv3h1yuVxj3WV53ynv1w9RjSOISK8kSRIymUzMmTNH\nSJIkmjZtKi5fvlxs/5ycHHHjxg2N9oyMDNGqVStha2srnjx5ojbP1dVVNGrUSK0tJCRESJIkJEkS\nW7ZsUZvXv39/IUmSkMvlYtmyZWrzJk6cKCRJEsuXL1drv3HjhsjNzdWoa+/evcLAwEBMnjxZrT0y\nMlK1/U8++URt3p49e4QkSWLgwIHFHAVNrq6uQpIkMX36dDFv3jy1n88++6xUx2L16tVq7ZIkafQt\nkp6eLuzs7ETdunXF2bNn1eadPXtWWFlZCWdnZ5GTk6NqnzdvnpAkSRgYGIg9e/aUet+EEGLMmDFa\na8zNzRXe3t5CkiQxYcIEjePRpk0bkZaW9sK1T5gwQUiSJN577z21/seOHRPGxsZCkiSxYMECtXm9\ne/cWMplMra3osW3UqJG4fv26xn4+3Vb0uDy73tJITk7WaFMqlarjGB8frzavqF0ul4vTp0+rzRs5\ncqSQJEmEhYWprcvDw0PIZDKN1893332nel1HR0eXqt7evXsLSZJ09i96/jx7PIoeaw8PD5Genq5q\nf/LkiejUqZOQJEmsX79e1Z6SkiKMjIyEjY2NSElJUdunYcOGqWp/2vO87+j79UNUUzFcE+lZUcCU\nJEkYGxuLixcvPve6vvzySyFJkjh48KBau65A+fLLL2usZ82aNaqg/6yDBw8KSZLEuHHjSl1X69at\nRePGjdXaisJ1o0aNhFKp1FjGxcVF2Nvbl3obRQFD24+NjY1aP32E62+++UZIkiRWrFihdf6MGTOE\nJEli9+7dqraicDRkyJBS71eRovA3ePBg1YeGKVOmiMaNGwtJkoSjo6NITU3VOB47dux44dpzc3OF\nubm5sLKyUgtvRcaNG1fqcO3v7y8kSRK///57ifv8IuG6OImJiUKSJLFw4UK19qLj+/HHH2ssU/Rc\n/eCDD1RtMTExQpIk0aNHD43+SqVSuLu7lxiWn6aPcL127VqNZfbu3SskSRK+vr6qtkWLFglJksR/\n/vMfjf4pKSnCwMBA43HTpbj3HX2/fohqKg4LISon/fv3R3h4OEaOHIk9e/bAxsam2L5JSUlYunQp\nDh48CIVCgezsbLX5xY2b1KZt27YabfXq1QMAeHp6asxzcnICAFy/fl1j3tq1axEaGooTJ04gPT0d\nBQUFqnkmJiZat+/l5aV16EDDhg3x999/l24n/keSJKSkpOi8oFFfDh06BKDwri7z58/XmH/+/HkA\nwNmzZzFgwAC1eZ06dXru7W7fvh3bt28HAJiamsLV1RXvvvsu5syZo3psikiSpHVbZa393LlzePLk\nCbp166Z1yECvXr0QEhJSqvrj4+MhSZLGMdG3tLQ0LF26FLt370ZycjIeP36sNr/omoJndejQQaOt\nQYMGAIAHDx6o2o4ePQoA6N27t0Z/SZLQvXt3XLp06bnrLytJkrTW0rNnTwDA8ePHVW26andzc0PD\nhg1x9epVjXn6fN95kdcPUU3DcE1UDiRJwo4dOzBs2DBs27YN3t7eiIiIgL29vUbf+Ph49OnTB0ql\nEn379sXgwYNhbW0NmUyGY8eOYfv27cjJySn1trWFJUNDwxLnPXuR1IwZM7B8+XI4OztjwIABqF+/\nPszMzAAAISEhWn9ZA9B627yi7Wi78KyqSEtLAwCsWrWq2D6SJCErK0ujvejDy/MIDQ1Vu1tISRwd\nHTXaylp7RkZGsevS1a5Neno6rK2tYW5uXuplyio9PR0dO3ZEamoqOnfujLFjx8LW1haGhoZ48OAB\nli9fXuxrRNvzseg5//SHRX0eEwCqCwB1PeeL5hV3kai2bZqamsLa2lpVL1C62p99ver7fedFXj9E\nNQ3DNVE5MTQ0xKZNmzBmzBj89ttv6NWrFyIiIjQuAly0aBGys7MRFRWFXr16qc1bvHix6qxmRbpz\n5w6++eYbtG7dGrGxsWoXOgIo9uKx6qzog8fRo0fVLtIqjcq+929Zay/qX9yFl2W5ILNOnTq4f/8+\nsrKyNJ4n+vLzzz8jNTUV8+fPx9y5c9XmxcXFYfny5S+8DX0ek6fXVxQ6tbl37x6A4j+QKhQKjdsf\nZmdn4+HDh6hbt67Gtm7fvo3WrVuXqnZ9v++8yOuHqKbhrfiIypGBgQHWrFmD8ePH4/z58+jVqxdS\nU1PV+ly6dAl2dnYav+AA6Px2t/KUnJwMIQT69eunEZiuX7+O5OTkSqnrRUmSpHa28mndunUDgGr5\n9dZlrf2ll16CmZkZTp48ifT0dI35ZXnede3aFUII/PnnnyX2NTAwAIBiH4PiFA3HeP311zXm6es1\nUnQnn6ioKI15SqUSMTExZVpfUcDUtVxsbCwAoE2bNhrzhBBa963oMX56+Jeu2lNSUrTeOvN53ndq\n6uuHSN8YronKmSRJ+PHHHxEUFISUlBT07NkTFy5cUM1v1KgR0tLSNO41vWrVKuzdu7eiy1XVBAB/\n/fWX2p+1MzMzMWHChDKHo6rCzs4Od+/e1RhbCgCBgYGwsbHBwoULtd7XWAiBmJiYYu8xXJnKWruh\noSFGjRqFzMxMjTPBx44dw9q1a0u97XfffRcA8MEHH2gdt//0WOiis61Xrlwp9fqBf56PkZGRGrUu\nXry4TOsqTrdu3eDh4YHY2Fhs2bJFbd7KlStx+fLlMv2F4q233oKhoSF+/vlnnDhxQmP+zz//jJMn\nT6JZs2bo0aOH1nUsXLhQbfjHkydP8J///AcA1O4v/eabb8LIyAjfffcdUlJSVO1KpRJz5szROjTl\ned53aurrh0jfOCyEqIJ89dVXMDc3x+LFi9G7d2/s27cPrVq1wvTp07Fnzx706NEDw4YNg7W1NRIS\nEnDo0CEMHToUv//+e4XX6ujoiOHDh2PDhg3w8vKCr68vMjIysG/fPpibm8PLy0vtgqrSEmX8xrqy\n9i9Jv3798Ntvv6F///7o2bMnTExM4OXlBX9/f9jY2GDz5s0YPHgwunXrhj59+qBFixYwMjLCtWvX\n8Pfff+PatWtIT0+HkZGRXut6Uc9T+6effor9+/fj22+/xdGjR9GzZ08oFAqEhYVh4MCB2LFjh9Zt\nPfuY+Pr64uOPP8bChQvRokULBAQEwMXFBXfu3EF8fDyaNm2quidzt27dYGFhgQ0bNsDIyAguLi6Q\nJAmjR4/WedHq6NGjsXTpUkyfPh2RkZFo2rQpLl68iF27duH111/Hhg0b9HIcV61aBV9fXwwbNgxD\nhgxB06ZNcfLkSURERKguUC6txo0b49tvv8WUKVPQqVMn+Pv7w8PDA3l5eYiPj8ehQ4dga2uLdevW\nFRvaX3rpJbRs2RJDhw6FgYEBtm3bhpSUFAwePBjDhw9X9XN1dcVnn32G999/H+3atcOwYcNU97nO\nyMiAp6cnTp48qbbu53nfqamvHyK9K+l2It9++63w9PQU1tbWwtraWnTt2lXs2rWr2P6RkZFi0KBB\nwsnJSZibmwtPT0/xyy+/6OPOJkTVgrZ7yj7t008/FZIkibp164rExEQhhBA7d+4UXbp0EVZWVsLG\nxka88sor4q+//hKhoaFCJpNp3FLOzc1N45ZYRX213eas6NZjgYGBGvNSUlK03sLv8ePH4qOPPhJN\nmzYVpqamwsXFRUybNk2kpaUJb29vjX3UtQ0hhNZldHFzcxMymUxcuXKlxH7FHYtnj9vdu3fF6NGj\nhZOTk+r2ZM/We/XqVREUFCQ8PDyEmZmZsLKyEh4eHmLEiBFiw4YNarcZnD9/vtbtlMbYsWPLtGzR\n8dClLLULIYRCoRDjxo0T9vb2wszMTLRt21asXr1aREVFab1FnK7HMDw8XAwcOFDY2dkJY2Nj0bBh\nQ/Hqq69q3Hpt3759okePHsLKyqpM944+c+aMGDRokHBwcBAWFhaiQ4cOYtWqVSI1NVXr867o+Gpb\nd9FzXttzNTExUfTv319YWVkJKysr4evrK+Lj41WPdWlvxVckPj5ejBw5Uri4uAgTExNhbm4uWrRo\nIWbMmKH1vuBCFN6KTyaTiZycHBEcHCzc3NyEiYmJaNKkiVi4cKHIy8vTutz69etFu3bthKmpqXBw\ncBBvvfWWuHXrVrGPW1nfd/T9+iGqqSQhdJ8a2rFjB0xMTODu7g6lUonQ0FAsWbIER44c0TpObPHi\nxXjy5AkGDBgAJycnhIeH491338Wvv/6KESNGlNuHBCIioprAzc0N165dq7bDr4hquxLDtTZ2dnb4\n7LPPMGHChFL1f+ONN1BQUFApf94mIiKqThiuiaq3Ml3QWFBQgA0bNiA7O1vrFcbFycjIgK2tbZmL\nIyIiIiKqTkp1QeOpU6fQtWtX5OTkwMzMDGFhYfDw8CjVBnbu3IkDBw6objlERERExavs+6YT0Ysp\n1bCQvLw8XLt2DRkZGdi0aRNWrFiByMhIrV8r+7RDhw5h4MCBWLJkCSZNmqQx/+lbDBERERERVTfP\nfvvxc4259vX1RYMGDRASElJsn5iYGPj5+WHhwoV47733tPZhuCYiIiKi6uzZcP1cXyJTUFCg9ab0\nRQ4ePIiBAwdiwYIFxQZrIiIiIqKapsQx13PmzIG/vz8aNGiAR48e4bfffkN0dLTqZvrBwcE4cuQI\nIiIiABR+/aqfnx+mTZuGESNGQKFQACj82lt7e/tit/Ns6qcXl5CQAAAlDt8hqmx8rlJ1wOcpVRd8\nrpY/XaMvSgzXt2/fxqhRo6BQKCCXy9GmTRuEh4fD19cXAKBQKJCcnKzqv3r1amRnZ2Pp0qVYunSp\nqt3NzU2tHxERERFRTVNiuNY1rlrb/JCQkBKXISIiIiKqiZ5rzDUREREREWliuCYiIiIi0hOGayIi\nIiIiPWG4JiIiIiLSE4ZrIiIiIiI9YbgmIiIiItIThmsiIiIiIj1huCYiIiIi0hOGayIiIiIiPWG4\nJiIiIiLSE4ZrIiIiIiI9YbgmIiIiItIThmsiIiIiIj1huCYiIiIi0hOGayIiIiIiPWG4JiIiIiLS\nE4ZrIiIiIiI9YbgmIiIiItIThmsiIqJqxj/4NwR+vl017T09FO998+cLrXPsZ9vw6ofrX7Q0olrP\nsLILICIiorKRJAnSU9PbFg2HkUHpzpdFHU9Fn5mrcW/bv2FrbaZqX/HeAAih50KJaiGGayIiokqQ\nm1cAYyMDvayrjqVpmZcRzyRpK3MTvdRCVNsxXBMREemB9/RQvORaF8aGBliz7yQAYPzAdvh8kg8k\nSYLb8K8ROMALVxQZ2BpzDv06NMHGeUMRe/oagn/aj4QLN2FjaYpB3Tzw+SQfVdh9nJ2HKV/vwuaD\nZ2FhaoSg1zsDAMQz227d2AEr3hsIoDC4zw+Nwm/7T0FxPxP17a0x/fXOGNTNA31mrgYA2L+2FAAw\n9hUv/DI7AGM/24a0h0/wx6cjAAA5ufmY/WMENhw4jYysHHg1rYcvJvuie2sXAP+cAY/4YjSCf9qP\n06l30MLVHj++74+27k7lfryJqiqOuSYiItKTdRGnAADx343HDzP98ePORHz9e7xq/rJN8WjhZo/E\nHybi0/F9cCr5Nl7591oM7uGBkz9PxpZP3sDxywqMW7JDtcyslXsRkZiMLZ8Mw/4vR+PYRQUOnryi\nNiykcJjIPy1jPtuGNftO4qupr+Dcr9Owes5g2FqZoaGDHJsXDAMAnAmdCsXmWVj+bv9/1vHUSv/9\nwz6ERSUhZHYAjv80Ca0bOaD/7HVQ3M9U2+cPf96PJZN8cPSHibCzNsOb/7dFX4eTqFrSGa6/++47\ntGnTBnK5HHK5HN26dcPu3bt1rvDUqVPo3bs3zM3N0aBBAyxcuFCvBRMREVVVznZWWP7uADRraId/\nebfEB8O7Ydmmf8K1dxs3zHqjGxo726BJfVss3RCLN15uiRn/6oom9W3R6aX6+O90P2w+eAb3Mh4j\n80kufvnzGJZO9oVvhyZo2cgBIbMDIHs6BT/j4vU0bIw8jVUfDMJrPV+CW7066NHaBW/6ekImk2Bj\nVTjO2qGOBRxsLFRnyIUQqjHXWU9y8f0fiVgyyRcDOrvDw6Uuvp/pD0cbC3y37bDa9haOexm9vdzg\n4VIXc0f3xrmr93Dz3iM9H1mi6kPnsJCGDRtiyZIlcHd3h1KpRGhoKAYPHowjR46gTZs2Gv0fPnwI\nX19feHt7IyEhAWfPnkVgYCAsLCwwc+bMctsJIiKiyiZJErq0aKDW1uWlBvj4l0g8epwDSZLQwUN9\nuETihVu4fPM+NkYmqdqEEJAkCZdv3IepsSFy8wvQtWVD1XwLM2O0buxQbB3HLiogkyS83Nbtuffl\n8s0HyMsvQPdW/2xXJpPQtWVDnEm9p9bXs7Gj6v9OdpYAgDvpWXCua/Xc2yeqznSG60GDBqlNL1q0\nCCtXrsThw4e1hut169YhOzsbq1evhomJCVq0aIFz585h2bJlDNdERFTjlXS3DQtTY/X+EJjg3w4z\nhnbV6Otc1wrnr97TaC/NdsqLEAIymfpZcyPDfy7KlP53Rl2p5G1HqPYq9ZjrgoICbNiwAdnZ2ejV\nq5fWPnFxcejZsydMTP654rhfv364efMmrly58uLVEhERVQKlUon8/LrIz68LpVKptY8QAn+fva7W\nFn/2OurXtS72Thzt3J1wOuUuGjvbaPyYGhuiSX1bGBkaIC7pmmqZrCe5OJ1yp9havZrWg1IIHDia\nonW+8f/CcEEx+wEATZxtYGxogJhTV1VtBQVKxJ25jhaudYtdjohKEa5PnToFS0tLmJqaYuLEiQgL\nC4OHh4fWvgqFAo6OjmptRdMKhUIP5RIREVUspVKJvXtz8NprLnjtNRfs3ZtTbMC+mfYI078Nx/mr\n9/B79Bl8sTEOM4Z2AaB56zsAmD2iOw6fu4F3vtqJYxdv4dKN+9gZdwGTl+0EAFiaGePtAW0x+8cI\nRCQmIynlDsYt2QHlM+sSQkD87/4hzRraYZh3S4z/4g9sOXgWKbce4K+TV7D2f3cwcXWUQ5Ik7Iy7\ngLvpWch6kqtRl4WZMd4J6IDZP0bgz78v4uyVu3jnq124m56FKQEdn/9gEtUCJd6Kr3nz5jh58iQy\nMjKwadMmDB8+HJGRkejQoYNGX0nHBRYlSUhIeO5lSTceW6ou+Fylqig/vy4CA12gUBSejwoMNMHW\nrVdhaKg+ZCMz8xH6tamHWwoFOk7+ARIkDOrUED0bGSIhIQF5ubm4du0aEhKM1Jb7flJnrAw/j557\nT0CpFKhva46XW9dTvR5Gdq6LqzduIeCj32BqZIg3erjC00WOe2n3VH0yMx/h7h1JNR3UzwUm4gne\nWbYD6Vm5cJCbYmSvRkiwKQzSE33d8e/v92D80h3w69AAc4e1QVpaGjIe56rWMay9LW7ftseoRZuR\nmZ0Hj/rW+CqwPa4ln8O1ZOD85TRIAI4dPwa5eeFwl5v3H0MCcObMGSgf3iiXx4NKj++p5cfd3b3Y\neZLQ9lFaB19fXzRo0AAhISEa88aMGYO0tDTs3LlT1XbkyBF07twZKSkpcHV1VeufkZGh+v/FixfL\nUgYREVGFyM+vi9de+ydc16un1BquJ38fh6b1rDFrcMvKKJOIKtDT4Voul6vNK/OXyBQUFBT757Cu\nXbti9uzZyMnJUY273rdvH+rXr68RrJ+l7Uw4vZiiT6w8tlTV8blKVZlSqURISA4CAwt/r4WE5KBT\nJxfIZG5q/SwtT8PewZ7PY6p0fE8tf0+fIH6WzjHXc+bMQUxMDFJTU3Hq1CkEBwcjOjoao0aNAgAE\nBwfDx8dH1X/kyJEwNzfH2LFjkZSUhC1btuDzzz/nnUKIiKjakslk6NevcCjI1q1X0a+fCWQyzV+f\nz36RCxHVTjrPXN++fRujRo2CQqGAXC5HmzZtEB4eDl9fXwCFFykmJyer+ltbW2Pfvn2YOnUqOnTo\nAFtbW8yaNQszZswo370gIiLSEyEEDp+9gbkhUQAEwpeMgkwmKxwGUlCgcca6SORXYyqyTCKqonSG\na23jqkua36pVK0RHR79YVURERBVICIEj525iU3QSNkWdwZXb//zJ90lOHsxNjWFy7jjkm37Gkw+X\nwKyz9lvSEhGVecw1ERFRTbJ+/ykE/7RfLVAXecm1Lsz/98UvhjevQcrPR+7lcwzXRFSsUn+JDBER\nUU0UGn4CV25nwNnOCp2aO6vNm8p7OhNRGfHMNRER1Wrr/jMEV2+nY+tf57Bo7V+QSYUXMRYolXi9\nd4vKLo+IqhmeuSYiolrNztoM22LOY9Hav2AgkzB5UAfkFyjRy9MV9WwtK7s8IqpmGK6JiKjWEkJg\nXkgUFq45CAOZhHUfDcG1uw8BAP/iWWsieg4M10REVCtpC9Zv9GmFjMwcWJkbc0gIET0XjrkmIqJa\np7hgDQDbFr2Bx9l5HBJCRM+F4ZqIiGoVXcEaAGyszGBjZVaJFRJRdcZhIUREVGuUFKyJiF4UwzUR\nEdUKDNZEVBEYromIqMZjsCaiisJwTURENRqDNRFVJIZrIiKqsRisiaiiMVwTEVGNxGBNRJWB4ZqI\niGocBmsiqiwM10REVKMwWBNRZWK4JiKiGoPBmogqG8M1ERHVCAzWRFQVMFwTEVG1x2BdtYwdOxav\nvvpqZZdBVCkYromIqFpjsK48UVFRkMlkuH//vlr7ihUrsG7dunLf/vz589G6dety3w5RWRhWdgFE\nRETPi8G6ahBCqE1bWVlVUiVElY9nromIqFqq7sHa29sbU6dOxYcffgh7e3s4Ojrigw8+UAuqubm5\nmD17Nho2bAgLCwt06tQJe/fuVc3v0qULPv/8c9X0qFGjIJPJcPv2bQDA48ePYWJigtjY2GLrOHPm\nDPz8/GBLAn1hAAAgAElEQVRtbQ1HR0eMHDlStTwAnDp1Cn379oVcLoeVlRW8vLwQFRWF1NRU9OnT\nBwBgb28PmUyGcePGAdAcFuLt7Y0pU6bg/fffh52dHRwcHPDNN98gOzsbkydPRp06deDq6or169er\n1TZnzhw0b94c5ubmaNSoEWbPno2cnBwAQGhoKD755BMkJSVBJpNBJpPh119/BQBkZGRg4sSJcHR0\nhLW1Nby9vZGYmFi2B4joOTFcExFRtVPdg3WRdevWwdjYGHFxcfj222/x9ddfY+PGjar5gYGB+Ouv\nv7B+/XokJSVhzJgxePXVV3Hy5EkAwMsvv4yoqChV/+joaNjb26vaYmNjYWRkhE6dOmnd/q1bt9Cr\nVy94enriyJEj2L9/PzIzMxEQEKDqM3LkSNSvXx9HjhzBiRMnsGDBApiamsLFxQWbN28GUBjQFQoF\nli9fDgCQJAmSJGnsq1wux+HDhzFnzhxMnz4dAQEBaNmyJY4ePYoxY8Zg3LhxasHe0tISISEhOHfu\nHP773/9iw4YN+L//+z8AwPDhw/H+++/Dw8MDCoUCCoUCw4YNgxACfn5+uHXrFnbt2oXjx4+jV69e\n6NOnDxQKxXM+UkRlIHT49NNPRYcOHYS1tbWwt7cXr776qjh9+rSuRYQQQuzatUt07txZWFlZibp1\n64qAgABx4cIFjX7p6emqH9K/I0eOiCNHjlR2GUQl4nOVykKpVIqPVx0Q8J4vDPosEBv2n6qQ7Z75\nfK64OrC9SF/3g17W17t3b9GtWze1Nl9fXzF+/HghhBCXLl0SMplMXL16Va1PQECAmDJlihBCiD//\n/FNYWlqKgoICcfHiRWFtbS0+/vhjMWnSJCGEEB999JHw9fUttoaPP/5Y9O3bV63t/v37QpIk1WvS\n2tparF69WuvykZGRQpIkkZaWptY+ZswY4e/vr3Nf7e3tRUBAgGo6Ly9PGBsbi82bNxdb78qVK0XT\npk1V0/PmzROtWrVS67N//35haWkpnjx5otbu5eUllixZUuy6axK+p5Y/XRlW55nr6OhoTJs2DXFx\ncThw4AAMDQ3h4+ODBw8eFLvMpUuXMHjwYHh7e+P48eOIiIhAdnY2Bg4cqPcPBkREVLuIGnLGGig8\nu+vp6anW5uTkhDt37gAAjh49CiEEWrRoASsrK9XP7t27kZycDADo0aMHcnJycPjwYURFRaFnz57o\n27ev6sx1VFQUvL29i60hMTERBw8eVFu/i4sLJEnC5cuXAQAzZ87E+PHj0bdvX3z66ac4f/68XvbV\nwcFB7WJEQ0ND2NjYqPYfAH7//Xf06NEDTk5OsLKywsyZM3Ht2jWd20pMTMTjx49hb2+vtl9JSUmq\n40ZUnnRe0BgeHq42vWbNGsjlcsTGxsLPz0/rMsePH4dSqcTixYtVfxKaPXs2+vbti/v378PW1lZP\npRMRUW1SXYJ1cnIyzpw5A39//xL7GhkZqU1LkqQac61UKiFJEhISEjT6mZmZASgcNtG+fXtERkbi\nzJkzePnll9GlSxdcvXoVly9fRkJCApYsWVLs9oUQ8Pf3xxdffKExz8HBAQAwb948vPnmm/jzzz+x\nZ88eLFiwAN9//z0CAwNL3L+S9lVbm1KpBADEx8djxIgRmD9/Pvr37486depg+/btmDVrls7tKJVK\nODo6IiYmRmOetbV1mWomeh5lulvIw4cPoVQqYWNjU2yf7t27w9LSEj/99BPefvttPH78GKGhoejU\nqRODNRERPZfKDtZKpRJKpbmqFm0yMzOxYsUKmJiYYMqUKS+8zbZt20IIgVu3buk8++zt7Y0DBw7g\n/PnzmD59OkxMTNC5c2csWrRI53hrAGjXrh3CwsLg4uICQ8PiI0HTpk3x7rvv4t1338WUKVPw888/\nIzAwEMbGxgCAgoKC597P4hw6dAj169fHRx99pGpLTU1V62NsbKyx7fbt2+P27duQJAmNGjXSe11E\nJSnTBY1BQUFo27YtunbtWmwfJycn7N69G//5z39gamqKOnXqICkpCX/88ccLF0tERLVPVQjWe/fm\nYGOYHABw+VKB6uxq0fy1a9di0aJFGD16NGbOnAlTU9MS1yuE0BrUi9qaNWuGN998E2PHjsXmzZuR\nnJyMhIQEfPHFF9i6dauqv7e3N6KiovDo0SO0a9dO1bZ27Vp07dpVZ2ieOnUqMjIy8MYbb+Dw4cNI\nTk5GREQEJk2ahMzMTGRnZ2Pq1KmIjo5Gamoq/v77b8TExKBly5YAAFdXV0iShJ07d+Lu3bvIysoq\n9b4W9yGliIeHB27cuIHffvsNycnJWLlyJTZs2KDWp1GjRrhy5QqOHTuGe/fuITc3Fz4+PujevTsC\nAgIQHh6OlJQUxMXFYd68eVrPZhPpW6nPXM+cOROxsbGIiYnRuAL4acnJyRg8eDACAwMxcuRIPHz4\nEHPnzsWwYcNw4MCBYpdNSEgoe/VUKjy2VF3wuUrPEkLgh70XsCriEgxkEj4Z4YUm1tkV+lzJz6+L\nwEAXjLQq/P21bZsB8l65CkPDe7hz5w7eeecdeHp6wsnJCfPnz1f7Pefi4oL+/ftrXW9mZibu3r2r\nti9paWnIyMhQtU2dOhXm5uYICgrCnTt3YG1tjVatWmHChAmqPkVDRFq3bq263Vy9evVQUFAAd3f3\nEo/V999/j++++w6+vr7IyclBvXr10KVLF5w+fRoAcPnyZYwcORL37t2DXC5Hz549MWrUKNV6J06c\niH//+98YP348/Pz8MHfuXI390Lav2dnZuHHjhlpbXl4erly5goSEBNSrVw+jRo3CtGnTkJOTgy5d\nuuDtt9/GkiVLVMu4ubmha9eu8Pb2xqNHjzBv3jz4+flh0aJFWLlyJcaMGYMHDx7A1tYWXl5eaNeu\nXa16n6lN+1rR3N3di50niZI+OgKYMWMGwsLCEBkZiWbNmunsO3v2bERERKjdT/LGjRto2LAhYmJi\n0K1bN1V7RkaG6v8XL14sqQwiIqpFtAXrfl7OFV5Hfn5dvPaaC0Za/YTp7j/hx5sT4LfyFRga3oMQ\nAkePHkVsbCzs7Ozg5+cHuVxe4TUSUcV6Olw/+5ov8cx1UFAQNm3aVKpgDRS+Gcpk6qNNiqaf/jPa\nszp06FDiuqlsij6x8thSVcfnKj2raChIUbCuzIsXlUolQkJyEPth4bmowYML0LaTC2QyNwBAx44d\nMWnSJFy/fh2//vorsrKyMGzYMLRp06ZS6iXie2r5e/oE8bN0jrmeOnUqQkNDVTd+L7pJ+9NjqoKD\ng+Hj46OaHjRoEI4ePYqFCxfi4sWLOHr0KAIDA+Hi4oL27dvrYXeIiKgmq+wx1s+SyWTo188Ebwwr\n/GXapKmBxkkkAGjQoAE+/PBDzJ07F5cvXy5xTDER1Uw6w/XKlSuRmZmJvn37wtnZWfXz5Zdfqvoo\nFAq1+0b26NEDGzduxPbt29GuXTsMGDAApqamCA8PV40LIyIi0qaqBesihV+v/RgAdF53BAAmJiYY\nMmRIif2IqGbSOSxE1zCOIiEhIRptQ4cOxdChQ5+/KiIiqnWqarAmIiqLMt2Kj4iIqDwwWBNRTcFw\nTURElYrBmohqEoZrIiKqNAzWRFTTMFwTEVGlYLAmopqI4ZqIiCocgzUR1VQM10REVKEYrImoJmO4\nJiKiCsNgTUQ1HcM1ERFVCAZrIqoNGK6JiKjcMVgTUW3BcE1EROWKwZqIahOGayIiKjcM1kRU2zBc\nExFRuWCwJqLaiOGaiIj0jsGaiGorhmsiItIrBmsiqs0YromISG8YrImotmO4JiIivWCwJiJiuCYi\nIj1gsCYiKsRwTUREL4TBmojoHwzXRET03BisiYjUMVwTEdFzYbAuX/m3b+Kaf0fkXjpXbJ/ci2dw\nzb8j8u8o9LrttGXzcXfBDL2uk6i2MKzsAoiIqPphsC5/Bvb14Lx2D2RW8orfuCRV/DaJagieuSYi\nojJhsC4dkZf3QstLMhkM6thCMjDQU0VlIETFb5OohuCZayIiKjUG6+LdmTMRhg0bQ2ZiiqwDu2Do\n6AzbGfOQvmo5cpKOQzIxgWmbjqgzYSYMbOwAALmpl5D+45fIvXgGEAKG9RqgzsSZMPXsgPzbN3Hr\n7QA4fr0Gxk2bAwCeJMQi/acvUXBHAWP3FrAY+LpaDVn7/sCDH5aiwe8HVW3ZJxNw98N34Lw+AgZW\nchQ8ykD6fz9HzpkTUD5Kh0G9+rB+7S1Y+L5acQeLqAZjuCYiolJhsC7Z48g/YTlgCByW/gzlo4e4\nM3sCLF55DXUmzIDIz0fG6u9wb+H7cFwWCgC4v+QjGDXxgOPUXyHJDJCXegmSsYnWdeffVeDeolmw\nHDAElv7/Ql7yRaT/tKzsQzhyc2Hk3gJWwwIhM7dA9rG/cf/bT2HgUA+mbTq+4BEgIp3DQhYvXoyO\nHTtCLpfDwcEBgwYNQlJSUqlW/PXXX6N58+YwNTWFs7MzgoOD9VIwERFVPAbr0jGsVx913g6CUX1X\nZB85BKNGHqgzdhqMGrjB2K0p7GYuQO6FpMIz1SgMzKZenWBU3xWGTg1g1tUbJs1ba1135u7NMHR0\ngs2kWTCq7wrznj6wHPh6mYdwGNjZw3rIKBg3coehozMs+78G824v43H0nhfefyIq4cx1dHQ0pk2b\nho4dO0KpVGLu3Lnw8fHBmTNnYGNjU+xyM2fOxK5du/DFF1+gdevWyMjIwK1bt/RePBERlT8G69KS\nVMM3ACD30lnkJB3F9aG9nukmIf/WdRi7t4DVa2/i/jeLkLV/F0zbdIRZ9z4wauCmde3511Jg7KEe\nvI2LCeK6iIICPNoUisd/7UPB/bsQeXkQeXkw9exQ5nURkSad4To8PFxtes2aNZDL5YiNjYWfn5/W\nZc6fP49vv/0Wp06dgoeHh6q9TZs2eiiXiIgqEoN12UimZk9NCZh17Ik6bwdp9JPVsQUAyEdOhLn3\nAGQnHEL20Xhk/PYTbKYFw9J3kLa1AyjhLLVM0jyTXZCvNvloyxo82vYb6kyaBSO3ppCZmiF99XdQ\npt8veQeJqERlulvIw4cPoVQqdZ613r59Oxo3bozdu3ejcePGaNSoEcaOHYu7d+++cLFERFRxGKxf\njHGT5si7chkGDvVg6NRA7UdmZq7qZ+TcEFaDhsN+/tew6BeArD3btK7PsKEbcs+fVmvLPXdKbVom\nt4HIyYbycdY/fZIvqPXJOXMCpp17weLlATBu5A6DevWRf/0Kb79HpCdluqAxKCgIbdu2RdeuXYvt\nk5ycjCtXriAsLAy//vorAGDWrFl49dVXERcXB6mYF29CQkJZSqEy4LGl6oLP1apDCIEf9l7AqohL\nMJBJ+GSEF5pYZ9fqx8jif//evHETF7UcB5tHD5F/+zYu/2+erKEHbDM24dLsd5DVox+EuSUMHtyD\nSdJRZL7yOoTMAFZ7fkd2q/YokNtClvUI1olxyGvQCNcSEiB7cA91AZw5cwb56ZmQNXBHXcUanFv4\nbzzp2AuGt2/Aas/vkAE4efIklHWuQ3qcj7pGxri4dC4ed+kLw9vXYbVnM2QAjh87DmFuAUtDE5ge\njsH1LRugNLOE+d+RML11DfmiIa7+r3brtHuQPc7ClVr8eNcEtfn1Wt7c3d2LnVfqcD1z5kzExsYi\nJiam2IAMAEqlEjk5OVizZg2aNm0KoHA4iYeHBxISEtCxI69EJiKqyrQF635ezpVdVjUgqZ39VVrJ\n8eDtD2AZsQ02a1dAys9DgdwWuU1aQBgaFS6R/Rjyrashy8yA0swCOR6eyOz3uta1K+W2SH9jEqz2\n/A7zhL+Q5+yKTJ/XYL0lRNVHmFvg4evjYLl3C8yOxSLXtRky+w6C9ZZQVZ+sXgNh8CANddZ+C2Fo\nhOy23ZDduhMM7z39LY8Sz2QTPSdJiJIvM54xYwbCwsIQGRmJZs2a6ew7b948LF68GLm5uao2IQSM\njY2xYcMGvP76P28aGRkZqv/L5ZXwDVQ1XNEn1g4deJEKVW18rlYdHApSvLNL5sEyehes35wI+ciJ\nlV0OUbH4nlr+dGXYEsdcBwUFYePGjThw4ECJwRoAevTogfz8fCQnJ6vakpOTUVBQAFdX17LUTURE\nFYjBmojoxekM11OnTkVoaCjWrVsHuVwOhUIBhUKBrKx/LpQIDg6Gj4+PatrHxwft2rXDuHHjcPz4\ncRw7dgzjxo1Dly5d+AmKiKiKYrAmItIPneF65cqVyMzMRN++feHs7Kz6+fLLL1V9FAqF2llqSZKw\nc+dOODg4oFevXujfvz9cXFywffv28tsLIiJ6bgzWRET6o/OCRqVSWeIKQkJCNNrq1auHsLCw56+K\niIgqBIM1EZF+lek+10REVHMwWBMR6R/DNRFRLcRgTURUPhiuiYhqGQZrIqLyw3BNRFSLMFgTEZUv\nhmsiolqCwZqIqPwxXBMR1QIM1kREFYPhmoiohmOwJiKqOAzXREQ1GIM1EVHFYrgmIqqhGKyJiCoe\nwzURUQ3EYE1EVDkYromIahgGayKiysNwTURUgzBYExFVLoZrIqIagsGaiKjyMVwTEdUADNZERFUD\nwzURUTXHYE1EVHUwXBMRVWMM1kREVQvDNRFRNcVgTURU9TBcExFVQwzWRERVE8M1EVE1w2BNRFR1\nMVwTEVUjDNZERFUbwzURUTXBYE1EVPUxXBMRVQMM1kRE1QPDNRFRFcdgTURUfegM14sXL0bHjh0h\nl8vh4OCAQYMGISkpqdQrv3jxIqysrGBlZfXChRIR1UYM1kRE1YvOcB0dHY1p06YhLi4OBw4cgKGh\nIXx8fPDgwYMSV5ybm4vhw4ejd+/ekCRJbwUTEdUWDNZERNWPoa6Z4eHhatNr1qyBXC5HbGws/Pz8\ndK549uzZ8PLyQq9evRAdHf3ilRIR1SIM1kRE1VOZxlw/fPgQSqUSNjY2Ovvt2rULu3btwooVKyCE\neKECiYhqGwZrIqLqS+eZ62cFBQWhbdu26Nq1a7F9bt68iYkTJ2Lbtm0wNzcv9boTEhLKUgqVAY8t\nVRd8rhYG6x/2XsCqiEswkEn4ZIQXmlhn89hUARb/+/fmjZu4yMeDqgG+b5Qfd3f3YueVOlzPnDkT\nsbGxiImJ0TmG+q233sI777yDjh07lq1KIqJaTluw7uflXNllERFRGUiiFOM2ZsyYgbCwMERGRqJZ\ns2Y6+8pkMhgYGKimhRBQKpUwMDDAypUrMX78eNW8jIwM1f/lcvnz1E86FH1i7dChQyVXQqQbn6sc\nClIdnF0yD5bRu2D95kTIR06s7HKIisX31PKnK8OWeOY6KCgImzZtKlWwBoDTp0+rTW/btg3/93//\nhyNHjsDZmWdgiIiexWBNRFRz6AzXU6dOxdq1a7Ft2zbI5XIoFAoAgJWVFSwsCkefBQcH48iRI4iI\niAAAtGjRQm0dhw8fhkwm02gnIiIGayKimkbn3UJWrlyJzMxM9O3bF87OzqqfL7/8UtVHoVAgOTlZ\n50Z4n2siIk0M1kRENY/OM9dKpbLEFYSEhOicP3bsWIwdO7ZMRRER1XQM1kRENVOZ7nNNREQvjsGa\niKjmYrgmIqpADNZERDUbwzURUQVhsCYiqvkYromIKgCDNRFR7cBwTURUzhisiYhqD4ZrIqJyxGBN\nVH6ioqIgk8lw//79yi6FSIXhmoionDBY1yzCzBwAILO0ruRKKkZ+fn5ll1BqQojKLoFIheGaiKgc\nMFjXPI/b90D6sAmw6Begs5+3tzemTJmC999/H3Z2dnBwcMA333yD7OxsTJ48GXXq1IGrqyvWr1+v\nWubGjRsYPnw4bG1tYWtrC39/f1y6dEk1//LlywgICICTkxMsLS3Rvn177Nq1S227W7ZsgaenJ8zN\nzWFnZwdvb2/cuXMHADB//ny0bt1arX9oaCisrKxU00V9QkND0aRJE5iamuLx48fIyMjAxIkT4ejo\nCGtra3h7eyMxMVFjPeHh4WjevDksLCwQEBCAhw8fYuPGjWjWrBnq1KmDsWPHIicnR62GJUuWoGnT\npjA3N4enpyfWrVunmpeamgqZTIYtW7bA19cXFhYWaNmypeoboVNTU9GnTx8AgL29PWQyGcaNG6fz\nsSGqCAzXRER6xmBd8yiVSuTL6iPL4xXA2KTE/uvWrYNcLsfhw4cxZ84cTJ8+HQEBAWjZsiWOHj2K\nMWPGYNy4cbhz5w4eP36Ml19+Gebm5jh48CDi4+Ph5OQEHx8fPHnyBACQlZUFPz8/RERE4OTJk3j9\n9dcxZMgQnD9/HkDhtyUPHz4cgYGBOHfuHA4ePIjRo0eXeT9TUlKwYcMGbN68GSdPnoSxsTH8/Pxw\n69Yt7Nq1C8ePH0evXr3Qp08fKBQK1XI5OTlYtmwZ1q9fj/379yMhIQFDhgzBunXrsGXLFmzbtg07\nduzAypUrVct89NFHCAkJwX//+1+cPXsWwcHBmDRpEnbv3q1W00cffYTp06fj5MmT6NixI4YPH46s\nrCy4uLhg8+bNAIAzZ85AoVBg+fLlZd5nIr0TlSg9PV31Q/p35MgRceTIkcoug6hENem5qlQqxcer\nDgh4zxcGfRaIDftPVXZJ9IIKCgrEn38+FvXqFYh69Qr/X1BQUGz/3r17i27duqm12dvbi4CAANV0\nXl6eMDY2Fr///rtYtWqVcHd3V+ufn58v7OzsRFhYWLHb6dKli1i0aJEQQojExEQhSZK4cuWK1r7z\n5s0TrVq1UmsLCQkRlpaWan2MjIzEnTt3VG379+8XlpaW4smTJ2rLenl5iSVLlqjWI0mSuHDhgmr+\nrFmzhIGBgUhLS1O1jR07Vvj7+wshhMjMzBRmZmYiJiZGbb1BQUFi4MCBQgghUlJShCRJ4scff1TN\nv3HjhpAkSRw6dEgIIURkZKSQJEltO1Sz3lOrKl0ZVufXnxMRUekJnrGuka5dy0NgoAkUisI/9gYG\nmiA+Pg+urtrPYEuSBE9PT7U2BwcHtWEZhoaGsLGxwZ07d3D69GmkpKSoDdEAgCdPniA5ORlA4Znr\nBQsWYNeuXbh16xby8vKQnZ2NNm3aAAC8vLzg4+ODVq1aoV+/fvDx8cHQoUNRt27dMu1rgwYNYG9v\nr5pOTEzE48eP1doAIDs7W1UbAJiYmMDd3V1tf+vVqwdbW1u1tjNnzgAoPNOcnZ2NV155BZIkqfrk\n5eWhUaNGatt6+lg6OTkBgGq4C1FVxHBNRKQHDNb0NCMjI7VpSZK0timVSggh4OXlhY0bN2qspyic\nzpo1C3v27MGXX34Jd3d3mJmZYfTo0cjNzQUAyGQy7N27F/Hx8di7dy9WrVqF4OBgREdHw9PTEzKZ\nTOOiv7y8PI3tWVhYqE0rlUo4OjoiJiZGo6+19T8XdhoaqscJXftbtF4A2LlzJ1xcXNT6Pbvc09NF\nQbxoeaKqiOGaiOgFMVjXbA0bGiEkJAeBgYVnqkNCctCwYcnjrktDkiS0a9cO69evh52dHeRyudZ+\nhw4dwpgxY/Daa68BKDxzfOnSJXh4eKj169KlC7p06YK5c+eiZcuWCAsLg6enJ+zt7XH79m21vseP\nHy+xvvbt2+P27duQJEnjjPKLaNGiBUxMTJCamgpvb+/nXo+xsTEAoKCgQE+VEb04XtBIRPQCGKxr\nPplMhn79TLB161Vs3XoV/fqZQCYr/tenEELjLPGz009788034ejoiICAABw8eBApKSk4ePAgZs2a\npbpjSLNmzbBlyxYcO3YMp06dwqhRo9TuvBEfH49FixYhISEBV69exfbt23Ht2jW0aNECQOEdTO7f\nv49PP/0Uly9fxqpVq1QXA+ri4+OD7t27IyAgAOHh4UhJSUFcXBzmzZun9Wx2aVlZWWHWrFmYNWsW\nQkJCcOnSJRw/fhzff/89fvrpp1Kvx9XVFZIkYefOnbh79y6ysrKeuyYifWG4JiJ6TgzWtYdMJoOh\n4T0YGt7TGayBwrPRT48jLmorjpmZGQ4ePIjGjRvjX//6F1566SWMHTsW6enpsLGxAQAsW7YMDg4O\n6NmzJ/z8/NCtWzf07NlTtY46deogNjYW/v7+aNasGT744APMnTsXI0eOBAC89NJLWLlyJX788Ue0\nadMG+/fvx4cffqhWl7a6AWD37t3o06cPJkyYgObNm+ONN97AxYsXUb9+/WL3r7hj8HTbwoULMX/+\nfHzxxReqseJbt25F48aNS3XcAKB+/fpYsGABPvroI9SrVw/vvvuuzv5EFUESuj5Ol7OMjAzV/4v7\nUxg9v4SEBABAhw4dKrkSIt2q43OVwbr2qY7PU6qd+Fwtf7oyLM9cExGVEYM1EREVh+GaiKgMGKyJ\niEgXhmsiolJisCYiopIwXBMRlQKDNRERlQbDNRFRCRisiYiotBiuiYh0YLAmIqKyYLgmIioGgzUR\nEZVVieF68eLF6NixI+RyORwcHDBo0CAkJSXpXCYqKgoBAQFwdnaGhYUF2rRpg5CQEL0VTURU3his\niYjoeZQYrqOjozFt2jTExcXhwIEDMDQ0hI+PDx48eFDsMnFxcWjTpg02b96MpKQkvPPOO5g4cSLW\nr1+v1+KJiMoDgzURET0vw5I6hIeHq02vWbMGcrkcsbGx8PPz07pMcHCw2vTkyZMRGRmJzZs3Y8SI\nES9QLhFR+WKwJiKiF1HmMdcPHz6EUqmEjY1NmZbLyMiAra1tWTdHRFRhGKyJiOhFlXjm+llBQUFo\n27YtunbtWupldu7ciQMHDiA2NrasmyMiqhAM1kREpA+SEEKUtvPMmTMRFhaGmJgYuLm5lWqZQ4cO\nYeDAgViyZAkmTZqkNi8jI0P1/4sXL5a2DCIivRJC4Ie9F7Aq4hIMZBI+GeGFfl7OlV0WERFVUe7u\n7qr/y+VytXmlPnM9Y8YMhIWFITIystTBOiYmBn5+fli4cKFGsCYiqgoYrImISJ9KFa6DgoKwadMm\nREZGolmzZqVa8cGDB+Hv749PPvkE7733Xon9O3ToUKr1UuklJCQA4LGlqq+ynqtFQ0GKgjWHgpAu\nfJBP/8cAABH1SURBVE+l6oLP1fL39OiLZ5V4QePUqVMRGhqKdevWQS6XQ6FQQKFQICsrS9UnODgY\nPj4+qumoqCgMGDAA77zzDkaMGKFa5u7duy+4K0RE+sEx1kREVB5KDNcrV65EZmYm+vbtC2dnZ9XP\nl19+qeqjUCiQnJysml69ejWys7OxdOlSODk5qZbp3Llz+ewFEVEZMFgTEVF5KXFYiFKpLHElz377\nYkhICL+RkYiqJAZrIiIqT2W+zzURUXXFYE1EROWN4ZqIagUGayIiqggM10RU4zFYExFRRWG4JqIa\njcGaiIgqEsM1EdVYDNZERFTRGK6JqEZisCYiosrAcE1ENQ6DNRERVRaGayKqURisiYioMjFcE1GN\nwWBNRESVjeGaiGoEBmsiIqoKGK6JqNpjsCYioqqC4ZqIqjUGayIiqkoYromo2mKwJiKiqobhmoiq\nJQZrIiKqihiuiajaYbAmIqKqiuGaiKoVBmsiIqrKGK6JqNpgsCYioqqO4ZqIqgUGayIiqg4Yromo\nymOwJiKi6oLhmoiqNAZrIiKqThiuiajKYrAmIqLqhuGaiKokBmsiIqqOGK6JqMphsCYioupKZ7he\nvHgxOnbsCLlcDgcHBwwaNAhJSUklrvTUqVPo3bs3zM3N0aBBAyxcuFBvBRNRzcZgTURE1ZnOcB0d\nHY1p06YhLi4OBw4cgKGhIXx8fPDgwYNil3n48CF8fX3h5OSEhIQELF++HEuXLsWyZcv0XjwR1SwM\n1kREVN0Z6poZHh6uNr1mzRrI5XLExsbCz89P6zLr1q1DdnY2Vq9eDRMTE7Ro0QLnzp3DsmXLMHPm\nTP1VTkQ1zoLV0QzWRERUrZVpzPXDhw+hVCphY2NTbJ+4uDj07NkT/9/evQdFVfZxAP/uiuguwiIU\neAFCmkBNEFfCZTVDRQwjZKYk77NQ5i0DDEXNvOSbpqRik9dmQPKSYCOa5pAaKzvMaiKKCF2EMHS0\ntaEUcA0cWN4/HM/rBnLR9T0LfD8zzLjPnn3Od+HM+uPhd87p1q2bMBYaGoobN26gvLz88ZMSUYdk\nMplQV/cM7tx1xH9YWBMRUTvX7Mr1v8XGxmLIkCEICgp65DYGgwEeHh5mY66ursJzzz333GPEJKKO\nyGQy4fjxWkRH3//MSFgYjrDRTnjF31PcYERERI+p1cX1ggULoNfrkZubC4lE8sjtmnuuOefOnXus\n11HL+L0la1VX9wyioz1gMNz/I1pakj8i1Vd5zJJV4/FJ7QWP1afnhRdeeORzrSqu4+PjkZGRAa1W\nC09Pz2a37dWrFwwGg9nYzZs3heeIiIiIiDqqFovr2NhYHDhwAFqtFt7e3i1OGBQUhMTERNTW1gp9\n1ydOnEDfvn2bbQkJCAhoQ2xqjQe/sfJ7S9bKZDIhNbUW0dH3PytSU2sRGOgBqdRT3GBETeBnKrUX\nPFafvsrKykc+1+wJjfPmzcOuXbuwd+9eKBQKGAwGGAwGGI1GYZslS5YgJCREeDxlyhTI5XJoNBoU\nFxfj4MGDWLduHa8UQkSNSKVShIZ2Q2bmVWRmXkVoaDdIpby3FRERtV/N/i+2bds23LlzB2PGjEGf\nPn2Erw0bNgjbGAwGlJWVCY8dHBxw4sQJ3LhxAwEBAZg/fz4SEhIQHx//9N4FEbVbUqkUNjYVsLGp\nYGFNRETtXrNtISaTqcUJUlNTG40NGjQIOTk5j5+KiIiIiKgd4jIREREREZGFsLgmog5BKpXi4MGD\nYsdoteDgYLz//vtixyAiIgtr001kiIislcFggKOjo9gxGtm1axfmz5+P6upqs/FDhw6ha9euT33/\nGo0Gf/31F44cOfLU90VERCyuiaidu3fvHmxtbeHi4mKRef5frPEXASIienJsCyEiqxEcHIw5c+Yg\nNjYWTk5OcHJywqJFi9DQ0CBs4+npiVWrViEmJgY9e/bE9OnTATRuC7l06RJCQkIgl8vh7OyM6Oho\nVFVVCc9rNBq8/vrrWLduHdzc3ODh4fHIXHq9Hq+88grs7Ozg5uaGuXPnmq1E63Q6qFQq2Nvbw9HR\nEcOGDUNxcTFOnTqFmJgYGI1GSKVSSKVSfPzxx8J7nT9/vtn7Wr16NTQaDRwcHODh4YGMjAzcunUL\nUVFRsLe3h4+PD7Kzs4XXmEwmvP322/Dy8oJcLoe3tzeSkpKE79fKlSvx1Vdf4bvvvhP2r9PpAADX\nr1/HpEmThO9zeHg4SktLH+vnRkRE/8Pimoisyt69ewEAZ86cwY4dO7Bz504kJyebbbNx40YMHDgQ\n+fn5WLNmTaM5jEYjxo0bBwcHB+Tl5SEzMxN6vR4xMTFm2+Xk5KCoqAjHjx/HDz/80GSeS5cuYdy4\ncYiMjERhYSEOHjyIgoICYa66ujpMmDABI0eORGFhIc6ePYv4+Hh06dIFw4cPR3JyMuRyuXCfgISE\nBACARCKBRCIx21dycjJUKhUuXLiAqKgoaDQaTJ48GREREbh48SJefvllTJ06FbW1tQDuF9dubm44\ncOAAfvnlF3zyySdYs2aNcBWnhQsXIioqCmPHjhX2HxQUhLt372LUqFGQy+XQ6XQ4c+YMevfujZCQ\nEPzzzz9t/ZEREdFD2BZCRFalT58+2Lx5MwDA29sbly9fxsaNG82ulR8cHCwUqU3Zt28f7t69i927\nd8POzg4AsHPnTowaNQplZWXw8vICAMhkMqSkpDTb+5yUlIS33npL2P/zzz+PrVu3QqlUoqLi/rW5\nKysrER4ejn79+gm5H3BwcIBEImlV28qrr76K2bNnAwBWrVqFjRs3on///pg2bRoA4KOPPkJKSgqK\ni4uhVCphY2ODVatWCa/38PBAfn4+vv76a8TExMDOzg7du3dv1Daze/duAEBKSoowtn37dri6uuLo\n0aOYOHFii1mJiKhpXLkmIqshkUigUqnMxlQqFa5fv447d+4I27R0S9+ff/4ZgwcPFgprAAgKCoJU\nKsVPP/0kjA0aNKjFkwrz8/OxZ88e2NvbC18jRoyARCLBb7/9BicnJ2g0GowbNw7h4eHYtGkTrl27\n1ta3DolEAj8/P+GxnZ0d5HI5fH19hbEHBfKff/4pjG3fvh0BAQFwcXGBvb09kpOTW9x/fn4+rly5\nYvaeHB0dcfv2bbObghERUdtx5ZqIrMrD/dWP8nDR3NZ5Hm7FkMvlrZpn5syZTd5ltk+fPgDurwDH\nxcUhKysL3377LT788EMcOnQIoaGhLc7/sH8X+hKJxGzsQfYHN/hKT09HfHw8NmzYALVaDQcHB3zx\nxRfIzMxsNM/DTCYT/P39kZ6e3ihDz54925SZiIjMsbgmIqvR0NCAH3/80WzszJkz6Nu3L3r06NHq\neQYOHIjU1FTcuXNHeJ1er4fJZMKAAQPalEmpVKKoqEhoJXkUPz8/+Pn5YdGiRRg/fjzS0tIQGhoK\nW1tb1NfXt2mfrZWbm4thw4Zh7ty5wlhpaalZMW1ra4u6ujqz1w0dOhT79++Hs7MzFArFU8lGRNRZ\nsS2EiKzKjRs3EBcXh19//RXffPMNPvvssyZXjZszdepUyOVyzJgxA0VFRdDpdJg1axbeeOONFovk\nf0tMTMTZs2cxZ84cXLhwAaWlpTh69KjQG33lyhUsXrwYp0+fRnl5ObRaLQoLC/Hiiy8CuH8VkJqa\nGpw8eRIVFRXCCYMNDQ2tWqVvjo+PD86fP4+srCyUlJRg9erV0Ol0ZvP269cPRUVFuHz5MioqKlBX\nV4epU6fC1dUVEyZMgE6nw5UrV6DT6ZCQkMArhhARPSEW10RkNSQSCaZNm4b6+nqoVCq8++67eOed\ndxAXF9emeWQyGb7//ntUVVUhMDAQkZGRGD58uNkJfE1draMpvr6+0Ol0+P333xEcHAx/f38sXboU\nvXr1AnC/RaWkpAQTJ06Ej48PNBoNpk2bhsTERACAWq3G7NmzMXnyZLi4uCApKalN+2/OrFmzEBUV\nhSlTpiAwMBBXr17FBx98YDbvzJkzMWDAAAQEBMDV1RV6vR4ymQw6nQ5eXl6YOHEiBgwYAI1Gg9u3\nb7MthIjoCUkannTp5AlUVlYK/+afJi3v3LlzANDiyV9EYntwrC5cuBC+vr74/PPPRU5E1Bg/U6m9\n4LH69DVXw3LlmoishiVaJYiIiMTE4pqIrIYlWiWIiIjExKuFEJHV0Gq1YkcgIiJ6Ily5JiIiIiKy\nEBbXREREREQWwuKaiIiIiMhCWFwTEREREVkIi2siIiIiIgthcU1EREREZCEsromIiIiILKTF4lqn\n0yEiIgJubm6QSqVIS0trcdJjx45BpVLBwcEBzz77LCIjI1FSUmKRwERERERE1qrF4tpoNMLPzw+b\nN2+GTCZr8e5ppaWliIyMRHBwMAoKCnDy5EnU1NRg/PjxFgtNRERERGSNWrxDY1hYGMLCwgAAGo2m\nxQkLCgpgMpmwdu1aoRBPTEzEmDFj8Pfff8PJyenJEhMRERERWSmL91wPHz4cPXr0wJdffon6+npU\nV1dj165dCAwMZGFNRERERB2axYvr3r1749ixY1i2bBm6d+8OR0dHFBcX48iRI5beFRERERGRVZE0\nNDQ0tHZje3t7bNmyBTNmzHjkNmVlZVCpVIiOjsaUKVNQVVWF5cuXAwCys7PNerYrKyufIDoRERER\nkbgUCoXZ4xZ7rttqx44dcHd3x7p164SxPXv2wN3dHadPn4Zarbb0LomIiIiIrILF20IaGhoglZpP\n++CxyWSy9O6IiIiIiKxGiyvXRqNRuEa1yWRCeXk5CgoK4OzsDHd3dyxZsgR5eXk4efIkACAiIgIb\nNmzA6tWrMWnSJFRXV2Pp0qXw8PDA0KFDzeb+9zI6EREREVF71uLKdV5eHpRKJZRKJWpqarBixQoo\nlUqsWLECAGAwGFBWViZsP2LECKSnp+Pw4cNQKpUICwtD9+7dkZWVBZlM9vTeCRERERGRyNp0QiMR\nERERET2axXuuyXps3boV/fr1g0wmQ0BAAHJzc8WORGRGp9MhIiICbm5ukEqlSEtLEzsSUSNr167F\nSy+9BIVCARcXF0RERKC4uFjsWESNbNmyBYMHD4ZCoYBCoYBarcaxY8fEjtXpsLjuoNLT0xEXF4dl\ny5ahoKAAarUaYWFhuHbtmtjRiARGoxF+fn7YvHkzZDKZ2aU6iaxFTk4O3nvvPZw+fRrZ2dmwsbFB\nSEgIbt26JXY0IjPu7u5Yv349Lly4gPz8fIwePRqRkZG4ePGi2NE6FbaFdFDDhg2Dv78/duzYIYx5\ne3vjzTffxJo1a0RMRtS01lxHn8gaGI1GKBQKHD58GK+99prYcYia5ezsjE8//RQzZ84UO0qnwZXr\nDujevXs4f/48QkNDzcZDQ0Oh1+tFSkVE1DFUVVXBZDKhZ8+eYkcheqT6+nrs378fNTU1GDlypNhx\nOhWL30SGxFdRUYH6+nq4urqajbu4uMBgMIiUioioY4iNjcWQIUMQFBQkdhSiRi5duoSgoCDU1tZC\nJpMhIyMDPj4+YsfqVFhcExERtdKCBQug1+uRm5vLcwTIKvXv3x+FhYWorKzEgQMHMGnSJGi1WgQE\nBIgdrdNgcd0BPfPMM+jSpQtu3rxpNn7z5k307t1bpFRERO1bfHw8MjIyoNVq4enpKXYcoiZ17doV\nXl5eAIAhQ4YgLy8PW7ZsQWpqqsjJOg/2XHdAtra2GDp0KI4fP242fuLECajVapFSERG1X7GxsUhP\nT0d2dja8vb3FjkPUavX19TCZTGLH6FS4ct1BLViwANOnT0dgYCDUajW2b98Og8GA2bNnix2NSGA0\nGlFSUgIAMJlMKC8vR0FBAZydneHu7i5yOqL75s2bhz179uDQoUNQKBTCuSv29vaws7MTOR3R/yxe\nvBjh4eFwc3NDdXU19u3bh5ycHGRlZYkdrVPhpfg6sG3btmH9+vX4448/4Ovri02bNmHEiBFixyIS\nnDp1CqNHjwYASCQSPPg40mg0SElJETMakUAqlZodnw+sXLkSy5cvFykVUWPR0dHQarUwGAxQKBQY\nPHgwFi5ciLFjx4odrVNhcU1EREREZCHsuSYiIiIishAW10REREREFsLimoiIiIjIQlhcExERERFZ\nCItrIiIiIiILYXFNRERERGQhLK6JiIiIiCyExTURERERkYWwuCYiIiIispD/AgJ0RTje7kvqAAAA\nAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x518ca90>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "import mkf_internal\n",
    "mkf_internal.show_residual_chart()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The blue point labeled \"prediction\" is the output of $\\mathbf{Hx}$, and the dot labeled \"measurement\" is $\\mathbf{z}$. Therefore, $\\mathbf{y} = \\mathbf{z} - \\mathbf{Hx}$ is how we compute the residual, drawn in red, where $\\mathbf{z}$ is the residual.\n",
    "\n",
    "The next two lines are the formidable:\n",
    "\n",
    "$$\n",
    "\\begin{aligned}\n",
    "\\textbf{S} &= \\mathbf{HPH}^\\mathsf{T} + \\mathbf{R} \\;\\;\\;&(4)\\\\\n",
    "\\mathbf{K} &= \\mathbf{PH}^\\mathsf{T} \\mathbf{S}^{-1}\\;\\;\\;&(5) \\\\\n",
    "\\end{aligned}\n",
    "$$\n",
    "\n",
    "Unfortunately it is a fair amount of linear algebra to derive this. The derivation can be quite elegant, and I urge you to look it up if you have the mathematical education to follow it. But $\\mathbf{K}$ is just the *Kalman gain* - the ratio of how much measurement vs prediction we should use to create the new estimate. $\\mathbf{R}$ is the *measurement noise*, and $\\mathbf{P}$ is our *uncertainty covariance matrix* from the prediction step.\n",
    "\n",
    "So let's work through this expression by expression. Start with $\\mathbf{HPH}^\\mathsf{T}$. The linear equation $\\mathbf{ABA}^T$ can be thought of as changing $\\mathbf{B}$ to the coordinate system of $\\mathbf{A}$. So $\\mathbf{HPH}^\\mathsf{T}$ is taking the covariance $\\mathbf{P}$ and putting it in measurement ($\\mathbf{H}$) space. \n",
    "\n",
    "In English, consider the problem of reading a temperature with a thermometer that provides readings in volts. Our state is in terms of temperature, but we are now doing calculations in *measurement space* - volts. So we need to convert $\\mathbf{P}$ from applying to temperatures to volts. The linear algebra form $\\textbf{H}\\textbf{P}\\textbf{H}^\\mathsf{T}$ takes $\\mathbf{P}$ to the basis used by $\\mathbf{H}$, namely volts. \n",
    "\n",
    "Then, once in measurement space, we can add the measurement noise $\\mathbf{R}$ to it. Hence, the expression for the uncertainty once we include the measurement is:\n",
    "\n",
    "$$\\mathbf{S} = \\mathbf{HP}\\mathbf{H}^\\mathsf{T} + \\mathbf{R}$$"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The next equation is\n",
    "\n",
    "$$\\textbf{K} = \\textbf{P}\\textbf{H}^T\\mathbf{S}^{-1}\\\\\n",
    "$$\n",
    "\n",
    "$\\mathbf{K}$ is the *Kalman gain* - the ratio that chooses how far along the residual to select between the measurement and prediction in the graph above.\n",
    "\n",
    "We can think of the inverse of a matrix as linear algebra's way of computing  $\\frac{1}{x}$. So we can read the equation for $\\textbf{K}$ as\n",
    "\n",
    "$$ \\textbf{K} = \\frac{\\textbf{P}\\textbf{H}^\\mathsf{T}}{\\mathbf{S}} $$\n",
    "\n",
    "$$\n",
    "\\textbf{K} = \\frac{uncertainty_{prediction}}{uncertainty_{measurement}}\\textbf{H}^\\mathsf{T}\n",
    "$$\n",
    "\n",
    "In other words, the *Kalman gain* equation is doing nothing more than computing a ratio based on how much we trust the prediction vs the measurement. If we are confident in our measurements and unconfident in our predictions $\\mathbf{K}$ will favor the measurement, and vice versa. The equation is complicated because we are doing this in multiple dimensions via matrices, but the concept is simple - scale by a ratio.\n",
    "\n",
    "Without going into the derivation of $\\mathbf{K}$, I'll say that this equation is the result of finding a value of $\\mathbf{K}$ that optimizes the *mean-square estimation error*. It does this by finding the minimal values for $\\mathbf{P}$ along its diagonal. Recall that the diagonal of $\\mathbf{P}$ is just the variance for each state variable. So, this equation for $\\mathbf{K}$ ensures that the Kalman filter output is optimal. To put this in concrete terms, for our dog tracking problem this means that the estimates for both position and velocity will be optimal - a value of $\\mathbf{K}$ that made the position extremely accurate but the velocity very inaccurate would be rejected in favor of a $\\mathbf{K}$ that made both position and velocity just somewhat accurate."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Our next line is:\n",
    "\n",
    "$$\\mathbf{x}=\\mathbf{x} +\\mathbf{Ky}\\tag{5}$$\n",
    "\n",
    "This just multiplies the residual by the Kalman gain, and adds it to the state variable. In other words, this is the computation of our new estimate.\n",
    "\n",
    "Finally, we have:\n",
    "\n",
    "$$\\mathbf{P}=(\\mathbf{I}-\\mathbf{KH})\\mathbf{P}\\tag{6}$$\n",
    "\n",
    "$I$ is the identity matrix, and is the way we represent $1$ in multiple dimensions. $H$ is our measurement function, and is a constant.  So, simplified, this is simply $P = (1-cK)P$. $K$ is our ratio of how much prediction vs measurement we use. So, if $K$ is large then $(1-cK)$ is small, and P will be made smaller than it was. If $K$ is small, then $(1-cK)$ is large, and P will be made larger than it was. So we adjust the size of our uncertainty by some factor of the *Kalman gain*. I would like to draw your attention back to the g-h filter, which included this Python code:\n",
    "\n",
    "    # update filter \n",
    "    w = w * (1-scale_factor) + z * scale_factor\n",
    "\n",
    "This multidimensional Kalman filter equation is partially implementing this calculation for the variance instead of the state variable."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we have the measurement steps. The first equation is\n",
    "\n",
    "$$\\mathbf{x} = \\mathbf{Fx} + \\mathbf{Bu}\\tag{1}$$\n",
    "\n",
    "This is just our state transition equation which we have already discussed. $\\mathbf{Fx}$  multiplies $\\mathbf{x}$ with the state transition matrix to compute the next state. $B$ and $u$ add in the contribution of the control input $\\mathbf{u}$, if any.\n",
    "\n",
    "The final equation is:\n",
    "$$\\mathbf{P} = \\mathbf{FPF}^\\mathsf{T} + \\mathbf{Q}\\tag{2}$$\n",
    "\n",
    "$\\mathbf{FPF}^\\mathsf{T}$ is the way we put $\\mathbf{P}$ into the process space using linear algebra so that we can add the process noise $\\mathbf{Q}$ to it."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Converting the Multivariate Equations to the Univariate Case\n",
    "\n",
    "\n",
    "As it turns out the Kalman filter equations are quite easy to deal with in one dimension, so let's do the mathematical proof. \n",
    "\n",
    "> **Note:** This section will provide you with a strong intuition into what the Kalman filter equations are actually doing. While this section is not strictly required, I recommend reading this section carefully as it should make the rest of the material easier to understand. It is not merely a proof of correctness that you would normally want to skip past! The equations look complicated, but they are actually doing something quite simple.\n",
    "\n",
    "Let's start with the predict step, which is slightly easier. Here are the multivariate equations.\n",
    "\n",
    "$$\n",
    "\\begin{aligned}\n",
    "\\mathbf{x} &= \\mathbf{F x} + \\mathbf{B u} \\\\\n",
    "\\mathbf{P} &= \\mathbf{FPF}^\\mathsf{T} + \\mathbf{Q}\n",
    "\\end{aligned}\n",
    "$$\n",
    "\n",
    "The state $\\mathbf{x}$ only has one variable, so it is a $1\\times 1$ matrix. Our motion $\\mathbf{u}$ is also be a $1\\times 1$ matrix. Therefore, $\\mathbf{F}$ and $\\mathbf{B}$ must also be $1\\times 1$ matrices. That means that they are all scalars, and we can write\n",
    "\n",
    "$$x = Fx + Bu$$\n",
    "\n",
    "Here the variables are not bold, denoting that they are not matrices or vectors. \n",
    "\n",
    "Our state transition is simple - the next state is the same as this state, so $F=1$. The same holds for the motion transition, so, $B=1$. Thus we have\n",
    "\n",
    "$$x = x + u$$\n",
    "\n",
    "which is equivalent to the Gaussian equation from the last chapter\n",
    "\n",
    "$$ \\mu = \\mu_1+\\mu_2$$\n",
    "\n",
    "Hopefully the general process is clear, so now I will go a bit faster on the rest. Our other equation for the predict step is\n",
    "\n",
    "$$\\mathbf{P} = \\mathbf{FPF}^\\mathsf{T} + \\mathbf{Q}$$\n",
    "\n",
    "Again, since our state only has one variable $\\mathbf{P}$ and $\\mathbf{Q}$ must also be $1\\times 1$ matrix, which we can treat as scalars, yielding  \n",
    "\n",
    "$$P = FPF^\\mathsf{T} + Q$$\n",
    "\n",
    "We already know $F=1$. The transpose of a scalar is the scalar, so $F^\\mathsf{T} = 1$. This yields\n",
    "\n",
    "$$P = P + Q$$\n",
    "\n",
    "which is equivalent to the Gaussian equation of \n",
    "\n",
    "$$\\sigma^2 = \\sigma_1^2 + \\sigma_2^2$$\n",
    "\n",
    "This proves that the multivariate equations are performing the same math as the univariate equations for the case of the dimension being 1."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Here our our multivariate Kalman filter equations for the update step.\n",
    "\n",
    "$$\n",
    "\\begin{aligned}\n",
    "\\textbf{y} &= \\mathbf{z} - \\mathbf{H x}\\\\\n",
    "\\mathbf{K}&= \\mathbf{PH}^\\mathsf{T} (\\mathbf{HPH}^\\mathsf{T} + \\mathbf{R})^{-1} \\\\\n",
    "\\mathbf{x}&=\\mathbf{x} +\\mathbf{K\\textbf{y}} \\\\\n",
    "\\mathbf{P}&= (\\mathbf{I}-\\mathbf{KH})\\mathbf{P}\n",
    "\\end{aligned}\n",
    "$$\n",
    "\n",
    "As above, all of the matrices become scalars. $H$ defines how we convert from a position to a measurement. Both are positions, so there is no conversion, and thus $H=1$. Let's substitute in our known values and convert to scalar in one step. One final thing you need to know - division is scalar's analogous operation for matrix inversion, so we will convert the matrix inversion to division.\n",
    "\n",
    "$$\n",
    "\\begin{aligned}\n",
    "y &= z - x\\\\\n",
    "K &=P / (P + R) \\\\\n",
    "x &=x +Ky \\\\\n",
    "P &= (1-K)P\n",
    "\\end{aligned}\n",
    "$$\n",
    "\n",
    "Before we continue with the proof, I want you to look at those equations to recognize what a simple concept these equations implement. The residual $y$ is nothing more than the measurement minus the previous state. The gain $K$ is scaled based on how certain we are about the last prediction vs how certain we are about the measurement. We choose a new state $x$ based on the old value of $x$ plus the scaled value of the residual. Finally, we update the uncertainty based on how certain we are about the measurement. Algorithmically this should sound exactly like what we did in the last chapter.\n",
    "\n",
    "So let's finish off the algebra to prove this. It's straightforward, and not at all  necessary for you to learn unless you are interested. Feel free to skim ahead to the last paragraph in this section if you prefer skipping the algebra.\n",
    "\n",
    "Recall that the univariate equations for the update step are:\n",
    "\n",
    "$$\n",
    "\\begin{aligned}\n",
    "\\mu &=\\frac{\\sigma_1^2 \\mu_2 + \\sigma_2^2 \\mu_1} {\\sigma_1^2 + \\sigma_2^2}, \\\\\n",
    "\\sigma^2 &= \\frac{1}{\\frac{1}{\\sigma_1^2} + \\frac{1}{\\sigma_2^2}}\n",
    "\\end{aligned}\n",
    "$$\n",
    "\n",
    "Here we will say that $\\mu_1$ is the state $x$, and $\\mu_2$ is the measurement $z$. That is entirely arbitrary, we could have chosen the opposite assignment. Thus it follows that that $\\sigma_1^2$ is the state uncertainty $P$, and $\\sigma_2^2$ is the measurement noise $R$. Let's substitute those in.\n",
    "\n",
    "$$ \\mu = \\frac{Pz + Rx}{P+R} \\\\\n",
    "\\sigma^2 = \\frac{1}{\\frac{1}{P} + \\frac{1}{R}}\n",
    "$$\n",
    "\n",
    "I will handle $\\mu$ first. The corresponding equation in the multivariate case is\n",
    "\n",
    "$$\n",
    "\\begin{aligned}\n",
    "x &= x + Ky \\\\\n",
    "&= x + \\frac{P}{P+R}(z-x) \\\\\n",
    "&= \\frac{P+R}{P+R}x + \\frac{Pz - Px}{P+R} \\\\\n",
    "&= \\frac{Px + Rx + Pz - Px}{P+R} \\\\\n",
    "&= \\frac{Pz + Rx}{P+R}\n",
    "\\end{aligned}\n",
    "$$"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now let's look at $\\sigma^2$. The corresponding equation in the multivariate case is\n",
    "\n",
    "$$ \n",
    "\\begin{aligned}\n",
    "P &= (1-K)P \\\\\n",
    "&= (1-\\frac{P}{P+R})P \\\\\n",
    "&= (\\frac{P+R}{P+R}-\\frac{P}{P+R})P \\\\\n",
    "&= (\\frac{P+R-P}{P+R})P \\\\\n",
    "&= \\frac{RP}{P+R}\\\\\n",
    "&= \\frac{1}{\\frac{P+R}{RP}}\\\\\n",
    "&= \\frac{1}{\\frac{R}{RP} + \\frac{P}{RP}} \\\\\n",
    "&= \\frac{1}{\\frac{1}{P} + \\frac{1}{R}}\n",
    "\\quad\\blacksquare\n",
    "\\end{aligned}\n",
    "$$\n",
    "\n",
    "So we have proven that the multivariate equations are equivalent to the univariate equations when we only have one state variable. I'll close this section by recognizing one quibble - I hand waved my assertion that $H=1$ and $F=1$. In general we know this is not true. For example, a digital thermometer may provide measurement in volts, and we need to convert that to temperature, and we use $H$ to do that conversion. I left that issue out of the last chapter to keep the explanation as simple and streamlined as possible. It is very straightforward to add that generalization to the equations of the last chapter, redo the algebra above, and still have the same results. In practice we do not use the equations in the last chapter to perform Kalman filtering due to the material in the next section which demonstrates how much better the Kalman filter performs when we include unobserved variables. So I prefer to leave the equations from the last chapter in their simplest form so that they economically represent our central ideas without any extra complications."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Modeling Dynamic Systems"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Modeling dynamic systems is properly the topic of at least one undergraduate course in mathematics. To an extent there is no substitute for a few semesters of ordinary and partial differential equations. If you are a hobbyist, or trying to solve one very specific filtering problem at work you probably do not have the time and/or inclination to devote a year or more to that education.\n",
    "\n",
    "However, I can present enough of the theory to allow us to create the system equations for many different Kalman filters, and give you enough background to at least follow the mathematics in the literature. My goal is to get you to the stage where you can read a Kalman filtering book or paper and understand it well enough to implement the algorithms. The background math is deep, but we end up using a few simple techniques over and over again in practice.\n",
    "\n",
    "I struggle a bit with the proper way to present this material. If you have not encountered this math before I fear reading this section will not be very profitable for you. In the **Extended Kalman Filter** chapter I take a more ad-hoc way of presenting this information where I expose a problem that the KF needs to solve, then provide the math without a lot of supporting theory. This gives you the motivation behind the mathematics at the cost of not knowing why the math I give you is correct. On the other hand, the following section gives you the math, but somewhat divorced from the specifics of the problem we are trying to solve. Only you know what kind of learner your are. If you like the presentation of the book so far (practical first, then the math) you may want to wait until you read the **Extended Kalman Filter** before \n",
    "In particular, if your intent is to work with Extended Kalman filters (a very prelevant form of nonlinear Kalman filtering) you will need to understand this math at least at the level I present it. If that is not your intent this section may still prove to be beneficial if you need to simulate a nonlinear system in order to test your filter.\n",
    "\n",
    "Let's lay out the problem and discuss what the solution will be. We  model *dynamic systems* with a set of first order *differential equations*. This should not be a surprise as calculus is the math of things that vary. For example, we say that velocity is the derivative of distance with respect to time\n",
    "\n",
    "$$\\mathbf{v}= \\frac{d \\mathbf{x}}{d t} = \\dot{\\mathbf{x}}$$\n",
    "\n",
    "where $\\dot{\\mathbf{x}}$ is the notation for the derivative of $\\mathbf{x}$ with respect to t.\n",
    "\n",
    "We need to use these equations for the predict step of the Kalman filter. Given the state of the system at time $t$ we want to predict its state at time $t + \\Delta t$. The Kalman filter matrices do not accept differential equations, so we need a mathematical technique that will find the solution to those equations at each time step. In general it is extremely difficult to find analytic solutions to systems of differential equations, so we will normally use *numerical* techniques to find accurate approximations for these equations."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Why This is Hard\n",
    "\n",
    "We model dynamic systems with a set of first order differential equations. For example, we already presented the Newtonian equation\n",
    "\n",
    "$$\\mathbf{v}=\\dot{\\mathbf{x}}$$\n",
    "\n",
    "where $\\dot{\\mathbf{x}}$ is the notation for the derivative of $\\mathbf{x}$ with respect to t, or $\\frac{d \\mathbf{x}}{d t}$.\n",
    "\n",
    "In general terms we can then say that a dynamic system consists of equations of the form\n",
    "\n",
    "$$ g(t) = \\dot{x}$$\n",
    "\n",
    "if the behavior of the system depends on time. However, if the system is *time invariant* the equations are of the form\n",
    "\n",
    "$$ f(x) = \\dot{x}$$\n",
    "\n",
    "What does *time invariant* mean? Consider a home stereo. If you input a signal $x$ into it at time $t$, it will output some signal $f(x)$. If you instead make the input at a later time $t + \\Delta t$ the output signal will still be exactly the same, just shifted in time. This is different from, say, an aircraft. If you make a control input to the aircraft at a later time it's behavior will be different because it will have burned additional fuel (and thus lost weight), drag may be different due to being at a different altitude, and so on.\n",
    "\n",
    "We can solve these equations by integrating each side. The time variant equation is very straightforward. We essentially solved this problem with the Newtonian equations above, but let's be explicit and write it out. Starting with  $$\\dot{\\mathbf{x}}=\\mathbf{v}$$ we get the expected\n",
    "\n",
    "$$ \\int \\dot{\\mathbf{x}}\\mathrm{d}t = \\int \\mathbf{v} \\mathrm{d}t\\\\\n",
    "x = vt + x_0$$\n",
    "\n",
    "However, integrating the time invariant equation is not so straightforward. \n",
    "\n",
    "$$ \\dot{x} = f(x) \\\\\n",
    "\\frac{dx}{dt} = f(x)\n",
    "$$ \n",
    "\n",
    "Using the *separation of variables* techniques, we divide by $f(x)$ and move the $dx$ term to the right so we can integrate each side:\n",
    "\n",
    "$$\n",
    "\\int^x_{x_0} \\frac{1}{f(x)} dx = \\int^t_{t_0} dt\\\\\n",
    "$$\n",
    "\n",
    "If we let the solution to the left hand side by named $F(x)$, we get\n",
    "\n",
    "$$F(x) - f(x_0) = t-t_0$$\n",
    "\n",
    "We then solve for x with\n",
    "\n",
    "$$F(x) = t - t_0 + F(x_0) \\\\\n",
    "x = F^{-1}[t-t_0 + F(x_0)]$$\n",
    "\n",
    "In other words, we need to find the inverse of $F$. This is not at all trivial, and a significant amount of course work in a STEM education is devoted to finding tricky, analytic solutions to this problem, backed by several centuries of research. \n",
    "\n",
    "In the end, however, they are tricks, and many simple forms of $f(x)$ either have no closed form solution, or pose extreme difficulties. Instead, the practicing engineer turns to numerical methods to find a solution to her problems. I would suggest that students would be better served by learning fewer analytic mathematical tricks and instead focusing on learning numerical methods, but that is the topic for another book."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Finding the Fundamental Matrix for Time Invariant Systems"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    " If you already have the mathematical training in solving partial differential equations you may be able to put it to use; I am not assuming that sort of background.  So let me skip over quite a bit of mathematics and present the typical numerical techniques used in Kalman filter design. \n",
    "\n",
    "First, we express the system equations in state-space form (i.e. using linear algebra equations) with\n",
    "\n",
    "$$ \\dot{\\mathbf{x}} = \\mathbf{Fx}$$\n",
    "\n",
    "Now we can assert that we want to find the fundamental matrix $\\Phi$ that propagates the state with the equation\n",
    "\n",
    "$$x(t) = \\Phi(t-t_0)x(t_0)$$\n",
    "\n",
    "which we can equivalently write as\n",
    "\n",
    "$$x(t_k) = \\Phi(\\Delta t)x(t_{k-1})$$\n",
    "\n",
    "In other words, we just want to compute the value of $x$ at time $t$ by multiplying its previous value by some matrix $\\Phi$. This is not trivial to do because the original equations do not include time."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Taylor Series Expansion\n",
    "\n",
    "Broadly speaking there are three ways to find $\\Phi$. The technique most often used with Kalman filters is to use a Taylor-series expansion. The Taylor series represents a function as an infinite sum of terms. The terms are linear, even for a nonlinear function, so we can express any arbitrary nonlinear function using linear algebra. The cost of this choice is that unless we use an infinite number of terms (and who has time for that these days) the value we compute will be approximate rather than exact.\n",
    "\n",
    "For the Kalman filter we will be using a form of the series that uses a matrix. But before we do that, let's work through a couple of examples with real functions since real functions are easier to plot and reason about. The Taylor series for either are nearly identical, so this is a good first step.\n",
    "For a real (or complex) function the Taylor series of a function $f(x)$ evaluated at $a$ is defined as \n",
    "\n",
    "$$ \\Phi(t) = e^{\\mathbf{F}t} = \\mathbf{I} + \\mathbf{F}t  + \\frac{(\\mathbf{F}t)^2}{2!} + \\frac{(\\mathbf{F}t)^3}{3!} + ... $$\n",
    "\n",
    "This is easy to compute, and thus is the typical approach used in Kalman filter design when the filter is reasonably small. If you are wondering where $e$ came from, I point you to the Wikipedia article on the matrix exponential [1]. Here the important point is to recognize the very simple and regular form this equation takes. \n",
    "\n",
    "Before applying it to a Kalman filter, lets do the Taylor expansion of a math function since this is much easier to visualize than a matrix. I choose sin(x). The Taylor series for a real or complex function f(x) about x=a is\n",
    "\n",
    "$$f(x) = \\sum_{n=0}^\\infty\\frac{f^{(n)}(a)}{x!}(x-a)^n$$\n",
    "\n",
    "where $f^{n}$ is the nth derivative of f. To compute the Taylor series for $f(x)=sin(x)$ at $x=0$ Let's first work out the terms for f.\n",
    "\n",
    "$$\\begin{aligned}\n",
    "f^{0}(x) &= sin(x) ,\\ \\  &f^{0}(0) &= 0 \\\\\n",
    "f^{1}(x) &= cos(x),\\ \\  &f^{1}(0) &= 1 \\\\\n",
    "f^{2}(x) &= -sin(x),\\ \\  &f^{2}(0) &= 0 \\\\\n",
    "f^{3}(x) &= -cos(x),\\ \\  &f^{3}(0) &= -1 \\\\\n",
    "f^{4}(x) &= sin(x),\\ \\  &f^{4}(0) &= 0 \\\\\n",
    "f^{5}(x) &= cos(x),\\ \\  &f^{5}(0) &= 1\n",
    "\\end{aligned}\n",
    "$$\n",
    "\n",
    "Now we can substitute these values into the equation.\n",
    "\n",
    "$$f(x) = \\frac{0}{0!}(x)^0 + \\frac{1}{1!}(x)^1 + \\frac{0}{2!}(x)^2 + \\frac{-1}{3!}(x)^3 + \\frac{0}{4!}(x)^4 + \\frac{-1}{5!}(x)^5 + ... $$\n",
    "\n",
    "And let's test this with some code:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "estimate of sin(.3) is 0.30452025\n",
      "exact value of sin(.3) is 0.295520206661\n"
     ]
    }
   ],
   "source": [
    "x = .3\n",
    "estimate = x + x**3/6 + x**5/120\n",
    "exact = np.sin(.3)\n",
    "\n",
    "print('estimate of sin(.3) is', estimate)\n",
    "print('exact value of sin(.3) is', exact)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This is not bad for only three terms. If you are curious, go ahead and implement this as a Python function to compute the series for an arbitrary number of terms. But I will forge ahead to the matrix form of the equation. \n",
    "\n",
    "Let's consider tracking an object moving in a vacuum. In one dimesion the differential equation for motion with zero acceleration is\n",
    "\n",
    "$$ v = \\dot{x}\\\\a=\\ddot{x} =0,$$\n",
    "\n",
    "which we can put in state space matrix form as\n",
    "\n",
    "$$\\begin{bmatrix}\\dot{x} \\\\ \\ddot{x}\\end{bmatrix} =\\begin{bmatrix}0&1\\\\0&0\\end{bmatrix} \\begin{bmatrix}x \\\\ \\dot{x}\\end{bmatrix}$$\n",
    "\n",
    "This is a first order differential equation, so we can set $\\mathbf{F}=\\begin{bmatrix}0&1\\\\0&0\\end{bmatrix}$ and solve the following equation.\n",
    "\n",
    "$$\\Phi(t) = e^{\\mathbf{F}t} = \\mathbf{I} + \\mathbf{F}t  + \\frac{(\\mathbf{F}t)^2}{2!} + \\frac{(\\mathbf{F}t)^3}{3!} + ... $$\n",
    "\n",
    "If you perform the multiplication you will find that $\\mathbf{F}^2=\\begin{bmatrix}0&0\\\\0&0\\end{bmatrix}$, which means that all higher powers of $\\mathbf{F}$ are also $\\mathbf{0}$. This makes the computation very easy.\n",
    "\n",
    "$$\n",
    "\\begin{aligned}\n",
    "\\Phi(t) &=\\mathbf{I} + \\mathbf{F}t + \\mathbf{0} \\\\\n",
    "&= \\begin{bmatrix}1&0\\\\0&1\\end{bmatrix} + \\begin{bmatrix}0&1\\\\0&0\\end{bmatrix}t\\\\\n",
    "&= \\begin{bmatrix}1&t\\\\0&1\\end{bmatrix}\n",
    "\\end{aligned}$$\n",
    "\n",
    "We plug this into $x(t_k) = \\Phi(\\Delta t)x(t_{k-1})$ to get\n",
    "\n",
    "$$\n",
    "\\begin{aligned}\n",
    "x(t_k) &= \\Phi(\\Delta t)x(t_{k-1}) \\\\\n",
    "x^- &= \\Phi(\\Delta t)x \\\\\n",
    "x^- &=\\begin{bmatrix}1&\\Delta t\\\\0&1\\end{bmatrix}x \\\\\n",
    "\\begin{bmatrix}x \\\\ \\dot{x}\\end{bmatrix}^- &=\\begin{bmatrix}1&\\Delta t\\\\0&1\\end{bmatrix}\\begin{bmatrix}x \\\\ \\dot{x}\\end{bmatrix}\n",
    "\\end{aligned}$$\n",
    "\n",
    "This should look very familiar to you! This is the equation we used in the **Multivariate Kalman Filter** chapter to track a moving object.\n",
    "\n",
    "$$\n",
    "{\\begin{bmatrix}x\\\\\\dot{x}\\end{bmatrix}}^- =\\begin{bmatrix}1&t \\\\ 0&1\\end{bmatrix} \\begin{bmatrix}x \\\\ \\dot{x}\\end{bmatrix}\n",
    "$$\n",
    "\n",
    "We derived this equation in that chapter by using techniques that are much easier to understand. The advantage of the Taylor series expansion is that we can use it for any arbitrary set of differential equations which are time invariant. \n",
    "\n",
    "Time invariant? This just means equations that do not depend on time. For example, $f(x) = sin(t)t$ is not time invariant; the value will be different at different times due to the multiplication by t. On the other hand $f(x) = sin(t)*3$ is time invariant. $x(t)$ is dependent on time, but that is allowed. This is because to be time invariant it must be true that if $f(t) = x(t)$ then $f(t+\\Delta t) = x(t+\\Delta t)$. This will be true for the second equation, but not the first.\n",
    "\n",
    "However, we often use a Taylor expansion even when the equations are not time invariant. The answer will still be reasonably accurate so long as the time step is short and the system is nearly constant over that time step."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Linear Time Invariant Theory\n",
    "\n",
    "*Linear Time Invariant Theory*, also known as LTI System Theory, gives us a way to find $\\Phi$ using the inverse Laplace transform. You are either nodding your head now, or completely lost. Don't worry, I will not be using the Laplace transform in this book except in this paragraph, as the computation is quite difficult to perform in practice. LTI system theory tells us that \n",
    "\n",
    "$$ \\Phi(t) = \\mathcal{L}^{-1}[(s\\mathbf{I} - \\mathbf{F})^{-1}]$$\n",
    "\n",
    "I have no intention of going into this other than to say that the inverse Laplace transform converts a signal into the frequency (time) domain, but finding a solution to the equation above is non-trivial. If you are interested, the Wikipedia article on LTI system theory provides an introduction [2]."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Numerical Solutions\n",
    "Finally, there are numerical techniques to find $\\Phi$. As filters get larger finding analytical solutions becomes very tedious (though packages like SymPy make it easier). C. F. van Loan [3] has developed a technique that finds both $\\Phi$ and $Q$ numerically.\n",
    "\n",
    "I have implemented van Loan's method in `FilterPy`. You may use it as follows:\n",
    "\n",
    "    from filterpy.common import van_loan_discretization\n",
    "  \n",
    "    F = np.array([[0,1],[-1,0]], dtype=float)\n",
    "    G = np.array([[0.],[2.]]) # white noise scaling\n",
    "    phi, Q = van_loan_discretization(F, G, dt=0.1)\n",
    "    \n",
    "See the docstring documentation for van_loan_discretization for more information, which I have embedded below."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Help on function van_loan_discretization in module filterpy.common.discretization:\n",
      "\n",
      "van_loan_discretization(F, G, dt)\n",
      "    Discretizes a linear differential equation which includes white noise\n",
      "    according to the method of C. F. van Loan [1]. Given the continuous\n",
      "    model\n",
      "    \n",
      "        x' =  Fx + Gu\n",
      "    \n",
      "    where u is the unity white noise, we compute and return the sigma and Q_k\n",
      "    that discretizes that equation.\n",
      "    \n",
      "    \n",
      "    **Example**::\n",
      "    \n",
      "        Given y'' + y = 2u(t), we create the continuous state model of\n",
      "    \n",
      "        x' = | 0 1| * x + |0|*u(t)\n",
      "             |-1 0|       |2|\n",
      "    \n",
      "        and a time step of 0.1:\n",
      "    \n",
      "    \n",
      "        >>> F = np.array([[0,1],[-1,0]], dtype=float)\n",
      "        >>> G = np.array([[0.],[2.]])\n",
      "        >>> phi, Q = van_loan_discretization(F, G, 0.1)\n",
      "    \n",
      "        >>> phi\n",
      "        array([[ 0.99500417,  0.09983342],\n",
      "               [-0.09983342,  0.99500417]])\n",
      "    \n",
      "        >>> Q\n",
      "        array([[ 0.00133067,  0.01993342],\n",
      "               [ 0.01993342,  0.39866933]])\n",
      "    \n",
      "        (example taken from Brown[2])\n",
      "    \n",
      "    \n",
      "    **References**\n",
      "    \n",
      "    [1] C. F. van Loan. \"Computing Integrals Involving the Matrix Exponential.\"\n",
      "        IEEE Trans. Automomatic Control, AC-23 (3): 395-404 (June 1978)\n",
      "    \n",
      "    [2] Robert Grover Brown. \"Introduction to Random Signals and Applied\n",
      "        Kalman Filtering.\" Forth edition. John Wiley & Sons. p. 126-7. (2012)\n",
      "\n"
     ]
    }
   ],
   "source": [
    "from filterpy.common import van_loan_discretization\n",
    "help(van_loan_discretization)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Forming First Order Equations from Higher Order Equations"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the sections above I spoke of *first order* differential equations; these are equations with only first derivatives. However, physical systems often require second or higher order equations. Any higher order system of equations can be converted to a first order set of equations by defining extra variables for the first order terms and then solving. Let's do an example. \n",
    "\n",
    "Given the system $\\ddot{x} - 6\\dot{x} + 9x = t$ find the first order equations.\n",
    "\n",
    "The first step is to isolate the highest order term onto one side of the equation .\n",
    "\n",
    "$$\\ddot{x} = 6\\dot{x} - 9x + t$$\n",
    "\n",
    "We define two new variables:\n",
    "\n",
    "$$ x_1(t) = x \\\\\n",
    "x_2(t) = \\dot{x}\n",
    "$$\n",
    "\n",
    "Now we will substitute these into the original equation and solve, giving us a set of first order equations in terms of these new variables.\n",
    "\n",
    "First, we know that $\\dot{x}_1 = x_2$ and that $\\dot{x}_2 = \\ddot{x}$. Therefore\n",
    "\n",
    "$$\\begin{aligned}\n",
    "\\dot{x}_2 &= \\ddot{x} \\\\\n",
    "          &= 6\\dot{x} - 9x + t\\\\\n",
    "          &= 6x_2-9x_1 + t\n",
    "\\end{aligned}$$\n",
    "\n",
    "Therefore our first order system of equations is\n",
    "\n",
    "$$\\begin{aligned}\\dot{x}_1 &= x_2 \\\\\n",
    "\\dot{x}_2 &= 6x_2-9x_1 + t\\end{aligned}$$\n",
    "\n",
    "If you practice this a bit you will become adept at it. Just isolate the highest term, define a new variable and its derivatives, and then substitute."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Design of the Process Noise Matrix"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Author's note: this section contains some of the more challenging math in this book. Please bear with it, as few books cover this well, and an accurate design is imperative for good filter performance. At the end I present Python functions from FilterPy which will compute the math for you for common scenarios.**\n",
    "\n",
    "In general the design of the $\\mathbf{Q}$ matrix is among the most difficult aspects of Kalman filter design. This is due to several factors. First, the math itself is somewhat difficult and requires a good foundation in signal theory. Second, we are trying to model the noise in something for which we have little information. For example, consider trying to model the process noise for a baseball. We can model it as a sphere moving through the air, but that leave many unknown factors - the wind, ball rotation and spin decay, the coefficient of friction of a scuffed ball with stitches, the effects of wind and air density, and so on. I will develop the equations for an exact mathematical solution for a given process model, but since the process model is incomplete the result for $\\mathbf{Q}$ will also be incomplete. This has a lot of ramifications for the behavior of the Kalman filter. If $\\mathbf{Q}$ is too small than the filter will be overconfident in it's prediction model and will diverge from the actual solution. If $\\mathbf{Q}$ is too large than the filter will be unduly influenced by the noise in the measurements and perform sub-optimally. In practice we spend a lot of time running simulations and evaluating collected data to try to select an appropriate value for $\\mathbf{Q}$. But let's start by looking at the math.\n",
    "\n",
    "\n",
    "Let's assume a kinematic system - some system that can be modeled using Newton's equations of motion. We can make a few different assumptions about this process. \n",
    "\n",
    "We have been using a process model of\n",
    "\n",
    "$$ f(\\mathbf{x}) = \\mathbf{Fx} + \\mathbf{w}$$\n",
    "\n",
    "where $\\mathbf{w}$ is the process noise. Kinematic systems are *continuous* - their inputs and outputs can vary at any arbitrary point in time. However, our Kalman filters are *discrete*. We sample the system at regular intervals. Therefore we must find the discrete representation for the noise term in the equation above. However, this depends on what assumptions we make about the behavior of the noise. We will consider two different models for the noise."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Continuous White Noise Model"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We model kinematic systems using Newton's equations. So far in this book we have either used position and velocity, or position,velocity, and acceleration as the models for our systems. There is nothing stopping us from going further - we can model jerk, jounce, snap, and so on. We don't do that normally because adding terms beyond the dynamics of the real system actually degrades the solution. \n",
    "\n",
    "Let's say that we need to model the position, velocity, and acceleration. We can then assume that acceleration is constant. Of course, there is process noise in the system and so the acceleration is not actually constant. In this section we will assume that the acceleration changes by a continuous time zero-mean white noise $w(t)$. In other words, we are assuming that velocity is acceleration changing by small amounts that over time average to 0 (zero-mean). \n",
    "\n",
    "Since the noise is changing continuously we will need to integrate to get the discrete noise for the discretization interval that we have chosen. We will not prove it here, but the equation for the discretization of the noise is\n",
    "\n",
    "$$\\mathbf{Q} = \\int_0^{\\Delta t} \\Phi(t)\\mathbf{Q_c}\\Phi^\\mathsf{T}(t) dt$$\n",
    "\n",
    "where $\\mathbf{Q_c}$ is the continuous noise. This gives us\n",
    "\n",
    "$$\\Phi = \\begin{bmatrix}1 & \\Delta t & {\\Delta t}^2/2 \\\\ 0 & 1 & \\Delta t\\\\ 0& 0& 1\\end{bmatrix}$$\n",
    "\n",
    "for the fundamental matrix, and\n",
    "\n",
    "$$\\mathbf{Q_c} = \\begin{bmatrix}0&0&0\\\\0&0&0\\\\0&0&1\\end{bmatrix} \\Phi_s$$\n",
    "\n",
    "for the continuous process noise matrix, where $\\Phi_s$ is the spectral density of the white noise.\n",
    "\n",
    "We could carry out these computations ourselves, but I prefer using SymPy to solve the equation.\n",
    "\n",
    "$$\\mathbf{Q_c} = \\begin{bmatrix}0&0&0\\\\0&0&0\\\\0&0&1\\end{bmatrix} \\Phi_s$$\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/latex": [
       "$$\\left[\\begin{matrix}\\frac{\\Delta{t}^{5}}{20} & \\frac{\\Delta{t}^{4}}{8} & \\frac{\\Delta{t}^{3}}{6}\\\\\\frac{\\Delta{t}^{4}}{8} & \\frac{\\Delta{t}^{3}}{3} & \\frac{\\Delta{t}^{2}}{2}\\\\\\frac{\\Delta{t}^{3}}{6} & \\frac{\\Delta{t}^{2}}{2} & \\Delta{t}\\end{matrix}\\right] \\Phi_{s}$$"
      ],
      "text/plain": [
       "⎡         5           4           3⎤       \n",
       "⎢\\Delta{t}   \\Delta{t}   \\Delta{t} ⎥       \n",
       "⎢──────────  ──────────  ──────────⎥⋅\\Phi_s\n",
       "⎢    20          8           6     ⎥       \n",
       "⎢                                  ⎥       \n",
       "⎢         4           3           2⎥       \n",
       "⎢\\Delta{t}   \\Delta{t}   \\Delta{t} ⎥       \n",
       "⎢──────────  ──────────  ──────────⎥       \n",
       "⎢    8           3           2     ⎥       \n",
       "⎢                                  ⎥       \n",
       "⎢         3           2            ⎥       \n",
       "⎢\\Delta{t}   \\Delta{t}             ⎥       \n",
       "⎢──────────  ──────────  \\Delta{t} ⎥       \n",
       "⎣    6           2                 ⎦       "
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import sympy\n",
    "from sympy import init_printing, Matrix,MatMul, integrate, symbols\n",
    "\n",
    "init_printing(use_latex='mathjax')\n",
    "dt, phi = symbols('\\Delta{t} \\Phi_s')\n",
    "F_k = Matrix([[1, dt, dt**2/2],\n",
    "              [0,  1,      dt],\n",
    "              [0,  0,       1]])\n",
    "Q_c = Matrix([[0, 0, 0],\n",
    "              [0, 0, 0],\n",
    "              [0, 0, 1]])*phi\n",
    "\n",
    "Q=sympy.integrate(F_k * Q_c * F_k.T, (dt, 0, dt))\n",
    "\n",
    "# factor phi out of the matrix to make it more readable\n",
    "Q = Q / phi\n",
    "sympy.MatMul(Q, phi)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "For completeness, let us compute the equations for the 0th order and 1st order equations."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0th order discrete process noise\n"
     ]
    },
    {
     "data": {
      "text/latex": [
       "$$\\left[\\begin{matrix}\\Delta{t} \\Phi_{s}\\end{matrix}\\right]$$"
      ],
      "text/plain": [
       "[\\Delta{t}⋅\\Phi_s]"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "F_k = sympy.Matrix([[1]])\n",
    "Q_c = sympy.Matrix([[phi]])\n",
    "\n",
    "print('0th order discrete process noise')\n",
    "sympy.integrate(F_k*Q_c*F_k.T,(dt, 0, dt))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "1st order discrete process noise\n"
     ]
    },
    {
     "data": {
      "text/latex": [
       "$$\\left[\\begin{matrix}\\frac{\\Delta{t}^{3}}{3} & \\frac{\\Delta{t}^{2}}{2}\\\\\\frac{\\Delta{t}^{2}}{2} & \\Delta{t}\\end{matrix}\\right] \\Phi_{s}$$"
      ],
      "text/plain": [
       "⎡         3           2⎤       \n",
       "⎢\\Delta{t}   \\Delta{t} ⎥       \n",
       "⎢──────────  ──────────⎥⋅\\Phi_s\n",
       "⎢    3           2     ⎥       \n",
       "⎢                      ⎥       \n",
       "⎢         2            ⎥       \n",
       "⎢\\Delta{t}             ⎥       \n",
       "⎢──────────  \\Delta{t} ⎥       \n",
       "⎣    2                 ⎦       "
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "F_k = sympy.Matrix([[1, dt],\n",
    "                    [0, 1]])\n",
    "Q_c = sympy.Matrix([[0, 0],\n",
    "                    [0, 1]])*phi\n",
    "\n",
    "Q = sympy.integrate(F_k * Q_c * F_k.T, (dt, 0, dt))\n",
    "\n",
    "print('1st order discrete process noise')\n",
    "# factor phi out of the matrix to make it more readable\n",
    "Q = Q / phi\n",
    "sympy.MatMul(Q, phi)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Piecewise White Noise Model\n",
    "\n",
    "Another model for the noise assumes that the that highest order term (say, acceleration) is constant for each time period, but differs for each time period, and each of these is uncorrelated between time periods. This is subtly different than the model above, where we assumed that the last term had a continuously varying noisy signal applied to it.  \n",
    "\n",
    "We will model this as\n",
    "\n",
    "$$f(x)=Fx+\\Gamma w$$\n",
    "\n",
    "where $\\Gamma$ is the *noise gain* of the system, and $w$ is the constant piecewise acceleration (or velocity, or jerk, etc). \n",
    "\n",
    "Lets start with by looking a first order system. In this case we have the state transition function\n",
    "\n",
    "$$\\mathbf{F} = \\begin{bmatrix}1&\\Delta t \\\\ 0& 1\\end{bmatrix}$$\n",
    "\n",
    "In one time period, the change in velocity will be $w(t)\\Delta t$, and the change in position will be $w(t)\\Delta t^2/2$, giving us\n",
    "\n",
    "$$\\Gamma = \\begin{bmatrix}\\frac{1}{2}\\Delta t^2 \\\\ \\Delta t\\end{bmatrix}$$\n",
    "\n",
    "The covariance of the process noise is then\n",
    "\n",
    "$$Q = E[\\Gamma w(t) w(t) \\Gamma^\\mathsf{T}] = \\Gamma\\sigma^2_v\\Gamma^\\mathsf{T}$$.\n",
    "\n",
    "We can compute that with SymPy as follows"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/latex": [
       "$$\\left[\\begin{matrix}\\frac{\\Delta{t}^{4}}{4} & \\frac{\\Delta{t}^{3}}{2}\\\\\\frac{\\Delta{t}^{3}}{2} & \\Delta{t}^{2}\\end{matrix}\\right] \\sigma^{2}_{v}$$"
      ],
      "text/plain": [
       "⎡         4           3⎤    \n",
       "⎢\\Delta{t}   \\Delta{t} ⎥    \n",
       "⎢──────────  ──────────⎥⋅σ²ᵥ\n",
       "⎢    4           2     ⎥    \n",
       "⎢                      ⎥    \n",
       "⎢         3            ⎥    \n",
       "⎢\\Delta{t}            2⎥    \n",
       "⎢──────────  \\Delta{t} ⎥    \n",
       "⎣    2                 ⎦    "
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "var=symbols('sigma^2_v')\n",
    "v = Matrix([[dt**2 / 2], [dt]])\n",
    "\n",
    "Q = v * var * v.T\n",
    "\n",
    "# factor variance out of the matrix to make it more readable\n",
    "Q = Q / var\n",
    "sympy.MatMul(Q, var)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The second order system proceeds with the same math.\n",
    "\n",
    "\n",
    "$$\\mathbf{F} = \\begin{bmatrix}1 & \\Delta t & {\\Delta t}^2/2 \\\\ 0 & 1 & \\Delta t\\\\ 0& 0& 1\\end{bmatrix}$$\n",
    "\n",
    "Here we will assume that the white noise is a discrete time Wiener process. This gives us\n",
    "\n",
    "$$\\Gamma = \\begin{bmatrix}\\frac{1}{2}\\Delta t^2 \\\\ \\Delta t\\\\ 1\\end{bmatrix}$$\n",
    "\n",
    "There is no 'truth' to this model, it is just convenient and provides good results. For example, we could assume that the noise is applied to the jerk at the cost of a more complicated equation. \n",
    "\n",
    "The covariance of the process noise is then\n",
    "\n",
    "$$Q = E[\\Gamma w(t) w(t) \\Gamma^\\mathsf{T}] = \\Gamma\\sigma^2_v\\Gamma^\\mathsf{T}$$.\n",
    "\n",
    "We can compute that with SymPy as follows"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/latex": [
       "$$\\left[\\begin{matrix}\\frac{\\Delta{t}^{4}}{4} & \\frac{\\Delta{t}^{3}}{2} & \\frac{\\Delta{t}^{2}}{2}\\\\\\frac{\\Delta{t}^{3}}{2} & \\Delta{t}^{2} & \\Delta{t}\\\\\\frac{\\Delta{t}^{2}}{2} & \\Delta{t} & 1\\end{matrix}\\right] \\sigma^{2}_{v}$$"
      ],
      "text/plain": [
       "⎡         4           3           2⎤    \n",
       "⎢\\Delta{t}   \\Delta{t}   \\Delta{t} ⎥    \n",
       "⎢──────────  ──────────  ──────────⎥⋅σ²ᵥ\n",
       "⎢    4           2           2     ⎥    \n",
       "⎢                                  ⎥    \n",
       "⎢         3                        ⎥    \n",
       "⎢\\Delta{t}            2            ⎥    \n",
       "⎢──────────  \\Delta{t}   \\Delta{t} ⎥    \n",
       "⎢    2                             ⎥    \n",
       "⎢                                  ⎥    \n",
       "⎢         2                        ⎥    \n",
       "⎢\\Delta{t}                         ⎥    \n",
       "⎢──────────  \\Delta{t}       1     ⎥    \n",
       "⎣    2                             ⎦    "
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "var=symbols('sigma^2_v')\n",
    "v = Matrix([[dt**2 / 2], [dt], [1]])\n",
    "\n",
    "Q = v * var * v.T\n",
    "\n",
    "# factor variance out of the matrix to make it more readable\n",
    "Q = Q / var\n",
    "sympy.MatMul(Q, var)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We cannot say that this model is more or less correct than the continuous model - both are approximations to what is happening to the actual object. Only experience and experiments can guide you to the appropriate model. In practice you will usually find that either model provides reasonable results, but typically one will perform better than the other.\n",
    "\n",
    "The advantage of the second model is that we can model the noise in terms of $\\sigma^2$ which we can describe in terms of the motion and the amount of error we expect. The first model requires us to specify the spectral density, which is not very intuitive, but it handles varying time samples much more easily since the noise is integrated across the time period. However, these are not fixed rules - use whichever model (or a model of your own devising) based on testing how the filter performs and/or your knowledge of the behavior of the physical model."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Using FilterPy to Compute Q\n",
    "\n",
    "FilterPy offers several routines to compute the $\\mathbf{Q}$ matrix. The function `Q_continuous_white_noise()` computes $\\mathbf{Q}$ for a given value for $\\Delta t$ and the spectral density."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 0.33333333,  0.5       ],\n",
       "       [ 0.5       ,  1.        ]])"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import filterpy.common as common\n",
    "\n",
    "common.Q_continuous_white_noise(dim=2, dt=1, spectral_density=1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 0.05      ,  0.125     ,  0.16666667],\n",
       "       [ 0.125     ,  0.33333333,  0.5       ],\n",
       "       [ 0.16666667,  0.5       ,  1.        ]])"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "common.Q_continuous_white_noise(dim=3, dt=1, spectral_density=1)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The function `Q_discrete_white_noise()` computes $\\mathbf{Q}$ assuming a piecewise model for the noise."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 0.25,  0.5 ],\n",
       "       [ 0.5 ,  1.  ]])"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "common.Q_discrete_white_noise(2, var=1.)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 0.25,  0.5 ,  0.5 ],\n",
       "       [ 0.5 ,  1.  ,  1.  ],\n",
       "       [ 0.5 ,  1.  ,  1.  ]])"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "common.Q_discrete_white_noise(3, var=1.)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Simplification of Q\n",
    "\n",
    "Through the early parts of this book I used a much simpler form for $\\mathbf{Q}$, often only putting a noise term in the lower rightmost element. Is this justified? Well, consider the value of $\\mathbf{Q}$ for a small $\\Delta t$"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 0.00000002,  0.00000078,  0.00002083],\n",
       "       [ 0.00000078,  0.00004167,  0.00125   ],\n",
       "       [ 0.00002083,  0.00125   ,  0.05      ]])"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "common.Q_continuous_white_noise(dim=3, dt=0.05, spectral_density=1)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can see that most of the terms are very small. Recall that the only Kalman filter using this matrix is\n",
    "\n",
    "$$ \\mathbf{P}=\\mathbf{FPF}^\\mathsf{T} + \\mathbf{Q}$$\n",
    "\n",
    "If the values for $\\mathbf{Q}$ are small relative to $\\mathbf{P}$\n",
    "than it will be contributing almost nothing to the computation of $\\mathbf{P}$. Setting $\\mathbf{Q}$ to \n",
    "\n",
    "$$\\mathbf{Q}=\\begin{bmatrix}0&0&0\\\\0&0&0\\\\0&0&\\sigma^2\\end{bmatrix}$$\n",
    "\n",
    "while not correct, is often a useful approximation. If you do this you will have to perform quite a few studies to guarantee that your filter works in a variety of situations. Given the availability of functions to compute the correct values of $\\mathbf{Q}$ for you I would strongly recommend not using approximations. Perhaps it is justified for quick-and-dirty filters, or on embedded devices where you need to wring out every last bit of performance, and seek to minimize the number of matrix operations required. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "** author's note: the following aside probably belongs elsewhere in the book**\n",
    "\n",
    "> As an aside, most textbooks are more exact with the notation, in Gelb[1] for example, *Pk(+)* is used to denote the uncertainty covariance for the prediction step, and *Pk(-)* for the uncertainty covariance for the update step. Other texts use subscripts with 'k|k-1', superscript $^-$, and many other variations. As a programmer I find all of that fairly unreadable; I am used to thinking about variables changing state as a program runs, and do not use a different variable name for each new computation. There is no agreed upon format, so each author makes different choices. I find it challenging to switch quickly between books an papers, and so have adopted this admittedly less precise notation. Mathematicians will write scathing emails to me, but I hope the programmers and students will rejoice.\n",
    "\n",
    "> If you are a programmer trying to understand a paper's math equations, I strongly recommend just removing all of the superscripts, subscripts, and diacriticals, replacing them with a single letter. If you work with equations like this every day this is superfluous advice, but when I read I am usually trying to understand the flow of computation. To me it is far more understandable to remember that $P$ in this step represents the updated value of $P$ computed in the last step, as opposed to trying to remember what $P_{k-1}(+)$ denotes, and what its relation to $P_k(-)$ is, if any.\n",
    "\n",
    "> For example, for the equation of $\\mathbf{S}$ above, Wikipedia uses\n",
    "\n",
    "> $$\\textbf{S}_k = \\textbf{H}_k \\textbf{P}_{k\\mid k-1} \\textbf{H}_k^\\mathsf{T} + \\textbf{R}_k\n",
    "$$\n",
    "\n",
    "> Is that more exact? Absolutely. Is it easier or harder to read? You'll need to answer that for yourself.\n",
    "\n",
    "> For reference, the Appendix **Symbols and Notations** lists the symbology used by the major authors in the field."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Numeric Integration of Differential Equations"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "** author's note: this is just notes to a section. If you need to know this in depth, \n",
    "*Computational Physics in Python * by Dr. Eric Ayars is excellent, and available here.\n",
    "http://phys.csuchico.edu/ayars/312/Handouts/comp-phys-python.pdf **\n",
    "\n",
    "So far in this book we have been working with systems that can be expressed with simple linear differential equations such as\n",
    "\n",
    "$$v = \\dot{x} = \\frac{dx}{dt}$$\n",
    "\n",
    "which we can integrate into a closed form solution, in this case $x(t) =vt + x_0$. This equation is then put into the system matrix $\\mathbf{F}$, which allows the Kalman filter equations to predict the system state in the future. For example, our constant velocity filters use\n",
    "\n",
    "$$\\mathbf{F} = \\begin{bmatrix}\n",
    "1 & \\Delta t \\\\ 0 & 1\\end{bmatrix}$$.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The Kalman filter predict equation is $\\mathbf{x}^- = \\mathbf{Fx} + \\mathbf{Bu}$. Hence the prediction is\n",
    "\n",
    "$$\\mathbf{x}^- = \\begin{bmatrix}\n",
    "1 & \\Delta t \\\\ 0 & 1\\end{bmatrix}\\begin{bmatrix}\n",
    "x\\\\ \\dot{x}\\end{bmatrix}\n",
    "$$\n",
    "\n",
    "which multiplies out to \n",
    "\n",
    "$$\\begin{aligned}x^- &= x + v\\Delta t \\\\\n",
    "\\dot{x}^- &= \\dot{x}\\end{aligned}$$."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This works for linear ordinary differential equations (ODEs), but does not work (well) for nonlinear equations. For example, consider trying to predict the position of a rapidly turning car. Cars turn by pivoting the front wheels, which cause the car to pivot around the rear axle. Therefore the path will be continuously varying and a linear prediction will necessarily produce an incorrect value. If the change in the system is small enough relative to $\\Delta t$ this can often produce adequate results, but that will rarely be the case with the nonlinear Kalman filters we will be studying in subsequent chapters. Another problem is that even trivial systems produce differential equations for which finding closed form solutions is difficult or impossible. \n",
    "\n",
    "For these reasons we need to know how to numerically integrate differential equations. This can be a vast topic, and SciPy provides integration routines such as `scipy.integrate.ode`. These routines are robust, but "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Euler's Method\n",
    "\n",
    "Let's say we have the initial condition problem of \n",
    "\n",
    "$$ y' = y, \\\\ y(0) = 1$$\n",
    "\n",
    "I happen to know the exact answer is $y=e^t$, but of course in general we will not know the exact solution. In general all we know is the derivative of the equation, which is equal to the slope. We also know the initial value: at $t=0$, $y=1$. If we know these two pieces of information we can predict that value for y(1): it is the slope of the function at $t=0$. I've plotted this below"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAuEAAAEWCAYAAADIP0muAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3XlU1Pe9P/7nzMAM+7DvyKIIuIAgGAEX1Ghjszb5Zalp\njH577m3vL+lNyMm5qeeYxDTetjFNvm3vqfbcc38Sbpu0SZrFpE2MWDcUjSAgyObCvgw7M6wDzLx/\nfwwMEhhgYBi25+McDzKf93w+L5JPJk/fvj7vt0QIIUBERERERFYjnesCiIiIiIiWGoZwIiIiIiIr\nYwgnIiIiIrIyhnAiIiIiIitjCCciIiIisjKGcCIiIiIiK2MIJyIiIiKysglD+B/+8AfExMRAqVRC\nqVQiKSkJX3311YQnLCwsxNatW+Hg4IDAwEC8+eabFi2YiIiIiGihs5noYFBQEI4cOYLw8HDo9Xq8\n9957eOSRR5CdnY2YmJgx4zUaDXbu3ImUlBTk5OSgpKQE+/fvh6OjI1566aVZ+yGIiIiIiBYSibk7\nZnp4eODXv/41/uVf/mXMsWPHjuHAgQNobGyEQqEAAPznf/4njh07htraWstUTERERES0wE25J1yn\n0+Gvf/0r+vr6sGXLlnHHXL58GZs3bzYGcADYtWsX6uvrUVVVNfNqiYiIiIgWgQnbUQBDj3diYiK0\nWi3s7e3x0UcfISIiYtyxKpUKy5YtG/Waj4+P8VhwcLAFSiYiIiIiWtgmDeGRkZEoKCiAWq3Gxx9/\njKeeegpnz55FfHz8mLESicSsi6vVarPGExERERHNJ0qlclrvmzSE29raIiwsDAAQGxuL7Oxs/OEP\nf0BaWtqYsb6+vlCpVKNea2xsNB4jIiIiIqJprBOu0+mg1+vHPZaYmIjMzExotVrjaxkZGQgICGAr\nChERERHRkAlnwn/+85/jgQceQGBgIDo7O/HBBx/g/PnzOHnyJADgwIEDyM7OxunTpwEAe/bswRtv\nvIF9+/bh4MGDKCsrw1tvvYVDhw5NWsh0p/KJrCUnJwcAxm3FIppveL/SQsL7lRYaS7RUTxjCGxsb\n8aMf/QgqlQpKpRIxMTE4efIkdu7cCcDwsGV5eblxvIuLCzIyMvDcc88hPj4e7u7uePnll5Gamjrj\nQomIiIiIFosJQ/h4fd+THV+zZg3Onz8/s6qIiIiIiBYxs3vCiYiIiIhoZhjCiYiIiIisjCGciIiI\niMjKGMKJiIiIiKyMIZyIiIiIyMoYwomIiIiIrIwhnIiIiIjIyhjCiYiIiIisjCGciIiIiMjKGMKJ\niIiIiKyMIZyIiIiIyMoYwomIiIiIrIwhnIiIiIjIyhjCiYiIiIisjCGciIiIiMjKGMKJiIiIiKZg\nYLAfBXe+tci5bCxyFiIiIiKiRUoIgbxbl/DFpf9Fm6YJb+5Ln/E5GcKJiIiIiEyoVN3Epxf+P1Q2\nlFn0vAzhRERERETf0aZpxpdZf8K1sguzcn6GcCIiIiKiIX39vTid8wnO5n6BAV3/mONSqcwi12EI\nJyIiIqIlT6/X4UrxGfzj8vvo7OkYd8yasA14eNOzFrkeQzgRERERLWll1dfxWWYa6lsqxz0e4BmC\nRzbvR8SyGACAWq2e8TUZwomIiIhoSWpsq8XnF99DUUXOuMddHNxwf9LTuCdqm8XaUIYxhBMRERHR\nktLdq8HX336Ii4Unodfrxhy3lcmxff3D2LH+UdjJ7WelBoZwIiIiIloSBnUDuHD9K3xz9SP0arvH\nHRMfuRUPJv0Ibs5es1oLQzgRERERLWpCCBTc+RYnLr6HFrVq3DFhflH4wZb9CPZdaZWaGMKJiIiI\naNGqbryNzzLTcKeuaNzjHi4+eGjTs1i3IhESicRqdTGEExEREdGi09HVir9n/RnZJecgIMYct5M7\n4HsbHseWmPthayO3en0M4URERES0aGgH+vDPa5/hzLXP0T+oHXNcIpEiec0u7N74Qzg7KOegQgPp\nZAN+9atfISEhAUqlEt7e3njooYdQVDT+dP6wyspKSKXSMb9OnTplscKJiIiIiIbphR7fFp/B4fT/\nFye//XDcAL4qOA4/f/q3eGL7T+c0gANTmAk/f/48nn/+eSQkJECv1+O1117Dvffei+LiYri5uU34\n3m+++QYxMTHG7ycbT0RERERkrlu1N/BZ5nHUNpWPe9zPYxke2bwfUcGxVq7MtElD+MmTJ0d9/6c/\n/QlKpRJZWVm4//77J3yvu7s7vL29Z1YhEREREdE4mjsacOJiOgruXBn3uJO9Evcn7sHG1fdCZuHN\ndmbK7J5wjUYDvV4/pVntRx99FH19fQgPD0dqaioee+yxaRVJRERERDSsp68LJ69+hMzrX0GnHxxz\nXCazwbZ1D2FnwmOwVzjOQYWTMzuEv/DCC4iNjUViYqLJMc7OznjnnXeQnJwMGxsbnDhxAk8++STS\n09Px9NNPz6hgIiIiIlqadLpBXCw8ia+//RA9fZ3jjokNT8ZDyXvhofSxcnXmkQghxq7ZYsJLL72E\njz76CBcvXkRISIhZF3r++eeRmZmJ69evG19Tq9XG39+6dcus8xERERHR0iCEQF37beRUnoamt3Xc\nMZ5O/ogP3Qlvl6BZryc8PNz4e6Vyeg94TnkmPDU1FR999BHOnj1rdgAHgISEBBw/ftzs9xERERHR\n0tXW3Yicigyo1JXjHneQuyAuZDtCPVdbdbOdmZpSCH/hhRfw8ccf4+zZs1i5cnpbeebn58Pf39/k\n8fj4+Gmdl8hacnJyAPBepYWB9ystJLxfaTya7nb84/IHuFJ0etzNdhS2dtgZ/xhS4h6C3EZh1dru\n7uaYrklD+HPPPYc///nP+Pzzz6FUKqFSqQAY+r4dHQ2N7gcOHEB2djZOnz4NAEhPT4dcLse6desg\nlUrx5Zdf4ujRozhy5MiMCyYiIiKixat/UItzuV8gI+cTaAf6xhyXQIKNq+/F/Yl74OK4cJe/njSE\nHzt2DBKJBDt27Bj1+qFDh/Daa68BAFQqFcrLR9ZllEgkOHz4MKqqqiCTyRAREYG0tDTs2bPHwuUT\nERER0WKgF3rklmXiy0t/QntXy7hjVgZF4web9yPAK9TK1VnepCFcr9dPepK0tLRR3+/duxd79+6d\nflVEREREtGSU15fgswvHUdU4/kId3m4BeGTTPqwOjV9Qfd8TMXuJQiIiIiIiS2hVN+KLS/+LvFuX\nxj3uYOeM3fc8iU1r74NMtrhi6+L6aYiIiIho3uvVduNU9t9wLv9L6HTjbLYjtcGWmO/jexuegIOd\n0xxUOPsYwomIiIjIKnR6HS7fyMBXV/6Crt7xVxiJXr4RDyXvhbeb6VX1FgOGcCIiIiKadSVVefg8\nMw0NrdXjHg/0DsMPNv8fhAeusXJlc4MhnIiIiIhmTUNrDT7PTENJVe64x5WO7ngg6UdIiEqBVCK1\ncnVzhyGciIiIiCyus0eNr6/8BVk3TkEvxq62Z2sjx471P8CO9T+AwtZuDiqcWwzhRERERGQxA4P9\nOJ//d5zK/hv6+nvGHbMhahseSPoRXJ08rFzd/MEQTkREREQzJoRA/u0sfHHxf9GqaRx3zPKA1fjB\n5v1Y5rPCytXNPwzhRERERDQjVaqb+PTCcVQ0lI573FPpi4c37UP08nsWzWY7M8UQTkRERETT0qZp\nxt+z/oycsvPjHreXO+B79zyJLTHfh43M1srVzW8M4URERERkFm1/L05f+xRnrp3AgK5/zHGpRIpN\n0btx3z1PwsneZQ4qnP8YwomIiIhoSvR6Hb4tPoN/XP4Amp72ccesDo3HI5v2wcc90MrVLSwM4URE\nREQ0qZs1BfjswnHUtVSOe9zfMwQ/2LwfEctirFvYAsUQTkREREQmNbbX4UTme7hRkT3ucWcHV9yf\n+DQ2rtoOqVRm5eoWLoZwIiIiIhqju1eDk1c/QmbB19DrdWOO28hssT3uYdwb/xjs5PZzUOHCxhBO\nREREREaDugFkXv8aJ69+iF5t97hj1kdswYNJP4K7i7eVq1s8GMKJiIiICEIIFJZ/ixOZ6WhWN4w7\nJsQvAj/Y/H8Q6hdh5eoWH4ZwIiIioiWupukOPstMw+3aG+Med3f2wkObnkVseDI327EQhnAiIiKi\nJaq5owGnrn6MqyVnISDGHFfI7bEr4XGkrHsAtjbyOahw8WIIJyIiIlpiyutLcSb3cxTe+Xbc8C2R\nSJG0Zhe+v/EpODu4zkGFix9DOBEREdESoNfrUHDnW5zJPYFKVZnJcZHL1uGRzfvh7xlsxeqWHoZw\nIiIiokVMO9CHb4v/ibN5X6BV3WhynK97EB7ZvB+rQuKsWN3SxRBOREREtAipu9uQef0rXCw4iR5t\nl8lxAV6h2B73MOJWboaMm+1YDUM4ERER0SLS0FqNM7knkFN2HjrdoMlxq4LjsC3uYawMiuaKJ3OA\nIZyIiIhogRNC4GZNAc7knkBJVa7JcTKZDRIitmJb3MPw81hmxQrpuxjCiYiIiBYonW4Qubcu4kzu\nCdQ1V5gc56Bwwqbo3dgS8324OLpZsUIyhSGciIiIaIHp1XYj68YpnMv/O9RdrSbHeSh9sC32Ydyz\najsUtnZWrJAmwxBOREREtEC0aZpwLv/vuHzjFLQDfSbHhfhFYEfcI1gbtgFSPmw5LzGEExEREc1z\n1Y23cSb3BPJvXYJe6McdI4EE0cvvwba4RxDmH2nlCslcE4bwX/3qV/j0009x8+ZNKBQKbNy4Eb/6\n1a+wevXqCU9aWFiI559/HtnZ2XB3d8dPfvITvPrqqxYtnIiIiGgx0ws9iiuu4Uzu57hdV2RynK2N\nHBtX3YuU2Afh5epnxQppJiYM4efPn8fzzz+PhIQE6PV6vPbaa7j33ntRXFwMN7fxm/o1Gg127tyJ\nlJQU5OTkoKSkBPv374ejoyNeeumlWfkhiIiIiBaLgcF+ZJeew9ncL9DYXmtynLODK7bE3I9Na78H\nR3sXK1ZIljBhCD958uSo7//0pz9BqVQiKysL999//7jvef/999HX14f09HQoFAqsWrUKpaWlePfd\ndxnCiYiIiEzo6tUgs+BrXLz+FTp71SbH+bgHYnvsw4iP3ApbG7kVKyRLMqsnXKPRQK/Xm5wFB4DL\nly9j8+bNUCgUxtd27dqFV199FVVVVQgODp5+tURERESLTFN7Hc7mfYmrJWcwMNhvctzKwLXYFvcw\nokLiIJVIrVghAYa12CsbgEuFwIMbZ34+s0L4Cy+8gNjYWCQmJpoco1KpsGzZ6MXffXx8jMdMhfCc\nnBxzSiGaM7xXaSHh/UoLyVK6X4UQaOqsQXHdt6hpKzM5TgIJQjxXYVXARng4+aG3FchtNb0ZD1nO\noA64WeeAgnInXK9wREGFE5rVhr95aP9q5uefcgh/6aWXkJWVhYsXL064tSm3PSUiIiIan17oUd1a\niuK6b9HSVWdynK1MjnCfOET6J8BJobRihUtXV58UhRVOKKhwxPVyJxRVOaK3f/aWd5xSCE9NTcVH\nH32Es2fPIiQkZMKxvr6+UKlUo15rbGw0HjMlPj5+KqUQzZnhGRreq7QQ8H6lhWQp3K/a/l5cKf4n\nzuZ9gTZNk8lxbk6e2Br7ABJX74S9wtGKFS4tQghUNwKXCgztJVkFQMEdQAjr1TBpCH/hhRfw8ccf\n4+zZs1i5cuWkJ0xMTMQrr7wCrVZr7AvPyMhAQEAA+8GJiIhoSVF3teH89X/gUuFJ9Gq7TY4L9A7D\n9tiHERueDJmM27hY2uCgQMEdQ+jOKgQuFgB1zeafx14BbFhlmZom/Lf83HPP4c9//jM+//xzKJVK\n4wy3s7MzHB0Nfzo7cOAAsrOzcfr0aQDAnj178MYbb2Dfvn04ePAgysrK8NZbb+HQoUOWqZiIiIho\nnqtvqcSZ3BO4VpYJnX7Q5LjVIfHYFvcwwgPXsKXXgjq7Ba4UGWa5LxUA3xYBXb3mn8fHHdgUDSSt\nBZKjgdiVgK2NBGrTi9dM2YQh/NixY5BIJNixY8eo1w8dOoTXXnsNgOFhy/LycuMxFxcXZGRk4Lnn\nnkN8fDzc3d3x8ssvIzU1debVEhEREc1TQgiUVV/HmbwTKK3KMzlOJrPBhshtSIl9CH4eQVascPGq\naRS4VAhcvG6Y6S64A+jH31h0QqtDgaRoIHmt4VdYwOw97zhhCNdPofq0tLQxr61Zswbnz5+fflVE\nREREC8SgbgC5Ny/iTO4J1LdUmhznYOeMzdH3YXP09+HiaHq5Z5qYTidQeMfQUpJVaJjtrmk0/zx2\nckNryfAsd+IawN3Fen8bwaYjIiIiomno0XbhUuEpXMj/O9TdbSbHeSn9kBL7IDas2g6FrZ0VK1wc\nunpGWkuyCoArRUBnj/nn8XYzzG4Pz3THRQBy27lrAWIIJyIiIjJDq6YR5/P+jstFGdAO9JkcF+oX\nie1xj2BtWAKk0tlb6m6xqW0SI6uWFALXbwM6nfnniQoZmuUemuleETi/ltJmCCciIiKagirVLZzN\nO4G8W1kQYvyWXYlEiujl92B73MMI9Yu0coULj04ncKN8ZJb7UiFQpZr8fd+lkAMJkSOz3ElrAQ/l\n/Anc42EIJyIiIjJBL/QoqsjBmdwTuFNXZHKc3EaBjat3YOu6B+Hl6mfFCheW7l6Bb4tHlgq8fAPQ\nmF650SRP15GwvSkGiFsJKOTzO3R/F0M4ERER0Xf0D2qRXXIOZ3NPoKmj3uQ4ZwdXbI25H8nR98HR\nztmKFS4M9c3CuExgViGQd2t6rSURywyz3JuGZrrDg+ZXa8l0MIQTERERDensUSOz4CtkFnyN7l6N\nyXG+7kHYHvcI1kdsga2NrRUrnL/0eoGiipHAfakQqDD95xeT5LZAfKShj3t4ttvTdWEH7vEwhBMR\nEdGS19heh3O5X+BqyVkM6PpNjlsZFI3tcY8gKjh2wc/EzlRPn8DV4pF+7qwbgLrL/PN4KIGkNUBy\njCF0r48A7BSL/58tQzgREREtSUII3KkvxpncE7hRftXkOKlUhriVm7A97mEEeoVZscL5RdU6smrJ\npQIg7yYwOI3WkvCgkRVLkqMNrSZL8Q80DOFERES0pOj0Oly/fRlnck+guvGWyXF2cgckr92FLTEP\nwM3Z04oVzj29XqCkciRwXyoAyqfRWmJrY5jZHg7cSWsBb7elF7jHwxBORERES0Jffy+uFJ3Gubwv\n0NbZbHKcm7MXUtY9iI2r74W9wsGKFc6dXq1AdsnItu+XbwDtneafx815JGwnrwXiowD7JdBaMh0M\n4URERLSodXS14kL+P3Cp8CR6+01vtRjkvRzb4x7BuvAkyBb55jqNbXdtiFMA5N4EBgbNP8+KwNG7\nUEYGA1IpQ/dUMIQTERHRolTXXImzeSdwrSwTOr3phLk6NB7b4x7BioDVi7I3Wa8XKK0avSHO7Vrz\nz2MjM7SWDAfu5GjAx33x/fOyFoZwIiIiWjSEECitzseZ3M9RVn3d5DgbmS02RKUgJfYh+LoHWbHC\n2dc31FoyvO17ViHQZnq1RZNcnQ2rliQNBe6EKMDBjqHbUhjCiYiIaMFrVTcip+w8skvOTbi5jqOd\nMzZHfx+bonfDxdHVihXOnub20RviXCsD+gfMP0+Y/0g/96ZoICqErSWziSGciIiIFqSevi7k3bqE\n7NJzKK8vmXCsl6s/tsU+hA1R2yC3VVipQssTQqCsGqP6uW/WmH8eGxkQu3Jkljt5LeDnycBtTQzh\nREREtGAMDA6guPIackrP4UZlDnS6iZ8mDPOPwva4h7EmNAHSBfiwpbZfIKd0dD93q9r88yidgMQ1\nI7PcCVGAoz1D91xiCCciIqJ5TQiBioZSZJecQ96tS+jRTrwto0xqg7XLN2B73CMI8V1ppSoto6VD\nGLd8v1QA5JROr7UkxG/0hjirQ9laMt8whBMREdG81NReh+zS88gpPY9WTeOk40P8IpAQmYK48GQ4\n2rtYocKZEULgVo0hcF8sMMx0l1Wbfx6ZDFi3YiRwJ68F/L0YuOc7hnAiIiKaNzp71Mi9mYmc0vOo\nmmA3y2FeSj/ER25FfORWeLn6WaHC6dP2C+TeHNkQJ6sQaO4w/zzODoa2kuF+7g1RgJMDQ/dCwxBO\nREREc2pQN4Catpu49sVJlFTlQa/XTTje0c4ZcSs3Iz5yK0J8V87btb1b1SOtJVkFQHYpoO03/zzL\nfAx93MPrc68JA2Sy+fkz09QxhBMREZHV6YUet2uLkF16DrllmRjQTZxObWS2WBOWgITIFEQFx8JG\nZmulSqdGCIHbtXetWlIIlFSafx6pFFgXPrLte3I0EOjNwL0YMYQTERGR1dS3VCGn9Dxyys6jo6t1\n0vErAtcgIWIr1oUnwV7haIUKp6Z/QCC3bPSqJU3t5p/HyX5o1ZKhWe57VgHOjgzdSwFDOBEREc0q\ndXcbrpVdQHbpedQ1V0w63sc9EAmRKYiP2Ap3Fy8rVDi5do1A1o2RDXGuFgN902gtCfIxhO3hfu61\nYYCNDUP3UsQQTkRERBan7e/F9TtXkF16DjdrCiGEfsLxdraO2LhmBxIityLQK2xO+7yFECivG1om\ncGimu2jyPzuMIZUC0ctHb4izzJeBmwwYwomIiMgidHodbtYUILvkHAruXEH/oHbC8XIbBaKXb4RS\n5g8/11BsSNhgpUpHGxgUyLs5Mst9qRBQTd4pM4ajPbBx9Ug/98Y1gAtbS8gEhnAiIiKaNiEEapvL\nkV1yDtduZqKzZ+I19yQSKSKCohEfuRUxyzdCIbdHTk6Olao16OgUuHxjZJb722Kgd+I/L4wrwGuo\ntSTasHpJ9HK2ltDUMYQTERGR2do0zcgpM2yko2qrmXR8gFcoEiJTsH7lZiid3K1QoYEQApUNIztQ\nXhpqLRHCvPNIJMDa5SOz3JtiDEsHztflEWn+YwgnIiKiKenVdiP/VhayS8/hdl3RpONdnTwQH2HY\nSMffM9gKFRpaS67fGh26G6bRWuJgZ1ipJGkocG9cDSidGLjJchjCiYiIyKRB3QBKqvKQXXoON8qz\nMagbmHC8Qm6P2BVJiI9MwYrA1ZBKpLNan7pL4ErRyC6U3xYDPX3mn8fPY/S27zHhgC1bS2gWTRrC\nL1y4gN/85jfIzc1FfX090tLS8Oyzz5ocX1lZibCwsDGvnzx5Ert27ZpZtURERDTrhBCoVN1ETul5\n5N7MRHdf54TjpVIZooJjkRCZgjVhCZDbKGatrupGQ+Ae3hCn8M70WktWh44O3SF+bC0h65o0hHd3\ndyM6OhrPPvss9u7dO+Ub9JtvvkFMTIzxezc3t+lXSURERLOuuaPBsJFO6Xk0qxsmHR/suxIJkVsR\nG74Jzg5Ki9czOChw/fboDXHqms0/j71iqLVkKHAnrgFcnRm4aW5NGsJ3796N3bt3AwD27ds35RO7\nu7vD29t72oURERHR7Ovu1SD31iVkl55DZUPZpOM9XHwQH7kVCZFb4e0WYNFaNN0CV26MzHJfKQK6\ne80/j6/H6A1xYleytYTmn1nrCX/00UfR19eH8PBwpKam4rHHHputSxEREZEZBgb7caMiBzml51Bc\nmQudfnDC8Q4KJ8Su3ISEyK0I9Yu0WNtGtUrgUiHw+T+DcL3cCbcbAP3Ee/qMa3XoyCx38logLICt\nJTT/WTyEOzs745133kFycjJsbGxw4sQJPPnkk0hPT8fTTz9t8n3WXiOUaLp4r9JCwvuVhgkh0KSp\nxp3mQlS1lGBAN/HC2FKJDIHu4QjzWosAt+WQSW3QVt+Ntvpr07q+Tg/crrfH9XInFFQ44Xq5Exo7\n5ENHp/435wpbPVYt60ZMaBeiw7qwNqQbSked8Xi7CrimmlaJRFMWHh4+43NYPIR7eHggNTXV+H1c\nXBxaW1tx5MiRCUM4ERERWV5HTwsqmgtR3nwD3Vr1pOO9XYIQ5rUWwZ5RUNjYT/u63X1SFFU5GkN3\nYaUjerQys8/j7jSA6LCuodDdjcjAHtjamPkkJtE8ZJUlChMSEnD8+PEJx8THx1ujFKJpG55R5L1K\nCwHv16VN092B3JuZyC49h5qmO5OO93YLQEJkCuIjtsBD6TOta9Y2CcO63EPrc1+/Pb3WkqiQ0Rvi\nLA+whUTiDsB6G/wQTUatnvwPtJOxSgjPz8+Hv7+/NS5FRES0JPUPaFFw5wpySs+jtDofejFxAnay\nV2J9xGbER2zFMp8VZvVQ63QCN8pHb4hT3Wh+zQo5kBAJhHmpEBPWhb0/WAEPJXu5aWmY0hKFt27d\nAgDo9XpUVVUhPz8fHh4eCAoKwoEDB5CdnY3Tp08DANLT0yGXy7Fu3TpIpVJ8+eWXOHr0KI4cOTK7\nPwkREdESo9frcKv2BrJLz+H67cvQDky8S42tTI61y+9BQuRWRC5bB5lsanNx3b0C3xaPbIhzpQjQ\ndJtfr6fr0MOTQ+tzx60EFHIJcnLqAIABnJaUSf/ry87Oxvbt2wEYnjR+/fXX8frrr2Pfvn04fvw4\nVCoVysvLjeMlEgkOHz6MqqoqyGQyREREIC0tDXv27Jm9n4KIiGgJqWuuQHbpeVwruwB1d9uEYyWQ\nIDxoLRIityJ6eSLsFQ5TOP9Ia0lWAZB/G9DpJn3bGBHLDKuWbBpauSQ8iKuWEA2bNISnpKRAP0FT\nV1pa2qjv9+7di7179868MiIiIjJq72zBtbILyCk9j/rWqknH+3sEIyEqBXErN8PN2dPkOJ1OoKhi\n9IY4lZPv0zOG3BaIjxzZgTJpLeDpysBNZIpVesKJiIjIfJ09ahRV5CCn7Dxu1RRCYOJVQZSO7lgf\nsQUJkSkI8AoZd0x3r8DV4pENcS7fANRd5tfmoQSS1gDJMYbQvT4CsFMwdBNNFUM4ERHRPKEXetQ2\nlaOo8hqKK6+hWnVr0uCtsLVDzIpEJESmIDxwDaTS0csANrQI4wOUWYVA3k1gcBqtJeFBI7PcydGG\nVhO2lhBNH0M4ERHRHOrRdqG0Kh/FlddQUpmLzt7Jlz6TSqSIXLYOCVEpWBO2AQpbOwCAXi9wo1wY\nA/elAqC83vyabG0MrSXD274nrQW83Ri4iSyJIZyIiMiKhBBoaK1CUWUuiiuvoaK+ZNLlBIcFeS9H\nQqShz9soOPAoAAAelElEQVTF0RU9fQJXbgCXCgSyCoGsG0BHp/k1ubsYgvbw+tzxUYA9W0uIZhVD\nOBER0SzT9veirKYAxUNtJh1drVN+b6BXGFaHrsf6iC2QIBCXCoA3jgNZBQLXyqbXWrIicOjhyaH2\nkshgQCpl6CayJoZwIiIiCxNCoKmjHsUVhtB9u74IOt3glN6rkNsjctk6RC5bDxtpPAruKPG3fwIv\n/l/gTp35tdjIDA9NJt3Vz+3jzsBNNNcYwomIiCygf1CL27VFKK7MQVHlNbSqp76FpJ/HMiwPSIBu\nMAkV9cH4/JwMWYVA+zRaS1ydDauWDPdzJ0QBDnYM3UTzDUM4ERHRNLVqGodmu3Nxs7YAA4P9U3qf\nrY0cvu4bMTiQgrrmCHx5wQHXyoCBqU2WjxLmP/Lw5KZoICqErSVECwFDOBER0RQN6gZQXl+C4spr\nKKq8hsa22im9TwgAiIFucAdUratwo9wdt2vND8o2MiB25UjgTloL+HkycBMtRAzhREREE1B3tRlD\nd1l1PrQDfZO+Z1BnixZ1BAa0W9HUvgZl1d5o00jNvrbSCUhcM7I+94ZVbC0hWiwYwomIiO6i0+tQ\npbppDN51zRWTvqdX64yGlii0a2LRql6HinpvDAyaH7pD/EZmuJOjgdWhbC0hWqwYwomIaMnr7FGj\npCoXxZW5KK3KQ4/W9D7uQgAdnf5oaImCqjUKLR3RaGr3MvuaMhmwbsXQLPfQTLe/FwM30VLBEE5E\nREuOcXv4ihzD9vCNt01uD6/T2aCpfTkaWqLQ0BKJxrYo9PS5mH1NZ4e7NsSJBjZEAU4ODN1ESxVD\nOBERLQk9fV0orZ58e/herTNUrRHG0N3UtgI6vdzs6wX7jt4QZ00YIJMxdBORAUM4EREtSkII1LdU\nGXeprGgoHbM9vBCAussPDS2RQ6E7Cu2dgWZfSyoF1oWPbPueHA0EejNwE5FpDOFERLRojGwPn4Oi\nylyov7M9vE5ng+aOsLtCdyR6ta5mX8fJ3rBqyfAs9z2rAGdHhm4imjqGcCIiWrDGbA9fVwSdfmTH\nmz6tE1StEahviYKqJRKN7Sug0ynMvk6Qz1BrydD63GuXs7WEiGaGIZyIiBYUw/bwN4xLCA5vDy8E\noOn2Rf3QDLeqJRJtmmVmn18qBaKXjzxAmbwWWObLwE1ElsUQTkRE816ruhFFQ73dt2oKMaDrH2ot\nCUVDyz2G0N0aiZ4+N7PP7WgPbFw90s+9cQ3gwtYSIpplDOFERDTvjLc9fF+/49CqJY8PrVoSjsFp\ntJYEeI2sWrIp2jDrbWPD0E1E1sUQTkRE80JHVyuKK3NRXHkNpVX5aO5QDj1A+QAaWiPRpg4CYN4u\nlBKJoX97uJc7ORpY5gNIJAzdRDS3GMKJiGhO6PQ6VDaUobjyGgrv5OH6HelQ6N6MhpZ/QU+fu9nn\ndLAzrFQyvAvlxtWA0omBm4jmH4ZwIiKyGnV3G8qqryOn9AbO5fagsiEEDa0xaGz9fzCoszP7fH4e\nwKaYkX7umHDAlq0lRLQAMIQTEdGs0As9VK01KK8vxdWSWlwqAG7VGDbGaVVvwXRaS9aEjV61JMSP\nrSVEtDAxhBMRkUX0D2pR3Xgbt6pLkFnQjqvFclQ3hqGhZT26e3eZfT57hcA9qyTGDXES1wCuzgzc\nRLQ4MIQTEdG0dPZ0oLy+FEUVt3EurxcFt5Wob45AY9v3MTBob/b5fNz12BQtNc50x66UsLWEiBYt\nhnAiIpqUEAJN7XW4U1+C7JIaXCoQKKvyQ0NrJFrV8RBCZvY5w4O0SImVIzlaguS1QFiAlK0lRLRk\nMIQTEdEYA4P9qGm6g5s1pbhY0IqrRXJUqULQ0LIOXb33mn0+ua0OMSv6kBJnhy3rZEhcA7i7mP8g\nJhHRYsEQTkRE6OrVoKKhFEUVt3AutxfXbzujvnklVK3fm1ZriZuzFhtX67BtvT02x0gQu1IGua3T\nLFRORLQwTRrCL1y4gN/85jfIzc1FfX090tLS8Oyzz074nsLCQjz//PPIzs6Gu7s7fvKTn+DVV1+1\nWNFERDR9Qgg0dzSgvL4E2aXVuHhdoLTKG6qWSLSon5xWa0mofw82x8iwLU6B5GhgeYCCrSVERBOY\nNIR3d3cjOjoazz77LPbu3Tvph6pGo8HOnTuRkpKCnJwclJSUYP/+/XB0dMRLL71kscKJiGhqBnUD\nqGkqx+26Ely83opvi2xR0RAMVcsadPZsN/t8tjY6RC/vQ0qcAltjbZC4BvBQOs5C5UREi9ekIXz3\n7t3YvXs3AGDfvn2TnvD9999HX18f0tPToVAosGrVKpSWluLdd99lCCcisoKevi7Utt1CdasKaReu\nI/+mE2qbwqFq3YmBQQezz6d06sc9qwaxI94Om2KkiFspg0LO1hIiopmweE/45cuXsXnzZigUCuNr\nu3btwquvvoqqqioEBwdb+pJEREuWEAKtmkaU15egvL4EFQ2laGitRkNLJD49e3harSXBvj3YHCPF\ntvV2SF4LhAfJIZEoJn8jERFNmcVDuEqlwrJly0a95uPjYzxmKoTn5ORYuhSiWcF7leaSXq9DW3cj\nmjpr0KypRZOmBr0DXWPGubtUQ4jJe7JtZIMID+hA3HItYpf3Ijq0C65OOuNxTRNwrcmiPwKRSfx8\npYUiPDx8xueweAjngzhERJbTP9iH5s46NGlq0NxZg5bOegzqByZ9n0LeAw9lNVrVIaNed7LvxZpg\nNdaHD2BdWDcig3qgsBWzVD0REZli8RDu6+sLlUo16rXGxkbjMVPi4+MtXQqRRQ3P0PBepdkihEB7\nZ7OxtaS8oRQNLVUQMC8kSyCBq4MXopa1oLrJG5uiJUhZb49N0UDEMntIJOb3hRPNJn6+0kKjVqtn\nfA6Lh/DExES88sor0Gq1xr7wjIwMBAQEsB+ciOguOr0O9S2Vxl7uO/UlUHe1mn0eWxs5QnwjEOYf\niVC/KIT6RaCosATfjwHu2cBVS4iI5qMpLVF469YtAIBer0dVVRXy8/Ph4eGBoKAgHDhwANnZ2Th9\n+jQAYM+ePXjjjTewb98+HDx4EGVlZXjrrbdw6NChWf1BiIjmu77+XlSpbuJOfTEq6ktRqSqDdqDP\n7PO4OLgh1D8SYf5RCPOLQqBXKGSysR/nMqklqiYiotkwaQjPzs7G9u2GdWQlEglef/11vP7669i3\nbx+OHz8OlUqF8vJy43gXFxdkZGTgueeeQ3x8PNzd3fHyyy8jNTV19n4KIqJ5qL2zBRUNpcb2krqW\nSgihN/s8fh7LEOo3FLr9o+Dh4sPnb4iIFrhJQ3hKSgr0etP/00hLSxvz2po1a3D+/PmZVUZEtIDo\n9To0tNagvL4Y5Q2lqKgvQVtns9nnsZXJscxnhTFwh/hFwNHOeRYqJiKiuWTxnnAiosVOCIGOrlbU\nNVegtrkc5Q2lqGwoQ19/j9nncrJXGnu5w/yjEOQdBhuZ7SxUTURE8wlDOBHRBAZ1A2hsq0VdSyVq\nmytQ31yB2pZK9PR1Tut83m4Bxl7uMP9IeLn6s7WEiGgJYggnIhrS3deJuuZK1DVXoK6lAnXNFVC1\n1UKnH5zW+WQyGyzzXoEw/0iE+a9CqF8knOxdLFw1EREtRAzhRLTk6IUerepGw8x2S8XQDHcl2rta\nZnReBztnhPlFItQ/CmF+kVjmswK2NnILVU1ERIsJQzgRLWr9A1o0tFahtrkCdS2GWe76lsppLQ14\nN7mNAv6eIQjwCkWQ93KE+UfC2y0AUgnXBSQioskxhBPRoiCEgKan3dBK0lw51E5SiaaO+mktC3g3\npZMHAj1DEeBlCN0BniHwVPpCKpVZqHoiIlpqGMKJaMHR6QbR2F5nnNkeDtxdvTPbRlgqlcHXPQgB\nniNhO8ArlH3cRERkcQzhRDSv9Wi7UN9SNTTDXYHalgqoWmswqBuY0XkdFE7w9woZNcPt4xYEWxsu\nD0hERLOPIZyI5gUhBNo0TUO92xVDM9yVaNM0zfjcnkrfUTPbAZ6hcHP25NKAREQ0ZxjCicjqBgb7\n0dBaPaqVpK6lclqb3dzN1kYOf49gw8y2ZygCvELh7xkCO7m9hSonIiKyDIZwIppVmu6OUTPbdc0V\naGqvg36GD0u6OLoZg3aAZwgCvULh5erHhyWJiGhBYAgnIovQ63Vo6qi/a7Mbw1dNT/uMziuVSOHj\nHjgUuEOMX50dXC1UORERkfUxhBOR2fr6e1E/vI17SwVqmyvR0FqFgcH+GZ3XTu7wnd7tEPh5LOOG\nN0REtOgwhBORSUIItHe2jLSTDM1wt6hVMz63u4s3AocekhxencTd2ZsPSxIR0ZLAEE5EAIBebTea\nOxpG7S5Z31yJHm3XjM5rI7OFn8eykdltr1D4ewbDQeFkocqJiIgWHoZwoiVkYHAALWoVmjvq0NRe\nj6aOejQPfe3s6Zjx+Z3slQjwMjwk6e8ZikCvUHi7BUDGhyWJiIhGYQgnWmT0eh3au1rQ1F6P5o76\nUWG7rbN5xlu4A4BEIoW3q//o/m2vELg4uLGdhIiIaAoYwokWICEEuno1aGqvGzWb3dxRj+aOhhnv\nJnk3ha0dAjxDDbtLGh+WDIbcVmGxaxARES01DOFE85i2vxdNHQ1DM9qjA3evttui15JJbeCp9IWX\nm79hdntohttD6QOpRGrRaxERES11DOFEc2xQN4BWTROa2uvGtI+ou9ssfj03Zy94u/rDy80f3q7+\n8Hbzh5erP9xdvNm7TUREZCUM4URWoBd6qLtaxzwM2dxej1ZN44x3j/wuR3sXQ8D+Ttj2VPqxjYSI\niGgeYAgnsqDuvs67Hoi8awWSjvoZb2TzXbY28rtCdgC83fzh7RYAL1c/ONo5W/RaREREZFkM4URm\n6h/QormjYWgm29CnPTyr3d3XadFrSSVSeCh9x20fUTq5s1ebiIhogWIIJxqHTq9D21Cf9nDAvl1d\nCk1vG/73ksbi11M6eYzbPuLh4gOZjP+ZEhERLTb8vzstWUIIaLrb0TS0cc3dD0W2qFXQ63UWvZ69\nwhHebgGjZrO93fzhpfSDQm5v0WsRERHR/MYQTotej7YLze0Ndz0QORK6tQN9Fr2WjcwWXq5+QzPa\nI4Hb2y0AjnbO3MiGiIiIADCE0wInhEB3XyfaO5vRpmk2fO00fG3vbEGbpgldvWqLXlMikcLdxcv4\nMKSX60j7iKuzJ/u0iYiIaFIM4TSv6XSD6OhuNQbs9s4WtHc2oa2zBe1Dr/UPamfl2i4ObqP6s9Ut\nPXCx98DWpB2wtbGdlWsSERHR0jClEH706FG8/fbbUKlUWL16NX77299i06ZN446trKxEWFjYmNdP\nnjyJXbt2zaxaWnR6tT1o72wyzFp3NhuD9fBstrq7HcLCa2jfTSG3H/VApI9bALxcDbPb9gqHUWNz\ncnIAgAGciIiIZmzSEP7hhx/ixRdfxLFjx7Bp0yb84Q9/wO7du1FcXIygoCCT7/vmm28QExNj/N7N\nzc0yFdOCoRd6dHZ3oG04ZGuGw7bha7umCb39PbNeh0xqA09X37seiBxaU9vVH84OruzTJiIiIqub\nNIS/++672L9/P3784x8DAH7/+9/j5MmTOHbsGH75y1+afJ+7uzu8vb0tVynNO/2D2qEwfXcfdrNx\nRrujqxU6/eCs1yG3tYO7sxfcnL3g5uxp+L2Ll/E1pZMHt2MnIiKieWXCEN7f34/c3Fz8x3/8x6jX\nd+3ahaysrAlP/Oijj6Kvrw/h4eFITU3FY489NvNqyWqEEOjq1YwJ1sYHHjubLf7AoynODq7GQO3u\nMhy2R753UDhxNpuIiIgWlAlDeEtLC3Q6HXx8fEa97u3tDZVKNe57nJ2d8c477yA5ORk2NjY4ceIE\nnnzySaSnp+Ppp5+2XOU0I4O6Aai72kZaQ8ZZXcTS26yPRyazgbuTYQbbzcXb8NXZa9TMtq2NfNbr\nICIiIrImi6+O4uHhgdTUVOP3cXFxaG1txZEjRyYM4cMPvZFl9A/2oVurQbdWjS6tGt3GX4bXevot\nu726KXIbOzgqlHBUKOGkUMJR4TLqeztbx7Gz2L1AZ+8AOpvqUY16q9RpDt6rtJDwfqWFhPcrLRTh\n4eEzPseEIdzT0xMymQyNjY2jXm9sbISfn9+UL5KQkIDjx49Pr0IaQy/06OvvGgrXGmPAvvv7Ad3s\nLNt3NwkkcFA4G0O1o8JlKGgP/ZK7wNZGMet1EBERES00E4ZwuVyO9evX49SpU6N6ujMyMvD4449P\n+SL5+fnw9/efcEx8fPyUz7dY6fU6dPVqoOlph6a7A5ru9qHfG752dnego6sV7V0tFt9SfTx3P/Do\n7jzSMuLu7Ak3Z28ondyX1AOPwzM0vFdpIeD9SgsJ71daaNTqmT8XN2k7yksvvYRnnnkGGzZsQFJS\nEv74xz9CpVLhpz/9KQDgwIEDyM7OxunTpwEA6enpkMvlWLduHaRSKb788kscPXoUR44cmXGxC5V2\noM8QpO8K1Z09HVB3t6Ozux2aHkPg7uxVz+qa2N/l4uA2FKzv7sEeefiRDzwSERERzY5JQ/gTTzyB\n1tZWHD58GA0NDVi7di2++uor4xrhKpUK5eXlxvESiQSHDx9GVVUVZDIZIiIikJaWhj179szeTzEH\nDLPWndD0tI2atTaE6zZ03vWadqDP6vUZH3h0uXvpPsODj+4u3nB18uADj0RERERzRCKEEHN18bun\n8pVK5VyVMcroWesOaLrb0Dk0U62Zw1nr73Kwcx5ZE/uu2evh750clJBKpHNW32LEvy6lhYT3Ky0k\nvF9pobFEhrX46ijz0XdnrTt72g2tIHfPWg8F7rmYtb6bg8IJzo6uUDq4wdnRDS4OrnBxdIeLoytc\nHNzg4ugOd2dPKOT2c1onEREREU3fgg7h35217hx+iPHuWeuednT1qKGfw1lrmdQGLg6uhlBtDNZu\nQ6F6KGQ7uMLZwQ22NrZzVicRERERWce8C+HDs9Yjs9VDK4X0jA3X2v7eOa118llrw2sOds58wJGI\niIiIjOZNCD/ywUvzd9Z6OFCPmrV25YONRERERDQt8yaE1zaXTz5oBoZnre+eoeasNRERERHNhXkT\nwqdjsllrZwc3KB3dOGtNRERERPPKvAzh9grHux5cvOtBxu+8Zm/nxGX4iIiIiGjBmTchPPWJtzhr\nTURERERLwrwJ4aF+EXNdAhERERGRVbCXg4iIiIjIyhjCiYiIiIisjCGciIiIiMjKGMKJiIiIiKyM\nIZyIiIiIyMoYwomIiIiIrIwhnIiIiIjIyhjCiYiIiIisjCGciIiIiMjKGMKJiIiIiKyMIZyIiIiI\nyMoYwomIiIiIrIwhnIiIiIjIyhjCiYiIiIisjCGciIiIiMjKGMKJiIiIiKyMIZyIiIiIyMoYwomI\niIiIrIwhnIiIiIjIyhjCiYiIiIisbEoh/OjRowgNDYW9vT3i4+Nx8eLFCccXFhZi69atcHBwQGBg\nIN58802LFEtEREREtBhMGsI//PBDvPjiizh48CDy8/ORlJSE3bt3o6amZtzxGo0GO3fuhJ+fH3Jy\ncvC73/0Ob7/9Nt59912LF09EREREtBBNGsLfffdd7N+/Hz/+8Y8RERGB3//+9/Dz88OxY8fGHf/+\n+++jr68P6enpWLVqFR577DG88sorDOFEREREREMmDOH9/f3Izc3Frl27Rr2+a9cuZGVljfuey5cv\nY/PmzVAoFKPG19fXo6qqygIlExEREREtbBOG8JaWFuh0Ovj4+Ix63dvbGyqVatz3qFSqMeOHvzf1\nHiIiIiKipcTG0ieUSCTTep9arbZwJUSWFR4eDoD3Ki0MvF9pIeH9SkvRhDPhnp6ekMlkaGxsHPV6\nY2Mj/Pz8xn2Pr6/vmBnv4ff7+vrOpFYiIiIiokVhwhAul8uxfv16nDp1atTrGRkZSEpKGvc9iYmJ\nyMzMhFarHTU+ICAAwcHBFiiZiIiIiGhhkwghxEQDPvroIzzzzDM4evQokpKS8Mc//hFpaWkoKipC\nUFAQDhw4gOzsbJw+fRqAYYnCiIgIpKSk4ODBgygrK8P+/ftx6NAhpKamWuWHIiIiIiKazybtCX/i\niSfQ2tqKw4cPo6GhAWvXrsVXX32FoKAgAIaHLcvLy43jXVxckJGRgeeeew7x8fFwd3fHyy+/zABO\nRERERDRk0plwIiIiIiKyrCltW28p//3f/41t27bB1dUVUqkU1dXVU3rfJ598glWrVsHOzg6rV6/G\n559/PsuVEgFarRY/+9nP4OXlBScnJzz88MOoq6ub8D3vvfcepFLpqF8ymQz9/f1WqpqWkqNHjyI0\nNBT29vaIj4/HxYsXJxxfWFiIrVu3wsHBAYGBgXjzzTetVCmRefdrZWXlmM9SqVQ65hk1otlw4cIF\nPPTQQwgMDIRUKkV6evqk75nO56tVQ3hvby/uu+8+vPHGG1N+z+XLl/HUU0/hmWeewfXr1/H000/j\n8ccfx9WrV2exUiLgxRdfxKeffoq//vWvyMzMhEajwQMPPAC9Xj/h+xwcHNDY2AiVSgWVSoWGhgbI\n5XIrVU1LxYcffogXX3wRBw8eRH5+PpKSkrB7927U1NSMO16j0WDnzp3w8/NDTk4Ofve73+Htt9/m\nbsZkFeber8O++eYb42epSqXCtm3brFQxLWXd3d2Ijo7G7373O9jb20+6/Pa0P1/FHMjOzhYSiURU\nVVVNOvaJJ54Qu3btGvXavffeK374wx/OVnlEoqOjQ8jlcvHBBx8YX6upqRFSqVR88803Jt+XlpYm\nnJycrFEiLXEbNmwQ//qv/zrqtfDwcHHgwIFxxx89elQolUrR19dnfO3w4cMiICBgVuskEsL8+7Wi\nokJIJBKRk5NjjfKITHJychLp6ekTjpnu56tVZ8Kn48qVK9i1a9eo13bt2oWsrKw5qoiWgmvXrmFg\nYGDUvRcYGIioqKhJ773e3l6EhIQgKCgIDz74IPLz82e7XFpi+vv7kZuba9Zn4+XLl7F582YoFIpR\n4+vr61FVVTWr9dLSNp37ddijjz4KHx8fbNq0CZ988slslkk0bdP9fJ33IVylUhm3vR/m4+MzZkMg\nIktSqVSQyWTw8PAY9bqPj8+YzavuFhkZibS0NHzxxRf4y1/+Ajs7OyQnJ+P27duzXTItIS0tLdDp\ndGM+G729vU1+Npr6LB0+RjRbpnO/Ojs745133sHHH3+Mr7/+Gjt27MCTTz6J999/3xolE5llup+v\nMw7hBw8eHPfhibt/XbhwYaaXIbKI2b5fN27ciGeeeQbR0dHYtGkTPvzwQ6xYsQL/9V//ZcGfgsh8\nk/U0Es0nHh4eSE1NxYYNGxAXF4c33ngDP/3pT3HkyJG5Lo1ojOl+vk66TvhkUlNTsXfv3gnHDK8p\nPh2+vr5j/hTR2NgIX1/faZ+Tlq6p3q+Dg4PQ6XRobW0dNRuuUqmwZcuWKV9PKpUiLi4Ot27dmnbN\nRN/l6ekJmUw25m9lGhsb4efnN+57TH2WDh8jmi3TuV/Hk5CQgOPHj1u6PKIZm+7n64xDuIeHx5i/\nsrekxMREZGRk4OWXXza+lpGRgeTk5Fm7Ji1eU71f169fD1tbW5w6dQo//OEPAQC1tbUoLS1FUlLS\nlK8nhMD169cRFxc37ZqJvksul2P9+vU4deoUHnvsMePrGRkZePzxx8d9T2JiIl555RVotVpj32JG\nRgYCAgIQHBxslbppaZrO/Tqe/Px8+Pv7z0aJRDMy7c9XSzw5OlUNDQ0iLy9PvP/++0IikYivvvpK\n5OXliba2NuOY7du3j3paOisrS9jY2Ihf//rXoqSkRPzyl78Utra24urVq9YsnZagf/u3fxOBgYHi\n9OnTIjc3V6SkpIjY2Fih1+uNY757vx46dEh888034s6dOyIvL0/s379fyOVykZ2dPRc/Ai1iH374\noZDL5eJ//ud/RHFxsfj3f/934ezsLKqrq4UQQvz85z8XO3bsMI5Xq9XC19dXPPXUU+LGjRvik08+\nES4uLuLdd9+dqx+BlhBz79f33ntPfPDBB6K4uFiUlpaKt99+W8jlcvHb3/52rn4EWkK6urpEXl6e\nyMvLEw4ODuIXv/iFyMvLs/jnq1VD+Ouvvy4kEomQSCRCKpUav9699EtISIjYv3//qPf97W9/E5GR\nkUIul4tVq1aJzz77zJpl0xKl1WrFz372M+Hh4SEcHBzEQw89JGpra0eN+e79mpqaKoKDg4VCoRDe\n3t7ivvvuE1euXLF26bREHD16VISEhAiFQiHi4+NFZmam8di+fftEaGjoqPGFhYViy5Ytws7OTvj7\n+4tf/OIX1i6ZljBz7tf09HSxatUq4ejoKFxcXERCQoJ4//3356JsWoLOnj07Jq9KJBLj/+8t9fnK\nbeuJiIiIiKxs3i9RSERERES02DCEExERERFZGUM4EREREZGVMYQTEREREVkZQzgRERERkZUxhBMR\nERERWRlDOBERERGRlTGEExERERFZGUM4EREREZGV/f9uv1TXAUaBaQAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x81bc6a0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "import numpy as np\n",
    "t = np.linspace(-1, 1, 10)\n",
    "plt.plot(t, np.exp(t))\n",
    "t = np.linspace(0, 1, 2)\n",
    "plt.plot(t,t+1)\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "If the curve is relatively straight than the line formed by the slope will not be very far from the curve. Here the step size of 1 is rather large; you can see that the slope is very close to the line at, say, 0.1. But let's continue with a step size of 1 for a moment. We can see that at $t=1$ the estimated value of $y$ is 2. Now we can compute the value at $t=2$ by taking the slope of the curve at $t=1$ and adding it to our initial estimate. The slope is computed with $y'=y$, so the slope is 2."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAusAAAEtCAYAAACxoC4JAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3Xl8VPW9P/7XzCQzmUySSci+kQRIgIQtJOyCslbAUlrr\ngkuR3t+1tepV/Lb30Xqpdat6rbVVr9iqFWwRqhZFrSiChB2ELGxhSSAkZCfrJJlMJpOZz++PJDMM\nWciEzJyZyev5eOTB5JzPmXnH48FXPn7O+8iEEAJEREREROR25FIXQEREREREvWNYJyIiIiJyUwzr\nRERERERuimGdiIiIiMhNMawTEREREbkphnUiIiIiIjfFsE5ERERE5KYkDesdHR148sknMWrUKKjV\naowaNQq//e1vYTabpSyLiIiIiMgt+Ej54S+88AL++te/4u9//zsmTpyIEydO4IEHHoBKpcK6deuk\nLI2IiIiISHKShvVjx45hxYoVWL58OQBg5MiRuO2223D06FEpyyIiIiIicguSLoNZunQpdu/ejfPn\nzwMAzpw5g6ysLCxbtkzKsoiIiIiI3IKkM+u/+MUvUFZWhvHjx8PHxwcdHR1Yt24dfv7zn0tZFhER\nERGRW5A0rL/++uvYsGED/vnPfyItLQ15eXl47LHHkJiYiJ/+9KfWcTqdTsIqiYiIiIhujFarHdRx\nMiGEGOJaBiwyMhLr1q3Do48+at32+9//Hhs3bkRhYaF1G8M6EREREXmywYZ1SdesCyEgl9uXIJfL\nIeHvD0REREREbkPSZTArV67ESy+9hKSkJKSmpiIvLw9/+tOfsHr16j6PGexvJSS97OxsAEBmZqbE\nldCN4rn0HjyX3oPn0nvwXHqPoVgdImlY/9Of/oSgoCA8/PDDqK6uRnR0NB588EE89dRTUpZFRERE\nROQWJA3rGo0Gr7zyCl555RUpyyAiIiIickuSrlknIiIiIqK+MawTEREREbkphnUiIiIiIjfFsE5E\nRERE5KYY1omIiIiI3BTDOhERERGRm2JYJyIiIiJyUwzrRERERERuimGdiIiIiMhNMawTEREREbkp\nhnUiIiIiIjfFsE5ERERENIQ6zCaUVBUMyXsxrBMRERERDRGDUY+/fPYcXv/XuiF5P58heRciIiIi\nomFO11KPtz57FhW1xUP2ngzrREREREQ3qKq+FG9texYNzTVD+r4M60REREREN+Bi+Rm888ULaDW2\nDPl7M6wTEREREQ3SiQuH8f7Xr6LDbLLbPiFp2pC8P8M6EREREdEg7DvxJbbueRcCwm777AlLcMf8\nn6Gl+cZn2hnWiYiIiIgcYBEWfHHwH/g259Me+5bPugdLpt0BmUw2JJ8laevGxMREyOXyHl+33Xab\nlGUREREREfWqw2zCph2v9Qjqcpkc9yx6FN+bfueQBXVA4pn1nJwcmM1m6/cVFRXIyMjAXXfdJWFV\nREREREQ9GYyt+NuXL6Gg9KTddqWvH3667FdITcwY8s+UNKyHhobaff/OO+9Aq9XizjvvlKgiIiIi\nIqKedC31+Mtnz6L8mh7qgWotfvaD32Jk5BinfK7brFkXQuBvf/sb7rvvPqhUKqnLISIiIiIC0HcP\n9fDgGDy08imEaaOc9tluE9Z37tyJ4uJi/Od//qfUpRARERERAQCKKs7i7c9/36OHekJkMh5csQ6B\n/lqnfr5MCCGuP8z57rjjDpSWluLIkSM99ul0OuvrwsJCV5ZFRERERMPU5bpz2F+wDWZLh932uJBk\nzB37Q/gqlP0en5ycbH2t1Q4u1LvFzPqVK1fw+eefY/369VKXQkRERESEc5XHcLRoR4/tyZHpmDF6\nKeQy1zRVdIuwvnHjRvj5+WHVqlXXHZuZmemCisgZsrOzAfAcegOeS+/Bc+k9eC69B8+ltCzCgn8f\n3NRrUF82c5VDrRmvXh0yWJKHdSEE3n33Xdx9993w9/eXuhwiIiIiGqY6zCZs3vV/yD631267XCbH\nXQt/gVlpi1xek+Rhfc+ePbh48SI2b94sdSlERERENEwZjK1478v/xfnSE3bblT4q/HT5fzulh/pA\nSB7W58+fb/dgJCIiIiIiV9Lp6/GXz55Dec0lu+3O7qE+EJKHdSIiIiIiqVTXl+Gtbc+g/toe6tpo\n/HzlUwgPjpaosk4M60REREQ0LBVVnMXbX7yA1rZmu+2u6qE+EAzrRERERDTsnLhwBH//+lWYzO12\n29MSM/HAsl9C5esnUWX2GNaJiIiIaFjZd2I7tu55BwL2zwadPWEx7pj/cyjkCokq64lhnYiIiIiG\nBSEEvji0Cbuyt/bYt3TmKtzqQA91V2FYJyIiIiKv12E2YcuuN3Hs3B677XKZHHcteAizJiyWprDr\nYFgnIiIiIq/W1m7A3758Cecv9+yhvmbZr5CW5L5Pi2VYJyIiIiKvpdPX46+fPY+ymiK77QFqLX62\nYh0SopIlqmxgGNaJiIiIyCu5ew/1gWBYJyIiIiKvU1RxDm9/8fsePdRHRibjZyv+B4H+wRJV5hiG\ndSIiIiLyKicvHsH7X/XsoZ6amIE1y37lNj3UB4JhnYiIiIi8xv4T2/Gvve9CCIvd9llpi3HnAvfq\noT4QDOtERERE5PGEEPj3oU3Y2VsP9Rl349YZd7ldD/WBYFgnIiIiIo9m6jDhw93rcfRslt12d++h\nPhAM60RERETksep01Xhv+8sovXLRbrsn9FAfCIZ1IiIiIvJIJy9+hw92vg6DUW+33VN6qA8EwzoR\nEREReRSzuQNfHPoHdud+1mOfJ/VQHwiGdSIiIiLyGA3Ntdj41Su4VHmux75Jo2finsWPwF8VIEFl\nzsGwTkREREQe4WxJHv6+40/QG5rstsvlCvxgzmrckv59j+z40h+51AVUVlZi9erViIiIgFqtRlpa\nGvbt2yd1WURERETkJiwWM748vBl/2fZsj6AeHBCKx378e8yfusLrgjog8cx6Y2Mj5syZg3nz5mH7\n9u0IDw9HUVERIiIipCyLiIiIiNxEk74Rf//6jygoO9Vj3/iEqbj/e48jQB0kQWWuIWlYf/nllxEb\nG4uNGzdatyUkJEhXEBERERG5jQvl+dj41Sto0jfYbZfJ5Fg+cxUWTbsdcpnkC0WcStKfbtu2bZg+\nfTruuusuREZGIj09HW+++aaUJRERERGRxCzCgp3HtuKNrb/tEdQD/YPx8A+fwZLpd3h9UAcknlkv\nKirC+vXr8cQTT+DJJ59EXl4eHn30UQDAww8/LGVpRERERCQBvaEJ//jmNZwpzumxb0zcBDxw6/9D\nkCZEgsqkIRNCCKk+XKlUYvr06Thw4IB12//8z//g008/xZkzZ6zbdDqd9XVhYaFLayQiIiIi16hp\nLse+81uhNzb12Dcxbg4mj7zZo2bTk5NtD2XSarWDeg9JZ9ZjYmKQmppqt23cuHG4fPmyRBURERER\nkasJIXCu8hhyinfBIix2+1Q+atyU8gPEhoyRqDppSRrW58yZg3Pn7BvaFxQUIDExsc9jMjMznVwV\nOUt2djYAnkNvwHPpPXguvQfPpfcYbufSYNRj867/w4lLh3vsS4weizVLf4mQwHAJKrtxV68OGSxJ\nw/ratWsxe/ZsvPDCC7jzzjuRl5eHN954Ay+++KKUZRERERGRC5TVFGHDl39Aja6yx7756SuwYs5P\noFAM72d4SvrTZ2ZmYtu2bXjyySfx3HPPISEhAc8//zweeughKcsiIiIiIicSQuBw/k78a8876DCb\n7Paplf64Z/F/YfKYmRJV514k/1Vl2bJlWLZsmdRlEBEREZELGNsN+DDrL8g+t7fHvrjwUViz7FcI\nD46WoDL3JHlYJyIiIqLhobKuFO9t/19U15f12Ddn4q340byfwtdHKUFl7othnYiIiIic7ti5Pfjw\n27fQ3mG026709cPdCx5C5ribJarMvTGsExEREZHTmDrasXXvuzh0+pse+6JDR2LNsl8hakS8BJV5\nBoZ1IiIiInKKmsZKvLf9ZZTXXOqxb/r4+bhj/s+g8vWToDLPwbBOREREREPueOEhbN71f2hrb7Xb\n7qtQ4sfzH8TM1IWQyWQSVec5GNaJiIiIaMh0mE347MD72Hv83z32hQfH4KfLfoXY8CQJKvNMDOtE\nRERENCTqm2qw4as/oKSqoMe+KcmzsWrhI1Cr/CWozHMxrBMRERHRDcu/lI1/fPMaWtua7bYr5D74\n4bw1mDtpGZe9DALDOhERERENmtlixvbDm7Eze2uPfSMCw7Fm2a+QEJUiQWXegWGdiIiIiAZFp6/H\n+1/9ERfK83vsS0vKxH1LHoPGL1CCyrwHwzoREREROayg9CTe/+qPaDbo7LbLZXLcNvs+LMhYCblM\nLlF13oNhnYiIiIgGrN1kxFffbcHu3M8hhMVun1YzAg8s/X8YHZsmUXXeh2GdiIiIiAaksOw0/rnr\nTdToKnvsGxs/GT+5dS0C/YMlqMx7MawTERERUb8MRj0+P/B3HDy9o8c+GWS4dcZd+N70OyCXKySo\nzrsxrBMRERFRn04XHcOHWX+BrqWux76QgDDcs/hRjB05WYLKhgeGdSIiIiLqoblVh0/2voucgv29\n7p87aRm+P+d++CnVLq5seGFYJyIiIiIrIQRyzu/D1r3vQn/NA44AICI4BqsWPcybSF2EYZ2IiIiI\nAAANzbX4KOsvyL+U3WOfXCbHwowf4tYZd8HXRylBdcMTwzoRERHRMGcRFhw69Q0+O/g+jO2GHvtj\nw5Nwz6JHER8xSoLqhjdJw/rTTz+NZ5991m5bVFQUKioqJKqIiIiIaHi50lCBLd++iYu9PIXUR+GL\npTPuxoKpP4BCwTleKUj+T33cuHHYs2eP9XuFgi1/iIiIiJzNbDEjK/czfHXknzCZ23vsHxUzHqsW\nPYLIkFgJqqNukod1hUKBiIgIqcsgIiIiGjbKay7hg11voOxKUY99Kl8/rJjzE8yZdCvkMrkE1dHV\nJA/rRUVFiI2NhUqlwowZM/DCCy8gKSlJ6rKIiIiIvI6pw4Rvjn2EndmfwGIx99g/PmEq7lrwEEYE\nhUtQHfVGJoQQUn34119/jZaWFowbNw7V1dV4/vnnce7cOeTn52PEiBHWcTqdzvq6sLBQilKJiIiI\nPNqVplIcvvBv6Aw9H26k9FFjetISJIVPgEwmk6A675ScnGx9rdVqB/Uekob1a7W2tiIpKQm//vWv\nsXbtWut2hnUiIiKiwTGZ25FXkoVzlcd63Z8YloppSd+DWqlxcWXebyjCuuTLYK7m7++PtLQ0XLhw\noc8xmZmZLqyIhlJ2dmfPVp5Dz8dz6T14Lr0Hz6X3GMpzebYkDx9+uwH1zTU99gVpQnDn/J9j0ugZ\nN/w51LurJ5wHy63CeltbG86ePYsFCxZIXQoRERGRx9K3NePTfe/h6NmsXvfPnrAYK25aDX9VgIsr\nI0dJGtZ/+ctfYsWKFYiPj8eVK1fw3HPPwWAwYPXq1VKWRUREROSxjhcewsd73kZza2OPfaHaSKxa\n+DBS4idJUBkNhqRhvby8HKtWrUJtbS3Cw8Mxa9YsHDlyBPHx8VKWRURERORxdPp6fJz1Nk5ePNJj\nn0wmx/z072PZzHug9FVJUB0NlqRhfcuWLVJ+PBEREZHHE0LgyJlvsW3/BhiM+h77o0NH4p5FjyAh\nKkWC6uhGudWadSIiIiIauFpdFT789i2cLz3RY59C7oMl0+/A4swfwUfhK0F1NBQY1omIiIg8jMVi\nxt4TX+LLQx+gvcPYY39CVAruWfQIokNHSlAdDSWGdSIiIiIPUllXii27/g/FVed77FP6qLB89r24\nefJyyOUKCaqjocawTkREROQBOswm7Mz+BN8c/RhmS0eP/Snxk3D3wl8gTBslQXXkLAzrRERERG6u\nqOIcPtr9FirqSnrsUyv9sXLeTzEzdSFkMpkE1ZEzMawTERERuamaxkp8fvDvOHHhcK/7J42egTtu\n+Rm0ASNcXBm5CsM6ERERkZtpM7Vi6953ceDk170ueQlUa/Hj+T/DlDGzOJvu5RjWiYiIiNyEqaMd\np8sO41TZAZjMPbu8AMD08fPxw7lroFEHubg6kgLDOhEREZHELMKCvIID+OLgP1DfXNPrmJGRyVg5\n9wGMiU1zcXUkJYZ1IiIiIgldKM/Htv0bcbm6sNf9IwLD8f059yM95SbIZXIXV0dSY1gnIiIikkB1\nQzk+P/A+ThUd7XW/WumPJdPvxLzJy+Dro3RxdeQuGNaJiIiIXKi5tRFfffchDp3aAYuw9Ngvl8kx\nNioTP/n+I1yXTgzrRERERK7Q3mHEnrwvsDN7K4zthl7HTBkzG4lBUxCkHsGgTgAY1omIiIicyiIs\nyD63F18e+gANLbW9jkmMGouVc9dgVMw4ZGdnu7hCcmcM60REREROUlB6Etv2b0RZTVGv+0O1kVgx\nZzX7pVOfGNaJiIiIhlhlXSk+P/A+8ot7nyX3VwXgezPuxE0Tl8LXx9fF1ZEnYVgnIiIiGiJN+gZs\nP7IFh/N3QfRy86hC4YObJy/Hkml3wN8vQIIKydMwrBMRERHdIKOpDVm5n2FXzqdoN7X1OmZqylx8\nf/Z9CNVGurg68mQM60RERESDZLGY8d3ZLGw/vBk6fX2vY0bFjMfKuWuQGJXi4urIG7jNY7BefPFF\nyOVyPProo1KXQkRERHRdZ0vy8PLmJ7Bl1//1GtTDg2Pw/932azz24xcY1GnQBjyzvmPHDixZssQp\ndyofOXIE77zzDiZNmsQ7oYmIiMitldcU47MDG3Hu8vFe92v8ArF05t2YM+F7UCi4iIFuzID/DVq6\ndCmio6OxatUq3H///Zg8efKQFKDT6XDfffdhw4YNePrpp4fkPYmIiIiGmq6lHl8e/gDfndkNAdFj\nv4/CF7ekr8DizB9BrdJIUCF5owGH9W3btmHTpk1488038eqrr2LChAm4//77ce+99yImJmbQBTz4\n4IO44447cPPNN0OInv/iExEREUmprd2Ab3M+RVbuZ2jvMPY6JnPczbht1r0YERTh4urI3Zg6BI6e\nAb7NBh67/cbfTyYcTMhNTU3417/+hU2bNmHfvn0AgAULFuD+++/H7bffDn9//wG/1zvvvIO3334b\nR44cgUKhwPz58zFx4kS8/vrrduN0Op31dWFhoSPlEhEREQ2KRVhwofo4jl/eizaTvtcxkUEJyExa\nhNCAaBdXR+7CYgEKK9Q4VhCE7IJA5F0MgKFdAQBo2N5kHafVagf1/g6H9auVlZVh8+bN2Lx5M06e\nPAmNRoOVK1di9erVWLRoUb/Hnj9/HnPnzsWBAweQktJ508Utt9yCiRMn4o033rAby7BOREREriKE\nQGl9AfJKsqAz1PY6RqsOxdTEhYgLSeb9dsOMEMDlKyocKwxEdkEQsgsD0dTa+2KVoQjrN3TXg8Vi\ngclkgtHY+b+E/Pz8sGvXLnzwwQeYNGkSNm3ahAkTJvR67OHDh1FbW4u0tDTrNrPZjP379+Ovf/0r\n9Ho9fH17PtErMzPzRkomCWVndz7FjefQ8/Fceg+eS+/Bc3njzBYzcgv2Y1f2J6isu9zrmEC1Fktn\nrsKsCYuhkCucUgfPpfspuyLwbTaQlQN8mwOU17jusx0O642Njfjoo4+wadMmHDx4EL6+vli+fDle\neuklLF++HDKZDF988QUef/xxPPDAA9Z/4a71wx/+ENOnT7d+L4TAmjVrkJKSgieffLLXoE5EREQ0\n1No7jPgu/1t8m7sN9U1Xeh3j66PEgqk/wMKMH8FPqXZxheRqtY0Ce/I6153vzgEKSx07PioUWDB1\naGoZcFj/9NNPsWnTJmzfvh1GoxHTpk3D66+/jlWrVmHEiBF2Y1euXIna2lo89NBDfb6fVqvt8b8D\n/P39ERISgtTUVAd/DCIiIiLHGIx6HDj5NfbkfY5mg67XMTLIMH38fCybdQ9CAsNcXCG5SkurwL7j\nnbPmWTnAcQdXXQcHArekAwsyOr/GJwIymQy63v+1csiAw/rtt9+O2NhYPP7441i9ejXGjRvX7/iJ\nEyfivvvuc6gYmUzGdV9ERETkVM2tjdiT9wX2n/wKbe2tvY6RyeSYmjwHi6fdjpiwRNcWSE5nbBc4\nkm+bOT96BugwD/x4tQq4aRKwIBNYmAGkpwAKhXMyrEMPRVq0aNGAw/SMGTMwY8YMh4rJyspyaDwR\nERHRQNU1VWN3zmc4kr8LJnN7r2MUCh/MHL8QCzJWIjyYHV68hdkskFvQGcx3ZwMHTgKG3rtw9spH\nAcxIs82cz0wDVErXTDAPOKwvXrzYmXUQEREROUVl3WXsyv4EOef3wSIsvY5R+fphzsRbMT99BbQB\nI3odQ55DCIGzxbaZ8z15gK5l4MfLZMCUZGB+RufM+U2TgECNNKs/+AxcIiIi8krFVQXYeexfOFV0\ntM8xGr9A3DzlNsybvBz+fgEurI6GWnGlrWPL7lygqs6x41PiO5e1LMgA5k8FQrXusTSbYZ2IiIi8\nhhAC5y+fwM7srSgsO9XnuOCAUCyYuhKzJiyGytfPhRXSUKmuF8jKhTWgF1U4dnxseOeseXdAj4tw\nj3B+LYZ1IiIi8ngWYcHJC0ewM3srSq9c7HNcREgsFmX8CJnj5sFHwTbRnkTXIrA3r2vdeQ5wusix\n40O1nTPm3evOk+PhEY1NGNaJiIjIY3WYTcg+tw+7cj7BlYbyPsfFR4zG4szbMWn0DMid9DAjGloG\no8ChU7Z159nnAEvvtxz0SqMGbp5iW3c+aQwgl7t/OL8WwzoRERF5HKOpDYdP70RW7mdoaKntc1xy\n3EQszrwdY0dO9ohZ1OGso0Pg2DnbspZDpwFj7017eqX0BWZNsM2cT08FfH08/5wzrBMREZHHaG1r\nwb4TX2LviS+hNzT1OW7iqOlYPO3HSIxKcWF15AiLReDURduyln3Hgebe2973Si4HMsbaZs7nTAL8\n/Tw/nF+LYZ2IiIjcnk5fj6zcz3Hw1Ncwmtp6HSOXyZExdh4WZf4I0aEjXVwhXY8QAhfLYdexpbbR\nsfdITbTdEHrzFCAkyPvC+bUY1omIiMht1TRW4tucT/Hd2d0wmzt6HeOrUGJm2iIsyPgBQoMiXVwh\n9aeiRmB3bueDiHbnAJerHTs+Icr2lNAFGUBUqPeH82sxrBMREZHbKa8pxs7srcgrPAjRx4OM/JT+\nmDtpKW6e8n0EaYJdXCH1pr5JYE+ubWnLuRLHjo8Isa05X5ABjIodfuH8WgzrRERE5DYulp/BruxP\nkF+c3eeYQLUWt6SvwE2TboVapXFhdXQtvUHgwElbx5a8AkCIgR8fpAFuSe9ad54JpCV5RjtFV2JY\nJyIiIklZLGacLcnDruxPcLHiTJ/jRgSGY2HGDzEjbSGUPioXVkjd2k0C3+XDurTlSD5g6n11Uq/8\nlJ03gnbPnGeMBXy8oGOLMzGsExERkSR0+nocyf8Wh09/g/rmmj7HRY2Ix6LMHyEjZS4UCkYXVzKb\nBU5csM2c7z8BtPZ+f2+vFApg+nhbx5ZZEwA/FcO5I/hvPBEREbmMRVhQWHoKB059jVNFR2GxmPsc\nmxCVgiXTfoy0pEzIZXIXVjl8CSFw/rKtY0tWLtDQ7Nh7TBpjmzmfNwUI0jCc3wiGdSIiInK65lYd\nvjvzLQ6d/ga1uqp+x44dORmLM3+M5LgJXL/sAperhPWG0N05QEXfz5jq1Zg428z5/KlAeAjP2VBi\nWCciIiKnEELgQnk+Dp7agRMXD/fZehHobL+YnjIH8yYvx8jIMS6scvipaRDIuqpjy4Uyx46PDu28\nGXR+1+x5QhTDuTMxrBMREdGQ0rc14+iZLBw6/Q2qG/pPgpEhcZg9cQmmj58PjV+giyocXpr1AvtO\n2Nadn7zg2PHBgcD89K5+55nA2JHs2OJKDOtERER0w4QQuFR5DgdP7UBe4UF0mE19jlUofDBl9CzM\nmXQrRsekMvgNsTajwOHTtpnzo2cBc9+3BvTg7wfMnWxbdz4lGVAoeI6kwrBOREREg2Yw6nHs3B4c\nPLUDlXWX+x0bro3umkVfgEB/rYsq9H4dHQK5BbaZ84Mngbb2gR/v6wPMTLOtO5+RBih9Gc7dhaRh\n/c0338Tbb7+N4uJiAEBaWhrWrVuHZcuWSVkWERER9UMIgcvVF3Dw1NfILTiA9g5jn2PlcgUmjZqB\nORO/h+T4iezqMgSEEMi/ZOvYsicPaNIP/HiZDEhPsc2cz50MaNQM5+5K0rAeHx+Pl19+GcnJybBY\nLNi4cSNWrlyJY8eOYfLkyVKWRkRERNdoazcg5/w+HDy1A2U1Rf2OHREUgdkTlmBm6kIEaUJcVKH3\nKiq379hypcGx48cl2GbOb5kKjAhiOPcUkob1FStW2H3//PPP46233sLRo0cZ1omIiNxE6ZUiHDq1\nA9nn98Jo6vuJOHKZHBNGTcPsCd/DuIQpnEW/AbVNPtj8jS2gF1c6dnx8ZGcwX5DZ2U4xNpzh3FO5\nzZp1s9mMjz/+GG1tbZg3b57U5RAREQ1rRlMbcgsO4NCpHSipLux3bHBAKGZNWIJZaYsQHBDqogq9\nS2OzwN7jnUtbvjyQiktVaoeODwvuDOULMjo7toyOZccWbyETQggpCzh16hRmzZoFo9EItVqNLVu2\nYPny5XZjdDqd9XVhYf9/YRAREdHgNeivoKA6F0VXTsFk7nstOgDEhoxBStRUxIaM4Sy6g9raZThR\nFIBjBUHILgzEuVJ/WMTAw7W/yoz00c2YltKMzJRmjIk2QM5T4HaSk5Otr7Xawd1ULfnM+rhx43Dy\n5EnodDp8/PHHuPvuu5GVlYXMzEypSyMiIhoWzJYOlNSexfmqHNQ0998XXe0bgDGRU5AcOQUBfsEu\nqtDzdZiB/BINsgsDcawgCKcuaWAyDzxd+yosmJSkR2ZKE6alNCN1pB4+CicWTG5D8pn1ay1evBhx\ncXHYsGGDddvVM+uD/a2EpJednQ0A/EXMC/Bceg+eS+8xmHNZ3VCOg6d24OjZLLS2Nfc7dtzIKZgz\n8VZMSMqEQiH5XJ/bs1gETl4Avs3p7Niy7zjQYhj48XKZQOZ4mbVjy5xJgFrFZS2eZigyrNtdbWaz\nGRaLReqbzqTdAAAgAElEQVQyiIiIvJK+rRknLhxB9rk9uFCe3+/YALUWM9MWYfaExQjTRrmoQs8k\nhMCFMluv86xcoE53/eOuNmFUZ8eWBO0FpI9uwfx56c4pljyKpGH917/+NW677TbExcWhubkZmzdv\nxt69e/H1119LWRYREZFXaWs34FTRd8g9fwBnL+fBYun/cZbJcRMxZ+L3MGn0DPgofF1UpecprxHW\nXuff5gBlVxw7PinG1ut8QQYQOaJz5jw728GUT15N0rBeXV2N++67D1VVVdBqtZg8eTK+/vprLF68\nWMqyiIiIPF57hxFnLuUgt+AA8i9lw2Tu/5GW/n6BmJm6ALMnLEFESKyLqvQsdTqBPbm2pS3n+39g\naw+RI+zDeVIMl7XQ9Uka1q9el05EREQ3xmIxI/9SNnILDuBk0Xcwtl9/kfTomFTMnvg9TBkzC74+\nShdU6TlaWgX2n7A9iOh4IeDInX7aAOCWdFs4T01iO0VynNutWSciIqKBs1jMuFB+BocvfImSunNo\n77h+QI8MicPUsXMxNeUmRHIW3crYLvDdGdu68+/yO7u4DJRaBdw0qetJoZlAejLg48NwTjeGYZ2I\niMjDCCFQXFWA3IL9yCs4iKbW6z97fkRQBKamzEVGyk2ICUvkDC8As1kgr8C2rGX/CcDQf2t5OwoF\nMCPVNnM+awKgUvKfKw0thnUiIiIPIIRAee0l5J4/gNyC/ahvrrnuMUGaEKQnz0HG2HlIiEwe9gFd\nCIGzxbZlLXvygMb+O1b2MCW5a+Y8A5g7GQjUDO9/puR8DOtERERurLqhHLnn9yO34ACqG/p/YBHQ\neaPolDGzkDF2LkbHpEIuH95PzimpsnVs2Z0DVNY5dnxyvG3mfP5UICyY4Zxci2GdiIjIzdQ3XUFu\nwQHkFOxHec2l645XKdWI1Y5BUngablvw42H90KIrDcLaSnF3NlBU4djxMWGd6827A3p8JMM5SWv4\nXs1ERERupEnfgLzCg8gp2I/iyvPXHe+rUCJtVCYyUuZifOJUnDx+CgCGXVBv0gvszbMtbTl10bHj\nRwR1zpgvyAQWTAVSRrJjC7mX4XVFExERuZHOp4keRu75/Sgsz4cQ/T/BWyH3wbiEKZiaMhcTR02H\nn1LtokrdR5tR4NDpro4t2UD2ecDsQMcWjRqYN9nWsWXyGEAuZzgn98WwTkRE5EKOPk1UJpMjOW4C\npqbMxeQxM6HxC3RRpe6ho0Mg+5ytY8vBU4Cx/+c72fH16ezS0r2sZXoqoPRlOCfPwbBORETkZMZ2\nA86W5A34aaIAkBQ9Dhlj52LKmNkI0oS4oEr3YLEInC6yLWvZmwc0tw78eJkMyBhr69hy02TA34/h\nnDwXwzoREZET1OqqkH8pG/nFOSgsOwWzueO6x8RFjEJGylykJ8/BiKAIF1QpPSEEisptM+e7c4Ca\nRsfeY3yibeb8lnQgJIjhnLwHwzoREdEQMJs7UFR5FvmXcpBfnI3q+uu3WQSG59NEK2sFdl/VseVy\ntWPHj4zsvCF0YVc7xZhwhnPyXgzrREREg9TcqsPZklzkX8rGuZI8GNoHtl7D9jTRuYgJS/D67iMN\nTQJ78jpvCs3KBc4WO3Z8eHBXn/OupS2jYtmxhYYPhnUiIqIB6n6KaP6lHORfykZJVQEExICODdVG\nYmLSdEwdO9frnyaqNwgcPGmbOc8tAMTA/jEBAAL9gZvTOwP6wkwgLYkdW2j4YlgnIiLqh9HUhoLS\nk9b157qWgT0CUy5XYFTMeExIykRaYiYiQmK9NqC3mwSOnrHdFHr4NGC6/hJ9K5USmDPRtu48cxzg\n4+Od/6yIHMWwTkREdI06XTXyi7ORf6nz5tAOs2lAxwWotUhNnIq0pEyMGzkFapXGyZVKw2IROHGh\nq9d5DrD/BKA3DPx4hQKYNs7W63zWBECtYjgn6g3DOhERDXtmixmXKs8h/9Ix5F/KQVV96YCPjQsf\nhbSkDKQlTcPIiNGQyxVOrFQaQggUXLZ1bMnKBeqbHHuPiaNtM+fzpgDaAIZzooFgWCciomGpxdBk\nvTn0bEkeDEb9gI5T+qgwduRkpCVlIjUxA8EBoU6uVBql1cK6rGV3DlBe49jxo2NtN4TOzwAiQhjO\niQaDYZ2IiIYFIQQqaouRfykbp4uzUVLpwM2hQZFIS8pEWlImxsSmwddH6eRqXa+2USAr1xbOCwf+\nPxcAAFGhncF8QWbn7HlCFMM50VCQNKy/+OKL+OSTT1BQUACVSoWZM2fixRdfRFpampRlERGRl2g3\nGXG+9ATOdPU+bxzozaEyOUbFjLcG9MiQOK+7ObRZL7D/hK1jy4kLjh0fHNj5AKLuji3jEthOkcgZ\nJA3re/fuxSOPPIJp06bBYrHgqaeewqJFi3DmzBmEhAyfRysTEdHQsAgLKmtLUFB2CudLjqOw7DRM\n5vYBHavxC0RqYkbnzaEJU+CvCnByta5lbBc4fNrW6/zoGaDDPPDj1Spg7uSumfOpQHoKoFAwnBM5\nm6Rh/euvv7b7/h//+Ae0Wi0OHTqE5cuXS1QVERF5is5wfhkXyk+jsOwULpTlo9XYMuDjY8MSkZY0\nDWlJGUiITPaqm0PNZoGc813LWrKBAyeBtoH93gIA8FEAM9NsHVtmpAIqJcM5kau51Zr1pqYmWCwW\nzqoTEVGvLMKCqrrSrmB+GhfK86Fvax7w8b4+SoyN7745dCpCAsOdWK1rCQEUVfnh0McCWTnAnjxA\nN/DfWyCTAVOSbR1b5k4GAvwZzomk5lZh/bHHHkN6ejpmzZoldSlEROQGhBCoqi9FYVnXzHl5PvQG\nx3oGjgiKQFpiJtKSMjAmbgKUPionVet8pg6By1VAUQVwqRK4VNH1VQmcL5mMplbH/rM+dqStY8st\nU4FQLcM5kbuRCeHIA4Cd54knnsBHH32EAwcOIDEx0W6fTqezvi4sLHRxZURE5CpCCOgMdajSFaNa\nV4LqphK0mVodeg+lwg+R2pGI1CYgJngUtOowj7nxUQigrskHFfUqlNeqUFGvREWdChV1KpTXKXGl\nUQmLGPzPEhHcjmkpTZiW0oyM5GZEBg/sYU9ENDjJycnW11qtdlDv4RYz62vXrsVHH32ErKysHkGd\niIi8lxACTYY6VOlKUGUN5wPrd97NV6FCZNBIRGkTEalNQIgmAnKZ3EkV37gWg7wrfNuH8Yo6JSrq\nVTCahq52raYDmclNyExuxrSUZsSHG+Ehv7cQURfJZ9Yfe+wxfPzxx8jKysLYsWN7HXP1zPpgfysh\n6WVnZwMAMjMzJa6EbhTPpfdw9bkUQqCmsaJrWctpXCg7jabWBofew0/pj9GxqUiOm4DkuImIDUt0\nqxtD200CJd1LVXpZruLokz8d4a8y45apCmvHlkljALmc6dzT8O9Y7zEUGVbSmfWHH34YmzZtwrZt\n26DValFVVQUACAwMhEajkbI0IiIaAp3hvLKzW0vpKRSWn0aT3rFwrlKqMTomFclxE5EcNwGx4UlQ\nSBjOLRaByrrO8N29dry468+iis4nfTpzGiw6FBgVCyRFA4nRQFIMMCoGaK45ifBgE2ZMZ8Aj8iaS\nhvW33noLMpkMCxcutNv+9NNP46mnnpKoKiIiGiwhBGp1VdZZ88Ly09AN8EFE3VS+fhgdk4oxcROQ\nHDcBcRGjXR7OG5uF3cx4UQVQ3DVDXlwFGB1ogegobUBnEE+KBpJiba9HxQIJUYBa1ftMeXY2158T\neSNJw7rFYpHy44mI6AZZLGZU1pWipLoAF8rzcaHs9ICfEtpN6euHUTHjrTPn8eGjoFA49z9Pbcar\nlqpcs0zlUiXQOPBukA5T+gKJUZ0z4onRnbPiSTFdgTwGCAnishUisnGLG0yJiMgzNDTXoqSqACXV\nBSiuKkTplYtoN7U59B5KHxVGxYzvmjmfiJERo4c8nJvNAhW1XbPi5V1LVSptS1cqaof04+zIZEBM\nWFcIjwYSY2yvk2I693EdORENFMM6ERH1ythuwOUrF1BcVdgZ0KsKoNPXO/w+vj5KjIoej+S4CRgT\nNxEjI0fDR+F7Q7UJIVDfZD8bXlTeFci7grmp44Y+ol8hgba14t3rxrtnxhOi+KRPIho6DOtERASL\nxYyq+lK7YF5ZXwohHF+u6KtQIilmnLVby8jIMYMK5wajQHFl311Vmhzr8OgQP2VXCO9lZjwpGggO\nZBgnItdgWCciGoYaW+pQUlWInOJ9qG0ux4dHX4HRweUs3QLVWiREpSAhKhljYtMwMjIFvj7XD+dm\ns0BZzVVdVbpu4uxeR17l2NJ3h8hkQFzEVUtVom0dVpKigahQLlUhIvfAsE5E5OWMpjZcrr5gnTEv\nri50uENLN1+FEnERo5AQlYLEroA+IjCi1yeECiFQp0PPripdr0uqgA7zjf50fQvV2pamJF61TCUp\nBhgZCSh9GcaJyP0xrBMReZHO5SxldjeBVtZdHtRyFgCICIntDOWRyUiISkFsWKLdzaB6g8CZS0BR\nhejZVaUCaDEM1U/Wk1plW5pybVeVpBggSMMwTkSej2GdiMiD6fT1nbPlXWvNL1cXDno5i0YdhMTI\nztnyhK6ArvTRoPRKZ/j+5rvumzeFdenKFceeb+QQuRyIj+h9ZjwpGogcgV5n9ImIvAnDOhGRBxBC\noKG5BuW1xSivuYTy2mJcripEQ8vgehD6KHwRFz4KftDCVz4K8SMXo143AsWVwLEztq4ql6sBsxOX\nqoQH9+yq0r2OPD4S8PVhGCei4Y1hnYjIzbR3GFFZexnltcWoqL2E8ppiVNQWw9DeOrj3M/nBRzEB\nPoqJMJvHQN8agyuNQdh5RI6L5Wa0tTvv6aAate2mzd66qgT4M4wTEfWHYZ2ISCJCCOj09daZ8ora\nYpTXFONKY4VDa8zNFgVaWsPRpI+AriUSbcZ4mDpGoVkfhZrGIDQ099eZ5caCukLRebOmdWb86q4q\nMZ0z51yqQkQ0eAzrREQuYOowobqhFOU1xZ3BvCug69uu/1x7IYDWthA06SPQpI/s/LMlqvPP1ki0\ntIZBCLnTao8c0XdXlbhwwIdLVYiInIZhnYhoiDW3NlpDeXntJVTUFKOqoQwWS9+Lv9tNajTpI6Fr\nibQFcn3n62Z9BDrMKqfVq1GZMTpeYbc8Jemq/uMaNcM4EZFUGNaJiAbJbO5AdUP5NWvLS9DU2rNF\nitnsg+bWaPtZcX0kdF2B3Nge6LQ6fRRAQlTvM+O66uPQasyYNi3TaZ9PRESDx7BORDQA+rbmrtny\nzpny8tpiVNZfhtncAQAQQga9IQRN+ig06SdZZ8W7Z8lbWkMBOG+pSnRo311VYsMBhaL32fFsvRNb\nvRAR0Q1jWCci6mIRFjQ016C6vhzVDWWori9DdUM5rtSXodmgg7Hd3zYb3jIRzfpFXTPjEWjWR8Bs\nUTqttiDNVZ1UYm0dVrofCKRWcakKEZE3YlgnomGn3WTElcZyayi/0lCO6voyVNTWoL5Je9WMeDSa\n9JPR1LWO3GgKcFpNSl8gMcoWvpOuaXMYEsiuKkREwxHDOhF5JSEEmlt19mG8vgwXS/W4fMWnM4xb\nb+achCZ9BPSGMKfVI5MBMWF9d1WJCQPkcoZxIiKyx7BORB7NbO5AbVM1quvLUFVfjksVNTh/2Yii\nCoHaRu1VHVYmoLk1HBZLfz3Hb0xI4DXdVK4K5AlRgErJME5ERI5hWCcij2Aw6nGloRwl1ZU4fbGx\nM5BXAhU1ftC1hHfNkKeh3aRxWg0qZf9P4wwOZBgnIqKhJXlY37dvH1555RXk5uaioqICGzZswOrV\nq6Uui4gkYOowoabxCs5cqkf+peauGXKgvEaFOl0wmvSRaG1Ldtrny2QCcREy21KVa9aOR4VyqQoR\nEbmW5GFdr9dj0qRJWL16NX7yk5/wBioiL9a5jrwJhWVXcPpiM86XtqGoXKD0ii+q6jSobwrpWqoS\n47QaQgLNGBUjw6hYuW3JSjQwKhYYGSmD0pd/BxERkfuQPKwvXboUS5cuBQA88MAD0hZDRDfM1GFC\nWU0NTl1sxNliPQpLO1BSrUBFrR9qGrTQtYTD1DHGaZ+v8jUjLsKE0bFyJMf7IilGZrdcJUgj+V97\nREREA8b/ahGRQ4QQaDO14mJlG7LLTqKga6lK2RUlqus1qG8KhcEYDSDaKZ8vk1kQHtyKuAgTxsTK\nMS5BjeR4JUZ19R6PHKGATMa/2oiIyDvwv2hE1EOH2YSG5lrU6qpQq6tCna4adV2va5uqYWw34L3P\n/4bWthFO+fwAdQsiR7QgLqIDY+LkGJ/gjwmjAjEmToH4SDl8fQKd8rlERETuxuPCenZ2ttQl0A3i\nOZSe2dIBvbEJrcYm6NuboDfq0GLUoaWtAc1tjWg1NkFA9PseQZorgw7rvj5GhAY1IDy4GdEhbYgL\n70BiBJAUqUB8uBn+Kkuvx9VXdn7R0ON16T14Lr0Hz6XnS06+8aYIHhfWiah/FmGBob0ZemOT9au1\nvemqcK5Dm6n1hj8nSFONqrpxve6TycwIDmhAmFaHqJBWxISaMDLcglFRCiRGyDAi0Ize7yXvPaQT\nERENVx4X1jMzM6UugQape4aA53DwhBBoMejQ0FyLxpZaNDTXXvO6Bk36BliEc0Ovj9wX8RFXYOoo\nR2x4GxKjBZLjfJCaqMGkMcFIivaFj084gHCn1kE3jtel9+C59B48l95Dp9Pd8HtIHtb1ej0KCwsB\nABaLBSUlJTh+/DhCQ0MRHx8vcXVErmUw6vsM4o3NtWhoqUWH2eSSWrSaEQjTRiFUG4lQbRTCtJEI\nDYpCmDYK588U4p5ZMmRmxrmkFiIiouFK8rB+7NgxLFiwAAAgk8nwu9/9Dr/73e/wwAMP4L333pO4\nOqKhYREW6A1NaNI3oKm1EU36+quCeB0aW2pR31wDY7vBJfXIZHJoNSEIDgxDSEAYQgLDEBIYbg3n\nI4IioPRR9XM8e5ETERG5guRh/ZZbboHFwnWq5JnM5o6u8N2AptYGNOkboNPXd37f9aVrbUBzayMs\nFrPL6gpQaxEcGNoVxMMREhiG4K5QHhwQBm3ACCjkCpfVQ0RERIMjeVgnckftJqMtdLc29Ajf3a/1\nhut3TRlqfkr/q8J3KEICw+2CeHBgaL+z4kREROQ5GNZp2BBCwNCut4VuawCv7xHC29pvvFvKYPgo\nfBESENa5PCUwrMeMeEhgGNQqjSS1ERERkesxrJNHa+8woqW1CS0GXddXE5pbba9bDDq0tHa+btI3\nwGRul6xWtdIfQZoRCNKEIEgTAq1mRI9AHqDWcj04ERERWTGsk1tpNxntgnZza8/QbQ3lBh3aTW1S\nl4wAtdYWwP1DrK+DNCOg1di+59IUIiIichTDOjnV1eG7rP4CjB166HLK0GJo7JoR7wzd3WPcIXwD\ngFyuQJB/sHUm3D6Ed86KB2lCEKjWQqHgZURERETOwZRBA2I2d6DV2ILWthbo21rQ2tYMfVszWtta\n0Gps7rFN39bcd/gudH393Xx9lF3he8Q14btzJjyoK5Rr1IGQy+TSFUpEREQEhvVhp8NsQmubHq1G\nW6juDNmdQdwucHeNaW1rkeyGy+uRyxUIUAchQK1FoFrb+dpfi4Du11dtC/IPhp/Sn2vCiYiIyGMw\nrHsgi7DA2G6AwaiHwdgKQ7veGqptIbwF+rYm2/auEG50k2UmfZHLFbbQ3Uv4Drw6iPtroVZqGL6J\niIjIazGsS8DUYYLBqEdbu94ucBuMrV3fd+5rNerR1r2tvfPPNqMebe0Gl/f2HiyF3KcreAfB0iGD\nn48/RsYldc6E+18dyrUI8A9i+CYiIiK6CsO6gywWM4ymNmuwtobq9lZb8O4K3IauMH5t4O4wm6T+\nMRwmgwxqvwBoVAHw9wuAxi8Q/n6B8Pez/17jF9C5XRXQI3xnZ2cDADIzM6X8UYiIiIg8xrAI6x1m\nE4ztBrSZDGgzGmA0GdDW3vWnsRVtJkPn/naDdVzn99372tDW3gpjuwHtHUapf5wbIpPJ4a/SWIO2\n5uo/VQHQqDv/vDp4a/wC4afy5w2XRERERC7mcWE95/w+tF0TrLuDtO17+31mc4fUZQ85la8f/FQa\n+Ks08FP6Q63SWIN3d9C2zn53z4arA+GnZOgmIiIi8hQeF9bf//pVqUu4YXKZHGqVBmqVBn4qf/gr\nNfDr+l7dFbz9VP5dQVxjHatWde1T+kMhV0j9YxARERGRk3lcWHcHSl8/+1B9ddi+KnDbwrV92Fb6\nqHgTJRERERFd17AI63KZHCqlGn6+6s4/lf5QKf3svvdTqqGyfq+2fu9nHd+934/LSIiIiIjIJTwu\nrKcnz7GGZ79ewvW14dtPqYavj5Iz2URERETkcTwurK9Z9iupSyAiIiIicgmu5yAiIiIiclMM60RE\nREREbsotwvr69euRlJQEtVqNzMxMHDhwQOqSiIiIiIgkJ3lY//DDD/H4449j3bp1OH78OGbPno2l\nS5eitLRU6tKIiIiIiCQleVh/9dVXsWbNGvzHf/wHxo4di9dffx3R0dF46623pC6NiIiIiEhSkob1\n9vZ25ObmYsmSJXbblyxZgkOHDklUFRERERGRe5A0rNfW1sJsNiMyMtJue0REBKqqqiSqioiIiIjI\nPXhcn3WdTid1CTRIycnJAHgOvQHPpffgufQePJfeg+eSribpzHpYWBgUCgWqq6vttldXVyM6Olqi\nqoiIiIiI3IOkYV2pVCIjIwPffPON3fadO3di9uzZElVFREREROQeJF8G88QTT+D+++/H9OnTMXv2\nbPzlL39BVVUVfv7zn1vHaLVaCSskIiIiIpKG5GH9zjvvRF1dHZ5//nlUVlZi4sSJ2L59O+Lj46Uu\njYiIiIhIUjIhhJC6CCIiIiIi6knyhyL15u2338b8+fMRHBwMuVyOy5cvD+i4rVu3IjU1FX5+fkhL\nS8O2bducXCldj9FoxKOPPorw8HAEBATgBz/4AcrLy/s9ZuPGjZDL5XZfCoUC7e3tLqqaAGD9+vVI\nSkqCWq1GZmYmDhw40O/4U6dO4eabb4a/vz/i4uLw3HPPuahSuh5HzmVxcXGP608ul/e4t4hca9++\nfVixYgXi4uIgl8vx/vvvX/cYXpPuydFzyWvSfb344ouYNm0atFotIiIisGLFCuTn51/3OEevTbcM\n6waDAbfeeiueeeaZAR9z+PBh3H333bj//vtx4sQJ3Hvvvbjjjjtw9OhRJ1ZK1/P444/jk08+wT//\n+U/s378fTU1NuO2222CxWPo9zt/fH9XV1aiqqkJVVRUqKyuhVCpdVDV9+OGHePzxx7Fu3TocP34c\ns2fPxtKlS1FaWtrr+KamJixevBjR0dHIzs7Ga6+9hj/84Q949dVXXVw5XcvRc9ltx44d1uuvqqoK\n8+fPd1HF1Bu9Xo9Jkybhtddeg1qthkwm63c8r0n35ei57MZr0v3s3bsXjzzyCA4fPozdu3fDx8cH\nixYtQkNDQ5/HDOraFG7s2LFjQiaTiZKSkuuOvfPOO8WSJUvsti1atEisWrXKWeXRdTQ2NgqlUik2\nb95s3VZaWirkcrnYsWNHn8dt2LBBBAQEuKJE6sP06dPFgw8+aLctOTlZ/OY3v+l1/Pr164VWqxVt\nbW3Wbc8//7yIjY11ap10fY6ey0uXLgmZTCays7NdUR4NQkBAgHj//ff7HcNr0jMM5FzymvQcLS0t\nQqFQiH//+999jhnMtemWM+uDceTIESxZssRu25IlS3Do0CGJKqKcnByYTCa78xIXF4fx48df97wY\nDAYkJiYiPj4e3//+93H8+HFnl0td2tvbkZub69D1dPjwYcydOxcqlcpufEVFBUpKSpxaL/VtMOey\n249+9CNERkbipptuwtatW51ZJjkBr0nvw2vS/TU1NcFisSAkJKTPMYO5Nr0mrFdVVSEyMtJuW2Rk\nJKqqqiSqiKqqqqBQKBAaGmq3PTIysseDsK42btw4bNiwAZ9//jm2bNkCPz8/zJkzBxcuXHB2yQSg\ntrYWZrO5x/UUERHR5/XU1/XXvY+kMZhzGRgYiD/+8Y/4+OOP8dVXX2HhwoW466678MEHH7iiZBoi\nvCa9B69Jz/HYY48hPT0ds2bN6nPMYK5Nl7VuXLduHV544YV+x+zZswfz5s1zUUU0WAM9l4M1c+ZM\nzJw50/r97NmzkZ6ejjfeeAOvvfbaoN+XnGegay7J/YWGhmLt2rXW76dOnYq6ujq8/PLLuPfeeyWs\njBzBa9J78Jr0DE888QQOHTqEAwcO9Hv9DebadFlYX7t2LX7yk5/0O+ZGeqtHRUX1+I2kuroaUVFR\ng35P6t1Az2VHRwfMZjPq6ursZterqqoc+qVMLpdj6tSpKCwsHHTNNHBhYWFQKBQ9/u9HdXU1oqOj\nez2mr+uvex9JYzDnsjfTpk3De++9N9TlkRPxmvRuvCbdy9q1a/HRRx8hKysLiYmJ/Y4dzLXpsmUw\noaGhSElJ6fdLrVYP+v1nzZqFnTt32m3buXMn5syZc6Ol0zUGei4zMjLg6+tr116qrKwM586dw+zZ\nswf8eUIInDhxAjExMc74cegaSqUSGRkZPdqC7dy5s8/zNmvWLOzfvx9Go9FufGxsLBISEpxaL/Vt\nMOeyN8ePH+f152F4TXo3XpPu47HHHsOHH36I3bt3IyUl5brjB3VtDuVdsEOlsrJS5OXliQ8++EDI\nZDKxfft2kZeXJ+rr661jFixYYNfN4NChQ8LHx0e89NJL4uzZs+KFF14Qvr6+4ujRo1L8CNTloYce\nEnFxcWLXrl0iNzdX3HLLLSI9PV1YLBbrmGvP5dNPPy127NghLl68KPLy8sSaNWuEUqkUx44dk+JH\nGJY+/PBDoVQqxbvvvivOnDkj/uu//ksEBgaKy5cvCyGE+PWvfy0WLlxoHa/T6URUVJS4++67xenT\np8XWrVtFUFCQePXVV6X6EaiLo+dy48aNYvPmzeLMmTPi3Llz4g9/+INQKpXiz3/+s1Q/AonOLhN5\neaGL/iQAAALuSURBVHkiLy9P+Pv7i2effVbk5eXxmvRAjp5LXpPu6xe/+IUICgoSu3fvFpWVldav\nlpYW65ihuDbdMqz/7ne/EzKZTMhkMiGXy61/Xt3eKDExUaxZs8buuH/9619i3LhxQqlUitTUVPHp\np5+6unS6htFoFI8++qgIDQ0V/v7+YsWKFaKsrMxuzLXncu3atSIhIUGoVCoREREhbr31VnHkyBFX\nlz7srV+/XiQmJgqVSiUyMzPF/v37rfseeOABkZSUZDf+1KlTYt68ecLPz0/ExMSIZ5991tUlUx8c\nOZfvv/++SE1NFRqNRgQFBYlp06aJDz74QIqy6SpZWVk9/rsok8msf3fymvQcjp5LXpPu69pz2P31\nzDPPWMcMxbUpE0KIofpfAURERERENHS8pnUjEREREZG3YVgnIiIiInJTDOtERERERG6KYZ2IiIiI\nyE0xrBMRERERuSmGdSIiIiIiN8WwTkRERETkphjWiYiIiIjcFMM6EdEwdejQITzzzDPQ6XRSl0JE\nRH1gWCciGqYY1omI3B/DOhHRMCeEkLoEIiLqA8M6EdEw9PTTT+O///u/AQBJSUmQy+WQy+XYt2+f\nxJUREdHVfKQugIiIXO/2229HYWEhtmzZgj//+c8ICwsDAIwbN07iyoiI6GoM60REw9DEiRORnp6O\nLVu2YOXKlRg5cqTUJRERUS+4DIaIiIiIyE0xrBMRERERuSmGdSIiIiIiN8WwTkQ0TMlkMqlLICKi\n62BYJyIapjQaDQCgvr5e4kqIiKgv7AZDRDRMTZs2DQDwm9/8BqtWrYJSqcTChQsRHh4ucWVERNRN\nJvjoOiKiYet///d/sX79epSXl0MIgaysLMybN0/qsoiIqAvDOhERERGRm+KadSIiIiIiN8WwTkRE\nRETkphjWiYiIiIjcFMM6EREREZGbYlgnIiIiInJTDOtERERERG6KYZ2IiIiIyE0xrBMRERERuSmG\ndSIiIiIiN8WwTkRERETkpv5/la74lpbmYxMAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x81bc2e8>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "t = np.linspace(-1, 2, 20)\n",
    "plt.plot(t, np.exp(t))\n",
    "t = np.linspace(0, 1, 2)\n",
    "plt.plot([1,2, 4])\n",
    "plt.xlabel('t')\n",
    "plt.ylabel('y')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Here we see the next estimate for y is 4. The errors are quickly getting large, and you might be unimpressed. But 1 is a very large step size. Let's put this algorithm in code, and verify that it works by trying to generate the result above."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "def euler(t, tmax, y, dx, step=1.):\n",
    "    ys = []\n",
    "    while t < tmax:\n",
    "        y = y + step*dx(t, y)\n",
    "        ys.append(y)\n",
    "        t +=step        \n",
    "    return ys"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "2.0\n",
      "4.0\n"
     ]
    }
   ],
   "source": [
    "def dx(t, y): return y\n",
    "\n",
    "print(euler(0, 1, 1, dx, step=1.)[-1])\n",
    "print(euler(0, 2, 1, dx, step=1.)[-1])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This looks correct. So now lets plot the result of a much smaller step size."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAt0AAAEjCAYAAADuR70GAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzs3XlYVOfdPvD7DDuIiCj7IggIKLiAikRBXKOJWxI1sTYx\nNk2TmCamS1rT9w0kMab2tf5Ma9psTUIWs5jFmM1gFBXEBVxQxAUEBQQGWWSRnXl+f1gmHgYEYYYz\nA/fnurzqfM+ZM7fEPnw9POd5JCGEABERERERGYxK6QBERERERP0dm24iIiIiIgNj001EREREZGBs\nuomIiIiIDIxNNxERERGRgbHpJiIiIiIyMDbdREZs1apVUKlUyM/PVzoKERER9QKbbrql8+fP4+mn\nn0ZYWBiGDBkCKysruLm5Yf78+XjjjTdQV1endMQ+9d5770GlUuGFF17os8+UJKnPPouIqDdUKlWX\nvw4cOKB0zA7t27cPKpUKDz/8sNJRqJ8yVzoAGa+XXnoJ8fHxEEIgMjISq1atgr29Pa5evYoDBw7g\n8ccfx6ZNm5Cdna101D7Xl40w968iIlMiSRLi4uI6Pe7j49OHaW4fb3SQobDppg5t2LABcXFx8PLy\nwmeffYbJkyfrnJOUlIT/+Z//USCd8tgIExF17vnnn1c6Qo9xfCdD4fQS0nHp0iXEx8fD0tIS3333\nXYcNNwDExsYiKSlJVvvyyy8RGxsLBwcH2NjYICQkBHFxcbh+/brO+6dPnw6VSoVLly5h69atCAkJ\ngY2NDXx9fbFx40bteR999BEiIiIwaNAguLi44KmnnkJjY6PO9VQqFXx9fVFVVYUnnngC7u7usLGx\nwZgxY/Cvf/1L5/y2HyV2NlWkLV+bVatWYfXq1QCAF1544ZY/Lv3iiy8wa9YsDB06FNbW1ggMDMS6\ndetQU1PT4Wf99NNPmDZtGuzs7ODk5IQlS5bg3LlzHZ5LRNQfXLt2Db6+vrCyssLRo0dlx4QQuOuu\nu6BSqWTjd1FREV588UXccccdcHV1hZWVFTw8PLBixQpkZWV1+llpaWm4//774eHhoZ0mOXPmTLz/\n/vsAgPj4eMyYMQMAkJCQIBvfExISDPCnp4GId7pJx7vvvouWlhbcf//9GDNmzC3PtbS01P7++eef\nx/r16+Hk5IQVK1ZgyJAhSExMxEsvvYSdO3ciOTkZgwYN0rnGH/7wByQnJ2PBggWYPXs2tm/fjnXr\n1qGxsRFWVlZ4+eWXsWTJEsTExOCbb77B1q1b0dLS0mEj3dTUhFmzZqGmpgYrV65EQ0MDtm/fjief\nfBIXLlzAli1bdN5zqx8l3nxsyZIlqKqqwtdff43p06dj+vTp2mM3/7j0iSeewOuvvw4vLy/ce++9\ncHR0xKFDh7Bx40Z8//33OHjwoOzr8Pnnn2P58uWwsrLCsmXL4OHhgZSUFERFRSEsLKzzLz4RkQkb\nMmQIPv30U0ybNg3Lly/HiRMnMGTIEADApk2b8MMPP+Dee+/FE088oX3PgQMHsHHjRsyYMQMTJkzA\noEGDcOHCBXzxxRfYuXMnUlJSMG7cONnnvP3223jsscdgbm6OBQsWYNSoUSgrK8OxY8fw6quv4sEH\nH0RsbCwuX76MhIQEjBs3DosXL9a+f/z48X3zBaH+TxC1M2PGDCFJkvjPf/7T7fccOnRISJIkvLy8\nRHFxsezYQw89JCRJEk8++aSsHhMTIyRJEgEBAaK0tFRbv3TpkrC0tBS2trbCxcVF5OTkaI9VVVWJ\n4cOHCysrK9l7hBBCkiQhSZKYNm2aaGpq0tbLysqEr6+vkCRJpKamautJSUlCkiTxwgsvdPhniomJ\nESqVSlZ79913b/meDz74QEiSJO69917R0NAgO7Z+/XohSZL4/e9/r63V1NSIoUOHCgsLC3H06FHZ\n+X/84x+FJElCpVKJy5cvd/h5RETGpG0cjo+PF3FxcTq/4uPjdd6zefNmIUmSWLJkiRBCiMOHDwsL\nCwvh5+cnqqqqZOeWlpaK2tpanWtkZGSIQYMGiTvvvFNWP3PmjDA3NxeOjo4iMzNT532FhYXa3+/b\nt09IkiQefvjhHv3ZibrCppt0BAcHC0mSxI8//tjt9zzyyCNCkiTx73//W+eYWq0WNjY2wt7eXjQ3\nN2vrbU13QkKCzntmzpzZaXP78MMPC0mSxIEDB2T1tgY1JSVF5z1vvvmmkCRJ/PrXv9bWDNF0T5gw\nQVhYWIjKykqdYy0tLWLYsGHC1dVVW/vwww+FJEli5cqVOudXV1cLBwcHNt1EZDLamu7OfrUfU9ss\nXLhQSJIkXnzxRTFixAhhZWWlcyOiKwsWLBDW1taipaVFW3vyySeFJEli06ZNXb6/7XsCm24yFE4v\nIb04fvw4AGjnxN3M2dkZoaGhSEtLw4ULFxASEiI73tGP7lxdXTs95u7uDgAoLCzUOWZubo6oqCid\nekxMDADg5MmTXf1Reqyurg4nTpyAk5NTh9NYgBvTcYqLi1FZWQlHR0ft160t383s7e0xfvx47N+/\n32CZiYj0TZIktLa23tZ73nvvPYwfP1676snf//53TJw4scNzv/vuO7z++utIT09HeXk5WlpaZJ9d\nVlYGFxcXAMDhw4cBAPPmzevJH4VIr9h0kw43NzecO3cOBQUF3X5PVVUVJEnSNssdXbPtvPYcHBx0\naubm5l0ea25u1jk2bNiwDudoOzs7d/r5+lJZWQkAKC8vx4svvtjpeZIkoba2Fo6Ojto8bd8g2uus\nTkTUnzg6OiI2NhYJCQmwt7fHr371qw7Pe/XVV/HMM89g6NChmD17Nry9vWFrawtJkvDVV18hIyND\n9qD9tWvXIEkSPDw8+uqPQtQpNt2kY9q0aUhKSsKePXs6Hfjaa2uOi4uLMXjwYJ3jxcXFsvMMpays\nDEIIncZbrVbrfH7byiQ33yW52bVr127rs9uuHRYW1u076m3vacvXXmd1IqL+5Msvv0RCQgKGDx+O\nq1ev4rHHHsO2bdtk57S0tCA+Ph5ubm44fvy4zk2JgwcP6lx3yJAhEEKgsLDQ4N9/iLrCJQNJx8MP\nPwwLCwt88cUXOHPmzC3PbWpqAgCEh4dDCKGzhCAAlJaWIjMzE4MGDcKoUaMMkrlNS0tLhwNv2xSN\nm6erODo6AkCHW6xXVVXhwoULOnUzMzMA6PBHp4MGDcKYMWNw9uxZlJeXdytveHg4gBvLF7ZXU1OD\nEydOcKMGIurX8vLysHr1ajg6OiItLQ3z5s3DJ598grfeekt2XllZGaqqqhAVFaXTcNfW1uL48eM6\n4+WUKVMAAD/88EOXOW41vhPpA5tu0uHj44P4+Hg0Nzfjrrvu0lk/tc3evXu1c5Hb1q/esGGD7O6s\nEAJ/+tOfUF9fj4ceekg7qLXRd0MphMBzzz2n/ccAcGOgfuWVVyBJkmx73+DgYDg4OGDHjh2yzC0t\nLVi7di0aGhp0rj9s2DAAwOXLlzv8/N///vdobm7Gww8/rJ1ucrOamhrZ13PRokVwdHTEp59+qvN1\nfvHFF1FdXd3NPzkRkelpbm7G8uXLUVNTg3feeQfe3t54//334e7ujrVr1yIzM1N7rrOzM2xtbZGe\nni7b+6G5uRlPP/10hzc7Hn/8cZibm+Pll1/u8CbSzc8GOTk5Aeh8fCfqLU4voQ6tW7cOLS0teOGF\nFxAZGYkpU6YgIiIC9vb2KC0tRXJyMs6fP4/AwEAAQGRkJNatW4dXXnkFY8aMwdKlSzF48GDs3r0b\nJ06cQFhYGF555RWdzxF63vnLzc0N9fX1CA0NxcKFC9HQ0IDPP/8carUaTz/9NCIjI7Xnmpub45ln\nnkF8fDzGjx+PxYsXQ5IkJCUlQZIkjB07FhkZGbLrR0VFwc7ODp988gksLCzg7e0NSZLw4IMPwtvb\nGw899BCOHz+Of/7znxg5ciTmzp0LHx8fXLt2DZcuXUJycjLmzp2LL7/8EgBgZ2eHN998E8uXL0dM\nTAyWL18ONzc3HDx4EJmZmYiOjtbZeIeIyJgJIfDCCy90Or7PmzdPu+nan/70J6Snp+O3v/0tFi1a\nBOBG87tt2zbMnDkTy5cvR1paGmxtbaFSqfDUU0/hr3/9q3aMb2pqQlJSEq5du9bhhm3BwcH417/+\nhcceewzh4eFYsGABAgMDUVFRgRMnTqCpqUn7QHtQUBC8vLyQnJyMlStXIiAgAGZmZli0aBFCQ0MN\n+BWjAaM7S5wUFRWJBx98UAwfPlxYW1uLkJAQsX//ftk5cXFxwt3dXdjY2Ijp06eLM2fO6HWZFVLG\nuXPnxFNPPSVCQ0OFg4ODsLCwEK6urmLu3Lni9ddfF/X19bLzt2/fLmJiYsTgwYOFlZWVCA4OFv/7\nv//b4bqq06dP73Q5vFWrVgmVSqXz90wIIeLj44VKpdJZalCSJOHr6yuqqqrE448/Ltzd3YWVlZUY\nPXq0eO211zr9M27atEkEBAQIS0tL4e7uLp544glRUVGhzdfe7t27xdSpU4W9vb12Caz2OXft2iUW\nLVokXF1dhaWlpXBxcRHh4eHi2WefFSdPnuz0mra2tmLo0KFi8eLF4vz589qvA5cMJEPg2E761jYm\n3mrJwFdffVUIIcTOnTuFJEliwoQJsr0V2rzwwgtCpVLJlvBraWkRmzdvFiEhIcLGxka4ubmJBx98\nUOTn599yvDx8+LC47777tGOyu7u7mDVrlvjwww9l5x0/flzMnj1bDBkyRKhUqg6/1xD1lCTErW81\nXrt2DRMmTEB0dDSefPJJDB8+HLm5uXBzc0NQUBAAYOPGjXj55ZeRkJCAwMBAvPjii0hJScH58+c7\n3IGQyBBUKhVGjBiB3NxcpaMQGT2O7UREfavLpvu5555DcnIykpOTOzwuhIC7uzueeuoprFu3DgDQ\n0NAAZ2dnbNq0CY8++qj+UxN1gE03UfdxbCci6ltdPki5Y8cOTJo0CcuXL4eLiwvGjx+P1157TXs8\nLy8ParUac+bM0dasra0RHR2N1NRUw6QmIqJe4dhORNS3umy6c3Nz8a9//Qv+/v5ITEzE008/jT//\n+c/awbmkpASA7iYezs7O2mNERGRcOLYTEfWtLlcv0Wg0mDRpEl5++WUAwNixY5GdnY3XXnsNa9as\nueV7b14OzpA7ARIBP+8Iyb9rZAyMfSMOfY3tAP8/R0QDR2/G9i7vdLu7uyMkJERWCwoK0m4o0rbt\nd/ud89RqdadbghMRkbI4thMR9a0um+477rgD586dk9UuXLiAESNGAAB8fX3h6uqKxMRE7fGGhgak\npKQgKipKv2mJiEgvOLYTEfWtLqeXPPPMM4iKisKGDRuwbNkynDhxAv/85z+1G51IkoS1a9diw4YN\nCAoKQkBAANavXw97e3usWLGiw2sa249d09PTAQAREREKJ+mYMedjtp5htp4x5myAaU2zMMTYDnB8\nvx3GnA0w7nzM1jPM1jP6Gtu7bLojIiKwY8cOPPfcc3jppZfg4+OD9evX4/HHH9ee8+yzz6K+vh5r\n1qxBZWUlIiMjkZiYCDs7O72EJCIi/eLYTkTUt7q1Dfz8+fMxf/78W54TFxeHuLg4vYQiIiLD49hO\nRNR3upzTTUREREREvcOmm4iIiIjIwNh0ExEREREZGJtuIiIiIiIDY9NNRERERGRgbLqJiIiIiAyM\nTTcRERERkYGx6SYiIiIiMjA23UREREREBsamm4iIiIjIwNh0ExEREREZGJtuIiIiIiIDY9NNRERE\nRGRgbLqJiIiIiAyMTTcRERERkYGx6SYi6qXSyiuoqq1QOgYREelZXvE5vV2LTTcRUS/tPPg+nn/n\nEaVjEBGRHmmEBgk//F1v12PTTUTUC9cbanAm7xiE0CgdhYiI9Oh8fgYqaq7q7XpsuomIeuH4+WS0\nalqUjkFERHqWevpHvV6PTTcRUS8cOZukdAQiItKzqusVOJ2XptdrsukmIuqh4vIC5KuzlY5BRER6\nduTMHmg0rXq9JptuIqIeOnp2r9IRiIhIzzRCg9Qzu/V+XTbdREQ90KppRdq5fUrHICIiPTufn4GK\n6lK9X5dNNxFRD5zPz0D19UrtaysLawXTEBGRvqRmJhrkumy6iYh6oP3UknEBdyiUhIiI9KX6eiVO\n5x41yLXZdBMR3aa6hlqcunhEVpscMkOhNEREpC+Hs+QPULoM9dTbtdl0ExHdphPZB9HS2qx97eTg\nAj/3YAUTERFRb2mEBocy5Q9QRo2Zo7frs+kmIrpNR7LkU0smBcVCJXE4JSIyZRfyT6G8Wq19bW5m\ngUlB0/V2fX6XICK6DerKK7hUcl5WmxQcq1AaIiLSl/YPUI7zj4KdzWC9Xb/Lpjs+Ph4qlUr2y93d\nXeccDw8P2NraIjY2FllZWXoLSERkTI6c2SN77e85Bk4OLgql6TmO7UREP6u+fg2ncuXP6kSF6m9q\nCdDNO91BQUEoKSnR/jp9+rT22MaNG7F582Zs3boVaWlpcHZ2xuzZs1FbW6vXoERESmttbcGRdquW\nTDbhu9wc24mIbjjS/gFKR0+MdA/R62d0q+k2MzODs7Oz9peTkxMAQAiBLVu2YN26dViyZAlGjx6N\nhIQE1NTUYNu2bXoNSkSktMy8NNTUXdO+trK0MemlAjm2ExG17UApn1oSNWYOJEnS6+d0q+nOzc2F\nh4cH/Pz88MADDyAvLw8AkJeXB7VajTlzfr79bm1tjejoaKSmpuo1KBGR0lLbPdUeMSrGpDfF4dhO\nRARkF5xGedXPD1CamZljUvB0vX9Ol013ZGQkEhIS8OOPP+Ktt95CSUkJoqKiUFFRgZKSEgCAi4t8\nPqOzs7P2GBFRf1BRXYpzl0/IalFjZiuUpvc4thMR3XAw80fZa30/QNlGEkKI23lDXV0dfH198ec/\n/xmTJ0/G1KlTkZ+fD0/PnxcPX716NYqLi/HDDz9oa1VVVdrfZ2dn6yE6EVHfOZm/H6cKkrWvh9q5\n4u5xj8jOCQgI0P7ewcGhz7LpQ0/HdoDjOxGZrvqmWnye/g8IodHW5oz5JVwdfLSv9TW23/aSgba2\nthg9ejRycnLg5uYGAFCr1bJz1Go1XF1dexyKiMiYaIQGOeqTslqAy3iF0hgGx3YiGogulp6SNdyD\nbZzgMtjbIJ9lfrtvaGhowNmzZzFjxgz4+vrC1dUViYmJCA8P1x5PSUnBpk2bOr1GREREzxMbQHp6\nOgDjy9XGmPMxW88wW88olS0zNw11TTXa15bmVrhnzi9hY2UrO+/mO76mRh9jO2B8f2/497nnjDkf\ns/UMs8lphAbfZ74tq82IWIiJEybKavoa27u80/2HP/wBBw4cQF5eHo4cOYL77rsP9fX1eOihhwAA\na9euxcaNG/HVV18hMzMTq1atgr29PVasWKGXgERESks9I3+AcnzgVJ2G29RwbCeigS674DTKqn5+\nTuXGA5SGWwa2yzvdV65cwQMPPICysjIMHz4cU6ZMweHDh+Hl5QUAePbZZ1FfX481a9agsrISkZGR\nSExMhJ2dncFCExH1laraCmTlpctqUWP0u2GCEji2E9FAp7MD5cgpGGSAByjbdNl0f/zxx11eJC4u\nDnFxcXoJRERkTA5n7YHmpvl+bk7eGOEaqGAi/eDYTkQDWU3dNZy6aNgdKNu77QcpiYgGCo2mFYfa\nTS0xxIYJRETUt45k7UWrpkX72nmIO/w9xhj0M9l0ExF14sylY6ioLtW+NjezQERQjIKJiIiotzRC\ng0PtNjuLCjX8DRU23UREnUg+JV+POjxwGuys7RVKQ0RE+pBTmImrVcXa1zceoJxh8M9l001E1IGr\n14p1dqCcNna+QmmIiEhf2j9AOdbAD1C2YdNNRNSBlHZ3ub1dAuDt4q9QGiIi0oeauipk5ByW1fpq\nRSo23URE7TQ1N+Jw1h5ZbVrYPIXSEBGRvhw9K3+AcriDGwI8DfsAZRs23URE7Rw7fwD1jde1r+2s\n7TEhcKqCiYiIqLeEEEg9LZ9a0hcPULZh001EdBMhhM4DlJGjZ8HC3FKhREREpA/Z7R+gVPXNA5Rt\n2HQTEd3kUsl5FF7N1b6WIGFq6J0KJiIiIn3QeYDSPxL2tg599vlsuomIbtL+LneIbzicHFwUSkNE\nRPpQU1eFjIuHZLW+eoCyDZtuIqL/qqm7hhPZB2W1aWFcJpCIyNQdPZuE1lb5A5T+ffQAZRs23URE\n/5VyapdsUB7m4Iogn3EKJiIiot4SQuhMLZkyZjZUUt+2wWy6iYgANLc06azNPW3s/D4flImISL9y\nrmTi6rUi7WszlTkmh/TdA5Rt+N2EiAjAsfPJqKmv0r62srRBZMgsBRMREZE+tF8mMGzkZNjbDunz\nHGy6iWjAE0Jg34mdstqU0bNhY2WrUCIiItKH2vpqnFT4Aco2bLqJaMDLLjyNovLL2teSpELMuLsU\nTERERPpw9OxenWd1ArxCFcnCppuIBrykdne5w0ZOhtNgLhNIRGTKNEKjM7Vkypg5ij2rw6abiAa0\n0sorOJOXLqtNH7dAoTRERKQvpy8eRelND1CqVGaY3Ic7ULbHppuIBrR9J7+VvfZ29oefe7BCaYiI\nSB+EENh19FNZbZx/FAbb9f0DlG3YdBPRgHW9oQZHs/bKatPHL4AkSQolIiIifcjMS8OVq3my2pyJ\n9ymU5gY23UQ0YKWeTkRTS6P2tcMgJ4wPuEPBRERE1FtCCPx45DNZbZx/FNyH+SiU6AY23UQ0IDW3\nNGHfyW9kteiw+TAzM1coERER6cPZy8eRX5ojq82dtFShND9j001EA9LRs0moqbumfW1lYY07Qucq\nmIiIiHpLCIEfjsjncoeNnAyP4b4KJfoZm24iGnA0mlbsPbZDVrsjdC5srQcplIiIiPThXP5JXC65\nIKvNnbRMoTRybLqJaMDJuHgYV6uKta/NVOaYPn6hgomIiKi3hBDY1e4u92jfCHg5j1QokRybbiIa\nUIQQ2J3+hawWERSDIYOcFEpERET6kF14GnnF52S1O43kLjfAppuIBpgLBadQWJqrfS1BwszwxQom\nIiIifWh/lzvYZwJ8XAMVSqOLTTcRDSjt73KHjpwE16FeCqUhIiJ9yC7MRM6VM7LanZON5y43wKab\niAaQfHUOLhScktVmht+jUBoiItKXH4/K1+Ue5T0Wvm5BCqXp2G013a+88gpUKhV++9vfyurx8fHw\n8PCAra0tYmNjkZWVpdeQRET68FP6l7LXIz1Gw9dtlEJpjAvHdyIyVblFZ3VuqNw5ablCaTrX7ab7\n8OHDeOuttxAWFibbInnjxo3YvHkztm7dirS0NDg7O2P27Nmora01SGAiop4oLs9HRs4hWW12BO9y\nAxzfici07Wp3lzvAMxQjPUIUStO5bjXdVVVVWLlyJd599104Ojpq60IIbNmyBevWrcOSJUswevRo\nJCQkoKamBtu2bTNYaCKi25V4dDsEhPa1x7ARCPaZoGAi48DxnYhM2aWSCzh3+YSsZmxzudt0q+l+\n9NFHsXTpUsTExECIn79p5eXlQa1WY86cOdqatbU1oqOjkZqaqv+0REQ9oK4oxPELKbLanZOXy+7q\nDlQc34nIlLVfsWSkewj8PcYolObWzLs64a233kJubq72zsbN36RKSkoAAC4uLrL3ODs7o6ioqNNr\npqen9yisoRlrrjbGnI/ZeobZeuZ2s6Vc+Fp2l3uI7XA0VZrr/c8YEBCg1+sZGsd342DM2QDjzsds\nPdNfspXVFCHr0jFZzddxHI4dO9bJO3pGX2P7LZvu8+fP4y9/+QtSUlJgZmYG4MaPHG++G9IZ3kEi\nImNQXV+BvKuZslqY17QBP0ZxfCciU3eqUP4TzOH2nnBz8FUoTddu2XQfOnQIZWVlGD16tLbW2tqK\n5ORkvPHGG8jMvPGNTK1Ww9PTU3uOWq2Gq6trp9eNiIjobW69avtXlbHlamPM+ZitZ5itZ3qS7aPd\n/5Td5XYZ6ol75vwCKpWZ3vNVVVXp/ZqGwvFdecacDTDufMzWM/0pW0FpLgoPXpDV7pv5KwT7jNd7\nNn2N7bec071kyRJkZmYiIyMDGRkZOHnyJCIiIvDAAw/g5MmTCAgIgKurKxITE7XvaWhoQEpKCqKi\novQSkIiop8qqSpB2NklWmztxqUEablPD8Z2ITFliuxVLfFwCEOQ9TqE03XPLO90ODg5wcHCQ1Wxt\nbeHo6IiQkBtLsaxduxYbNmxAUFAQAgICsH79etjb22PFihWGS01E1A27076ARmi0r52HuGNC4FQF\nExkPju9EZKqKyi4h4+JhWc0UHo7v8kHK9iRJkv2hnn32WdTX12PNmjWorKxEZGQkEhMTYWdnp9eg\nRES3o7xajSNn98pqcybxLvetcHwnIlPQfl1uT2c/hIwIVyhN9912052UlKRTi4uLQ1xcnF4CERHp\nw67Dn0KjadW+HubgivBR0QomMn4c34nI2BWX5yMjW77R2Z2TjP8uN3Cb28ATEZmCkooCHD23T1ab\nO2kZzHiXm4jIpHW00Vmo3yQFE3Ufm24i6ne+P/wxxE1zuV0cPTExKEbBRERE1FumvtEZm24i6lcK\nSnNxMlu+Y+L8KSs4l5uIyMQlpn0uu8vt5uSN0JGTFUx0e9h0E1G/8t2hj2SvPYf7Yax/pEJpiIhI\nH65eK0b6+QOy2txJy6CSTKeVNZ2kRERdyC06q7Ml8N1RvzCpQZmIiHQlpn0unzY41BPj/KcomOj2\n8TsREfULQgh8m/qhrObnHoxgnwkKJSIiIn3oLxudsekmon7hfH4Gcq6ckdXujlppMg/YEBFRx/rL\nRmdsuonI5GmEBjsPvi+rBfmMh7/HaIUSERGRPlRUl/abjc7YdBORyUs/tx+FV3Nltbun/EKhNERE\npC+707/sNxudsekmIpPW1NKI71LlK5ZMCJwGbxd/hRIREZE+VNZcxeEzP8lqcyYuNdmNzth0E5FJ\n23/iW1TWlmlfm5mZY0HUSgUTERGRPnx3aBtaNS3a10MHO5v0RmdsuonIZNXUVWF3+heyWnTYfDg5\nuCiUiIiI9CHnyhkcbbdiyZyJ98HMzFyhRL3HppuITNaPRz9DQ1Od9rWNlR3mTFqqYCIiIuqt1tYW\nbE96Q1alL4zaAAAgAElEQVRzc/LG5OAZCiXSDzbdRGSSSiuvIOX0Lllt7qSlsLO2VygRERHpw/6M\nb1Fcni+rLYv9jUnf5QbYdBORifrm4AeyJ9qHDnbGtLC7FExERES9VVlThu8PfyKrTQqOxch+sAQs\nm24iMjkXCk4j4+JhWW1B1EpYmFsolIiIiPThqwPvoKm5QfvaxsoOi6Y+pGAi/WHTTUQmRSM0+HL/\n27Kat7M/xpvg7mRERPSzK5UXcTInVVa7O2ol7G2HKJRIv9h0E5FJuVByHEXll2W1e2IegUricEZE\nZKpaNS04mit/Tsfb2R93jJmjUCL943cpIjIZDc11OJm/T1aLCIqBn3uQMoGIiEgvMgtTUdNQqX0t\nQcKyGY+Z5HbvnWHTTUQmIyN/P5pafp7rZ2lhjUV39I+5fkREA9XVa8U4XXhQVrsjdG6/21mYTTcR\nmYQrVy/hQslxWW3uxKVwGDRUoURERNRbQgh8sf9taMTPq1ENsnHA3f1wZ2E23URk9G4Mym9BQGhr\nwxxcMX38QgVTERFRb526eARZl47JaounrYKt9SCFEhkOm24iMnonsg8i58oZWW1J9GouEUhEZMIa\nmxt0VqMa6R6CiUHTlQlkYGy6icio1Tdex5cH/iOrBfmMxxjfiQolIiIiffjxyGeorC3TvpYgYWns\nbyBJkoKpDIdNNxEZte8ObUP19Z+faFdJKtwb/at+OygTEQ0ExeUF2Hvia1kt2H0y3If5KJTI8Nh0\nE5HRylfnIPnUD7LaaI8ouAz1VCgRERH1lhAC2/e9AY3m54cnbS3tMdY7WsFUhsemm4iMkkbTik/3\n/htCaLS1QdZDEOp5h4KpiIiot9LPH0BOYaasNtF3DizMLBVK1DfYdBORUUo+9QMKSi/KapP95sHc\njA9PEhGZqrrGWuxIfldWC/IZD2+n/r/JGZtuIjI6VbUV+PbQR7La+IA74OE4UqFERESkD98f2oaa\numva1+ZmFlg6/dEB8ZxOl033a6+9hrFjx8LBwQEODg6IiorC999/LzsnPj4eHh4esLW1RWxsLLKy\nsgwWmIj6vy8OvI3GpnrtaytLG9wT/SsFE/U/HNuJqK8VlF5E8qldstqs8HswfIibQon6VpdNt5eX\nF/72t7/hxIkTOHbsGGbMmIHFixcjIyMDALBx40Zs3rwZW7duRVpaGpydnTF79mzU1tYaPDwR9T+n\nLh7GyexUWe3uKb/gzpN6xrGdiPqSRmjw2d7XZc/pODm4YNbEexRM1be6bLoXLlyIuXPnws/PD/7+\n/li/fj3s7e1x9OhRCCGwZcsWrFu3DkuWLMHo0aORkJCAmpoabNu2rS/yE1E/UtdQi8/2viGreTmP\nxLSweQol6r84thNRXzqUuRuX1dmy2tLpj8LS3EqhRH3vtuZ0t7a24pNPPkFDQwOio6ORl5cHtVqN\nOXPmaM+xtrZGdHQ0UlNTb3ElIiJdXx14B9V1N63JrTLDillPQqUyUzBV/8exnYgMqaauCt8c/EBW\nCxsZiZAR4QolUoYkhBBdnXT69GlMmTIFjY2NsLGxwccff4y77roLqampmDp1KvLz8+Hp+fO6uatX\nr0ZRURF27fp53k5VVZX299nZ8n/pEBFdqbyIPVkfy2phnlMxzme6MoF6ICAgQPt7BwcHBZN0jz7G\ndoDjOxHdWmr2N8gpzdC+NldZYOGExzDIyvjHSUB/Y7t5d04KCgrCqVOnUFVVhe3bt+P+++9HUlLS\nLd8zEJ5CJSL9aGppxKGc72S1IbbDEeo1VaFEAwPHdiIytNLqAlnDDQBhXtNMpuHWp2413RYWFvDz\n8wMAjB8/HmlpaXjttdfw/PPPAwDUarXsboharYarq2un14uIiOhNZr1LT08HYHy52hhzPmbrGWaT\n+2zv66hrqta+liQVfrXgj/BxDVQ82+24+Y6vKdD32A4Y338bY/47Y8zZAOPOx2w909fZWjWt+L+P\nP5TVXId6YeWCx3X2XDDmr5u+xvYerdPd2toKjUYDX19fuLq6IjExUXusoaEBKSkpiIqK0ktAIurf\nLhScRspp+XSF2PELdRpuMjyO7USkTwcyvkNR2SVZbWnsowN2k7Mu73T/+c9/xt133w1PT0/tk+v7\n9+/Xzulbu3YtNmzYgKCgIAQEBGifgF+xYoXBwxORaatvvI6Pdv9DVhs+xB3zpzygUKKBg2M7ERlS\nSUUBvkuVb3IWERSDAM9QhRIpr8umW61WY+XKlSgpKYGDgwPGjh2LXbt2Yfbs2QCAZ599FvX19Viz\nZg0qKysRGRmJxMRE2NnZGTw8EZm2L/a/jcqaq9rXEiQ8MGvNgFpCSikc24nIUBqbG/Du9/+HppZG\nbc3G0haLp65SLpQR6LLpfvfdd7u8SFxcHOLi4vQSiIgGhpPZqTh6Vv7Q3vTxC+DvMVqhRAMLx3Yi\nMpTP972F4vJ8WW1x9GoMtnNUKJFx6NGcbiKi3qi6XoFP9/5bVnNz8sbdUSsVSkRERPpwJGsvjmTt\nkdUigmIQGTJToUTGg003EfUpIQQ+/uk1XG+o0dbMVOb45dy1sDC3VDAZERH1RnF5AbYnyXcVdnH0\nxPLYx7jcKNh0E1EfS81MRNalY7La/MgH4DncT6FERETUWzfmcf9NNo/bwtwSD8//I6wsbRRMZjzY\ndBNRnympKMBXB96R1fzcgjEzfLFCiYiISB8+T3oTJRUFstp90x+F+zAfhRIZHzbdRNQnmloa8d73\nm2R3QawsrLFy7tNQqcwUTEZERL1xJGsPjpzdK6tNDJrOedztsOkmoj6x48C7KCq/LKvdE/MIhjnc\neodDIiIyXsXl+fisg3ncy2J/w3nc7bDpJiKDO5mdqrPrZHjgNN4FISIyYW3rcTe3NGlrnMfdOTbd\nRGRQ5dVqfPzTVlltmIMrls14nHdBiIhMGOdx3x423URkMK2tLUj4YTPqm+q0NTOVOVbN+wNsrGwV\nTEZERL3R0TzuScGx/AnmLbDpJiKD+fbQh7hUcl5WWzj1QXi7+CuUiIiIeqvDedxDPbGU87hviU03\nERnEyexU7Dm2Q1Yb7RuB6eMWKJSIiIh6q7G5Ae98/zfdedzz/ggrC2sFkxk/Nt1EpHfqikJ89NM/\nZTWHQU74xeyneBeEiMiEbU96A+qKQllt6fTfcB53N7DpJiK9amyqx9vf/RWNTfXampnKHKvn/xGD\nbAYrmIyIiHrjSNYeHD2bJKtNCo7F5JAZCiUyLWy6iUhvhBDY9tNWnbsg90Svhq9bkEKpiIiotziP\nu/fYdBOR3uw78Q1OZB+U1SYGTcfUsHkKJSIiot5qbKrvcB736vnPch73bWDTTUR6caHgNL5OeU9W\ncx82Asu5HjcRkckSQuCzDuZxL4v9DdycvBVKZZrYdBNRr129Vox3vtsIjdBoazaWtvjVXX+CpYWV\ngsmIiKg3jmTtRdq5fbLajXncXI/7drHpJqJeqW+8jjd3voy6xlpZ/Zdzn8HwIW4KpSIiot4qKruM\n7fvk87hdh3phaexvFEpk2th0E1GPtWpa8d4Pf4e6Uv5jx7ujVmKM30SFUhERUW81NtXj3e//TzaP\n29LcCg9zHnePsekmoh77OiUBZy8fl9XCR0VjdsS9CiUiIqLeam5pxtvf/lXnhsrS2N/AzclLoVSm\nj003EfXIoczd2Hdip6zm4xKAB2at4YOTREQmSqNpxQc//j+cL8iQ1ScHz+B63L3EppuIbtu5yyfx\nadLrsprDICc8smAdLM354CQRkSkSQuDTva/jZE6qrO7lPBL3xT6qUKr+g003Ed2WK1fz8J/vN0Kj\nadXWLMwt8eu718HBbqiCyYiIqDd2Hnwfh87sltWcHT3w2KLnOY9bD9h0E1G3VdZcxetfvyTb4h0A\nVs55Gt4u/gqlIiKi3vop/UvsOfaVrOY4aBieWBwPe1sHhVL1L2y6iahb6hpr8frXL6HqeoWsvnja\nKowPuEOhVERE1Fupmbux8+D7spqdzWA8cc8LGDp4uEKp+h823UTUpbYn2YvL82X1mHF3I3b8IoVS\nERFRb53ITsWne/8tq1lZ2uDxRc/DxdFDoVT9E5tuIroljaYVH+1+FTmFmbL62JGRWDLtYa5UQkRk\nos5dPon3d22GuGk3YXMzCzy64DlOGTQANt1E1CkhBD5LegPHL6TI6r5uQfjlnc9ApTJTKBkREfXG\npZILePu7v6JV06KtqSQVVs37AwI8QxVM1n+x6SaiDgkhsPNgAlIzE2V15yHu+PWC57g0IBGRiSou\nz8frO15EU3ODrL5i9m8RNnKyQqn6vy6b7ldeeQUTJ06Eg4MDnJ2dsXDhQpw5c0bnvPj4eHh4eMDW\n1haxsbHIysoySGAi6hu707/AnmM7ZDWHQU54fEkcBtkMVigV6QvHdqKBqbbhGv71VTzqGmtl9SXR\nqzEpOFahVANDl033/v378eSTT+LQoUPYu3cvzM3NMWvWLFRWVmrP2bhxIzZv3oytW7ciLS0Nzs7O\nmD17Nmpra29xZSIyVueK0/Ft6oeymp3NYKxZEg+nwS4KpSJ94thONPDUN9Vi95mPdFahmjtpKWLH\nL1Qo1cBh3tUJu3btkr3+4IMP4ODggNTUVNx1110QQmDLli1Yt24dlixZAgBISEiAs7Mztm3bhkcf\n5Q5GRKbkYukpHM2V///e2tIWTyyOg+tQL4VSkb5xbCcaWOoaa/FT1seoaaiU1aeGzcP8yBUKpRpY\nbntOd3V1NTQaDRwdHQEAeXl5UKvVmDNnjvYca2trREdHIzU1tbPLEJERSju3Dwezd8pqFmaW+M3C\nv8DLeaRCqagvcGwn6r+amhvx5tcvo/K6WlYPD5yG+6b/mqtQ9RFJCCFu5w3Lli3DxYsXkZ6eDkmS\nkJqaiqlTpyI/Px+enp7a81avXo2ioiLt3ZSqqirtsezsbD3FJyJ9yS09jZTsr2U1laRCbPAyeDhy\n6ajuCAgI0P7ewcG0dnDr6dgOcHwnMmYaTSuSzm3HlcocWd3DcSRig5ZxFapu0NfY3uX0kpv97ne/\nQ2pqKlJSUrr1ryL+y4nINOSWnta5wy1BwrTAJWy4BwCO7UT9kxACKdk7dRru4faeiBl1HxvuPtbt\npvuZZ57BZ599hqSkJIwYMUJbd3V1BQCo1WrZ3RC1Wq091l5EREQP4xpGeno6AOPL1caY8zFbzxhT\ntrRz+3Aw9RsI/PxDLwkSVs3/I8YHRCmYTJcxfd06cvMdX1Ohz7EdML7/Nsb8d8aYswHGnY/ZuiaE\nwPZ9b+JSmXxVIkdbZ/z+F3+FrdUghZJ1zFi+bh3R19jerTndTz/9ND799FPs3bsXgYGBsmO+vr5w\ndXVFYuLPa/k2NDQgJSUFUVHG9Q2biOSOnk3Ch4n/kO1GJkFC9Kh7jK7hJv3j2E7UP7Xts5By6gdZ\n3d7aEbNGrzC6hnug6PJO95o1a/Dhhx9ix44dcHBwQElJCQDA3t4ednZ2kCQJa9euxYYNGxAUFISA\ngACsX78e9vb2WLGCT8MSGasDGd/h831vyWoqSYWpgYvhMyxYoVTUVzi2E/VPzS3N+PinrUg/v19W\nd7AbihlBD8DGkg23Urpsuv/9739DkiTMnDlTVo+Pj8fzzz8PAHj22WdRX1+PNWvWoLKyEpGRkUhM\nTISdnZ1hUhNRjwkhkJj2Ob479JGsrpJUeGje79FaxZ0mBwKO7UT9T11jLd7+9q/IKcyU1W2tBuHx\nxXEounRVoWQEdKPp1mg0XZ0CAIiLi0NcXFyvAxGR4bT9yLH9TpNmKnM8dOfvMC4gSjuvjvo3ju1E\n/UtFdSle//ollFQUyOp2NoPx2ML/hfswHzbdCrut1UuIyHRpNK3YnvQmDmb+KKtbmFvikbvXIdhn\nvELJiIioNwpKL+KNr9ejuk6+8c3wIe54bNH/YvgQN4WS0c3YdBMNAM0tTfjgxy04mSPf1MTa0ha/\nWfg/GOkRolAyIiLqjTN56Xj3h01oam6Q1X3dgvDrBc9hkM1ghZJRe2y6ifq56/XVeOubV5BbfFZW\nt7MZjCcWx3GnSSIiE3Xw9I/YnvQGNEI+XWycfxRWzn0aluZ8RseYsOkm6sfKq9T499cvorTyiqzu\nMMgJTy55AS5DPTt5JxERGSuN0OC71I+wO/0LnWMzJizCwqkPQSV1a1Vo6kNsuon6qXx1Dt7YuR41\ndddkddehXnhs0fMYOni4QsmIiKinmluase2nf+LY+QOyugQJ98T8CjHj7lYoGXWFTTdRP5SZm4b3\ndv1dZ46fv8doPHL3Othac51WIiJTU9dQi7e/fQU5V+S7TFqYW+KhO3+PsJGTFUpG3cGmm6gfEUJg\nz7Gv8M3BD2TbugNAeOA0rJj9FCzMLRRKR0REPVVercbrX78EdUWhrD7IxgGPLvwLRrgGdvJOMhZs\nuon6ieaWJnyy519IO7dP59is8Htw9x0rOcePiMgE5atz8ObOl7kkoIlj003UD1Rdr8Db37yCy+ps\nWV0lqXBvzCOYNna+QsmIiKg3OlsS0M8tGL9esA52XBLQZLDpJjJx+eocvPXtK6iqLZfVbazs8PC8\nPyLIZ5xCyYiIqDcOnv4RnyW9AdF+ScCAKPxyzlpYmFsqlIx6gk03kYkSQuDQmd34fN9baGltlh1z\ndvTAowueg7Ojh0LpiIiopzSaVnyb+hF+OvalzrEZExZj4dQHOV3QBLHpJjJBTc2N+CzpdRw9m6Rz\nLNhnAh6a9zvYWnGFEiIiU1NercYHP25BbpF8QzPpv9MFozld0GSx6SYyMaWVRXjn+7+hqOySzrHp\n4xdi8dSHoFKZ9X0wIiLqlbRz+7E96Q00NNXJ6hbmllg17w8I9ZukUDLSBzbdRCYkI+cwPtr9D50B\n2dLcCg/MWoPwUdEKJSMiop6qa6zF9r1v4NiFZJ1j9v9dEtCHSwKaPDbdRCagqaURO5LfQ8qpH3SO\nuTh6YvVdf4Kbk5cCyYiIqDdyrpzBBz9uQWXNVZ1jwT4T8IvZv8VgO0cFkpG+sekmMnJFZZeQsGsz\nisvzdY5NCJyK+2eugbWljQLJiIiop1pbW/DDkU+wO+0Lnc3MzM0ssHjaKkwLmw9JkhRKSPrGppvI\nSAkhkHzqe+xIfk9ndRKVygxLpj2M6LF3cUAmIjIxpZVX8P6u/4f80hydY+7DRuChO38HNydvBZKR\nIbHpJjJCNXXXsO2nrTiTl65zzMnBBQ/d+Xtu+UtEZGLalnr9cv9/0NTSqHN8xoRFuGvKSliYWyiQ\njgyNTTeRkTmRfRCfJb2B6/XVOscmBcfivumPcjoJEZGJqa2vxsc/bcXp3KM6xxzshmLlnKcxynus\nAsmor7DpJjIStfXV2J70Bk5kH9Q5Zm1pi2Wxv0FEUIwCyYiIqDfOXj6BjxL/geq6Sp1jY0dG4v6Z\nT3A79wGATTeREcjIOYTP9r6OmvoqnWMj3Ebhobm/g5ODiwLJiIiop5pbmrDz4PvYf/JbnWOWFta4\nN+YRRIbM5LM5AwSbbiIF1dRdwxf7/4PjHazNaqYyx7zJyzEz4h6YcbMbIiKTcquVp3xcA/Hg3Gcw\nfIibAslIKWy6iRQghECO+iQ+T9+CusZaneOezn5YOfspuA8b0ffhiIiox1pam3HmyiFsO3xIZ+Up\nSVJhzsT7cOekZTAzYws20PC/OFEfKy7Px67TCbhaU6hzzExljjsnL8Os8Hs4IBMRmRAhBI5fSMGO\n42+hrkn3Qfihg53x4Nxn4OcerEA6Mgb8rk7UR5paGvHjkc+w5/gOaDStOsc9hvti5eyn4DHcV4F0\nRETUU/nqHHy5/z/ILT7b4fFJwbG4N+bXsLGy7eNkZEzYdBMZmBACGTmHsCPlPVRUl+octzS3wvwp\nDyBm3ALO3SYiMiFV1yvw7cEPceTs3g6P29kMxn0xv0b4qGl9nIyMEZtuIgO6cvUSvjzwH2QXnu7w\n+OgREVga+yiGDnbu42RERNRTzS1NSDr+NRLTv0BTc4POcUlSYfq4uzF38jLYWg1SICEZIzbdRAZQ\nW1+N7w9tw8HMRAih0TluY2mPSb5zcM/clVwqiojIRAghcDLnEL7u5CeXAODpGIAI31mYMW1uH6cj\nY6fq6oQDBw5g4cKF8PT0hEqlQkJCgs458fHx8PDwgK2tLWJjY5GVlWWQsETGrrmlGUnHd+KlhMeR\ncnqXTsOtklSIGXc3Fo1/DD7Dgtlwk6I4vhN1X0FpLv7xxf/g3e//1mHD7TrUC48vjsOMkOUYbOOk\nQEIydl023devX0dYWBheffVV2NjY6DQJGzduxObNm7F161akpaXB2dkZs2fPRm2t7jJoRP2VRtOK\no2eTsP79J/BV8juob7yuc06Q9zj86Rev4t6YR2BpbqVASiI5ju9EXau+fg0f//QaNn38e1y8ckbn\nuK21Pe6b/ij+9IstCPYZr0BCMhVdTi+ZN28e5s2bBwBYtWqV7JgQAlu2bMG6deuwZMkSAEBCQgKc\nnZ2xbds2PProo/pPTGREhBA4k5eOb1I/6HADBAAY7uCGJdGrMdo3gne2yahwfCfqXHNLMw5kfItd\nRz9DY1O9znGVpMK0sfNx5+TlsLO2VyAhmZpezenOy8uDWq3GnDlztDVra2tER0cjNTWVgzL1axev\nZOHb1A9xsajjH7dbWdrgzknLED32bliYW/RxOqLe4fhOA5VGaJCRcxjfHHwfZVUlHZ4T7DMBS6If\nhutQrz5OR6asV013ScmNv4wuLi6yurOzM4qKinpzaSKjlXPlDHYd/gQXOlmRxExljqlhd2LOxKWw\nt3Xo43RE+sHxnQaa5pZmpJ3bh73HvkLptY7/jjs7emDJtIcx2jeij9NRf2Cw1Utu9WP09PR0Q31s\nrxhrrjbGnK+/ZxNCQF11GRkFB6Cu7ngaCQD4DR+Dsd4xsLd2xPms7D7JZijMdvsCAgKUjtAnOL7r\nlzFnA4w7nz6yNbU04kLJMZwtOor65o6fV7A0s8ZY72iMcg1HfTmQXt715/b3r5uhGGM2fY3tvWq6\nXV1dAQBqtRqenp7aulqt1h4jMmVCCBRX5eFUQTJKqws6Pc/D0R8TfGLhaOfS6TlEpoTjO/V3dU01\nOFuUhgslx9Dc2tjhORIkBLpOwFjvGFhbcDdJ6p1eNd2+vr5wdXVFYmIiwsPDAQANDQ1ISUnBpk2b\nOn1fRIRx/Vim7V9VxparjTHn66/ZWjWtOHEhBUnHv0bh1dxOzwv0DMWdkffD32N0n2UzNGbruaqq\nKqUj6A3Hd8Mz5myAcefrTbbSyiLsPf4VjpxNQmtrS4fnqFRmCA+chlkR98LN6fbmbffXr5uhGXM2\nfY3tXTbd169fR3b2jR+TazQaXL58GSdPnoSTkxO8vLywdu1abNiwAUFBQQgICMD69ethb2+PFStW\n6CUgUV9qbKpH6pnd2HfiG1TWXO30vFHeY3HnpOUY6RHSh+mI9IvjOw0kl0uysefYV8jIOQQB0eE5\nluZWmDJmNmLHL8LQwcP7OCH1d1023WlpaZgxYwaAG/P44uLiEBcXh1WrVuGdd97Bs88+i/r6eqxZ\nswaVlZWIjIxEYmIi7OzsDB6eSF+u1ZYjOeN7pJze1eEa222CfMZj3uTl8HUL6sN0RIbB8Z36OyEE\nzuWfxJ70Lzt9+B0A7GwGI3rsXYgOmwc7m8F9mJAGki6b7unTp0Oj0d3G+mZtAzWRKRFCIOdKJpIz\nfsCpi4eh6WC7duDGnL7QkZMxM3wJfN1G9XFKIsPh+E79VaumFSezU7Hn2Fe3nCI4dLAzZkxYhMiQ\nWbC04KZlZFgGW72EyFg1NtXj6Ll9SDn1Q6cb2gCAuZkFJgfPQOyEhXB29OjDhERE1BOVNVeRdnYf\nDp35CeXV6k7Pcx82ArPCl2B84FSYqcz6MCENZGy6acC4cjUPh87sxtGz+9DQVNfpebbW9pgWNg/R\nY+fD3nZIHyYkIqLb1dTSiNMXj+Bw1h5cyD/V6XxtAPD3HINZ4fcg2Gc8dwimPsemm/q1ppYGJGd8\nj8NZe1BQevGW57oO9cK0sHmYFDIDVhbWfZSQiIhulxACZbVX8OmeNBy/kIz6W9xIkSAhbORkzIq4\nBz6ugX2YkkiOTTf1OxqhQU5hJpLPf4X8ivNo1XS8JBQAqCQVQkdOxrSw+QjwHMM7H0RERqyqtgJH\nz+3DgRPfoaq+/JbnmpmZY1JQLGaEL4YLpwiSEWDTTf1GUdllHDt/AMfOH0DFLZb7AwB7GwdEhc5B\n1Ji5cLQf1kcJiYjodjW3NOF07lEczdqLs/knITp56L2Nl/NITA6ZgfDAaVyJhIwKm24yaeXVahw/\nn4Jj5w+gqPzyLc+VIGGU91hEjp6FUL/JsDC36KOURER0O4QQKCi9iMNZe3D8fDLqGjvenr2NvY0D\nIoJiMCl4BjyGj+ibkES3iU03mZyq6xXIyDmM4+eTkVt8tsvzhw52xuSQmZgcPIObHRARGSkhBIrL\n85GZexTHLiTfcnUpAJAkFUL9JmJyyEyE+EyAmRlbGjJu/BtKJqGsqgSnLh5GRs5hXCo+f8un0wHA\nwswSno4B8HcZh7tm3guVpOqjpERE1F2trS24WJSF07lHkZmbdstl/tq4DxsBd/sA+A0fg6lTYvog\nJZF+sOkmo9R2xyPj4mGcyjmEK2WXunyPSlIh0HssIkZFI9RvMs6cztLWiYjIONQ3XsfZyydwOvco\nsi4du+UuwG3srO0RERSDySEz4DncD+np6X2QlEi/2HST0WhqaURO4RlkXTqGrEvHUFZV0q33+boF\nIXzUNIzzvwOD7biuNhGRsSmvViMzNw2ZuWnIvpIJjaa1y/eoJBVCRoRjcsgMjPaNgLkZn8Mh08am\nmxRVXq1GVt4xZF06jguFp9Dc0tSt93k7+yPMPxLhgdPg5OBi4JRERHQ7NEKDwtJcnM49gtO5aSjq\nxk8rgRs7AQd6hSHUbxJC/SZhsJ2jYYMS9SE23dSn6hvrkFuUhfMFp3D28nGoKwq79T5JUmGkezDG\n+gBfV7YAABGBSURBVE9BqN9kPhBJRGRkqmorkHMlE9mFp3Em7xiqrld06312NoMxZkQExvhNQpD3\nWFhZ2hg4KZEy2HSTQTW3NCGv+DwuFJzChcJTyC/JhqaLNVbbmJmZY5TXWISNjESo30RuyU5EZEQq\na64i58oZ5BSeQU5hJq5WFXf7vS6OnhjjNxGhfpMwwjUQKpWZAZMSGQc23aRXzS1NyFdn4+KVLFwo\nPI28onNobu3elBEAcBw0DCEjwhHiG45Az1De8SAiMhLl1eobDfaVG012d1YaaSNJKvi5ByPUbyLG\n+E6EM3eIpAGITTf1SkNzHa5WF+JKSiYuFp1FgfriLbddb0/134E4ZEQ4QkaEw83Jm1uxExEpTAiB\nmvoKlFTn41ziQeQUZna50297lhbWCPYZj1C/SRg9Ipy7Q9KAx6abuk2jaUVJRSHy1TnIKz6H3KKz\nUFd2b072zVwcPRHoFYZAr1AEeIXC1mqQAdISEVF3NTU34kpZHgpKL+JS8QXkXMnEtdry27qGSmUG\nbxd/+HuMQYDnGPh7jIaFuaWBEhOZHjbd1CEhBMqr1chX5yBfnY3L6hwUlF5EU3PDbV/LcdCwG022\ndxgCPcPgMGioARITEVF33NxgF6gvIr80B+qKwm4/b9PGTGUOH9cAbZM9wm0UrCysDZSayPSx6SZo\nhAblVWoUlV1C4dU8baN9vaGmR9dzGuwCX/cgjHQPQaBXGIY5uHLKCBGRAppaGnHl6iUUlOagQH0R\nBaUXUVJRcNsNNnBjOb8RroHw9xgDf88xGOEWCEtzKwOkJuqf2HQPMI3NDSgqu4yisku4cjUPV8ou\noajsEhp7cAcbACRIcLRzQWhABHzdguDnHowhg5z0nJqIiLpS11CLkopCFF7N/e9d7JweN9jAjTvZ\nw+09MT54CgI8x8DHJYDTRYh6gU13P9XU0oirlUUoqShESUUBSioKUFR2GWXXiiEgenxdO5vB8HH2\nh7drAPzcglFZfB0W5laIiIjQY3oiIuqIEAI1dVUoqSiAuqIAJRWF2v+trqvs1bWHObjC28UfXs4j\nMcJ1FMquVMNMZc7xnUhP2HSbuPrGOqgr2wbdtgG4EOVV6l411wBgZWENL+eR8HYJgI9rALxd/DHU\n3lk2VST9anpv/whERNSOEAKVNWVQVxaipLzgv032jZsodY21vb7+MAdXeDmP/O8Y7w9PZz+dh9or\nizm+E+kTm24T0NTSgJqGShy/kIKr14pRdq0YV6uKUXatpNd3NtrYWNnBY9gIeAz3hedwX3i7BMLF\n0Z0bFhARGYgQAvXNtcgtOovyajXKqtQou1YMdUUh1JWFPZ72156Tgwu8nf21TbaX80jYWnPVKKK+\nxqbbCLRqWnGttgwV1VdRWXMVZVUlKLtW8t/GuvjnBxozev9ZEiQMG+L23wZ7BNyHjYDHMF842g/j\nw45ERHrW2FSvbajLq9Qor77xv2XVN8b5Vk0LkKafzzJTmcPZ0R0uQz3h5ewPbzbYREaFTXcfaGpu\nREVNKSpryv5/e/cb09S9hwH8abv+O+3pgRZoEbiKi9syrzFO8CphssTMZS+uiUs2XZYlmuWSZRlz\n+mJzl1dzRO+d0Zgl4LJ5E3nhIlNfmHiZYYkuQuS+MIIiROPU6e4UNmEU+o86+N0XhSpakJ6ec4rc\n55M00PKrPH49PPutKedgYOhX/D78GwaGfks8NvQbBsMDECp/0WUqJpjg9RTA7y1GwFsMf24xAr4/\nYV7efJ7SiYhIA0IIhGPDCIb6MTh+S7xwcn9zHYoGNf++1qdsiW7PLUn0u7cEAV8J8jx+WCz8zzrR\nbMWfzgyMjY0iFB3CYKgfwfAAhsK/3/88NIBgeACD4QGEo0O6ZTCbLcjPKUQgd7x4xwvYn1sEm5Wn\nciIiUuOP0XvjnT6AYLgfg8P9iY+hgeQmOxgewB+j93TL4LRJ8PtKEMgtRsBXMv7iSQly5XyYTWbd\nvi8R6YOb7ocIIRCNhxGKBDEcCSIUTXwcjgYxHBnEUHhgvIQHMBz+XfWpmNJhNlkgO3JREihFXk4h\n8pUA8nIKkacE4JXz+coGEdEMjI6NIhwdRig6OKnfkz0fGcRguB/B0ACGI4OGZLJa7PB7i+DzFMCn\nBODzFKAgtwgBXwk8Ui7f9kc0h8z53dro2CgisRAiIyGEo8OIxIYRjg1NKtpfem8hdi+C4xf2IxQJ\nJt5jZzBZyoFXzkeuJx8+TwHylELk5xQiTynEj1duwGwy87RNREQPuPfHPURHQgjHQim7PRQN4nbf\nz4jGwzh2Po5IdDjjszqly2y2wCvnw6f4kecJwKv4kaf44fP48fP1O7A95UB5ebmhmYgoO56ITfeY\nGMNIPIZYPIxYPJrcRCdKNpS4HxtObqzDI8Pjj4UQi0eyHR9mswU5bh+8cj68ngLkyvmJDbacD68n\n8XG6Cw6YTTcNTEtEZJxEv0cRHYlM2kBHHvw8+Vg4eT88EkJco7N7ZMJudSDHnQfF7UWO24ccd17y\nVes8xQ/F7YNlirNA/fqzMa+mE9HskJVN98Vr/0F0JIJYPHGb6vPYSATReAQj8ajhr07MlOSQkePy\nwuP2QnF5keP2wuOa+NwHxeWFLCk89R4R/V+48GN7sscT/R2ZdH+i2+9/PZrtyCmZYIIs5UBxe6G4\nfciZ6HS3b/yjF4rLB6ddynZUInpCaLbpbmhowO7du9Hb24vFixdj3759qKysTLn2wIl/aPVtdWG3\nOuCWFMjOnPGPCmRJgcvpmbSZ9rhyeUlcIprz0un3f/37nwanS4/kkCE7lWS33+/4HLidnuRmWnHl\n8vdliEhTmjRKU1MTPvzwQ+zfvx+VlZWor6/Hq6++ip6eHpSUlGjxLVQzmcyQ7C5IDhmSww2X3Z0o\nXUmBW8qB7FTQ+8uvcFhdWLF8JdxOhWf9ICIaN5v73Wwyw/lAr0sON+TxXndLiY30nf/2wWF14S9l\nq+B2eLiRJqKs0aR99u7di82bN+Odd94BAHzxxRc4efIk9u/fj507d2rxLWC3OuCwu+CwOeG0ueAa\nL9jETYbLIcM1/rlkTzzucshw2KXHnlrpXDRxqVuvp0CTrEREc4Vh/W6TEn1uf7DXJ+7LyU5P9r5d\nhsPmfOzZPc6FEv2uuLyaZCUiUivjTXc8Hsf58+fx0UcfTXp87dq1OHv2bMrn/Lm0HA67BKctsYl2\n2F1w2qTEhtrugsMmwWGT4LRLcNglOKxOvieaiMhgavp9ycIV4z3uhGO84+/ff6Dbbex3Ivr/kvGm\n++7duxgdHYXf75/0eEFBAXp7e1M+p3pdbabfloiIdKam3//2178bEY2I6ImTlTe3BYPaXxY3E4sW\nLQIw+3JNmM35mE0dZlNnNmejhNn2bzObj5nZnA2Y3fmYTR1my66MryObl5cHi8WCvr6+SY/39fWh\nsLAw0z+eiIiyhP1ORKSdjDfdNpsNy5cvR0tLy6THv//+e1RUVGT6xxMRUZaw34mItKPJ20u2bduG\nt99+GytWrEBFRQW+/PJL9Pb24t13302uURRFi29FREQGYr8TEWlDk033G2+8gf7+ftTV1eHOnTtY\nsmQJmpubs34OVyIiygz7nYhIGyYhxOy8vjoRERER0RyR8Xu6H9TQ0IDS0lI4nU6UlZWhra1t2vVd\nXV2oqqqCJEkoLi7GZ599pmUc1dl++uknmM3mR24Pv69RC2fOnMG6detQXFwMs9mMxsbGxz7HqLml\nm83Iue3atQvl5eVQFAUFBQVYt24duru7H/s8I2anJptRs6uvr8fSpUuhKAoURUFFRQWam5unfY5R\nx1u62Yw83h62a9cumM1m1NTUTLvOyI7TG/s9fex3ddjv6rDftaFrvwuNHD58WFitVnHgwAFx+fJl\nUVNTI9xut7h161bK9cFgUPj9frFhwwbR3d0tjh49KmRZFnv27NEqkupsN27cECaTSbS0tIi+vr7k\nLR6Pa56tublZ1NbWiqNHjwpJkkRjY+O0642cW7rZjJzbK6+8Ig4ePCi6u7tFV1eXWL9+vQgEAmJg\nYGDK5xg1OzXZjJrd8ePHxcmTJ8W1a9fE1atXRW1trbBaraKzszPleiOPt3SzGXm8Pai9vV2UlpaK\npUuXipqaminXGTk7vbHf1WG/q8N+V4f9njm9+12zTfeKFStEdXX1pMcWLVokPvnkk5TrGxoahKIo\nIhaLJR+rq6sTRUVFWkVSnW3iH/vcuXOaZ5mO2+1+bPEZObd0s2VrbkIIEQqFhMViESdOnJhyTbZm\nN5Ns2Zyd1+sVX331VcqvZWtmM8mWjZkNDg6Kp59+Wvzwww/ipZdemraUsz07LbHfM8d+V4/9rh77\nfeaM6HdN3l4ycangtWvXTnp8uksFt7e348UXX4Tdbp+0/vbt27h586YWsVRnm/Daa6/B7/ejsrIS\nx44d0yxTJoyaWyayMbehoSGMjY0hNzd3yjXZmt1Msk0wcnajo6M4fPgwYrEYVq9enXJNtmY2k2wT\njJxZdXU1Xn/9dVRVVUE85tdhnoSf1ZlgvxvnSThm2O/pZ5vAfp95tglzrd812XSruVRwb2/vI+sn\n7k/1HKOyybKMPXv24MiRI/juu++wZs0abNiwAYcOHdIsl1pGzU2NbM5ty5YtWLZsGVatWjXlmmzN\nbibZjJxdV1cX3G43HA4Hqqur8e233+LZZ59NudbomaWTzejj7euvv8b169dRV1cHADCZTNOun80/\nq+lgvxtnNh8z7Hf12djv6Webq/2elcvAA4//C2WTz+fD1q1bk/dfeOEF9Pf34/PPP8dbb72VxWSc\nWyrbtm3D2bNn0dbWNu18sjG7mWYzcnbPPfccLl68iGAwiCNHjmDjxo04ffo0ysrKHllr9MzSyWbk\nzK5cuYLa2lq0tbXBYrEAAETi7XlTPmc2/6zqbTb/3dnv6rDfH8V+1y/bXO13TV7pVnOp4EAg8Mj/\nDUw8PxAIaBFLdbZUysvLcfXqVc1yqWXU3LSi99y2bt2KpqYmnDp1CgsWLJh2rdGzSydbKnrNzmq1\nYuHChVi2bBl27tyJlStXor6+PuVao2eWTrZU9JpZe3s77t69i8WLF8NqtcJqteLMmTNoaGiAzWbD\nvXv3HnnOk/azOhX2u3GetGOG/c5+1ytbKnOh3zXZdKu5VPCqVavQ2tqKkZGRSeuLioowf/58LWKp\nzpZKZ2cn5s2bp1kutYyam1b0nNuWLVuSpffMM888dr2Rs0s3WypGHXOjo6MYGxtL+bVsH2/TZUtF\nr5mtX78ely5dwoULF3DhwgV0dnairKwMb775Jjo7O2G1Wh95TrZnpxX2u3GetGOG/c5+1ytbKnOi\n3zX4hU8hhBBNTU3CZrOJAwcOiJ6eHvHBBx8IWZaTp23avn27WLNmTXJ9MBgUgUBAbNy4UVy6dEkc\nO3ZMeDwesXfvXq0iqc528OBB8c0334ienh5x+fJlsXv3bmGz2cS+ffs0zxYKhURHR4fo6OgQkiSJ\nHTt2iI6Ojlkxt3SzGTm39957T3g8HnHq1Clx586d5C0UCiXXZGt2arIZNbuPP/5YtLa2ihs3boiL\nFy+K7du3C7PZLFpaWlLmMvJ4SzebkcdbKlVVVeL9999P3s/m7PTGfleH/a4O+10d9rt29Op3zTbd\nQiROobJgwQJht9tFWVmZaG1tTX5t06ZNorS0dNL6rq4usXr1auFwOMS8efPEjh07tIyjOltjY6N4\n/vnnhcvlEh6PR5SXl4tDhw7pkuv06dPCZDIJk8kkzGZz8vPNmzenzCaEcXNLN5uRc3s408Tt008/\nTa7J1uzUZDNqdps2bRLz588XdrtdFBQUiJdffjlZeqlyCWHc8ZZuNiOPt1QePqVUtjtOb+z39LHf\n1WG/q8N+145e/c7LwBMRERER6UzTy8ATEREREdGjuOkmIiIiItIZN91ERERERDrjppuIiIiISGfc\ndBMRERER6YybbiIiIiIinXHTTURERESkM266iYiIiIh0xk03EREREZHO/geMu0F6HYQwigAAAABJ\nRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0xa0594a8>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "ys = euler(0, 4, 1, dx, step=0.00001)\n",
    "plt.subplot(1,2,1)\n",
    "plt.title('Computed')\n",
    "plt.plot(np.linspace(0, 4, len(ys)),ys)\n",
    "plt.subplot(1,2,2)\n",
    "t = np.linspace(0, 4, 20)\n",
    "plt.title('Exact')\n",
    "plt.plot(t, np.exp(t))\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "exact answer= 54.5981500331\n",
      "euler answer= 54.59705808834125\n",
      "difference = 0.00109194480299\n",
      "iterations = 400000\n"
     ]
    }
   ],
   "source": [
    "print('exact answer=', np.exp(4))\n",
    "print('euler answer=', ys[-1])\n",
    "print('difference =', np.exp(4) - ys[-1])\n",
    "print('iterations =', len(ys))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Here we see that the error is reasonably small, but it took a very large number of iterations to get three digits of precision. In practice Euler's method is too slow for most problems, and we use higher level methods.\n",
    "\n",
    "Before we go on, let's formally derive Euler's method, as it is the basis for the more advanced Runge Kutta methods used in the next section. In fact, Euler's method is the simplest form of Runge Kutta.\n",
    "\n",
    "\n",
    "Here are the first 3 terms of the Euler expansion of $y$. An infinite expansion would give an exact answer, so $O(h^4)$ denotes the error due to the finite expansion.\n",
    "\n",
    "$$y(t_0 + h) = y(t_0) + h y'(t_0) + \\frac{1}{2!}h^2 y''(t_0) + \\frac{1}{3!}h^3 y'''(t_0) +  O(h^4).$$\n",
    "\n",
    "Here we can see that Euler's method is just using the first two terms of the Taylor expansion. Each subsequent term is smaller than the previous terms, so we are assured that the estimate will not be too far off from the correct value. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Runge Kutta Methods"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "Runge Kutta integration is the workhorse of numerical integration. As mentioned earlier there are a vast number of methods in the literature. In practice, using the Runge Kutta algorithm that I present here will solve most any problem you will face. It offers a very good balance of speed, precision, and stability, and it is the 'go to' numerical integration method unless you have a very good reason to choose something different. If you have the knowledge to make that decision you have no need to be reading this section!\n",
    "\n",
    "Let's just dive in. We start with some differential equation\n",
    "\n",
    "$$\\ddot{y} = \\frac{d}{dt}\\dot{y}$$.\n",
    "\n",
    "We can substitute the derivative of y with a function f, like so\n",
    "\n",
    "$$\\ddot{y} = \\frac{d}{dt}f(y,t)$$."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Deriving these equations is outside the scope of this book, but the Runge Kutta RK4 method is defined with these equations.\n",
    "\n",
    "$$y(t+\\Delta t) = y(t) + \\frac{1}{6}(k_1 + 2k_2 + 2k_3 + k_4) + O(\\Delta t^4)$$\n",
    "\n",
    "$$\\begin{aligned}\n",
    "k_1 &= f(y,t)\\Delta t \\\\\n",
    "k_2 &= f(y+\\frac{1}{2}k_1, t+\\frac{1}{2}\\Delta t)\\Delta t \\\\\n",
    "k_3 &= f(y+\\frac{1}{2}k_2, t+\\frac{1}{2}\\Delta t)\\Delta t \\\\\n",
    "k_4 &= f(y+k_3, t+\\Delta t)\\Delta t\n",
    "\\end{aligned}\n",
    "$$\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "def runge_kutta4(y, x, dx, f):\n",
    "    \"\"\"computes 4th order Runge-Kutta for dy/dx.\n",
    "    y is the initial value for y\n",
    "    x is the initial value for x\n",
    "    dx is the difference in x (e.g. the time step)\n",
    "    f is a callable function (y, x) that you supply to compute dy/dx for\n",
    "      the specified values.\n",
    "    \"\"\"\n",
    "    \n",
    "    k1 = dx * f(y, x)\n",
    "    k2 = dx * f(y + 0.5*k1, x + 0.5*dx)\n",
    "    k3 = dx * f(y + 0.5*k2, x + 0.5*dx)\n",
    "    k4 = dx * f(y + k3, x + dx)\n",
    "    \n",
    "    return y + (k1 + 2*k2 + 2*k3 + k4) / 6."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's use this for a simple example. Let\n",
    "\n",
    "$$\\dot{y} = t\\sqrt{y(t)}$$\n",
    "\n",
    "with the initial values\n",
    "\n",
    "$$\\begin{aligned}t_0 &= 0\\\\y_0 &= y(t_0) = 1\\end{aligned}$$"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAuMAAAEWCAYAAADMypmTAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzs3X1c1fX9//HHOVzIpUdADkfBFA0FqZhp5kU/ykRXy2l+\ntzLNVsvNtTkXYxtNs3RlmOXXyLTW182L6Zy15bd20fqSZaXTmphdKOJF4gXgOSoiyPW5+v2hUWeI\nCAIHDs/77cYNeX/e73Nen94STz6+P++Pwe12uxERERERkXZn9HYBIiIiIiJdlcK4iIiIiIiXKIyL\niIiIiHiJwriIiIiIiJcojIuIiIiIeInCuIiIiIiIlyiMi4iIiIh4SZNh3OFwMHfuXPr3709wcDD9\n+/fnsccew+l0evRbsGABsbGxhISEMGbMGPLy8jyO19bWMnv2bKKjowkLC2PSpEkUFRW17tmIiIiI\niHQiTYbxrKwsXn75ZV544QX279/P888/z4svvsiiRYvq+yxevJilS5eyfPlydu7cidlsZty4cVRU\nVNT3SU9PZ9OmTWzcuJGtW7dSXl7OhAkTcLlcbXNmIiIiIiIdnKGpJ3B++9vfpmfPnqxevbq+7f77\n7+fMmTP87W9/w+1207t3b372s58xZ84cAGpqajCbzSxZsoSZM2dSVlaG2WxmzZo1TJ06FYDCwkL6\n9u3LP//5T8aPH9+GpygiIiIi0jE1eWX89ttv591332X//v0A5OXlsWXLFu644w4ACgoKsNlsHoE6\nKCiI1NRUtm/fDsCuXbuw2+0efeLi4khKSqrvIyIiIiLS1fg31eEnP/kJhYWFJCUl4e/vj8PhYN68\neTz00EMAWK1WAGJiYjzGmc1miouL6/v4+fkRFRXl0ScmJgabzdYqJyIiIiIi0tk0GcaXLVvG6tWr\n2bhxI8nJyezevZuHH36Yfv368eCDD15yrMFgaFYxZWVlzeovIiIiItKRmEymZvVvcpnKU089xdy5\nc7n77rtJTk5m+vTpZGRk1N/AabFYABpc4bbZbPXHLBYLTqeTkpISjz5Wq7W+j4iIiIhIV9NkGHe7\n3RiNnt2MRiNf3vcZHx+PxWIhJyen/nhNTQ3btm1j1KhRAAwdOpSAgACPPoWFheTn59f3ERERERHp\nappcpnLnnXfy9NNPEx8fz+DBg9m9ezfPPfcc999/P3B+KUp6ejpZWVkkJiaSkJDAwoULCQ8PZ9q0\nacD5y/UzZswgMzMTs9lMZGQkGRkZpKSkkJaWdtH3be4lfulYcnNzARg2bJiXK5Erpbn0HZpL36G5\n9A2aR99xJUutmwzjzz33HN27d2fWrFnYbDZ69erFzJkzefzxx+v7ZGZmUl1dzaxZsygtLWXEiBHk\n5OQQGhpa3yc7Oxt/f3+mTJlCdXU1aWlprF+/vtnrykVEREREfEWT+4y3p6//VqEr452bftv3HZpL\n36G59B2aS9+gefQdV5Jhm1wzLiIiIiIibUNhXERERETESxTGRURERES8RGFcRERERMRLFMZFRERE\nRLxEYVxERERExEsUxkVEREREvERhXERERETESxTGRURERES8RGFcRERERMRLFMZFRERERLxEYVxE\nRERExEsUxkVEREREvERhXERERETESxTGRURERES8RGFcRERERMRLFMZFRERERLxEYVxERERExEsU\nxkVEREREvKTJMN6vXz+MRmODjwkTJgDgdrtZsGABsbGxhISEMGbMGPLy8jxeo7a2ltmzZxMdHU1Y\nWBiTJk2iqKiobc5IRERERKSTaDKM79q1C6vVWv/x8ccfYzAYmDJlCgDPPPMMS5cuZfny5ezcuROz\n2cy4ceOoqKiof4309HQ2bdrExo0b2bp1K+Xl5UyYMAGXy9V2ZyYiIiIi0sE1GcajoqIwm831H//4\nxz8wmUzcfffduN1usrOzmTNnDpMnTyY5OZm1a9dy7tw5NmzYAEBZWRmrVq1iyZIljB07liFDhrBu\n3To+++wzNm/e3OYnKCIiIiLSUTVrzbjb7eb3v/8906dPp1u3bhQUFGCz2Rg/fnx9n6CgIFJTU9m+\nfTtw/sq63W736BMXF0dSUlJ9HxERERGBolMVTXcSn9KsMP72229z5MgRfvjDHwJgtVoBiImJ8ehn\nNpvrj1mtVvz8/IiKivLoExMTg81ma3HhIiIiIr4k78gZBt3jZPKcz6mqsXu7HGkn/s3pvHLlSoYP\nH861117bZF+DwdDiogByc3OvaLx0DJpH36G59B2aS9+hufQNubm52J0upj9roqpmIG98cA0Dpxxh\n8fcLGRQX7O3y5DIkJCS0eOxlXxk/efIkf/3rX+uvigNYLBaABle4bTZb/TGLxYLT6aSkpMSjj9Vq\nre8jIiIi0pU9u8lOwYmB9V8Xn+7HXz+6sgub0jlc9pXxNWvWEBQUxNSpU+vb4uPjsVgs5OTkMHTo\nUABqamrYtm0bS5YsAWDo0KEEBASQk5NTP7awsJD8/HxGjRrV6PsNGzasRSckHcOXV2s0j52f5tJ3\naC59h+bSN3w5j0fO9eSNf8V5HBt41Rf8ceEo/P30SJjOoKysrMVjLyuMu91ufve733HPPfcQEhJS\n324wGEhPTycrK4vExEQSEhJYuHAh4eHhTJs2DQCTycSMGTPIzMzEbDYTGRlJRkYGKSkppKWltbhw\nERERkc6u5JydHz4ditvtV98W3K2cNxZHKYh3EZcVxt977z2++OKL+u0Kvy4zM5Pq6mpmzZpFaWkp\nI0aMICcnh9DQ0Po+2dnZ+Pv7M2XKFKqrq0lLS2P9+vVXvK5cREREpLNyudw8sjqUsoqeHu1LZtsY\ndNXARkaJr7msMD5mzBicTmejx+fPn8/8+fMbPR4YGMiyZctYtmxZ8ysUERER8UErc6r47AvPpUYT\nRu/hx5Ob3ihDfIf+/UNERESknb2/+wRrc270aOvds5ANCxK9VJF4i8K4iIiISDs6U17DlMfcOJzd\n6tsC/Gv481MBhIUEeLEy8QaFcREREZF29F9zvuBkaS+PtkfuK2DkNdryuStSGBcRERFpJ4//Lo8P\nPhns0Tbqun0seDDJSxWJtymMi4iIiLSD93ef4Ok/xHu0RZlO8MbT8RiN2mGuq1IYFxEREWljX60T\nD6pv8/erJev+Q0SZ9Mj7rkxhXERERKSNTb7IOvHv3/YRQwaENDJCugqFcREREZE29PjKvWy9yDrx\nGWkK4qIwLiIiItJm3t1VzNPr+nu09exh1TpxqacwLiIiItIGbGeqmPKYscE68Y1PuLVOXOopjIuI\niIi0MpfLzR2/PEZJWYxH+6/u/YJbh/b2UlXSESmMi4iIiLSy2Uv38vH+QR5tNw/J46kfJXupIumo\nFMZFREREWtEr7xTw29cTPdp69Szk9cVXe6ki6cgUxkVERERayaHCMn64qAdut199W7fASt5YHIQp\ntJsXK5OOSmFcREREpBXU1jn51i9OU1Hdw6P9mVlFDEuM9lJV0tEpjIuIiIi0gnt/k8ehQs9tDL87\nZg+zvzuokREiCuMiIiIiV+zZDflseu8aj7aBfQ6z7vHBjYwQOU9hXEREROQKvLe7mHkv9/VoCwsp\n5c3/7km3QL9GRomcpzAuIiIi0kLFJRV8d64fdsdXD/YxGh2sfrSc/rEmL1YmncVlhfETJ05w//33\nYzabCQ4OJjk5mQ8++MCjz4IFC4iNjSUkJIQxY8aQl5fncby2tpbZs2cTHR1NWFgYkyZNoqioqPXO\nRERERKQdOZwuvplezJlys0f7L6bu5zu39PNOUdLpNBnGz549y+jRozEYDLz55pvk5+ezfPlyzOav\n/uItXryYpUuXsnz5cnbu3InZbGbcuHFUVFTU90lPT2fTpk1s3LiRrVu3Ul5ezoQJE3C5XG1zZiIi\nIiJt6L4n9rL3cIJH2y3X57H4J9c0MkKkIf+mOjzzzDPExsayZs2a+ra+fb9aF+V2u8nOzmbOnDlM\nnjwZgLVr12I2m9mwYQMzZ86krKyMVatWsWbNGsaOHQvAunXr6Nu3L5s3b2b8+PGtfFoiIiIibef5\nV/fzymbP0H1VzDH+uniglyqSzqrJK+Ovv/46w4cPZ8qUKcTExDBkyBBWrFhRf7ygoACbzeYRqIOC\ngkhNTWX79u0A7Nq1C7vd7tEnLi6OpKSk+j4iIiIincG2T6088mKcR1toUBlvLg0nLCTAS1VJZ9Vk\nGD98+DAvvvgiV199NTk5OTz88MP8+te/rg/kVqsVgJiYGI9xZrO5/pjVasXPz4+oqCiPPjExMdhs\ntlY5EREREZG2VnSqgslzoM4eUt9mNDhYOaeUwf0ivViZdFZNLlNxuVwMHz6cp556CoCUlBQOHjzI\nihUrmDVr1iXHGgyGFheWm5vb4rHScWgefYfm0ndoLn2H5rJ91TlcfP+5cErKEj3a703bwdU9QsjN\nLWnR62oeO7+EhISmOzWiySvjvXv3ZvBgzw3rExMTOXbsGAAWiwWgwRVum81Wf8xiseB0Oikp8fxL\narVa6/uIiIiIdGTz/+jmYKFnEB+euJtZ3wr2UkXiC5q8Mj569Gjy8/M92g4cOEC/fv0AiI+Px2Kx\nkJOTw9ChQwGoqalh27ZtLFmyBIChQ4cSEBBATk4OU6dOBaCwsJD8/HxGjRp10fcdNmxYi09KvO/L\n3/I1j52f5tJ3aC59h+ay/T2+ci/vfOx5cbKv5SibX7i2xevENY++o6ysrMVjmwzjP//5zxk1ahRZ\nWVncfffd7N69mxdeeIFFixYB55eipKenk5WVRWJiIgkJCSxcuJDw8HCmTZsGgMlkYsaMGWRmZmI2\nm4mMjCQjI4OUlBTS0tJaXLyIiIhIW3vtvSMs+oPnMoTwkDO89ZxJN2zKFWsyjA8bNozXX3+duXPn\n8uSTT9K3b18WLlzIj3/84/o+mZmZVFdXM2vWLEpLSxkxYgQ5OTmEhobW98nOzsbf358pU6ZQXV1N\nWloa69evv6J15SIiIiJtac/hMzzwZA+crq9Ct59fHX9cUMWgq/p4sTLxFQa32+32dhFf+volfpNJ\nj5DtzPRPb75Dc+k7NJe+Q3PZPs6eq+Xa+2wUnfIM3Qtn5jP3/qQrfn3No++4kgzb5A2cIiIiIl2N\nw+liXHpBgyD+3TF7WiWIi3xJYVxERETkP0z/zV525Q/yaLvu6gNs+E2ylyoSX6UwLiIiIvI1v1mV\nx6vveD7q3hxxgv97rg/+fopO0rr0N0pERETkglfeKWDh6qs92kKCyvnncwHERIY0Mkqk5RTGRURE\nRICd+07y4FNRnjunGOtY+1gpQxKivViZ+DKFcREREenyiksqmPArB9W14R7tv/nBYb5zSz/vFCVd\ngsK4iIiIdGk1tQ7SZls5VdrLo33qeO2cIm1PYVxERES6LJfLze2/2E/+0QEe7Tcm57PusWsaGSXS\nehTGRUREpMt6MGsP7+8e7NHW13KUnOcGYDTqKeHS9hTGRUREpEt6YnUef/in59XvHuGnePv5CMJD\nA71UlXQ1CuMiIiLS5fzhrcM8sSrBoy0osIK/Pevi6rjmPc5c5EoojIuIiEiX8t7uYn70tBmXy7++\nzc9oZ9Wjpxl9rcWLlUlXpDAuIiIiXcb+Y6VMfiSQWnuoR/sTP/yCe9LivVSVdGUK4yIiItIlnDpb\nzdjZFZRVRnm0PzhhD3O+py0MxTsUxkVERMTnVdXYSf1xEcWn4zzabx22l/95RFsYivcojIuIiIhP\nczhdpD18kP3HPPcST44/yD+eTdIWhuJVCuMiIiLi07776F4+3OO5DKWP+RjvrehDt0A/L1Ulcp7C\nuIiIiPisHz/7OX/d6rkMJbL7Sd5bEUGUKdhLVYl8RWFcREREfNLCNXm8/LpnEA8NKuOt54zE9+7u\npapEPDUZxhcsWIDRaPT46N27d4M+sbGxhISEMGbMGPLy8jyO19bWMnv2bKKjowkLC2PSpEkUFRW1\n7pmIiIiIXLDq74dY8HvPh/oEBlTx6lMVDEuM9lJVIg1d1pXxxMRErFZr/cfnn39ef2zx4sUsXbqU\n5cuXs3PnTsxmM+PGjaOioqK+T3p6Ops2bWLjxo1s3bqV8vJyJkyYgMvlav0zEhERkS5t0/tHeeiZ\nWI+H+hiNDl76lZXbR8RdYqRI+/Nvugv4+flhNpsbtLvdbrKzs5kzZw6TJ08GYO3atZjNZjZs2MDM\nmTMpKytj1apVrFmzhrFjxwKwbt06+vbty+bNmxk/fnwrno6IiIh0Ze/uKmb6gkgcziCP9id+cIjv\n36G9xKXjuawr44cPHyY2Npb+/fszdepUCgoKACgoKMBms3kE6qCgIFJTU9m+fTsAu3btwm63e/SJ\ni4sjKSmpvo+IiIjIlcrNP8WdjwRTUxfm0T7rO3uZe7+CuHRMTV4ZHzFiBGvXriUxMRGbzcbChQsZ\nNWoUe/fuxWq1AhATE+Mxxmw2U1xcDIDVasXPz4+oKM+nXcXExGCz2Rp939zc3GafjHQ8mkffobn0\nHZpL36G5/Mrx07XMeO5qKqp7eLRPGLGD+1MDO/R/q45cm1yehISEpjs1oskwftttt9X/+ZprrmHk\nyJHEx8ezdu1abrzxxkbHGQzaQF9ERETa3unyOn68/CrOVnguqU1N2cm8KQFeqkrk8lzWmvGvCwkJ\nITk5mUOHDnHnnXcCYLPZiIv76oYIm82GxWIBwGKx4HQ6KSkp8bg6brVaSU1NbfR9hg0b1tzSpAP5\n8rd8zWPnp7n0HZpL36G5/MqZ8hrufvAEJ0s9b8wcec0+Nr8wDH+/jruLs+bRd5SVlbV4bLP/htbU\n1LBv3z569epFfHw8FouFnJwcj+Pbtm1j1KhRAAwdOpSAgACPPoWFheTn59f3EREREWmuc5V1jP5R\nIUdO9PNov6b/Qd5ZNrBDB3GRLzV5ZfyXv/wlEydOpE+fPpw8eZInn3yS6upq7r//fuD8toVZWVkk\nJiaSkJDAwoULCQ8PZ9q0aQCYTCZmzJhBZmYmZrOZyMhIMjIySElJIS0trW3PTkRERHxSVY2dm358\nhP3HPNfqDogtYOtv+xLUrdn/+C/iFU3+TS0qKmLq1KmcPn2a6OhoRo4cyYcffkifPn0AyMzMpLq6\nmlmzZlFaWsqIESPIyckhNDS0/jWys7Px9/dnypQpVFdXk5aWxvr167WuXERERJqtts7JLT89xOdf\nJHq09+5ZyNaXYjCFdvNSZSLN12QY/9Of/tTki8yfP5/58+c3ejwwMJBly5axbNmy5lUnIiIi8jUO\np4uxD+8nd5/nVoXmiBP86+UeWKJCGxkp0jFpMZWIiIh0Ci6Xm2/9Io/tn3kG8cjuJ3n/xWD6WsK9\nVJlIyymMi4iISIfncrmZPGcPm3cme7SbQkt49wV/Bl0V4aXKRK6MwriIiIh0aC6Xm7vm7eFv267x\naA8LPkvO8y6uuzqqkZEiHZ/CuIiIiHRYLpebex7fw/++7xnEQ4LK+cd/13BDkrmRkSKdg8K4iIiI\ndEgul5t7f7OHv2zxDOJBgRW8lnWO/5fSy0uVibQehXERERHpkO57cg+vbPYM4t0CK/lL1lm+eWNc\nI6NEOheFcREREelwvvfk5/wp5z+CeEAlf15YyrdG9vFSVSKtT2FcREREOpQHnvqc9W95BvHAgCpe\nWXiGCaMVxMW36FmxIiIi0iG4XG7ue3JPgyvigQFVbHziNBNv6uulykTajsK4iIiIeJ3L5Wbq/D38\n+V3PIB7gX836+ae4M7WfdwoTaWMK4yIiIuJVLpeb7zy6hzc+aHhFfN3jp/jumH5eqUukPSiMi4iI\niNe4XG4mPrKHN7c3vFnzj78p4b9u7uedwkTaicK4iIiIeIXD6WLCr/LI+ajhPuKvLjzLhNFaIy6+\nT2FcRERE2p3d7mR8Rj7vf5zs0R7c7Rx/ySrn9hHaNUW6BoVxERERaVdVNXbG/PQQO/cN9mgPCSrn\n9acrSLtBD/SRrkNhXERERNpNWWUt/++ho+w5nOjRHhpUxt+XVHPzkFgvVSbiHQrjIiIi0i5KyqoZ\n9aNiDh5P8GjvHlrCP5c6GHlNLy9VJuI9CuMiIiLS5opOVXDTQ6c5au3v0R7Z/STvLPMjJcHipcpE\nvEthXERERNrUocIybv7JOU6UeO6OEhNZzHsrQhh0VYSXKhPxPmNzOi9atAij0cjs2bM92hcsWEBs\nbCwhISGMGTOGvLw8j+O1tbXMnj2b6OhowsLCmDRpEkVFRVdevYiIiHRoufmnuPGHNZwo8VwLHmc+\nzkcrwxXEpcu77DD+4YcfsnLlSq677joMBkN9++LFi1m6dCnLly9n586dmM1mxo0bR0VFRX2f9PR0\nNm3axMaNG9m6dSvl5eVMmDABl8vVumcjIiIiHcbmnUWM+ak/peVmj/b+sQXs/H1PrrJ091JlIh3H\nZYXxsrIypk+fzurVq4mI+Oo3WLfbTXZ2NnPmzGHy5MkkJyezdu1azp07x4YNG+rHrlq1iiVLljB2\n7FiGDBnCunXr+Oyzz9i8eXPbnJWIiIh41SvvFPDtX5morO7h0T44/hC5v48lJjLES5WJdCyXFcZn\nzpzJXXfdxc0334zb7a5vLygowGazMX78+Pq2oKAgUlNT2b59OwC7du3Cbrd79ImLiyMpKam+j4iI\niPiOF/6yn+m/6U2tPdSjfcQ1+8j9fTw9wrt5qTKRjqfJGzhXrlzJ4cOH6690f32JitVqBSAmJsZj\njNlspri4uL6Pn58fUVFRHn1iYmKw2WyNvm9ubu5lnoJ0ZJpH36G59B2aS9/REedy1eZKXv77aNxu\nP4/2W76xk0XfM7Dn80+8VFnH1RHnUZonISGh6U6NuGQY379/P48++ijbtm3Dz+/8N5Xb7fa4Ot6Y\nr4d2ERER8W0ul5tnXqtj07bUBsfuHL2dX383EKNR2UDkP10yjO/YsYPTp0+TnJxc3+Z0Otm6dSsv\nv/wye/bsAcBmsxEX99Wja202GxbL+f1CLRYLTqeTkpISj6vjVquV1NSG37BfGjZsWMvOSDqEL3/L\n1zx2fppL36G59B0dbS7tdicTMvfx9r//sx4Xv5yWzzOzRnulro6uo82jtFxZWVmLx15yzfjkyZPZ\ns2cPn376KZ9++imffPIJw4YNY+rUqXzyySckJCRgsVjIycmpH1NTU8O2bdsYNWoUAEOHDiUgIMCj\nT2FhIfn5+fV9REREpHM6e66W4T88xNv/TvZo9zPaWTzrIM/MSm5kpIhAE1fGTSYTJpPJoy0kJISI\niAgGDx4MnN+2MCsri8TERBISEli4cCHh4eFMmzat/jVmzJhBZmYmZrOZyMhIMjIySElJIS0trY1O\nS0RERNraUes5bplVwlHrQI/2bgGV/G7uSe4dn+ilykQ6j2Y/gdNgMHisB8/MzKS6uppZs2ZRWlrK\niBEjyMnJITT0qzuos7Oz8ff3Z8qUKVRXV5OWlsb69eu1rlxERKSTys0/xe0ZTkrKPJ+qGR56hjcW\n13LLkP6NjBSRr2t2GN+yZUuDtvnz5zN//vxGxwQGBrJs2TKWLVvW3LcTERGRDua1945w/5MRVNV4\nPrTHElnM5heCGdyvt5cqE+l8mh3GRUREpOtavH4f817uj9MV6NGe0Ocw76+wYIkKbWSkiFyMwriI\niIg0yeVy84On97DmH9c0OHZjcj5vZ19NWEiAFyoT6dwUxkVEROSSqmrs3PHLA7y/u2EQn5K2h3WP\nJ+Pvd1kP9RaR/6AwLiIiIo0qOlXB2Nk2Dhwf7NFuNDqY+70DPPHDa71UmYhvUBgXERGRi/rX51bu\nfARKyjx3RukWWMnKX59k+je1h7jIlVIYFxERkQZ+97dDzP5vC7V2zxsyI8JP8cZiFzelaOtCkdag\nMC4iIiL1XC43P1+2l+V/ScTt9vM41q/XEd5ZFkV87+6NjBaR5lIYFxEREeD8jZoTH9nPu7kNl5+M\nTtnHP5ckaMcUkVamW59FRESEguJyUu4/fpEg7mLmpD28vzxJQVykDejKuIiISBf35o7j3Ds/mLLK\neI/2wIAq/nt2EbO+ox1TRNqKwriIiEgX9sTqPJ5cPQCn0/OJmj3CT7FpkYNbhgz0UmUiXYPCuIiI\nSBdUW+fku/Py+Me/Gj7IZ0BcAZufj6avJdwLlYl0LQrjIiIiXUxBcTm3ZZzi4PGGQfz2kXt57alE\ngropIoi0B93AKSIi0oW8sfUoQx6o4+Bxz33C/Yx1PP7gPv6x5BoFcZF2pO82ERGRLsDlcvOrFXt5\n/tVBuFyeP/7DQ8/wx/lVTBg9uJHRItJWFMZFRER83JnyGr6deZgdnzfcP3xAbAH/91wU/WP7eKEy\nEdEyFRERER+2Y4+V5HtL2PF5UoNjE0bv4fN1V9E/1uSFykQEFMZFRER81rMb8hnz03BsZ3p7tAf4\nV/P0T/bz12eu1fpwES/Td6CIiIiPOVdZx12PHSDno4bLUswRJ/jLU0ZuSkn0QmUi8p+avDK+YsUK\nUlJSMJlMmEwmRo0axZtvvunRZ8GCBcTGxhISEsKYMWPIy8vzOF5bW8vs2bOJjo4mLCyMSZMmUVRU\n1LpnIiIiIny4x0bSNNtFg/iNyfns/WMEN6VYvFCZiFxMk2G8T58+PPPMM+zevZtdu3Zx6623cued\nd/Lpp58CsHjxYpYuXcry5cvZuXMnZrOZcePGUVFRUf8a6enpbNq0iY0bN7J161bKy8uZMGECLper\n7c5MRESki1n0h33c8tMwik/HebQbjQ5+dvde/vXbRKJMwV6qTkQupsllKhMnTvT4euHChbz00kv8\n+9//5rrrriM7O5s5c+YwefJkANauXYvZbGbDhg3MnDmTsrIyVq1axZo1axg7diwA69ato2/fvmze\nvJnx48e3wWmJiIh0HWWVtXx37kHeyW14NTwi/BRrH6tlwuiGD/gREe9r1g2cTqeTjRs3UlNTQ2pq\nKgUFBdhsNo9AHRQURGpqKtu3bwdg165d2O12jz5xcXEkJSXV9xEREZGWeSe3iEFTSi4axIcm7mfv\nH0OZMFrbFop0VJd1A+fnn3/OyJEjqa2tJTg4mFdffZVBgwbVh+mYmBiP/mazmeLiYgCsVit+fn5E\nRUV59IkVUDJ7AAAgAElEQVSJicFmszX6nrm5uc06EemYNI++Q3PpOzSXvsHlcnP/gg/Y8M6NOF2B\nHseMRjvT0z7kJ7cHU1iwj8ICLxUpl0Xfk51fQkJCi8deVhhPTEzks88+o6ysjD//+c/cc889bNmy\n5ZJjDAZDi4sSERGRxllL68hcZSL/2LAGx3qE23jyvv3cOCjUC5WJSHNdVhgPCAigf//+AAwZMoSd\nO3eyYsUKHn/8cQBsNhtxcV/dLGKz2bBYzt+pbbFYcDqdlJSUeFwdt1qtpKamNvqew4Y1/B+MdB5f\n/paveez8NJe+Q3PpG1b/4wt+9lwEldURDY6NTtnHpqx4onvc7IXKpLn0Pek7ysrKWjy2RQ/9cTqd\nuFwu4uPjsVgs5OTk1B+rqalh27ZtjBo1CoChQ4cSEBDg0aewsJD8/Pz6PiIiInJpZZW1TPjV58zI\n6t8giAcGVPHED/ex9cXBRPfQbikinUmTV8Z//etfM2HCBOLi4jh37hwbNmzg/fff56233gLOb1uY\nlZVFYmIiCQkJLFy4kPDwcKZNmwaAyWRixowZZGZmYjabiYyMJCMjg5SUFNLS0tr27ERERHzAmzuO\n8/2n/DhV2nBHlL6Wo7yWFcr1gwZ7oTIRuVJNhnGbzcb06dOxWq2YTCZSUlJ46623GDduHACZmZlU\nV1cza9YsSktLGTFiBDk5OYSGfrVWLTs7G39/f6ZMmUJ1dTVpaWmsX79e68pFREQuwW538qNn8vjD\nPxNxuT1/ZBsMTu4eu4/Vc5P0SHuRTszgdrvd3i7iS19fb2MymbxYiVwprYPzHZpL36G57Fx27jvJ\nlMcqOXKiX4NjptBTzJmyj8wZWhvemel70ndcSYbVr9IiIiIdiMPp4lcr8ljxlwE4nNENjt88JI+5\n3z1HRJh2SxHxBS26gVNERERa38f7TzF4WgHPv5KMwxnkcSy4Wzn/PfsAW5YnExGma2kivkLfzSIi\nIl7mcLp45MU8lv9lAHZHzwbHr+l/kNeyzCT0GeSF6kSkLSmMi4iIeNHug6eY+ngZB441fJx9YEAV\nP7/nCE/NHIzRqE0PRHyRwriIiIgX2O1OMl7Yx/+8cfGr4Yl9v2DjExFcd3XDkC4ivkNhXEREpJ29\nt7uYB560c8zWMGgH+FeTPuUwix5K1tVwkS5AYVxERKSdVFTZ+dGz+byyORGXq+GP4IF9DvPKkyZS\nEho+3EdEfJPCuIiISDv487tHmL00kJMXeYpmt4BK0u85qrXhIl2QwriIiEgbOn7yHA8sPMqWXRdf\n+/2NgQfYsMBMYl+tDRfpihTGRURE2oDL5Wbh2n08sz6WqpqGQTskqIz5M6z84p5Buhou0oUpjIuI\niLSyD/fYeOCpcxw4lnTR4//vG3msn38VfcyJ7VyZiHQ0CuMiIiKt5Oy5Wh569gCvbRmE02VucLxn\nDytLf1bN9G9qSYqInKcwLiIicoVcLjfPv3qAJ1ZFUVbZ8AZNP2MdU8cf4MVfJBIWEuCFCkWko1IY\nFxERuQIf7rExY1E5+44MvOjxgVd9wZpHwxlxzbXtXJmIdAYK4yIiIi1w6mw1s5Yc4n/fv/iSlLDg\ns2ROP8Hc7yXpBk0RaZTCuIiISDM4nC6eWJ3Pcxt7UVndcEmKweBkwuh9/M8jA4iJHOyFCkWkM1EY\nFxERuUyvvXeEjOcNHD958V1SBsQV8HJmELcO1ZIUEbk8CuMiIiJN2HO4hB8ttrFjz8VDuJakiEhL\nGZvqsGjRIm644QZMJhNms5mJEyeyd+/eBv0WLFhAbGwsISEhjBkzhry8PI/jtbW1zJ49m+joaMLC\nwpg0aRJFRUWtdyYiIiKtzHamirvnfc6QB8IuGsT9jHXcdeseCl4LYt4DepS9iDRfk2H8/fff56c/\n/Sk7duzg3Xffxd/fn7S0NEpLS+v7LF68mKVLl7J8+XJ27tyJ2Wxm3LhxVFRU1PdJT09n06ZNbNy4\nka1bt1JeXs6ECRNwuVxtc2YiIiItVFPrIGPZHgbcZecvW67B6Qxs0Of6Qfv56HflvPLktUSZgr1Q\npYj4giaXqbz11lseX69btw6TycT27du54447cLvdZGdnM2fOHCZPngzA2rVrMZvNbNiwgZkzZ1JW\nVsaqVatYs2YNY8eOrX+dvn37snnzZsaPH98GpyYiItI8LpebFZsO8uTqcE6fvfiDeSxRRTwzq47p\n39TTM0XkyjV5Zfw/lZeX43K5iIiIAKCgoACbzeYRqIOCgkhNTWX79u0A7Nq1C7vd7tEnLi6OpKSk\n+j4iIiLe9Mo7BSTcfYSHn0vg9FlLg+OhwWd55L48jr7Wi+nf7O+FCkXEFzX7Bs6HH36YIUOGMHLk\nSACsVisAMTExHv3MZjPFxcX1ffz8/IiKivLoExMTg81ma1HhIiIirWHzziIyllWy53DCRY/7+9Uw\nZewhstOvJsqkx9iLSOtqVhjPyMhg+/btbNu2DYOh6ZtULqdPY3Jzc1s8VjoOzaPv0Fz6Ds3leQeK\nq3nuf8PYdeA6LvYPxQaDkxuTPuVX36mhT89uFBzcS0H7l3lJmkvfoHns/BISLv7L/OW47DD+85//\nnFdffZUtW7bQr1+/+naL5fw/5dlsNuLi4urbbTZb/TGLxYLT6aSkpMTj6rjVaiU1NbXFxYuIiDRX\nga2GZX8NYsfeEbjcF/8xmNQ3j4cnlXD9gBCgW/sWKCJdymWF8Ycffpg///nPbNmyhYEDB3oci4+P\nx2KxkJOTw9ChQwGoqalh27ZtLFmyBIChQ4cSEBBATk4OU6dOBaCwsJD8/HxGjRp10fccNmxYi09K\nvO/L3/I1j52f5tJ3dPW53H+slJ8vK+Ltj67D6Qq4aJ/4XkfI+jFMGduxl6N09bn0FZpH31FWVtbi\nsU2G8VmzZrF+/Xpef/11TCZT/Rrx8PBwQkNDMRgMpKenk5WVRWJiIgkJCSxcuJDw8HCmTZsGgMlk\nYsaMGWRmZmI2m4mMjCQjI4OUlBTS0tJaXLyIiEhTCorLyXjhKP/4VwIO58VDdkxkMfMeqOTHkxO0\nV7iItKsmw/hLL72EwWCo35LwSwsWLODxxx8HIDMzk+rqambNmkVpaSkjRowgJyeH0NDQ+v7Z2dn4\n+/szZcoUqqurSUtLY/369Ve0rlxERKQxB4+f5VcrjvPm9qtxOK+5aJ+I8FP87O7TzL1vEAEBfu1c\noYjIZYTxy30oz/z585k/f36jxwMDA1m2bBnLli27/OpERESaKf9oKb9cXsj/fTQQZyMh3BRawkP/\nZWP+9wcR1M3czhWKiHyl2VsbioiIdESfHjzNr1+ysnlnAk7XxUN4WPBZZkws4skfDCIspGc7Vygi\n0pDCuIiIdGrv7z7BvJWl7PgsAZc76qJ9QoPP8r3bisj6cQKm0IsHdRERb1AYFxGRTumNrUf5zaoa\nPjkwEGj4xEyA8JAzfH/CCX7zA4VwEemYFMZFRKTTcLnc/O5vh1j6JyMHjjf+SHpTaAk/mGhl/oOD\nCAu5+NVyEZGOQGFcREQ6vKoaO0+vP8jKN0zYzlzdaL8ok42Zk0p49P6BhARpTbiIdHwK4yIi0mEV\nnapg/u8LePWdWCqqkhrtFxt9nJ/dXUX6XQkEBFx8yYqISEekMC4iIh3Ovz638uTq07ybO6DRPcIB\nro47TOZ0Nw/eMUAP6xGRTklhXEREOgSXy83v//4Fy151sbcgAYi5aD+DwckNSQeZe38oE28a0L5F\nioi0MoVxERHxKtuZKp5ef5gNOZGcKm08XPv71TBu+Bc8+cMYrh/U+JIVEZHORGFcRES84r3dxTy9\n7gxbdvXH7khutF9YSCnfvaWI3/ywH33M2p5QRHyLwriIiLSbqho7y1/7gpV/DeSLwnigV6N9+8Qc\n40eTqsi4J4GgbpHtV6SISDtSGBcRkTa3c99JFq+38daHfaiqGdRovy/Xg2dOD+G/bu7bjhWKiHiH\nwriIiLSJL6+Cr/67P/uPDQCiG+0bGnyWiTcV8ugDsQzup/XgItJ1KIyLiEirendXMc+/WsI7uVdd\n8io4wIDYAn4wsZaH70ogqNu17VShiEjHoTAuIiJXrLikguf+dIRX3wnn+MmruNRa8MCAKm65voBf\nTYtg7LDGH2kvItIVKIyLiEiL1NY5WfvPw6z+h4Pc/P44nY3viALQ13KUe79ZRcY9/Ynsrl1RRERA\nYVxERJrp7X8Xsvy1Ut7dFUdl9dWX7NstoJKbrz/CL+7pwbjh/dqnQBGRTkRhXEREmvTpwdO88NoJ\n3twegbUkFoi9RG8Xg64q4L7b7Mz6bn9MoboKLiLSGIVxERG5qILicl74yzHe+CCUghP9gKhL9jeF\nnWbCKCsZ0ywMSbj0FXMRETnP2FSHDz74gIkTJxIXF4fRaGTt2rUN+ixYsIDY2FhCQkIYM2YMeXl5\nHsdra2uZPXs20dHRhIWFMWnSJIqKilrvLEREpFUUnapg3v/kcc30g1x9dwjZryRfCOIXFxhQxc1D\n8lg3v4BTb0axbv61DElofAtDERHx1GQYr6ys5LrrruP5558nODgYg8HgcXzx4sUsXbqU5cuXs3Pn\nTsxmM+PGjaOioqK+T3p6Ops2bWLjxo1s3bqV8vJyJkyYgMvlav0zEhGRZik6VcHjK/dy7fQD9J3c\njay1SeQVXI3b7XfR/gaDk+T4gzz1o3ysf/Nny/Jk7h3fH3+/Jn+kiIjIf2hymcrtt9/O7bffDsAD\nDzzgccztdpOdnc2cOXOYPHkyAGvXrsVsNrNhwwZmzpxJWVkZq1atYs2aNYwdOxaAdevW0bdvXzZv\n3sz48eNb+ZRERKQph4vKWPm3Qv6+LYB9R+NxuQY3Oaav5SgT/18FP/1OHAl9BrZDlSIivu+K1owX\nFBRgs9k8AnVQUBCpqals376dmTNnsmvXLux2u0efuLg4kpKS2L59u8K4iEg7KbDV8NeP3Hz47GEO\nF12F2910ADdHnOBbI0v4yXcsDEvs1/ZFioh0MVcUxq1WKwAxMTEe7WazmeLi4vo+fn5+REV53vgT\nExODzWa7krcXEZFLcLnc/N+/i9jwf6W8t9tE0anRlzWuZw8r4244zYxvR3Hr0N5A77YtVESkC2uz\n3VT+c215c+Xm5rZSJeJNmkffobnsHKpqnbz7WTVbPg3lky/iOVfV1DaE50V2P8HIpCN8+0YH34gP\nxmg0gLuY3Nziti9aWkzfl75B89j5JSQktHjsFYVxi8UCgM1mIy4urr7dZrPVH7NYLDidTkpKSjyu\njlutVlJTU6/k7UVEhPPLT9762MWH+6I4WNgfhzPossbFRB5jRFIhd9zg4rq+QRiNgUBg2xYrIiIe\nriiMx8fHY7FYyMnJYejQoQDU1NSwbds2lixZAsDQoUMJCAggJyeHqVOnAlBYWEh+fj6jRo1q9LWH\nDRt2JaWJl335W77msfPTXHY8FVV2Nn1wnL9urWT7Z5FYz1zuMhIXfcxHuGN0FT/4toXrB/UF+rZl\nqdJG9H3pGzSPvqOsrKzFY5sM45WVlRw8eBAAl8vF0aNH+eSTT4iKiqJPnz6kp6eTlZVFYmIiCQkJ\nLFy4kPDwcKZNmwaAyWRixowZZGZmYjabiYyMJCMjg5SUFNLS0lpcuIhIV+Fyufkoz8bGzafZsiuQ\n/cf6YHfEX9ZYf79akvsf5VsjHdwYX0bvyED94BcR6UCaDOM7d+7k1ltvBc6vA58/fz7z58/ngQce\nYNWqVWRmZlJdXc2sWbMoLS1lxIgR5OTkEBoaWv8a2dnZ+Pv7M2XKFKqrq0lLS2P9+vVXvK5cRMRX\nHSos49V3ink718UnB8yUVcQAMU2OAwgPOcOwpBP8182BTL+tL6bQQYDWpYqIdERNhvFbbrmlyYfz\nfBnQGxMYGMiyZctYtmxZ8ysUEekCiksqeG1LEW//u47cfV8uPel+WWMNBif9LMe5+foKpqZFMHZY\nLEbjpR9dLyIiHUOb7aYiIiKNs5ZU8tp7Rby9s5Zd+SaKTsUCl/8gnbCQUoYMPMFtNxqZflscfcyX\nt2xFREQ6FoVxEZF2cKiwjP/94ARbPnbw6UET1pJeuN2XvxWWn7GOq+OOc/OQau66NZIx1/fGaIxs\nw4pFRKQ9KIyLiLQyh9PFjj02/rnjDNs/h70FUZSUxXC5y07Oc9HHXMjw5HLuGBXC5JvjMIVe3VYl\ni4iIlyiMi4hcoVNnq/nnjmLe+7iKnfnd+KKwFzV1FsDSrNeJiSxmyMBS0m7w565bY+lj1raDIiK+\nTmFcRKQZauucbP3Uyubcs3y0F/YdieBkaQzQv9mvZY44wZCBZ7h1mD/fubkX/WMv72mZIiLiOxTG\nRUQa4XC6+HDPSd79+Awf7XWx70gohSd74XD2Bi73QTvnGQxO4qKL+MbAcm4dGsidqb3pa2n+64iI\niG9RGBcRAWpqHWz7zMYHn5axK99F/tFQCk/GYHdc/v7eXxcYUMWA2GKuH1TDrUNDmHhTb6JMWnYi\nIiKeFMZFpMspLqlgy66TfLS3is+/MHCoMBxrSQxOV8uvVEdHnCCxbykjkt1888ZIUr9hwd/v8ndL\nERGRrklhXER8VkWVnQ/3nmTH3nI+O+TgwLFuHLNGUlYZBbR8X+6QoDIGxJ5kyMBaUr8RzG0jLfSO\n0pITERFpPoVxEen0KqrsfJR3kp37zvH5F3YOHA/gmK07p8+acbuvLCQHBVbQr7eVa/vXMPLaQNKG\nRTO4XwRGY4/WOwEREemyFMZFpNM4Zi3no7wzfHKwkn1HXRwuCqTolIkz5T0vhO4rExZSSj/LaZL7\n1zI8KZBbh0Zx7YAojEYtNxERkbahMC4iHYq1pJKPD5zhs0OV5B2xc7jYj6KTIdjORFFTFw6EX/F7\nGAxOzBE2+vcu45oBTm5ICuaWIdFcHRcJ6KmWIiLSfhTGRaRdOZwuDhw/y2eHysg/Ws3B404KTvhR\nfCqUU2d7UF3bHQhptffrHlpCn5gzDOxTS0qCHzcO7s7oa2MIC9Ge3iIi4n0K4yLSqhxOF4cKy9hb\nUMaBY9V8UeTgmM1A8elu2M6Ec/ZcBE5XBBDRqu9rCi0h1lzKgNgakuONDE0MZfS10ViiegI9W/W9\nREREWovCuIhcNpfLTeHJcxw4fo6DhZUUFNs5ZnNReMqPk2e6UVIeRnlFBE5XD6D1b3D0M9YR3eM0\ncTHlDIh1MDjen+sHhjJ8cDTRPRS6RUSk81EYFxEAzpTXcKiwnC+KKjlyoobCk06KS9wcO+FP6bkQ\nyqpslFf2wOlsnXXbjTEaHUSEl9Arqpy+vWpJiDNw7YBgrh9oIrl/JP5+Wl4iIiK+Q2FcxIedPVfL\n4eJyjlirKDpVS9EpO9YSFydLDZw668+Z8m6UVYRwriocuyMYiL7w0baCAiuIMpViiariqhg7V8cZ\nSOoXzJAEE4P7RRAQYAEsbV6HiIiItymMi3QSVTV2ik9XUXSqiuLTNVhL6rCVOjhZ6qKkDErK/Th7\nLoCyim5UVAdTWR2GwxmEN5ZuBAVWENH9LOaIKnr3tNPX4ubquACS+oWRktCD3lFte3VdRESks1AY\nF2lHFVV2rGeqsJVWc/psLafO2ikps1NS5uJMuYvSc3C2wkB5pT/nqvypqOpGZU0Q1bUh1NlDgO4X\nPrwnwL8GU9hZIsOrMEfWEBvtoq/FyIDYbgzsE8rg+B5E91DYFhERuRztGsZffPFFnn32WaxWK8nJ\nyWRnZ3PTTTe1ZwkizeJyuamqcVBaUcOZslpKK+o4e85O6TkHZZUOyiqclFW4KK90c64KzlUZOFdt\npLLaj6pqfyprAqiu7UZNXTdq64JxugLpCIH6YoxGB2HBZfQIqyTKVI05wkGvKDeBhjNYItzcMmIg\niVeZMEeEYDT28na5IiIiPqHdwvgrr7xCeno6L730EjfddBMrVqzg9ttvJy8vjz59+rRXGeIjvgzJ\n5dW1VFY5qKixU1nl5Fy1g8pqBxXVTiqrnVTWuKiqcVFV46ay2k1lrZuaWqiqgepaA1W1RmpqjdTU\n+VFT509tnT+19gDq7AHU2bthd3TD5fYHwi58dC5Go4PQoHK6h1bSI6yGiO52onu4MEdAbLQfV8V0\no68lhP6xYcT2DMNobLgjSW5uLgDDhlz5Ey5FRETEU7uF8aVLl/L973+fGTNmALBs2TLeeustXnrp\nJbKystqrDPkal8uN0+mi1u6izuHE7rjw2e6izuGi7sJnu8NJnd1Nnd1JncNFrd2N/cJnh+PCeLub\nOocb+4XPJ6yV2J0GwrbuuXAM7HawO6HOAbV1BuwOsDsM1NkN2J0G6uxG7A4jDuf5z3aHHw7n+Q+7\nwx+H0x+n0x+HM+DCFWZ/utJKK4PBSVBgFSFBVYSHVNM9tI4eYQ4iuruIMoG5h5FePQPo3TOQPuYQ\nrooJvXAVOwqI8nb5IiIichHtkmTq6ur4+OOPyczM9GgfP34827dvb3L8uco6Hnp2f4N2l/vi/d3u\nRj7/R1uDry9yzO024L4w2LP9Iv0utLnc4ObC167zfVwuQ33NX/3ZgMt14VxchgtjDbjdhvOv4TZc\n6GOof4+vvjZ8re+Fzy7j+T9f+OxyG3G7jbhcxgv9zn/tdhsv/NkPMF74aO2/Ckmt/Hq+wWhw0C2w\niqBuNYR0qyU0uI6wYAfhoU56hLmICIOI7gZ6mvzo2SOAmMhAevcMpnd0MOYeIfj7dcwlLiIiItIy\n7RLGT58+jdPpJCYmxqPdbDZjtVqbHF9ZY+dPb1/TVuWJXJLR4CDAv5bAwFq6BdQRHFhHUDcHwd0c\nhAQ5CQt2ER7iJjwEuoca6B5qJCLMSKQpgMju/vTs0Y2epm7ERITQPTQQo9EEmLx9WiIiItIBdNh/\n4y8rK6v/c7A/lL5Z7sVqROCrZTEhLRvuquHcuZrWLKhdJCQkAJ7fk9I5aS59h+bSN2geBc6vT2hz\nPXv2xM/PD5vN5tFus9no1Uu7MoiIiIhI19QuYTwwMJChQ4eSk5Pj0f72228zatSo9ihBRERERKTD\nabdlKhkZGdx3330MHz6cUaNG8dvf/har1cpDDz1U38dk0jpaEREREek62i2M33333ZSUlLBw4UJO\nnDjBtddey5tvvqk9xkVERESkyzK43e5GNggUEREREZG21C5rxi/Xiy++SHx8PMHBwQwbNoxt27Z5\nuyRppkWLFnHDDTdgMpkwm81MnDiRvXv3erssuUKLFi3CaDQye/Zsb5ciLXDixAnuv/9+zGYzwcHB\nJCcn88EHH3i7LGkmh8PB3Llz6d+/P8HBwfTv35/HHnsMp9Pp7dKkCR988AETJ04kLi4Oo9HI2rVr\nG/RZsGABsbGxhISEMGbMGPLy8rxQqTTlUnPpcDh45JFHSElJISwsjN69e3Pvvfdy/PjxS75mhwnj\nr7zyCunp6cybN49PPvmEUaNGcfvttzd5AtKxvP/++/z0pz9lx44dvPvuu/j7+5OWlkZpaam3S5MW\n+vDDD1m5ciXXXXcdBoPB2+VIM509e5bRo0djMBh48803yc/PZ/ny5ZjNZm+XJs2UlZXFyy+/zAsv\nvMD+/ft5/vnnefHFF1m0aJG3S5MmVFZWct111/H8888THBzc4P+lixcvZunSpSxfvpydO3diNpsZ\nN24cFRUVXqpYGnOpuaysrGT37t3MmzeP3bt388Ybb3D8+HFuu+22S//S7O4ghg8f7p45c6ZHW0JC\ngnvOnDleqkhaQ0VFhdvPz8/997//3dulSAucPXvWPWDAAPd7773nvuWWW9yzZ8/2dknSTHPmzHHf\ndNNN3i5DWsGECRPcDzzwgEfb9773Pfe3v/1tL1UkLREWFuZeu3Zt/dcul8ttsVjcWVlZ9W3V1dXu\n8PBw98svv+yNEuUy/edcXkxeXp7bYDC49+zZ02ifDnFlvK6ujo8//pjx48d7tI8fP57t27d7qSpp\nDeXl5bhcLiIiIrxdirTAzJkzueuuu7j55ptx6/aSTun1119n+PDhTJkyhZiYGIYMGcKKFSu8XZa0\nwO233867777L/v37AcjLy2PLli1861vf8nJlciUKCgqw2WweGSgoKIjU1FRlIB/w5QOdLpWDOsQT\nOE+fPo3T6SQmJsaj3Ww2Y7VavVSVtIaHH36YIUOGMHLkSG+XIs20cuVKDh8+zIYNGwC0RKWTOnz4\nMC+++CIZGRnMnTuX3bt316/9nzVrlperk+b4yU9+QmFhIUlJSfj7++NwOJg3b57HFsHS+XyZcy6W\ngYqLi71RkrSSuro6fvGLXzBx4kR69+7daL8OEcbFN2VkZLB9+3a2bdumINfJ7N+/n0cffZRt27bh\n5+cHgNvt1tXxTsjlcjF8+HCeeuopAFJSUjh48CArVqxQGO9kli1bxurVq9m4cSPJycns3r2bhx9+\nmH79+vHggw96uzxpA/rZ2Xk5HA6mT59OeXk5f//73y/Zt0OE8Z49e+Ln54fNZvNot9ls9OrVy0tV\nyZX4+c9/zquvvsqWLVvo16+ft8uRZtqxYwenT58mOTm5vs3pdLJ161ZefvllKisrCQgI8GKFcrl6\n9+7N4MGDPdoSExM5duyYlyqSlnrqqaeYN28ed999NwDJyckcPXqURYsWKYx3YhaLBTifeeLi4urb\nbTZb/THpXBwOB1OnTmXv3r289957TS7V/f/t3D1LI1EYxfEzU+iohFFsVBASwRdsLAwWY+NHiIWK\ngoi1hYqljYIEO4uA+AFs7ASxUTCFloFMIIJoo50fQEGxeLYQwmZ3fVlduBn2/4NpLmE4MMU9mXm4\nDTEz3tTUpNHRUZ2cnNStn56eKooiR6nwVcvLyzo4ONDZ2ZkGBgZcx8EXTE5OqlqtqlKpqFKpKI5j\nZbNZzc7OKo5jiniCjI+P6+rqqm7t+vqaP8kJZGby/fpt2/d9vlglXCaTUVdXV10Henp60sXFBR0o\ngV5eXjQzM6Nqtapisfipk6sa4s249DrSMD8/r7GxMUVRpL29Pd3f3zMLlzBLS0va39/X4eGhwjCs\nzUDzNXoAAAF3SURBVMKlUim1tbU5TofPCsNQYRjWrbW2tqqjo+O3t6xobKurq4qiSPl8XtPT0yqX\nyyoUChyHl0C5XE7b29vKZDIaHh5WuVzWzs6OFhYWXEfDBx4fH3VzcyPpdXTs7u5OcRyrs7NTvb29\nWllZUT6f19DQkPr7+7W1taVUKqW5uTnHyfGr955lT0+PpqamVCqVdHR0JDOr9aD29nYFQfDnm/67\nA16+b3d319LptDU3N1s2m7Xz83PXkfCXPM8z3/fN87y6a3Nz03U0fBNHGybX8fGxjYyMWBAENjg4\naIVCwXUkfMHDw4Otra1ZOp22lpYW6+vrs/X1dXt+fnYdDR8oFou1/fDnPXJxcbH2m42NDevu7rYg\nCGxiYsIuLy8dJsZb3nuWt7e3b/ag945A9Mz4vgUAAAC40BAz4wAAAMD/iDIOAAAAOEIZBwAAAByh\njAMAAACOUMYBAAAARyjjAAAAgCOUcQAAAMARyjgAAADgCGUcAAAAcOQHTQ0VU1S8KKEAAAAASUVO\nRK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0xaa29160>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "max error 5.206970035942504e-05\n"
     ]
    }
   ],
   "source": [
    "import math\n",
    "import numpy as np\n",
    "t = 0.\n",
    "y = 1.\n",
    "dt = .1\n",
    "\n",
    "ys, ts = [], []\n",
    "\n",
    "def func(y,t):\n",
    "    return t*math.sqrt(y)\n",
    "\n",
    "while t <= 10:\n",
    "    y = runge_kutta4(y, t, dt, func)\n",
    "    t += dt\n",
    "\n",
    "    ys.append(y)\n",
    "    ts.append(t)\n",
    "\n",
    "exact = [(t**2 + 4)**2 / 16. for t in ts]\n",
    "plt.plot(ts, ys)\n",
    "plt.plot(ts, exact)\n",
    "plt.show()\n",
    "\n",
    "error = np.array(exact) - np.array(ys)\n",
    "print(\"max error {}\".format(max(error)))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Iterative Least Squares for Sensor Fusion"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "A broad category of use for the Kalman filter is *sensor fusion*. For example, we might have a position sensor and a velocity sensor, and we want to combine the data from both to find an optimal estimate of state. In this section we will discuss a different case, where we have multiple sensors providing the same type of measurement. \n",
    "\n",
    " The Global Positioning System (GPS) is designed so that at least 6 satellites are in view at any time at any point on the globe. The GPS receiver knows the location of the satellites in the sky relative to the Earth. At each epoch (instant in time) the receiver gets a signal from each satellite from which it can derive the *pseudorange* to the satellite. In more detail, the GPS receiver gets a signal identifying the satellite along with the time stamp of when the signal was transmitted. The GPS satellite has an atomic clock on board so this time stamp is extremely accurate. The signal travels at the speed of light, which is constant in a vacuum, so in theory the GPS should be able to produce an extremely accurate distance measurement to the measurement by measuring how long the signal took to reach the receiver. There are several problems with that. First, the signal is not traveling through a vacuum, but through the atmosphere. The atmosphere causes the signal to bend, so it is not traveling in a straight line. This causes the signal to take longer to reach the receiver than theory suggests. Second, the on board clock on the GPS *receiver* is not very accurate, so deriving an exact time duration is nontrivial. Third, in many environments the signal can bounce off of buildings, trees, and other objects, causing either a longer path or *multipaths*, in which case the receive receives both the original signal from space and the reflected signals. \n",
    "\n",
    "Let's look at this graphically. I will due this in 2D just to make it easier to graph and see, but of course this will generalize to three dimensions. We know the position of each satellite and the range to each (the range is called the *pseudorange*; we will discuss why later). We cannot measure the range exactly, so there is noise associated with the measurement, which I have depicted with the thickness of the lines. Here is an example of four pseudorange readings from four satellites. I positioned them in a configuration which is unlikely for the actual GPS constellation merely to make the intersections easy to visualize. Also, the amount of error shown is not to scale with the distances, again to make it easier to see."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAp8AAAGNCAYAAABXHhoFAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzs3Xd4VOeZPv77nDNdM2qAOqIJJDoIITBgOjbYuAC2sbEd\n1zhOvN6UzSbxJrv2btrP+WYdO5s41XGJe8EVbFMsU01HVAEC1JBQ76Op55zfH4oJGFRm5syMZub+\nXJcuG8153/NoGGYePW8TVFVVQUREREQUAmK4AyAiIiKi2MHkk4iIiIhChsknEREREYUMk08iIiIi\nChkmn0REREQUMkw+iYiIiChkmHwSERERUchomnxu3boVN954I7KysiCKIl588cVLHr/33nshiuIl\nX7NmzdIyBCIiIiIawDRNPu12OyZNmoRnnnkGZrMZgiBc8rggCFiyZAlqa2svfK1fv17LEIiIiIho\nANNp2dmyZcuwbNkyAN1Vzq9SVRUGgwEpKSla3paIiIiIIkRI53wKgoDt27cjNTUVubm5eOihh9DQ\n0BDKEIiIiIgojDStfPZl6dKlWLVqFUaMGIGysjL85Cc/wcKFC7F//34YDIYL17W1tYUyLCIiIiIK\nkoSEhEv+HNLkc/Xq1Rf+f/z48Zg2bRqGDRuGdevWYcWKFaEMhYiIiIjCIKxbLaWnpyMrKwunT58O\nZxhEREREFCIhrXx+VUNDA6qrq5Gent7jNV8t1Uazffv2AQAKCgrCHMnAxOend3x+esfnp2d8bnrH\n56d3fH56FsvPTW9TKDVNPu12O0pLSwEAiqKgoqICxcXFGDRoEJKTk/H444/jlltuQVpaGsrLy/HY\nY48hNTWVQ+5EREREMULTYfe9e/ciPz8f+fn5cDqdePzxx5Gfn4/HH38ckiTh6NGjuOmmm5Cbm4t7\n770XY8eOxRdffIG4uDgtwyAiIiKiAUrTyuf8+fOhKEqPj3/yySda3o6IiIiIIgzPdiciIiKikGHy\nSUREREQhw+STiIiIiEKGyScRERERhQyTTyIiIiIKGSafRERERBQyTD6JiIiIKGSYfBIRERFRyDD5\nJCIiIqKQYfJJRERERCHD5JOIiIiIQobJJxERERGFDJNPIiIiIgoZJp9EREREFDJMPomIiIgoZJh8\nEhEREVHI6MIdABFRoGRZRru9Da0dLWhrb0VbZ/eXx+OBoipQFBlnz56FIIo423gSkihBp9Mh3pqA\nBGsiEm2JSLAlIcGWCJ3Et0UiomDiuywRRYwuhx0V58tRUVOGipqzqGuqQ1tHC9o726Cqaq9tW9va\nAACna0p6vc5qsSEpPhmDk1MwPGMEstOHY1jmSMTHxWv1YxARxTQmn0Q0IHllL85UlqKs+gwqas6i\nsqYcdU21Qb9vZ1cHOrs6UFVbgYPH9174fnLiYAzLGIHhGSMwPHMkRg/Lg0FvCHo8RETRhsknEQ0Y\nXQ47jpYewqGTB3DkVDG6nF3hDumC5tZGNLc2XkhIDXojxudMxOS8aZg0ZgrirQlhjpCIKDIw+SSi\nsGpoqcehE/tx6MRBnCovgazI4Q6pX9weFw6W7MPBkn0QBAEjs3IwOW8aJuflI2NIJgRBCHeIREQD\nEpNPIgo5r+zFwZJ9+HzPJpwsOx7ucAKmqirOVJXiTFUp1m58HcMyRmB+4RIUTrwKRoMx3OEREQ0o\nTD6JKGSa25qwdd9n2La/CG0dreEOJ2gqasrw4nt/xlufvoLZU+dh3vRFSBucHu6wiIgGBCafRBRU\nqqqi5OxRFO3ZhEMn9kNRlHCHFDJdDjs27lyPjTvXY9yoiZhfuBhT8qZBFLnFMhHFLiafRBQ0J8tK\nsHbj6zhTVRruUMLu+JkjOH7mCDJSsrBy8WpMzsvnvFAiiklMPolIc5Xny/Hupjdx5FRxuEMZcGrq\nz+F3r/4vcrLHYOWS2zFmeF64QyIiCikmn0SkmYbmOry3+S3sPrwz3KEMeKcrT+FXz/0PJuVOxcrF\nq5GVlh3ukIiIQoLJJxEFzOly4N1Nb2LL3s3wyt5whxNRDp88iCOnijFz8hzceu0a7hdKRFGPyScR\nBaTkzFG88N5f0NTaEO5QIpaqqviieBuOnCrGnTfch+kTZoY7JCKioGHySUR+cboceOvT17Bl76Zw\nhwKg+8ShRFsi4m2JSIpPQoI1Eba4eEiSDpIo4syZs1BVFSNHjoRX9qCzqxPtna1o7WhFa0cL2jpa\n4XQ5wvozdHZ14E9v/Bb7ju7GncvvZRWUiKISk08i8lk4q506SYeM1KEYnjECwzJGIDtjOFKT02A2\nWXpdPZ5k2AcAKCgo6PEap8uBhuZ6VJwvv3CefGVtBTwet9Y/Rq/2H9uNk2XHWQUloqjE5JOI+s3l\nduLNT14NabVTJ+mQO2IsJuXmY+TQHGSlZkOv0wflXiajGUPTh2Fo+jDMyZ8HAJBlGecbqnH23Gkc\nOVWMY6ePwO1xBeX+F7u4Cnr3jffDarEF/Z5ERKHA5JOI+qWptRG/f/UpVJ4vD/q94ixWTBozFZPz\n8jF+1ESYTZag37MnkiQhKy0bWWnZmFuwEG6PGyVnj+LQyYM4fOIAWjtagnr//cd2o/J8GR6543tc\nEU9EUYHJJxH1qbTiJJ597TfosLcH7R6SKGHquOmYV7AQY4aPhSRJQbtXIAx6Aybn5mNybj6U5feh\nvPoMtu4rwu4jO4M2PN/QXI9f/uUJPHjLtzB1bM/TBoiIIgGTTyLq1bZ9RXjlo+eDtoVSUnwy5hYs\nxNXTFiAxPiko9wgWURQxcuhojBw6Grdcewe+KN6Gz/dsQl1Treb3crmd+P2rT+HmRbfi+nk383Qk\nIopYTD6J6Iq8shdvffIKNu/6NCj95wzLxZKrlmFyXj50UuS/FVktNiyZdR0WzVyKkrNHsemLT4Jy\nwtN7m99CdX0V7r35IRgNJs37JyIKtsh/xycizXU57PjD68+g5OxRzfsemjYMK5bchomjp0Rl9U4U\nRYzPmYTxOZNwuvIU3t7wGk5XnNT0HnuP7EJdYy3+9a5/j7hqMRERk08iukRnVweefulJlFef1bTf\nwUlDcNPCWzBj0myIoqhp3wNVTvYY/PCB/8LhUwexduMbqK6r0qzvyvPl+NVz/4N/u+/HGJQ4WLN+\niYiCjcknEV3Qbm/Hb174JapqKzTr02Ky4KZFt2Le9EVRMbzuK0EQMDk3HxNHT8HuwzuwduMbaGlv\n1qTv+uY6/Oq5n+L79/0HhiSnatInEVGwxUb5gYj61G5vx/8+/3NNE89JuVPx34/+CotmXhuTiefF\nRFHEVVOuxhP/8v9h1tS5mvXb1NqAXz33U9QHYZETEVEwMPkkInR2deA3L/xSs2Fhi8mC+1Y+jEfv\n/D6S4pM16TNaxJmtuH/lw3j0Lu2em5b2Zvz6hV+gsSX0J04REfmKySdRjOty2PHM33+lWcXzy2rn\n7Klzo3JBkVYm5+ZrWgVtbm3EUy/8QrMhfSKiYGHySRTDvLIXz77+NMrOnQm4L0mUcOcN97Ha6YMv\nq6DfvP07MOiNAfdX31yHp196Eg5nlwbREREFB5NPohj2xsd/x4mzxwLux2qx4Xv3/gcWFC5htdMP\n08YX4rGvP4FBiUMC7qu6rgp/fftZKIqiQWRERNpj8kkUo7bs3Yyi3RsD7icrLRs/fvinyB0xVoOo\nYtfQ9GH48cM/xZjhgT+Ph04ewAefva1BVERE2mPySRSDTpaV4NWPXgi4n6njpuNHDz6OIUkpgQdF\niI+Lx/fufQzzpi8OuK+PtryHPUe+0CAqIiJtMfkkijENLfX4w+tPQ1bkgPpZMus6fHP1t2EymjWK\njABAJ+lw9433Y/WyuwLu64V3/4yKmjINoiIi0g6TT6IY4nQ58Oyrv0FnV0dA/SyfvwK3Lb0zZk4q\nCocls67D3Tc+EFAfbo8Lv3v1KbR3tmkUFRFR4PjJQRRDXl//94C3VLp50a24edGtXFgUAvOmL8J9\nKx8O6LluaWvCc+88C1VVNYyMiMh/TD6JYsSRU8XYfuDzgPpYPn8Fls9foU1A1C+zp84NuAJ67PQR\nbNtfpFFERESBYfJJFAO6HHa89P5fA+rj2jnLcdPCWzSKiHwxt2Ah7rj+noD6eOvTV9DU2qhRRERE\n/mPySRQD3vjk5YBOvpk2fgZWLbmdQ+1htGjmtVgy6zq/2zucDrz0/l84/E5EYcfkkyjKHTlVjB0H\ntvjdfmjaMNy/8htcXDQA3HLNHRifM9Hv9hx+J6KBgJ8mRFEs0OF2W1w8HlnzPRgNJg2jIn9JkoSH\nbnsUqYPS/O6Dw+9EFG5MPomi2NsbX/d7uF0n6fCtO76LwUmBH/lI2okzW/HImn+D2eTf/qoOpwMv\nf/g3jaMiIuo/Jp9EUaqmvhrbAxhiveP6ezB6WK6GEZFWMlIy8fVb/8XvObhHThWj5MxRjaMiIuof\nJp9EUerdzW9CURS/2uaPK8TcgoUaR0RamjRmKhbNvNbv9ms3vcHFR0QUFkw+iaLQ2apSHDy+16+2\nVosNd91wH1e2R4AVi1cjJTnVr7Zl585g//E9GkdERNQ3Jp9EUUZVVbyz8Q2/26+5/h7EWxM0jIiC\nxWgw4t4V3/D7F4V3N70JWZY1joqIqHdMPomizNHSQzhZdtyvtvnjCjF94lUaR0TBNGZ4nt/D73WN\n57HjoP/bcBER+YPJJ1EUURQFa/2senK4PXKtWLza7+2XPixaC4/XrXFEREQ90zT53Lp1K2688UZk\nZWVBFEW8+OKLl13zxBNPIDMzExaLBQsWLMDx4/5VaIjocqfPnURVbYVfbVcuWc3h9ghlNBj9Pn6z\npb0Zh08f1DgiIqKeaZp82u12TJo0Cc888wzMZvNlFZQnn3wSTz31FH73u99h7969SElJwZIlS9DZ\n2allGEQx6+BJ/xYZpQ3JwOyp8zSOhkJpfM4k5I0c71fbAyf2cOU7EYWMpsnnsmXL8LOf/QyrVq26\n7Cg+VVXx9NNP47HHHsOKFSswfvx4vPjii+jo6MCrr76qZRhEMam5rRFl58/41XbFotsgSZLGEVEo\nCYKAlUtW+9W2qb0RlbVlGkdERHRlIZvzWVZWhrq6OlxzzTUXvmcymTB37lzs3LkzVGEQRa3i0n1+\ntRuRNQr546ZrHA2Fw8isHEwbP8OvtgdP+Vc1JyLylS5UN6qtrQUApKZeuiddSkoKampqemy3b59/\nH6iRLBZ/Zl/w+bmcx+u+MG+vta3Np7Z5hROxf//+YIQ1IEX762fkkDEoat8Ixcdh9FOVJ/D51iJY\nLbYgRRb5ov21Eyg+Pz2Lxedm9OjRPT42IFa7c3UtUWBKyo7C6Xb63G5E+igMSx8ZhIgoXAYlDMHE\nUVN9bqeoit/VcyIiX4Ss8pmW1r0NSF1dHbKysi58v66u7sJjV1JQUBD02AaKL38ziqWf2Rd8fq5M\nVVWs3/vuhT8nJvR/xfo9tzyACaMnByOsASeWXj/p2Wl4/P9+0O/rv6yWn2sqx5SpU6CTQvbREBFi\n6bXjDz4/PYvl56atl1G4kFU+R4wYgbS0NGzYsOHC95xOJ7Zv345Zs2aFKgyiqFNdV4XKGt8Xi6Qk\np2LcqIlBiIjCLTMlC7kjxvncrrWjBcdKDwchIiKif9J8q6Xi4mIUFxdDURRUVFSguLgYVVVVEAQB\n3/nOd/Dkk0/i3XffxdGjR3HvvffCZrNhzZo1WoZBFFMOlvg3VDpv+uLLdqWg6DG/cLFf7YpPxM78\nXyIKD00/efbu3Yv8/Hzk5+fD6XTi8ccfR35+Ph5//HEAwA9+8AN897vfxSOPPILp06ejrq4OGzZs\nQFxcnJZhEMWUw6d83yBcrzdgdv7cIERDA8XUsQVItCX53O7wqYNQFCUIERERddN0Ys/8+fP7fNN6\n/PHHLySjRBSY1vYWlJ3zfW/PwolXcVVzlNNJOlxdsAAfFq31qV1bRyvKa85iZFZOkCIjoljHMTei\nCHbo5AG/2s0rWKhxJDQQzS1Y6NduIodP+Pe6IiLqDyafRBHMn+QzOXEwRrCqFROS4pMxamjPe+31\npNjPX2qIiPqDySdRhHK5nTh+5qjP7SbnTuXeujFkct40n9ucq61EQ0t9EKIhImLySRSxTpw9Dq/X\n43O7ybn5QYiGBip//74Pn/R9IRsRUX8w+SSKUGfPnfa5jclo9mv/R4pc6UMykDqo54M8euLPQjYi\nov5g8kkUocprzvrcZnzOJOh1+iBEQwOVIAiY5Ef1s8KPgwuIiPqDySdRBFJVFRXVvicHk3J9P/Ob\nIp8/f++1jTVwuhxBiIaIYh2TT6II1NzWhM6uDp/bjc4eE4RoaKAbmZXj82lWqqqiqrYySBERUSxj\n8kkUgcqrfR9yt5gsGJKcGoRoaKAzGoxIH5Lpc7sKP6Z2EBH1hcknUQSqPF/uc5vsjBHcYimGDcsY\n4XObippy7QMhopjH5JMoAvmz2Mif5IOih3/JJxcdEZH2mHwSRaDahvM+txmWPlz7QChi+JN81jWe\nh6IoQYiGiGIZk0+iCKOqKto6W31uNyyTlc9YNjRtmM+LjmRF9mthGxFRb5h8EkUYu6PT55ONJFHC\nkCQuNoplRoMRSfGDfG7X2tEShGiIKJYx+SSKMK3tvicD8dYEn6teFH0SbYk+t2HySURa46cRUYTx\nZ8g9wY+kg6JPgi3J5zZtHW1BiISIYhmTT6II09rhR/JpZfJJQIItwec2re3NQYiEiGIZk0+iCNPm\nxzBoYnxyECKhSJPoT+XTj0o7EVFvmHwSRZg2fyqfflS8KPr4N+zO5JOItMXkkyjCuD1un9vY4uKD\nEAlFGluczec2bq/vrzciot4w+SSKMIrq+6bfOkkfhEgo0uh1vr8OFJmbzBORtph8EkUYWZZ9biNx\nmyUCIIqSz21kxffXGxFRb/iJRBRhFD+SAUnyPemg6CMKvr/l+/N6IyLqDZNPogjjz2bxPJ+bgO6j\nWX0lsGpORBrjuwpRhPFv6JTJJ/lZNffj9UZE1Bsmn0QRxp9kQJa9QYiEIo3Xj9cB5wsTkdZ04Q6A\niHzjz/xNu8N+xe+rqgpFUaECkEQBgiAEGB0NZF3OK78OeiNJ/JggIm3xXYUowvS1Z6esqHC6vfB4\nZbi9MjxeBe9tO4h9ZQlo7nCgud0Bu9MDWVEgK5fOARQFAZIkwKjXIdFqxKB4C5JsJiTbzEi2mZFk\nMyM53ozUpDgMTrAwWY0wre2+bxgfH8cDCohIW0w+iSLMxUckyoqKLqcHdqcbTS12ODwy1PN2fHVZ\nSYuzHOftNX32ragqFK8Kj9eNTocb5xo6erw23mJETmYScjKTMSojGTmZyRiSyIR0IGv152hWW2IQ\nIiGiWMbkkyiCtNtdKK1x4GxNC+xON5xu+UKi6fV4AAA6/eXD8rLs0D6WLhcOlNbiQGnthe99mZCO\nH56CwrGZGJaawGR0AGn345z2hHjfj+QkIuoNk0+iAa66oR17TlRjd0k1Sioa4XDUobHdt2RS9vo+\n188fFyekf994GKlJcSjMy8SMsZkYPyIFOomLV8Kp1Y9z2hOsrHwSkbaYfBINMKqq4lRVE3Yeq8Ke\nE9WXDX1Lujif+5S9XVBVNeRVyLoWOz784hQ+/OIULEY9po1Jx4yxmZg5LgtGA99+Qo3D7kQ0EPDd\nn2iAcLg82HKoAut3laKstucKlSSZIQCXzevsjarKUGQHJJ0l4Dj91eXyYNuRSmw7Ugmr2YDF+SOw\nbMZoZAy2hS2mWCLLMlramn1ul2DjsDsRaYvJJ1GYnWtox/pdpdh8oAxdLk+f1wuCCFFnhuz1bejd\n7WqEWZftb5ia6nS48d6Ok3hvx0lMzUnD9TNHoyA3AxKH5YOmtrEGbo/L53YJrHwSkcaYfBKFgaKo\n2HX8HNbvLsWhM3U+t9fp4v1IPhtgjhsYyefFDp6uxcHTtRiSYMHSwhwsLcxBfJwx3GFFnfKaMp/b\nJCUMgo77fBKRxviuQhRCqqpi/6nzeOnTQ70OrffFYBoMl9O3pNXtbPT7fqHQ0NaFv288jHe2lmDF\n1Xm4aXYuzEZ9uMOKGpV+JJ/DM0YEIRIiinVMPolC5ERlI178tBhHyxoC7stgHOJzG7cr8PuGQpfL\ng1c2HcG6XaVYvWA8lhbmcJW8Bir8SD6z04drHwgRxTwmn0RBVlnXhr9vPIRdx6s169Of5NPrtUP2\ndoV10ZEvWjud+NOH+/H+jhO4c/EkzJ00DKLIPUP9IcsyKs9X+NxuWCYrn0SkPSafREHSbnfh+Y8P\n4rOD5VBUX9am901vSIQo6qAoXp/auV0NMOuGaRpLsNU22/G/b36BtVtL8NAN0zBhREq4Q4o4NfXn\n/FpsNDxjZBCiIaJYx7EsoiDYebQK33p6HTYdKNM88QS6V7zrDYN8buewV2keS6iU1bbisb9sxp8+\n2AdHP3YFoH86UnrI5zZJ8cmIt/JcdyLSHiufRBpqt7vwxw/2YduRyqDfy59FRw57OVR1dkQfefnR\nrlLsO1WDb6+aySpoPx06sd/nNsO42IiIgoSVTyKNfFntDEXiCfg/79PjbgpCNKFV22y/UAV1un2b\nehBr2jvbcPbcaZ/bMfkkomBh5ZMoQKGsdl7MZMnyq52jsxwG42CNowkPVkH7dujkQah+TP2YMGZy\nEKIhImLlkyggpeea8K//93HIE08A0OniYDT5Xv3ssvu+6nkgq2224z/+uhlvbznuV5IV7Q6fPOBz\nm0RbEoals/JJRMHB5JPIT1sPVeBHf96MpnbfThrSkjluuM9t3K5GeD0d2gcTRqoKvPjpIfzvm1/A\n7ZHDHc6A4XI7cez0EZ/bTcrLhyjy44GIgoPvLkQ+UhQVL316CP/vjZ1we8Ob6Jjj/Ns2qbP9pMaR\nDAxbDlXgh3/eiMa2rnCHMiDsObLLry2WJudODUI0RETdmHwS+aDL6cHPX96Kt7YcD3coAAC9IRk6\nvdXndp3tx6Gq3YmzIABiBK9+/6rT1S343u8/xYnKgX2caLCpqoqiPRt9bmfQGzF25IQgRERE1I0L\njoj66XxTB372962orG8PdygXCIIAc9xwdLQevewxSRQQZ9LDZNBBr5Og14kw6CTodRIMOgkP3z4S\nMyZedeHUIFVVISsqnG4vmtsdaOlwoLnD0f3/nU7UtXTiTHULGiKgqtjS6cR//HUzHrlpOhZNi82N\n0svOne77PHdVhSp7IbhdEGQZMhSMTh0O1yfvwuX1QlUUQJYBVQFEERAlCKII6A0QrTaItgSItnhI\ntgQIVhvEOFv340REvWDySdQPZ2ta8J9/K0J7l+9DmMFmjhsGe9tRWIw6mA0SBicnIM6kh9GgQ2/1\nzO37P8NVk2dd+LMgCNBJAqxmA6xmA7JTr7zBeFunE2dqWnC6uhlnappRUtGIlk6nxj9V4DxeBU+/\nsxtN7Q7ctmB8uMMJuaI9my75s+pxQ3U6obocUJ0OKG4X4O3epkrn6f6vrNdhtBQP54Fd/t1UECBa\n46FLy4AuLQu6jKHQpQ+FGJ8Q0XvLEpG2mHwS9aH0XBP+6/nP0elwhzuUS8RbjJiel4GCMVfhnfVl\nqKrpXsWeGG/uV/uTZcdRXX8OmSm+bdmUYDUhf0w68sekA+ieA3umphm7S6qxp6QaZbWtvv0gQfb3\njYfh9srITVRjJgFqb2vGnl0bIXe2dSeaLmd3BbMPelHCRJvvOyhcoKpQOtrg7miDu7TkwrfFOOuF\nRFQ/YjT0Q0dAkCT/70NEEY3JJ1EvSioa8MQLW9A1QI5zTIgzYuHUEZg5Lgt52YMvDJk3Ny3CS+/+\nzef+Ptu1AXffeH9AMYmigNFZgzA6axDuWjIJ9S127DlRjaKDZTh1rjmgvrXyRtExTB1qwg0F/u2N\nGgkUeyfcpcfhPnUM63auh+P8GZ/7yI9PhUXSBym2ku6EdOsGiCYz9KPHwZg7AfpRuRBN/fuFiYii\nA5NPoh6crGzE489/DscAOEFnbPZgXD9zNGZNGAq97vKK0dxpC/Hyey9AURWf+t2+vwhL51yPIcmp\nWoWKlKQ4LL9qDJZfNQanq5uxflcpthyqCPvOAEVHagEABQUFUVMBlVua4DpeDPfJY/BUdc/v7JI9\n+Ly+j7mePZiVlKlleD1SnA64juyH68h+CJIE/bBRMOROgHHcFIhWW0hiIKLwYfJJdAVnqpvx+Avh\nTTyNegkLpgzHshmjMTIjqddrE+OTMCY7DycqfFuFLysy3tv8Fr5+678EEmqPcjKT8a+rZuD+66Zi\n8/6zWL+7FDVNnUG5V38UHalF3uajWLN4YthiCJSqKPCcOQnHvh1wnzp22eNFTZVwyL5X6oca45Bl\nDn3ip8oy3GdPwX32FOwb3odh7GSYp8+GbuiIqPklgYguxeST6CvKa1vxn38rgt0ZnqF2SRSwtDAH\nt80fj+R+zt8EgKljpvucfALA7sM7ce2c5chOH+5z2/6ymg24aU4ell81BkXF5Xh105GwrZp/7bOj\n0OtE3Do/shYhKV12OA/uhnP/TsgtTVe8ps3jwrbmc371P92qXfXbX6osw3X0AFxHD0CXkg7T9Nkw\nTpwG0WgKd2hEpCEmn0QXae104r9f3IKOMC0umjd5GO5cPBHpg3yvQGWnjcCg+MGQ4XvS/O6mN/Ht\nu3/gcztfSZKIxdNGYu6kYVi/uxRvFh0Ly3P90obDSEmMw7wpw0N+b195G2rh2PEZXEcPQpV7r8Rv\nbCyHR/F9eoNF0mGCJdnfEIPCW38enevehn3TRzBNmgbz7MWQEhLDHRYRaYDJJ9E/eLwyfvHytrCc\njjN5VCruXza1z+H13giCgPy8Quw9ucPntkdOFeNkWQlyR4z1+/6+MOgl3DwnD0umjcS7209g7bYS\neLy+zVcN1G/X7kHGYBtGZw0K6X37S25rRdeWT+As3tN9fmgf6l1d2N1a4/uNJAlTkrOAjGyYxuRC\nsMZDssZDMFsAUYQg6bpPIlAUqIoMyDIURxeUjjYonR1QOtsv/L/q0n7LLdXlhGPvDjgP7IapcA4s\ncxZDtMRpfh8iCh0mn0To3mD9D+/vQ0mIT8WxGPV48PqpWDxtpCbz2yaOmoIT546gw+77Rvivr38J\nP374p9CNbuX4AAAgAElEQVRJoXtbiDMbcNeSSZg7aRieeWdXSFfHu70yfv7yNjz1rWt9mt4QbEqX\nHV07NsO5e1uflc4vqaqKD+pKofSapAoQjEYIRhMEk7l7KNtogt5gxPj5X4M9LgG2goLAYnc64K2t\nhremCt7z5+CtqYTcrM2/KVX2wvHF53Ae2AXL7IUwz5gLwWDUpG8iCi0mn0QAPvriFDbuPxvSe+aP\nTsOjK2dgcIJFsz4NeiOWz7sZr61/yee2VbUVWL/1fdy4YJVm8fRXdmoCfvWNJXhv+wm8svlIyKqg\nTe0O/OKVbfjFg4tg0Id330nV7YJj9zZ07dwM1elbBXFvWy1KOi+fByqYLRDjbBDNFghGU/cpRV+x\naOa1iI+78oECvhJNZhiG58AwPOfC975MSD3lp+E+eRTe2uqA7qG6nLB/th6OPdtgmXsNTPkzu6uz\nRBQx+C+WYl7x6Vo8t/5gyO6ndbXzq+ZOX4SNX3yMxpYGn9uu+/w9TM0rwND0YZrH1RdJErFq3jhM\nz8sMaRX0ZFUTnn1/L769akbYVle7z5xE54evQ27zfYP+Vo8T79eWdv9BFCFarBCtVghxtj6TMovJ\ngmVX34ATx0/6E3a/XJyQxs1fCrmtBe6Tx+A+eRSeitNQ+7H5/ZUonR3oXP8OnPt2wHrjHdBnZmsc\nOREFCw/hpZh2vqkDT762A7LS95w6LQxPS8BvH12KJQWjgpbo6HV63LTwFr/ayoqM59/9E7z9HO4N\nhi+roDfPzg3ZPTcfKMP7O4KXgPVEcTrR8dGbaHv5j34lnqqq4q3zJ+E2maDLGArDqDzoMoZCjE/q\nVzVw6dU3wGoJ7fZKUkISzIVzkHD3w0j+/s9gu/lO6IcO97s/b30t2v72DOyfrYPqDf+evETUNyaf\nFLO8soInX9sRsmMzrxqXhV99YwlSk61Bv9eMSbORleZfJajyfDnWb31f24B8JEkiHrg+H99eNQN6\nXWjepp7/uBgnQzjn133mJFr/+CSc+7/wq71oMuNwZirODEmGLmsYRGt898KgfkqwJWLRzGv9urdW\nRJMJpskFSLz/20h66N9gmnYVBL3vJyypioKubZvQ+pf/hae6MgiREpGWQp58PvHEExBF8ZKvjIyM\nUIdBhLe3HMeZmpaQ3OuOhRPwozVzYDZqf3ThlYiiiBWLb/O7/brP30NZte/HM2pt8bSR+MWDi5Bk\nDf4+j4qq4pl3dsPtCe5JTIFWO3XpWbDddAfkex/BB/VnIOgNfsVxw/yVMBoGzv6ZuvQs2JbfhuTv\n/Tesy1ZCSh7scx+sghJFhrBUPvPy8lBbW3vh68iRI+EIg2JYeW0r3ii6/HQYrRn1En50x2ysWTzx\nwjnsoTJpzFSMGe7f1kmyIuPZV3+D1vbQJOe9ycsejKceuRY5mf5vQ9VfVQ3teG1z8N6PvHU1aP3z\nr/2qdkqDhiD+1nuR+PXvAWMn4vdv/RZdTv+2BUsdlIY50+b71TbYRJMZ5sKrkfStH8F242qINt8W\nQ12ogj73NOTW0O2eQET9F5bkU5IkpKSkXPgaNGhg7rNH0ckrK3j67V3wysFdUW0x6vGzBxZi9sTw\nLIQQBAF33nAfdDr/qq0t7c149vXfwO0Jz4b7FxucYMEvv74Yk0cF/xSetdtOBGX43XX8EFqfe6bH\n04l6ItoSYF1+G5K++UMYx02Gqqp47p0/oLquyu9Y7rrxgZBuqeUPQZJgmjoTyY/+GHGLb4Bo8m07\nLG9tNVr/8ht4KsJfwSeiS4Ul+Tx79iwyMzMxcuRI3HHHHSgrKwtHGBSjQjHcbjUb8LMHFiAv2/eh\nQy1lpmQFtHXS2arTePnDv0HtxybnwWYy6PBfX5uHaWPSg3ofrYffVUVB15ZP0f7WC1B9SORFkxlx\ni5cj+dEfwzztKghS91ZQH3z2Ng6W7PM7ngUzlmDsyMg5WlTQ62GZvRBJ3/5PWOYs8mlOqNLVibaX\nnoXDz3m1RBQcghriT5VPPvkEnZ2dyMvLQ11dHX72s5/hxIkTOHbsGJKTu493a2tru3B9aWlpKMOj\nKFfT3IXffHAc3iCubrcYdfjm0lxkDdJu/85AKIqMlz95DjWN/u+vuLDgWhSOm6VhVP7zygqe23Qa\nJ6rb+r44AIsmpWN5QVZgnXg8sOzaDEOlb9U3T9YIdBXOg2q+9CSfE+VH8d7Wt/wOJ9GahPtv+CYM\n+sjdnF3saINl12fQ1ft2mpNrzEQ48mcDUnj3cyWKFaNHj77w/wkJl06fCXnlc+nSpbjlllswYcIE\nLFq0COvWrYOiKHjxxRdDHQrFGFlR8dq2sqAmniaDhIeuGT1gEk8AEEUJ1826GTrR/w/dz/dvwOmq\n0G9FdCU6ScR9i0YhJz24WwQVHalFZYPd7/ZCZztsG9f6lHgqRhPss5fAPnfZZYlnTeM5rNvxnt/x\nAMB1s26K6MQTABRbAjoX3YSugquh6vo/dcB46gjiij6EEIQjQInIN2Gf9GOxWDB+/HicPn36io8X\nBHjcWyTZt697KC2WfmZfBPr8bNx3Bp2yAYmJ/q0O7oskCvif+xZgUgjmJV5JX8+PapTxzobX/O7/\n88MbMHHiRIzPmeR3H1qaOjUfP/zTJpTV9m/FeGtr93WJiYn9vsfuSjdWLJ3r856s3sZ6tP39D1BU\nL9DP+xlzJ8B6/a0QbfGXPVZ5vhwvbfgT4qz+/1KzYMYSrFx+6xUfi8j3nsJCyMtuRMf7r8FT2c/T\nyVx26A7vQMLd34Jo7f8vLxH5/IQQn5+exfJzc/Eo9leFfZ9Pp9OJkpISpKcHdx4XxTa3R8arm48G\n9R4PLZ8WtsSzP66ZdR1GZI3yu73X68HvXn0KJWeDv0tAf5iNevzk7rmItwSvkne8ohH7Tvo2vOut\nr0Xbi7+D0t6/pFgwGGFbcSdsq++/YuJ5rrYST73wS3Q5/K/CDklOwaolt/vdfqCSkgcj4Z5HYL3m\npgtzYvvira9F64u/g9zPvx8i0l7Ik8/vf//72Lp1K8rKyrB7927ccsstcDgcuOeee0IdCsWQdbtO\nobHNv21p+mNZYQ6Wzcjp+8IwkiQJD97yLVhM/lfPPB43/u/lX+P4mYGxPVpKUhweu3MOpCBuY/XS\nhkNQ+jlVw1tX0514dnb063opaRASH/gOTJMKrlhdrTxfjl8//3N0dvWvvyvR6fR4cNUjMBl9Wy0e\nKQRRhPmq+Ui4+5sQLXF9NwAgN9aj7YXf+bXPKhEFLuTJZ3V1Ne644w7k5eVh1apVMJvN2LVrF4YO\nHRrqUChG2B1uvPn58aD1P374EDx0w7SwnQvui9RB6Xjotkchiv7/03d7XPjty7/GoZMHNIzMfxNG\npODhG4M3pFVe24Yth8r7vM7bUIu2l/4Apat/FUrDiNFIfPC70KWkXfHxs+dOB5x4AsBdN9yPUdmj\n+74wwumHjULi178HXWr/Di2RW5rQ9tLvIXcEd+EaEV0u5Mnna6+9hurqarhcLpw7dw5vvfUW8vLy\nQh0GxZC120qCdoRmSqIFj62ZA50U9hks/TZh9GTccs2agPrwej149tXfoGjPxgGxDdPSwhxcPzN4\nCdbLGw/D4+156yW5ubF7jmdXZ7/6Mxdejfg7H+qxUrf/2B78+m8/D2ioHQCWzFqGOfnzAuojkkiJ\nyUi8/19hHDu5X9fLzY3dvzD0s1JNRNqInE9MIj80tzvw/o7grNIWBOD7q2chIQRHP2ptyaxlmDV1\nbkB9yIqMVz58Hi9/+Dy8cviPMnzw+nwMT/PtNJz+qm/twid7rrwoUunsQNtLz0LpaO+zH0EUYV1+\nG6zLVkK4wibviqLg/c/exh9efxpujyugmMfnTAz4l4xIJBiMsN16D+LmL+3X9XJjHdpe/TNUd2DP\nNxH1H5NPimpvfn4MriCd1X3TrFyMHTYkKH0HmyAI3cOxQwOvFm7ZuwlPvfBLtNv7Tr6CSSeJ+M6q\nmUGb//n6Z8fgcHku+Z4qe9H+5vOQ2/o+tECQdLDddh/M06664uNOlwN/fOO3+LBobcCxpg5Kw0O3\nPQopRve0FAQBlnnXwnr9lVf3f5X3/Dl0vP/agKjiE8UCJp8UtTq6XNi4r59bsPgoY5AVdy0ZGFsO\n+cugN+Cbt38HSfHJAfd1qrwEP//jf6LqfIUGkflvVGYybp03Lih9t3e5UHSw/MKfVVVF5/p34Knq\n+4Q2QadD/O0PwJg74YqPN7TU48m//g8OHN8TcJxmkxmPrPk3xJmtAfcV6cwFs2C76Y7uYYo+uI4f\ngmP7phBERURMPilqbT5QBncv8/T8JQjAd26ZCaMh7NvkBiwxPgnfvvsHsJj7t0q4N02tDfjlX57A\npi8+hqIoGkTnn9ULJwRt+H397tIL1THn3h1wHtjVZxtB0iH+9gdhyLl8bruqqth1aDt++ocfo6o2\n8MRdp9PjW7d/FxkpmQH3FS1MUwphu6l/0w/sn62H60Rwt2QjIiafFKUURcXHu4NzNGskD7dfSVZa\nNr57z49gNgW+FY/b48Lr6/+O//f8z1DfVKtBdL4L5vB7RV0bjpc3wF1WCvun7/Z5vSBJiF99Hwyj\nci97rK2jFc++9hv89e1nA15YBAA6SYdH7vguxo66cnU1lpkmF8B24+p+Xdvx7svw1p8PckREsY3J\nJ0WlQ2dqUdPUv5XHvkiymrBm8UTN+w23EZmj8O27fwijQZvFU6XlJ/DE7x8LWxV0VGYylhUGZ9/V\nz4r2oeOtF6D24+eyrbwbhtGXTgP4str5n//37zhYsk+TmCRRwsOrv42JY6Zo0l80Mk2dCeuylX1e\np7pdaH/9uX7vXEBEvmPySVFpfZCqnqsXjIfZqA9K3+GWkz1GswoocGkVtLr+nCZ9+mL1wgkwaTw1\nQlAVxG/7AK6OvrfmiVu8HMZxl27509jSoGm1E+iueD58+7cxZew0TfqLZubCq2EumN3ndXJLEzo/\nfJMLkIiChMknRZ2GVjv2lPh2JGJ/pCXH4dogVdMGiu4E9DFN5oB+qbT8BP779z/C8+/+CY0tDZr1\n25dEqwk3z758uDsQk9tOY4izGQ2tvZ+WZZyQD/OshRf+3G5vxxsf/x0/+e33Nat2Av+Y47nmu5g6\nNvbOjfZX3NKboR/e979j14kjcB07GIKIiGIPk0+KOp/uPQMlCBWLu5dMjqjN5P01MisH37/vx4i3\nardoR1EU7DiwBT/57ffxxscvo8Memk29V1w9VrOz35Pc7ShsLQHQ/QtOT1UxXXoWbDfeDkEQ4HQ5\n8GHRWvz46e9i486P4fV6rtjGHyajGf961/cxacxUzfqMBYKkQ/yt90BK7HuXB/vHa7kBPVEQRP8n\nKcUUVVWx+UDfW9/4amR6IuZMzNa834EqO304fvyNnyI7Y4Sm/Xq9HmzcuR7/8fR38EHRO0HfG9Ri\n0uO2+YFvvSSoChY0HoCkds/zdHtldHRdvim5aLUhfvUDcMrdP+djv/ku3v/sbTicjoBjuNiQ5BQ8\n9tB/Y9yo6Jt/HAqixYr42x+AoDf0ep3SZUfnurcADr8TaYrJJ0WVszUtaGzrfUjUH2sWTYQYpM3L\nB6pBiYPxwwf+C9MnztS8b4fTgQ8+ewc/+PWj+Ovbz+JMZWnQ5tddN3M0kgI8hWpy22mkui7dSL6l\nw3nJnwVJQvuipXht61r8+68f/UeFV/vkeuzICfjxN36KzJQszfuOJbrUDNhW3Nnnda4TR6CvuPLp\nVkTkn8jfqJDoIrtLqjXvc0iCBdPzYnPfRKPBiIdufRRZqdl4d9Obmvfv9Xqw69B27Dq0HdnpwzG/\ncDFmTJql2ap7ANDrJFwzfRT+dM6/rZ8uHm6/WGunE8NUFV6oONLegL3xRpS987tAw+3VopnX4tal\nd0J3haM5yXfGsZNgmjoDzoO7e73OvG8rvKmx+R5AFAx8B6OosueE9snnshk5MVf1vJggCLh+3s3I\nTBmKv77zLJwubYeQv1R5vhwvvf9XvPnJKxifMwlT8vIxccwUWC22gPteWpiDv7y30/e5wKqKq5sO\nXRhu/5JblXHG0YpDlY0odbbAoddBbxnRr5N0/KGTdFiz/F7MLVjY98Xkk7hrbobn7EnIba09XiO6\nnDAf3AlcPTeEkRFFLyafFDUa27pwpqbvM7Z9oZNELCkYpWmfkWrK2Gl47OtP4I9v/BbnG7RP8r/k\ndDmw/9hu7D+2G6IoYlT2GEzJnYZJuVORNjgdgh8J3uAEC8ZnJ+BIRc8JxpUMddQj09kIVVXRoXpQ\n5W1HubcdNbIdsqrAJOtgMuqhT80OWuKZlDAIX7/lEYwZfvkJSRQ40WSCdflqtL3yp16vM5Sfgreu\nBrrUjBBFRhS9mHxS1NgThCH32ROGIjHA+YLRJDN1KP7zmz/Hh0Vr8emOj4K+gbyiKCgtP4HS8hN4\n69NXYDHHYXjGSAzLGIHsjOEYnjECg5NS+pWQzs5L6VfyqaoqZK8dHlcDLLVbsd7VhAa5Cw7Ve9m1\nHllBXPIQCMbgvEaunrYAt167RtOtr+hyhpy8voffVRX2z9Yj4Y4HQxcYUZRi8klRIyhD7lG+r6c/\nDHoDVl1zO6aOK8Dza/8U1CroV3U57Dh+5giOnzly4XsWcxxSB6UhwZqIBFsSEm2JsFpssBgssJjj\nIEKAAAEGuQEJUgvcnXaoggJFdkNWnJAVF2RvF2TZDtnrgNfTDll2IM7rwCl378mqQ5Vgi0+CpPHP\nmZQwCPfc9CAmjJ7c98Wkif4Mv7tPHYOn8iz02SNDGBlR9GHySVHB4fLg8Nk6TfscnGDBuOHRc4a7\n1kZm5YS0Cvolr9cLj9sNr9cLWZbR2NCAsrOn4fV6u7/n9V4xFo/HA7dXhkf+ygOCAECEKoqA0P0l\nCCIsnna4VRWSIPSYXDYZ4mG0uzAkUbu3UlY7w0M0mRC3dBXa33iu1+vsmz5Cwn2P+jX9g4i6Mfmk\nqHC6uhker7bJz4yxmfyA6cPFVdAX3/sLquuqNO3f6/XC5XTC6XTC5XTC5XJC9n41e+w/SRThkb/y\nOlFVADIE+Z/96lQZXco/N4QXIUAnADpBuPDlkExwiQZ0ONwYkhh4opicOBhfu/EBVjvDyJA7Hvqh\nI+Cp6nmvYE9VGdynjsGYOyGEkRFFFyafFBVOVzdr3mdhjG6v5I+RWTl4/Fu/xM7ibfig6B00tzb6\n3IeqqnA4HHB2dcHl6k44A0k0r0QSBQhCX3uGq9Apl87vVKDCrQLuixo6VS8EtRUdqgP2eAMsFotf\nv6xYLTZcP+8mzJu+GIY+Nj2n4BIEAXGLl6P1+f/r9bquz9bBMHocBJFbZRP5g8knRQWtV7mbDTpM\nHJmiaZ/RThRFzMmfh8KJV6Fo90as3/Y+7F2dvbZRFAV2ux32zg502e1QvlqVDAK9ToL7srH3f5JU\nBQJ635LJK0hQAQiyB54uD2qqqiBKIixxcYizWhEXZ4Uk9T4T1GgwYcmsZbhm1nUcYh9A9NkjYRg9\nDu7S4z1e462vhaesFIZRuSGMjCh6MPmkqKB15TN/TDr0Oq2XkcQGg96Aa+dcj6unzceGHeuwYefH\ncHv+eRSlx+OBvbMT9s5OOBxd6CPP05xeEntNPnVqX9VWAR7x0rdOWVEhCCrsHZ2wd3Qn3CazuTsR\ntVphMPyzoimJEuZOX4gb5q9EvDXB75+Dgidu0fW9Jp8A4Ny7ncknkZ+YfFLE63J6UN3YoWmf03O5\nl1+gLOY43Lz4NiyYcQ3Wff4ePtnyIWrrzsPtuvxM9FDS6XoeKhVVBaLae/XVK0gALh1elxUFOunS\nfp0OB5wOB5oaGqA36DFo0BAsmXMdbly0EkOSU/2On4JPl5oB06QCOA/v6/Ea16ljkNtaISUkhjAy\noujACSsU8c7UaD/fMy97sOZ9xqK68+exs2gLag5WYIxxDHKTcpFoDu+HtQABknTluZn9q3peXhGX\n5Z7Lt1ajFTlJozHeOh5Nx2qxc/MWnKusCNpZ9qQN89VLer9AVeHcvzM0wRBFGVY+KeJpPeRuMeqR\nPijwIx1jldfrxYljR3Fwzx6cq6y88H1JlJCRkImMhEy0O9tQ2VqJ2vbzkPtM+LQniSJk+av3VSH1\nEYssiPhq1RPornxeTBAEpFrTMDQxG0nmpAsLkWRZxvHDh3H88GGkpKVh6vRCjJ88GUajMZAfh4JA\nNzgFhhGj4S4r7fEa58FdsMy7BoLEj1IiX/BfDEW8s+e1XWw0KiMpps9y91dHezv279qF4v374Ojq\n6vXaeFMCJqRNRO6QPNR2nEdDZz2aupqg9DHkrRWdKMKNSxNNndJ3Etw95H45WVEBCEi2JGNI3BCk\nx2fAqOs9oayvrcWnH36Azzd+ivGTp6DwqllIGjSo3z8DBZ+pYHavyafS2QF3yREYJ0wNYVREkY/J\nJ0W8htbeEx1fjcpI0rS/aOd0OLBr+zbs++ILeDyevhtcRC/pMTQxG0MTs+FVvGiyN6HBXo+Gznq4\nZXeQIsYVh937GnJXBBGKcOlMJVGQYJYSYZESUThsNKwms8+xuJwuHNi9G8V792JKQQFmz18Aq42V\n94HAkDsBoi0BaO351CPH/p1MPol8xOSTIl5zu0PT/nIykzXtL1p5PB4c2L0bO7dugdMR+N+BTtQh\n1ZaKVFsqVFVFm7MVDfYGtDnb0O5sg0f2LbHtjSgK3aPn/5h2KfRzeyVBkGAULTCKcTBLiTCJVgj/\nSEhVNbDdERRFwYE9e3Dk4EEUzpqNwtmzYTL7nsySdgRJgnnaVWipqujxGk/FGShddogWbpdF1F9M\nPimiqaqK5g5tk8+RrHz2SpZlHC0uxvaiz9De1haUewiCgERzEhLN3X8XqqrC4XWg3dmGdmc72l3t\nASWkAgRIggD5H4t+pCsM90sQESeYECcYYRZMaDNlQieae9xI3qPRhvgejwc7tnyOA3t346qr5yF/\nxgzo9XpN+ibfGfNnQv3gTQg9HR+rqnCXlsA0uSC0gRFFMCafFNEcLi9cvezZ6I/BCRZN+4sWqqri\n5PHj2Lp5I5oafD/BKBCCIMCit8CityDNln4hHo/sgUt2wuV1w+V1wuV1dX/JLsjwdtcyBUBF9+lJ\nAgCz2QKogKB2weVUIAkGDPa6YFEBg6CDHhIM0EEH6UKi2aGzoEvq/XWhVfL5JUeXA599+gn27foC\ncxYsxMSpUyHyRJ2Qk2wJ8KZnQ19d3uM17lNHmXwS+YDJJ0W0Fo2rnhajHmYjq0xf1d7Who/ffw9n\nS3tefBFKBqMBKWnpSEpOhtVqgzU+HlabFVabDVZbPOKs1suqhfv2de/ZWFDQnST8+cP9+HDnCZhc\n7Vh5bhNcigKXqnZ/KSqcqoJ2WYFXVdEl9b0aXevk80vtbW1Y/967KN6/D9ffvAKDU3jyVqh5sob3\nnnyeOQnV64Wg40cqUX/wXwpFtCaN53smx5s07S/SqaqKwwcOYPMn6+FyhmdzeIPRgLT0DKRlZCI1\nIx3pGZlIGjQo4CpgcrwZEESM8LQiQZKAKxyHqaoq2iHijSHToLrsEFztEFztwBWG+93e4K7Ur6mq\nwt/+8CzmLlyIwtlzWAUNIU/G8F4fV11OeCpOwzAqLzQBEUU4Jp8U0bSufCZZucDjS+1tbfjkg/dx\n5tSpkN5XkiRkjxiBnNw8jBg1SpNE80qSrN2/aAzvOt/jNYIgoNGSDtmWAXy5AF1VAa8DQlcLRHs9\nBEczoMhBq3xeTPZ6UbRhA06WlGD5ipUYNGRI0O9JgGqJg3dQKiD3/AuY+9QxJp9E/cTkkyJaa6dT\n0/6S45l8qqqKIwcPYNPHH8Pl1Pb57YnJbEbOmFzk5OViZM5oGE3Br0Anx5shKTKyHA29Xlcel37p\nNwQB0FugJlggJ2QCigyhqxmC1IE4m3ThbPdgqqmqwnPP/h5zFy1C4azZrIKGgCdrOFBxssfH3aeO\nA8tWhS4gogjG5JMimlvjatOX1bBYFcpqp9FkxPjJUzB2/ARkZmdDusKwdzAl2cxI9rT3ur+nAgEV\n5rTeOxIlqNYhMA4eiX/5znWoranBiWNHcfjAgT432w+E7PWi6NNPcfL4cVZBQ8CTObzX5FNubYbS\n2QHRyj1aifrC5JMiWvfJMtoxGmL3n0RF2Vm8+/rrQU2YACAlLRX5hTMwblJ4j5U06iWkuHo/Have\nmASXZOhXf7KiQBRFZGRlISMrC3MXLb7iMaNaq6mqwvN/eBbXr1yJsRMmBu0+sU5JHAQpIRFyW88b\nznvPV8EwelwIoyKKTLH7SUtRQdE4+ZRi9FjNA3t2Y+O6dVB62sswQJIkIXf8eEybMQOZQ7N73Csz\nlCRRxBBXz4kEANQZ+3/ggCxf+lrU6XSYMHkKJkyegrrzNTiwdy+OFRf7fApUf3g8Hrz3xhtoqKvH\nnAULOAwfDIIAXcaw3pPPGiafRP3B5JMimqxxsiQOgKQolGRZxsZ1H+Hg3r1B6d9oMqJw1mxMnV6I\nOKs1KPfwlyQKGOLuPflsMCb2u7/eqvCp6RlYduNNWLDkGhw+eAC7tm2DvVP7uaE7Pi9CQ10tlq+6\nJaxV5WilS8+Cq+RQj497z58LYTREkYvJJ0U0rSto2tZRBza7vRPvvf46KsvLNe9b0ukwbcYMzJo7\nD2bLwNy0X/F6kOxu7/WaBkP/k0+xH1Vzk9mMwlmzMXlaAfbu3Ik9O7drvoXVqZISvPzXP2PVmruQ\nmMTTurSky8jq9XFPTVWIIiGKbEw+KaJpPUwuy8Hdq3GgqK+txduvvIy21t4rf74SRAETp0zFnAUL\nkZDY/8QtHLx15yH28uuGW9ChTd//aq0vr0Wj0Yg5CxZgauF07Nq6Dfv37Ibs9fa7fV/qa+vwwh//\ngBW3345hI0Zq1m+s06UP7fVxpaONi46I+oHJJ0U0SeO5bd4YSD5PlRzHB2+/DY/brWm/Y8aOxdzF\nizEkJVXTfoNFPt97larRmAjVh8q6P78IxcVZsWjZMhTMnIltRZ/haHExVFWb+rujqwuvv/ACrlm+\nHJ+RkskAACAASURBVFOnF2rSZ6wTLXGQEpMhtzb3eA0XHRH1jcknRTStK5/tXeE5xSdUjhw8iHXv\nrYWq4UKtxKQkLLt5BYaPjKwKW1d9fa+P+zLkDvRv2L0nCUlJWL5yFaZfdRU+WrsW9bW1fvd1MUVR\n8MkHH8DpcOKquXM16TPW6dKH9pp8yi1NIYyGKDIx+aSIZrNou6iiWeMTkwaS4n178ckHH2hWWQOA\n/BkzMH/JNRG5uMXR3HMCAQCtPgy5A4DNHPhzkJqegXsf/iZ2bvkcO7ds0Wz3gc83boDX68GcBQsH\nxE4DkUwa3Pt+qkpHW4giIYpcTD4poiXZtN0Uvlnjs+IHin27dmHjuo806y9Sq50Xc/cx39Wu8+21\npdXpWJIk4eqFizBm7FhNq6Dbi4rg9Xoxf8k1TEADIFrje31c6ewIUSREkYvJJ0W0QfHarqRu6QjN\ncZKhtH+3tolnJFc7L+Zt7z357JJ8TD5t2h7NGowq6K5t2wCACWgA+kw+21n5JOoLk0+KaFpXPlvt\nTsiyAkmKjk26i/ftw4aPtEk846xW3HjrbRFd7byY2keFyu5r8qlR5fNiF1dB3339dbT0MVWgP3Zt\n2wadToerFy7SIMLYI9oSen1c6ex9+y4iAqLjE5ZiVkKcSdON4VUVaOmMjurn0eJifPLB+5r0lZaR\ngXu+8XD0JJ4eNxRnz1MsVAAOybfKbpJV21+ELpaaru3zv72oCF9s3apJX7Gmr22UmHwS9Y3JJ0U0\nURQ0r35W1Uf+sNnpkyfw0bvvaLK4aOzEibjrgQcH/L6dvlA62uFw9byvpkMyQRV8e3sclBDczfTN\nFgtu+9o9KJg5U5P+Pt+4AQf37tGkr1jSZ+Wzyw5V1m7PVqJoxOSTIp7WyWfpucCHNsOpob4OH7z9\nlibbKc1bvBg33Xob9AaDBpENHC0NTfDIco+Pd/lY9QSCW/n8kiRJWHL9clx38wpIkhRwfxs++giV\nZWUaRBY7BJ0Ooqn3KRZKlz1E0RBFJiafFPG0XuhxpiZyk0+Xy4V3Xnkl4CMbDUYDVq25E7PmzY/K\nhSmV51t6fdwr+J7YBWPOZ08mT5uGNfffjzirb9tBfZWiKFj7+muwd3CFtk/0ffwypuE+ukTRiMkn\nRbxhqdoOB5+ujszkU1EU7N66JeBFKbb4eNz94EMYM3asRpENPJW1vSefio9D7sk2s+Z7zvYlK3sY\n7vnGwxg8pPd9J/vi6OrCzs+L4PF4NIos+gl9naym9FxVJyImnxQFcjKTNe2vvrUL7fbIO+no8P59\nqDtfE1Af8YkJuPP+B5CSlqZRVAPTubret1lS4Fu1NyczKZBw/JaQmIg1Gvx9tbY0Y++O7Zptah/1\nxD4q43weiXrF5JMi3qgM7T/4S89F1hF5h/bvR2nJ8YD6SEpOxl33P4ikQYM0impgUlUVVX0kn74a\nlaHtL0C+iLNasea++5GemRlQP9WVFdjxeZFGUcU2LU8RI4pGTD4p4qUkxcFm1nZBTPFpbU6VCYVz\nlRX49MMPAuojMTkJa+5/AAlJ4anghVJFXRtaHL2vRhbhW/KgdfXdV2aLBbffc2/ACej2oiKcOHZM\no6iiWB/D6oIGi8GIohmTT4p4giBo/uG/u6Q6IqoXdnsn1r7+GuReVm73JT4xAWvuvR/xCb1vIRMt\ndh8/B7WPRVSi6tuwabiTTwAwmc1Y/bV7Ah6C/+idt9HU2KhRVNFJ7WtYva9heaIYx+STooLWH/7n\nmztRVT/wN4veuG4d7B2dfre3xcdjzb33x0TF80t7TlT3OadT8iH5TLaZQ7rSvTdmiwW333svBqek\n+N2Hx+PB+nfXcv5nb7x9LM4So2+HCCItMfmkqBCMytOeE9Wa96mlE8eOouTIEb/b6/V63HrXXVE/\nx/NibV1unDrXDJfU+zQNi9z/U67CtdioJ3FxVtx299dgiYvzu49zlZXY98UXGkYVPVTZC8XR1es1\noim4Bw4QRTomnxQVRmcFIfksGbjJp93eiU8//DCgPq5fuRKp6RkaRRQZjld1n17V1ybyZtkFoZ/T\nLkZnDbzkPSExESvvWBPQRvRbNm/k8PsVKJ2974kqmi0Q9PoQRUMUmZh8UlQYkhiH7JR4Tfs8UdWI\n5vaez/8Op43r1qHL7v8pKrPnL8DYCRM1jCgyHK3o3t/TI+rhFnQ9XidChbmf1c9pY9I1iU1rQ4cN\nwzXLb/C7vdfj5fD7FSgdvR+/K9q0fR8iikZMPilqFOYFttL3q1QV2LDvjKZ9aiHQ4fYxY8dizoIF\nGkYUGZo6XCj5/9u77/imzjRv+L+jasmS3Jts44aNjU2xMSY4dDCQQEiBCYQE0nZSnikkmZ332ezy\nbpLZbOaZ98nOzsxm0pmEhBTSJxMIJQFCB4MxzQUbbDDu3ZKsrvP+4UAwYFk6OtJRub6fjz8B+dzn\nXD45SJfvct3NPyUOBonzeZpK++i1XqPVCkHLLI1mcnGxR3vB0/D7jRw653PBRarQWLhHiCco+SRB\nY9r4FN7Pue1oPex2/+n58XS4PT4xAUuXr4BotB1agtDh2k5cO5I+2tB7uAs9n1NztRD5+eKSeYtv\nQ3pmJuf2NPw+nEM/WvKp9lEkhAQuQT6BXn31VWRkZEChUKC4uBj79+8XIgwSZHJSYhCpCuP1nN0D\nRr9aeOTJcLtCqcTy1Q9ALvftNpD+wGqz4/C5zmGvDYqdPytK2+jJ57Q8fnvbvUEsFuOulasQGc1t\nYRQNvw83as+nmno+CRmNz5PPzZs346mnnsL69etRWVmJ0tJS3HbbbWhqavJ1KCTIiEQMpo7jfwHN\n1iN1vJ+Ti0sNDR4Nty+5+x5EhlBJpWsdPNMEvWl4YXnDKMlnhM15CSu5VIxJWYGxDalCqcRd967i\n3ON9+dIlVJ06xXNUgcne0+n0+zTnk5DR+Tz5/OMf/4iHH34Yjz76KMaNG4e//OUvSEpKwmuvvebr\nUEgQ8kZPVGV9O5o7ha35ybIs9uzcwbl9weTJyM7N5TGiwHKzXyB0UueliOLNzrfgLMxOhEwaOMXE\nk5KTMX3mLM7t9+363qPNDIKFreWy0++LIv13DjAh/sKnyafFYkFFRQUWLlw47PWFCxfi4MGDvgyF\nBKlJYxMhlfD/WH++t5r3c7qjrqYazRxHB1RqNRbcvoTniAJHVWMnqi7eOGexQxbptF2spQ9wUm6J\n7wVuvlA6Zw7iEhI4te3r7cWJ8nKeIwosDpMR9l7n818l2lQfRUNI4Bq51ogXdHV1wW63I+G6N7/4\n+Hi0td18L+1jx475IjS/Eoo/sztGuz9aFYuTjc57rdz1+a4TyIywIDHS9zvZOBwO7PzH1xjod+1n\n6rvuuPyiKTgbovt1syyL/9lSg76+n4bQ+/qG7o+OZWG22kbcx10EK9Ddij7JjQXDJWIGUmMHjh3r\n9U7gXpSWnY3zdXVw3GQXp+ufnev944vPYGVZSEO0juWp77ZD1TfyPXIolLhY6x/TdIRAn10jC8V7\nk52dPeL3Qm/JKwl6pbnctxYciYNl8e1xYRYeXbpw3uXE83ppmVnQpoZuT8zZpj40dNx87qadEaNb\nonLaPsF28+kWk9KjoVIEZgIWFROLcRxrvJpMJtRVVfEcUeAQjzLf0x7N/3sPIcHIpz2fsbGxEIvF\naG9vH/Z6e3s7kpJuXqi5uLjYF6H5hSu/GYXSz+wOV+/PFJbFvvODuNzpfCcSd13qZ6GOT8e4MbG8\nntcZq9WKIz/sRmSE8yFi4KdeqyvHqtRqPPz4E1Ao/GPfcV9zOFi8e+BbREYO3Y8rPZ5X/g4AA9YE\naPUjr2rPkNnQHnnjvX98xVzkpcXxHLHvTJ48Ge++/ho6f3wvvv7ZcaaztRl5q1YiPNx54h5Mrrz3\npCllMN/kebhCWTwN4SH4/k2fXSML5XvT3z/yhgw+7fmUyWSYMmUKduwYvnBi586dKC0t9WUoJIgx\nDIPbSkbu7vfExu0nwbq47SIfKo4cwUCf8x1VRrJw6R0hm3gCwO4TDbjY7vzedcqdl8VJMN84rJ6R\nGIlcH/4C4g0SiQRL7r6bU1uL2YKDP/zAc0QBgGVha3E+71qSxH+tYUKCkc+H3Z955hm8++672LBh\nA6qrq7Fu3Tq0tbXhiSee8HUoJIjNL8qA3AsrkU83dPhsz3eT0YhD+7h9yKekpSEnL4/niAKH0WzF\nB9+NXpaqc5RFR4mmbsjs1mGv3X5LNhjGvwvLuyIpOQXjJ07k1PZEeTn6egNvvqsnRAN9sPd2Oz2G\nFhsR4hqfJ5/33nsv/vSnP+HFF19EYWEhDh48iK1btyI1hOelEf6FK2SYPSnNK+d+9e/HoDdavHLu\na52uPAHjILe95ecuXBgUCRJX726rRGf/4KjHdcsiYGdGfhsUgcUY40/ThJRyqdeeKyHMmr8AYrH7\nv6TZbTYcP3zYCxH5L2lzg9Pvi9QREFOBeUJcIsiCoyeffBINDQ0wmUwoLy/HjBkzhAiDBLklt+R4\n5bw9OiPe+ua4V859BcuyqDh6lFPb7NxcpIwJngTJXafOt2PrkXqXjrWJJGgOcz53M32w9eqf5xdl\nQCEPzIVGNxMVHY3JxVM5tT11ogJWi/d/CfMX0suNTr8vyxnvm0AICQK02p0ErUxtFManeWdu3q4T\njV4dfr944QJ6OOynzYDB7LIyL0QUGIxmK/78uXs9co1K57sUjTG2Q8Q6wDBDQ+7B5tY5cyCRuJ9Q\nm4xGVJ/hvuNWIGFMRki6bl4O8ApZTr6PoiEk8FHySYLa/Qu4zWlzxV+/Kvfa8HvF0SOc2qVlZSEu\nnlsR8WDw7rZKdPSNPtx+rdGST7nDiiRTN+ZMSkdKXPBtnRiuUiFnPLdeO66984FG2nLR6YYDjFQK\nWYZ3RloICUaUfJKgNjErAYVjvbP/do/OiFe/Kud99ftAfz/qamrcbicWiTF+0mReYwkkx2tbXB5u\nv5ZBohx14VGWqQ33L+BWGzMQ5IzPh1zufK/7m2ltbkZrs/PtJoOB5LLz+Z6yzHFgQrTwPiFcUPJJ\ngt6DiyZ57dz7Tl/CFzxvvXny+DE4HDfuPjOajOxshKtCp/bitZo7B/B/N3Pfone03s+Z8n7Ea9xP\nzgKFVCZDTj63YeNg7/10GPRDPZ9OyMbRkDsh7qDkkwS9rORozJwwxmvn37jjJMpr+Jn/abfbceIY\nt/2zs3JDs7SSwWjBi5v2wmCyjn7wCBqVN9/kAgBEDIMxajHMNac4nz8QZGTnQCJ1f9+RqtOnYBx0\nb6pDIDFVHgFjtzs9RpZNySch7qDkk4SENQsnQizyTukhlgVe3nwITR3cisFf61x1FQy6m28H6Ux6\nZiY0EaFX5sXhYPF/Nx/0eDerLlkEdOKbF+RPjFZBKhHDdHS/R9fwd3K5HOMnuD9H2ma14VRFhRci\nEh7rcMB0zHmPujQ1AyKV2kcRERIcKPkkISEpRo2FxVleO/+g2YoX39/r8QKk0ydOcGpXWDLNo+sG\nqo3bK3H8XOvoB46GYVCtTr/hZYlYhMSYoakM1qYG2NpbPL+WHysqKeHU7nQlt+fW31nqq2Hv63F6\nTNiU6T6KhpDgQcknCRmr5hUgTOb+sKKrWrr1+M9Ne2G22Di1N5vNaLxwwe12ao0G2bm5nK4ZyLYe\nrsMX+9xfmDWSKnU6HBjeO66NVUMs+ult0lh+gLfr+aOk5BQkJSe73a6zvR293c53/wlEpmPO/3+L\nFErIx4fuIj9CuKLkk4SMaI0CDy/27gfFmYZO/OemfbBYnc8Ru5mG+nrYbe4nrpOLizntUhPIdh47\nj9e+PsbrOY2SMFwI1179u0ohQ0Jk+LBjzKeOwWEy8Xpdf8O197Oulr9fBPyBvacLljrniwnlhdNo\nlTshHFDySULK4pKxmJTl3TqYJ+rb8PsP3U9A6zl8eItEIkyaUux2u0D2/fEL+J8vvbPC+ow6EwDA\nMAwyEiOB67YoZa0WmMr3eeXa/iKvYALCFDef/+pMfW2tF6IRzuDBXaMeo5hS6oNICAk+lHySkCIS\nMfjV3SVeHX4HgGO1rXjxfdeH4B0OB6cP77G5uVBrgq/w+Ui2Ha3Hn7844qzet0daw2LQLdUgJVaN\nsBG20Rw8sAuOQYN3AvADUpkMBZPdHyFoamyE0Wj0QkS+Z+vqgPmE840eZNl5EEd7Zwc1QoIdJZ8k\n5CREq7w+/A4M9YD++zu7MWAwj3psy+UmTuVqxnHcmSbQsCyLL/ZW469flXst8QQAMAz6syYhMXrk\neqms2YTBfTu9GITwcse7XzrI4XCgoa7OC9H43uCurWBHqbUbVnyrj6IhJPhQ8klCki+G3wGg6mIX\nfvPadjS29Tk9jsuORiKRCFnZwb+ln8Vqx58+O4x3tlV6/VpSiQh3/tMqiJThTo8zlR+Avb/X6/EI\nRZuaCoXS/aH3uhp+N1wQgrX5EszVJ50eI46OhWxsaNbVJYQPlHySkOSr4XcAaOsx4Lev78ThqpG3\nIeTyoZ2SlgaFUulJaH6vZ8CIZ9/6DrtONPrkemvKJiI1OQ6KGQucHsfabRjcs80nMQlBLBYjK2ec\n2+3O19XBPkpBdn83+P03ox4TPm8JGBF9fBLCFf3rISErIVqFJ+6Y4pNrmSw2/Oemfdi868wNe8H3\ndHehu7PL7XMGe3mlusvdeObV7Th32XmdRb5MzIzHnbcO3VPF1BkQaZzv9246WQ5bR5svQhMEl+fL\nbDKhqbGR/2B8xHK+FpYG51MHJEkpkOW5X4yfEPITSj5JSJs/JRPLSn03dL3pu9N46YN96NP/VK7n\n8kXn+0aPJHtccCafDgeLLYfO4X+/+R26B3yzgCUxOhz/+74ZEP24CxYjlSJ8ziLnjVgW+m82jzo3\nMFBljM2GWOL+yMDlS9yeZ6GxVgv0Wz8b9bjw+Uup15MQD9G/IBLyHrmtEJPHen/+5xWHq5rxiz9t\nxf7TlwAArS3u75oTGxeHqJgYvkMTXFuPHus37MLr/zgOq803SZ1CJsH6B2ZBEy4f9rp84lSIY+Od\ntrU2NcJ0ZK83wxOMXC7HmPR0t9u1NgfmLlCG77fA3uN8BEKWkQ1ZlvvTEQghw1HySUKeWCzC/7Pq\nViQ5WeHMt4FBM/7w0QH8nw/342LjJbfbZ+cG12KHK72dv/rLtzjd0OHTa//m3ulIS7xxiJ0RixE+\n9/ZR2xt2bYGty7cx+wqXoff21sBLPq0Xz8Powi8RyvlLfRANIcGPkk9CAKiVcqxfMwvKEWo7esuB\n0xfx3cGT6B4YhDsVhFI59Ej5q+bOgau9nSaOW5NytaZsIqaNTxnx+7K8iZAmpzk9B2uzQf/1x0E5\n/D4mI8PtNrqBAegGBrwQjXewVgt0X3886nGWMVmQJo/xQUSEBD9KPgn50ZiECPzzyunXb2rjXRYD\nrFYrzrf0oqqxw6WaoACQmKwd/SA/190/iFe+PIpf/Hmrz3s7AWDmhDH42RzndVIZhoFqyYpR5/hZ\nmxqCcvg9JjYOUpnM7XaB1PvpynA7K5XBWDTDRxEREvwo+STkGlNzk31SgP4KxvxTD5HBZEVNUxdq\nmrpgMFlGbKOJjEB4uO+mCPBNN2jGu9sq8dh/fYPt5edhd3izavzN5aRE49fLp4Fx4TcNSVLKqKWX\ngB+H39ua+QjPb4hEIiQkJbndro3DPGYhWM7XuDTcbiy6FWwA/5sjxN9Q8knIde6emYf75hX45FqM\n6cbhyQGDGWcbO1Hf3AO98cYkNFGb7IvQeNenN+HjXWfw2H99g8/3VsNiE6YeZGZSJF54eK5bNV6V\ns8ogiXeehLE2GwY+3gCHQe9piH4lkUPyGQiLjuzdndB99t6ox8mycmHJCq451oQIzfsVtgkJQPfN\nL4DFZsfne727Y8u1PZ/X69EZ0aMzIjxMivjIcMRolBCJGCRpA2fInWVZ1FzqwpbDdThwpgk2u7Dz\nIhMjFfjdw3OhUrg3lMyIJVDftRp9b/+307md9v5eDHz6LiLWPAFGHBxvr0nJI8+JHYm/D7s7TEb0\nf7wBDpPzUl6MPAyqO1YCdfU+ioyQ0BAc746E8IxhGDy4aBLsdge+OlDrnYuwLBjz6L1kBpMVDW19\naOoYQGykEqxcA5ZlXRoyForeaMH+05ew9XAdGkbZWtRXEiLC8OTicYhQhXFqf2X4fXDvDqfHWS+e\nh/7bL6Ba8jO//n/kqgSt+z2fuoEB6HU6qNRqL0TkGdbhgO6LTbB3tY96rGrhnRBHON9sgBDiPko+\nCRkBwzB45PZCSMQifOaNHlC7BWBdH3q2ORxo69Hj/3xxGtoDzSjJTca08SnIGxMLsVj4GTRtPXoc\nqbqMozXNONvYKchczpGkJ0bgnsJ0qBWeVTNQziqDpeY0bB2tTo8zHT8ESYIWiqmBv0jlyqIjq2Xk\necg309/X55fJ5+CurbDUVY16nCwrF/LCaT6IiJDQQ8knIU4wDIO1iyZBJhXjw+/P8Htum2n0g64n\nCQMkMrR06/HVgVp8daAWKoUMxeOSoLAPICVGCbvd4ZNktGfAiPMtPahq7ER5bQsutvd7/ZpcZGmj\n8B+PzEVt1WmPz8WIJVAvX4u+DX8Ca3FemcCw7UuIo+MCvii5SCRCQmIiLl9yrx6tXqfzUkTcmSqP\nYvDA96MeJ1JHQHXnqqDouSbEH1HyScgoGIbBffMnIDxMhg1bT8DB8tSjZ3OvJwkAWOmNQ8Z6owV7\nKi+ir29oePu9A23ISIrEWG00xiZHIyVOg2iNAlFqBSRuJqUOBwvdoBm9ehPae/Q439KL8y09qG/u\nRY/ON1tfemJSVgKeXT0D4W7O8XRGEp8I9T0PYODjDU6PYx0ODGzeAM3qxyBLH8vb9YWgiYwE3Ew+\nDXr/Sj7NZytdqufJiCXQrHwEYnWED6IiJDRR8kmIi5bdOg4pcRr8fx8fgMFk9fyEdtdqeg4jlo96\niNlqR82lbtRc6r7hexqlHNGaMESpFNCEyyEWMRCLRGCYoUTT5nDAZLGhZ8CIXp0JvXqT4IuEuLpj\nes7VaRN8k48rQPi8JTDs2uL0ONZqxcBHbyNizROQpqTzHoevqFTuD5/rB/wn+TTXnIHui/cBF35x\nVN2xkorJE+JllHwS4oainCT815ML8eKmvbjc6dmHK2NzP/lkJaMnn84MDJoxMGhGI/xziJwPErEI\nT9wxBYtKvNvbqJgxH7aOFpjPnHB6HGsxo3/TG4hY/RikY9zfMcgfcJm7qfOTYXdz9SnoPn/PpR2o\nlKXzEDap2AdRERLahF+lQEiASY7T4OUnFmJKjvurgIfxUs9nKIsIl+PFR+Z6PfEEhqZjqJetgiRp\n9FJErNmE/k2vw9IYmCV7VBoOPZ864bfYNJ2pgO6zjWDtoy/sk2XnQTl/iQ+iIoRQ8kkIB+EKGf59\n7WzcMzOX8zmE6PkMZplJkfjj/1qE/Ix4n12TkcqgWfkoRC4MS7NWCwY+eAPms5U+iIxf4VyG3QXs\n+WRZFsaj+6D7YpNLPZ7i2Hio71kz6jaqhBB+0L80QjgSiRg8fFshfruy1O2i5QAADsknKPm8qQVF\nGfjD42WIjwr3+bXFEZGIeOAJiBTKUY9lbTYMfLYRht3fupQU+Qs1h2F3oZJP1m6D/h+bof/2C5fm\neIojoxHxwJMQhSl8EB0hBKDkkxCPzZqUhld+fRumjnNv5yHGzmG1Ow27DxOjUeC5B2dj3Ypb3Nou\nk2+SBC0i1jwJJsy1AvaDe3dA98k7cJg5lNsSAJc5n4MGA+wuDHfzyaHXoX/jqzCdOOLS8SJNJCLW\n/i8qJE+Ij1HySQgPYiKU+H/XzsJTy6chPMzFQuZuFJi/SsxfyaBAt6AoA39ddzuK3Uz6vUWSlIKI\n+x8HI3ctATXXnkH/3/4Ce++NVQn8jUwuh0TqfnJvs9m8EM0I12q9jL63/whrU4NLx4vUGkSseRLi\nqBgvR0YIuR4ln4TwhGEYzJ+Sib+uu921XlAu9UJpThpiNAr8+9pZWLfiFl7rd/JBmpKOiDWuD+Ha\nOlrR9/Z/u7TjjpAYhoGYw171Dh9MLWBZFqbKo+h75y+w97u2las4IhKRD/0KkljfzQ8mhPyEPskI\n4dmVXtCnV9zifC4op2L1ob3jyvyiDLyy7nZMzU0WOpQRSZPHIOLBX0CkdG3+qWPQgP4P34Lu7x/B\nYfLfwv0iDr/4OBzeHXa36/ox8PEG6P7+EVira7V3xVExiHjoVxBHx3o1NkLIyKjOJyFewDAM5hVl\noCQvGZ//UIWvD56DxXb9BzGHXqEQ3e5vUlYCHlw0CdkpgTFEKklMRsTDv8LAR2/D3tPlUhtT5VFY\nztdCfce9kGWP93KE7hNxKNbv8NIGBSzLwnzqOAzbvnArYZdoU6FZ9SjtXkSIwCj5JMSLVAoZHlw8\nGUun5+DjXWew8/gF2B0/9nhSz+eosrRReGjxZEwemyh0KG6TxCYg8p+ehu6z92C5UOtSG4euH/0f\nvoWwySUIX3SXX63AFjHuJ58sX1vRXsOu64f+m09hOXfWrXbygiKol60CI3VxTjYhxGso+STEB2Ii\nlPjF3SW4a0Yu3t95CgfONA31Yrr94cwiFBJQbYwKaxZOQml+KkSiwP15RQolNKt/DsN3/4Dx8A8u\ntxvqBa2BctYihBVOAyMWezFK1zhY93sxuQzVj4S1WmE8uhfG/d+7PT0hfMFSKErngQnRkQNC/A0l\nn4T4UHKcBv+yegbqLnfj988dQN+AAW6lnywb1LmnNkaFu2fmYcGUTK/syS4ERiyGatFdkMQnQb/l\nM7B211aAO3QD0G/5FMbDexA+73bI8iYJmjw5OJRN4iP5ZO12mE+Ww7BnGxw697aFZeRhUN/zAOQ5\n+R7HQQjhDyWfhAggOyUGBZkJGNAZ0NlnQGffIKyuzI/zwjCm0EQMg5I8LW6flo1JWYkB3dPpTFjh\nNIhj4jHw6Ttw6F0vwG7v7sTApxsh0aYifP5SyDJzvBjlyLisXPck+WRZFpbqUzDs3gp7V4fbehbo\nIQAAIABJREFU7cXRsdCsehSSuMCbskFIsKPkkxCBMIwIcqkEKXER0MZq0Kszor3XAL3RSfF51o5g\n+WcbqQrDoqlZWDQ1C3GRvt+ZSAjSMRmIevy30G/9HObqk261tbU0of/91yBNHwvFtFmQZY/32XA8\ny7KwWd2v2cllu0rWaoW56iSMR36ArfWy2+0BIGxKKcLL7oDIxZqrhBDfCo5PMUICkFwuh8k4NHdN\nxDCI0SgRo1Fi0GRFR58BvTrjjb2hdnNAb7EpFjGYkBmPsilZKC1IDZqhdXeIVGpo7n0I5rOV0G/9\nDI5Bg1vtrY31sDbWQ6SJhGLKdIQV3gKRWuOlaIeYjEa3dysSiUSQurG4x97bDdOxgzBVHnH7nlwh\njoiCatkqwXqHCSGuoeSTEIGo1Gr0991YFFsZJkV6YiTSEiNhMFrQpzeiV2+C0WwDYzODDbDcU6WQ\nYUpOEqblJaMoO8nvCsMLRZ4/GdK0LE69oADgGOiDYfe3GPxhO2R5ExE2pRTStCxOvY2j0Q0MuN0m\nXKUaddidtdtgOV8L07EDsNRVcw0PAPV2EhJIKPkkRCDho+yXzWAocVMpZEiJi4DZakNCXiouWzU4\n29j5U8kmP5QUrcK0vGSU5CUjLy0uJHs4XeFpLygAsA4HzGcrYT5bCZEyHLLs8ZDl5EOaNY63REzv\nxhzVK0baD94xaIClvhqWc2dhqa8B6+H+9tTbSUjgoeSTEIGM9OE8ErlUggljIvHk3LkwW2xoaOtD\nfXPP1a+B/n44BFiQFK1WYGxyFLK00RibPPQVrfGf+pSBQJ4/GdKMbAwe+B6mI/tcXhF/PcegAaaT\n5TCdLAcjlkCamT2UiI7Jgjg2nnOvqF7nfvIZrhp6vlm7DfaONlgb62E+dxa2SxfA8rDtJiMPg/LW\neVBMmwVGFmDDAYSEOEo+CRGI2s3kEwAMP/ZAyWUS5I6JRe6Yn7YIPHj4CFp6jAiL0qKpox89OiN6\ndSb0DAwN29s82G1Go5QjWhOGKJUCMRoF4qPCryablGjyQ6QMh6psGRQlszD4wzaYKo96VN2Atdtg\nqau+OpzNSGWQJCZDok2FJCkVkqQUlxNSl5NPlgVrMYE1myC7VI/et/8b9rYWzsn0zTBiCcJKZkA5\nY4HLW5gSQvwLJZ+ECORKz5A7nCUBMokY6fEqFBffOPzocLDQDZrRqzehu38QBpMVdocDDgcLm90B\nFkOLgcQiESRiEaQSEaLVCkRrFIhSK2jY3IfEEZFQL1sFRelcDO7aCnP1KV7Oy1otsDY1wNrUcPU1\nRiyBSK2ByjAIhyIc+s5LEKk0EKk1YMKUYMQiQCRCf8N5OAb1Q8kwC8BhA2sb+oLNOvRf+49//zFh\nltoHYbNG8hL7ULAMwiaXQDl7McQRPJ6XEOJzlHwSIhB3h90BbsOfACASMYhQhSFCFYb0RPrgDgSS\n2ARo7n0Y1uaLGNy3E5ZzVbzXeWXtNtj7eiD5ceGbcaD7psd1X+6AbWDQrXOHS/gpA8WIJZCNnwTl\nzAVUs5OQIEHJJyEC4ZJ89vb0gGVZ2iYwhEiT0xCx6p9g7+uBqeIQTMcPD/VC+lC/xf1hc6WHyac4\nIgphxaUImzwNIg6jBIQQ/0XJJyECUWnc/0A1Dg5ioK8PEVFRXoiI+DNxZDTC5y2BctYimGtOwXR0\n/7AhdG+xO1j0mK1ut+Pa8ynLzkNY8a2Qjc3zStkoQojwKPkkRCBKZTjkYWEwm9wrNdPa0kLJZwhj\nJBKEFRQhrKAItvYWmM9UwHLuLGwdbV65XrfZwqmKgkbmeoF5iTYV8px8yCdMgTg6dvQGhJCARskn\nIQJhGAaJWi0uXrjgVrv21hbk5ud7KSoSSCQJWkgStAifvxT2ni5Yas/wWs4IADpNTrZ7HUGETAq5\nk0VqQ2WgciDLyYdsXD7E6ghPQiSEBBhKPgkREJfks62lxUvRkEAmjo6FYvocKKbPgcM4CEt9NawX\nz8PW0gR7RytYN7fHvKLDaHa7TVzY8F2sGIkEksQUSJKSIc0cB1lmDtXmJCSEUfJJiIAStclut2lt\nbqZFR8QpkUKJsAlTEDZhCgCAtdlg62iFraUJtrbLPyakbS7V33S751PEIDElBYqSqdfUE00AI+Zn\n9TshJPBR8kmIgJK0WrfbGAcHMdDfj4hIKplEXMNIJJBqUyHVpl59jWVZsMZBOPQDaD5yGCKjAVpt\nIhy6ATj0A0MJq92GvkvdYJRSMGCG9nxlmKEviRSMRAJGLLn6Z0gkYERiZK15BKrMTOF+YEKIX6Pk\nkxABRUZHc1t01NxMySfxCMMwYJThECnDYUsaSkqVxcXDjmltvgxR7WW4u+Y8MSmJpygJIcGI6lgQ\nIqAri47c1Xi+3gvREDJcQ737z1l0TAzCFLTlKiFkZJR8EiIwLslnfW0tWJ53uyHkenW1tW63SeDw\nPBNCQgsln4QIjMuiI93AAK16J16l1+nQ0tTkdjsuv0wRQkILJZ+ECGxMejqndvW1NfwGQsg1zp87\nx6ldWkYGz5EQQoKNT5PPOXPmQCQSDftavXq1L0MgxO+o1GpoU1NHP/A6dTWUfBLvqaupdruNWqNB\nQhL1fBJCnPPpaneGYfDII4/gpZdeuvqagiamE4LscePcHuJsb23FQH8/NBG0Owzhl9ViQeP58263\nGztuHES0HzshZBQ+f5dQKBSIj4+/+qVWq30dAiF+Jzs3j1M7Gnon3tB44QKsVqvb7cbm5nohGkJI\nsPF58vnxxx8jLi4OBQUF+O1vfwu9Xu/rEAjxO7Hx8YiMjnK7XfXp016IhoS6mjNn3G4jlUqRlkGF\n5Qkho2NYH9Zreeutt5Ceng6tVoszZ87g2WefRXZ2NrZv3z7suP7+/qt/rqur81V4hAiq8ugRTvPs\nFi67iwrOE96YTSZs+exT2B3u7QWfnDoGpXPneSkqQkigyc7OvvrniOumh3nc87l+/fobFhFd/7V3\n714AwM9//nOUlZUhPz8fK1euxCeffIKdO3fixIkTnoZBSMBL4rDoCAAu0NA74VFDfZ3biScATovm\nCCGhyeMFR08//TTWrl3r9JjUEd6UioqKIBaLUV9fj8LCwpseU3zddm/B7NixYwBC62d2R7DfH7vd\njtpTp9zealPX14sJEybg9I9D8MF6fzwV7M+PJ67cm6KiIpTv+wGREe71pDMMg9uW3oFwlcob4QmO\nnh3n6P6MLJTvzbWj2NfzOPmMiYlBTEwMp7anT5+G3W5HEu0DTAjEYjGycnJQdeqUW+3MJjPOnjwJ\n0Cpj4qEL9XXo6+l1u13ymDFBm3gSQvjns0+rCxcu4He/+x2OHz+OxsZGbN26FatWrUJRURFuvfVW\nX4VBiF+bNIXbb8cnyo/QdpvEYyeOHuXUbtKUKTxHQggJZj5LPmUyGXbt2oVFixYhNzcX69atw+LF\ni/Hdd9+BYRhfhUGIX0vLyEBMXKzb7Tra2tHd2emFiEioMOh0nHY1UigVyCuY4IWICCHBymdF5lNS\nUrBnzx5fXY6QgMQwDIpKbsHOLd+43bauugqx8fFeiIqEgvraGk695xOLpkAqlXohIkJIsKJJYoT4\nmYJJkzh9mF++2Ije7i4vRESC3aDBgPMctmtlGAaFxVO9EBEhJJhR8kmInwlTKJA/eTKntqcrKniO\nhoSCqpOVnMorZWZnI4rjglNCSOii5JMQP1Q0lVtvUntrC6c9uUno6uroQOP5ek5ti0pKeI6GEBIK\nKPkkxA8lJGmRMmYMp7Z7du6gle/EZXu//47T8xIRGYnM7BwvREQICXaUfBLipwo59iq1Njejtuos\nz9GQYNTc1ITaqipObSdPnQoR1ZYlhHBA7xyE+Km8ggmIio7m1PaH776D3e7+HD4SOliWxZ6dOzi1\nDVMoUDSVhtwJIdxQ8kmInxKLxZg1fwGntj1dXag4eoTniEgwOVddjUsNDZzaTp85E2EKBc8REUJC\nBSWfhPix3IICJGq1nNr+sHMneru7eY6IBAPj4CC2f/M1p7ZqjQZTbpnOc0SEkFBCySchfkwkEmH2\ngjJOba1WK7Z+9SUcDgfPUZFAt2PLNzDo9Jzazpg7j4rKE0I8QsknIX4uY+xYjMnI4NT2UmMjKo7Q\n8Dv5ybnqKlSdOsWpbUxcLCYUFvIcESEk1FDySYifYxgGc8oWcm6/Z+cOGn4nAIaG27f9g9twOwDM\nml8GsVjMY0SEkFBEySchASA5NRXjxo/n1JaG38kVngy3a1NSOD+DhBByLUo+CQkQsxeUgRExnNpe\namzE8SOHeY6IBJLaKu7D7QAwu2whGIbb80cIIdei5JOQABETF4dpt87g3H739u1ouniRx4hIoOju\n7MSWLz/n3H78xIlIz8zkMSJCSCij5JOQADJj7jzExMVyamu32/HFRx+iv6+P56iIPzMajfjsww9g\nNpk5tQ9XqVB2+xKeoyKEhDJKPgkJIFKpFEvuXs55+H3QYMDnH34Ai8XCc2TEH9ntdnz96Sfo6eri\nfI5FdyyDMjycx6gIIaGOkk9CAkxyaqpHw+/tra3Y8uUXYFmWx6iIP9qzYwcu1NVxbj9+4kRaZEQI\n4R0ln4QEoBlz5yE2Lo5z+5ozZ3Dwhz38BUT8zqkTFTh68ADn9jTcTgjxFko+CQlAUqkUS+7hPvwO\nAHu//x61VVU8RkX8RXNTE7Z9zb2eJ0DD7YQQ76Hkk5AApU1JwS23zvToHF9/9gkaL1zgKSLiDzra\n2vDppvdgt9k4n4OG2wkh3kTJJyEB7Na5cxGfmMi5vc1qw2eb3qcSTEGiq6MDH737DoyDRs7nUGs0\nNNxOCPEqSj4JCWBSqRTLV98PhVLJ+RxWqxWfbnoPzU1NPEZGfK2nuwsfvfsOBg0GzueQSCVYvvp+\nGm4nhHgVJZ+EBLjIqCjcs+o+iBju/5zNJjM2v/cu9YAGqM6Odmza8Db0Op1H51ly1z1ISk7mKSpC\nCLk5Sj4JCQJjMjJQOG2aR+cwm8zYvPFdmgMaYNpbW/HBhg2c92y/IrdgAsZPnMhTVIQQMjJKPgkJ\nEpk545CVk+vROa4MwdecPctTVMSbmhob8eE7f4NxcNCj82hTUlEwuZCnqAghxDlKPgkJIpOnTsWY\njAyPzmGz2vDlxx9h/+5dcDgcPEVG+Hai/Cg+fOdvMBm5Ly4CgNj4eJTMmAlGRB8HhBDfoHcbQoKI\nSCzG3StXITIqyuNz7du1C3//ZDNtxeln7HY7tn/zD2z7+muPfzkIUyiwYvX9kMpkPEVHCCGjo+ST\nkCCjDA/H8tX3Qx4W5vG5as6exftvvYn+3l4eIiOeGjQYsPm9jag4csTjc4klEty96j5ExcTwEBkh\nhLiOkk9CglB8YiJWrn0QMrnnPVodbW14943X0dTY6HlghLOOtjZsfPN1XORhQZhIJMLdK1chPTOT\nh8gIIcQ9lHwSEqSSU1Nx7wNrIZVKPT7XoMGAD9/5G44eOEDzQH2MZVmcqazE+2+/ib4ez3ugGRGD\nO++9F9m5ni1OI4QQrij5JCSIpaanY8X9D0AskXh8LofDge+3fYsP/rYBPd1dPERHRqMbGMBnH3yA\nf3z+GSxmz+feMgyDpXcvR25+AQ/REUIIN5R8EhLk0rOycO8Da3jpAQWAyxcvYsNfX8HRg9QL6i1X\nejvffuV/UF9bw8s5RSIR7lixAgWTJ/NyPkII4YqST0JCQHpWFm9zQIGhckzff0u9oN5wbW+np2WU\nrhCLxbjz3pXInziJl/MRQognKPkkJESkpqdj1YMP87IK/oorvaBH9u+H3W7n7byhyOFw4NSJCl57\nO4GhVe333HcfcvPzeTsnIYR4wvOJYISQgJGcmoo1//RzfPbhJl4WrwBDvaC7tm9DRfkRzJ5fhtyC\nAoioYLnLWJbFhbo67Nm5Ax1tbbyeW6FUYvl9q5Gans7reQkhxBOUfBISYuISEvDgY0/gq08281K2\n54q+nl78/dNPcHj/PsxeUIbM7GwwDMPb+YNR86VL2LNzBy55oYxVfGIiVqy+HxE8bDhACCF8ouST\nkBCkDA/HyrUP4rtvt/JSsPxa7a2t+OT99zAmIwNzyhYiOTWV1/MHg86Oduz97jucq672yvlz8/Ox\n5J7lkNHORYQQP0TJJyEhSiwWY9HSOxCfkIAd33zD+8r1Sw0NeO/NN5Cdm4vi6aVIy8gI6Z5QlmXR\n2tyM44cP4+zpk2AdrFeuM3PefJTOnk1THwghfouST0JCXOHUEsTExuGLjz+CcXCQ9/PX1dSgrqYG\nMXGxKJo6DQWTJyNMoeD9Ov7KarGg6vRpVBw9graWFq9dRyqTYek9y2lhESHE71HySQjBmIwMPPTE\nk/jiow/R3trqlWt0d3Zh59Yt2LNzB/InTUJRSQkSkrReuZY/6Onuwomj5Th1ooK3kkkjiYyKwvLV\n9yM+MdGr1yGEED5Q8kkIATCUwKx97HEc2LMbh/ft81oBeavVispjx1B57BiSU1ORW1CA7HG5iIqJ\n8cr1fGmgvx/1tbWorTqLxvPnfXLNyVOnYt7CRbyW0CKEEG+i5JMQcpVEIsHsBWXIycvDli+/RGd7\nu1ev19zUhOamJnz/7beIjYtDdm4exuaOgzYlNSDmLLIsi/bWVtTXDk0t8Oaw+vU0kRG4/a67kZE1\n1mfXJIQQPlDySQi5QVJyCh564kmv94Jeq6uzE12dnTi0by8USiWyc3ORnpWFRG0yoqKj/SIZZVkW\n/X19aGtpxsULF1BfW4uB/n6fx0G9nYSQQEbJJyHkpnzdC3ot4+AgTlVU4FRFBQBAHiZHQmISErXJ\nSEzW+iQhvTbRbGtuQWtLM9pbW2Ac9O78TWeot5MQEgwo+SSEOHWlF/Tgnj04tG+vT3pBr2c2mXGp\nsXFYMXZ5mBwRkZEIV6mhUl/50kClVkGlViNcpYZEIoFILIJYJIbVagXLshg0GGC322G322HQ66HX\n6WDQ66Af0EF35c86Hfr7+ry+UMgd1NtJCAkWlHwSQkYlkUgwa8ECTCgsxN7vv0PV6dNChwSzyYyO\ntnYArvXI9vX3AQB++HarF6PiX2Z2NuaUlQV1ZQBCSGih5JMQ4rKomBjcee9KTJsxE3t27kBDfb3Q\nIQUtbUoK5ixciLSMTKFDIYQQXlHySQhxW6JWi1UPPoTGCxfww84daLl8WeiQgkZMXCxmL1iInLy8\nkN4RihASvCj5JIRwlp6ZibTHHkdtVRX2fr8T3Z1dQocUsNQaDWbOm4+CyZMhFouFDocQQryGkk9C\niEcYhkFufj6yc3NRV1ONiqNHcfHCBaHDChhJyckoKilB3oSJkEqlQodDCCFeR8knIYQXYrEYufkF\nyM0vQGdHOyrLy3G68gTMJrPQofkdiVSC8RMmoqikBEnJKUKHQwghPkXJJyGEd3HxCShbshSzFpSh\n6tRJVBw9io62NqHDElxUdDQKp5ZgYlERFEql0OEQQoggKPkkhHiNXC5H4dQSTC6eiuamSzh5/Djq\nampgHBwUOjSfkYfJkZmdg4mFRUjPyvKLnZoIIURIlHwSQryOYRikjElDypg0OBwONDc1oa6mGvW1\nNUG5SCkiMhJjx+UiOy8XY9IzaAERIYRcg5JPQohPiUQipKalITUtDfMWLUZ3Vxfqa2pQX1uDpksX\nwTpYoUPkRJuSgrHjxiE7Nw9xCQlUJokQQkZAySchRFAxsbGImTED02bMgHFwEE0XL6KtpWVoT/WW\nFhj0eqFDvEGYQoFErRZJ2mQkaJOQMiYNao1G6LAIISQgUPJJCPEbCqUSOXl5yMnLAwCwLAvdwMCP\nyeiPCWlrCww63yWk1yeaidpkREZFUc8mIYRwRMknIcRvMQwDTUQENBERVxNSADCbzTDoddAP6KDX\n6aDX//jfq18DsJgtcLAOOOwOOBwOSAxSMAwDhVIBkUgMkUgEqVQKlVr945cGKrUa4WoVVGoN1D++\nLpPLKdEkhBAeUfJJCAk4crkccrkc0TGxLrc5duwYAKC4uNhbYRFCCHEB1fwghBBCCCE+Q8knIYQQ\nQgjxGd6SzzfffBNz585FZGQkRCIRLl26dMMxvb29WLNmDSIjIxEZGYm1a9eiv7+frxAIIYQQQoif\n4y35NBqNWLx4MV544YURj1m9ejUqKyuxfft2bNu2DRUVFVizZg1fIRBCCCGEED/H24KjdevWAfhp\nUv/1qqursX37dhw4cADTpk0DALzxxhuYOXMmzp07h5ycHL5CIYQQQgghfspncz4PHToElUqF6dOn\nX32ttLQU4eHhOHTokK/CIIQQQgghAvJZqaW2tjbExcUNe41hGMTHx6OtrW3EdqE0JzQ7OxtAaP3M\n7qD74xzdH+fo/oyM7o1zdH+co/szMro3N+e053P9+vUQiUROv/bu3eurWAkhhBBCSIBz2vP59NNP\nY+3atU5PkJqa6tKFEhMT0dnZOew1lmXR0dGBxMREl85BCCGEEEICm9PkMyYmBjExMbxcaPr06dDr\n9Th06NDVeZ+HDh2CwWBAaWnpsGMjIiJ4uSYhhBBCCPEvvM35bGtrQ1tbG86dOwcAOHv2LHp6epCW\nloaoqCjk5eVh8eLFePzxx/Hmm2+CZVk8/vjjuOOOO67OiSCEEEIIIcGNYVmW5eNEzz//PH73u98N\nnZRhwLIsGIbBO++8c3Xovq+vD7/61a/w9ddfAwDuvPNOvPLKK9BoNHyEQAghhBBC/BxvySchhBBC\nCCGjob3d/YQr25Omp6ffUG3gX//1XwWI1vdo+1b3zJkz54ZnZfXq1UKHJZhXX30VGRkZUCgUKC4u\nxv79+4UOyS88//zzNzwnWq1W6LAEsXfvXixbtgwpKSkQiUTYuHHjDcc8//zzSE5OhlKpxNy5c1FV\nVSVApMIY7f489NBDNzxL16/nCGa///3vMXXqVERERCA+Ph7Lli3D2bNnbzgulJ+ha1Hy6Sdc2Z6U\nYRg899xzV+fXtrW14d/+7d98GKVwaPtW9zAMg0ceeWTYs/LGG28IHZYgNm/ejKeeegrr169HZWUl\nSktLcdttt6GpqUno0PxCbm7usOfk9OnTQockCIPBgIkTJ+LPf/4zFAoFGIYZ9v0//OEP+OMf/4hX\nXnkF5eXliI+PR1lZGfR6vUAR+9Zo94dhGJSVlQ17lrZu3SpQtL73ww8/4Je//CUOHTqEXbt2QSKR\nYMGCBejt7b16TKg/Q8OwxK+Ul5ezDMOwFy9evOF76enp7MsvvyxAVP5jpPtTVVXFMgzDHjx48Opr\n+/fvZxmGYWtra30dpuDmzJnD/vKXvxQ6DL9QUlLCPvbYY8Ney87OZp999lmBIvIfzz33HFtQUCB0\nGH5HpVKxGzduvPp3h8PBJiYmsi+99NLV14xGI6tWq9k33nhDiBAFdf39YVmWffDBB9mlS5cKFJH/\n0ev1rFgsZr/55huWZekZuh71fAaYl19+GbGxsSgsLMRLL70Eq9UqdEh+gbZvvdHHH3+MuLg4FBQU\n4Le//W1I/nZtsVhQUVGBhQsXDnt94cKFOHjwoEBR+ZcLFy4gOTkZmZmZuO+++9DQ0CB0SH6noaEB\n7e3tw56jsLAwzJo1i56jHzEMg/379yMhIQHjxo3DY489dkNt71AyMDAAh8OBqKgoAPQMXc9n22sS\nz/36179GUVERYmJicOTIEfzLv/wLGhoa8NZbbwkdmuC4bt8arFavXo309HRotVqcOXMGzz77LE6d\nOoXt27cLHZpPdXV1wW63IyEhYdjrofpcXO+WW27Bxo0bkZubi/b2drz44osoLS3F2bNnER0dLXR4\nfuPKs3Kz56ilpUWIkPzO4sWLsXz5cmRkZKChoQHr16/HvHnzcPz4cchkMqHD87l169ahsLDwaocI\nPUPDUc+nF/G9PenTTz+N2bNno6CgAI8++ihee+01bNiwYdickkBC27e6x5379fOf/xxlZWXIz8/H\nypUr8cknn2Dnzp04ceKEwD8F8SeLFy/GihUrUFBQgPnz52PLli1wOBw3XWxDbu76uY+hauXKlVi6\ndCny8/OxdOlSfPvtt6itrcWWLVuEDs3nnnnmGRw8eBCff/65S89HKD5D1PPpRXxuT3ozU6dOBQDU\n19df/XMgoe1b3ePJ/SoqKoJYLEZ9fT0KCwu9EZ5fio2NhVgsRnt7+7DX29vbkZSUJFBU/kupVCI/\nPx/19fVCh+JXrryHtLe3IyUl5err7e3tQfP+wrekpCSkpKSE3LP09NNP45NPPsHu3buRnp5+9XV6\nhoaj5NOL+Nye9GYqKysBIGA/RIXavjVQeXK/Tp8+DbvdHrDPClcymQxTpkzBjh07sHz58quv79y5\nEz/72c8EjMw/mUwmVFdXY968eUKH4lcyMjKQmJiIHTt2YMqUKQCG7tX+/fvx8ssvCxydf+rs7ERz\nc3NIveesW7cOn376KXbv3o2cnJxh36NnaDhKPv3EaNuTHj58GIcOHcLcuXMRERGB8vJyPPPMM7jz\nzjuH/RYVrGj7VtdduHABmzZtwpIlSxATE4Oqqir85je/QVFREW699Vahw/O5Z555BmvWrEFJSQlK\nS0vx+uuvo62tDU888YTQoQnun//5n7Fs2TKkpqaio6MD//Ef/wGj0YgHH3xQ6NB8zmAwoK6uDgDg\ncDhw8eJFVFZWIiYmBqmpqXjqqafw0ksvITc3F9nZ2XjxxRehVqtDpn6us/sTHR2N5557DitWrEBi\nYiIaGxvx7LPPIiEhAXfffbfAkfvGL37xC2zatAlfffUVIiIirs7xVKvVCA8PB8MwIf8MDSP0cnsy\n5LnnnmMZhmEZhmFFItHVP18pZ1FRUcHecsstbGRkJKtQKNjc3Fz2hRdeYI1Go8CR+8bN7o9IJBpW\n7qO3t5d94IEHWI1Gw2o0GnbNmjVsf3+/gFELo6mpiZ09ezYbExPDyuVyduzYsexTTz3F9vb2Ch2a\nYF599VU2PT2dlcvlbHFxMbtv3z6hQ/ILq1atYrVaLSuTydjk5GR2xYoVbHV1tdBhCWJe4hoaAAAA\nsElEQVT37t03fQ9++OGHrx7z/PPPs0lJSWxYWBg7Z84c9uzZswJG7FvO7o/RaGQXLVrExsfHszKZ\njE1LS2Mffvhh9vLly0KH7TPX35crXy+88MKw40L5GboWba9JCCGEEEJ8hla7E0IIIYQQn6HkkxBC\nCCGE+Awln4QQQgghxGco+SSEEEIIIT5DySchhBBCCPEZSj4JIYQQQojPUPJJCCGEEEJ8hpJPQggh\nhBDiM/8/3QDBZRpvieYAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0xa971630>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "import ukf_internal\n",
    "with book_format.figsize(10, 6):\n",
    "    ukf_internal.show_four_gps()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In 2D two measurements are typically enough to determine a unique solution. There are two intersections of the range circles, but usually the second intersection is not physically realizable (it is in space, or under ground). However, with GPS we also need to solve for time, so we would need a third measurement to get a 2D position.\n",
    "\n",
    "However, since GPS is a 3D system we need to solve for the 3 dimensions of space, and 1 dimension of time. That is 4 unknowns, so in theory with 4 satellites we have all the information we need. However, we normally have at least 6 satellites in view, and often more than 6. This means the system is *overdetermined*. Finally, because of the noise in the measurements none of pseudoranges intersect exactly.\n",
    "\n",
    "If you are well versed in linear algebra you know that this an extremely common problem in scientific computing, and that there are various techniques for solving overdetermined systems. Probably the most common approach used by GPS receivers to find the position is the *iterative least squares* algorithm, commonly abbreviated ILS. As you know, if the errors are Gaussian then the least squares algorithm finds the optimal solution. In other words, we want to minimize the square of the residuals for an overdetermined system.\n",
    "\n",
    "Let's start with some definitions which should be familiar to you. First, we define the innovation as \n",
    "\n",
    "$$\\delta \\mathbf{z}^-= \\mathbf{z} - h(\\mathbf{x}^-)$$\n",
    "\n",
    "where $\\mathbf{z}$ is the measurement, $h(\\bullet)$ is the measurement function, and $\\delta \\mathbf{z}^-$ is the innovation, which we abbreviate as $y$ in FilterPy. I don't use the $\\mathbf{x}^-$ symbology often, but it is the prediction for the state variable. In other words, this is just the equation $\\mathbf{y} = \\mathbf{z} - \\mathbf{Hx}$ in the linear Kalman filter's update step.\n",
    "\n",
    "Next, the *measurement residual* is\n",
    "\n",
    "$$\\delta \\mathbf{z}^+ = \\mathbf{z} - h(\\mathbf{x}^+)$$\n",
    "\n",
    "I don't use the plus superscript much because I find it quickly makes the equations unreadable, but $\\mathbf{x}^+$ it is just the *a posteriori* state estimate, which is just the predicted or unknown future state. In other words, the predict step of the linear Kalman filter computes this value. Here it is stands for the value of x which the ILS algorithm will compute on each iteration.\n",
    "\n",
    "These equations give us the following linear algebra equation:\n",
    "\n",
    "$$\\delta \\mathbf{z}^- = \\mathbf{H}\\delta \\mathbf{x} + \\delta \\mathbf{z}^+$$\n",
    "\n",
    "$\\mathbf{H}$ is our measurement function, defined as\n",
    "\n",
    "$$\\mathbf{H} = \\frac{d\\mathbf{h}}{d\\mathbf{x}} = \\frac{d\\mathbf{z}}{d\\mathbf{x}}$$\n",
    "\n",
    "We find the minimum of an equation by taking the derivative and setting it to zero. In this case we want to minimize the square of the residuals, so our equation is"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "$$ \\frac{\\partial}{\\partial \\mathbf{x}}({\\delta \\mathbf{z}^+}^\\mathsf{T}\\delta \\mathbf{z}^+) = 0,$$\n",
    "\n",
    "where\n",
    "\n",
    "$$\\delta \\mathbf{z}^+=\\delta \\mathbf{z}^- - \\mathbf{H}\\delta \\mathbf{x}.$$\n",
    "\n",
    "Here I have switched to using the matrix $\\mathbf{H}$ as the measurement function. We want to use linear algebra to peform the ILS, so for each step we will have to compute the matrix $\\mathbf{H}$ which corresponds to $h(\\mathbf{x^-})$ during each iteration.  $h(\\bullet)$ is usually nonlinear for these types of problems so you will have to linearize it at each step (more about this soon).\n",
    "\n",
    "For various reasons you may want to weigh some measurement more than others. For example, the geometry of the problem might favor orthogonal measurements, or some measurements may be more noisy than others. We can do that with the equation\n",
    "\n",
    "$$ \\frac{\\partial}{\\partial \\mathbf{x}}({\\delta \\mathbf{z}^+}^\\mathsf{T}\\mathbf{W}\\delta \\mathbf{z}^+) = 0$$\n",
    "\n",
    "If we solve the first equation for ${\\delta \\mathbf{x}}$ (the derivation is shown in the next section) we get\n",
    "\n",
    "$${\\delta \\mathbf{x}} = {{(\\mathbf{H}^\\mathsf{T}\\mathbf{H})^{-1}}\\mathbf{H}^\\mathsf{T} \\delta \\mathbf{z}^-}\n",
    "$$\n",
    "\n",
    "And the second equation yields\n",
    "\n",
    "$${\\delta \\mathbf{x}} = {{(\\mathbf{H}^\\mathsf{T}\\mathbf{WH})^{-1}}\\mathbf{H}^\\mathsf{T}\\mathbf{W} \\delta \\mathbf{z}^-}\n",
    "$$\n",
    "\n",
    "Since the equations are overdetermined we cannot solve these equations exactly so we use an iterative approach. An initial guess for the position is made, and this guess is used to compute  for $\\delta \\mathbf{x}$ via the equation above. $\\delta \\mathbf{x}$ is added to the intial guess, and this new state is fed back into the equation to produce another $\\delta \\mathbf{x}$. We iterate in this manner until the difference in the measurement residuals is suitably small."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Derivation of ILS Equations (Optional)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "I will implement the ILS in code, but first let's derive the equation for $\\delta \\mathbf{x}$. You can skip the derivation if you want, but it is somewhat instructive and not too hard if you know basic linear algebra and partial differential equations.\n",
    "\n",
    "Substituting $\\delta \\mathbf{z}^+=\\delta \\mathbf{z}^- - \\mathbf{H}\\delta \\mathbf{x}$ into the partial differential equation we get\n",
    "\n",
    "$$ \\frac{\\partial}{\\partial \\mathbf{x}}(\\delta \\mathbf{z}^- -\\mathbf{H} \\delta \\mathbf{x})^\\mathsf{T}(\\delta \\mathbf{z}^- - \\mathbf{H} \\delta \\mathbf{x})=0$$\n",
    "\n",
    "which expands to\n",
    "\n",
    "$$ \\frac{\\partial}{\\partial \\mathbf{x}}({\\delta \\mathbf{x}}^\\mathsf{T}\\mathbf{H}^\\mathsf{T}\\mathbf{H}\\delta \\mathbf{x} - \n",
    "{\\delta \\mathbf{x}}^\\mathsf{T}\\mathbf{H}^\\mathsf{T}\\delta \\mathbf{z}^- - \n",
    "{\\delta \\mathbf{z}^-}^\\mathsf{T}\\mathbf{H}\\delta \\mathbf{x} +\n",
    "{\\delta \\mathbf{z}^-}^\\mathsf{T}\\delta \\mathbf{z}^-)=0$$"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We know that \n",
    "\n",
    "$$\\frac{\\partial \\mathbf{A}^\\mathsf{T}\\mathbf{B}}{\\partial \\mathbf{B}} = \\frac{\\partial \\mathbf{B}^\\mathsf{T}\\mathbf{A}}{\\partial \\mathbf{B}} = \\mathbf{A}^\\mathsf{T}$$\n",
    "\n",
    "Therefore the third term can be computed as\n",
    "\n",
    "$$\\frac{\\partial}{\\partial \\mathbf{x}}{\\delta \\mathbf{z}^-}^\\mathsf{T}\\mathbf{H}\\delta \\mathbf{x} = {\\delta \\mathbf{z}^-}^\\mathsf{T}\\mathbf{H}$$\n",
    "\n",
    "and the second term as\n",
    "\n",
    "$$\\frac{\\partial}{\\partial \\mathbf{x}}{\\delta \\mathbf{x}}^\\mathsf{T}\\mathbf{H}^\\mathsf{T}\\delta \\mathbf{z}^-={\\delta \\mathbf{z}^-}^\\mathsf{T}\\mathbf{H}$$\n",
    "\n",
    "We also know that\n",
    "$$\\frac{\\partial \\mathbf{B}^\\mathsf{T}\\mathbf{AB}}{\\partial \\mathbf{B}} = \\mathbf{B}^\\mathsf{T}(\\mathbf{A} + \\mathbf{A}^\\mathsf{T})$$\n",
    "\n",
    "Therefore the first term becomes\n",
    "\n",
    "$$\n",
    "\\begin{aligned}\n",
    "\\frac{\\partial}{\\partial \\mathbf{x}}{\\delta \\mathbf{x}}^\\mathsf{T}\\mathbf{H}^\\mathsf{T}\\mathbf{H}\\delta \\mathbf{x} &= {\\delta \\mathbf{x}}^\\mathsf{T}(\\mathbf{H}^\\mathsf{T}\\mathbf{H} + {\\mathbf{H}^\\mathsf{T}\\mathbf{H}}^\\mathsf{T})\\\\\n",
    "&= {\\delta \\mathbf{x}}^\\mathsf{T}(\\mathbf{H}^\\mathsf{T}\\mathbf{H} + \\mathbf{H}^\\mathsf{T}\\mathbf{H}) \\\\\n",
    "&= 2{\\delta \\mathbf{x}}^\\mathsf{T}\\mathbf{H}^\\mathsf{T}\\mathbf{H}\n",
    "\\end{aligned}$$\n",
    "\n",
    "Finally, the fourth term is\n",
    "\n",
    "$$ \\frac{\\partial}{\\partial \\mathbf{x}}\n",
    "{\\delta \\mathbf{z}^-}^\\mathsf{T}\\delta \\mathbf{z}^-=0$$\n",
    "\n",
    "Replacing the terms in the expanded partial differential equation gives us\n",
    "\n",
    "$$\n",
    " 2{\\delta \\mathbf{x}}^\\mathsf{T}\\mathbf{H}^\\mathsf{T}\\mathbf{H} -\n",
    " {\\delta \\mathbf{z}^-}^\\mathsf{T}\\mathbf{H} - {\\delta \\mathbf{z}^-}^\\mathsf{T}\\mathbf{H}\n",
    " =0\n",
    "$$\n",
    "\n",
    "$${\\delta \\mathbf{x}}^\\mathsf{T}\\mathbf{H}^\\mathsf{T}\\mathbf{H} -\n",
    " {\\delta \\mathbf{z}^-}^\\mathsf{T}\\mathbf{H} = 0$$\n",
    " \n",
    "$${\\delta \\mathbf{x}}^\\mathsf{T}\\mathbf{H}^\\mathsf{T}\\mathbf{H} =\n",
    " {\\delta \\mathbf{z}^-}^\\mathsf{T}\\mathbf{H}$$\n",
    "\n",
    "Multiplying each side by $(\\mathbf{H}^\\mathsf{T}\\mathbf{H})^{-1}$ yields\n",
    "\n",
    "$${\\delta \\mathbf{x}}^\\mathsf{T} =\n",
    "{\\delta \\mathbf{z}^-}^\\mathsf{T}\\mathbf{H}(\\mathbf{H}^\\mathsf{T}\\mathbf{H})^{-1}$$\n",
    "\n",
    "Taking the transpose of each side gives\n",
    "\n",
    "$${\\delta \\mathbf{x}} = ({{\\delta \\mathbf{z}^-}^\\mathsf{T}\\mathbf{H}(\\mathbf{H}^\\mathsf{T}\\mathbf{H})^{-1}})^\\mathsf{T} \\\\\n",
    "={{(\\mathbf{H}^\\mathsf{T}\\mathbf{H})^{-1}}^T\\mathbf{H}^\\mathsf{T} \\delta \\mathbf{z}^-} \\\\\n",
    "={{(\\mathbf{H}^\\mathsf{T}\\mathbf{H})^{-1}}\\mathbf{H}^\\mathsf{T} \\delta \\mathbf{z}^-}\n",
    "$$\n",
    "\n",
    "For various reasons you may want to weigh some measurement more than others. We can do that with the equation\n",
    "\n",
    "$$ \\frac{\\partial}{\\partial \\mathbf{x}}({\\delta \\mathbf{z}}^\\mathsf{T}\\mathbf{W}\\delta \\mathbf{z}) = 0$$\n",
    "\n",
    "Replicating the math above with the added $\\mathbf{W}$ term results in\n",
    "\n",
    "$${\\delta \\mathbf{x}} = {{(\\mathbf{H}^\\mathsf{T}\\mathbf{WH})^{-1}}\\mathbf{H}^\\mathsf{T}\\mathbf{W} \\delta \\mathbf{z}^-}\n",
    "$$"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Implementing Iterative Least Squares"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Our goal is to implement an iterative solution to \n",
    "$${\\delta \\mathbf{x}} = {{(\\mathbf{H}^\\mathsf{T}\\mathbf{H})^{-1}}\\mathbf{H}^\\mathsf{T} \\delta \\mathbf{z}^-}\n",
    "$$\n",
    "\n",
    "First, we have to compute $\\mathbf{H}$, where $\\mathbf{H} =  d\\mathbf{z}/d\\mathbf{x}$. Just to keep the example small so the results are easier to interpret we will do this in 2D. Therefore for $n$ satellites $\\mathbf{H}$ expands to\n",
    "\n",
    "$$\\mathbf{H} = \\begin{bmatrix}\n",
    "\\frac{\\partial p_1}{\\partial x_1} & \\frac{\\partial p_1}{\\partial y_1} \\\\\n",
    "\\frac{\\partial p_2}{\\partial x_2} & \\frac{\\partial p_2}{\\partial y_2} \\\\\n",
    "\\vdots & \\vdots \\\\\n",
    "\\frac{\\partial p_n}{\\partial x_n} & \\frac{\\partial p_n}{\\partial y_n}\n",
    "\\end{bmatrix}$$\n",
    "\n",
    "We will linearize $\\mathbf{H}$ by computing the partial for $x$ as\n",
    "\n",
    "$$ \\frac{estimated\\_x\\_position - satellite\\_x\\_position}{estimated\\_range\\_to\\_satellite}$$\n",
    "\n",
    "The equation for $y$ just substitutes $y$ for $x$.\n",
    "\n",
    "Then the algorithm is as follows.\n",
    "\n",
    "    def ILS:\n",
    "        guess position\n",
    "        while not converged:\n",
    "            compute range to satellites for current estimated position\n",
    "            compute H linearized at estimated position\n",
    "            compute new estimate delta from (H^T H)'H^T dz\n",
    "            new estimate = current estimate + estimate delta\n",
    "            check for convergence\n",
    "            "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "iteration: 0\n",
      "innovation [-148.512    28.6789 -148.5361]\n",
      "pos       [ 805.4175  205.2868]\n",
      "\n",
      "\n",
      "iteration: 1\n",
      "innovation [-0.1177 -7.4049 -0.1599]\n",
      "pos       [ 800.04    199.9746]\n",
      "\n",
      "\n",
      "iteration: 2\n",
      "innovation [-0.0463 -0.001  -0.0463]\n",
      "pos       [ 800.  200.]\n",
      "\n",
      "\n",
      "iteration: 3\n",
      "innovation [-0. -0. -0.]\n",
      "pos       [ 800.  200.]\n",
      "\n",
      "\n",
      "Iterated solution:  [ 800.  200.]\n"
     ]
    }
   ],
   "source": [
    "import numpy as np\n",
    "from numpy.linalg import norm, inv\n",
    "from numpy.random import randn\n",
    "from numpy import dot\n",
    "\n",
    "\n",
    "np.random.seed(1234)\n",
    "user_pos = np.array([800, 200])\n",
    "\n",
    "\n",
    "sat_pos = np.asarray(\n",
    "    [[0, 1000],\n",
    "     [0, -1000],\n",
    "     [500, 500]], dtype=float)\n",
    "\n",
    "def satellite_range(pos, sat_pos):\n",
    "    \"\"\" Compute distance between position 'pos' and the list of positions\n",
    "    in sat_pos\"\"\"\n",
    "\n",
    "    N = len(sat_pos)\n",
    "    rng = np.zeros(N)\n",
    "\n",
    "    diff = np.asarray(pos) - sat_pos\n",
    "\n",
    "    for i in range(N):\n",
    "        rng[i] = norm(diff[i])\n",
    "\n",
    "    return norm(diff, axis=1)\n",
    "\n",
    "\n",
    "def hx_ils(pos, sat_pos, range_est):\n",
    "    \"\"\" compute measurement function where\n",
    "    pos : array_like \n",
    "        2D current estimated position. e.g. (23, 45)\n",
    "        \n",
    "    sat_pos : array_like of 2D positions\n",
    "        position of each satellite e.g. [(0,100), (100,0)]\n",
    "        \n",
    "    range_est : array_like of floats\n",
    "        range to each satellite\n",
    "    \"\"\"\n",
    "    \n",
    "    N = len(sat_pos)\n",
    "    H = np.zeros((N, 2))\n",
    "    for j in range(N):\n",
    "        H[j, 0] = (pos[0] - sat_pos[j, 0]) / range_est[j]\n",
    "        H[j, 1] = (pos[1] - sat_pos[j, 1]) / range_est[j]\n",
    "    return H\n",
    "\n",
    "\n",
    "def lop_ils(zs, sat_pos, pos_est, hx, eps=1.e-6):\n",
    "    \"\"\" iteratively estimates the solution to a set of measurement, given\n",
    "    known transmitter locations\"\"\"\n",
    "    pos = np.array(pos_est)\n",
    "\n",
    "    with book_format.numpy_precision(precision=4):\n",
    "        converged = False\n",
    "        for i in range(20):\n",
    "            r_est = satellite_range(pos, sat_pos)\n",
    "            print('iteration:', i)\n",
    "\n",
    "            H = hx(pos, sat_pos, r_est)        \n",
    "            Hinv = inv(dot(H.T, H)).dot(H.T)\n",
    "\n",
    "            # update position estimate\n",
    "            y = zs - r_est\n",
    "            print('innovation', y)\n",
    "\n",
    "            Hy = np.dot(Hinv, y)\n",
    "            pos = pos + Hy\n",
    "            print('pos       {}\\n\\n'.format(pos))\n",
    "\n",
    "            if max(abs(Hy)) < eps:\n",
    "                converged = True\n",
    "                break\n",
    "\n",
    "    return pos, converged\n",
    "\n",
    "# compute measurement of where you are with respect to each sensor\n",
    "rz = satellite_range(user_pos, sat_pos)\n",
    "\n",
    "pos, converted = lop_ils(rz, sat_pos, (900, 90), hx=hx_ils)\n",
    "print('Iterated solution: ', pos)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "So let's think about this. The first iteration is essentially performing the computation that the linear Kalman filter computes during the update step:\n",
    "\n",
    "$$\\mathbf{y} = \\mathbf{z} - \\mathbf{Hx}\\\\\n",
    "\\mathbf{x} = \\mathbf{x} + \\mathbf{Ky}$$\n",
    "\n",
    "where the Kalman gain equals one. You can see that despite the very inaccurate initial guess (900, 90) the computed value for $\\mathbf{x}$, (805.4, 205.3), was very close to the actual value of (800, 200). However, it was not perfect. But after three iterations the ILS algorithm was able to find the exact answer. So hopefully it is clear why we use ILS instead of doing the sensor fusion with the Kalman filter - it gives a better result. Of course, we started with a very inaccurate guess; what if the guess was better?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "iteration: 0\n",
      "innovation [-0.0009 -1.3868 -0.0024]\n",
      "pos       [ 800.0014  199.9991]\n",
      "\n",
      "\n",
      "iteration: 1\n",
      "innovation [-0.0016 -0.     -0.0016]\n",
      "pos       [ 800.  200.]\n",
      "\n",
      "\n",
      "iteration: 2\n",
      "innovation [-0. -0. -0.]\n",
      "pos       [ 800.  200.]\n",
      "\n",
      "\n",
      "Iterated solution:  [ 800.  200.]\n"
     ]
    }
   ],
   "source": [
    "pos, converted = lop_ils(rz, sat_pos, (801, 201), hx=hx_ils)\n",
    "print('Iterated solution: ', pos)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The first iteration produced a better estimate, but it still could be improved upon by iterating.\n",
    "\n",
    "I injected no noise in the measurement to test and display the theoretical performance of the filter. Now let's see how it performs when we inject noise."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "iteration: 0\n",
      "innovation [ 129.8823  100.461   107.5398]\n",
      "pos       [ 831.4474  186.1222]\n",
      "\n",
      "\n",
      "iteration: 1\n",
      "innovation [-31.6446  -7.4837 -30.7861]\n",
      "pos       [ 800.3284  198.8076]\n",
      "\n",
      "\n",
      "iteration: 2\n",
      "innovation [-0.6041 -0.3813  0.3569]\n",
      "pos       [ 799.948   198.6026]\n",
      "\n",
      "\n",
      "iteration: 3\n",
      "innovation [-0.4803  0.0004  0.4802]\n",
      "pos       [ 799.9476  198.6025]\n",
      "\n",
      "\n",
      "iteration: 4\n",
      "innovation [-0.4802  0.0007  0.4803]\n",
      "pos       [ 799.9476  198.6025]\n",
      "\n",
      "\n",
      "Iterated solution:  [ 799.9475854   198.60245871]\n"
     ]
    }
   ],
   "source": [
    "# add some noise\n",
    "nrz = []\n",
    "for z in rz:\n",
    "    nrz.append(z + randn())\n",
    "pos, converted = lop_ils(nrz, sat_pos, (601,198.3), hx=hx_ils)\n",
    "print('Iterated solution: ', pos)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Here we can see that the noise means that we no longer find the exact solution but we are still able to quickly converge onto a more accurate solution than the first iteration provides.\n",
    "\n",
    "This is far from a complete coverage of the iterated least squares algorithm, let alone methods used in GNSS to compute positions from GPS pseudoranges. You will find a number of approaches in the literature, including QR decomposition, SVD, and other techniques to solve the overdetermined system. For a nontrivial task you will have to survey the literature and perhaps design your algorithm depending on your specific sensor configuration, the amounts of noise, your accuracy requirements, and the amount of computation you can afford to do."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## References"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    " * [1] *Matrix Exponential* http://en.wikipedia.org/wiki/Matrix_exponential \n",
    "\n",
    " * [2] *LTI System Theory* http://en.wikipedia.org/wiki/LTI_system_theory\n",
    " \n",
    " * [3] C.F. van Loan, \"Computing Integrals Involving the Matrix Exponential,\" IEEE Transactions Automatic Control, June 1978."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.4.1"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}