time_series_models/estspec.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "<a id='estspec'></a>\n",
    "<div id=\"qe-notebook-header\" style=\"text-align:right;\">\n",
    "        <a href=\"https://quantecon.org/\" title=\"quantecon.org\">\n",
    "                <img style=\"width:250px;display:inline;\" src=\"https://assets.quantecon.org/img/qe-menubar-logo.svg\" alt=\"QuantEcon\">\n",
    "        </a>\n",
    "</div>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Estimation of Spectra\n",
    "\n",
    "\n",
    "<a id='index-1'></a>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Contents\n",
    "\n",
    "- [Estimation of Spectra](#Estimation-of-Spectra)  \n",
    "  - [Overview](#Overview)  \n",
    "  - [Periodograms](#Periodograms)  \n",
    "  - [Smoothing](#Smoothing)  \n",
    "  - [Exercises](#Exercises)  \n",
    "  - [Solutions](#Solutions)  "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Overview\n",
    "\n",
    "In a [previous lecture](https://lectures.quantecon.org/arma.html#arma) we covered some fundamental properties of covariance stationary linear stochastic processes\n",
    "\n",
    "One objective for that lecture was to introduce spectral densities — a standard and very useful technique for analyzing such processes\n",
    "\n",
    "In this lecture we turn to the problem of estimating spectral densities and other related quantities from data\n",
    "\n",
    "\n",
    "<a id='index-2'></a>\n",
    "Estimates of the spectral density are computed using what is known as a periodogram — which in\n",
    "turn is computed via the famous [fast Fourier transform](https://en.wikipedia.org/wiki/Fast_Fourier_transform)\n",
    "\n",
    "Once the basic technique has been explained, we will apply it to the analysis of several key macroeconomic time series\n",
    "\n",
    "For supplementary reading, see [[Sar87]](https://lectures.quantecon.org/zreferences.html#sargent1987) or [[CC08]](https://lectures.quantecon.org/zreferences.html#cryerchan2008)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Setup"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "hide-output": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[32m\u001b[1mActivated\u001b[0m /home/qebuild/repos/lecture-source-jl/_build/website/jupyter/Project.toml\u001b[39m\n",
      "\u001b[36m\u001b[1mInfo\u001b[0m quantecon-notebooks-julia 0.1.0 activated, 0.2.0 requested\u001b[39m\n"
     ]
    }
   ],
   "source": [
    "using InstantiateFromURL\n",
    "github_project(\"QuantEcon/quantecon-notebooks-julia\", version = \"0.2.0\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "hide-output": false
   },
   "outputs": [],
   "source": [
    "using LinearAlgebra, Statistics"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "<a id='periodograms'></a>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Periodograms\n",
    "\n",
    "[Recall that](https://lectures.quantecon.org/arma.html#arma-specd) the spectral density $ f $ of a covariance stationary process with\n",
    "autocorrelation function $ \\gamma $ can be written\n",
    "\n",
    "$$\n",
    "f(\\omega) = \\gamma(0) + 2 \\sum_{k \\geq 1} \\gamma(k) \\cos(\\omega k),\n",
    "\\qquad \\omega \\in \\mathbb R\n",
    "$$\n",
    "\n",
    "Now consider the problem of estimating the spectral density of a given time series, when $ \\gamma $ is unknown\n",
    "\n",
    "In particular, let $ X_0, \\ldots, X_{n-1} $ be $ n $ consecutive observations of a single time series that is assumed to be covariance stationary\n",
    "\n",
    "The most common estimator of the spectral density of this process is the *periodogram* of $ X_0, \\ldots, X_{n-1} $, which is defined as\n",
    "\n",
    "\n",
    "<a id='equation-estspec-p'></a>\n",
    "$$\n",
    "I(\\omega)\n",
    ":= \\frac{1}{n} \\left| \\sum_{t=0}^{n-1} X_t e^{i t \\omega} \\right|^2,\n",
    "\\qquad \\omega \\in \\mathbb R \\tag{1}\n",
    "$$\n",
    "\n",
    "(Recall that $ |z| $ denotes the modulus of complex number $ z $)\n",
    "\n",
    "Alternatively, $ I(\\omega) $ can be expressed as\n",
    "\n",
    "$$\n",
    "I(\\omega)\n",
    "= \\frac{1}{n}\n",
    "\\left\\{\n",
    "\\left[\\sum_{t=0}^{n-1} X_t \\cos(\\omega t) \\right]^2\n",
    "+\n",
    "\\left[\\sum_{t=0}^{n-1} X_t \\sin(\\omega t) \\right]^2\n",
    "\\right\\}\n",
    "$$\n",
    "\n",
    "It is straightforward to show that the function $ I $ is even and $ 2\n",
    "\\pi $-periodic (i.e., $ I(\\omega) = I(-\\omega) $ and $ I(\\omega +\n",
    "2\\pi) = I(\\omega) $ for all $ \\omega \\in \\mathbb R $)\n",
    "\n",
    "From these two results, you will be able to verify that the values of\n",
    "$ I $ on $ [0, \\pi] $ determine the values of $ I $ on all of\n",
    "$ \\mathbb R $\n",
    "\n",
    "The next section helps to explain the connection between the periodogram and the spectral density"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Interpretation\n",
    "\n",
    "\n",
    "<a id='index-4'></a>\n",
    "To interpret the periodogram, it is convenient to focus on its values at the *Fourier frequencies*\n",
    "\n",
    "$$\n",
    "\\omega_j := \\frac{2 \\pi j}{n},\n",
    "\\quad j = 0, \\ldots, n - 1\n",
    "$$\n",
    "\n",
    "In what sense is $ I(\\omega_j) $ an estimate of $ f(\\omega_j) $?\n",
    "\n",
    "The answer is straightforward, although it does involve some algebra\n",
    "\n",
    "With a bit of effort one can show that, for any integer $ j > 0 $,\n",
    "\n",
    "$$\n",
    "\\sum_{t=0}^{n-1} e^{i t \\omega_j }\n",
    "= \\sum_{t=0}^{n-1} \\exp \\left\\{ i 2 \\pi j \\frac{t}{n} \\right\\} = 0\n",
    "$$\n",
    "\n",
    "Letting $ \\bar X $ denote the sample mean $ n^{-1} \\sum_{t=0}^{n-1} X_t $, we then have\n",
    "\n",
    "$$\n",
    "n I(\\omega_j)\n",
    " = \\left| \\sum_{t=0}^{n-1} (X_t - \\bar X) e^{i t \\omega_j } \\right|^2\n",
    " =  \\sum_{t=0}^{n-1} (X_t - \\bar X) e^{i t \\omega_j }\n",
    "\\sum_{r=0}^{n-1} (X_r - \\bar X) e^{-i r \\omega_j }\n",
    "$$\n",
    "\n",
    "By carefully working through the sums, one can transform this to\n",
    "\n",
    "$$\n",
    "n I(\\omega_j)\n",
    "=  \\sum_{t=0}^{n-1} (X_t - \\bar X)^2\n",
    "+ 2 \\sum_{k=1}^{n-1} \\sum_{t=k}^{n-1} (X_t - \\bar X)(X_{t-k} - \\bar X)\n",
    "\\cos(\\omega_j k)\n",
    "$$\n",
    "\n",
    "Now let\n",
    "\n",
    "$$\n",
    "\\hat \\gamma(k)\n",
    ":= \\frac{1}{n} \\sum_{t=k}^{n-1} (X_t - \\bar X)(X_{t-k} - \\bar X),\n",
    "\\qquad k = 0,1,\\ldots, n-1\n",
    "$$\n",
    "\n",
    "This is the sample autocovariance function, the natural “plug-in estimator” of the [autocovariance function](https://lectures.quantecon.org/arma.html#arma-defs) $ \\gamma $\n",
    "\n",
    "(“Plug-in estimator” is an informal term for an estimator found by replacing expectations with sample means)\n",
    "\n",
    "With this notation, we can now write\n",
    "\n",
    "$$\n",
    "I(\\omega_j)\n",
    "=  \\hat \\gamma(0)\n",
    "+ 2 \\sum_{k=1}^{n-1} \\hat \\gamma(k) \\cos(\\omega_j k)\n",
    "$$\n",
    "\n",
    "Recalling our expression for $ f $ given [above](#periodograms),\n",
    "we see that $ I(\\omega_j) $ is just a sample analog of $ f(\\omega_j) $"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Calculation\n",
    "\n",
    "\n",
    "<a id='index-5'></a>\n",
    "Let’s now consider how to compute the periodogram as defined in [(1)](#equation-estspec-p)\n",
    "\n",
    "There are already functions available that will do this for us\n",
    "— an example is `periodogram` in the `DSP.jl` package\n",
    "\n",
    "However, it is very simple to replicate their results, and this will give us a platform to make useful extensions\n",
    "\n",
    "The most common way to calculate the periodogram is via the discrete Fourier transform,\n",
    "which in turn is implemented through the [fast Fourier transform](https://en.wikipedia.org/wiki/Fast_Fourier_transform) algorithm\n",
    "\n",
    "In general, given a sequence $ a_0, \\ldots, a_{n-1} $, the discrete\n",
    "Fourier transform computes the sequence\n",
    "\n",
    "$$\n",
    "A_j := \\sum_{t=0}^{n-1} a_t \\exp \\left\\{ i 2 \\pi \\frac{tj}{n} \\right\\},\n",
    "\\qquad j = 0, \\ldots, n-1\n",
    "$$\n",
    "\n",
    "With  $ a_0, \\ldots, a_{n-1} $ stored in Julia array `a`, the function call `fft(a)` returns the values $ A_0, \\ldots, A_{n-1} $ as a Julia array\n",
    "\n",
    "It follows that, when the data $ X_0, \\ldots, X_{n-1} $ are stored in array `X`, the values $ I(\\omega_j) $ at the Fourier frequencies, which are given by\n",
    "\n",
    "$$\n",
    "\\frac{1}{n} \\left| \\sum_{t=0}^{n-1} X_t \\exp \\left\\{ i 2 \\pi \\frac{t j}{n} \\right\\} \\right|^2,\n",
    "\\qquad j = 0, \\ldots, n-1\n",
    "$$\n",
    "\n",
    "can be computed by `abs(fft(X)).^2 / length(X)`\n",
    "\n",
    "Note: The Julia function `abs` acts elementwise, and correctly handles complex numbers (by computing their modulus, which is exactly what we need)\n",
    "\n",
    "A function called `periodogram` that puts all this together can be found [here](https://github.com/QuantEcon/QuantEcon.jl/blob/master/src/estspec.jl)\n",
    "\n",
    "Let’s generate some data for this function using the `ARMA` type from [QuantEcon.jl](https://github.com/QuantEcon/QuantEcon.jl) (see the [lecture on linear processes](https://lectures.quantecon.org/arma.html#arma) for more details)\n",
    "\n",
    "Here’s a code snippet that, once the preceding code has been run, generates data from the process\n",
    "\n",
    "\n",
    "<a id='equation-esp-arma'></a>\n",
    "$$\n",
    "X_t = 0.5 X_{t-1} + \\epsilon_t - 0.8 \\epsilon_{t-2} \\tag{2}\n",
    "$$\n",
    "\n",
    "where $ \\{ \\epsilon_t \\} $ is white noise with unit variance, and compares the periodogram to the actual spectral density"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "hide-output": false
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "WARNING: DSP.TFFilter is deprecated, use PolynomialRatio instead.\n",
      "  likely near /home/qebuild/.julia/packages/IJulia/fRegO/src/kernel.jl:52\n",
      "WARNING: DSP.TFFilter is deprecated, use PolynomialRatio instead.\n",
      "  likely near /home/qebuild/.julia/packages/IJulia/fRegO/src/kernel.jl:52\n",
      "WARNING: DSP.TFFilter is deprecated, use PolynomialRatio instead.\n",
      "  likely near /home/qebuild/.julia/packages/IJulia/fRegO/src/kernel.jl:52\n",
      "WARNING: DSP.TFFilter is deprecated, use PolynomialRatio instead.\n",
      "  likely near /home/qebuild/.julia/packages/IJulia/fRegO/src/kernel.jl:52\n",
      "WARNING: DSP.TFFilter is deprecated, use PolynomialRatio instead.\n",
      "  likely near /home/qebuild/.julia/packages/IJulia/fRegO/src/kernel.jl:52\n",
      "WARNING: DSP.TFFilter is deprecated, use PolynomialRatio instead.\n",
      "  likely near /home/qebuild/.julia/packages/IJulia/fRegO/src/kernel.jl:52\n",
      "WARNING: DSP.TFFilter is deprecated, use PolynomialRatio instead.\n",
      "  likely near /home/qebuild/.julia/packages/IJulia/fRegO/src/kernel.jl:52\n",
      "WARNING: DSP.TFFilter is deprecated, use PolynomialRatio instead.\n",
      "  likely near /home/qebuild/.julia/packages/IJulia/fRegO/src/kernel.jl:52\n",
      "in #spectral_density#10 at /home/qebuild/.julia/packages/QuantEcon/Iww9D/src/arma.jl\n"
     ]
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"utf-8\"?>\n",
       "<svg xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\" width=\"600\" height=\"400\" viewBox=\"0 0 2400 1600\">\n",
       "<defs>\n",
       "  <clipPath id=\"clip9900\">\n",
       "    <rect x=\"0\" y=\"0\" width=\"2400\" height=\"1600\"/>\n",
       "  </clipPath>\n",
       "</defs>\n",
       "<polygon clip-path=\"url(#clip9900)\" points=\"\n",
       "0,1600 2400,1600 2400,0 0,0 \n",
       "  \" fill=\"#ffffff\" fill-rule=\"evenodd\" fill-opacity=\"1\"/>\n",
       "<defs>\n",
       "  <clipPath id=\"clip9901\">\n",
       "    <rect x=\"480\" y=\"0\" width=\"1681\" height=\"1600\"/>\n",
       "  </clipPath>\n",
       "</defs>\n",
       "<polygon clip-path=\"url(#clip9900)\" points=\"\n",
       "113.754,1487.47 2352.76,1487.47 2352.76,47.2441 113.754,47.2441 \n",
       "  \" fill=\"#ffffff\" fill-rule=\"evenodd\" fill-opacity=\"1\"/>\n",
       "<defs>\n",
       "  <clipPath id=\"clip9902\">\n",
       "    <rect x=\"113\" y=\"47\" width=\"2240\" height=\"1441\"/>\n",
       "  </clipPath>\n",
       "</defs>\n",
       "<polyline clip-path=\"url(#clip9902)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  177.122,1487.47 177.122,47.2441 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9902)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  849.477,1487.47 849.477,47.2441 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9902)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  1521.83,1487.47 1521.83,47.2441 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9902)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  2194.19,1487.47 2194.19,47.2441 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9902)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  113.754,1450.17 2352.76,1450.17 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9902)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  113.754,1205.16 2352.76,1205.16 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9902)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  113.754,960.145 2352.76,960.145 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9902)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  113.754,715.133 2352.76,715.133 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9902)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  113.754,470.122 2352.76,470.122 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9902)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  113.754,225.111 2352.76,225.111 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9900)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  113.754,1487.47 2352.76,1487.47 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9900)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  113.754,1487.47 113.754,47.2441 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9900)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  177.122,1487.47 177.122,1465.87 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9900)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  849.477,1487.47 849.477,1465.87 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9900)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  1521.83,1487.47 1521.83,1465.87 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9900)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  2194.19,1487.47 2194.19,1465.87 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9900)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  113.754,1450.17 147.339,1450.17 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9900)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  113.754,1205.16 147.339,1205.16 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9900)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  113.754,960.145 147.339,960.145 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9900)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  113.754,715.133 147.339,715.133 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9900)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  113.754,470.122 147.339,470.122 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9900)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  113.754,225.111 147.339,225.111 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip9900)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 177.122, 1541.47)\" x=\"177.122\" y=\"1541.47\">0</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip9900)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 849.477, 1541.47)\" x=\"849.477\" y=\"1541.47\">1</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip9900)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 1521.83, 1541.47)\" x=\"1521.83\" y=\"1541.47\">2</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip9900)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 2194.19, 1541.47)\" x=\"2194.19\" y=\"1541.47\">3</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip9900)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 89.7545, 1467.67)\" x=\"89.7545\" y=\"1467.67\">0</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip9900)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 89.7545, 1222.66)\" x=\"89.7545\" y=\"1222.66\">1</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip9900)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 89.7545, 977.645)\" x=\"89.7545\" y=\"977.645\">2</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip9900)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 89.7545, 732.633)\" x=\"89.7545\" y=\"732.633\">3</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip9900)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 89.7545, 487.622)\" x=\"89.7545\" y=\"487.622\">4</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip9900)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 89.7545, 242.611)\" x=\"89.7545\" y=\"242.611\">5</text>\n",
       "</g>\n",
       "<polyline clip-path=\"url(#clip9902)\" style=\"stroke:#0000ff; stroke-width:8; stroke-opacity:0.5; fill:none\" points=\"\n",
       "  177.122,1352.07 282.736,1286.19 388.349,975.033 493.962,1133.89 599.576,644.695 705.189,88.0053 810.802,1393.88 916.415,660.436 1022.03,1276.36 1127.64,828.096 \n",
       "  1233.26,1222.67 1338.87,219.534 1444.48,732.77 1550.1,871.299 1655.71,1072.08 1761.32,1117.36 1866.93,1441.83 1972.55,844.957 2078.16,1446.71 2183.77,1407.37 \n",
       "  2289.39,1412.59 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9902)\" style=\"stroke:#ff0000; stroke-width:8; stroke-opacity:0.8; fill:none\" points=\"\n",
       "  177.122,1410.97 194.873,1408.84 212.623,1402.5 230.373,1392.06 248.123,1377.74 265.873,1359.78 283.623,1338.52 301.373,1314.33 319.123,1287.59 336.874,1258.74 \n",
       "  354.624,1228.18 372.374,1196.35 390.124,1163.64 407.874,1130.43 425.624,1097.08 443.374,1063.91 461.125,1031.2 478.875,999.207 496.625,968.139 514.375,938.18 \n",
       "  532.125,909.479 549.875,882.156 567.625,856.305 585.375,831.992 603.126,809.268 620.876,788.16 638.626,768.681 656.376,750.832 674.126,734.602 691.876,719.968 \n",
       "  709.626,706.904 727.376,695.373 745.127,685.337 762.877,676.752 780.627,669.572 798.377,663.75 816.127,659.236 833.877,655.979 851.627,653.931 869.378,653.04 \n",
       "  887.128,653.256 904.878,654.531 922.628,656.816 940.378,660.063 958.128,664.226 975.878,669.26 993.628,675.12 1011.38,681.763 1029.13,689.147 1046.88,697.232 \n",
       "  1064.63,705.977 1082.38,715.345 1100.13,725.298 1117.88,735.799 1135.63,746.815 1153.38,758.309 1171.13,770.25 1188.88,782.605 1206.63,795.342 1224.38,808.431 \n",
       "  1242.13,821.842 1259.88,835.547 1277.63,849.517 1295.38,863.726 1313.13,878.146 1330.88,892.751 1348.63,907.517 1366.38,922.418 1384.13,937.431 1401.88,952.532 \n",
       "  1419.63,967.699 1437.38,982.909 1455.13,998.14 1472.88,1013.37 1490.63,1028.58 1508.38,1043.75 1526.13,1058.86 1543.88,1073.89 1561.63,1088.83 1579.38,1103.64 \n",
       "  1597.13,1118.32 1614.88,1132.85 1632.63,1147.22 1650.38,1161.39 1668.13,1175.37 1685.88,1189.13 1703.63,1202.66 1721.38,1215.94 1739.13,1228.96 1756.88,1241.71 \n",
       "  1774.63,1254.17 1792.38,1266.33 1810.13,1278.18 1827.88,1289.7 1845.63,1300.89 1863.38,1311.73 1881.13,1322.2 1898.89,1332.31 1916.64,1342.04 1934.39,1351.39 \n",
       "  1952.14,1360.33 1969.89,1368.87 1987.64,1376.99 2005.39,1384.69 2023.14,1391.96 2040.89,1398.8 2058.64,1405.19 2076.39,1411.13 2094.14,1416.62 2111.89,1421.64 \n",
       "  2129.64,1426.21 2147.39,1430.3 2165.14,1433.92 2182.89,1437.07 2200.64,1439.73 2218.39,1441.92 2236.14,1443.62 2253.89,1444.84 2271.64,1445.57 2289.39,1445.81 \n",
       "  \n",
       "  \"/>\n",
       "<polygon clip-path=\"url(#clip9900)\" points=\"\n",
       "1706.37,312.204 2280.76,312.204 2280.76,130.764 1706.37,130.764 \n",
       "  \" fill=\"#ffffff\" fill-rule=\"evenodd\" fill-opacity=\"1\"/>\n",
       "<polyline clip-path=\"url(#clip9900)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  1706.37,312.204 2280.76,312.204 2280.76,130.764 1706.37,130.764 1706.37,312.204 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip9900)\" style=\"stroke:#0000ff; stroke-width:8; stroke-opacity:0.5; fill:none\" points=\"\n",
       "  1730.37,191.244 1874.37,191.244 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip9900)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 1898.37, 208.744)\" x=\"1898.37\" y=\"208.744\">periodogram</text>\n",
       "</g>\n",
       "<polyline clip-path=\"url(#clip9900)\" style=\"stroke:#ff0000; stroke-width:8; stroke-opacity:0.8; fill:none\" points=\"\n",
       "  1730.37,251.724 1874.37,251.724 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip9900)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 1898.37, 269.224)\" x=\"1898.37\" y=\"269.224\">spectral density</text>\n",
       "</g>\n",
       "</svg>\n"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "using QuantEcon, Plots, Random\n",
    "Random.seed!(42) # For reproducible results.\n",
    "\n",
    "n = 40              # Data size\n",
    "ϕ = 0.5             # AR parameter\n",
    "θ = [0, -0.8]       # MA parameter\n",
    "σ = 1.0\n",
    "lp = ARMA(ϕ, θ, σ)\n",
    "X = simulation(lp, ts_length = n)\n",
    "\n",
    "x, y = periodogram(X)\n",
    "x_sd, y_sd = spectral_density(lp, two_pi=false, res=120)\n",
    "\n",
    "plot(x, y,linecolor=\"blue\", linewidth=2, linealpha=0.5, lab=\"periodogram\")\n",
    "plot!(x_sd, y_sd, linecolor=\"red\", linewidth=2, linealpha=0.8, lab=\"spectral density\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This estimate looks rather disappointing, but the data size is only 40, so\n",
    "perhaps it’s not surprising that the estimate is poor\n",
    "\n",
    "However, if we try again with `n = 1200` the outcome is not much better\n",
    "\n",
    "<img src=\"https://s3-ap-southeast-2.amazonaws.com/lectures.quantecon.org/jl/_static/figures/periodogram1.png\" style=\"\">\n",
    "\n",
    "  \n",
    "The periodogram is far too irregular relative to the underlying spectral density\n",
    "\n",
    "This brings us to our next topic"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Smoothing\n",
    "\n",
    "\n",
    "<a id='index-7'></a>\n",
    "There are two related issues here\n",
    "\n",
    "One is that, given the way the fast Fourier transform is implemented, the\n",
    "number of points $ \\omega $ at which $ I(\\omega) $ is estimated\n",
    "increases in line with the amount of data\n",
    "\n",
    "In other words, although we have more data, we are also using it to estimate more values\n",
    "\n",
    "A second issue is that densities of all types are fundamentally hard to\n",
    "estimate without parametric assumptions\n",
    "\n",
    "\n",
    "<a id='index-8'></a>\n",
    "Typically, nonparametric estimation of densities requires some degree of smoothing\n",
    "\n",
    "The standard way that smoothing is applied to periodograms is by taking local averages\n",
    "\n",
    "In other words, the value $ I(\\omega_j) $ is replaced with a weighted\n",
    "average of the adjacent values\n",
    "\n",
    "$$\n",
    "I(\\omega_{j-p}), I(\\omega_{j-p+1}), \\ldots, I(\\omega_j), \\ldots, I(\\omega_{j+p})\n",
    "$$\n",
    "\n",
    "This weighted average can be written as\n",
    "\n",
    "\n",
    "<a id='equation-estspec-ws'></a>\n",
    "$$\n",
    "I_S(\\omega_j) := \\sum_{\\ell = -p}^{p} w(\\ell) I(\\omega_{j+\\ell}) \\tag{3}\n",
    "$$\n",
    "\n",
    "where the weights $ w(-p), \\ldots, w(p) $ are a sequence of $ 2p + 1 $ nonnegative\n",
    "values summing to one\n",
    "\n",
    "In generally, larger values of $ p $ indicate more smoothing — more on\n",
    "this below\n",
    "\n",
    "The next figure shows the kind of sequence typically used\n",
    "\n",
    "Note the smaller weights towards the edges and larger weights in the center, so that more distant values from $ I(\\omega_j) $ have less weight than closer ones in the sum [(3)](#equation-estspec-ws)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "hide-output": false
   },
   "outputs": [
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"utf-8\"?>\n",
       "<svg xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\" width=\"600\" height=\"400\" viewBox=\"0 0 2400 1600\">\n",
       "<defs>\n",
       "  <clipPath id=\"clip0300\">\n",
       "    <rect x=\"0\" y=\"0\" width=\"2400\" height=\"1600\"/>\n",
       "  </clipPath>\n",
       "</defs>\n",
       "<polygon clip-path=\"url(#clip0300)\" points=\"\n",
       "0,1600 2400,1600 2400,0 0,0 \n",
       "  \" fill=\"#ffffff\" fill-rule=\"evenodd\" fill-opacity=\"1\"/>\n",
       "<defs>\n",
       "  <clipPath id=\"clip0301\">\n",
       "    <rect x=\"480\" y=\"0\" width=\"1681\" height=\"1600\"/>\n",
       "  </clipPath>\n",
       "</defs>\n",
       "<polygon clip-path=\"url(#clip0300)\" points=\"\n",
       "242.516,1425.62 2352.76,1425.62 2352.76,121.675 242.516,121.675 \n",
       "  \" fill=\"#ffffff\" fill-rule=\"evenodd\" fill-opacity=\"1\"/>\n",
       "<defs>\n",
       "  <clipPath id=\"clip0302\">\n",
       "    <rect x=\"242\" y=\"121\" width=\"2111\" height=\"1305\"/>\n",
       "  </clipPath>\n",
       "</defs>\n",
       "<polyline clip-path=\"url(#clip0300)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  242.516,1425.62 2352.76,1425.62 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0300)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  242.516,1425.62 242.516,121.675 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0300)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  468.14,1425.62 468.14,1406.06 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0300)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  882.888,1425.62 882.888,1406.06 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0300)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  1297.64,1425.62 1297.64,1406.06 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0300)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  1712.38,1425.62 1712.38,1406.06 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0300)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  2127.13,1425.62 2127.13,1406.06 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0300)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  242.516,1388.71 274.17,1388.71 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0300)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  242.516,1093.48 274.17,1093.48 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0300)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  242.516,798.25 274.17,798.25 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0300)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  242.516,503.017 274.17,503.017 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0300)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  242.516,207.785 274.17,207.785 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip0300)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 468.14, 1479.62)\" x=\"468.14\" y=\"1479.62\">-10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0300)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 882.888, 1479.62)\" x=\"882.888\" y=\"1479.62\">-5</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0300)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 1297.64, 1479.62)\" x=\"1297.64\" y=\"1479.62\">0</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0300)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 1712.38, 1479.62)\" x=\"1712.38\" y=\"1479.62\">5</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0300)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 2127.13, 1479.62)\" x=\"2127.13\" y=\"1479.62\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0300)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 218.516, 1406.21)\" x=\"218.516\" y=\"1406.21\">0.00</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0300)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 218.516, 1110.98)\" x=\"218.516\" y=\"1110.98\">0.02</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0300)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 218.516, 815.75)\" x=\"218.516\" y=\"815.75\">0.04</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0300)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 218.516, 520.517)\" x=\"218.516\" y=\"520.517\">0.06</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0300)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 218.516, 225.285)\" x=\"218.516\" y=\"225.285\">0.08</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0300)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:84px; text-anchor:middle;\" transform=\"rotate(0, 1297.64, 73.2)\" x=\"1297.64\" y=\"73.2\">Hanning window</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0300)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:66px; text-anchor:middle;\" transform=\"rotate(0, 1297.64, 1559.48)\" x=\"1297.64\" y=\"1559.48\">Position in sequence of weights</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0300)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:66px; text-anchor:middle;\" transform=\"rotate(-90, 89.2861, 773.647)\" x=\"89.2861\" y=\"773.647\">Weights</text>\n",
       "</g>\n",
       "<polyline clip-path=\"url(#clip0302)\" style=\"stroke:#00008b; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  302.24,1388.71 385.19,1367.76 468.14,1306.31 551.089,1208.57 634.039,1081.18 716.989,932.838 799.938,773.647 882.888,614.456 965.838,466.113 1048.79,338.728 \n",
       "  1131.74,240.983 1214.69,179.537 1297.64,158.579 1380.59,179.537 1463.54,240.983 1546.49,338.728 1629.43,466.113 1712.38,614.456 1795.33,773.647 1878.28,932.838 \n",
       "  1961.23,1081.18 2044.18,1208.57 2127.13,1306.31 2210.08,1367.76 2293.03,1388.71 \n",
       "  \"/>\n",
       "</svg>\n"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "function hanning_window(M)\n",
    "    w = [0.5 - 0.5 * cos(2 * pi * n / (M - 1)) for n = 0:(M-1)]\n",
    "    return w\n",
    "end\n",
    "\n",
    "window = hanning_window(25) / sum(hanning_window(25))\n",
    "x = range(-12, 12, length = 25)\n",
    "plot(x, window, color=\"darkblue\", title=\"Hanning window\", ylabel=\"Weights\",\n",
    "    xlabel=\"Position in sequence of weights\", legend=false, grid=false)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Estimation with Smoothing\n",
    "\n",
    "\n",
    "<a id='index-9'></a>\n",
    "Our next step is to provide code that will not only estimate the periodogram but also provide smoothing as required\n",
    "\n",
    "Such functions have been written in  [estspec.jl](https://github.com/QuantEcon/QuantEcon.jl/blob/master/src/estspec.jl) and are available once you’ve installed [QuantEcon.jl](http://quantecon.org/julia_index.html)\n",
    "\n",
    "The [GitHub listing](https://github.com/QuantEcon/QuantEcon.jl/blob/master/src/estspec.jl) displays three functions,  `smooth()`, `periodogram()`, `ar_periodogram()`. We will discuss the first two here and the third one [below](#ar-periodograms)\n",
    "\n",
    "The `periodogram()` function returns a periodogram, optionally smoothed via the `smooth()` function\n",
    "\n",
    "Regarding the `smooth()` function, since smoothing adds a nontrivial amount of computation, we have applied a fairly terse array-centric method based around `conv`\n",
    "\n",
    "Readers are left either to  explore or simply to use this code according to their interests\n",
    "\n",
    "The next three figures each show smoothed and unsmoothed periodograms, as well as the population or “true” spectral density\n",
    "\n",
    "(The model is the same as before — see equation [(2)](#equation-esp-arma) — and there are 400 observations)\n",
    "\n",
    "From top figure to bottom, the window length is varied from small to large\n",
    "\n",
    "\n",
    "<a id='fig-window-smoothing'></a>\n",
    "<img src=\"https://s3-ap-southeast-2.amazonaws.com/lectures.quantecon.org/jl/_static/figures/window_smoothing.png\" style=\"\">\n",
    "\n",
    "  \n",
    "In looking at the figure, we can see that for this model and data size, the\n",
    "window length chosen in the middle figure provides the best fit\n",
    "\n",
    "Relative to this value, the first window length provides insufficient\n",
    "smoothing, while the third gives too much smoothing\n",
    "\n",
    "Of course in real estimation problems the true spectral density is not visible\n",
    "and the choice of appropriate smoothing will have to be made based on\n",
    "judgement/priors or some other theory\n",
    "\n",
    "\n",
    "<a id='estspec-pfas'></a>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Pre-Filtering and Smoothing\n",
    "\n",
    "\n",
    "<a id='index-11'></a>\n",
    "In the [code listing](https://github.com/QuantEcon/QuantEcon.jl/blob/master/src/estspec.jl) we showed three functions from the file `estspec.jl`\n",
    "\n",
    "The third function in the file (`ar_periodogram()`) adds a pre-processing step to periodogram smoothing\n",
    "\n",
    "First we describe the basic idea, and after that we give the code\n",
    "\n",
    "The essential idea is to\n",
    "\n",
    "1. Transform the data in order to make estimation of the spectral density more efficient  \n",
    "1. Compute the periodogram associated with the transformed data  \n",
    "1. Reverse the effect of the transformation on the periodogram, so that it now\n",
    "  estimates the spectral density of the original process  \n",
    "\n",
    "\n",
    "Step 1 is called *pre-filtering* or *pre-whitening*, while step 3 is called *recoloring*\n",
    "\n",
    "The first step is called pre-whitening because the\n",
    "transformation is usually designed to turn the data into something closer to white noise\n",
    "\n",
    "Why would this be desirable in terms of spectral density estimation?\n",
    "\n",
    "The reason is that we are smoothing our estimated periodogram based on\n",
    "estimated values at nearby points — recall [(3)](#equation-estspec-ws)\n",
    "\n",
    "The underlying assumption that makes this a good idea is that the true\n",
    "spectral density is relatively regular — the value of $ I(\\omega) $ is close\n",
    "to that of $ I(\\omega') $ when $ \\omega $ is close to $ \\omega' $\n",
    "\n",
    "This will not be true in all cases, but it is certainly true for white noise\n",
    "\n",
    "For white noise, $ I $ is as regular as possible — [it is a constant function](https://lectures.quantecon.org/arma.html#arma-wnsd)\n",
    "\n",
    "In this case, values of $ I(\\omega') $ at points $ \\omega' $ near to $ \\omega $\n",
    "provided the maximum possible amount of information about the value $ I(\\omega) $\n",
    "\n",
    "Another way to put this is that if $ I $ is relatively constant, then we can use a large amount of smoothing without introducing too much bias\n",
    "\n",
    "\n",
    "<a id='ar-periodograms'></a>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### The AR(1) Setting\n",
    "\n",
    "\n",
    "<a id='index-12'></a>\n",
    "Let’s examine this idea more carefully in a particular setting — where\n",
    "the data are assumed to be generated by an  AR(1) process\n",
    "\n",
    "(More general ARMA settings can be handled using similar techniques to those described below)\n",
    "\n",
    "Suppose in particular that $ \\{X_t\\} $ is covariance stationary and AR(1),\n",
    "with\n",
    "\n",
    "\n",
    "<a id='equation-estspec-ar-dgp'></a>\n",
    "$$\n",
    "X_{t+1} = \\mu + \\phi X_t + \\epsilon_{t+1} \\tag{4}\n",
    "$$\n",
    "\n",
    "where $ \\mu $ and $ \\phi \\in (-1, 1) $ are unknown parameters and $ \\{ \\epsilon_t \\} $ is white noise\n",
    "\n",
    "It follows that if we regress $ X_{t+1} $ on $ X_t $ and an intercept, the residuals\n",
    "will approximate white noise\n",
    "\n",
    "Let\n",
    "\n",
    "- $ g $ be the spectral density of $ \\{ \\epsilon_t \\} $ — a constant function, as discussed above  \n",
    "- $ I_0 $ be the periodogram estimated from the residuals — an estimate of $ g $  \n",
    "- $ f $ be the spectral density of $ \\{ X_t \\} $ — the object we are trying to estimate  \n",
    "\n",
    "\n",
    "In view of [an earlier result](https://lectures.quantecon.org/arma.html#arma-spec-den) we obtained while discussing ARMA processes, $ f $ and $ g $ are related by\n",
    "\n",
    "\n",
    "<a id='equation-ar-sdsc'></a>\n",
    "$$\n",
    "f(\\omega) = \\left| \\frac{1}{1 - \\phi e^{i\\omega}} \\right|^2 g(\\omega) \\tag{5}\n",
    "$$\n",
    "\n",
    "This suggests that the recoloring step, which constructs an estimate $ I $ of $ f $ from $ I_0 $, should set\n",
    "\n",
    "$$\n",
    "I(\\omega) = \\left| \\frac{1}{1 - \\hat \\phi e^{i\\omega}} \\right|^2 I_0(\\omega)\n",
    "$$\n",
    "\n",
    "where $ \\hat \\phi $ is the OLS estimate of $ \\phi $\n",
    "\n",
    "The code for `ar_periodogram()` — the third function in `estspec.jl` — does exactly this. (See the code [here](https://github.com/QuantEcon/QuantEcon.jl/blob/master/src/estspec.jl))\n",
    "\n",
    "The next figure shows realizations of the two kinds of smoothed periodograms\n",
    "\n",
    "1. “standard smoothed periodogram”, the ordinary smoothed periodogram, and  \n",
    "1. “AR smoothed periodogram”, the pre-whitened and recolored one generated by `ar_periodogram()`  \n",
    "\n",
    "\n",
    "The periodograms are calculated from time series drawn from [(4)](#equation-estspec-ar-dgp) with $ \\mu = 0 $ and $ \\phi = -0.9 $\n",
    "\n",
    "Each time series is of length 150\n",
    "\n",
    "The difference between the three subfigures is just randomness — each one uses a different draw of the time series\n",
    "\n",
    "\n",
    "<a id='fig-ar-smoothed-periodogram'></a>\n",
    "<img src=\"https://s3-ap-southeast-2.amazonaws.com/lectures.quantecon.org/jl/_static/figures/ar_smoothed_periodogram.png\" style=\"\">\n",
    "\n",
    "  \n",
    "In all cases, periodograms are fit with the “hamming” window and window length of 65\n",
    "\n",
    "Overall, the fit of the AR smoothed periodogram is much better, in the sense\n",
    "of being closer to the true spectral density"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Exercises\n",
    "\n",
    "\n",
    "<a id='estspec-ex1'></a>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Exercise 1\n",
    "\n",
    "Replicate [this figure](#fig-window-smoothing) (modulo randomness)\n",
    "\n",
    "The model is as in equation [(2)](#equation-esp-arma) and there are 400 observations\n",
    "\n",
    "For the smoothed periodogram, the window type is “hamming”\n",
    "\n",
    "\n",
    "<a id='estspec-ex2'></a>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Exercise 2\n",
    "\n",
    "Replicate [this figure](#fig-ar-smoothed-periodogram) (modulo randomness)\n",
    "\n",
    "The model is as in equation [(4)](#equation-estspec-ar-dgp), with $ \\mu = 0 $, $ \\phi = -0.9 $\n",
    "and 150 observations in each time series\n",
    "\n",
    "All periodograms are fit with the “hamming” window and window length of 65"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Solutions"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Exercise 1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "hide-output": false
   },
   "outputs": [],
   "source": [
    "n = 400\n",
    "ϕ = 0.5\n",
    "θ = [0, -0.8]\n",
    "σ = 1.0\n",
    "lp = ARMA(ϕ, θ, 1.0)\n",
    "X = simulation(lp, ts_length = n)\n",
    "\n",
    "xs = []\n",
    "x_sds = []\n",
    "x_sms = []\n",
    "ys = []\n",
    "y_sds = []\n",
    "y_sms = []\n",
    "titles = []\n",
    "\n",
    "for (i, wl) in enumerate([15, 55, 175])  # window lengths\n",
    "    x, y = periodogram(X)\n",
    "    push!(xs, x)\n",
    "    push!(ys, y)\n",
    "\n",
    "    x_sd, y_sd = spectral_density(lp, two_pi=false, res=120)\n",
    "    push!(x_sds, x_sd)\n",
    "    push!(y_sds, y_sd)\n",
    "\n",
    "    x, y_smoothed = periodogram(X, \"hamming\", wl)\n",
    "    push!(x_sms, x)\n",
    "    push!(y_sms, y_smoothed)\n",
    "\n",
    "    t = \"window length = $wl\"\n",
    "    push!(titles, t)\n",
    "end"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "hide-output": false
   },
   "outputs": [
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"utf-8\"?>\n",
       "<svg xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\" width=\"600\" height=\"400\" viewBox=\"0 0 2400 1600\">\n",
       "<defs>\n",
       "  <clipPath id=\"clip0700\">\n",
       "    <rect x=\"0\" y=\"0\" width=\"2400\" height=\"1600\"/>\n",
       "  </clipPath>\n",
       "</defs>\n",
       "<polygon clip-path=\"url(#clip0700)\" points=\"\n",
       "0,1600 2400,1600 2400,0 0,0 \n",
       "  \" fill=\"#ffffff\" fill-rule=\"evenodd\" fill-opacity=\"1\"/>\n",
       "<defs>\n",
       "  <clipPath id=\"clip0701\">\n",
       "    <rect x=\"480\" y=\"0\" width=\"1681\" height=\"1600\"/>\n",
       "  </clipPath>\n",
       "</defs>\n",
       "<polygon clip-path=\"url(#clip0700)\" points=\"\n",
       "140.517,420.808 2352.76,420.808 2352.76,121.675 140.517,121.675 \n",
       "  \" fill=\"#ffffff\" fill-rule=\"evenodd\" fill-opacity=\"1\"/>\n",
       "<defs>\n",
       "  <clipPath id=\"clip0702\">\n",
       "    <rect x=\"140\" y=\"121\" width=\"2213\" height=\"300\"/>\n",
       "  </clipPath>\n",
       "</defs>\n",
       "<polyline clip-path=\"url(#clip0702)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  203.127,420.808 203.127,121.675 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0702)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  867.446,420.808 867.446,121.675 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0702)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  1531.76,420.808 1531.76,121.675 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0702)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  2196.08,420.808 2196.08,121.675 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0702)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  140.517,412.344 2352.76,412.344 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0702)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  140.517,319.432 2352.76,319.432 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0702)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  140.517,226.519 2352.76,226.519 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0702)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  140.517,133.607 2352.76,133.607 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,420.808 2352.76,420.808 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,420.808 140.517,121.675 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  203.127,420.808 203.127,416.321 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  867.446,420.808 867.446,416.321 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  1531.76,420.808 1531.76,416.321 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  2196.08,420.808 2196.08,416.321 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,412.344 173.7,412.344 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,319.432 173.7,319.432 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,226.519 173.7,226.519 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,133.607 173.7,133.607 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 203.127, 474.808)\" x=\"203.127\" y=\"474.808\">0</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 867.446, 474.808)\" x=\"867.446\" y=\"474.808\">1</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 1531.76, 474.808)\" x=\"1531.76\" y=\"474.808\">2</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 2196.08, 474.808)\" x=\"2196.08\" y=\"474.808\">3</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 116.517, 429.844)\" x=\"116.517\" y=\"429.844\">0</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 116.517, 336.932)\" x=\"116.517\" y=\"336.932\">5</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 116.517, 244.019)\" x=\"116.517\" y=\"244.019\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 116.517, 151.107)\" x=\"116.517\" y=\"151.107\">15</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:84px; text-anchor:middle;\" transform=\"rotate(0, 1246.64, 73.2)\" x=\"1246.64\" y=\"73.2\">window length = 15</text>\n",
       "</g>\n",
       "<polyline clip-path=\"url(#clip0702)\" style=\"stroke:#0000ff; stroke-width:8; stroke-opacity:0.5; fill:none\" points=\"\n",
       "  203.127,411.291 213.562,411.549 223.998,407.328 234.433,409.331 244.868,407.359 255.303,403.761 265.738,409.664 276.173,410.327 286.608,412.042 297.043,411.699 \n",
       "  307.478,392.702 317.913,405.314 328.348,404.48 338.784,411.539 349.219,408.723 359.654,370.654 370.089,407.358 380.524,392.361 390.959,380.67 401.394,400.638 \n",
       "  411.829,397.022 422.264,403.671 432.699,342.666 443.134,358.162 453.57,321.215 464.005,325.691 474.44,295.638 484.875,323.259 495.31,411.015 505.745,359.732 \n",
       "  516.18,384.323 526.615,286.838 537.05,388.577 547.485,384.559 557.92,276.636 568.355,353.506 578.791,273.798 589.226,349.023 599.661,407.382 610.096,392.857 \n",
       "  620.531,393.504 630.966,364.187 641.401,364.595 651.836,330.013 662.271,321.178 672.706,366.866 683.141,302.749 693.577,337.26 704.012,343.963 714.447,284.941 \n",
       "  724.882,407.877 735.317,368.122 745.752,377.911 756.187,380.023 766.622,371.957 777.057,351.165 787.492,349.413 797.927,361.758 808.363,329.634 818.798,318.475 \n",
       "  829.233,326.601 839.668,330.502 850.103,402.011 860.538,374.619 870.973,344.498 881.408,322.054 891.843,409.815 902.278,377.572 912.713,358.373 923.149,332.283 \n",
       "  933.584,244.946 944.019,408.725 954.454,332.516 964.889,398.071 975.324,352.463 985.759,359.835 996.194,398.852 1006.63,347.856 1017.06,374.465 1027.5,396.006 \n",
       "  1037.93,398.098 1048.37,379.7 1058.8,281.058 1069.24,342.773 1079.67,412.272 1090.11,300.787 1100.55,252.166 1110.98,319.906 1121.42,379.434 1131.85,130.141 \n",
       "  1142.29,322.383 1152.72,388.635 1163.16,386.756 1173.59,347.878 1184.03,334.696 1194.46,404.768 1204.9,321.449 1215.33,338.201 1225.77,351.083 1236.2,373.736 \n",
       "  1246.64,317.923 1257.07,385.637 1267.51,314.775 1277.94,346.826 1288.38,396.25 1298.81,407.611 1309.25,407.182 1319.68,409.131 1330.12,365.622 1340.55,409.579 \n",
       "  1350.99,352.92 1361.42,362.518 1371.86,377.596 1382.29,373.432 1392.73,283.815 1403.16,403.669 1413.6,388.937 1424.03,384.239 1434.47,374.591 1444.9,391.164 \n",
       "  1455.34,378.103 1465.77,378.798 1476.21,408.879 1486.64,411.203 1497.08,402.206 1507.51,382.243 1517.95,349.943 1528.38,381.885 1538.82,390.175 1549.25,295.715 \n",
       "  1559.69,412.048 1570.12,391.679 1580.56,407.988 1590.99,322.521 1601.43,300.466 1611.86,407.87 1622.3,337.316 1632.73,401.902 1643.17,404.96 1653.6,409.338 \n",
       "  1664.04,400.268 1674.48,376.06 1684.91,397.814 1695.35,400.433 1705.78,344.557 1716.22,391.279 1726.65,345.698 1737.09,399.346 1747.52,389.178 1757.96,387.556 \n",
       "  1768.39,387.705 1778.83,403.32 1789.26,405.831 1799.7,411.767 1810.13,408.429 1820.57,404.972 1831,398.018 1841.44,408.496 1851.87,401.738 1862.31,398.364 \n",
       "  1872.74,411.232 1883.18,384.067 1893.61,412.104 1904.05,405.537 1914.48,410.667 1924.92,400.798 1935.35,411.021 1945.79,408.238 1956.22,405.934 1966.66,411.675 \n",
       "  1977.09,406.86 1987.53,406.538 1997.96,408.922 2008.4,408.501 2018.83,410.852 2029.27,409.521 2039.7,409.158 2050.14,405.613 2060.57,408.657 2071.01,408.294 \n",
       "  2081.44,407.239 2091.88,412.334 2102.31,411.089 2112.75,411.322 2123.18,411.165 2133.62,410.138 2144.05,410.925 2154.49,409.678 2164.92,411.694 2175.36,411.776 \n",
       "  2185.79,410.395 2196.23,411.817 2206.66,412.311 2217.1,411.556 2227.53,412.22 2237.97,412.074 2248.41,412.252 2258.84,412.342 2269.28,411.944 2279.71,411.58 \n",
       "  2290.15,412.083 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0702)\" style=\"stroke:#ff0000; stroke-width:8; stroke-opacity:0.8; fill:none\" points=\"\n",
       "  203.127,409.371 220.665,409.21 238.203,408.729 255.741,407.938 273.279,406.851 290.817,405.489 308.355,403.877 325.893,402.042 343.431,400.014 360.969,397.826 \n",
       "  378.507,395.508 396.045,393.094 413.583,390.613 431.121,388.095 448.659,385.565 466.197,383.05 483.735,380.569 501.273,378.142 518.811,375.786 536.349,373.514 \n",
       "  553.887,371.337 571.425,369.265 588.963,367.304 606.501,365.46 624.039,363.736 641.577,362.135 659.114,360.658 676.652,359.304 694.19,358.073 711.728,356.964 \n",
       "  729.266,355.973 746.804,355.098 764.342,354.337 781.88,353.686 799.418,353.141 816.956,352.7 834.494,352.357 852.032,352.11 869.57,351.955 887.108,351.888 \n",
       "  904.646,351.904 922.184,352.001 939.722,352.174 957.26,352.42 974.798,352.736 992.336,353.118 1009.87,353.562 1027.41,354.066 1044.95,354.626 1062.49,355.239 \n",
       "  1080.03,355.902 1097.56,356.613 1115.1,357.368 1132.64,358.164 1150.18,359 1167.72,359.872 1185.25,360.777 1202.79,361.714 1220.33,362.68 1237.87,363.673 \n",
       "  1255.41,364.69 1272.94,365.73 1290.48,366.789 1308.02,367.867 1325.56,368.96 1343.1,370.068 1360.63,371.188 1378.17,372.318 1395.71,373.457 1413.25,374.602 \n",
       "  1430.79,375.752 1448.32,376.906 1465.86,378.061 1483.4,379.216 1500.94,380.37 1518.47,381.521 1536.01,382.667 1553.55,383.807 1571.09,384.939 1588.63,386.063 \n",
       "  1606.16,387.176 1623.7,388.278 1641.24,389.368 1658.78,390.443 1676.32,391.503 1693.85,392.546 1711.39,393.573 1728.93,394.58 1746.47,395.568 1764.01,396.534 \n",
       "  1781.54,397.48 1799.08,398.402 1816.62,399.3 1834.16,400.174 1851.7,401.023 1869.23,401.845 1886.77,402.639 1904.31,403.406 1921.85,404.144 1939.39,404.853 \n",
       "  1956.92,405.531 1974.46,406.178 1992,406.795 2009.54,407.379 2027.08,407.93 2044.61,408.448 2062.15,408.933 2079.69,409.384 2097.23,409.8 2114.77,410.181 \n",
       "  2132.3,410.527 2149.84,410.838 2167.38,411.112 2184.92,411.351 2202.46,411.553 2219.99,411.719 2237.53,411.848 2255.07,411.94 2272.61,411.996 2290.15,412.014 \n",
       "  \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0702)\" style=\"stroke:#000000; stroke-width:8; stroke-opacity:1; fill:none\" points=\"\n",
       "  203.127,409.529 213.562,409.38 223.998,409.202 234.433,408.829 244.868,408.578 255.303,408.28 265.738,407.951 276.173,407.561 286.608,406.794 297.043,406.24 \n",
       "  307.478,405.262 317.913,403.89 328.348,402.45 338.784,400.805 349.219,399.182 359.654,397.12 370.089,395.225 380.524,392.499 390.959,389.178 401.394,384.188 \n",
       "  411.829,377.911 422.264,370.792 432.699,362.376 443.134,355.34 453.57,348.842 464.005,345.781 474.44,345.03 484.875,345.278 495.31,347.588 505.745,348.647 \n",
       "  516.18,349.597 526.615,348.821 537.05,346.819 547.485,344.777 557.92,344.27 568.355,346.077 578.791,348.897 589.226,353.273 599.661,357.484 610.096,360.886 \n",
       "  620.531,361.753 630.966,359.827 641.401,355.926 651.836,350.802 662.271,345.909 672.706,342.223 683.141,340.567 693.577,341.617 704.012,344.624 714.447,349.213 \n",
       "  724.882,354.111 735.317,358.343 745.752,361.259 756.187,361.668 766.622,360.366 777.057,357.445 787.492,353.179 797.927,350.017 808.363,347.041 818.798,346.867 \n",
       "  829.233,347.757 839.668,349.925 850.103,352.837 860.538,355.132 870.973,357.829 881.408,357.514 891.843,356.436 902.278,354.059 912.713,351.906 923.149,351.176 \n",
       "  933.584,350.662 944.019,352.022 954.454,354.983 964.889,359.4 975.324,363.557 985.759,366.93 996.194,369.743 1006.63,371.162 1017.06,370.879 1027.5,367.448 \n",
       "  1037.93,363.834 1048.37,358.209 1058.8,349.275 1069.24,341.199 1079.67,332.028 1090.11,323.573 1100.55,316.706 1110.98,312.84 1121.42,313.024 1131.85,315.615 \n",
       "  1142.29,322.258 1152.72,330.249 1163.16,337.652 1173.59,344.064 1184.03,349.713 1194.46,351.871 1204.9,351.271 1215.33,352.285 1225.77,351.975 1236.2,352.329 \n",
       "  1246.64,354.289 1257.07,357.91 1267.51,363.71 1277.94,368.982 1288.38,375.091 1298.81,380.254 1309.25,383.673 1319.68,383.876 1330.12,383.446 1340.55,379.847 \n",
       "  1350.99,375.905 1361.42,372.081 1371.86,369.376 1382.29,368.176 1392.73,368.655 1403.16,370.585 1413.6,373.849 1424.03,377.125 1434.47,380.994 1444.9,384.337 \n",
       "  1455.34,387.035 1465.77,388.401 1476.21,388.704 1486.64,387.911 1497.08,385.67 1507.51,382.891 1517.95,379.404 1528.38,375.97 1538.82,373.875 1549.25,371.299 \n",
       "  1559.69,369.52 1570.12,368.04 1580.56,367.233 1590.99,367.424 1601.43,369.047 1611.86,371.908 1622.3,375.53 1632.73,380.352 1643.17,384.609 1653.6,387.474 \n",
       "  1664.04,388.566 1674.48,388.135 1684.91,386.817 1695.35,384.125 1705.78,382.753 1716.22,381.869 1726.65,382.349 1737.09,384.02 1747.52,386.752 1757.96,390.358 \n",
       "  1768.39,394.043 1778.83,397.169 1789.26,400.156 1799.7,402.003 1810.13,403.366 1820.57,403.894 1831,403.859 1841.44,403.58 1851.87,403.228 1862.31,403.07 \n",
       "  1872.74,403.171 1883.18,403.494 1893.61,404.11 1904.05,404.818 1914.48,405.658 1924.92,406.369 1935.35,406.993 1945.79,407.518 1956.22,407.714 1966.66,408.118 \n",
       "  1977.09,408.226 1987.53,408.416 1997.96,408.488 2008.4,408.604 2018.83,408.633 2029.27,408.641 2039.7,408.7 2050.14,408.748 2060.57,408.901 2071.01,409.154 \n",
       "  2081.44,409.449 2091.88,409.813 2102.31,410.142 2112.75,410.416 2123.18,410.621 2133.62,410.79 2144.05,410.882 2154.49,410.974 2164.92,411.106 2175.36,411.227 \n",
       "  2185.79,411.386 2196.23,411.545 2206.66,411.689 2217.1,411.822 2227.53,411.913 2237.97,411.984 2248.41,412.013 2258.84,412.016 2269.28,412.016 2279.71,412.001 \n",
       "  2290.15,411.989 \n",
       "  \"/>\n",
       "<polygon clip-path=\"url(#clip0700)\" points=\"\n",
       "1545.85,447.115 2280.76,447.115 2280.76,205.195 1545.85,205.195 \n",
       "  \" fill=\"#ffffff\" fill-rule=\"evenodd\" fill-opacity=\"1\"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  1545.85,447.115 2280.76,447.115 2280.76,205.195 1545.85,205.195 1545.85,447.115 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#0000ff; stroke-width:8; stroke-opacity:0.5; fill:none\" points=\"\n",
       "  1569.85,265.675 1713.85,265.675 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 1737.85, 283.175)\" x=\"1737.85\" y=\"283.175\">periodogram</text>\n",
       "</g>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#ff0000; stroke-width:8; stroke-opacity:0.8; fill:none\" points=\"\n",
       "  1569.85,326.155 1713.85,326.155 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 1737.85, 343.655)\" x=\"1737.85\" y=\"343.655\">spectral density</text>\n",
       "</g>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:8; stroke-opacity:1; fill:none\" points=\"\n",
       "  1569.85,386.635 1713.85,386.635 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 1737.85, 404.135)\" x=\"1737.85\" y=\"404.135\">smoothed periodogram</text>\n",
       "</g>\n",
       "<polygon clip-path=\"url(#clip0700)\" points=\"\n",
       "140.517,954.141 2352.76,954.141 2352.76,655.008 140.517,655.008 \n",
       "  \" fill=\"#ffffff\" fill-rule=\"evenodd\" fill-opacity=\"1\"/>\n",
       "<defs>\n",
       "  <clipPath id=\"clip0703\">\n",
       "    <rect x=\"140\" y=\"655\" width=\"2213\" height=\"300\"/>\n",
       "  </clipPath>\n",
       "</defs>\n",
       "<polyline clip-path=\"url(#clip0703)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  203.127,954.141 203.127,655.008 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0703)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  867.446,954.141 867.446,655.008 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0703)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  1531.76,954.141 1531.76,655.008 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0703)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  2196.08,954.141 2196.08,655.008 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0703)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  140.517,945.678 2352.76,945.678 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0703)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  140.517,852.765 2352.76,852.765 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0703)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  140.517,759.853 2352.76,759.853 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0703)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  140.517,666.94 2352.76,666.94 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,954.141 2352.76,954.141 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,954.141 140.517,655.008 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  203.127,954.141 203.127,949.654 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  867.446,954.141 867.446,949.654 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  1531.76,954.141 1531.76,949.654 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  2196.08,954.141 2196.08,949.654 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,945.678 173.7,945.678 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,852.765 173.7,852.765 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,759.853 173.7,759.853 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,666.94 173.7,666.94 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 203.127, 1008.14)\" x=\"203.127\" y=\"1008.14\">0</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 867.446, 1008.14)\" x=\"867.446\" y=\"1008.14\">1</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 1531.76, 1008.14)\" x=\"1531.76\" y=\"1008.14\">2</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 2196.08, 1008.14)\" x=\"2196.08\" y=\"1008.14\">3</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 116.517, 963.178)\" x=\"116.517\" y=\"963.178\">0</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 116.517, 870.265)\" x=\"116.517\" y=\"870.265\">5</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 116.517, 777.353)\" x=\"116.517\" y=\"777.353\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 116.517, 684.44)\" x=\"116.517\" y=\"684.44\">15</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:84px; text-anchor:middle;\" transform=\"rotate(0, 1246.64, 606.533)\" x=\"1246.64\" y=\"606.533\">window length = 55</text>\n",
       "</g>\n",
       "<polyline clip-path=\"url(#clip0703)\" style=\"stroke:#0000ff; stroke-width:8; stroke-opacity:0.5; fill:none\" points=\"\n",
       "  203.127,944.624 213.562,944.882 223.998,940.661 234.433,942.664 244.868,940.692 255.303,937.094 265.738,942.998 276.173,943.66 286.608,945.375 297.043,945.033 \n",
       "  307.478,926.036 317.913,938.647 328.348,937.813 338.784,944.872 349.219,942.056 359.654,903.987 370.089,940.691 380.524,925.694 390.959,914.003 401.394,933.972 \n",
       "  411.829,930.356 422.264,937.004 432.699,875.999 443.134,891.495 453.57,854.549 464.005,859.024 474.44,828.972 484.875,856.592 495.31,944.348 505.745,893.065 \n",
       "  516.18,917.656 526.615,820.172 537.05,921.911 547.485,917.892 557.92,809.97 568.355,886.84 578.791,807.131 589.226,882.356 599.661,940.715 610.096,926.19 \n",
       "  620.531,926.837 630.966,897.52 641.401,897.928 651.836,863.346 662.271,854.511 672.706,900.2 683.141,836.082 693.577,870.594 704.012,877.296 714.447,818.274 \n",
       "  724.882,941.21 735.317,901.455 745.752,911.244 756.187,913.356 766.622,905.291 777.057,884.498 787.492,882.746 797.927,895.091 808.363,862.967 818.798,851.809 \n",
       "  829.233,859.934 839.668,863.835 850.103,935.344 860.538,907.952 870.973,877.831 881.408,855.387 891.843,943.149 902.278,910.906 912.713,891.706 923.149,865.617 \n",
       "  933.584,778.279 944.019,942.059 954.454,865.849 964.889,931.405 975.324,885.796 985.759,893.169 996.194,932.185 1006.63,881.189 1017.06,907.798 1027.5,929.339 \n",
       "  1037.93,931.432 1048.37,913.033 1058.8,814.391 1069.24,876.107 1079.67,945.606 1090.11,834.12 1100.55,785.499 1110.98,853.24 1121.42,912.767 1131.85,663.474 \n",
       "  1142.29,855.716 1152.72,921.969 1163.16,920.089 1173.59,881.211 1184.03,868.029 1194.46,938.101 1204.9,854.783 1215.33,871.535 1225.77,884.417 1236.2,907.07 \n",
       "  1246.64,851.257 1257.07,918.971 1267.51,848.108 1277.94,880.159 1288.38,929.583 1298.81,940.945 1309.25,940.516 1319.68,942.464 1330.12,898.956 1340.55,942.913 \n",
       "  1350.99,886.253 1361.42,895.851 1371.86,910.93 1382.29,906.766 1392.73,817.149 1403.16,937.002 1413.6,922.271 1424.03,917.572 1434.47,907.924 1444.9,924.498 \n",
       "  1455.34,911.436 1465.77,912.131 1476.21,942.212 1486.64,944.536 1497.08,935.539 1507.51,915.577 1517.95,883.277 1528.38,915.218 1538.82,923.508 1549.25,829.049 \n",
       "  1559.69,945.381 1570.12,925.013 1580.56,941.322 1590.99,855.854 1601.43,833.799 1611.86,941.203 1622.3,870.65 1632.73,935.235 1643.17,938.294 1653.6,942.671 \n",
       "  1664.04,933.601 1674.48,909.394 1684.91,931.148 1695.35,933.767 1705.78,877.891 1716.22,924.612 1726.65,879.032 1737.09,932.679 1747.52,922.511 1757.96,920.89 \n",
       "  1768.39,921.039 1778.83,936.653 1789.26,939.165 1799.7,945.1 1810.13,941.762 1820.57,938.306 1831,931.351 1841.44,941.829 1851.87,935.072 1862.31,931.697 \n",
       "  1872.74,944.565 1883.18,917.401 1893.61,945.437 1904.05,938.87 1914.48,944.001 1924.92,934.131 1935.35,944.354 1945.79,941.571 1956.22,939.268 1966.66,945.009 \n",
       "  1977.09,940.194 1987.53,939.872 1997.96,942.255 2008.4,941.835 2018.83,944.185 2029.27,942.854 2039.7,942.491 2050.14,938.946 2060.57,941.99 2071.01,941.627 \n",
       "  2081.44,940.572 2091.88,945.668 2102.31,944.422 2112.75,944.655 2123.18,944.499 2133.62,943.472 2144.05,944.258 2154.49,943.011 2164.92,945.028 2175.36,945.109 \n",
       "  2185.79,943.729 2196.23,945.151 2206.66,945.644 2217.1,944.889 2227.53,945.553 2237.97,945.408 2248.41,945.585 2258.84,945.675 2269.28,945.277 2279.71,944.914 \n",
       "  2290.15,945.416 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0703)\" style=\"stroke:#ff0000; stroke-width:8; stroke-opacity:0.8; fill:none\" points=\"\n",
       "  203.127,942.705 220.665,942.543 238.203,942.062 255.741,941.271 273.279,940.184 290.817,938.823 308.355,937.21 325.893,935.375 343.431,933.348 360.969,931.159 \n",
       "  378.507,928.842 396.045,926.427 413.583,923.947 431.121,921.428 448.659,918.899 466.197,916.383 483.735,913.902 501.273,911.475 518.811,909.119 536.349,906.847 \n",
       "  553.887,904.67 571.425,902.598 588.963,900.637 606.501,898.793 624.039,897.07 641.577,895.469 659.114,893.992 676.652,892.638 694.19,891.407 711.728,890.297 \n",
       "  729.266,889.306 746.804,888.432 764.342,887.67 781.88,887.019 799.418,886.475 816.956,886.033 834.494,885.691 852.032,885.444 869.57,885.288 887.108,885.221 \n",
       "  904.646,885.237 922.184,885.334 939.722,885.507 957.26,885.754 974.798,886.069 992.336,886.451 1009.87,886.895 1027.41,887.399 1044.95,887.959 1062.49,888.573 \n",
       "  1080.03,889.236 1097.56,889.946 1115.1,890.701 1132.64,891.498 1150.18,892.333 1167.72,893.205 1185.25,894.11 1202.79,895.048 1220.33,896.014 1237.87,897.006 \n",
       "  1255.41,898.023 1272.94,899.063 1290.48,900.122 1308.02,901.2 1325.56,902.294 1343.1,903.401 1360.63,904.521 1378.17,905.651 1395.71,906.79 1413.25,907.935 \n",
       "  1430.79,909.086 1448.32,910.239 1465.86,911.394 1483.4,912.55 1500.94,913.703 1518.47,914.854 1536.01,916 1553.55,917.14 1571.09,918.272 1588.63,919.396 \n",
       "  1606.16,920.51 1623.7,921.612 1641.24,922.701 1658.78,923.776 1676.32,924.836 1693.85,925.88 1711.39,926.906 1728.93,927.913 1746.47,928.901 1764.01,929.868 \n",
       "  1781.54,930.813 1799.08,931.735 1816.62,932.634 1834.16,933.508 1851.7,934.356 1869.23,935.178 1886.77,935.973 1904.31,936.739 1921.85,937.477 1939.39,938.186 \n",
       "  1956.92,938.864 1974.46,939.512 1992,940.128 2009.54,940.712 2027.08,941.263 2044.61,941.782 2062.15,942.266 2079.69,942.717 2097.23,943.133 2114.77,943.515 \n",
       "  2132.3,943.861 2149.84,944.171 2167.38,944.446 2184.92,944.684 2202.46,944.887 2219.99,945.052 2237.53,945.181 2255.07,945.274 2272.61,945.329 2290.15,945.347 \n",
       "  \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0703)\" style=\"stroke:#000000; stroke-width:8; stroke-opacity:1; fill:none\" points=\"\n",
       "  203.127,936.006 213.562,936.142 223.998,935.89 234.433,935.571 244.868,934.751 255.303,934.123 265.738,933.191 276.173,931.866 286.608,930.623 297.043,929.097 \n",
       "  307.478,927.628 317.913,926.16 328.348,924.651 338.784,922.963 349.219,921.129 359.654,919.273 370.089,917.294 380.524,915.311 390.959,913.395 401.394,911.307 \n",
       "  411.829,909.33 422.264,907.39 432.699,905.332 443.134,903.63 453.57,901.855 464.005,900.171 474.44,898.553 484.875,897 495.31,895.489 505.745,894.079 \n",
       "  516.18,892.824 526.615,891.589 537.05,890.445 547.485,889.442 557.92,888.536 568.355,887.918 578.791,887.313 589.226,886.721 599.661,886.211 610.096,885.988 \n",
       "  620.531,885.755 630.966,885.526 641.401,885.3 651.836,884.998 662.271,885.08 672.706,885.015 683.141,885.175 693.577,885.165 704.012,885.186 714.447,885.286 \n",
       "  724.882,885.403 735.317,885.545 745.752,885.844 756.187,886.145 766.622,886.503 777.057,886.558 787.492,886.571 797.927,886.928 808.363,886.923 818.798,887.065 \n",
       "  829.233,887.109 839.668,887.298 850.103,887.074 860.538,887.123 870.973,887.508 881.408,887.628 891.843,887.429 902.278,887.175 912.713,887.042 923.149,886.693 \n",
       "  933.584,886.322 944.019,886.016 954.454,885.74 964.889,885.14 975.324,884.861 985.759,884.27 996.194,883.733 1006.63,883.488 1017.06,882.946 1027.5,882.53 \n",
       "  1037.93,882.126 1048.37,881.643 1058.8,881.356 1069.24,881.036 1079.67,880.822 1090.11,880.697 1100.55,880.734 1110.98,880.657 1121.42,880.986 1131.85,881.365 \n",
       "  1142.29,881.642 1152.72,882.068 1163.16,882.72 1173.59,883.501 1184.03,884.142 1194.46,885.038 1204.9,886.073 1215.33,887.236 1225.77,888.676 1236.2,889.673 \n",
       "  1246.64,891.042 1257.07,892.313 1267.51,893.496 1277.94,895 1288.38,896.341 1298.81,897.854 1309.25,899.038 1319.68,900.057 1330.12,901.284 1340.55,902.265 \n",
       "  1350.99,903.582 1361.42,904.628 1371.86,905.378 1382.29,906.292 1392.73,907.175 1403.16,907.848 1413.6,908.284 1424.03,909.192 1434.47,909.672 1444.9,909.816 \n",
       "  1455.34,910.073 1465.77,910.367 1476.21,910.662 1486.64,910.736 1497.08,911.055 1507.51,911.32 1517.95,911.566 1528.38,911.747 1538.82,912.091 1549.25,912.26 \n",
       "  1559.69,912.69 1570.12,913.067 1580.56,913.355 1590.99,913.699 1601.43,914.016 1611.86,914.444 1622.3,915.009 1632.73,915.503 1643.17,916.157 1653.6,916.85 \n",
       "  1664.04,917.53 1674.48,918.252 1684.91,919.278 1695.35,920.011 1705.78,920.826 1716.22,921.695 1726.65,922.62 1737.09,923.531 1747.52,924.493 1757.96,925.465 \n",
       "  1768.39,926.351 1778.83,927.23 1789.26,928.113 1799.7,929.02 1810.13,929.999 1820.57,930.854 1831,931.651 1841.44,932.673 1851.87,933.344 1862.31,934.036 \n",
       "  1872.74,934.636 1883.18,935.433 1893.61,936.263 1904.05,936.771 1914.48,937.455 1924.92,937.944 1935.35,938.398 1945.79,938.813 1956.22,939.22 1966.66,939.661 \n",
       "  1977.09,940.011 1987.53,940.319 1997.96,940.75 2008.4,941.032 2018.83,941.422 2029.27,941.653 2039.7,941.903 2050.14,942.151 2060.57,942.393 2071.01,942.589 \n",
       "  2081.44,942.775 2091.88,942.936 2102.31,943.101 2112.75,943.266 2123.18,943.437 2133.62,943.575 2144.05,943.723 2154.49,943.866 2164.92,943.969 2175.36,944.137 \n",
       "  2185.79,944.225 2196.23,944.326 2206.66,944.404 2217.1,944.507 2227.53,944.56 2237.97,944.617 2248.41,944.673 2258.84,944.696 2269.28,944.732 2279.71,944.76 \n",
       "  2290.15,944.775 \n",
       "  \"/>\n",
       "<polygon clip-path=\"url(#clip0700)\" points=\"\n",
       "140.517,1487.47 2352.76,1487.47 2352.76,1188.34 140.517,1188.34 \n",
       "  \" fill=\"#ffffff\" fill-rule=\"evenodd\" fill-opacity=\"1\"/>\n",
       "<defs>\n",
       "  <clipPath id=\"clip0704\">\n",
       "    <rect x=\"140\" y=\"1188\" width=\"2213\" height=\"300\"/>\n",
       "  </clipPath>\n",
       "</defs>\n",
       "<polyline clip-path=\"url(#clip0704)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  203.127,1487.47 203.127,1188.34 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0704)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  867.446,1487.47 867.446,1188.34 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0704)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  1531.76,1487.47 1531.76,1188.34 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0704)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  2196.08,1487.47 2196.08,1188.34 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0704)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  140.517,1479.01 2352.76,1479.01 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0704)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  140.517,1386.1 2352.76,1386.1 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0704)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  140.517,1293.19 2352.76,1293.19 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0704)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  140.517,1200.27 2352.76,1200.27 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,1487.47 2352.76,1487.47 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,1487.47 140.517,1188.34 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  203.127,1487.47 203.127,1482.99 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  867.446,1487.47 867.446,1482.99 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  1531.76,1487.47 1531.76,1482.99 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  2196.08,1487.47 2196.08,1482.99 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,1479.01 173.7,1479.01 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,1386.1 173.7,1386.1 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,1293.19 173.7,1293.19 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0700)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  140.517,1200.27 173.7,1200.27 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 203.127, 1541.47)\" x=\"203.127\" y=\"1541.47\">0</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 867.446, 1541.47)\" x=\"867.446\" y=\"1541.47\">1</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 1531.76, 1541.47)\" x=\"1531.76\" y=\"1541.47\">2</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 2196.08, 1541.47)\" x=\"2196.08\" y=\"1541.47\">3</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 116.517, 1496.51)\" x=\"116.517\" y=\"1496.51\">0</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 116.517, 1403.6)\" x=\"116.517\" y=\"1403.6\">5</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 116.517, 1310.69)\" x=\"116.517\" y=\"1310.69\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:end;\" transform=\"rotate(0, 116.517, 1217.77)\" x=\"116.517\" y=\"1217.77\">15</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip0700)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:84px; text-anchor:middle;\" transform=\"rotate(0, 1246.64, 1139.87)\" x=\"1246.64\" y=\"1139.87\">window length = 175</text>\n",
       "</g>\n",
       "<polyline clip-path=\"url(#clip0704)\" style=\"stroke:#0000ff; stroke-width:8; stroke-opacity:0.5; fill:none\" points=\"\n",
       "  203.127,1477.96 213.562,1478.22 223.998,1473.99 234.433,1476 244.868,1474.03 255.303,1470.43 265.738,1476.33 276.173,1476.99 286.608,1478.71 297.043,1478.37 \n",
       "  307.478,1459.37 317.913,1471.98 328.348,1471.15 338.784,1478.21 349.219,1475.39 359.654,1437.32 370.089,1474.02 380.524,1459.03 390.959,1447.34 401.394,1467.31 \n",
       "  411.829,1463.69 422.264,1470.34 432.699,1409.33 443.134,1424.83 453.57,1387.88 464.005,1392.36 474.44,1362.3 484.875,1389.93 495.31,1477.68 505.745,1426.4 \n",
       "  516.18,1450.99 526.615,1353.51 537.05,1455.24 547.485,1451.23 557.92,1343.3 568.355,1420.17 578.791,1340.46 589.226,1415.69 599.661,1474.05 610.096,1459.52 \n",
       "  620.531,1460.17 630.966,1430.85 641.401,1431.26 651.836,1396.68 662.271,1387.84 672.706,1433.53 683.141,1369.42 693.577,1403.93 704.012,1410.63 714.447,1351.61 \n",
       "  724.882,1474.54 735.317,1434.79 745.752,1444.58 756.187,1446.69 766.622,1438.62 777.057,1417.83 787.492,1416.08 797.927,1428.42 808.363,1396.3 818.798,1385.14 \n",
       "  829.233,1393.27 839.668,1397.17 850.103,1468.68 860.538,1441.29 870.973,1411.16 881.408,1388.72 891.843,1476.48 902.278,1444.24 912.713,1425.04 923.149,1398.95 \n",
       "  933.584,1311.61 944.019,1475.39 954.454,1399.18 964.889,1464.74 975.324,1419.13 985.759,1426.5 996.194,1465.52 1006.63,1414.52 1017.06,1441.13 1027.5,1462.67 \n",
       "  1037.93,1464.77 1048.37,1446.37 1058.8,1347.72 1069.24,1409.44 1079.67,1478.94 1090.11,1367.45 1100.55,1318.83 1110.98,1386.57 1121.42,1446.1 1131.85,1196.81 \n",
       "  1142.29,1389.05 1152.72,1455.3 1163.16,1453.42 1173.59,1414.54 1184.03,1401.36 1194.46,1471.43 1204.9,1388.12 1215.33,1404.87 1225.77,1417.75 1236.2,1440.4 \n",
       "  1246.64,1384.59 1257.07,1452.3 1267.51,1381.44 1277.94,1413.49 1288.38,1462.92 1298.81,1474.28 1309.25,1473.85 1319.68,1475.8 1330.12,1432.29 1340.55,1476.25 \n",
       "  1350.99,1419.59 1361.42,1429.18 1371.86,1444.26 1382.29,1440.1 1392.73,1350.48 1403.16,1470.34 1413.6,1455.6 1424.03,1450.91 1434.47,1441.26 1444.9,1457.83 \n",
       "  1455.34,1444.77 1465.77,1445.46 1476.21,1475.55 1486.64,1477.87 1497.08,1468.87 1507.51,1448.91 1517.95,1416.61 1528.38,1448.55 1538.82,1456.84 1549.25,1362.38 \n",
       "  1559.69,1478.71 1570.12,1458.35 1580.56,1474.66 1590.99,1389.19 1601.43,1367.13 1611.86,1474.54 1622.3,1403.98 1632.73,1468.57 1643.17,1471.63 1653.6,1476 \n",
       "  1664.04,1466.93 1674.48,1442.73 1684.91,1464.48 1695.35,1467.1 1705.78,1411.22 1716.22,1457.95 1726.65,1412.36 1737.09,1466.01 1747.52,1455.84 1757.96,1454.22 \n",
       "  1768.39,1454.37 1778.83,1469.99 1789.26,1472.5 1799.7,1478.43 1810.13,1475.1 1820.57,1471.64 1831,1464.68 1841.44,1475.16 1851.87,1468.41 1862.31,1465.03 \n",
       "  1872.74,1477.9 1883.18,1450.73 1893.61,1478.77 1904.05,1472.2 1914.48,1477.33 1924.92,1467.46 1935.35,1477.69 1945.79,1474.9 1956.22,1472.6 1966.66,1478.34 \n",
       "  1977.09,1473.53 1987.53,1473.21 1997.96,1475.59 2008.4,1475.17 2018.83,1477.52 2029.27,1476.19 2039.7,1475.82 2050.14,1472.28 2060.57,1475.32 2071.01,1474.96 \n",
       "  2081.44,1473.91 2091.88,1479 2102.31,1477.76 2112.75,1477.99 2123.18,1477.83 2133.62,1476.81 2144.05,1477.59 2154.49,1476.34 2164.92,1478.36 2175.36,1478.44 \n",
       "  2185.79,1477.06 2196.23,1478.48 2206.66,1478.98 2217.1,1478.22 2227.53,1478.89 2237.97,1478.74 2248.41,1478.92 2258.84,1479.01 2269.28,1478.61 2279.71,1478.25 \n",
       "  2290.15,1478.75 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0704)\" style=\"stroke:#ff0000; stroke-width:8; stroke-opacity:0.8; fill:none\" points=\"\n",
       "  203.127,1476.04 220.665,1475.88 238.203,1475.4 255.741,1474.6 273.279,1473.52 290.817,1472.16 308.355,1470.54 325.893,1468.71 343.431,1466.68 360.969,1464.49 \n",
       "  378.507,1462.18 396.045,1459.76 413.583,1457.28 431.121,1454.76 448.659,1452.23 466.197,1449.72 483.735,1447.24 501.273,1444.81 518.811,1442.45 536.349,1440.18 \n",
       "  553.887,1438 571.425,1435.93 588.963,1433.97 606.501,1432.13 624.039,1430.4 641.577,1428.8 659.114,1427.32 676.652,1425.97 694.19,1424.74 711.728,1423.63 \n",
       "  729.266,1422.64 746.804,1421.76 764.342,1421 781.88,1420.35 799.418,1419.81 816.956,1419.37 834.494,1419.02 852.032,1418.78 869.57,1418.62 887.108,1418.55 \n",
       "  904.646,1418.57 922.184,1418.67 939.722,1418.84 957.26,1419.09 974.798,1419.4 992.336,1419.78 1009.87,1420.23 1027.41,1420.73 1044.95,1421.29 1062.49,1421.91 \n",
       "  1080.03,1422.57 1097.56,1423.28 1115.1,1424.03 1132.64,1424.83 1150.18,1425.67 1167.72,1426.54 1185.25,1427.44 1202.79,1428.38 1220.33,1429.35 1237.87,1430.34 \n",
       "  1255.41,1431.36 1272.94,1432.4 1290.48,1433.46 1308.02,1434.53 1325.56,1435.63 1343.1,1436.73 1360.63,1437.85 1378.17,1438.98 1395.71,1440.12 1413.25,1441.27 \n",
       "  1430.79,1442.42 1448.32,1443.57 1465.86,1444.73 1483.4,1445.88 1500.94,1447.04 1518.47,1448.19 1536.01,1449.33 1553.55,1450.47 1571.09,1451.61 1588.63,1452.73 \n",
       "  1606.16,1453.84 1623.7,1454.94 1641.24,1456.03 1658.78,1457.11 1676.32,1458.17 1693.85,1459.21 1711.39,1460.24 1728.93,1461.25 1746.47,1462.23 1764.01,1463.2 \n",
       "  1781.54,1464.15 1799.08,1465.07 1816.62,1465.97 1834.16,1466.84 1851.7,1467.69 1869.23,1468.51 1886.77,1469.31 1904.31,1470.07 1921.85,1470.81 1939.39,1471.52 \n",
       "  1956.92,1472.2 1974.46,1472.85 1992,1473.46 2009.54,1474.05 2027.08,1474.6 2044.61,1475.12 2062.15,1475.6 2079.69,1476.05 2097.23,1476.47 2114.77,1476.85 \n",
       "  2132.3,1477.19 2149.84,1477.5 2167.38,1477.78 2184.92,1478.02 2202.46,1478.22 2219.99,1478.39 2237.53,1478.51 2255.07,1478.61 2272.61,1478.66 2290.15,1478.68 \n",
       "  \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip0704)\" style=\"stroke:#000000; stroke-width:8; stroke-opacity:1; fill:none\" points=\"\n",
       "  203.127,1439.92 213.562,1440.02 223.998,1439.85 234.433,1439.74 244.868,1439.73 255.303,1439.76 265.738,1439.67 276.173,1439.53 286.608,1439.44 297.043,1439.29 \n",
       "  307.478,1439.16 317.913,1438.99 328.348,1438.86 338.784,1438.67 349.219,1438.49 359.654,1438.3 370.089,1438.06 380.524,1437.98 390.959,1437.83 401.394,1437.65 \n",
       "  411.829,1437.45 422.264,1437.17 432.699,1436.99 443.134,1436.74 453.57,1436.47 464.005,1436.17 474.44,1435.93 484.875,1435.61 495.31,1435.39 505.745,1435.14 \n",
       "  516.18,1434.86 526.615,1434.58 537.05,1434.3 547.485,1433.99 557.92,1433.68 568.355,1433.39 578.791,1433.11 589.226,1432.78 599.661,1432.55 610.096,1432.23 \n",
       "  620.531,1431.96 630.966,1431.72 641.401,1431.34 651.836,1431.11 662.271,1430.86 672.706,1430.6 683.141,1430.27 693.577,1429.9 704.012,1429.63 714.447,1429.29 \n",
       "  724.882,1429.06 735.317,1428.9 745.752,1428.69 756.187,1428.55 766.622,1428.3 777.057,1428.07 787.492,1427.94 797.927,1427.7 808.363,1427.52 818.798,1427.28 \n",
       "  829.233,1427.17 839.668,1427.08 850.103,1426.98 860.538,1426.89 870.973,1426.81 881.408,1426.75 891.843,1426.66 902.278,1426.58 912.713,1426.52 923.149,1426.48 \n",
       "  933.584,1426.46 944.019,1426.44 954.454,1426.45 964.889,1426.47 975.324,1426.47 985.759,1426.52 996.194,1426.57 1006.63,1426.66 1017.06,1426.74 1027.5,1426.84 \n",
       "  1037.93,1426.96 1048.37,1427.09 1058.8,1427.24 1069.24,1427.4 1079.67,1427.57 1090.11,1427.77 1100.55,1427.97 1110.98,1428.19 1121.42,1428.42 1131.85,1428.66 \n",
       "  1142.29,1428.91 1152.72,1429.18 1163.16,1429.46 1173.59,1429.76 1184.03,1430.06 1194.46,1430.38 1204.9,1430.7 1215.33,1431.04 1225.77,1431.4 1236.2,1431.76 \n",
       "  1246.64,1432.12 1257.07,1432.49 1267.51,1432.88 1277.94,1433.3 1288.38,1433.69 1298.81,1434.11 1309.25,1434.54 1319.68,1434.97 1330.12,1435.4 1340.55,1435.83 \n",
       "  1350.99,1436.31 1361.42,1436.79 1371.86,1437.31 1382.29,1437.82 1392.73,1438.37 1403.16,1438.89 1413.6,1439.35 1424.03,1439.85 1434.47,1440.34 1444.9,1440.91 \n",
       "  1455.34,1441.4 1465.77,1441.89 1476.21,1442.48 1486.64,1443.01 1497.08,1443.6 1507.51,1444.14 1517.95,1444.63 1528.38,1445.13 1538.82,1445.63 1549.25,1446.16 \n",
       "  1559.69,1446.69 1570.12,1447.25 1580.56,1447.81 1590.99,1448.34 1601.43,1448.92 1611.86,1449.47 1622.3,1450.02 1632.73,1450.61 1643.17,1451.09 1653.6,1451.62 \n",
       "  1664.04,1452.13 1674.48,1452.64 1684.91,1453.15 1695.35,1453.67 1705.78,1454.19 1716.22,1454.71 1726.65,1455.24 1737.09,1455.78 1747.52,1456.31 1757.96,1456.82 \n",
       "  1768.39,1457.28 1778.83,1457.76 1789.26,1458.26 1799.7,1458.75 1810.13,1459.18 1820.57,1459.62 1831,1460.08 1841.44,1460.56 1851.87,1461.09 1862.31,1461.49 \n",
       "  1872.74,1461.95 1883.18,1462.35 1893.61,1462.77 1904.05,1463.18 1914.48,1463.54 1924.92,1463.93 1935.35,1464.29 1945.79,1464.63 1956.22,1464.92 1966.66,1465.25 \n",
       "  1977.09,1465.62 1987.53,1465.97 1997.96,1466.25 2008.4,1466.59 2018.83,1466.99 2029.27,1467.33 2039.7,1467.6 2050.14,1468.07 2060.57,1468.32 2071.01,1468.56 \n",
       "  2081.44,1468.7 2091.88,1468.89 2102.31,1469.15 2112.75,1469.32 2123.18,1469.58 2133.62,1469.71 2144.05,1469.9 2154.49,1470.05 2164.92,1470.22 2175.36,1470.34 \n",
       "  2185.79,1470.53 2196.23,1470.69 2206.66,1470.8 2217.1,1470.86 2227.53,1470.91 2237.97,1470.96 2248.41,1471.02 2258.84,1471.04 2269.28,1471.11 2279.71,1471.16 \n",
       "  2290.15,1471.09 \n",
       "  \"/>\n",
       "</svg>\n"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "plot(xs, ys, layout=(3,1), color=:blue, alpha=0.5,\n",
    "    linewidth=2, label=[\"periodogram\" \"\" \"\"])\n",
    "plot!(x_sds, y_sds, layout=(3,1), color=:red, alpha=0.8,\n",
    "    linewidth=2, label=[\"spectral density\" \"\" \"\"])\n",
    "plot!(x_sms, y_sms, layout=(3,1), color=:black,\n",
    "    linewidth=2, label=[\"smoothed periodogram\" \"\" \"\"])\n",
    "plot!(title=reshape(titles,1,length(titles)))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Exercise 2"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "hide-output": false
   },
   "outputs": [
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"utf-8\"?>\n",
       "<svg xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\" width=\"600\" height=\"400\" viewBox=\"0 0 2400 1600\">\n",
       "<defs>\n",
       "  <clipPath id=\"clip1100\">\n",
       "    <rect x=\"0\" y=\"0\" width=\"2400\" height=\"1600\"/>\n",
       "  </clipPath>\n",
       "</defs>\n",
       "<polygon clip-path=\"url(#clip1100)\" points=\"\n",
       "0,1600 2400,1600 2400,0 0,0 \n",
       "  \" fill=\"#ffffff\" fill-rule=\"evenodd\" fill-opacity=\"1\"/>\n",
       "<defs>\n",
       "  <clipPath id=\"clip1101\">\n",
       "    <rect x=\"480\" y=\"0\" width=\"1681\" height=\"1600\"/>\n",
       "  </clipPath>\n",
       "</defs>\n",
       "<polygon clip-path=\"url(#clip1100)\" points=\"\n",
       "258.107,420.808 2352.76,420.808 2352.76,47.2441 258.107,47.2441 \n",
       "  \" fill=\"#ffffff\" fill-rule=\"evenodd\" fill-opacity=\"1\"/>\n",
       "<defs>\n",
       "  <clipPath id=\"clip1102\">\n",
       "    <rect x=\"258\" y=\"47\" width=\"2096\" height=\"375\"/>\n",
       "  </clipPath>\n",
       "</defs>\n",
       "<polyline clip-path=\"url(#clip1102)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,420.808 258.107,47.2441 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1102)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  924.855,420.808 924.855,47.2441 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1102)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  1591.6,420.808 1591.6,47.2441 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1102)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  2258.35,420.808 2258.35,47.2441 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1102)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,403.041 2352.76,403.041 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1102)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,340.492 2352.76,340.492 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1102)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,277.943 2352.76,277.943 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1102)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,215.394 2352.76,215.394 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1102)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,152.845 2352.76,152.845 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1102)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,90.2953 2352.76,90.2953 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,420.808 2352.76,420.808 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,420.808 258.107,47.2441 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,420.808 258.107,415.205 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  924.855,420.808 924.855,415.205 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  1591.6,420.808 1591.6,415.205 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  2258.35,420.808 2258.35,415.205 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,403.041 289.527,403.041 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,340.492 289.527,340.492 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,277.943 289.527,277.943 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,215.394 289.527,215.394 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,152.845 289.527,152.845 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,90.2953 289.527,90.2953 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 258.107, 474.808)\" x=\"258.107\" y=\"474.808\">0</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 924.855, 474.808)\" x=\"924.855\" y=\"474.808\">1</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 1591.6, 474.808)\" x=\"1591.6\" y=\"474.808\">2</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 2258.35, 474.808)\" x=\"2258.35\" y=\"474.808\">3</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 92.5101, 426.769)\" x=\"92.5101\" y=\"426.769\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 146.035, 399.359)\" x=\"146.035\" y=\"399.359\">-</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 399.359)\" x=\"168.874\" y=\"399.359\">0.5 </text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 115.35, 364.22)\" x=\"115.35\" y=\"364.22\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 336.809)\" x=\"168.874\" y=\"336.809\">0.0 </text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 115.35, 301.671)\" x=\"115.35\" y=\"301.671\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 274.26)\" x=\"168.874\" y=\"274.26\">0.5 </text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 115.35, 239.121)\" x=\"115.35\" y=\"239.121\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 211.711)\" x=\"168.874\" y=\"211.711\">1.0 </text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 115.35, 176.572)\" x=\"115.35\" y=\"176.572\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 149.162)\" x=\"168.874\" y=\"149.162\">1.5 </text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 115.35, 114.023)\" x=\"115.35\" y=\"114.023\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 86.6125)\" x=\"168.874\" y=\"86.6125\">2.0 </text>\n",
       "</g>\n",
       "<polyline clip-path=\"url(#clip1102)\" style=\"stroke:#ff0000; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  258.107,410.235 269.809,410.231 281.511,410.219 293.213,410.198 304.915,410.169 316.617,410.131 328.319,410.085 340.021,410.031 351.723,409.968 363.425,409.897 \n",
       "  375.127,409.818 386.829,409.73 398.531,409.634 410.233,409.529 421.935,409.416 433.637,409.294 445.339,409.164 457.041,409.025 468.742,408.878 480.444,408.722 \n",
       "  492.146,408.558 503.848,408.385 515.55,408.204 527.252,408.013 538.954,407.814 550.656,407.607 562.358,407.39 574.06,407.165 585.762,406.931 597.464,406.688 \n",
       "  609.166,406.437 620.868,406.176 632.57,405.906 644.272,405.628 655.974,405.34 667.676,405.043 679.378,404.737 691.079,404.421 702.781,404.097 714.483,403.763 \n",
       "  726.185,403.419 737.887,403.067 749.589,402.704 761.291,402.332 772.993,401.951 784.695,401.56 796.397,401.159 808.099,400.748 819.801,400.327 831.503,399.896 \n",
       "  843.205,399.455 854.907,399.004 866.609,398.543 878.311,398.071 890.013,397.589 901.715,397.097 913.416,396.593 925.118,396.08 936.82,395.555 948.522,395.019 \n",
       "  960.224,394.473 971.926,393.915 983.628,393.346 995.33,392.765 1007.03,392.173 1018.73,391.57 1030.44,390.955 1042.14,390.328 1053.84,389.689 1065.54,389.037 \n",
       "  1077.24,388.374 1088.95,387.698 1100.65,387.009 1112.35,386.308 1124.05,385.594 1135.75,384.866 1147.46,384.126 1159.16,383.372 1170.86,382.604 1182.56,381.822 \n",
       "  1194.26,381.027 1205.97,380.217 1217.67,379.393 1229.37,378.554 1241.07,377.7 1252.77,376.831 1264.47,375.947 1276.18,375.047 1287.88,374.131 1299.58,373.199 \n",
       "  1311.28,372.251 1322.98,371.286 1334.69,370.304 1346.39,369.305 1358.09,368.288 1369.79,367.253 1381.49,366.2 1393.2,365.128 1404.9,364.038 1416.6,362.928 \n",
       "  1428.3,361.798 1440,360.648 1451.71,359.477 1463.41,358.285 1475.11,357.072 1486.81,355.837 1498.51,354.579 1510.22,353.298 1521.92,351.994 1533.62,350.665 \n",
       "  1545.32,349.312 1557.02,347.933 1568.73,346.529 1580.43,345.098 1592.13,343.64 1603.83,342.153 1615.53,340.638 1627.24,339.093 1638.94,337.518 1650.64,335.911 \n",
       "  1662.34,334.272 1674.04,332.6 1685.74,330.894 1697.45,329.152 1709.15,327.374 1720.85,325.558 1732.55,323.704 1744.25,321.809 1755.96,319.873 1767.66,317.894 \n",
       "  1779.36,315.871 1791.06,313.801 1802.76,311.683 1814.47,309.516 1826.17,307.297 1837.87,305.024 1849.57,302.695 1861.27,300.308 1872.98,297.86 1884.68,295.348 \n",
       "  1896.38,292.77 1908.08,290.123 1919.78,287.403 1931.49,284.607 1943.19,281.73 1954.89,278.77 1966.59,275.721 1978.29,272.579 1990,269.338 2001.7,265.994 \n",
       "  2013.4,262.539 2025.1,258.968 2036.8,255.273 2048.51,251.447 2060.21,247.48 2071.91,243.364 2083.61,239.089 2095.31,234.643 2107.02,230.014 2118.72,225.189 \n",
       "  2130.42,220.153 2142.12,214.89 2153.82,209.383 2165.52,203.612 2177.23,197.559 2188.93,191.201 2200.63,184.518 2212.33,177.489 2224.03,170.095 2235.74,162.325 \n",
       "  2247.44,154.178 2259.14,145.675 2270.84,136.87 2282.54,127.875 2294.25,118.888 2305.95,110.234 2317.65,102.395 2329.35,96.0082 2341.05,91.7809 2352.76,90.2953 \n",
       "  \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1102)\" style=\"stroke:#000000; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  258.107,387.925 286.036,388.057 313.965,388.098 341.893,388.334 369.822,388.544 397.751,388.499 425.679,388.798 453.608,389.052 481.537,389.141 509.465,389.47 \n",
       "  537.394,390.152 565.323,390.51 593.251,390.921 621.18,391.242 649.108,391.649 677.037,392.115 704.966,392.089 732.894,392.734 760.823,393.205 788.752,393.495 \n",
       "  816.68,393.709 844.609,393.785 872.538,394.076 900.466,394.216 928.395,393.827 956.324,393.567 984.252,393.676 1012.18,392.941 1040.11,388.701 1068.04,388.163 \n",
       "  1095.97,384.217 1123.9,380.126 1151.82,378.169 1179.75,375.308 1207.68,372.616 1235.61,368.466 1263.54,365.032 1291.47,358.732 1319.4,350.557 1347.32,346.159 \n",
       "  1375.25,340.02 1403.18,334.827 1431.11,302.173 1459.04,291.477 1486.97,281.344 1514.9,264.278 1542.83,259.098 1570.75,252.777 1598.68,246.131 1626.61,238.734 \n",
       "  1654.54,231.593 1682.47,224.775 1710.4,218.064 1738.33,211.677 1766.25,205.573 1794.18,199.824 1822.11,194.316 1850.04,189.168 1877.97,184.441 1905.9,179.963 \n",
       "  1933.83,175.875 1961.75,172.098 1989.68,168.617 2017.61,165.416 2045.54,162.507 2073.47,159.871 2101.4,157.492 2129.33,155.372 2157.26,153.503 2185.18,151.881 \n",
       "  2213.11,150.501 2241.04,149.351 2268.97,148.44 2296.9,147.759 2324.83,147.304 2352.76,147.078 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1102)\" style=\"stroke:#0000ff; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  258.107,393.256 286.224,393.383 314.34,393.395 342.456,393.639 370.572,393.763 398.688,393.776 426.804,393.954 454.92,394.082 483.036,394.138 511.152,394.361 \n",
       "  539.268,394.844 567.384,395.147 595.5,395.307 623.617,395.445 651.733,395.762 679.849,395.974 707.965,396.04 736.081,396.502 764.197,396.856 792.313,396.999 \n",
       "  820.429,397.2 848.545,397.371 876.661,397.48 904.777,397.532 932.894,398.022 961.01,398.057 989.126,398.578 1017.24,398.224 1045.36,397.737 1073.47,397.637 \n",
       "  1101.59,397.34 1129.71,396.402 1157.82,395.627 1185.94,394.788 1214.05,394.05 1242.17,393.046 1270.29,391.885 1298.4,390.186 1326.52,388.078 1354.63,386.805 \n",
       "  1382.75,384.642 1410.87,382.534 1438.98,379.887 1467.1,377.038 1495.22,373.687 1523.33,370.353 1551.45,366.834 1579.56,363.043 1607.68,359.385 1635.8,355.005 \n",
       "  1663.91,350.503 1692.03,345.916 1720.14,340.925 1748.26,335.613 1776.38,329.592 1804.49,324.361 1832.61,318.311 1860.72,311.635 1888.84,304.698 1916.96,297.596 \n",
       "  1945.07,289.96 1973.19,282.003 2001.3,273.582 2029.42,264.201 2057.54,254.237 2085.65,243.349 2113.77,231.141 2141.89,217.817 2170,202.826 2198.12,185.711 \n",
       "  2226.23,166.117 2254.35,142.979 2282.47,115.48 2310.58,84.3561 2338.7,57.8167 \n",
       "  \"/>\n",
       "<polygon clip-path=\"url(#clip1100)\" points=\"\n",
       "330.107,372.684 1265.69,372.684 1265.69,130.764 330.107,130.764 \n",
       "  \" fill=\"#ffffff\" fill-rule=\"evenodd\" fill-opacity=\"1\"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  330.107,372.684 1265.69,372.684 1265.69,130.764 330.107,130.764 330.107,372.684 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#ff0000; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  354.107,191.244 498.107,191.244 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 522.107, 208.744)\" x=\"522.107\" y=\"208.744\">spectral density</text>\n",
       "</g>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  354.107,251.724 498.107,251.724 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 522.107, 269.224)\" x=\"522.107\" y=\"269.224\">standard smoothed periodogram</text>\n",
       "</g>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#0000ff; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  354.107,312.204 498.107,312.204 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 522.107, 329.704)\" x=\"522.107\" y=\"329.704\">AR smoothed periodogram</text>\n",
       "</g>\n",
       "<polygon clip-path=\"url(#clip1100)\" points=\"\n",
       "258.107,954.141 2352.76,954.141 2352.76,580.577 258.107,580.577 \n",
       "  \" fill=\"#ffffff\" fill-rule=\"evenodd\" fill-opacity=\"1\"/>\n",
       "<defs>\n",
       "  <clipPath id=\"clip1103\">\n",
       "    <rect x=\"258\" y=\"580\" width=\"2096\" height=\"375\"/>\n",
       "  </clipPath>\n",
       "</defs>\n",
       "<polyline clip-path=\"url(#clip1103)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,954.141 258.107,580.577 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1103)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  924.855,954.141 924.855,580.577 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1103)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  1591.6,954.141 1591.6,580.577 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1103)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  2258.35,954.141 2258.35,580.577 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1103)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,934.036 2352.76,934.036 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1103)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,867.951 2352.76,867.951 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1103)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,801.865 2352.76,801.865 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1103)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,735.78 2352.76,735.78 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1103)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,669.695 2352.76,669.695 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1103)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,603.609 2352.76,603.609 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,954.141 2352.76,954.141 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,954.141 258.107,580.577 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,954.141 258.107,948.538 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  924.855,954.141 924.855,948.538 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  1591.6,954.141 1591.6,948.538 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  2258.35,954.141 2258.35,948.538 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,934.036 289.527,934.036 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,867.951 289.527,867.951 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,801.865 289.527,801.865 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,735.78 289.527,735.78 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,669.695 289.527,669.695 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,603.609 289.527,603.609 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 258.107, 1008.14)\" x=\"258.107\" y=\"1008.14\">0</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 924.855, 1008.14)\" x=\"924.855\" y=\"1008.14\">1</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 1591.6, 1008.14)\" x=\"1591.6\" y=\"1008.14\">2</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 2258.35, 1008.14)\" x=\"2258.35\" y=\"1008.14\">3</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 92.5101, 957.763)\" x=\"92.5101\" y=\"957.763\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 146.035, 930.353)\" x=\"146.035\" y=\"930.353\">-</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 930.353)\" x=\"168.874\" y=\"930.353\">0.5 </text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 115.35, 891.678)\" x=\"115.35\" y=\"891.678\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 864.268)\" x=\"168.874\" y=\"864.268\">0.0 </text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 115.35, 825.593)\" x=\"115.35\" y=\"825.593\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 798.182)\" x=\"168.874\" y=\"798.182\">0.5 </text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 115.35, 759.508)\" x=\"115.35\" y=\"759.508\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 732.097)\" x=\"168.874\" y=\"732.097\">1.0 </text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 115.35, 693.422)\" x=\"115.35\" y=\"693.422\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 666.012)\" x=\"168.874\" y=\"666.012\">1.5 </text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 115.35, 627.337)\" x=\"115.35\" y=\"627.337\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 599.927)\" x=\"168.874\" y=\"599.927\">2.0 </text>\n",
       "</g>\n",
       "<polyline clip-path=\"url(#clip1103)\" style=\"stroke:#ff0000; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  258.107,941.637 269.809,941.632 281.511,941.619 293.213,941.597 304.915,941.566 316.617,941.526 328.319,941.478 340.021,941.42 351.723,941.354 363.425,941.279 \n",
       "  375.127,941.195 386.829,941.102 398.531,941.001 410.233,940.89 421.935,940.77 433.637,940.642 445.339,940.504 457.041,940.358 468.742,940.202 480.444,940.038 \n",
       "  492.146,939.864 503.848,939.682 515.55,939.49 527.252,939.289 538.954,939.079 550.656,938.859 562.358,938.631 574.06,938.393 585.762,938.146 597.464,937.889 \n",
       "  609.166,937.623 620.868,937.348 632.57,937.063 644.272,936.768 655.974,936.464 667.676,936.15 679.378,935.827 691.079,935.494 702.781,935.151 714.483,934.798 \n",
       "  726.185,934.435 737.887,934.063 749.589,933.68 761.291,933.287 772.993,932.884 784.695,932.47 796.397,932.047 808.099,931.613 819.801,931.168 831.503,930.713 \n",
       "  843.205,930.247 854.907,929.77 866.609,929.283 878.311,928.785 890.013,928.275 901.715,927.755 913.416,927.223 925.118,926.68 936.82,926.126 948.522,925.56 \n",
       "  960.224,924.983 971.926,924.393 983.628,923.792 995.33,923.179 1007.03,922.554 1018.73,921.916 1030.44,921.266 1042.14,920.603 1053.84,919.928 1065.54,919.24 \n",
       "  1077.24,918.539 1088.95,917.825 1100.65,917.097 1112.35,916.356 1124.05,915.602 1135.75,914.833 1147.46,914.051 1159.16,913.254 1170.86,912.443 1182.56,911.617 \n",
       "  1194.26,910.777 1205.97,909.921 1217.67,909.05 1229.37,908.164 1241.07,907.262 1252.77,906.344 1264.47,905.41 1276.18,904.459 1287.88,903.491 1299.58,902.507 \n",
       "  1311.28,901.505 1322.98,900.485 1334.69,899.448 1346.39,898.392 1358.09,897.318 1369.79,896.225 1381.49,895.112 1393.2,893.98 1404.9,892.827 1416.6,891.654 \n",
       "  1428.3,890.461 1440,889.245 1451.71,888.009 1463.41,886.749 1475.11,885.467 1486.81,884.162 1498.51,882.833 1510.22,881.48 1521.92,880.102 1533.62,878.699 \n",
       "  1545.32,877.269 1557.02,875.813 1568.73,874.329 1580.43,872.817 1592.13,871.276 1603.83,869.705 1615.53,868.104 1627.24,866.472 1638.94,864.808 1650.64,863.11 \n",
       "  1662.34,861.379 1674.04,859.612 1685.74,857.809 1697.45,855.969 1709.15,854.091 1720.85,852.173 1732.55,850.213 1744.25,848.212 1755.96,846.166 1767.66,844.075 \n",
       "  1779.36,841.937 1791.06,839.75 1802.76,837.513 1814.47,835.223 1826.17,832.878 1837.87,830.477 1849.57,828.016 1861.27,825.494 1872.98,822.908 1884.68,820.254 \n",
       "  1896.38,817.531 1908.08,814.734 1919.78,811.86 1931.49,808.906 1943.19,805.867 1954.89,802.739 1966.59,799.518 1978.29,796.198 1990,792.774 2001.7,789.24 \n",
       "  2013.4,785.591 2025.1,781.818 2036.8,777.914 2048.51,773.871 2060.21,769.68 2071.91,765.332 2083.61,760.815 2095.31,756.118 2107.02,751.227 2118.72,746.129 \n",
       "  2130.42,740.808 2142.12,735.248 2153.82,729.429 2165.52,723.333 2177.23,716.937 2188.93,710.22 2200.63,703.159 2212.33,695.732 2224.03,687.92 2235.74,679.711 \n",
       "  2247.44,671.104 2259.14,662.12 2270.84,652.817 2282.54,643.313 2294.25,633.818 2305.95,624.675 2317.65,616.393 2329.35,609.645 2341.05,605.179 2352.76,603.609 \n",
       "  \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1103)\" style=\"stroke:#000000; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  258.107,936.622 286.036,936.887 313.965,936.652 341.893,936.464 369.822,936.301 397.751,936.063 425.679,935.823 453.608,935.345 481.537,934.667 509.465,933.544 \n",
       "  537.394,933.135 565.323,932.69 593.251,931.756 621.18,931.04 649.108,930.133 677.037,927.895 704.966,925.818 732.894,924.722 760.823,923.373 788.752,921.591 \n",
       "  816.68,919.958 844.609,916.951 872.538,915.147 900.466,912.612 928.395,910.516 956.324,907.563 984.252,905.306 1012.18,903.051 1040.11,899.849 1068.04,896.517 \n",
       "  1095.97,892.604 1123.9,889.369 1151.82,886.04 1179.75,883.468 1207.68,879.844 1235.61,874.063 1263.54,867.346 1291.47,864.48 1319.4,860.251 1347.32,853.84 \n",
       "  1375.25,846.953 1403.18,843.307 1431.11,831.144 1459.04,809.012 1486.97,792.32 1514.9,784.831 1542.83,779.875 1570.75,773.056 1598.68,766.021 1626.61,759.149 \n",
       "  1654.54,752.338 1682.47,745.085 1710.4,738.21 1738.33,731.778 1766.25,725.682 1794.18,719.822 1822.11,714.287 1850.04,709.062 1877.97,704.184 1905.9,699.641 \n",
       "  1933.83,695.44 1961.75,691.548 1989.68,687.935 2017.61,684.636 2045.54,681.617 2073.47,678.891 2101.4,676.411 2129.33,674.217 2157.26,672.278 2185.18,670.598 \n",
       "  2213.11,669.166 2241.04,667.967 2268.97,667.009 2296.9,666.308 2324.83,665.844 2352.76,665.605 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1103)\" style=\"stroke:#0000ff; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  258.107,943.313 286.224,943.569 314.34,943.377 342.456,943.287 370.572,943.102 398.688,942.825 426.804,942.604 454.92,942.181 483.036,941.967 511.152,941.207 \n",
       "  539.268,940.722 567.384,940.223 595.5,939.573 623.617,938.866 651.733,938.092 679.849,936.53 707.965,935.344 736.081,934.469 764.197,933.316 792.313,931.928 \n",
       "  820.429,930.486 848.545,928.78 876.661,927.314 904.777,925.548 932.894,923.741 961.01,921.985 989.126,920.053 1017.24,918.113 1045.36,915.68 1073.47,913.644 \n",
       "  1101.59,911.205 1129.71,908.84 1157.82,906.319 1185.94,903.736 1214.05,901.205 1242.17,898.245 1270.29,895.638 1298.4,892.768 1326.52,890.042 1354.63,887.06 \n",
       "  1382.75,884.216 1410.87,881.135 1438.98,877.949 1467.1,874.839 1495.22,871.404 1523.33,868.041 1551.45,864.546 1579.56,860.963 1607.68,857.343 1635.8,853.379 \n",
       "  1663.91,849.132 1692.03,845 1720.14,840.62 1748.26,836.071 1776.38,831.471 1804.49,826.277 1832.61,820.885 1860.72,815.271 1888.84,809.336 1916.96,802.96 \n",
       "  1945.07,796.079 1973.19,788.656 2001.3,780.671 2029.42,771.942 2057.54,762.534 2085.65,752.192 2113.77,740.587 2141.89,727.869 2170,713.494 2198.12,697.083 \n",
       "  2226.23,677.969 2254.35,656.634 2282.47,632.958 2310.58,608.69 2338.7,591.15 \n",
       "  \"/>\n",
       "<polygon clip-path=\"url(#clip1100)\" points=\"\n",
       "330.107,906.017 1265.69,906.017 1265.69,664.097 330.107,664.097 \n",
       "  \" fill=\"#ffffff\" fill-rule=\"evenodd\" fill-opacity=\"1\"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  330.107,906.017 1265.69,906.017 1265.69,664.097 330.107,664.097 330.107,906.017 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#ff0000; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  354.107,724.577 498.107,724.577 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 522.107, 742.077)\" x=\"522.107\" y=\"742.077\">spectral density</text>\n",
       "</g>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  354.107,785.057 498.107,785.057 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 522.107, 802.557)\" x=\"522.107\" y=\"802.557\">standard smoothed periodogram</text>\n",
       "</g>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#0000ff; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  354.107,845.537 498.107,845.537 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 522.107, 863.037)\" x=\"522.107\" y=\"863.037\">AR smoothed periodogram</text>\n",
       "</g>\n",
       "<polygon clip-path=\"url(#clip1100)\" points=\"\n",
       "258.107,1487.47 2352.76,1487.47 2352.76,1113.91 258.107,1113.91 \n",
       "  \" fill=\"#ffffff\" fill-rule=\"evenodd\" fill-opacity=\"1\"/>\n",
       "<defs>\n",
       "  <clipPath id=\"clip1104\">\n",
       "    <rect x=\"258\" y=\"1113\" width=\"2096\" height=\"375\"/>\n",
       "  </clipPath>\n",
       "</defs>\n",
       "<polyline clip-path=\"url(#clip1104)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,1487.47 258.107,1113.91 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1104)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  924.855,1487.47 924.855,1113.91 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1104)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  1591.6,1487.47 1591.6,1113.91 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1104)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  2258.35,1487.47 2258.35,1113.91 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1104)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,1469.1 2352.76,1469.1 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1104)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,1401.27 2352.76,1401.27 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1104)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,1333.43 2352.76,1333.43 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1104)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,1265.6 2352.76,1265.6 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1104)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,1197.77 2352.76,1197.77 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1104)\" style=\"stroke:#000000; stroke-width:2; stroke-opacity:0.1; fill:none\" points=\"\n",
       "  258.107,1129.93 2352.76,1129.93 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,1487.47 2352.76,1487.47 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,1487.47 258.107,1113.91 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,1487.47 258.107,1481.87 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  924.855,1487.47 924.855,1481.87 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  1591.6,1487.47 1591.6,1481.87 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  2258.35,1487.47 2258.35,1481.87 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,1469.1 289.527,1469.1 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,1401.27 289.527,1401.27 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,1333.43 289.527,1333.43 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,1265.6 289.527,1265.6 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,1197.77 289.527,1197.77 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  258.107,1129.93 289.527,1129.93 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 258.107, 1541.47)\" x=\"258.107\" y=\"1541.47\">0</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 924.855, 1541.47)\" x=\"924.855\" y=\"1541.47\">1</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 1591.6, 1541.47)\" x=\"1591.6\" y=\"1541.47\">2</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:middle;\" transform=\"rotate(0, 2258.35, 1541.47)\" x=\"2258.35\" y=\"1541.47\">3</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 92.5101, 1492.83)\" x=\"92.5101\" y=\"1492.83\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 146.035, 1465.42)\" x=\"146.035\" y=\"1465.42\">-</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 1465.42)\" x=\"168.874\" y=\"1465.42\">0.5 </text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 115.35, 1424.99)\" x=\"115.35\" y=\"1424.99\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 1397.58)\" x=\"168.874\" y=\"1397.58\">0.0 </text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 115.35, 1357.16)\" x=\"115.35\" y=\"1357.16\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 1329.75)\" x=\"168.874\" y=\"1329.75\">0.5 </text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 115.35, 1289.33)\" x=\"115.35\" y=\"1289.33\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 1261.92)\" x=\"168.874\" y=\"1261.92\">1.0 </text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 115.35, 1221.5)\" x=\"115.35\" y=\"1221.5\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 1194.08)\" x=\"168.874\" y=\"1194.08\">1.5 </text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 115.35, 1153.66)\" x=\"115.35\" y=\"1153.66\">10</text>\n",
       "</g>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:38px; text-anchor:start;\" transform=\"rotate(0, 168.874, 1126.25)\" x=\"168.874\" y=\"1126.25\">2.0 </text>\n",
       "</g>\n",
       "<polyline clip-path=\"url(#clip1104)\" style=\"stroke:#ff0000; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  258.107,1476.9 269.809,1476.9 281.511,1476.88 293.213,1476.86 304.915,1476.83 316.617,1476.79 328.319,1476.74 340.021,1476.68 351.723,1476.61 363.425,1476.54 \n",
       "  375.127,1476.45 386.829,1476.35 398.531,1476.25 410.233,1476.14 421.935,1476.01 433.637,1475.88 445.339,1475.74 457.041,1475.59 468.742,1475.43 480.444,1475.26 \n",
       "  492.146,1475.08 503.848,1474.9 515.55,1474.7 527.252,1474.49 538.954,1474.28 550.656,1474.05 562.358,1473.82 574.06,1473.57 585.762,1473.32 597.464,1473.06 \n",
       "  609.166,1472.78 620.868,1472.5 632.57,1472.21 644.272,1471.9 655.974,1471.59 667.676,1471.27 679.378,1470.94 691.079,1470.6 702.781,1470.24 714.483,1469.88 \n",
       "  726.185,1469.51 737.887,1469.13 749.589,1468.73 761.291,1468.33 772.993,1467.92 784.695,1467.49 796.397,1467.06 808.099,1466.61 819.801,1466.16 831.503,1465.69 \n",
       "  843.205,1465.21 854.907,1464.72 866.609,1464.22 878.311,1463.71 890.013,1463.19 901.715,1462.65 913.416,1462.11 925.118,1461.55 936.82,1460.98 948.522,1460.4 \n",
       "  960.224,1459.81 971.926,1459.2 983.628,1458.59 995.33,1457.96 1007.03,1457.31 1018.73,1456.66 1030.44,1455.99 1042.14,1455.31 1053.84,1454.62 1065.54,1453.91 \n",
       "  1077.24,1453.19 1088.95,1452.46 1100.65,1451.71 1112.35,1450.95 1124.05,1450.18 1135.75,1449.39 1147.46,1448.59 1159.16,1447.77 1170.86,1446.94 1182.56,1446.09 \n",
       "  1194.26,1445.23 1205.97,1444.35 1217.67,1443.45 1229.37,1442.54 1241.07,1441.62 1252.77,1440.68 1264.47,1439.72 1276.18,1438.74 1287.88,1437.75 1299.58,1436.74 \n",
       "  1311.28,1435.71 1322.98,1434.66 1334.69,1433.6 1346.39,1432.51 1358.09,1431.41 1369.79,1430.29 1381.49,1429.15 1393.2,1427.98 1404.9,1426.8 1416.6,1425.6 \n",
       "  1428.3,1424.37 1440,1423.13 1451.71,1421.86 1463.41,1420.56 1475.11,1419.25 1486.81,1417.91 1498.51,1416.54 1510.22,1415.15 1521.92,1413.74 1533.62,1412.3 \n",
       "  1545.32,1410.83 1557.02,1409.34 1568.73,1407.81 1580.43,1406.26 1592.13,1404.68 1603.83,1403.07 1615.53,1401.43 1627.24,1399.75 1638.94,1398.04 1650.64,1396.3 \n",
       "  1662.34,1394.52 1674.04,1392.71 1685.74,1390.86 1697.45,1388.97 1709.15,1387.04 1720.85,1385.07 1732.55,1383.06 1744.25,1381.01 1755.96,1378.91 1767.66,1376.76 \n",
       "  1779.36,1374.57 1791.06,1372.32 1802.76,1370.02 1814.47,1367.67 1826.17,1365.27 1837.87,1362.8 1849.57,1360.28 1861.27,1357.69 1872.98,1355.03 1884.68,1352.31 \n",
       "  1896.38,1349.51 1908.08,1346.64 1919.78,1343.69 1931.49,1340.66 1943.19,1337.54 1954.89,1334.33 1966.59,1331.02 1978.29,1327.62 1990,1324.1 2001.7,1320.48 \n",
       "  2013.4,1316.73 2025.1,1312.86 2036.8,1308.85 2048.51,1304.7 2060.21,1300.4 2071.91,1295.93 2083.61,1291.3 2095.31,1286.48 2107.02,1281.46 2118.72,1276.22 \n",
       "  2130.42,1270.76 2142.12,1265.05 2153.82,1259.08 2165.52,1252.82 2177.23,1246.26 2188.93,1239.36 2200.63,1232.12 2212.33,1224.49 2224.03,1216.48 2235.74,1208.05 \n",
       "  2247.44,1199.21 2259.14,1189.99 2270.84,1180.44 2282.54,1170.69 2294.25,1160.94 2305.95,1151.56 2317.65,1143.06 2329.35,1136.13 2341.05,1131.55 2352.76,1129.93 \n",
       "  \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1104)\" style=\"stroke:#000000; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  258.107,1464.02 286.036,1464.02 313.965,1464.15 341.893,1464.49 369.822,1464.28 397.751,1464.73 425.679,1464.92 453.608,1464.72 481.537,1464.64 509.465,1464.22 \n",
       "  537.394,1464.78 565.323,1464.45 593.251,1464.24 621.18,1464.04 649.108,1463.13 677.037,1462.85 704.966,1462.26 732.894,1461.62 760.823,1460.97 788.752,1460.42 \n",
       "  816.68,1459.79 844.609,1458.2 872.538,1456.54 900.466,1454.56 928.395,1451.26 956.324,1449.68 984.252,1447.52 1012.18,1445.53 1040.11,1443.29 1068.04,1440.73 \n",
       "  1095.97,1438.38 1123.9,1436.01 1151.82,1433.24 1179.75,1430.7 1207.68,1423.58 1235.61,1420.27 1263.54,1416.78 1291.47,1413.43 1319.4,1407.9 1347.32,1399.94 \n",
       "  1375.25,1384.78 1403.18,1373.01 1431.11,1362.97 1459.04,1358.1 1486.97,1352.43 1514.9,1342.39 1542.83,1332.51 1570.75,1322.73 1598.68,1315.67 1626.61,1309.03 \n",
       "  1654.54,1302.58 1682.47,1296.1 1710.4,1289.72 1738.33,1283.19 1766.25,1277.31 1794.18,1271.67 1822.11,1266.33 1850.04,1261.26 1877.97,1256.48 1905.9,1252 \n",
       "  1933.83,1247.85 1961.75,1243.99 1989.68,1240.43 2017.61,1237.1 2045.54,1234.1 2073.47,1231.37 2101.4,1228.91 2129.33,1226.72 2157.26,1224.78 2185.18,1223.11 \n",
       "  2213.11,1221.67 2241.04,1220.47 2268.97,1219.53 2296.9,1218.81 2324.83,1218.35 2352.76,1218.11 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1104)\" style=\"stroke:#0000ff; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  258.107,1472.68 286.224,1472.7 314.34,1472.81 342.456,1473.02 370.572,1472.87 398.688,1473.01 426.804,1473.13 454.92,1472.72 483.036,1472.69 511.152,1472.58 \n",
       "  539.268,1472.88 567.384,1472.73 595.5,1472.37 623.617,1471.93 651.733,1471.58 679.849,1471.25 707.965,1470.84 736.081,1470.14 764.197,1469.58 792.313,1469.16 \n",
       "  820.429,1468.91 848.545,1468.01 876.661,1466.84 904.777,1465.36 932.894,1463.93 961.01,1462.8 989.126,1461.38 1017.24,1459.74 1045.36,1458.62 1073.47,1456.8 \n",
       "  1101.59,1455.12 1129.71,1453.11 1157.82,1450.95 1185.94,1448.67 1214.05,1446.24 1242.17,1444.03 1270.29,1441.52 1298.4,1439.46 1326.52,1436.59 1354.63,1433.67 \n",
       "  1382.75,1430.74 1410.87,1427.59 1438.98,1424.53 1467.1,1421.33 1495.22,1417.82 1523.33,1414.62 1551.45,1411.19 1579.56,1407.37 1607.68,1403.5 1635.8,1399.52 \n",
       "  1663.91,1395.25 1692.03,1390.7 1720.14,1386.11 1748.26,1381.2 1776.38,1376.1 1804.49,1370.98 1832.61,1365.38 1860.72,1359.39 1888.84,1353.02 1916.96,1346.31 \n",
       "  1945.07,1339.15 1973.19,1331.26 2001.3,1322.67 2029.42,1313.56 2057.54,1303.69 2085.65,1292.96 2113.77,1281 2141.89,1267.69 2170,1252.45 2198.12,1235.73 \n",
       "  2226.23,1216.28 2254.35,1193.89 2282.47,1169.08 2310.58,1143.24 2338.7,1124.48 \n",
       "  \"/>\n",
       "<polygon clip-path=\"url(#clip1100)\" points=\"\n",
       "330.107,1439.35 1265.69,1439.35 1265.69,1197.43 330.107,1197.43 \n",
       "  \" fill=\"#ffffff\" fill-rule=\"evenodd\" fill-opacity=\"1\"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:4; stroke-opacity:1; fill:none\" points=\"\n",
       "  330.107,1439.35 1265.69,1439.35 1265.69,1197.43 330.107,1197.43 330.107,1439.35 \n",
       "  \"/>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#ff0000; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  354.107,1257.91 498.107,1257.91 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 522.107, 1275.41)\" x=\"522.107\" y=\"1275.41\">spectral density</text>\n",
       "</g>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#000000; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  354.107,1318.39 498.107,1318.39 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 522.107, 1335.89)\" x=\"522.107\" y=\"1335.89\">standard smoothed periodogram</text>\n",
       "</g>\n",
       "<polyline clip-path=\"url(#clip1100)\" style=\"stroke:#0000ff; stroke-width:8; stroke-opacity:0.75; fill:none\" points=\"\n",
       "  354.107,1378.87 498.107,1378.87 \n",
       "  \"/>\n",
       "<g clip-path=\"url(#clip1100)\">\n",
       "<text style=\"fill:#000000; fill-opacity:1; font-family:Arial,Helvetica Neue,Helvetica,sans-serif; font-size:48px; text-anchor:start;\" transform=\"rotate(0, 522.107, 1396.37)\" x=\"522.107\" y=\"1396.37\">AR smoothed periodogram</text>\n",
       "</g>\n",
       "</svg>\n"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "lp2 = ARMA(-0.9, 0.0, 1.0)\n",
    "wl = 65\n",
    "p = plot(layout=(3,1))\n",
    "\n",
    "for i in 1:3\n",
    "    X = simulation(lp2,ts_length=150)\n",
    "    plot!(p[i],xlims = (0,pi))\n",
    "\n",
    "    x_sd, y_sd = spectral_density(lp2,two_pi=false, res=180)\n",
    "    plot!(p[i],x_sd, y_sd, linecolor=:red, linestyle=:solid,\n",
    "        yscale=:log10, linewidth=2, linealpha=0.75,\n",
    "        label=\"spectral density\",legend=:topleft)\n",
    "\n",
    "    x, y_smoothed = periodogram(X, \"hamming\", wl)\n",
    "    plot!(p[i],x, y_smoothed, linecolor=:black, linestyle=:solid,\n",
    "        yscale=:log10, linewidth=2, linealpha=0.75,\n",
    "        label=\"standard smoothed periodogram\",legend=:topleft)\n",
    "\n",
    "    x, y_ar = ar_periodogram(X, \"hamming\", wl)\n",
    "    plot!(p[i],x, y_ar, linecolor=:blue, linestyle=:solid,\n",
    "        yscale=:log10, linewidth=2, linealpha=0.75,\n",
    "        label=\"AR smoothed periodogram\",legend=:topleft)\n",
    "end\n",
    "p"
   ]
  }
 ],
 "metadata": {
  "filename": "estspec.rst",
  "kernelspec": {
   "display_name": "Julia 1.2",
   "language": "julia",
   "name": "julia-1.2"
  },
  "language_info": {
   "file_extension": ".jl",
   "mimetype": "application/julia",
   "name": "julia",
   "version": "1.2.0"
  },
  "title": "Estimation of Spectra"
 },
 "nbformat": 4,
 "nbformat_minor": 2
}