examples/1. When mean variance models fail.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "** The following example is based on Karl Borch (1969, J. Economic Studies), where mean variance model fails to select efficient portfolios.**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Consider the investment universe with 3 assets,\n",
    "- with mean return vector:\n",
    "\n",
    "$$ \\mu = \\left[1,4,9\\right]^T $$\n",
    "\n",
    "- and the covariance matrix:\n",
    "\n",
    "$$\\Sigma=\\left[\\begin{array}{ccc}\n",
    "1 & 0 & 0\\\\\n",
    "0 & 4 & 0\\\\\n",
    "0 & 0 & 9\n",
    "\\end{array}\\right]$$"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Let's consider long position only\n",
    "- Efficient frontier can be obtained by solving the following quadratic programming problem:\n",
    "\n",
    "\\begin{align*}\n",
    "\\underset{w}{\\mathrm{argmin}}\\quad & w^{T}\\Sigma w\\\\\n",
    "\\mathrm{subject\\ to}\\quad & \\left[\\begin{array}{ccc}\n",
    "1 & 1 & 1\\\\\n",
    "1 & 4 & 9\n",
    "\\end{array}\\right]w=\\left[\\begin{array}{c}\n",
    "1\\\\\n",
    "a\n",
    "\\end{array}\\right]\\\\\n",
    " & w_{i}\\ge0,\\quad i=1,2,3\n",
    "\\end{align*}\n",
    "with $a$ varying from $1$ to $9$"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Let's use python package cvxopt to obtain the efficient frontier**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "from cvxopt import solvers, matrix, spdiag\n",
    "from numpy import linspace, random\n",
    "solvers.options['show_progress'] = False\n",
    "solvers.options['abstol'] = 1e-10\n",
    "solvers.options['reltol'] = 1e-9\n",
    "solvers.options['feastol'] = 1e-10\n",
    "P = spdiag([1.0, 4.0, 9.0])\n",
    "q = matrix([0.0, 0.0, 0.0])\n",
    "G = -1.0 * spdiag([1.0, 1.0, 1.0])\n",
    "h = matrix([0.0, 0.0, 0.0])\n",
    "A = matrix([1.0, 1.0, 1.0, 4.0, 1.0, 9.0], (2, 3))\n",
    "Rs_ef, Vs_ef, Rs, Vs = linspace(1.0, 9.0, 100), [], [], []\n",
    "for R in Rs_ef:\n",
    "    b = matrix([1.0, R])\n",
    "    sol = solvers.qp(2.0 * P, q, G=G, h=h, A=A, b=b)\n",
    "    Vs_ef.append(sol['primal objective'])\n",
    "    ws = random.uniform(0.0, 1.0, 3)\n",
    "    ws = ws / sum(ws)\n",
    "    Rs.append(ws.dot([1.0, 4.0, 9.0]))\n",
    "    Vs.append((ws*ws).dot([1.0, 4.0, 9.0]))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Plot the efficient frontier**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "hide_input": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<matplotlib.collections.PathCollection at 0x11b58e3d0>"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"utf-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       "  \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Created with matplotlib (http://matplotlib.org/) -->\n",
       "<svg height=\"270pt\" version=\"1.1\" viewBox=\"0 0 384 270\" width=\"384pt\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       " <defs>\n",
       "  <style type=\"text/css\">\n",
       "*{stroke-linecap:butt;stroke-linejoin:round;}\n",
       "  </style>\n",
       " </defs>\n",
       " <g id=\"figure_1\">\n",
       "  <g id=\"patch_1\">\n",
       "   <path d=\"\n",
       "M0 270.795\n",
       "L384.322 270.795\n",
       "L384.322 0\n",
       "L0 0\n",
       "L0 270.795\" style=\"fill:none;\"/>\n",
       "  </g>\n",
       "  <g id=\"axes_1\">\n",
       "   <g id=\"patch_2\">\n",
       "    <path d=\"\n",
       "M36.8406 235.239\n",
       "L371.641 235.239\n",
       "L371.641 12.0391\n",
       "L36.8406 12.0391\n",
       "z\n",
       "\" style=\"fill:#ffffff;\"/>\n",
       "   </g>\n",
       "   <g id=\"PathCollection_1\">\n",
       "    <defs>\n",
       "     <path d=\"\n",
       "M0 0.223607\n",
       "C0.0593012 0.223607 0.116182 0.200046 0.158114 0.158114\n",
       "C0.200046 0.116182 0.223607 0.0593012 0.223607 0\n",
       "C0.223607 -0.0593012 0.200046 -0.116182 0.158114 -0.158114\n",
       "C0.116182 -0.200046 0.0593012 -0.223607 0 -0.223607\n",
       "C-0.0593012 -0.223607 -0.116182 -0.200046 -0.158114 -0.158114\n",
       "C-0.200046 -0.116182 -0.223607 -0.0593012 -0.223607 0\n",
       "C-0.223607 0.0593012 -0.200046 0.116182 -0.158114 0.158114\n",
       "C-0.116182 0.200046 -0.0593012 0.223607 0 0.223607\n",
       "z\n",
       "\" id=\"md3abd3e121\" style=\"stroke:#000000;\"/>\n",
       "    </defs>\n",
       "    <g clip-path=\"url(#p6d730eb300)\">\n",
       "     <use style=\"stroke:#000000;\" x=\"72.2228432126\" xlink:href=\"#md3abd3e121\" y=\"158.393361691\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"77.5020660183\" xlink:href=\"#md3abd3e121\" y=\"164.188928708\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"130.293553929\" xlink:href=\"#md3abd3e121\" y=\"105.984898785\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"91.3787723357\" xlink:href=\"#md3abd3e121\" y=\"128.673644819\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"122.062952056\" xlink:href=\"#md3abd3e121\" y=\"137.077719746\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"123.589704628\" xlink:href=\"#md3abd3e121\" y=\"104.127106341\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"124.005287588\" xlink:href=\"#md3abd3e121\" y=\"111.174437415\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"125.174178015\" xlink:href=\"#md3abd3e121\" y=\"104.865708348\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"95.7165030261\" xlink:href=\"#md3abd3e121\" y=\"139.79980887\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"98.2025947626\" xlink:href=\"#md3abd3e121\" y=\"124.071958046\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"89.6527076926\" xlink:href=\"#md3abd3e121\" y=\"143.792772176\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"83.3130851873\" xlink:href=\"#md3abd3e121\" y=\"138.94128241\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"76.1423734806\" xlink:href=\"#md3abd3e121\" y=\"162.643859647\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"119.408747181\" xlink:href=\"#md3abd3e121\" y=\"106.257862513\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"100.036708831\" xlink:href=\"#md3abd3e121\" y=\"134.683632553\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"70.3670974049\" xlink:href=\"#md3abd3e121\" y=\"155.777478423\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"112.888351242\" xlink:href=\"#md3abd3e121\" y=\"113.332956726\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"137.263701215\" xlink:href=\"#md3abd3e121\" y=\"98.2028063566\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"71.4146444831\" xlink:href=\"#md3abd3e121\" y=\"170.429026272\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"93.7202589717\" xlink:href=\"#md3abd3e121\" y=\"126.557576955\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"84.5582892223\" xlink:href=\"#md3abd3e121\" y=\"139.401619771\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"103.275015789\" xlink:href=\"#md3abd3e121\" y=\"123.405456716\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"73.8861949168\" xlink:href=\"#md3abd3e121\" y=\"166.747345369\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"99.9005492\" xlink:href=\"#md3abd3e121\" y=\"128.103951546\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"75.1216518587\" xlink:href=\"#md3abd3e121\" y=\"148.389727963\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"107.216563105\" xlink:href=\"#md3abd3e121\" y=\"120.935310536\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"130.743340609\" xlink:href=\"#md3abd3e121\" y=\"99.014461529\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"93.5736487559\" xlink:href=\"#md3abd3e121\" y=\"126.613485702\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"71.6922244355\" xlink:href=\"#md3abd3e121\" y=\"160.0262258\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"105.246684099\" xlink:href=\"#md3abd3e121\" y=\"118.688046568\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"71.7027423871\" xlink:href=\"#md3abd3e121\" y=\"173.692473334\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"105.720513258\" xlink:href=\"#md3abd3e121\" y=\"127.862745795\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"71.7580035672\" xlink:href=\"#md3abd3e121\" y=\"164.728920794\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"215.893708828\" xlink:href=\"#md3abd3e121\" y=\"74.2245887509\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"73.8919536829\" xlink:href=\"#md3abd3e121\" y=\"163.859825314\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"110.024095074\" xlink:href=\"#md3abd3e121\" y=\"115.777375685\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"88.7914227899\" xlink:href=\"#md3abd3e121\" y=\"131.24737241\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"91.3168479009\" xlink:href=\"#md3abd3e121\" y=\"129.211093754\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"103.778155149\" xlink:href=\"#md3abd3e121\" y=\"117.888479156\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"91.5241223625\" xlink:href=\"#md3abd3e121\" y=\"129.415681073\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"84.5777562488\" xlink:href=\"#md3abd3e121\" y=\"136.925830431\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"84.0017665333\" xlink:href=\"#md3abd3e121\" y=\"136.51394226\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"97.8719325508\" xlink:href=\"#md3abd3e121\" y=\"126.41586579\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"95.2541032754\" xlink:href=\"#md3abd3e121\" y=\"125.346859982\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"82.5712367268\" xlink:href=\"#md3abd3e121\" y=\"138.231131993\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"76.5717586635\" xlink:href=\"#md3abd3e121\" y=\"147.582709951\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"145.801123305\" xlink:href=\"#md3abd3e121\" y=\"108.12122271\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"73.0831517558\" xlink:href=\"#md3abd3e121\" y=\"150.267378047\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"127.075568305\" xlink:href=\"#md3abd3e121\" y=\"103.598723805\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"84.3571675839\" xlink:href=\"#md3abd3e121\" y=\"139.604348721\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"88.8681881794\" xlink:href=\"#md3abd3e121\" y=\"132.722500221\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"115.352910275\" xlink:href=\"#md3abd3e121\" y=\"121.92388816\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"105.579453995\" xlink:href=\"#md3abd3e121\" y=\"116.410895781\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"118.262796985\" xlink:href=\"#md3abd3e121\" y=\"107.019800244\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"98.0225936464\" xlink:href=\"#md3abd3e121\" y=\"126.976057353\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"79.4963942075\" xlink:href=\"#md3abd3e121\" y=\"141.69551357\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"121.979839498\" xlink:href=\"#md3abd3e121\" y=\"115.228020468\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"83.2626493193\" xlink:href=\"#md3abd3e121\" y=\"143.564146337\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"78.5587674109\" xlink:href=\"#md3abd3e121\" y=\"144.585651814\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"138.312848415\" xlink:href=\"#md3abd3e121\" y=\"151.170540057\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"72.3875885276\" xlink:href=\"#md3abd3e121\" y=\"165.019837843\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"171.041730457\" xlink:href=\"#md3abd3e121\" y=\"80.2651052467\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"73.343060418\" xlink:href=\"#md3abd3e121\" y=\"156.836458189\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"66.3506394216\" xlink:href=\"#md3abd3e121\" y=\"178.128054031\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"73.0856522873\" xlink:href=\"#md3abd3e121\" y=\"150.281572068\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"107.812272089\" xlink:href=\"#md3abd3e121\" y=\"129.24177139\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"75.5458845613\" xlink:href=\"#md3abd3e121\" y=\"146.88259571\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"104.651669735\" xlink:href=\"#md3abd3e121\" y=\"120.38909158\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"143.073515637\" xlink:href=\"#md3abd3e121\" y=\"91.8798531673\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"109.8946182\" xlink:href=\"#md3abd3e121\" y=\"113.068468184\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"80.8150360431\" xlink:href=\"#md3abd3e121\" y=\"139.901063583\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"65.9197379384\" xlink:href=\"#md3abd3e121\" y=\"206.776045879\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"95.1873236702\" xlink:href=\"#md3abd3e121\" y=\"134.521884175\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"102.606842696\" xlink:href=\"#md3abd3e121\" y=\"118.88770335\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"93.034969839\" xlink:href=\"#md3abd3e121\" y=\"133.038039323\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"92.3053631591\" xlink:href=\"#md3abd3e121\" y=\"139.90058035\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"118.689537468\" xlink:href=\"#md3abd3e121\" y=\"106.99331711\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"185.596090182\" xlink:href=\"#md3abd3e121\" y=\"79.3741702645\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"102.318159405\" xlink:href=\"#md3abd3e121\" y=\"123.217691438\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"109.403572696\" xlink:href=\"#md3abd3e121\" y=\"113.773753286\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"86.0762588957\" xlink:href=\"#md3abd3e121\" y=\"134.520720619\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"88.8288229259\" xlink:href=\"#md3abd3e121\" y=\"144.174860194\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"79.1221283468\" xlink:href=\"#md3abd3e121\" y=\"152.198031252\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"116.815113783\" xlink:href=\"#md3abd3e121\" y=\"109.458806628\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"127.778610442\" xlink:href=\"#md3abd3e121\" y=\"100.923877663\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"147.879768045\" xlink:href=\"#md3abd3e121\" y=\"88.5632431677\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"92.5343678245\" xlink:href=\"#md3abd3e121\" y=\"128.342211808\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"103.687192735\" xlink:href=\"#md3abd3e121\" y=\"124.55887082\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"141.07056593\" xlink:href=\"#md3abd3e121\" y=\"92.6932281956\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"84.7271905603\" xlink:href=\"#md3abd3e121\" y=\"135.880639725\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"79.2666834779\" xlink:href=\"#md3abd3e121\" y=\"141.807077704\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"93.3304097685\" xlink:href=\"#md3abd3e121\" y=\"150.775121831\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"63.7002503049\" xlink:href=\"#md3abd3e121\" y=\"174.681366236\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"98.0328901028\" xlink:href=\"#md3abd3e121\" y=\"165.131145291\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"146.89390713\" xlink:href=\"#md3abd3e121\" y=\"91.2098260226\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"66.3712082293\" xlink:href=\"#md3abd3e121\" y=\"167.494929888\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"106.023508611\" xlink:href=\"#md3abd3e121\" y=\"119.455561461\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"90.0420269795\" xlink:href=\"#md3abd3e121\" y=\"135.345335646\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"122.796051874\" xlink:href=\"#md3abd3e121\" y=\"139.850579384\"/>\n",
       "     <use style=\"stroke:#000000;\" x=\"97.9340476672\" xlink:href=\"#md3abd3e121\" y=\"122.897951501\"/>\n",
       "    </g>\n",
       "   </g>\n",
       "   <g id=\"line2d_1\">\n",
       "    <path clip-path=\"url(#p6d730eb300)\" d=\"\n",
       "M70.3206 212.919\n",
       "L68.6384 211.115\n",
       "L67.1992 209.312\n",
       "L66.0028 207.508\n",
       "L65.0494 205.705\n",
       "L64.3389 203.901\n",
       "L63.7825 202.097\n",
       "L63.2853 200.294\n",
       "L62.8473 198.49\n",
       "L62.4685 196.686\n",
       "L62.1488 194.883\n",
       "L61.8884 193.079\n",
       "L61.6871 191.275\n",
       "L61.5451 189.472\n",
       "L61.4622 187.668\n",
       "L61.4385 185.865\n",
       "L61.4739 184.061\n",
       "L61.5686 182.257\n",
       "L61.7225 180.454\n",
       "L61.9355 178.65\n",
       "L62.2077 176.846\n",
       "L62.5391 175.043\n",
       "L62.9297 173.239\n",
       "L63.3795 171.435\n",
       "L63.8885 169.632\n",
       "L64.4566 167.828\n",
       "L65.0839 166.025\n",
       "L65.7705 164.221\n",
       "L66.5162 162.417\n",
       "L67.321 160.614\n",
       "L68.1851 158.81\n",
       "L69.1084 157.006\n",
       "L70.0908 155.203\n",
       "L71.1324 153.399\n",
       "L72.2333 151.595\n",
       "L73.3933 149.792\n",
       "L74.6124 147.988\n",
       "L75.8908 146.185\n",
       "L77.2284 144.381\n",
       "L78.6251 142.577\n",
       "L80.081 140.774\n",
       "L81.5961 138.97\n",
       "L83.1704 137.166\n",
       "L84.8039 135.363\n",
       "L86.4966 133.559\n",
       "L88.2484 131.755\n",
       "L90.0595 129.952\n",
       "L91.9297 128.148\n",
       "L93.8591 126.345\n",
       "L95.8477 124.541\n",
       "L97.8954 122.737\n",
       "L100.002 120.934\n",
       "L102.169 119.13\n",
       "L104.394 117.326\n",
       "L106.678 115.523\n",
       "L109.022 113.719\n",
       "L111.425 111.915\n",
       "L113.887 110.112\n",
       "L116.408 108.308\n",
       "L118.989 106.505\n",
       "L121.628 104.701\n",
       "L124.327 102.897\n",
       "L127.085 101.094\n",
       "L129.902 99.29\n",
       "L132.779 97.4863\n",
       "L135.714 95.6827\n",
       "L138.709 93.8791\n",
       "L141.763 92.0754\n",
       "L144.876 90.2718\n",
       "L148.048 88.4682\n",
       "L151.28 86.6645\n",
       "L154.579 84.8609\n",
       "L158.066 83.0572\n",
       "L161.78 81.2536\n",
       "L165.722 79.45\n",
       "L169.891 77.6463\n",
       "L174.288 75.8427\n",
       "L178.912 74.0391\n",
       "L183.763 72.2354\n",
       "L188.841 70.4318\n",
       "L194.147 68.6282\n",
       "L199.681 66.8245\n",
       "L205.441 65.0209\n",
       "L211.429 63.2172\n",
       "L217.645 61.4136\n",
       "L224.088 59.61\n",
       "L230.758 57.8063\n",
       "L237.655 56.0027\n",
       "L244.78 54.1991\n",
       "L252.133 52.3954\n",
       "L259.712 50.5918\n",
       "L267.519 48.7882\n",
       "L275.554 46.9845\n",
       "L283.815 45.1809\n",
       "L292.305 43.3772\n",
       "L301.021 41.5736\n",
       "L309.965 39.77\n",
       "L319.136 37.9663\n",
       "L328.535 36.1627\n",
       "L338.161 34.3591\" style=\"fill:none;stroke:#0000ff;stroke-linecap:square;\"/>\n",
       "   </g>\n",
       "   <g id=\"patch_3\">\n",
       "    <path d=\"\n",
       "M36.8406 12.0391\n",
       "L371.641 12.0391\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;\"/>\n",
       "   </g>\n",
       "   <g id=\"patch_4\">\n",
       "    <path d=\"\n",
       "M371.641 235.239\n",
       "L371.641 12.0391\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;\"/>\n",
       "   </g>\n",
       "   <g id=\"patch_5\">\n",
       "    <path d=\"\n",
       "M36.8406 235.239\n",
       "L371.641 235.239\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;\"/>\n",
       "   </g>\n",
       "   <g id=\"patch_6\">\n",
       "    <path d=\"\n",
       "M36.8406 235.239\n",
       "L36.8406 12.0391\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;\"/>\n",
       "   </g>\n",
       "   <g id=\"matplotlib.axis_1\">\n",
       "    <g id=\"xtick_1\">\n",
       "     <g id=\"line2d_2\">\n",
       "      <defs>\n",
       "       <path d=\"\n",
       "M0 0\n",
       "L0 -4\" id=\"m93b0483c22\" style=\"stroke:#000000;stroke-width:0.5;\"/>\n",
       "      </defs>\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"36.840625\" xlink:href=\"#m93b0483c22\" y=\"235.2390625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"line2d_3\">\n",
       "      <defs>\n",
       "       <path d=\"\n",
       "M0 0\n",
       "L0 4\" id=\"m741efc42ff\" style=\"stroke:#000000;stroke-width:0.5;\"/>\n",
       "      </defs>\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"36.840625\" xlink:href=\"#m741efc42ff\" y=\"12.0390625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_1\">\n",
       "      <!-- 0 -->\n",
       "      <defs>\n",
       "       <path d=\"\n",
       "M31.7812 66.4062\n",
       "Q24.1719 66.4062 20.3281 58.9062\n",
       "Q16.5 51.4219 16.5 36.375\n",
       "Q16.5 21.3906 20.3281 13.8906\n",
       "Q24.1719 6.39062 31.7812 6.39062\n",
       "Q39.4531 6.39062 43.2812 13.8906\n",
       "Q47.125 21.3906 47.125 36.375\n",
       "Q47.125 51.4219 43.2812 58.9062\n",
       "Q39.4531 66.4062 31.7812 66.4062\n",
       "M31.7812 74.2188\n",
       "Q44.0469 74.2188 50.5156 64.5156\n",
       "Q56.9844 54.8281 56.9844 36.375\n",
       "Q56.9844 17.9688 50.5156 8.26562\n",
       "Q44.0469 -1.42188 31.7812 -1.42188\n",
       "Q19.5312 -1.42188 13.0625 8.26562\n",
       "Q6.59375 17.9688 6.59375 36.375\n",
       "Q6.59375 54.8281 13.0625 64.5156\n",
       "Q19.5312 74.2188 31.7812 74.2188\" id=\"BitstreamVeraSans-Roman-30\"/>\n",
       "      </defs>\n",
       "      <g transform=\"translate(34.32109375 246.8375)scale(0.1 -0.1)\">\n",
       "       <use xlink:href=\"#BitstreamVeraSans-Roman-30\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"xtick_2\">\n",
       "     <g id=\"line2d_4\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"103.800625\" xlink:href=\"#m93b0483c22\" y=\"235.2390625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"line2d_5\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"103.800625\" xlink:href=\"#m741efc42ff\" y=\"12.0390625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_2\">\n",
       "      <!-- 2 -->\n",
       "      <defs>\n",
       "       <path d=\"\n",
       "M19.1875 8.29688\n",
       "L53.6094 8.29688\n",
       "L53.6094 0\n",
       "L7.32812 0\n",
       "L7.32812 8.29688\n",
       "Q12.9375 14.1094 22.625 23.8906\n",
       "Q32.3281 33.6875 34.8125 36.5312\n",
       "Q39.5469 41.8438 41.4219 45.5312\n",
       "Q43.3125 49.2188 43.3125 52.7812\n",
       "Q43.3125 58.5938 39.2344 62.25\n",
       "Q35.1562 65.9219 28.6094 65.9219\n",
       "Q23.9688 65.9219 18.8125 64.3125\n",
       "Q13.6719 62.7031 7.8125 59.4219\n",
       "L7.8125 69.3906\n",
       "Q13.7656 71.7812 18.9375 73\n",
       "Q24.125 74.2188 28.4219 74.2188\n",
       "Q39.75 74.2188 46.4844 68.5469\n",
       "Q53.2188 62.8906 53.2188 53.4219\n",
       "Q53.2188 48.9219 51.5312 44.8906\n",
       "Q49.8594 40.875 45.4062 35.4062\n",
       "Q44.1875 33.9844 37.6406 27.2188\n",
       "Q31.1094 20.4531 19.1875 8.29688\" id=\"BitstreamVeraSans-Roman-32\"/>\n",
       "      </defs>\n",
       "      <g transform=\"translate(101.4865625 246.8375)scale(0.1 -0.1)\">\n",
       "       <use xlink:href=\"#BitstreamVeraSans-Roman-32\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"xtick_3\">\n",
       "     <g id=\"line2d_6\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"170.760625\" xlink:href=\"#m93b0483c22\" y=\"235.2390625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"line2d_7\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"170.760625\" xlink:href=\"#m741efc42ff\" y=\"12.0390625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_3\">\n",
       "      <!-- 4 -->\n",
       "      <defs>\n",
       "       <path d=\"\n",
       "M37.7969 64.3125\n",
       "L12.8906 25.3906\n",
       "L37.7969 25.3906\n",
       "z\n",
       "\n",
       "M35.2031 72.9062\n",
       "L47.6094 72.9062\n",
       "L47.6094 25.3906\n",
       "L58.0156 25.3906\n",
       "L58.0156 17.1875\n",
       "L47.6094 17.1875\n",
       "L47.6094 0\n",
       "L37.7969 0\n",
       "L37.7969 17.1875\n",
       "L4.89062 17.1875\n",
       "L4.89062 26.7031\n",
       "z\n",
       "\" id=\"BitstreamVeraSans-Roman-34\"/>\n",
       "      </defs>\n",
       "      <g transform=\"translate(168.104375 246.8375)scale(0.1 -0.1)\">\n",
       "       <use xlink:href=\"#BitstreamVeraSans-Roman-34\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"xtick_4\">\n",
       "     <g id=\"line2d_8\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"237.720625\" xlink:href=\"#m93b0483c22\" y=\"235.2390625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"line2d_9\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"237.720625\" xlink:href=\"#m741efc42ff\" y=\"12.0390625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_4\">\n",
       "      <!-- 6 -->\n",
       "      <defs>\n",
       "       <path d=\"\n",
       "M33.0156 40.375\n",
       "Q26.375 40.375 22.4844 35.8281\n",
       "Q18.6094 31.2969 18.6094 23.3906\n",
       "Q18.6094 15.5312 22.4844 10.9531\n",
       "Q26.375 6.39062 33.0156 6.39062\n",
       "Q39.6562 6.39062 43.5312 10.9531\n",
       "Q47.4062 15.5312 47.4062 23.3906\n",
       "Q47.4062 31.2969 43.5312 35.8281\n",
       "Q39.6562 40.375 33.0156 40.375\n",
       "M52.5938 71.2969\n",
       "L52.5938 62.3125\n",
       "Q48.875 64.0625 45.0938 64.9844\n",
       "Q41.3125 65.9219 37.5938 65.9219\n",
       "Q27.8281 65.9219 22.6719 59.3281\n",
       "Q17.5312 52.7344 16.7969 39.4062\n",
       "Q19.6719 43.6562 24.0156 45.9219\n",
       "Q28.375 48.1875 33.5938 48.1875\n",
       "Q44.5781 48.1875 50.9531 41.5156\n",
       "Q57.3281 34.8594 57.3281 23.3906\n",
       "Q57.3281 12.1562 50.6875 5.35938\n",
       "Q44.0469 -1.42188 33.0156 -1.42188\n",
       "Q20.3594 -1.42188 13.6719 8.26562\n",
       "Q6.98438 17.9688 6.98438 36.375\n",
       "Q6.98438 53.6562 15.1875 63.9375\n",
       "Q23.3906 74.2188 37.2031 74.2188\n",
       "Q40.9219 74.2188 44.7031 73.4844\n",
       "Q48.4844 72.75 52.5938 71.2969\" id=\"BitstreamVeraSans-Roman-36\"/>\n",
       "      </defs>\n",
       "      <g transform=\"translate(235.2034375 246.8375)scale(0.1 -0.1)\">\n",
       "       <use xlink:href=\"#BitstreamVeraSans-Roman-36\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"xtick_5\">\n",
       "     <g id=\"line2d_10\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"304.680625\" xlink:href=\"#m93b0483c22\" y=\"235.2390625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"line2d_11\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"304.680625\" xlink:href=\"#m741efc42ff\" y=\"12.0390625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_5\">\n",
       "      <!-- 8 -->\n",
       "      <defs>\n",
       "       <path d=\"\n",
       "M31.7812 34.625\n",
       "Q24.75 34.625 20.7188 30.8594\n",
       "Q16.7031 27.0938 16.7031 20.5156\n",
       "Q16.7031 13.9219 20.7188 10.1562\n",
       "Q24.75 6.39062 31.7812 6.39062\n",
       "Q38.8125 6.39062 42.8594 10.1719\n",
       "Q46.9219 13.9688 46.9219 20.5156\n",
       "Q46.9219 27.0938 42.8906 30.8594\n",
       "Q38.875 34.625 31.7812 34.625\n",
       "M21.9219 38.8125\n",
       "Q15.5781 40.375 12.0312 44.7188\n",
       "Q8.5 49.0781 8.5 55.3281\n",
       "Q8.5 64.0625 14.7188 69.1406\n",
       "Q20.9531 74.2188 31.7812 74.2188\n",
       "Q42.6719 74.2188 48.875 69.1406\n",
       "Q55.0781 64.0625 55.0781 55.3281\n",
       "Q55.0781 49.0781 51.5312 44.7188\n",
       "Q48 40.375 41.7031 38.8125\n",
       "Q48.8281 37.1562 52.7969 32.3125\n",
       "Q56.7812 27.4844 56.7812 20.5156\n",
       "Q56.7812 9.90625 50.3125 4.23438\n",
       "Q43.8438 -1.42188 31.7812 -1.42188\n",
       "Q19.7344 -1.42188 13.25 4.23438\n",
       "Q6.78125 9.90625 6.78125 20.5156\n",
       "Q6.78125 27.4844 10.7812 32.3125\n",
       "Q14.7969 37.1562 21.9219 38.8125\n",
       "M18.3125 54.3906\n",
       "Q18.3125 48.7344 21.8438 45.5625\n",
       "Q25.3906 42.3906 31.7812 42.3906\n",
       "Q38.1406 42.3906 41.7188 45.5625\n",
       "Q45.3125 48.7344 45.3125 54.3906\n",
       "Q45.3125 60.0625 41.7188 63.2344\n",
       "Q38.1406 66.4062 31.7812 66.4062\n",
       "Q25.3906 66.4062 21.8438 63.2344\n",
       "Q18.3125 60.0625 18.3125 54.3906\" id=\"BitstreamVeraSans-Roman-38\"/>\n",
       "      </defs>\n",
       "      <g transform=\"translate(302.180625 246.8375)scale(0.1 -0.1)\">\n",
       "       <use xlink:href=\"#BitstreamVeraSans-Roman-38\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"xtick_6\">\n",
       "     <g id=\"line2d_12\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"371.640625\" xlink:href=\"#m93b0483c22\" y=\"235.2390625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"line2d_13\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"371.640625\" xlink:href=\"#m741efc42ff\" y=\"12.0390625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_6\">\n",
       "      <!-- 10 -->\n",
       "      <defs>\n",
       "       <path d=\"\n",
       "M12.4062 8.29688\n",
       "L28.5156 8.29688\n",
       "L28.5156 63.9219\n",
       "L10.9844 60.4062\n",
       "L10.9844 69.3906\n",
       "L28.4219 72.9062\n",
       "L38.2812 72.9062\n",
       "L38.2812 8.29688\n",
       "L54.3906 8.29688\n",
       "L54.3906 0\n",
       "L12.4062 0\n",
       "z\n",
       "\" id=\"BitstreamVeraSans-Roman-31\"/>\n",
       "      </defs>\n",
       "      <g transform=\"translate(366.159375 246.8375)scale(0.1 -0.1)\">\n",
       "       <use xlink:href=\"#BitstreamVeraSans-Roman-31\"/>\n",
       "       <use x=\"63.623046875\" xlink:href=\"#BitstreamVeraSans-Roman-30\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"text_7\">\n",
       "     <!-- Variance -->\n",
       "     <defs>\n",
       "      <path d=\"\n",
       "M54.8906 33.0156\n",
       "L54.8906 0\n",
       "L45.9062 0\n",
       "L45.9062 32.7188\n",
       "Q45.9062 40.4844 42.875 44.3281\n",
       "Q39.8438 48.1875 33.7969 48.1875\n",
       "Q26.5156 48.1875 22.3125 43.5469\n",
       "Q18.1094 38.9219 18.1094 30.9062\n",
       "L18.1094 0\n",
       "L9.07812 0\n",
       "L9.07812 54.6875\n",
       "L18.1094 54.6875\n",
       "L18.1094 46.1875\n",
       "Q21.3438 51.125 25.7031 53.5625\n",
       "Q30.0781 56 35.7969 56\n",
       "Q45.2188 56 50.0469 50.1719\n",
       "Q54.8906 44.3438 54.8906 33.0156\" id=\"BitstreamVeraSans-Roman-6e\"/>\n",
       "      <path d=\"\n",
       "M34.2812 27.4844\n",
       "Q23.3906 27.4844 19.1875 25\n",
       "Q14.9844 22.5156 14.9844 16.5\n",
       "Q14.9844 11.7188 18.1406 8.90625\n",
       "Q21.2969 6.10938 26.7031 6.10938\n",
       "Q34.1875 6.10938 38.7031 11.4062\n",
       "Q43.2188 16.7031 43.2188 25.4844\n",
       "L43.2188 27.4844\n",
       "z\n",
       "\n",
       "M52.2031 31.2031\n",
       "L52.2031 0\n",
       "L43.2188 0\n",
       "L43.2188 8.29688\n",
       "Q40.1406 3.32812 35.5469 0.953125\n",
       "Q30.9531 -1.42188 24.3125 -1.42188\n",
       "Q15.9219 -1.42188 10.9531 3.29688\n",
       "Q6 8.01562 6 15.9219\n",
       "Q6 25.1406 12.1719 29.8281\n",
       "Q18.3594 34.5156 30.6094 34.5156\n",
       "L43.2188 34.5156\n",
       "L43.2188 35.4062\n",
       "Q43.2188 41.6094 39.1406 45\n",
       "Q35.0625 48.3906 27.6875 48.3906\n",
       "Q23 48.3906 18.5469 47.2656\n",
       "Q14.1094 46.1406 10.0156 43.8906\n",
       "L10.0156 52.2031\n",
       "Q14.9375 54.1094 19.5781 55.0469\n",
       "Q24.2188 56 28.6094 56\n",
       "Q40.4844 56 46.3438 49.8438\n",
       "Q52.2031 43.7031 52.2031 31.2031\" id=\"BitstreamVeraSans-Roman-61\"/>\n",
       "      <path d=\"\n",
       "M9.42188 54.6875\n",
       "L18.4062 54.6875\n",
       "L18.4062 0\n",
       "L9.42188 0\n",
       "z\n",
       "\n",
       "M9.42188 75.9844\n",
       "L18.4062 75.9844\n",
       "L18.4062 64.5938\n",
       "L9.42188 64.5938\n",
       "z\n",
       "\" id=\"BitstreamVeraSans-Roman-69\"/>\n",
       "      <path d=\"\n",
       "M28.6094 0\n",
       "L0.78125 72.9062\n",
       "L11.0781 72.9062\n",
       "L34.1875 11.5312\n",
       "L57.3281 72.9062\n",
       "L67.5781 72.9062\n",
       "L39.7969 0\n",
       "z\n",
       "\" id=\"BitstreamVeraSans-Roman-56\"/>\n",
       "      <path d=\"\n",
       "M56.2031 29.5938\n",
       "L56.2031 25.2031\n",
       "L14.8906 25.2031\n",
       "Q15.4844 15.9219 20.4844 11.0625\n",
       "Q25.4844 6.20312 34.4219 6.20312\n",
       "Q39.5938 6.20312 44.4531 7.46875\n",
       "Q49.3125 8.73438 54.1094 11.2812\n",
       "L54.1094 2.78125\n",
       "Q49.2656 0.734375 44.1875 -0.34375\n",
       "Q39.1094 -1.42188 33.8906 -1.42188\n",
       "Q20.7969 -1.42188 13.1562 6.1875\n",
       "Q5.51562 13.8125 5.51562 26.8125\n",
       "Q5.51562 40.2344 12.7656 48.1094\n",
       "Q20.0156 56 32.3281 56\n",
       "Q43.3594 56 49.7812 48.8906\n",
       "Q56.2031 41.7969 56.2031 29.5938\n",
       "M47.2188 32.2344\n",
       "Q47.125 39.5938 43.0938 43.9844\n",
       "Q39.0625 48.3906 32.4219 48.3906\n",
       "Q24.9062 48.3906 20.3906 44.1406\n",
       "Q15.875 39.8906 15.1875 32.1719\n",
       "z\n",
       "\" id=\"BitstreamVeraSans-Roman-65\"/>\n",
       "      <path d=\"\n",
       "M41.1094 46.2969\n",
       "Q39.5938 47.1719 37.8125 47.5781\n",
       "Q36.0312 48 33.8906 48\n",
       "Q26.2656 48 22.1875 43.0469\n",
       "Q18.1094 38.0938 18.1094 28.8125\n",
       "L18.1094 0\n",
       "L9.07812 0\n",
       "L9.07812 54.6875\n",
       "L18.1094 54.6875\n",
       "L18.1094 46.1875\n",
       "Q20.9531 51.1719 25.4844 53.5781\n",
       "Q30.0312 56 36.5312 56\n",
       "Q37.4531 56 38.5781 55.875\n",
       "Q39.7031 55.7656 41.0625 55.5156\n",
       "z\n",
       "\" id=\"BitstreamVeraSans-Roman-72\"/>\n",
       "      <path d=\"\n",
       "M48.7812 52.5938\n",
       "L48.7812 44.1875\n",
       "Q44.9688 46.2969 41.1406 47.3438\n",
       "Q37.3125 48.3906 33.4062 48.3906\n",
       "Q24.6562 48.3906 19.8125 42.8438\n",
       "Q14.9844 37.3125 14.9844 27.2969\n",
       "Q14.9844 17.2812 19.8125 11.7344\n",
       "Q24.6562 6.20312 33.4062 6.20312\n",
       "Q37.3125 6.20312 41.1406 7.25\n",
       "Q44.9688 8.29688 48.7812 10.4062\n",
       "L48.7812 2.09375\n",
       "Q45.0156 0.34375 40.9844 -0.53125\n",
       "Q36.9688 -1.42188 32.4219 -1.42188\n",
       "Q20.0625 -1.42188 12.7812 6.34375\n",
       "Q5.51562 14.1094 5.51562 27.2969\n",
       "Q5.51562 40.6719 12.8594 48.3281\n",
       "Q20.2188 56 33.0156 56\n",
       "Q37.1562 56 41.1094 55.1406\n",
       "Q45.0625 54.2969 48.7812 52.5938\" id=\"BitstreamVeraSans-Roman-63\"/>\n",
       "     </defs>\n",
       "     <g transform=\"translate(182.94609375 261.515625)scale(0.1 -0.1)\">\n",
       "      <use xlink:href=\"#BitstreamVeraSans-Roman-56\"/>\n",
       "      <use x=\"60.658203125\" xlink:href=\"#BitstreamVeraSans-Roman-61\"/>\n",
       "      <use x=\"121.9375\" xlink:href=\"#BitstreamVeraSans-Roman-72\"/>\n",
       "      <use x=\"163.05078125\" xlink:href=\"#BitstreamVeraSans-Roman-69\"/>\n",
       "      <use x=\"190.833984375\" xlink:href=\"#BitstreamVeraSans-Roman-61\"/>\n",
       "      <use x=\"252.11328125\" xlink:href=\"#BitstreamVeraSans-Roman-6e\"/>\n",
       "      <use x=\"315.4921875\" xlink:href=\"#BitstreamVeraSans-Roman-63\"/>\n",
       "      <use x=\"370.47265625\" xlink:href=\"#BitstreamVeraSans-Roman-65\"/>\n",
       "     </g>\n",
       "    </g>\n",
       "   </g>\n",
       "   <g id=\"matplotlib.axis_2\">\n",
       "    <g id=\"ytick_1\">\n",
       "     <g id=\"line2d_14\">\n",
       "      <defs>\n",
       "       <path d=\"\n",
       "M0 0\n",
       "L4 0\" id=\"m728421d6d4\" style=\"stroke:#000000;stroke-width:0.5;\"/>\n",
       "      </defs>\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"36.840625\" xlink:href=\"#m728421d6d4\" y=\"235.2390625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"line2d_15\">\n",
       "      <defs>\n",
       "       <path d=\"\n",
       "M0 0\n",
       "L-4 0\" id=\"mcb0005524f\" style=\"stroke:#000000;stroke-width:0.5;\"/>\n",
       "      </defs>\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"371.640625\" xlink:href=\"#mcb0005524f\" y=\"235.2390625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_8\">\n",
       "      <!-- 0 -->\n",
       "      <g transform=\"translate(27.8015625 237.9984375)scale(0.1 -0.1)\">\n",
       "       <use xlink:href=\"#BitstreamVeraSans-Roman-30\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"ytick_2\">\n",
       "     <g id=\"line2d_16\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"36.840625\" xlink:href=\"#m728421d6d4\" y=\"190.5990625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"line2d_17\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"371.640625\" xlink:href=\"#mcb0005524f\" y=\"190.5990625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_9\">\n",
       "      <!-- 2 -->\n",
       "      <g transform=\"translate(28.2125 193.3584375)scale(0.1 -0.1)\">\n",
       "       <use xlink:href=\"#BitstreamVeraSans-Roman-32\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"ytick_3\">\n",
       "     <g id=\"line2d_18\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"36.840625\" xlink:href=\"#m728421d6d4\" y=\"145.9590625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"line2d_19\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"371.640625\" xlink:href=\"#mcb0005524f\" y=\"145.9590625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_10\">\n",
       "      <!-- 4 -->\n",
       "      <g transform=\"translate(27.528125 148.7184375)scale(0.1 -0.1)\">\n",
       "       <use xlink:href=\"#BitstreamVeraSans-Roman-34\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"ytick_4\">\n",
       "     <g id=\"line2d_20\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"36.840625\" xlink:href=\"#m728421d6d4\" y=\"101.3190625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"line2d_21\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"371.640625\" xlink:href=\"#mcb0005524f\" y=\"101.3190625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_11\">\n",
       "      <!-- 6 -->\n",
       "      <g transform=\"translate(27.80625 104.0784375)scale(0.1 -0.1)\">\n",
       "       <use xlink:href=\"#BitstreamVeraSans-Roman-36\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"ytick_5\">\n",
       "     <g id=\"line2d_22\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"36.840625\" xlink:href=\"#m728421d6d4\" y=\"56.6790625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"line2d_23\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"371.640625\" xlink:href=\"#mcb0005524f\" y=\"56.6790625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_12\">\n",
       "      <!-- 8 -->\n",
       "      <g transform=\"translate(27.840625 59.4384375)scale(0.1 -0.1)\">\n",
       "       <use xlink:href=\"#BitstreamVeraSans-Roman-38\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"ytick_6\">\n",
       "     <g id=\"line2d_24\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"36.840625\" xlink:href=\"#m728421d6d4\" y=\"12.0390625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"line2d_25\">\n",
       "      <g>\n",
       "       <use style=\"stroke:#000000;stroke-width:0.5;\" x=\"371.640625\" xlink:href=\"#mcb0005524f\" y=\"12.0390625\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "     <g id=\"text_13\">\n",
       "      <!-- 10 -->\n",
       "      <g transform=\"translate(21.878125 14.7984375)scale(0.1 -0.1)\">\n",
       "       <use xlink:href=\"#BitstreamVeraSans-Roman-31\"/>\n",
       "       <use x=\"63.623046875\" xlink:href=\"#BitstreamVeraSans-Roman-30\"/>\n",
       "      </g>\n",
       "     </g>\n",
       "    </g>\n",
       "    <g id=\"text_14\">\n",
       "     <!-- Mean -->\n",
       "     <defs>\n",
       "      <path d=\"\n",
       "M9.8125 72.9062\n",
       "L24.5156 72.9062\n",
       "L43.1094 23.2969\n",
       "L61.8125 72.9062\n",
       "L76.5156 72.9062\n",
       "L76.5156 0\n",
       "L66.8906 0\n",
       "L66.8906 64.0156\n",
       "L48.0938 14.0156\n",
       "L38.1875 14.0156\n",
       "L19.3906 64.0156\n",
       "L19.3906 0\n",
       "L9.8125 0\n",
       "z\n",
       "\" id=\"BitstreamVeraSans-Roman-4d\"/>\n",
       "     </defs>\n",
       "     <g transform=\"translate(14.7984375 136.34765625)rotate(-90.0)scale(0.1 -0.1)\">\n",
       "      <use xlink:href=\"#BitstreamVeraSans-Roman-4d\"/>\n",
       "      <use x=\"86.279296875\" xlink:href=\"#BitstreamVeraSans-Roman-65\"/>\n",
       "      <use x=\"147.802734375\" xlink:href=\"#BitstreamVeraSans-Roman-61\"/>\n",
       "      <use x=\"209.08203125\" xlink:href=\"#BitstreamVeraSans-Roman-6e\"/>\n",
       "     </g>\n",
       "    </g>\n",
       "   </g>\n",
       "   <g id=\"PathCollection_2\">\n",
       "    <defs>\n",
       "     <path d=\"\n",
       "M0 1.58114\n",
       "C0.419323 1.58114 0.821528 1.41454 1.11803 1.11803\n",
       "C1.41454 0.821528 1.58114 0.419323 1.58114 0\n",
       "C1.58114 -0.419323 1.41454 -0.821528 1.11803 -1.11803\n",
       "C0.821528 -1.41454 0.419323 -1.58114 0 -1.58114\n",
       "C-0.419323 -1.58114 -0.821528 -1.41454 -1.11803 -1.11803\n",
       "C-1.41454 -0.821528 -1.58114 -0.419323 -1.58114 0\n",
       "C-1.58114 0.419323 -1.41454 0.821528 -1.11803 1.11803\n",
       "C-0.821528 1.41454 -0.419323 1.58114 0 1.58114\n",
       "z\n",
       "\" id=\"mf03fee725c\" style=\"stroke:#000000;\"/>\n",
       "    </defs>\n",
       "    <g clip-path=\"url(#p6d730eb300)\">\n",
       "     <use style=\"fill:#ff0000;stroke:#000000;\" x=\"338.160625\" xlink:href=\"#mf03fee725c\" y=\"34.3590625\"/>\n",
       "    </g>\n",
       "   </g>\n",
       "  </g>\n",
       " </g>\n",
       " <defs>\n",
       "  <clipPath id=\"p6d730eb300\">\n",
       "   <rect height=\"223.2\" width=\"334.8\" x=\"36.840625\" y=\"12.0390625\"/>\n",
       "  </clipPath>\n",
       " </defs>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<matplotlib.figure.Figure at 0x11b420850>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "%matplotlib inline\n",
    "%config InlineBackend.figure_format = 'svg'\n",
    "\n",
    "import matplotlib.pyplot as plt\n",
    "plt.plot(Vs_ef, Rs_ef)\n",
    "plt.xlabel('Variance')\n",
    "plt.ylabel('Mean')\n",
    "plt.scatter(Vs, Rs, s=0.2, c='k')\n",
    "#fig = plt.scatter(9.0, 9.0, s=10, c='r', zorder = 3)\n",
    "plt.scatter(9.0, 9.0, s=10, c='r', zorder = 3)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**However, let's take a look at one possible return distribution with the required moments**\n",
    "\n",
    "| $P$ | $0.5$ | $0.5$ |\n",
    "| :------: | :------: | :------: |\n",
    "| $X_1$ | $0$ | $2$ |\n",
    "| $X_2$ | $2$ | $6$ |\n",
    "| $X_3$ | $6$ | $12$ |\n",
    "\n",
    "- You don't need any math knowledge to get the obvious best portfolio, all in with $X_3$\n",
    "- How come we got a continuum of other choices equally attractive as this one?"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "** What happened here? **\n",
    "\n",
    "Modern Portfolio Theory was introduced by Harry Markowitz in 1952, lead to Nobel price in economics. It is the first mean variance model. \n",
    "\n",
    "In this model, portfolio selection is only based the first two moments of the random return. This is also true for some other more sophisticated models (Black–Litterman, etc).\n",
    "\n",
    "Here the variance is chosen as risk measure, which choose non-efficient portfolios when the random return is not Gaussian. \n",
    "\n",
    "Is it the return normally distributed in the real world?\n",
    "\n",
    "We know it is not (skewed, fat tail, you name it). \n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "** Can PyMCEF handle this situation? **\n",
    "- PyMCEF use risk measures that will produce efficient portfolios according to stochastic dominance theory. (Hadar and Russell 1969, Hanoch and Levy 1969 and Rothschild and Stiglitz 1970) \n",
    "\n",
    "** Two risk measures are used in PyMCEF **\n",
    "- Absolute semi-deviation (Ogryczak and Ruszczyński 1999)\n",
    "- Fixed-target under-performance (Fishburn 1977)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "** Let's use PyMCEF to solve this problem **"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "from pymcef import SimpleEF, RiskMeasure\n",
    "import numpy as np\n",
    "# notice that each row corresponds of all realizations of one asset return\n",
    "\n",
    "returns = np.array([0,2,6,2,6,12]).reshape((3, 2))\n",
    "labels = ['Asset 1', 'Asset 2', 'Asset 3']\n",
    "sol = SimpleEF(training_set = returns, \\\n",
    "               risk_measure = RiskMeasure.FixTargetUnderPerformance, \n",
    "               target_return = 0,\\\n",
    "               asset_names = labels)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The efficient frontier only contains one portfolio."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{2: 1.0}\n"
     ]
    }
   ],
   "source": [
    "for prt in sol.frontier_in_sample:\n",
    "    print(prt['weight'])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Next example:\n",
    "\n",
    "[2. Black Scholes revisit, delta hedging as an efficient portfolio](http://nbviewer.jupyter.org/github/hzzyyy/pymcef/blob/master/examples/2.%20Black%20Scholes%20revisit%2C%20delta%20hedging%20as%20an%20efficient%20portfolio.ipynb)"
   ]
  }
 ],
 "metadata": {
  "hide_input": false,
  "kernelspec": {
   "display_name": "Python [conda env:jupyter27]",
   "language": "python",
   "name": "conda-env-jupyter27-py"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 2
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython2",
   "version": "2.7.13"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}