API_example_gadma.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Example of API usage for optimization with GADMA\n",
    "\n",
    "To install package run the following from base directory:\n",
    "\n",
    "```console\n",
    "$ pip install .\n",
    "```\n",
    "\n",
    "Install gadma cia `pip`:\n",
    "\n",
    "```console\n",
    "$ pip install gadma\n",
    "```\n",
    "\n",
    "To import packages:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import deminf_data\n",
    "import gadma"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Choose dataset\n",
    "\n",
    "Let us take dataset for one population which has name `1_Bot_4_Sim`:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "data_name = \"1_Bot_4_Sim\""
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Get objective function\n",
    "\n",
    "The call of this function will take values of parameters and return value of log-likelihood (negative or positive) for the data set with given name. It will be used in gadma optimization."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "objective = deminf_data.Objective.from_name(data_name)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Variables\n",
    "\n",
    "Objectives provide information about parameters. GADMA requires the created `variables` with information about type of the parameter and its domain. There is a special method in order to get this variables:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[PopulationSizeVariable nuB, PopulationSizeVariable nuF, TimeVariable tB, TimeVariable tF]\n"
     ]
    }
   ],
   "source": [
    "variables = objective.get_gadma_variables()\n",
    "print(variables)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Run genetic algorithm from GADMA\n",
    "\n",
    "Main optimization in GADMA is genetic algorithm. The object of such optimization could be created by:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "ga_optimizer = gadma.get_global_optimizer(id=\"Genetic_algorithm\")\n",
    "ga_optimizer.maximize=True  # It is important as we have maximum to find"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In order to run optimization method `optimize` should be used. The API of this method is following:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Help on method optimize in module gadma.optimizers.global_optimizer:\n",
      "\n",
      "optimize(f, variables, args=(), num_init=50, num_init_const=None, X_init=None, Y_init=None, linear_constrain=None, maxiter=None, maxeval=None, verbose=0, callback=None, report_file=None, eval_file=None, save_file=None, restore_file=None, restore_points_only=False, restore_x_transform=None) method of gadma.optimizers.genetic_algorithm.GeneticAlgorithm instance\n",
      "    Return best values of `variables` that minimizes/maximizes\n",
      "    the function `f`.\n",
      "    \n",
      "    :param f: function to minimize/maximize. The usage must be the\n",
      "              following: `f(x, \\*args)`, where `x` is a list of values.\n",
      "    :type f: func\n",
      "    :param variables: list of variables of the function.\n",
      "    :type variables: list of :class:`gadma.utils.Variable`\n",
      "    :param args: Additional arguments of function `f`.\n",
      "    :type args: tuple\n",
      "    :param num_init: Number of points in initial design.\n",
      "    :type num_init: int\n",
      "    :param num_init_const: If None then `num_init` is used. Otherwise\n",
      "                           number of points in initial design is equal to\n",
      "                           `num_init_const` \\* len(`variables`).\n",
      "    :param X_init: list of initial values.\n",
      "    :type X_init: list of vectors.\n",
      "    :param Y_init: value of function `f` on initial values from `X_init`.\n",
      "    :type Y_init: list of floats\n",
      "    \n",
      "    :param linear_constrain: Linear constrain on variables.\n",
      "    :type linear_constrain: :class:`gadma.optimizers.LinearConstrain`\n",
      "    :param maxiter: maximum number of algorithm iterations.\n",
      "    :type maxiter: int\n",
      "    :param maxeval: maximum number of function evaluations.\n",
      "    :type maxeval: int\n",
      "    :param verbose: Verbosity of the report output. If 0 then no output.\n",
      "    :type verbose: int\n",
      "    :param callback: callback to call after each iteration.\n",
      "                     It will be called as callback(x, y), where x, y -\n",
      "                     best solution of the iteration and its fitness.\n",
      "    :type callback: function\n",
      "    :param report_file: File to save report. Check option `verbose`.\n",
      "    :type report_file: str\n",
      "    :param eval_file: File to save all evaluations of the function `f`.\n",
      "    :type eval_file: str\n",
      "    :param save_file: File to save information during optimization for its\n",
      "                      reconstruction.\n",
      "    :type save_file: str\n",
      "    :param restore_file: File to restore previous run.\n",
      "    :type restore_file: str\n",
      "    :param restore_points_only: Restore point/points from previous run and\n",
      "                                run optimization from them once more. If\n",
      "                                False then previous run will be resumed.\n",
      "    :type restore_points_only: bool\n",
      "    :param restore_x_transform: Restore points but transform them with\n",
      "                                given transform before usage in this run.\n",
      "    :type restore_x_transform: func\n",
      "\n"
     ]
    }
   ],
   "source": [
    "help(ga_optimizer.optimize)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can run genetic algorithm the following way:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Generation #0.\n",
      "Current generation of solutions:\n",
      "N\tValue of fitness function\tSolution\n",
      "0\t-880.158960\t(nuB=0.07756,\tnuF=18.18559,\ttB=0.29546,\ttF=6e-05)\tr\n",
      "1\t-1141.655357\t(nuB=0.44962,\tnuF=0.13897,\ttB=0.9263,\ttF=0.00731)\tr\n",
      "2\t-1252.253473\t(nuB=0.43853,\tnuF=4.22454,\ttB=0.08649,\ttF=7.47e-08)\tr\n",
      "3\t-1354.284265\t(nuB=0.07414,\tnuF=0.20668,\ttB=1.35e-09,\ttF=0.68216)\tr\n",
      "4\t-1632.611999\t(nuB=10.31904,\tnuF=0.23911,\ttB=0.5627,\ttF=0.1144)\tr\n",
      "5\t-1720.210042\t(nuB=0.1026,\tnuF=21.38213,\ttB=0.00824,\ttF=0.00013)\tr\n",
      "6\t-1753.639588\t(nuB=0.04255,\tnuF=0.06446,\ttB=0.00386,\ttF=5.24e-06)\tr\n",
      "7\t-1797.153498\t(nuB=0.19305,\tnuF=0.02266,\ttB=7e-05,\ttF=0.06594)\tr\n",
      "8\t-2050.034562\t(nuB=0.13855,\tnuF=1.46641,\ttB=0.00312,\ttF=7.21e-06)\tr\n",
      "9\t-2102.717584\t(nuB=25.29892,\tnuF=0.09369,\ttB=0.01045,\ttF=0.10332)\tr\n",
      "10\t-2142.653228\t(nuB=0.03864,\tnuF=2.03684,\ttB=0.00084,\ttF=0.01958)\tr\n",
      "11\t-2218.584034\t(nuB=6.89196,\tnuF=0.20025,\ttB=8.34e-07,\ttF=0.0017)\tr\n",
      "12\t-2242.309143\t(nuB=0.31107,\tnuF=0.04667,\ttB=0.04432,\ttF=0.34881)\tr\n",
      "13\t-2250.358499\t(nuB=0.23237,\tnuF=0.73549,\ttB=5.99e-08,\ttF=2.67599)\tr\n",
      "14\t-2290.368693\t(nuB=0.26968,\tnuF=0.43211,\ttB=2.80e-06,\ttF=0.0019)\tr\n",
      "15\t-2325.866718\t(nuB=7.94242,\tnuF=0.02377,\ttB=2.19e-08,\ttF=0.2479)\tr\n",
      "16\t-2333.038014\t(nuB=0.09091,\tnuF=0.89058,\ttB=1.22e-14,\ttF=0.0016)\tr\n",
      "17\t-2333.143625\t(nuB=3.44974,\tnuF=0.04508,\ttB=1e-05,\ttF=9.41e-06)\tr\n",
      "18\t-2335.558938\t(nuB=0.0546,\tnuF=0.24447,\ttB=3.27e-08,\ttF=2e-05)\tr\n",
      "19\t-2336.565966\t(nuB=0.53915,\tnuF=0.25366,\ttB=8.89e-06,\ttF=1.64e-06)\tr\n",
      "20\t-2336.586810\t(nuB=0.19799,\tnuF=0.13096,\ttB=2.88e-09,\ttF=1.71e-06)\tr\n",
      "21\t-2336.745250\t(nuB=0.13901,\tnuF=0.90331,\ttB=1.88412,\ttF=1.09e-07)\tr\n",
      "22\t-2336.779922\t(nuB=7.64914,\tnuF=0.87244,\ttB=2.31e-06,\ttF=2e-05)\tr\n",
      "23\t-2336.784581\t(nuB=0.98613,\tnuF=0.12147,\ttB=6e-05,\ttF=1.72e-08)\tr\n",
      "24\t-2336.798217\t(nuB=0.19931,\tnuF=0.18762,\ttB=0.04749,\ttF=2.89037)\tr\n",
      "25\t-2336.804311\t(nuB=1.12928,\tnuF=0.1769,\ttB=3.20e-09,\ttF=1.35e-09)\tr\n",
      "26\t-2336.804424\t(nuB=2.00805,\tnuF=0.0978,\ttB=1.20e-11,\ttF=7.57e-12)\tr\n",
      "27\t-2336.804425\t(nuB=26.44005,\tnuF=0.01832,\ttB=0.00101,\ttF=0.67686)\tr\n",
      "28\t-2336.804425\t(nuB=1.50895,\tnuF=0.02863,\ttB=6.64e-10,\ttF=1.11111)\tr\n",
      "29\t-2336.804425\t(nuB=5.09558,\tnuF=1.29891,\ttB=4.21e-13,\ttF=8.09e-13)\tr\n",
      "30\t-2336.804435\t(nuB=0.60237,\tnuF=40.03368,\ttB=7.18e-11,\ttF=5.59e-10)\tr\n",
      "31\t-2336.810199\t(nuB=2.52182,\tnuF=0.18703,\ttB=5.49e-07,\ttF=7.13e-09)\tr\n",
      "32\t-2336.833286\t(nuB=0.11618,\tnuF=0.16559,\ttB=1.93177,\ttF=1.89469)\tr\n",
      "33\t-2336.887725\t(nuB=0.1535,\tnuF=7.80059,\ttB=3.02926,\ttF=6.80e-07)\tr\n",
      "34\t-2337.356520\t(nuB=4.08831,\tnuF=6.05451,\ttB=4e-05,\ttF=8.32e-07)\tr\n",
      "35\t-2337.698390\t(nuB=16.3432,\tnuF=2.56165,\ttB=6.57e-07,\ttF=8e-05)\tr\n",
      "36\t-2338.570735\t(nuB=44.76672,\tnuF=4.33689,\ttB=7e-05,\ttF=3e-05)\tr\n",
      "37\t-2374.869536\t(nuB=4.90819,\tnuF=1.06765,\ttB=0.00241,\ttF=7.47e-06)\tr\n",
      "38\t-2382.313738\t(nuB=0.49872,\tnuF=1.11856,\ttB=0.00193,\ttF=3.47421)\tr\n",
      "39\t-2485.378979\t(nuB=0.02508,\tnuF=1.35982,\ttB=3.27e-06,\ttF=0.02774)\tr\n",
      "40\t-2502.314351\t(nuB=2.77147,\tnuF=1.63832,\ttB=4.15e-06,\ttF=0.0202)\tr\n",
      "41\t-2587.120746\t(nuB=1.60196,\tnuF=0.67904,\ttB=0.51962,\ttF=0.09944)\tr\n",
      "42\t-2636.952515\t(nuB=0.07255,\tnuF=1.49509,\ttB=0.07828,\ttF=4.79269)\tr\n",
      "43\t-3624.686699\t(nuB=0.02838,\tnuF=3.45336,\ttB=2e-05,\ttF=0.06998)\tr\n",
      "44\t-6393.883160\t(nuB=4.29814,\tnuF=2.03333,\ttB=0.19639,\ttF=0.0046)\tr\n",
      "45\t-6560.338848\t(nuB=0.73763,\tnuF=2.38438,\ttB=4.67e-08,\ttF=1.50193)\tr\n",
      "46\t-9125.630530\t(nuB=0.13269,\tnuF=2.36218,\ttB=0.07615,\ttF=0.96241)\tr\n",
      "47\t-16850.827696\t(nuB=7.56567,\tnuF=4.9069,\ttB=3.08814,\ttF=8.10e-06)\tr\n",
      "48\t-27061.173558\t(nuB=1.51734,\tnuF=17.60611,\ttB=6e-05,\ttF=1.54124)\tr\n",
      "49\t-29584.470639\t(nuB=17.39722,\tnuF=0.27652,\ttB=2.89575,\ttF=7.48e-08)\tr\n",
      "Current mean mutation rate:\t 0.200000\n",
      "Current mean number of params to change during mutation:\t  1\n",
      "\n",
      "--Best solution by value of fitness function--\n",
      "Value of fitness: -880.1589600216848\n",
      "Solution:\t\t(nuB=0.07756,\tnuF=18.18559,\ttB=0.29546,\ttF=6e-05)\tr\n",
      "\n",
      "Mean time:\tnan sec.\n",
      "\n",
      "\n",
      "\n",
      "Generation #1.\n",
      "Current generation of solutions:\n",
      "N\tValue of fitness function\tSolution\n",
      "0\t-880.158960\t(nuB=0.07756,\tnuF=18.18559,\ttB=0.29546,\ttF=6e-05)\tr\n",
      "1\t-1138.856790\t(nuB=0.44962,\tnuF=0.12448,\ttB=0.9263,\ttF=0.00731)\tm\n",
      "2\t-1141.655357\t(nuB=0.44962,\tnuF=0.13897,\ttB=0.9263,\ttF=0.00731)\tr\n",
      "3\t-1208.404121\t(nuB=0.07414,\tnuF=0.20668,\ttB=7e-05,\ttF=0.06594)\tc\n",
      "4\t-1585.402234\t(nuB=0.07414,\tnuF=0.20668,\ttB=7.37e-10,\ttF=0.75485)\tmm\n",
      "5\t-2050.034462\t(nuB=0.13855,\tnuF=1.46641,\ttB=0.00312,\ttF=7.93e-06)\tm\n",
      "6\t-2329.202042\t(nuB=4.40268,\tnuF=0.3063,\ttB=0.00049,\ttF=0.00034)\tr\n",
      "7\t-2421.434177\t(nuB=0.13855,\tnuF=1.46641,\ttB=0.00312,\ttF=0.06594)\tc\n",
      "8\t-2453.450375\t(nuB=25.29892,\tnuF=0.09369,\ttB=0.29546,\ttF=0.10332)\tc\n",
      "9\t-2644.665175\t(nuB=0.21962,\tnuF=2.8186,\ttB=3e-05,\ttF=0.02137)\tr\n",
      "Current mean mutation rate:\t 0.191089\n",
      "Current mean number of params to change during mutation:\t  1\n",
      "\n",
      "--Best solution by value of fitness function--\n",
      "Value of fitness: -880.1589600216848\n",
      "Solution:\t\t(nuB=0.07756,\tnuF=18.18559,\ttB=0.29546,\ttF=6e-05)\tr\n",
      "\n",
      "Mean time:\t0.069 sec.\n",
      "\n",
      "\n",
      "\n",
      "Generation #2.\n",
      "Current generation of solutions:\n",
      "N\tValue of fitness function\tSolution\n",
      "0\t-865.780486\t(nuB=0.36106,\tnuF=9.98106,\ttB=0.12551,\ttF=3.53e-06)\tr\n",
      "1\t-876.782064\t(nuB=0.44962,\tnuF=0.13897,\ttB=0.63747,\ttF=0.00731)\tm\n",
      "2\t-880.158960\t(nuB=0.07756,\tnuF=18.18559,\ttB=0.29546,\ttF=6e-05)\tr\n",
      "3\t-984.693566\t(nuB=0.44962,\tnuF=0.12448,\ttB=0.75953,\ttF=0.00335)\tmm\n",
      "4\t-1138.856790\t(nuB=0.44962,\tnuF=0.12448,\ttB=0.9263,\ttF=0.00731)\tm\n",
      "5\t-1148.866186\t(nuB=0.50195,\tnuF=0.12448,\ttB=0.9263,\ttF=0.00731)\tm\n",
      "6\t-2154.121469\t(nuB=0.21962,\tnuF=1.46641,\ttB=0.00312,\ttF=7.93e-06)\tc\n",
      "7\t-2329.202042\t(nuB=4.40268,\tnuF=0.3063,\ttB=0.00049,\ttF=0.00034)\tc\n",
      "8\t-2336.806326\t(nuB=2.39568,\tnuF=4.01387,\ttB=3.28e-09,\ttF=1.29e-07)\tr\n",
      "9\t-2453.450375\t(nuB=25.29892,\tnuF=0.09369,\ttB=0.29546,\ttF=0.10332)\tc\n",
      "Current mean mutation rate:\t 0.229306\n",
      "Current mean number of params to change during mutation:\t  1\n",
      "\n",
      "--Best solution by value of fitness function--\n",
      "Value of fitness: -865.7804855267068\n",
      "Solution:\t\t(nuB=0.36106,\tnuF=9.98106,\ttB=0.12551,\ttF=3.53e-06)\tr\n",
      "\n",
      "Mean time:\t0.063 sec.\n",
      "\n",
      "\n",
      "\n",
      "Generation #3.\n",
      "Current generation of solutions:\n",
      "N\tValue of fitness function\tSolution\n",
      "0\t-819.246439\t(nuB=0.29358,\tnuF=9.98106,\ttB=0.12551,\ttF=3.53e-06)\tm\n",
      "1\t-865.780486\t(nuB=0.36106,\tnuF=9.98106,\ttB=0.12551,\ttF=3.53e-06)\tr\n",
      "2\t-876.782064\t(nuB=0.44962,\tnuF=0.13897,\ttB=0.63747,\ttF=0.00731)\tm\n",
      "3\t-880.158960\t(nuB=0.07756,\tnuF=18.18559,\ttB=0.29546,\ttF=6e-05)\tc\n",
      "4\t-947.863644\t(nuB=0.51672,\tnuF=0.13897,\ttB=0.63747,\ttF=0.00766)\tmm\n",
      "5\t-1164.355845\t(nuB=0.53482,\tnuF=0.12448,\ttB=0.9263,\ttF=0.00731)\tm\n",
      "6\t-2319.067587\t(nuB=0.0789,\tnuF=3.62345,\ttB=8e-05,\ttF=1.92e-09)\tr\n",
      "7\t-2329.202042\t(nuB=4.40268,\tnuF=0.3063,\ttB=0.00049,\ttF=0.00034)\tc\n",
      "8\t-2711.173459\t(nuB=0.06216,\tnuF=3.65325,\ttB=0.00167,\ttF=0.05316)\tr\n",
      "9\t-11871.949012\t(nuB=4.40268,\tnuF=0.12448,\ttB=0.9263,\ttF=0.00034)\tc\n",
      "Current mean mutation rate:\t 0.275168\n",
      "Current mean number of params to change during mutation:\t  1\n",
      "\n",
      "--Best solution by value of fitness function--\n",
      "Value of fitness: -819.2464389844154\n",
      "Solution:\t\t(nuB=0.29358,\tnuF=9.98106,\ttB=0.12551,\ttF=3.53e-06)\tm\n",
      "\n",
      "Mean time:\t0.061 sec.\n",
      "\n",
      "\n",
      "\n",
      "Generation #4.\n",
      "Current generation of solutions:\n",
      "N\tValue of fitness function\tSolution\n",
      "0\t-819.246439\t(nuB=0.29358,\tnuF=9.98106,\ttB=0.12551,\ttF=3.53e-06)\tm\n",
      "1\t-865.780486\t(nuB=0.36106,\tnuF=9.98106,\ttB=0.12551,\ttF=3.53e-06)\tr\n",
      "2\t-880.158960\t(nuB=0.07756,\tnuF=18.18559,\ttB=0.29546,\ttF=6e-05)\tc\n",
      "3\t-936.899327\t(nuB=0.51672,\tnuF=0.13897,\ttB=0.63747,\ttF=0.00644)\tm\n",
      "4\t-1378.639387\t(nuB=0.07756,\tnuF=0.13897,\ttB=0.29546,\ttF=0.00731)\tc\n",
      "5\t-1814.068748\t(nuB=11.0988,\tnuF=0.66144,\ttB=4.46e-07,\ttF=0.07145)\tr\n",
      "6\t-2319.067587\t(nuB=0.0789,\tnuF=3.62345,\ttB=8e-05,\ttF=1.92e-09)\tc\n",
      "7\t-2327.143219\t(nuB=2.22591,\tnuF=0.3063,\ttB=0.00049,\ttF=0.00034)\tm\n",
      "8\t-2947.132069\t(nuB=3.79929,\tnuF=0.05508,\ttB=8.14e-09,\ttF=0.0783)\tr\n",
      "9\t-13870.575894\t(nuB=5.60765,\tnuF=0.12448,\ttB=0.9263,\ttF=0.00034)\tm\n",
      "Current mean mutation rate:\t 0.262907\n",
      "Current mean number of params to change during mutation:\t  1\n",
      "\n",
      "--Best solution by value of fitness function--\n",
      "Value of fitness: -819.2464389844154\n",
      "Solution:\t\t(nuB=0.29358,\tnuF=9.98106,\ttB=0.12551,\ttF=3.53e-06)\tm\n",
      "\n",
      "Mean time:\t0.064 sec.\n",
      "\n",
      "\n",
      "\n",
      "Generation #5.\n",
      "Current generation of solutions:\n",
      "N\tValue of fitness function\tSolution\n",
      "0\t-819.246439\t(nuB=0.29358,\tnuF=9.98106,\ttB=0.12551,\ttF=3.53e-06)\tm\n",
      "1\t-865.780486\t(nuB=0.36106,\tnuF=9.98106,\ttB=0.12551,\ttF=3.53e-06)\tr\n",
      "2\t-1197.740110\t(nuB=0.07756,\tnuF=0.13897,\ttB=0.29546,\ttF=0.00504)\tm\n",
      "3\t-1814.068748\t(nuB=11.0988,\tnuF=0.66144,\ttB=4.46e-07,\ttF=0.07145)\tc\n",
      "4\t-1888.979205\t(nuB=11.0988,\tnuF=0.70316,\ttB=4.46e-07,\ttF=0.07145)\tm\n",
      "5\t-2309.793857\t(nuB=0.0789,\tnuF=3.62345,\ttB=0.00012,\ttF=1.92e-09)\tm\n",
      "6\t-2336.772002\t(nuB=3.75375,\tnuF=0.07555,\ttB=0.20224,\ttF=1.14619)\tr\n",
      "7\t-2672.715703\t(nuB=0.55473,\tnuF=1.57777,\ttB=2.09e-09,\ttF=3.77264)\tr\n",
      "8\t-3947.163676\t(nuB=2.22591,\tnuF=0.3063,\ttB=0.12551,\ttF=3.53e-06)\tc\n",
      "9\t-4256.768425\t(nuB=11.0988,\tnuF=9.98106,\ttB=4.46e-07,\ttF=0.07145)\tc\n",
      "Current mean mutation rate:\t 0.251192\n",
      "Current mean number of params to change during mutation:\t  1\n",
      "\n",
      "--Best solution by value of fitness function--\n",
      "Value of fitness: -819.2464389844154\n",
      "Solution:\t\t(nuB=0.29358,\tnuF=9.98106,\ttB=0.12551,\ttF=3.53e-06)\tm\n",
      "\n",
      "Mean time:\t0.065 sec.\n",
      "\n",
      "\n",
      "\n",
      "Generation #6.\n",
      "Current generation of solutions:\n",
      "N\tValue of fitness function\tSolution\n",
      "0\t-819.113375\t(nuB=0.29358,\tnuF=9.98106,\ttB=0.12551,\ttF=5.94e-06)\tm\n",
      "1\t-819.246439\t(nuB=0.29358,\tnuF=9.98106,\ttB=0.12551,\ttF=3.53e-06)\tm\n",
      "2\t-865.780486\t(nuB=0.36106,\tnuF=9.98106,\ttB=0.12551,\ttF=3.53e-06)\tr\n",
      "3\t-2064.830820\t(nuB=0.16419,\tnuF=0.12844,\ttB=0.00015,\ttF=0.00256)\tr\n",
      "4\t-2303.756004\t(nuB=0.06512,\tnuF=3.62345,\ttB=0.00012,\ttF=1.92e-09)\tm\n",
      "5\t-2313.721657\t(nuB=0.09137,\tnuF=3.62345,\ttB=0.00012,\ttF=1.92e-09)\tm\n",
      "6\t-2336.804425\t(nuB=0.10587,\tnuF=4.32016,\ttB=5.10e-14,\ttF=4.84e-12)\tr\n",
      "7\t-3947.163676\t(nuB=2.22591,\tnuF=0.3063,\ttB=0.12551,\ttF=3.53e-06)\tc\n",
      "8\t-3947.702046\t(nuB=2.22591,\tnuF=9.98106,\ttB=0.12551,\ttF=3.53e-06)\tc\n",
      "9\t-4256.768425\t(nuB=11.0988,\tnuF=9.98106,\ttB=4.46e-07,\ttF=0.07145)\tc\n",
      "Current mean mutation rate:\t 0.301431\n",
      "Current mean number of params to change during mutation:\t  1\n",
      "\n",
      "--Best solution by value of fitness function--\n",
      "Value of fitness: -819.1133747470994\n",
      "Solution:\t\t(nuB=0.29358,\tnuF=9.98106,\ttB=0.12551,\ttF=5.94e-06)\tm\n",
      "\n",
      "Mean time:\t0.063 sec.\n",
      "\n",
      "\n",
      "\n"
     ]
    }
   ],
   "source": [
    "result = ga_optimizer.optimize(\n",
    "    f=objective,\n",
    "    variables=variables,\n",
    "    verbose=1,  # prints information each iteration\n",
    "    maxeval=100,\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## The result object\n",
    "\n",
    "Optimizers in GADMA returns result objects that have information about run:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "  status: 2\n",
      " success: True\n",
      " message: MAXIMUM NUMBER OF FUNCTION EVALUATIONS ACHIEVED\n",
      "       x: [2.93577370e-01 9.98106418e+00 1.25508007e-01 5.93843610e-06]\tm\n",
      "       y: -819.1133747470994\n",
      "  n_eval: 107\n",
      "  n_iter: 6\n",
      "\n"
     ]
    }
   ],
   "source": [
    "print(result)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Local optimization\n",
    "\n",
    "GADMA has several optimizers including local search algorithms. They are available under `get_local_optimizer` method."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "ls_optimizer = gadma.get_local_optimizer(\"BFGS\")\n",
    "ls_optimizer.maximize = True\n",
    "ls_optimizer.log_transform = True  # we can also apply logarithm transform for all x"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0\t-819.1133747470994\t(nuB=0.29358,\tnuF=9.98106,\ttB=0.12551,\ttF=5.94e-06)\t\n",
      "1\t-819.1133747470994\t(nuB=0.29358,\tnuF=9.98106,\ttB=0.12551,\ttF=5.94e-06)\t\n",
      "2\t-819.0666982559515\t(nuB=0.29387,\tnuF=9.98106,\ttB=0.12551,\ttF=5.94e-06)\t\n",
      "2\t-819.1133655840122\t(nuB=0.29358,\tnuF=9.99105,\ttB=0.12551,\ttF=5.94e-06)\t\n",
      "2\t-814.8705435148013\t(nuB=0.29358,\tnuF=9.98106,\ttB=0.12651,\ttF=5.94e-06)\t\n",
      "2\t-766.2268558803826\t(nuB=0.29358,\tnuF=9.98106,\ttB=0.12551,\ttF=0.00101)\t\n",
      "2\t-22769.968076419304\t(nuB=0.29384,\tnuF=9.98107,\ttB=0.20628,\ttF=1.00677)\t\n",
      "2\t-22762.357266841147\t(nuB=0.29413,\tnuF=9.98107,\ttB=0.20628,\ttF=1.00677)\t\n",
      "2\t-22778.965502721574\t(nuB=0.29384,\tnuF=9.99105,\ttB=0.20628,\ttF=1.00677)\t\n",
      "2\t-22797.801422722987\t(nuB=0.29384,\tnuF=9.98107,\ttB=0.20728,\ttF=1.00677)\t\n",
      "2\t-22776.632325702765\t(nuB=0.29384,\tnuF=9.98107,\ttB=0.20628,\ttF=1.00777)\t\n",
      "2\t-6958.478921787733\t(nuB=0.29363,\tnuF=9.98106,\ttB=0.14115,\ttF=0.19497)\t\n",
      "2\t-6956.659950853614\t(nuB=0.29392,\tnuF=9.98106,\ttB=0.14115,\ttF=0.19497)\t\n",
      "2\t-6960.059906220246\t(nuB=0.29363,\tnuF=9.99105,\ttB=0.14115,\ttF=0.19497)\t\n",
      "2\t-6973.047111111756\t(nuB=0.29363,\tnuF=9.98106,\ttB=0.14215,\ttF=0.19497)\t\n",
      "2\t-6996.054647981619\t(nuB=0.29363,\tnuF=9.98106,\ttB=0.14115,\ttF=0.19597)\t\n",
      "2\t-635.5947586800357\t(nuB=0.29359,\tnuF=9.98106,\ttB=0.12848,\ttF=0.03704)\t\n",
      "2\t-636.7317056748161\t(nuB=0.29388,\tnuF=9.98106,\ttB=0.12848,\ttF=0.03704)\t\n",
      "2\t-635.6491684932735\t(nuB=0.29359,\tnuF=9.99105,\ttB=0.12848,\ttF=0.03704)\t\n",
      "2\t-633.4209129279834\t(nuB=0.29359,\tnuF=9.98106,\ttB=0.12948,\ttF=0.03704)\t\n",
      "2\t-660.1708535923508\t(nuB=0.29359,\tnuF=9.98106,\ttB=0.12848,\ttF=0.03804)\t\n",
      "2\t-635.5947586800357\t(nuB=0.29359,\tnuF=9.98106,\ttB=0.12848,\ttF=0.03704)\t\n",
      "2\t-763.9926136246122\t(nuB=0.28408,\tnuF=9.96505,\ttB=0.25058,\ttF=0.03428)\t\n",
      "3\t-763.6682158603926\t(nuB=0.28437,\tnuF=9.96505,\ttB=0.25058,\ttF=0.03428)\t\n",
      "3\t-764.0738206262595\t(nuB=0.28408,\tnuF=9.97502,\ttB=0.25058,\ttF=0.03428)\t\n",
      "3\t-768.4627746072865\t(nuB=0.28408,\tnuF=9.96505,\ttB=0.25158,\ttF=0.03428)\t\n",
      "3\t-805.9854381783334\t(nuB=0.28408,\tnuF=9.96505,\ttB=0.25058,\ttF=0.03528)\t\n",
      "3\t-584.7614166906124\t(nuB=0.29061,\tnuF=9.97611,\ttB=0.16624,\ttF=0.03619)\t\n",
      "3\t-585.4497423616103\t(nuB=0.2909,\tnuF=9.97611,\ttB=0.16624,\ttF=0.03619)\t\n",
      "3\t-584.8229319526572\t(nuB=0.29061,\tnuF=9.98609,\ttB=0.16624,\ttF=0.03619)\t\n",
      "3\t-585.7419348493195\t(nuB=0.29061,\tnuF=9.97611,\ttB=0.16724,\ttF=0.03619)\t\n",
      "3\t-613.8424523649473\t(nuB=0.29061,\tnuF=9.97611,\ttB=0.16624,\ttF=0.03719)\t\n",
      "3\t-584.7614166906124\t(nuB=0.29061,\tnuF=9.97611,\ttB=0.16624,\ttF=0.03619)\t\n",
      "3\t-541.4469209817471\t(nuB=0.20304,\tnuF=9.45039,\ttB=0.10518,\ttF=0.04332)\t\n",
      "4\t-541.7817549810561\t(nuB=0.20324,\tnuF=9.45039,\ttB=0.10518,\ttF=0.04332)\t\n",
      "4\t-541.5357585194452\t(nuB=0.20304,\tnuF=9.45985,\ttB=0.10518,\ttF=0.04332)\t\n",
      "4\t-543.0254871017687\t(nuB=0.20304,\tnuF=9.45039,\ttB=0.10618,\ttF=0.04332)\t\n",
      "4\t-571.8092198144941\t(nuB=0.20304,\tnuF=9.45039,\ttB=0.10518,\ttF=0.04432)\t\n",
      "4\t-541.4469209817471\t(nuB=0.20304,\tnuF=9.45039,\ttB=0.10518,\ttF=0.04332)\t\n",
      "4\t-391.39269438215433\t(nuB=0.18148,\tnuF=2.84975,\ttB=0.08778,\ttF=0.04608)\t\n",
      "5\t-391.8482961275704\t(nuB=0.18166,\tnuF=2.84975,\ttB=0.08778,\ttF=0.04608)\t\n",
      "5\t-391.5763079378403\t(nuB=0.18148,\tnuF=2.8526,\ttB=0.08778,\ttF=0.04608)\t\n",
      "5\t-390.7736199784631\t(nuB=0.18148,\tnuF=2.84975,\ttB=0.08878,\ttF=0.04608)\t\n",
      "5\t-410.61895435090446\t(nuB=0.18148,\tnuF=2.84975,\ttB=0.08778,\ttF=0.04708)\t\n",
      "5\t-2540.356846734865\t(nuB=0.11581,\tnuF=0.02356,\ttB=0.01821,\ttF=0.05716)\t\n",
      "5\t-2540.771908424732\t(nuB=0.11593,\tnuF=0.02356,\ttB=0.01821,\ttF=0.05716)\t\n",
      "5\t-2543.921846303454\t(nuB=0.11581,\tnuF=0.02359,\ttB=0.01821,\ttF=0.05716)\t\n",
      "5\t-2520.397291623587\t(nuB=0.11581,\tnuF=0.02356,\ttB=0.01921,\ttF=0.05716)\t\n",
      "5\t-2430.880792963366\t(nuB=0.11581,\tnuF=0.02356,\ttB=0.01821,\ttF=0.05816)\t\n",
      "5\t-377.4355355781945\t(nuB=0.18011,\tnuF=2.62894,\ttB=0.08661,\ttF=0.04627)\t\n",
      "5\t-377.90446809978675\t(nuB=0.18029,\tnuF=2.62894,\ttB=0.08661,\ttF=0.04627)\t\n",
      "5\t-377.6219929841036\t(nuB=0.18011,\tnuF=2.63157,\ttB=0.08661,\ttF=0.04627)\t\n",
      "5\t-376.5578074766918\t(nuB=0.18011,\tnuF=2.62894,\ttB=0.08761,\ttF=0.04627)\t\n",
      "5\t-395.6293935685435\t(nuB=0.18011,\tnuF=2.62894,\ttB=0.08661,\ttF=0.04727)\t\n",
      "5\t-363.43391361367503\t(nuB=0.17877,\tnuF=2.42686,\ttB=0.08545,\ttF=0.04646)\t\n",
      "5\t-363.9163262276188\t(nuB=0.17895,\tnuF=2.42686,\ttB=0.08545,\ttF=0.04646)\t\n",
      "5\t-363.6219602685542\t(nuB=0.17877,\tnuF=2.42929,\ttB=0.08545,\ttF=0.04646)\t\n",
      "5\t-362.2852697800772\t(nuB=0.17877,\tnuF=2.42686,\ttB=0.08645,\ttF=0.04646)\t\n",
      "5\t-380.5792736205276\t(nuB=0.17877,\tnuF=2.42686,\ttB=0.08545,\ttF=0.04746)\t\n",
      "5\t-838.0971024064966\t(nuB=0.14389,\tnuF=0.23913,\ttB=0.05183,\ttF=0.05181)\t\n",
      "5\t-838.3634234151968\t(nuB=0.14403,\tnuF=0.23913,\ttB=0.05183,\ttF=0.05181)\t\n",
      "5\t-837.0919904325801\t(nuB=0.14389,\tnuF=0.23937,\ttB=0.05183,\ttF=0.05181)\t\n",
      "5\t-832.7946960425706\t(nuB=0.14389,\tnuF=0.23913,\ttB=0.05283,\ttF=0.05181)\t\n",
      "5\t-833.5501554121711\t(nuB=0.14389,\tnuF=0.23913,\ttB=0.05183,\ttF=0.05281)\t\n",
      "5\t-252.09126126493175\t(nuB=0.16657,\tnuF=1.14149,\ttB=0.07451,\ttF=0.0482)\t\n",
      "5\t-252.68475886765827\t(nuB=0.16674,\tnuF=1.14149,\ttB=0.07451,\ttF=0.0482)\t\n",
      "5\t-252.19626138873537\t(nuB=0.16657,\tnuF=1.14263,\ttB=0.07451,\ttF=0.0482)\t\n",
      "5\t-247.87718553180548\t(nuB=0.16657,\tnuF=1.14149,\ttB=0.07551,\ttF=0.0482)\t\n",
      "5\t-258.90537344305267\t(nuB=0.16657,\tnuF=1.14149,\ttB=0.07451,\ttF=0.0492)\t\n",
      "5\t-242.4553466288162\t(nuB=0.16242,\tnuF=0.87158,\ttB=0.0706,\ttF=0.04882)\t\n",
      "5\t-243.06208905111816\t(nuB=0.16258,\tnuF=0.87158,\ttB=0.0706,\ttF=0.04882)\t\n",
      "5\t-242.46828427678247\t(nuB=0.16242,\tnuF=0.87246,\ttB=0.0706,\ttF=0.04882)\t\n",
      "5\t-237.131420263966\t(nuB=0.16242,\tnuF=0.87158,\ttB=0.0716,\ttF=0.04882)\t\n",
      "5\t-245.84940507571082\t(nuB=0.16242,\tnuF=0.87158,\ttB=0.0706,\ttF=0.04982)\t\n",
      "5\t-242.4553466288162\t(nuB=0.16242,\tnuF=0.87158,\ttB=0.0706,\ttF=0.04882)\t\n",
      "5\t-849.9260266211422\t(nuB=0.17252,\tnuF=0.00741,\ttB=0.16276,\ttF=0.04061)\t\n",
      "6\t-849.2776672618193\t(nuB=0.17269,\tnuF=0.00741,\ttB=0.16276,\ttF=0.04061)\t\n",
      "6\t-846.4685457986507\t(nuB=0.17252,\tnuF=0.00742,\ttB=0.16276,\ttF=0.04061)\t\n",
      "6\t-852.8841465010028\t(nuB=0.17252,\tnuF=0.00741,\ttB=0.16376,\ttF=0.04061)\t\n",
      "6\t-955.7029968414645\t(nuB=0.17252,\tnuF=0.00741,\ttB=0.16276,\ttF=0.04161)\t\n",
      "6\t-1731.7161330179079\t(nuB=0.16673,\tnuF=0.1099,\ttB=0.11063,\ttF=0.04525)\t\n",
      "6\t-1732.431188131528\t(nuB=0.1669,\tnuF=0.1099,\ttB=0.11063,\ttF=0.04525)\t\n",
      "6\t-1729.9681148630007\t(nuB=0.16673,\tnuF=0.11001,\ttB=0.11063,\ttF=0.04525)\t\n",
      "6\t-1724.8153645753027\t(nuB=0.16673,\tnuF=0.1099,\ttB=0.11163,\ttF=0.04525)\t\n",
      "6\t-1723.9681017511793\t(nuB=0.16673,\tnuF=0.1099,\ttB=0.11063,\ttF=0.04625)\t\n",
      "6\t-230.92539983512233\t(nuB=0.16272,\tnuF=0.75115,\ttB=0.07347,\ttF=0.04856)\t\n",
      "6\t-231.48524963203545\t(nuB=0.16289,\tnuF=0.75115,\ttB=0.07347,\ttF=0.04856)\t\n",
      "6\t-230.87056130773271\t(nuB=0.16272,\tnuF=0.7519,\ttB=0.07347,\ttF=0.04856)\t\n",
      "6\t-226.07283952528815\t(nuB=0.16272,\tnuF=0.75115,\ttB=0.07447,\ttF=0.04856)\t\n",
      "6\t-232.83546042017224\t(nuB=0.16272,\tnuF=0.75115,\ttB=0.07347,\ttF=0.04956)\t\n",
      "6\t-230.92539983512233\t(nuB=0.16272,\tnuF=0.75115,\ttB=0.07347,\ttF=0.04856)\t\n",
      "6\t-210.08158112267483\t(nuB=0.16579,\tnuF=0.79116,\ttB=0.07937,\ttF=0.04739)\t\n",
      "7\t-210.59603007703117\t(nuB=0.16595,\tnuF=0.79116,\ttB=0.07937,\ttF=0.04739)\t\n",
      "7\t-210.05043151189784\t(nuB=0.16579,\tnuF=0.79195,\ttB=0.07937,\ttF=0.04739)\t\n",
      "7\t-206.27686704364987\t(nuB=0.16579,\tnuF=0.79116,\ttB=0.08037,\ttF=0.04739)\t\n",
      "7\t-212.69323070423343\t(nuB=0.16579,\tnuF=0.79116,\ttB=0.07937,\ttF=0.04839)\t\n",
      "7\t-210.08158112267483\t(nuB=0.16579,\tnuF=0.79116,\ttB=0.07937,\ttF=0.04739)\t\n",
      "7\t-173.07147274888212\t(nuB=0.15968,\tnuF=0.82389,\ttB=0.08402,\ttF=0.04592)\t\n",
      "8\t-173.4681791021676\t(nuB=0.15984,\tnuF=0.82389,\ttB=0.08402,\ttF=0.04592)\t\n",
      "8\t-173.05584356345025\t(nuB=0.15968,\tnuF=0.82472,\ttB=0.08402,\ttF=0.04592)\t\n",
      "8\t-170.66596035020484\t(nuB=0.15968,\tnuF=0.82389,\ttB=0.08502,\ttF=0.04592)\t\n",
      "8\t-176.30081028602854\t(nuB=0.15968,\tnuF=0.82389,\ttB=0.08402,\ttF=0.04692)\t\n",
      "8\t-173.07147274888212\t(nuB=0.15968,\tnuF=0.82389,\ttB=0.08402,\ttF=0.04592)\t\n",
      "8\t-124.25422338563294\t(nuB=0.13911,\tnuF=0.88703,\ttB=0.08808,\ttF=0.04309)\t\n",
      "9\t-124.34724184981405\t(nuB=0.13925,\tnuF=0.88703,\ttB=0.08808,\ttF=0.04309)\t\n",
      "9\t-124.28228619122456\t(nuB=0.13911,\tnuF=0.88791,\ttB=0.08808,\ttF=0.04309)\t\n",
      "9\t-124.65530837964252\t(nuB=0.13911,\tnuF=0.88703,\ttB=0.08908,\ttF=0.04309)\t\n",
      "9\t-128.85183561376198\t(nuB=0.13911,\tnuF=0.88703,\ttB=0.08808,\ttF=0.04409)\t\n",
      "9\t-124.25422338563294\t(nuB=0.13911,\tnuF=0.88703,\ttB=0.08808,\ttF=0.04309)\t\n",
      "9\t-114.00497797647313\t(nuB=0.12686,\tnuF=0.87165,\ttB=0.08703,\ttF=0.04152)\t\n",
      "10\t-113.96418632333916\t(nuB=0.12698,\tnuF=0.87165,\ttB=0.08703,\ttF=0.04152)\t\n",
      "10\t-114.03426402751302\t(nuB=0.12686,\tnuF=0.87253,\ttB=0.08703,\ttF=0.04152)\t\n",
      "10\t-115.40987533097086\t(nuB=0.12686,\tnuF=0.87165,\ttB=0.08803,\ttF=0.04152)\t\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "10\t-118.40409649196499\t(nuB=0.12686,\tnuF=0.87165,\ttB=0.08703,\ttF=0.04252)\t\n",
      "10\t-114.00497797647313\t(nuB=0.12686,\tnuF=0.87165,\ttB=0.08703,\ttF=0.04152)\t\n",
      "10\t-108.29309589840341\t(nuB=0.11882,\tnuF=0.84337,\ttB=0.08328,\ttF=0.04044)\t\n",
      "11\t-108.22668499311476\t(nuB=0.11894,\tnuF=0.84337,\ttB=0.08328,\ttF=0.04044)\t\n",
      "11\t-108.29899987188583\t(nuB=0.11882,\tnuF=0.84422,\ttB=0.08328,\ttF=0.04044)\t\n",
      "11\t-109.71029247214392\t(nuB=0.11882,\tnuF=0.84337,\ttB=0.08428,\ttF=0.04044)\t\n",
      "11\t-111.5517429454112\t(nuB=0.11882,\tnuF=0.84337,\ttB=0.08328,\ttF=0.04144)\t\n",
      "11\t-108.29309589840341\t(nuB=0.11882,\tnuF=0.84337,\ttB=0.08328,\ttF=0.04044)\t\n",
      "11\t-101.23372990057396\t(nuB=0.10687,\tnuF=0.85301,\ttB=0.07385,\ttF=0.03882)\t\n",
      "12\t-101.17175378058346\t(nuB=0.10698,\tnuF=0.85301,\ttB=0.07385,\ttF=0.03882)\t\n",
      "12\t-101.20679765748082\t(nuB=0.10687,\tnuF=0.85387,\ttB=0.07385,\ttF=0.03882)\t\n",
      "12\t-102.3000488117641\t(nuB=0.10687,\tnuF=0.85301,\ttB=0.07485,\ttF=0.03882)\t\n",
      "12\t-102.42527089506711\t(nuB=0.10687,\tnuF=0.85301,\ttB=0.07385,\ttF=0.03982)\t\n",
      "12\t-101.23372990057396\t(nuB=0.10687,\tnuF=0.85301,\ttB=0.07385,\ttF=0.03882)\t\n",
      "12\t-97.09594400657261\t(nuB=0.09112,\tnuF=0.96023,\ttB=0.05642,\ttF=0.03684)\t\n",
      "13\t-97.11479595034325\t(nuB=0.09121,\tnuF=0.96023,\ttB=0.05642,\ttF=0.03684)\t\n",
      "13\t-97.03294525199635\t(nuB=0.09112,\tnuF=0.96119,\ttB=0.05642,\ttF=0.03684)\t\n",
      "13\t-96.64043203555502\t(nuB=0.09112,\tnuF=0.96023,\ttB=0.05742,\ttF=0.03684)\t\n",
      "13\t-94.68975908482207\t(nuB=0.09112,\tnuF=0.96023,\ttB=0.05642,\ttF=0.03784)\t\n",
      "13\t-97.09594400657261\t(nuB=0.09112,\tnuF=0.96023,\ttB=0.05642,\ttF=0.03684)\t\n",
      "13\t-92.9662935160577\t(nuB=0.09126,\tnuF=1.04488,\ttB=0.05566,\ttF=0.03697)\t\n",
      "14\t-92.97798089561093\t(nuB=0.09135,\tnuF=1.04488,\ttB=0.05566,\ttF=0.03697)\t\n",
      "14\t-92.92909058170699\t(nuB=0.09126,\tnuF=1.04592,\ttB=0.05566,\ttF=0.03697)\t\n",
      "14\t-92.77591885513448\t(nuB=0.09126,\tnuF=1.04488,\ttB=0.05666,\ttF=0.03697)\t\n",
      "14\t-91.51159527863274\t(nuB=0.09126,\tnuF=1.04488,\ttB=0.05566,\ttF=0.03797)\t\n",
      "14\t-92.9662935160577\t(nuB=0.09126,\tnuF=1.04488,\ttB=0.05566,\ttF=0.03697)\t\n",
      "14\t-91.97896425929684\t(nuB=0.08719,\tnuF=1.24621,\ttB=0.04925,\ttF=0.03697)\t\n",
      "15\t-92.04072698847267\t(nuB=0.08728,\tnuF=1.24621,\ttB=0.04925,\ttF=0.03697)\t\n",
      "15\t-91.96641253325015\t(nuB=0.08719,\tnuF=1.24746,\ttB=0.04925,\ttF=0.03697)\t\n",
      "15\t-91.03584779312769\t(nuB=0.08719,\tnuF=1.24621,\ttB=0.05025,\ttF=0.03697)\t\n",
      "15\t-91.0746554179641\t(nuB=0.08719,\tnuF=1.24621,\ttB=0.04925,\ttF=0.03797)\t\n",
      "15\t-91.97896425929684\t(nuB=0.08719,\tnuF=1.24621,\ttB=0.04925,\ttF=0.03697)\t\n",
      "15\t-90.5934716131651\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "16\t-90.5930508945039\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "16\t-90.59978194820178\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "16\t-90.85058602700246\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "16\t-90.87842508814174\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "16\t-90.5934716131651\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "16\t-90.88519195618028\t(nuB=0.08681,\tnuF=1.27616,\ttB=0.05041,\ttF=0.03686)\t\n",
      "17\t-90.89814930537159\t(nuB=0.0869,\tnuF=1.27616,\ttB=0.05041,\ttF=0.03686)\t\n",
      "17\t-90.88525736131942\t(nuB=0.08681,\tnuF=1.27743,\ttB=0.05041,\ttF=0.03686)\t\n",
      "17\t-90.8350648946489\t(nuB=0.08681,\tnuF=1.27616,\ttB=0.05141,\ttF=0.03686)\t\n",
      "17\t-90.59290629895077\t(nuB=0.08681,\tnuF=1.27616,\ttB=0.05041,\ttF=0.03786)\t\n",
      "17\t-90.61221410990584\t(nuB=0.08852,\tnuF=1.27183,\ttB=0.05195,\ttF=0.03704)\t\n",
      "17\t-90.61355478515998\t(nuB=0.08861,\tnuF=1.27183,\ttB=0.05195,\ttF=0.03704)\t\n",
      "17\t-90.61766409082156\t(nuB=0.08852,\tnuF=1.2731,\ttB=0.05195,\ttF=0.03704)\t\n",
      "17\t-90.82926840454365\t(nuB=0.08852,\tnuF=1.27183,\ttB=0.05295,\ttF=0.03704)\t\n",
      "17\t-90.81785800336911\t(nuB=0.08852,\tnuF=1.27183,\ttB=0.05195,\ttF=0.03804)\t\n",
      "17\t-90.59598751357862\t(nuB=0.08876,\tnuF=1.27124,\ttB=0.05216,\ttF=0.03706)\t\n",
      "17\t-90.59584357835502\t(nuB=0.08885,\tnuF=1.27124,\ttB=0.05216,\ttF=0.03706)\t\n",
      "17\t-90.60216179986855\t(nuB=0.08876,\tnuF=1.27251,\ttB=0.05216,\ttF=0.03706)\t\n",
      "17\t-90.84681405351421\t(nuB=0.08876,\tnuF=1.27124,\ttB=0.05316,\ttF=0.03706)\t\n",
      "17\t-90.86840432851386\t(nuB=0.08876,\tnuF=1.27124,\ttB=0.05216,\ttF=0.03806)\t\n",
      "17\t-90.59386629319579\t(nuB=0.08879,\tnuF=1.27115,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59349019995898\t(nuB=0.08888,\tnuF=1.27115,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.60015467138783\t(nuB=0.08879,\tnuF=1.27242,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.84996709771167\t(nuB=0.08879,\tnuF=1.27115,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87679660194681\t(nuB=0.08879,\tnuF=1.27115,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.59353522175843\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59312172750015\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59984200161762\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85048554668083\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87816111619213\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.59348191008394\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59306236174507\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59979166917856\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85056974206327\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87838231657679\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.59347328122931\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305275215684\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978352296366\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058338840099\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87841815830507\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.5934718834078\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.5930511954748\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978220332505\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.8505855995063\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842396539872\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.59347165695635\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305094325828\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.5997819895465\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058595773262\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842490624553\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.5934716202537\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305090239013\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978195491021\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058601581113\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.8784250586832\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.5934716143247\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089575992\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194929045\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058602519803\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508339327\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.59347161336336\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.5930508946949\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194839005\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058602671506\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508739413\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.59347161319329\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089452937\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194825635\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058602695699\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.8784250880326\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.59347161317055\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089449845\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194821724\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058602700883\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.8784250881481\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.59347161316782\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089449299\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194819905\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058602702156\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.8784250881663\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.593471613156\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089449845\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194820087\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "17\t-90.85058602701702\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508817448\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.59347161316873\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089447025\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194821542\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058602701429\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508816448\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.593471613156\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089449845\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194820087\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058602701702\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508817448\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.59347161316691\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089448208\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194820178\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.8505860270152\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508818267\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.593471613156\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089449845\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194820087\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058602701702\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508817448\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.5934716131469\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089448844\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194820542\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058602702156\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508817539\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.59347161316691\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089448208\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194820178\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.8505860270152\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508818267\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.5934716131469\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089448844\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194820542\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058602702156\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508817539\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.59347161316691\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089448208\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194820178\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.8505860270152\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508818267\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.5934716131469\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089448844\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194820542\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058602702156\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508817539\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.59347161316691\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089448208\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194820178\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.8505860270152\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508818267\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.5934716131469\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089448844\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194820542\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058602702156\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508817539\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.59347161316691\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089448208\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194820178\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.8505860270152\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508818267\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.5934716131469\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089448844\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194820542\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058602702156\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508817539\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.59347161316691\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089448208\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194820178\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.8505860270152\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508818267\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.5934716131469\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089448844\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194820542\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058602702156\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508817539\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.59347161316691\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089448208\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194820178\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.8505860270152\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508818267\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.5934716131469\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59305089448844\t(nuB=0.08889,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59978194820542\t(nuB=0.0888,\tnuF=1.2724,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.85058602702156\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0532,\ttF=0.03706)\t\n",
      "17\t-90.87842508817539\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03806)\t\n",
      "17\t-90.88519195618028\t(nuB=0.08681,\tnuF=1.27616,\ttB=0.05041,\ttF=0.03686)\t\n",
      "17\t-90.64491088524392\t(nuB=0.08817,\tnuF=1.2727,\ttB=0.05164,\ttF=0.037)\t\n",
      "17\t-90.60644072347895\t(nuB=0.0886,\tnuF=1.27164,\ttB=0.05202,\ttF=0.03704)\t\n",
      "17\t-90.59751353772663\t(nuB=0.08873,\tnuF=1.2713,\ttB=0.05214,\ttF=0.03706)\t\n",
      "17\t-90.59482530785499\t(nuB=0.08878,\tnuF=1.27119,\ttB=0.05218,\ttF=0.03706)\t\n",
      "17\t-90.59393751082735\t(nuB=0.08879,\tnuF=1.27115,\ttB=0.05219,\ttF=0.03706)\t\n",
      "17\t-90.59363348433635\t(nuB=0.0888,\tnuF=1.27114,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59352804236278\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.5934913076635\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.5934784896017\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59347401444666\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.59347245175377\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n",
      "17\t-90.5934716131651\t(nuB=0.0888,\tnuF=1.27113,\ttB=0.0522,\ttF=0.03706)\t\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "  status: 0\n",
       " success: True\n",
       " message: \n",
       "       x: [0.08680857 1.27615711 0.05040984 0.03786355]\t\n",
       "       y: -90.59290629895077\n",
       "  n_eval: 241\n",
       "  n_iter: 16"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ls_optimizer.optimize(\n",
    "    f=objective,\n",
    "    variables=variables,\n",
    "    x0=result.x,\n",
    "    verbose=1,\n",
    ")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.9"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}