docs/tutorials/integration_single_model_with_pipeline_and_hyperopt.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Integration of Single Hyperbox-based Models with Sklearn Pipeline and Hyperopt"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This example shows how to integrate the GFMM classifier into the Pipeline class implemented by scikit-learn\n",
    "\n",
    "Note that this example is illustrated by using the original online learning algorithm for GFMM model. However, it can be used for any GFMM models using other learning algorithms"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "scrolled": true
   },
   "outputs": [],
   "source": [
    "import warnings\n",
    "warnings.filterwarnings('ignore')\n",
    "from sklearn.pipeline import Pipeline\n",
    "from sklearn.preprocessing import MinMaxScaler\n",
    "from sklearn.model_selection import train_test_split\n",
    "from hbbrain.numerical_data.incremental_learner.onln_gfmm import OnlineGFMM"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Load Iris dataset and prepare training and testing sets"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sklearn.datasets import load_iris"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "df = load_iris()\n",
    "X = df.data\n",
    "y = df.target"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "X_train, X_test, y_train, y_test = train_test_split(X, y, train_size=0.8, random_state=0)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Create a pipeline of pre-processing method (i.e., normalization of data in the range of [0, 1]) and a GFMM classifier.\n",
    "**Note:** The GFMM classifier using an original online learning algorithm requires the input data in the range of [0, 1]."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "theta = 0.1\n",
    "theta_min = 0.1\n",
    "onln_gfmm_clf = OnlineGFMM(theta=theta, theta_min=theta_min)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "pipe = Pipeline([('scaler', MinMaxScaler()), ('onln_gfmm', onln_gfmm_clf)])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Training"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Pipeline(steps=[('scaler', MinMaxScaler()),\n",
       "                ('onln_gfmm',\n",
       "                 OnlineGFMM(C=array([2, 1, 0, 2, 2, 1, 0, 1, 1, 1, 2, 0, 0, 1, 2, 2, 2, 2, 1, 2, 2, 2,\n",
       "       1, 2, 1, 1, 2, 0, 1, 0, 0, 1, 0, 1, 2, 2, 0, 2, 0, 2, 1, 1, 0, 2,\n",
       "       2, 0, 0, 2, 2, 1, 1, 0, 1, 0, 2, 1]),\n",
       "                            V=array([[0.58333333, 0.41666667, 0.68965517, 0.70833333],\n",
       "       [0.30555556, 0.41666667, 0.5862069 , 0.58333333],\n",
       "       [0.19444444, 0.625     , 0.05172414, 0.04166667],\n",
       "       [0.44444444, 0.416666...\n",
       "       [0.86111111, 0.33333333, 0.86206897, 0.75      ],\n",
       "       [0.38888889, 0.25      , 0.44827586, 0.375     ],\n",
       "       [0.66666667, 0.41666667, 0.67241379, 0.66666667],\n",
       "       [0.19444444, 0.41666667, 0.0862069 , 0.04166667],\n",
       "       [0.44444444, 0.5       , 0.63793103, 0.70833333],\n",
       "       [0.33333333, 0.625     , 0.03448276, 0.04166667],\n",
       "       [0.55555556, 0.375     , 0.77586207, 0.70833333],\n",
       "       [0.41666667, 0.29166667, 0.51724138, 0.375     ]]),\n",
       "                            theta=0.1, theta_min=0.1))])"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "pipe.fit(X_train, y_train)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Testing"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      ">>> The testing sample 26 with the coordinate [ 0.08333333  0.66666667 -0.01724138  0.04166667] is outside the range [0, 1]. Membership value = 0.916667. The prediction is more likely incorrect.\n",
      "Testing accuracy =  96.67%\n"
     ]
    }
   ],
   "source": [
    "acc = pipe.score(X_test, y_test)\n",
    "print(f'Testing accuracy = {acc * 100: .2f}%')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## The example below shows how to use the HyperOpt library in combination with PipleLine and Cross-validation to find the best model"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "from hyperopt import fmin, hp, tpe, Trials, space_eval, STATUS_OK\n",
    "from hyperopt.pyll import scope as ho_scope\n",
    "from hyperopt.pyll.stochastic import sample as ho_sample"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Define search space"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'gamma': 4.542173063848446, 'theta': 0.8064001273117817}"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "hp_space_gfmm = {\n",
    "    'theta': hp.uniform('theta', 0, 1), \n",
    "    'gamma': hp.uniform('gamma', 0, 10)\n",
    "}\n",
    "\n",
    "# Draw random sample to see if hyperspace is correctly defined\n",
    "ho_sample(hp_space_gfmm)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Defining model"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "def init_model(hps):\n",
    "    \"\"\"\n",
    "    Constructs estimator\n",
    "    \n",
    "    Parameters:\n",
    "    ----------------\n",
    "    hps : sample point from search space\n",
    "    \n",
    "    Returns:\n",
    "    ----------------\n",
    "    model : sklearn.Pipeline.pipeline with hyperparameters set up as per hps\n",
    "    \"\"\"\n",
    "    \n",
    "    # Assembing pipeline\n",
    "    model = Pipeline([\n",
    "        ('scale', MinMaxScaler()), \n",
    "        ('clf', OnlineGFMM(**hps))\n",
    "    ])\n",
    "    \n",
    "    return model"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sklearn.model_selection import cross_val_score, StratifiedKFold\n",
    "from sklearn.metrics import accuracy_score"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Define target function"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Now we have to define function to minimize. We'll stick with cross-validation score on train set. Our function should take a sample from search space and return negative mean Acc score. As noted above, it is very important to return negative score here, since otherwise we'll seek for hyperparameters that minimize Acc**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [],
   "source": [
    "def f_to_min1(hps, X, y, ncv=5):\n",
    "    \"\"\"\n",
    "    Target function for optimization\n",
    "    \n",
    "    Parameters:\n",
    "    ----------------\n",
    "    hps : sample point from search space\n",
    "    X : feature matrix\n",
    "    y : target array\n",
    "    ncv : number of folds for cross-validation\n",
    "    \n",
    "    Returns:\n",
    "    ----------------\n",
    "    : target function value (negative mean cross-val Acc score)\n",
    "    \"\"\"\n",
    "    \n",
    "    model = init_model(hps)\n",
    "    cv_res = cross_val_score(model, X, y, cv=StratifiedKFold(ncv, shuffle=True, random_state=0), \n",
    "                             scoring='accuracy', n_jobs=1)\n",
    "    \n",
    "    return -cv_res.mean()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Running optimization"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "from functools import partial\n",
    "import numpy as np"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**All right, let's run optimization for 100 rounds using TPE algorithm, meaning that we use TPE to suggest next sample values based on previous function evaluations. We'll use Trials class objects to keep track of optimization history. Note: We're binding X and y arguments of target function to X_train and y_train respectively, using functools.partial, since target function of fmin may accept only a search space point.**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.888627. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.945905. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.842222. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.800702. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.701052. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.837797. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.921216. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.899729. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.709743. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.564614. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.414332. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.799199. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.414332. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.260208. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.814764. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.910028. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.885491. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.668525. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.502788. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.227886. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.663078. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.227886. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.024698. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.633662. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.822064. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.773537. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.344448. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.016672. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.417466. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.717055. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.174743. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.971811. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.987699. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.957717. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.946590. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.946590. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.917323. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.971654. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.917323. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.895566. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.843349. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.586375. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.793187. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.379562. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.310625. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.216289. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.595076. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.823306. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.595076. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.232775. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.232775. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.536979. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.797955. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.536979. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.415131. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.122697. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.225142. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.734335. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.225142. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.527092. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.770302. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.707657. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.153744. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.207652. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.728338. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.207652. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.484989. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.823425. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.484989. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.024189. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.024189. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.673487. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.836743. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.510230. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.381343. The prediction is more likely incorrect.\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.381343. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.738973. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.886097. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.738973. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.505423. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.505423. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.505573. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.759850. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.694354. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.115235. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.585234. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.857794. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.585234. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.476084. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.214127. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.650744. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.825372. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.476116. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.338252. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.338252. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.679227. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.839613. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.518840. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.392219. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.392219. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.666495. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.833248. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.499743. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.368097. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.368097. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.847477. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.923738. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.847477. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.711009. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.711009. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.869514. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.934757. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.869514. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.752763. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.752763. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.977404. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.990140. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.977404. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.957186. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.957186. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.792677. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.896339. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.792677. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.607178. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.607178. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.876281. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.946013. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.876281. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.765584. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.765584. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.849137. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.934169. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.849137. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.748562. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.714154. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.912143. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.961663. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.912143. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.833535. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.833535. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.810589. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.905295. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.715884. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.684315. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.641116. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.939373. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.969686. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.909059. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.885127. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.885127. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.937304. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.968652. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.905956. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.881207. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.881207. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.719306. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.877516. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.719306. The prediction is more likely incorrect.\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.532177. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.468160. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.398965. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.737730. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.398965. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.389053. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.733405. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.389053. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.448095. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.759169. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.448095. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.457615. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.763323. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.186423. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.551708. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.782258. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.364920. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.197794. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.659884. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.834801. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.789746. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.391371. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.087057. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.627892. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.837625. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.627892. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.379819. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.294953. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.649130. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.824565. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.473694. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.335193. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.335193. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.277219. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.684605. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.708327. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.899998. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.708327. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.631571. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.447357. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.683243. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.846147. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.551261. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.433172. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.149758. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.760300. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.917817. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.760300. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.697221. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.545832. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.690040. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.845020. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.535061. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.412708. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.412708. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.805245. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.902623. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.707868. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.630991. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.630991. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.620962. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.870044. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.620962. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.521215. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.281822. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.906224. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.959079. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.906224. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.822319. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.822319. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.864965. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.941076. The prediction is more likely incorrect.\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.864965. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.744145. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.744145. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.251775. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.625888. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.172844. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.586422. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.532322. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.772842. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.566335. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.163103. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.415407. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.744905. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.123111. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.025679. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.431079. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.751744. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.146619. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.051799. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.496359. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.780230. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.496359. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.045733. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.045733. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.518529. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.766143. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.702363. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.138421. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.999140. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.999625. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.999140. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.998913. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.998370. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.559096. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.807605. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.559096. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.164603. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.164603. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.379206. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.729108. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.068810. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.377855. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.728518. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.066782. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.224555. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.612278. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.959355. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.980258. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.942419. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.927266. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.890899. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.516105. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.834093. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.516105. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.388765. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.083147. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.356339. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.719130. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.356339. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.753394. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.876697. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.753394. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.532747. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.532747. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.957302. The prediction is more likely incorrect.\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.978651. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.935953. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.919098. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.919098. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.973522. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.986761. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.960283. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.949831. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.949831. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.997910. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.999088. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.997910. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.996040. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.996040. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.821118. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.910559. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.731677. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.661065. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.661065. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.886690. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.943345. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.886690. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.785307. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.785307. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.194951. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.597475. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.459018. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.763935. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.188527. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.933546. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.971002. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.933546. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.874086. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.874086. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.726992. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.863496. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.726992. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.482722. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.482722. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.604519. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.827427. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.604519. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.250668. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.250668. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.716278. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.858139. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.574417. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.462421. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.462421. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.795196. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.897598. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.692794. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.611951. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.611951. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.656288. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.828144. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.484432. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.348757. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.348757. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.825042. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.923655. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.825042. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.668500. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.668500. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.771271. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.921579. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.771271. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.711079. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.566619. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.696148. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.867410. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.696148. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.493580. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.424281. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.566989. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.811050. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.566989. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.453039. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.179558. The prediction is more likely incorrect.\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.658673. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.829336. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.488009. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.353275. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.353275. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.854032. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.927016. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.854032. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.723428. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.723428. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.775829. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.902180. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.775829. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.575256. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.575256. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.898866. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.955869. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.898866. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.808378. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.808378. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.687186. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.863499. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.687186. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.407299. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.407299. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.636231. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.841264. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.636231. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.310753. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.310753. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.607021. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.865264. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.607021. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.503605. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.255408. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.814544. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.909921. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.885354. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.668131. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.502196. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.683919. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.841960. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.525879. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.401110. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.401110. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.284114. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.687613. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.284114. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.809766. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.934777. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.809766. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.759704. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.639556. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.888344. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.951277. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.832516. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.813907. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.788442. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.394295. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.735692. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.394295. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.000000. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.840977. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.930608. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.840977. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.734961. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.698693. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.478630. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.739315. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.478630. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.012141. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.012141. The prediction is more likely incorrect.\n",
      ">>> The testing sample 19 with the coordinate [1.05882353 0.75       0.9137931  0.79166667] is outside the range [0, 1]. Membership value = 0.540064. The prediction is more likely incorrect.\n",
      ">>> The testing sample 11 with the coordinate [-0.02857143  0.41666667 -0.01818182  0.        ] is outside the range [0, 1]. Membership value = 0.770032. The prediction is more likely incorrect.\n",
      ">>> The testing sample 21 with the coordinate [0.94285714 0.25       1.03636364 0.91666667] is outside the range [0, 1]. Membership value = 0.540064. The prediction is more likely incorrect.\n",
      ">>> The testing sample 6 with the coordinate [ 0.19444444 -0.10526316  0.4137931   0.375     ] is outside the range [0, 1]. Membership value = 0.128542. The prediction is more likely incorrect.\n",
      ">>> The testing sample 12 with the coordinate [0.38888889 1.15789474 0.06896552 0.125     ] is outside the range [0, 1]. Membership value = 0.128542. The prediction is more likely incorrect.\n",
      "100%|█████████████████████████████████████████████| 100/100 [00:16<00:00,  6.08trial/s, best loss: -0.9666666666666666]\n"
     ]
    }
   ],
   "source": [
    "trials_clf = Trials()\n",
    "best_clf = fmin(partial(f_to_min1, X=X_train, y=y_train), \n",
    "                 hp_space_gfmm, algo=tpe.suggest, max_evals=100, \n",
    "                 trials=trials_clf, rstate = np.random.default_rng(0))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Model performance on test set"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      ">>> The testing sample 26 with the coordinate [ 0.08333333  0.66666667 -0.01724138  0.04166667] is outside the range [0, 1]. Membership value = 0.478630. The prediction is more likely incorrect.\n",
      "Cross-val score: 0.96667; testing score: 0.96667\n",
      "Best parameters:\n",
      "{'gamma': 6.256443392850102, 'theta': 0.09273471494941352}\n"
     ]
    }
   ],
   "source": [
    "# Building and fitting classifier with best parameters\n",
    "clf = init_model(space_eval(hp_space_gfmm, best_clf)).fit(X_train, y_train)\n",
    "\n",
    "# Calculating performance on validation set\n",
    "clf_val_score = accuracy_score(y_test, clf.predict(X_test))\n",
    "print('Cross-val score: {0:.5f}; testing score: {1:.5f}'.\\\n",
    "      format(-trials_clf.best_trial['result']['loss'], clf_val_score))\n",
    "print('Best parameters:')\n",
    "print(space_eval(hp_space_gfmm, best_clf))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [],
   "source": [
    "def f_wrap_space_eval(hp_space, trial):\n",
    "    \"\"\"\n",
    "    Utility function for more consise optimization history extraction\n",
    "    \n",
    "    Parameters:\n",
    "    ----------------\n",
    "    hp_space : hyperspace from which points are sampled\n",
    "    trial : hyperopt.Trials object\n",
    "    \n",
    "    Returns:\n",
    "    ----------------\n",
    "    : dict(\n",
    "        k: v\n",
    "    ), where k - label of hyperparameter, v - value of hyperparameter in trial\n",
    "    \"\"\"\n",
    "    \n",
    "    return space_eval(hp_space, {k: v[0] for (k, v) in trial['misc']['vals'].items() if len(v) > 0})\n",
    "\n",
    "\n",
    "def f_unpack_dict(dct):\n",
    "    \"\"\"\n",
    "    Unpacks all sub-dictionaries in given dictionary recursively. There should be no duplicated keys \n",
    "    across all nested subdictionaries, or some instances will be lost without warning\n",
    "    \n",
    "    Parameters:\n",
    "    ----------------\n",
    "    dct : dictionary to unpack\n",
    "    \n",
    "    Returns:\n",
    "    ----------------\n",
    "    : unpacked dictionary\n",
    "    \"\"\"\n",
    "    \n",
    "    res = {}\n",
    "    for (k, v) in dct.items():\n",
    "        if isinstance(v, dict):\n",
    "            res = {**res, **f_unpack_dict(v)}\n",
    "        else:\n",
    "            res[k] = v\n",
    "            \n",
    "    return res"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [],
   "source": [
    "import matplotlib.pyplot as plt\n",
    "import matplotlib.gridspec as gridspec\n",
    "from matplotlib.animation import FuncAnimation\n",
    "import seaborn as sns"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Visualize the search history"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAt0AAAJiCAYAAAAbq35SAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4xLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvDW2N/gAAIABJREFUeJzs3XmcZHV97//Xm8FRZEAg6ATZBn7igsQlMxKHGNMjJoLxhsS44L1R45LRG9dENC6J2a7BG72JJJggEVwSZNyjIW5cQl/DZURmlEVkJnIRZGRTQaDRMDJ8fn/UGVI03TPVPXWquqtez8ejH1Xne751zudbn6rqT5/+1jmpKiRJkiS1Z7dhByBJkiSNOotuSZIkqWUW3ZIkSVLLLLolSZKklll0S5IkSS2z6JYkSZJaZtEtSS1IMpGkkuy/i9v5YJJz+hXXLPtY0cS6quX9/FaSqV3tI0mLkUW3pLGU5MAkpyfZkmRrku8m+fskB81jW9ckOWla84XAAcAPdjHU1wG/uYvbuFeSySSnTmu+jk6sl/RrP7vgo8DhvXQc1B8LktQPFt2Sxk6Sw4ANwFHAi4FH0ClsHwtcnGTFru6jqrZW1Y21i1cgq6rbquqHuxrPTvaxrYn17jb302MsP66qmwe93yQPGPQ+JY0Xi25J4+i9wD3A06vqvKr6TlWdDzy9aX/v9o7NkeHTkpyS5Nbm511Jdtu+HjgUeFdz1LWa9vtML9k+bSLJ8Uk2JflRks8meUiS5yT5VpLbkvxDkj269n/v9JKubU7/mWzW/1SSs5uj9z9OckWSl3RvC/hF4FVdj10x0xHjJE9NclGS/0hyU5K/SrJ02vPyt0n+PMn3k9yc5N3bn5cdSXJskm8kuTPJ+c0fQdvX3Wd6SZKDk3wmyS3Nc7YpyYnN6m83txdPex52S/KHSa5LcleSy5Oc0LXN7eN9QZJ/TfJj4HeS3J7kOdNi/aUkP0myfGfjkqQdseiWNFaS7AccB7y3qn7Uva5Z/lvg+CT7dq36b3Q+L1cDrwDWAq9v1j0b2AL8KZ0pGgfsYPcPBN7QbO9YYBXwCTpH238D+DXgWcDvzPL47VNWtv+sAn4ITDbrHwR8rdnGY4FTgPclObZZ/zpgPfCBrm1cN30nSQ4EPg98HXgi8DLgBcDJ07r+N+Bu4Bjg1XSek+fvYPzbn4O3AC+l83zuA5y2g/5/CzwYWNOM6fXNmAGObm6Pa8by7K5xvhH4feBngE8Dn0ryhGnbPrnZ/pHAJ4Gzm7i6vRQ4p6pu2sm4JGmHdh92AJI0YEcAAa6cZf03m/VHAF9t2m4AXttMFdmU5JHA7wF/WVW3JNkG3FFVN+5k37sDr6qqzQBJPgL8LrC8qr7ftH2GToH5v6Y/uKq2Ajc2/fYAzgHOB/6kWf9d4F1dDzk9ydPoFMznVdVtSbYCP+qONcn0Xf1OM+bfqap7gCuTvJlOAf+HXX+sfLOq3t7c//ckv03nj4mz5/AcvBv4QJLdmn1Ndyjwyaq6tFn+dte67zW3P5j23J8EvLuqPtIsvz3JU5v27vnxf1NVn+h6Hv4e+EqSA6vqu80fXr8GPHcH45GknnikW9K4mm2udWZY/5Vpc7PXAwcm2XuO+7xre7HZuAm4cXvB3dX2sB1tJJ0q+YPAEuCF22NLsiTJ25JcluQHzTSNZwOHzDHOxwDrpxXBFwBL6cx/3+6yaY+7fmexc//n4HrgAXSOeM/kFOAPkqxP8j+SrNzRxpucPBz4v9NWXUDniHa3Dd0LVbUBuJzOfx4A/itwK52j/pK0Syy6JY2bb9EpqB87y/rHNOv/Xwv7nv5FxQJ+MkPbzj6b3w48FfgvVXVnV/tJdKavvIvOEecnAP9Ep1ieizD7HyXd7fOJfabngNkeV1VnAIfRmRLzSODCJH+8k31Mj3O2tjtn6PN+YPs8+JcCH6yqbT3sT5J2yKJb0lipqluAL9L54tyDu9c1y68CPt/02+7nct85GE8Grq+q25vlrXSOOreu+aLfm4ATqmrLtNVPAf65qv6hqi6h84fDI6f16SXWbwKrp30p8inNY9v4Y2SHqmpLVZ1eVc+j8wfH2mbV1uZ2SVff2+kcPX/KtM08hc64duYf6fwX49XAz9Ip9iVpl1l0SxpHr6Yzt/h/J3lac4aMCeBcOkd5Xz2t/8OB9yR5VFP0vhH4q6711wC/kM65v3fpYjg7kuQo4EPAW4HvJPnp5me/psu/A8cmeUqSRwOn0jlK3O0a4OjmDB77z3K2kb+lM+a/TfKYJL8CvBM4dfqXT9uWzlljjktyePNFyOP4z+L5ZuDHwDOSLE/ykKb9XcBJzdlJHpnkT4FfYIZ58tNV1W3Ax5u+X66qb/V7TJLGk0W3pLFTVf+Pzpk/rgD+Abga+AidL1c+qaq+Pe0hZ9E5mnoR8PfAGdy36H47cDCdo8Dfoz2r6JzJ4z10vui4/edTzfr/QefLn58Hvkxn+sRZ07bxbjpHiL/ZxHq/+d7NFzKPp3PmkkuAM+l8OfKtfR1Nb3YD/oZOvOfSmfP+4ibOu4HXAi+nc3T7M81j/ppO4f0XwDeAXwd+ozn634sz6EzJOaM/Q5AkyC5et0GSRlpz7udvVNX0o98aUUmeD7wPePigj+xLGl2eMlCSJO6d07+CzhH9v7fgltRPTi+RJKnjTcClwC3Anw05FkkjxuklkiRJUss80i1JkiS1zKJbkiRJatnIfpFy//33rxUrVrS2/TvvvJM999yzte1r4TDX48Ncjw9zPT7M9fgYVq43btz4/ap66M76jWzRvWLFCjZs2NDa9icnJ5mYmGht+1o4zPX4MNfjw1yPD3M9PoaV6yTX9tLP6SWSJElSyyy6JUmSpJZZdEuSJGlxWL8eTj65c7vIjOycbkmSJI2Q9evh2GNh61ZYuhTOOw9Wrx52VD3zSLckSZIWvsnJTsG9bVvndnJy2BHNiUW3JEmSFr6Jic4R7iVLOreL7Kw0Ti+RJEnSwrd6dWdKyeRkp+BeRFNLwKJbkiRJi8Xq1Yuu2N7O6SWSJElSyyy6JUmSpJZZdEuSJEkts+iWJEmSWmbRLUmSJLXMoluSJElqmUW3JEmS1DKLbkmSJKllFt2SJElSyyy6JUmSpJZZdEuSJEkts+iWJEmSWjawojvJcUk2J7kqyZtnWL9vkk8nuSzJV5Mc1bVunySfSLIpyZVJVg8qbkmSJGlXDaToTrIEeC9wPHAk8IIkR07r9lbgkqp6HPAi4JSudacAX6iqRwOPB65sP2pJkiSpPwZ1pPto4KqqurqqtgLrgBOm9TkSOA+gqjYBK5IsT7I38FTgjGbd1qr64YDiliRJknbZoIruA4Hrupa3NG3dLgWeDZDkaOBQ4CDgcOB7wAeSfD3J+5Ps2X7IkiRJUn+kqtrfSfJc4BlV9fJm+YXA0VX1mq4+e9OZRvJE4HLg0cDLgQcAXwF+vqouSnIKcHtV/eEM+1kLrAVYvnz5ynXr1rU2pqmpKZYtW9ba9rVwmOvxYa7Hh7keH+Z6fAwr12vWrNlYVat21m/3QQRD58j2wV3LBwHXd3eoqtuBlwAkCfDt5ufBwJaquqjp+gngfl/EbLZxOnA6wKpVq2piYqJ/I5hmcnKSNrevhcNcjw9zPT7M9fgw1+Njoed6UNNLLgaOSHJYkqXAicBnuzs0ZyhZ2iy+HPhyVd1eVTcC1yV5VLPuWOCbA4pbkiRJ2mUDKbqr6m7g1cAX6Zx55GNVdUWSVyZ5ZdPtMcAVSTbROcvJ67o28RrgrCSXAU8A/nwQcY+E9evh5JM7t+Oin2Nev55Dzjrr/tuabR/9au/3ONo2n/H1YzvDfI4W4r4XU0yjPIZh7rtf77l+b6vt/jt4Pmb8DB+Ehfgan6t+xTqIMQ8z172qqpH8WblyZbXp/PPPb3X7fXHhhVV77FG1ZEnn9sILhx1R+/o55mZb9+y22323Nds++tXe73G0bT7j68d2WniOen5fDzM/A3w+WotpAYzhfrkeZqzDev76+Rk0zP47eT7u9xk+CAvgNb7L+hXrIMY8zFxXFbCheqhNvSLlKJuchK1bYdu2zu3k5LAjal8/x9xsK/fcc99tzbaPfrX3exxtm8/4+rGdYT5HC3HfiymmUR7DMPfdr/dcv7fVdv+dPB/3+wwfhIX4Gp+rfsU6iDEPM9dzYNE9yiYmYOlSWLKkc7uAv1zQN/0cc7Ote3bb7b7bmm0f/Wrv9zjaNp/x9WM7w3yOFuK+F1NMozyGYe67X++5fm+r7f47eT7u9xk+CAvxNT5X/Yp1EGMeZq7nYCCnDByGVatW1YYNG1rb/uTkwv6G7L3Wr+/8xTcxAatXDzuawejnmNev5+ozz+Twl770vtuabR/9au/3ONo2n/H1Yzt9fo7m9L4eZn4G9Hy0GtOQxzBjrocZ67Cev35+Bg2z/w6ejxk/wwdhIb5P56pfsQ5izEPMdZKeThlo0T1Pi6bo1i4z1+PDXI8Pcz0+zPX4GFauey26dxtEMJIkSdI4s+iWJEmSWmbRLUmSJLXMoluSJElqmUW3JEmS1DKLbkmSJKllFt2SJElSyyy6JUmSpJb1VHQneW2S/dsORpIkSRpFvR7pfjpwTZJzkjw/yQPbDEqSJEkaJT0V3VX1q8ChwOeB1wM3Jnl/kqe2GZwkSZI0Cnqe011VP6iq91bVauAXgScB5ye5JsnbkixrLUpJkiRpEZvTFymTHJvkA8AkcBPwIuCFwBPpHAWXJEmSNM3uvXRK8m7gROA24MPAH1TVd7vWfwW4tZUIJUmSpEWup6IbeBDw61V18Uwrq+onSVb1LyxJkiRpdPRadJ8M/Ki7Icm+wB5VdT1AVW3qc2ySJEnSSOh1Tvc/AQdNazsI+HR/w5EkSZJGT69F96Oq6vLuhmb50b3uKMlxSTYnuSrJm2dYv2+STye5LMlXkxzVte6aJJcnuSTJhl73KUmSJC0EvRbdNyd5RHdDs/yDXh6cZAnwXuB44EjgBUmOnNbtrcAlVfU4OmdFOWXa+jVV9YSqcu64JEmSFpVei+4zgU8meVaSI5P8F+ATwPt7fPzRwFVVdXVVbQXWASdM63MkcB7cOz98RZLlPW5/YVi/Hk4+uXPbS/tct9PPfQzCXGPtV3s/Y12IFtPzOpthPt87GPchZ53V3vMxn/f1QrTQYp3n5+WMuR5ETMMyzM/LtvvPxyDe1wstpn5+BrX9+2Mhvof6oap2+kOnOH8jsAm4s7k9Cditx8c/B3h/1/ILgVOn9flz4C+b+0cDdwMrm+VvA18DNgJre9nnypUrq03nn3/+fRsuvLBqjz2qlizp3F544Y7bZ7Oj/v3axyDMNdZ+tfcz1sb9cj1Mi+l5nesYBmEn475nt93aeT7m875eiBZarLvweXm/XA8ipmEZ4OflwPv3oOff13M1zOd1rtvp52dQ278/dmE7w/p9DWyoHmrTns5eUlX3AO9qfuYjM2122vI7gVOSXAJcDnydTuEN8PNVdX2ShwHnJtlUVV++306StcBagOXLlzM5OTnPcHduamrqPts/5KyzOOyuu8g993DPXXdxzZln8p277pq1fTY76t+vfQzCXGPtV3s/Y91ueq6HaTE9r3MdwyAM6/mYz/t6IVposS7Ez8uF9hz1O6Z+/k5rO9btev19PVfDfF7nup1+fgYN8/NyZxbS7+sZ9VKZd4p4lgI/A6wBnrb9p8fHrga+2LX8FuAtO+gf4Bpg7xnW/TFw0s726ZHuIVtMR2Q90u2R7qZ9m0e6d2yhxboLn5f3y/UgYhoWj3S3sw+PdHuku0GPR7rT6btjSZ4CfBx4ILA3cDuwF3BdVR3ew+N3B/4dOBb4LnAx8F+r6oquPvsAP6qqrUl+G/iFqnpRkj3pTGO5o7l/LvCnVfWFHe1z1apVtWFDeyc6mZycZGJi4r6N69fD5CRMTMDq1Ttvn82O+vdrH4Mw11j71d7PWJkl18O0mJ7XuY5hEHYw7qvPPJPDX/rSdp6P+byvF6KFFus8Py9nzPUgYhqWAX1eDqX/Tszp9/VcDfN5net2+vkZ1Pbvj3luZ1i/r5NsrB5O9NFr0X0x8JGq+qskt1bVvkneTqdIfnePAT0TeA+wBDizqt6R5JUAVXVaktV0LjG/Dfgm8LKqujXJ4fzn+cB3b+J4x872N5SiWyPJXI8Pcz0+zPX4MNfjY6EX3b1ekfKR3P8Ufu+k8wXHnoruqvoc8Llpbad13V8PHDHD464GHt9jnJIkSdKC0+spA2+jM60E4IbmHNv7AstaiUqSJEkaIb0W3Z8CntncPwM4n87p+z7eRlCSJEnSKOn1lIGv77r/v5JcROeLlF9sKzBJkiRpVOy06G4u4f7vwJFVdRdAVV3QdmCSJEnSqNjp9JKq2kbnjCIPaj8cSZIkafT0evaS9wAfS/LnwBa6ribZnF1EkiRJ0ix6LbpPbW5/aVp70TnvtiRJkqRZ9PpFyl7PciJJkiRpGotpSZIkqWU9HelO8m90zePuVlVP7WtEkiRJ0ojpdU73+6ct/zTwMuAf+xuOJEmSNHp6ndP9oeltST4JfAD4034HJUmSJI2SXZnT/V3gcf0KRJIkSRpVvc7pfum0pgcDzwa+0veIJEmSpBHT65zuF05bvhO4EPir/oYjSZIkjZ5e53SvaTsQSZIkaVT1NKc7yYuSPG5a2+OTTD8CLkmSJGmaXr9I+WfAddPargP+R3/DkSRJkkZPr0X33sDt09puA/bpbzgamPXr4eSTO7e9tI+KUR+fRkvbr9fF9DmwEGPS6FmI74lRfu2P8thm0OsXKb8J/Abwsa62Xweu7HtEat/69XDssbB1KyxdCuedB6tXz94+KkZ9fBotbb9eF9PnwEKMSaNnIb4nRvm1P8pjm0WvR7p/H3h/kk8m+YsknwLOAN7Q646SHJdkc5Krkrx5hvX7Jvl0ksuSfDXJUdPWL0ny9STn9LpPzWJysvMi37atczs5ueP2UTHq49Noafv1upg+BxZiTBo9C/E9Mcqv/VEe2yx6Krqr6gLgscDFwJ7AV4Gjqur/9vL4JEuA9wLHA0cCL0hy5LRubwUuqarHAS8CTpm2/nV4ZL0/JiY6f1UuWdK5nZjYcfuoGPXxabS0/XpdTJ8DCzEmjZ6F+J4Y5df+KI9tFr1eHOeBwI1V9c6utgckeWBV3dXDJo4Grqqqq5vHrgNOoDNtZbsjgZMBqmpTkhVJllfVTUkOAn4FeAfwe73ErB1Yvbrzb5zJyc6LfPu/c2ZrHxWjPj6NlrZfr4vpc2AhxqTRsxDfE6P82h/lsc2i1znd5wJv4r5XoFwJvBOY6OHxB3Lfs59sAX5uWp9L6Vzl8oIkRwOHAgcBNwHvafa/V4/xamdWr575BT5b+6gY9fFptLT9el1MnwMLMSaNnoX4nhjl1/4oj20GvRbdPwNcNK3tq8Dje3x8ZmiracvvBE5JcglwOfB14O4kzwJurqqNSSZ2uJNkLbAWYPny5Uy2OD9oamqq1e1r4TDX48Ncjw9zPT7M9fhY6Lnutei+DVgO3NjVtpzO5eB7sQU4uGv5IOD67g5VdTvwEoAkAb7d/JwI/GqSZwIPAvZO8o9V9ZvTd1JVpwOnA6xataomWpwfNDk5SZvb18JhrseHuR4f5np8mOvxsdBz3evZSz4JfCTJUUkenORngH8APt7j4y8GjkhyWJKldArpz3Z3SLJPsw7g5cCXq+r2qnpLVR1UVSuax/3rTAW3JEmStFD1WnS/jc6ZQ74KTNGZ230l8Ae9PLiq7gZeDXyxedzHquqKJK9M8sqm22OAK5JsonOWk9f1PApJkiRpAetpeklV/QfwqiSvBvYHDqBzWr9vAQ/vcRufAz43re20rvvrgSN2so1JYLKX/UmSJEkLRa9HuknyUOC1dI5Wfx1YhUejJUmSpJ3a4ZHuJA8AfhX4LeAZwFXA2cAK4HlVdXPL8UmSJEmL3s6OdN8EvA/YDDy5qo6sqj8DerkgjiRJkiR2XnRfBuxD50I2T0qyb/shSZIkSaNlh0V3VU0A/x/wJeAk4MYk/wzsCTyg9egkSZKkEbDTL1JW1bVV9WdVdQRwLHADcA9waZK/aDtASZIkabHr+ewlAFV1QVWtBX4aeA2dy8NLkiRJ2oE5Fd3bVdV/VNXZVXV8vwOSJEmSRs28im5JkiRJvbPoliRJklpm0S1JkiS1zKJbkiRJaplFtyRJktQyi+5hWr8eTj65c7vQzRbrYhqDdo257s1CfJ4WYkzjylyoX3wtLTq7DzuAsbV+PRx7LGzdCkuXwnnnwerVw45qZrPFupjGoF1jrnuzEJ+nhRjTuDIX6hdfS4uSR7qHZXKy82bZtq1zOzk57IhmN1usi2kM2jXmujcL8XlaiDGNK3OhfvG1tChZdA/LxETnr9MlSzq3ExPDjmh2s8W6mMagXWOue7MQn6eFGNO4MhfqF19Li5LTS4Zl9erOv4MmJztvloX8b6HZYl1MY9CuMde9WYjP00KMaVyZC/WLr6VFyaJ7mFavXjxvlNliXUxj0K4x171ZiM/TQoxpXJkL9YuvpUXH6SWSJElSyyy6JUmSpJYNrOhOclySzUmuSvLmGdbvm+TTSS5L8tUkRzXtD2qWL01yRZI/GVTMkiRJUj8MpOhOsgR4L3A8cCTwgiRHTuv2VuCSqnoc8CLglKb9LuBpVfV44AnAcUmePIi4JUmSpH4Y1JHuo4GrqurqqtoKrANOmNbnSOA8gKraBKxIsrw6ppo+D2h+akBxS5IkSbtsUEX3gcB1XctbmrZulwLPBkhyNHAocFCzvCTJJcDNwLlVdVHrEUuSJEl9MqhTBmaGtulHq98JnNIU15cDXwfuBqiqbcATkuwDfDrJUVX1jfvtJFkLrAVYvnw5ky1eoWlqaqrV7WvhMNfjw1yPD3M9Psz1+FjouR5U0b0FOLhr+SDg+u4OVXU78BKAJAG+3fx09/lhkkngOOB+RXdVnQ6cDrBq1aqaaPEKTZOTk7S5fS0c5np8mOvxYa7Hh7keHws914OaXnIxcESSw5IsBU4EPtvdIck+zTqAlwNfrqrbkzy0OcJNkj2ApwObBhS3JEmStMsGcqS7qu5O8mrgi8AS4MyquiLJK5v1pwGPAT6cZBvwTeBlzcMPAD7UnAFlN+BjVXXOIOKWJEmS+mFgl4Gvqs8Bn5vWdlrX/fXAETM87jLgia0HKEmSJLXEK1JKkiRJLbPoliRJklpm0S1JkiS1zKJbkiRJaplFtyRJktQyi25JkiSpZRbdkiRJUsssuiVJkqSWWXRLGk3r18PJJ3duJUkasoFdkVKSBmb9ejj2WNi6FZYuhfPOg9Wrhx2VJGmMeaRb0uiZnOwU3Nu2dW4nJ4cdkSRpzFl0Sxo9ExOdI9xLlnRuJyaGHZEkacw5vUTS6Fm9ujOlZHKyU3A7tUSSNGQW3ZJG0+rVFtuSpAXD6SWSJElSyyy6JUmSpJalqoYdQyuSfA+4tsVd7A98v8Xta+Ew1+PDXI8Pcz0+zPX4GFauD62qh+6s08gW3W1LsqGqVg07DrXPXI8Pcz0+zPX4MNfjY6Hn2uklkiRJUsssuiVJkqSWWXTP3+nDDkADY67Hh7keH+Z6fJjr8bGgc+2cbkmSJKllHumWJEmSWmbRPUdJjkuyOclVSd487HjUP0kOTnJ+kiuTXJHkdU37fknOTfKt5nbfYceq/kiyJMnXk5zTLJvrEZRknySfSLKpeX+vNtejKcnvNp/f30hydpIHmevRkOTMJDcn+UZX26y5TfKWplbbnOQZw4n6viy65yDJEuC9wPHAkcALkhw53KjUR3cDb6iqxwBPBl7V5PfNwHlVdQRwXrOs0fA64MquZXM9mk4BvlBVjwYeTyfn5nrEJDkQeC2wqqqOApYAJ2KuR8UHgeOmtc2Y2+Z394nAY5vH/G1Tww2VRffcHA1cVVVXV9VWYB1wwpBjUp9U1Q1V9bXm/h10fjEfSCfHH2q6fQj4teFEqH5KchDwK8D7u5rN9YhJsjfwVOAMgKraWlU/xFyPqt2BPZLsDjwYuB5zPRKq6svALdOaZ8vtCcC6qrqrqr4NXEWnhhsqi+65ORC4rmt5S9OmEZNkBfBE4CJgeVXdAJ3CHHjY8CJTH70HeBNwT1ebuR49hwPfAz7QTCV6f5I9Mdcjp6q+C7wb+A5wA3BbVX0Jcz3KZsvtgqzXLLrnJjO0efqXEZNkGfBJ4PVVdfuw41H/JXkWcHNVbRx2LGrd7sDPAn9XVU8E7sTpBSOpmc97AnAY8HBgzyS/OdyoNCQLsl6z6J6bLcDBXcsH0fnXlUZEkgfQKbjPqqpPNc03JTmgWX8AcPOw4lPf/Dzwq0muoTNN7GlJ/hFzPYq2AFuq6qJm+RN0inBzPXqeDny7qr5XVT8BPgUcg7keZbPldkHWaxbdc3MxcESSw5IspTNJ/7NDjkl9kiR05n1eWVV/2bXqs8CLm/svBj4z6NjUX1X1lqo6qKpW0Hkf/2tV/SbmeuRU1Y3AdUke1TQdC3wTcz2KvgM8OcmDm8/zY+l8N8dcj67ZcvtZ4MQkD0xyGHAE8NUhxHcfXhxnjpI8k85c0CXAmVX1jiGHpD5J8hTg34DL+c95vm+lM6/7Y8AhdD7Un1tV07/MoUUqyQRwUlU9K8lPYa5HTpIn0PnC7FLgauAldA46mesRk+RPgOfTORvV14GXA8sw14tekrOBCWB/4Cbgj4B/YpbcJnkb8FI6r4XXV9XnhxD2fVh0S5IkSS1zeokkSZLUMotuSZIkqWUW3ZIkSVLLLLolSZKklll0S5IkSS2z6JYk9STJVJLDhx2HJC1GFt2StEgkuSbJ05P8VpILWt7XZJKXd7dV1bKqurrN/UrSqLLolqQxk2T3YccgSePGoluSFpfHAKcBq5vpHj8EaC53/O4k30lyU5LTkuzRrJtIsiXJ7ye5EfhAkn2TnJPke0lube4f1PR/B/ALwKnNPk5t2ivJI5r7D0ny4ebx1yb5gyS7Net+K8kFTTy3Jvl2kuMH/kxJ0gJi0S1Ji8uVwCuB9c10j32a9v8JPBJ4AvAI4EDg7V2P+2lgP+BQYC2dz/8PNMuHAD8GTgWoqrcB/wa8utnHq2eI42+AhwCHA78IvIiTVO/gAAAgAElEQVTO5dW3+zlgM51LNv8FcEaS7NLIJWkRs+iWpEWuKWZ/G/jdqrqlqu4A/hw4savbPcAfVdVdVfXjqvpBVX2yqn7U9H8HneK5l/0tAZ4PvKWq7qiqa4D/Bbywq9u1VfX3VbUN+BBwALB8F4cqSYuW8/okafF7KPBgYGPXweQAS7r6fK+q/uPelcmDgb8CjgP2bZr3SrKkKZR3ZH9gKXBtV9u1dI6ub3fj9jtV9aMmrmW9DkiSRo1HuiVp8alpy9+nMz3ksVW1T/PzkKpatoPHvAF4FPBzVbU38NSmPbP0n76/n9CZmrLdIcB35zAGSRorFt2StPjcBByUZClAVd0D/D3wV0keBpDkwCTP2ME29qJTqP8wyX7AH82wjxnPyd0cCf8Y8I4keyU5FPg94B93YUySNNIsuiVp8flX4ArgxiTfb9p+H7gK+EqS24H/TedI9mzeA+xB56j1V4AvTFt/CvCc5uwjfz3D418D3AlcDVwAfAQ4c37DkaTRl6od/QdRkiRJ0q7ySLckSZLUMotuSZIkqWUW3ZIkSVLLLLolSZKklll0S5IkSS2z6JYkSZJaZtEtSZIktcyiW5IkSWqZRbckSZLUMotuSZIkqWUW3ZIkSVLLLLolSZKklll0S5IkSS2z6JYkSZJaZtEtSZIktcyiW5IkSWqZRbckSZLUMotuSZIkqWUW3ZIkSVLLLLolSZKklll0S5IkSS2z6JYkSZJaZtEtSZIktcyiW5IkSWqZRbckSZLUMotuSZIkqWUW3ZIkSVLLLLolSZKklll0S5IkSS2z6JYkSZJaZtEtSZIktcyiW5IkSWqZRbckSZLUMotuSZIkqWUW3ZIkSVLLLLolSZKklu0+7ADasv/++9eKFSsGus8777yTPffcc6D71HCY6/FhrseHuR4f5no8DCrPGzdu/H5VPXRn/Ua26F6xYgUbNmwY6D4nJyeZmJgY6D41HOZ6fJjr8WGux4e5Hg+DynOSa3vp5/QSSZIkqWUW3ZIkSVLLLLolSZKklll0S5IkSS2z6JYkSZJaNpCiO8mZSW5O8o2utncl2ZTksiSfTrLPLI+9JsnlSS5JMtjTkagnBx58CEnG6ueyyy8f9tM+cOOY5wMPPmTYT7skaUQM6pSBHwROBT7c1XYu8JaqujvJ/wTeAvz+LI9fU1XfbzdEzdf1W67j+e+7cNhhDNRP7hiv8cJ45vmjrzhm2CFIkkbEQI50V9WXgVumtX2pqu5uFr8CHDSIWCRJkqRBWyhzul8KfH6WdQV8KcnGJGsHGJMkSZLUF6mqwewoWQGcU1VHTWt/G7AKeHbNEEySh1fV9UkeRmdKymuaI+cz7WMtsBZg+fLlK9etW9ffQezE1NQUy5YtG+g+F4KNGzey76GPHnYYA7XntimWL18+7DAGahzzfOu1m3jUox41lu/rcTSun+HjyFyPh0Hlec2aNRuratXO+g216E7yYuCVwLFV9aMetvHHwFRVvXtnfVetWlVeBn4wkozdXN8n3XEhb3jDG4YdxkCNY54/+opjOP/888fyfT2OxvUzfByZ6/EwwMvA91R0D216SZLj6Hxx8ldnK7iT7Jlkr+33gV8GvjFTX0mSJGmhGtQpA88G1gOPSrIlycvonM1kL+DcdE4HeFrT9+FJPtc8dDlwQZJLga8C/1JVXxhEzJIkSVK/DOSUgVX1ghmaz5il7/XAM5v7VwOPbzE0SZIkqXWDOk+3NGI6F0/RiNttdzZu3MiaNWuGHclAPPygg/nudd8ZdhiSNJIsuqV5qbH8UuHYuedu9j300WOT67HMsSQNyEI5T7ckSZI0siy6JUmSpJZZdEuSJEkts+iWJEmSWmbRLUmSJLXMoluSJElqmUW3JEmS1DKLbkmSJKllXhynzw48+BCu33LdsMOQJEnSAmLR3WfXb7lubK5et51XsZMkSdoxp5dIkiRJLbPoliRJklpm0S1JkiS1zKJbkiRJatlAiu4kZya5Ock3utr2S3Jukm81t/vO8tjjkmxOclWSNw8iXkmSJKmfBnWk+4PAcdPa3gycV1VHAOc1y/eRZAnwXuB44EjgBUmObDdUSZIkqb8GUnRX1ZeBW6Y1nwB8qLn/IeDXZnjo0cBVVXV1VW0F1jWPkyRJkhaNYc7pXl5VNwA0tw+boc+BQPeVZrY0bZIkSdKikaoazI6SFcA5VXVUs/zDqtqna/2tVbXvtMc8F3hGVb28WX4hcHRVvWaWfawF1gIsX7585bp169oYyqympqbYvHkz+x766IHud9huvXbT2I15z21T3Llk2bDDGKhxzPOt125ixeGP4LZt43EdsVuv3cTKlSuHHcbQTE1NsWzZeL2vx5W5Hg+DyvOaNWs2VtWqnfUb5m+Sm5IcUFU3JDkAuHmGPluAg7uWDwKun22DVXU6cDrAqlWramJioo/h7tzk5CQnnXTS+F2RcgzH/KQ7NnHxXuN1Jc5xzPNHTzqJMz5+Dl+6Zb9hhzIQHz3pJAZ1IGYhmpycZNC/NzQc5no8LLQ8D3N6yWeBFzf3Xwx8ZoY+FwNHJDksyVLgxOZxkiRJ0qIxqFMGng2sBx6VZEuSlwHvBH4pybeAX2qWSfLwJJ8DqKq7gVcDXwSuBD5WVVcMImZJkiSpXwYyvaSqXjDLqmNn6Hs98Myu5c8Bn2spNEmSJKl1XpFSkiRJaplFtyRJktQyi25JkiSpZRbdkiRJUsssuiVJkqSWjcdl1iRJEgAHHnwI12+5bthhDNTDDzqY7173nWGHoTFn0S1J0hi5fst143d12VeM1xWEtTA5vUSSJElqmUW3JEmS1DKLbkmSJKllFt2SJElSy3ap6E6yb5LH9SsYSZIkaRTNuehOMplk7yT7AZcCH0jyl/0PTZIkSRoN8znS/ZCquh14NvCBqloJPL2/YUmSJEmjYz5F9+5JDgCeB5zT53gkSZKkkTOfovtPgC8CV1XVxUkOB77V37AkSQO32+4kGauf3Zc+6N77GzduHHo8g/jReDjw4EOG/lob9M+BBx8y7Kd9h+ZzRcobqureL09W1dWZ55zuJI8CPtrVdDjw9qp6T1efCeAzwLebpk9V1Z/OZ3+SpB245+6xvFLh9jHvu98tYzF+r844Hrzy6MIzn6L7b4Cf7aFtp6pqM/AEgCRLgO8Cn56h679V1bPmun1JkiRpIei56E6yGjgGeGiS3+tatTewpA+xHAv8v6q6tg/bkiRJkhaMuczpXgoso1Oo79X1czvwnD7EciJw9izrVie5NMnnkzy2D/uSJEmSBiZVNbcHJIf2+2h0kqXA9cBjq+qmaev2Bu6pqqkkzwROqaojZtnOWmAtwPLly1euW7eun2Hu1NTUFJs3b2bfQx890P0O263Xbhq7Me+5bYo7lywbdhgDNY55vvXaTaw4/BHctm0+M/EWn3HN8fYxP2TJ3WOR63HN88qVK+9dnpqaYtmy0f4M37hxo3keUJ7XrFmzsapW7azffIruRwInASvomp5SVU+bY4zd2zwBeFVV/XIPfa8BVlXV93fUb9WqVbVhw4b5hjQvk5OTrFmzZiy/uDBuY37SHRdy8V4L+wsb/TaOef7oK47hjI+fw5du2W/YoQzEuOZ4+5h/eb9bxiLX45rn7npncnKSiYmJ4QU0AEnM84DynKSnons+f9J/HDgNeD+wbR6Pn8kLmGVqSZKfBm6qqkpyNJ0pMT/o034lSZKk1s2n6L67qv6uXwEkeTDwS8ArutpeCVBVp9GZL/7fk9wN/Bg4seZ6eF6SJEkaovkU3f+c5HfonNrvru2NVXXLfAKoqh8BPzWt7bSu+6cCp85n25IkSdJCMJ+i+8XN7Ru72orOhW0kSZIkTTPnoruqDmsjEEmSJGlUzbnoTvKimdqr6sO7Ho4kSZI0euYzveRJXfcfROdKkl8DLLolSZKkGcxneslrupeTPAT4h75FJEmSJI2YuVwGfjY/Ama8QqQkSZKk+c3p/mc6ZysBWAI8BvhYP4OSJEmSRsl85nS/u+v+3cC1VbWlT/FIkiRJI2fO00uq6v8Am4C9gH2Brf0OSpIkSRolcy66kzwP+CrwXOB5wEVJntPvwCRJkqRRMZ8vUr4NeFJVvbiqXgQcDfxhf8OSJEnqk912J8m9Pxs3brzP8ij+aOGZz5zu3arq5q7lH9Cfs6BIkiT13z138/z3XXjv4r773XKf5VH00VccM+wQNM18iu4vJPkicHaz/Hzgc/0LSZIkSRotPRfdSR4BLK+qNyZ5NvAUIMB64KyW4pMkSZIWvblMC3kPcAdAVX2qqn6vqn6XzlHu97QRnCRJkjQK5lJ0r6iqy6Y3VtUGYEXfIpIkSZJGzFyK7gftYN0e8w0gyTVJLk9ySZINM6xPkr9OclWSy5L87Hz3JUmSJA3DXIrui5P89vTGJC8DNu5iHGuq6glVtWqGdccDRzQ/a4G/28V9SZIkSQM1l7OXvB74dJL/xn8W2auApcCv9zuwLicAH66qAr6SZJ8kB1TVDS3uU5IkSeqbnovuqroJOCbJGuCopvlfqupfdzGGAr6UpID3VdXp09YfCFzXtbylabPoliRJ0qKQzgHkIQaQPLyqrk/yMOBc4DVV9eWu9f8CnFxVFzTL5wFvqqr7TWlJspbOFBSWL1++ct26dQMZw3ZTU1Ns3ryZfQ999ED3O2y3Xrtp7Ma857Yp7lyybNhhDNQ45vnWazex4vBHcNu2+VzSYPEZ1xxvH/NDltw9Frke9zzDeOR6XPO8cuXKe5enpqZYtqz939Vr1qzZOMsU6fsYetHdLckfA1NV9e6utvcBk1V1drO8GZjY2fSSVatW1YYN9/teZqsmJydZs2bNyF/larqPvuKYsRvzk+64kIv3Gq+rfY1jnj/6imM44+Pn8KVb9ht2KAMxrjnePuZf3u+Wscj1uOcZxiPX45rn7rp2cnKSiYmJ1vebpKeie6iXb0+yZ5K9tt8Hfhn4xrRunwVe1JzF5MnAbc7nliRJ0mIy7P+tLKfz5cztsXykqr6Q5JUAVXUanYvvPBO4CvgR8JIhxSpJkiTNy1CL7qq6Gnj8DO2ndd0v4FWDjEuSJEnqp6FOL5EkSZLGgUW3JEmS1DKLbkmSJKllFt2SJElSyyy6JUmSpJZZdEuSJEkts+iWJEmSWmbRLUmSJLXMoluSJElqmUW3JEmS1DKLbkmSJKllFt2SJElSyyy6JUmSpJZZdEuSJEkts+iWJEmSWmbRLUmSJLVsqEV3koOTnJ/kyiRXJHndDH0mktyW5JLm5+3DiFWSJEmar92HvP+7gTdU1deS7AVsTHJuVX1zWr9/q6pnDSE+SZIkaZcN9Uh3Vd1QVV9r7t8BXAkcOMyYJEmSpH5bMHO6k6wAnghcNMPq1UkuTfL5JI8daGCSJEnSLkpVDTsGkiwD/g/wjqr61LR1ewP3VNVUkmcCp1TVEbNsZy2wFmD58uUr161b13Lk9zU1NcXmzZvZ99BHD3S/w3brtZvGbsx7bpviziXLhh3GQI1jnm+9dhMrDn8Et20b9ky8wRjXHG8f80OW3D0WuR73PMN45Hpc87xy5cp7l6empli2rP3f1WvWrNlYVat21m/oRXeSBwDnAF+sqr/sof81wKqq+v6O+q1atao2bNjQnyB7NDk5yZo1a3j++y4c6H6H7aOvOGbsxvykOy7k4r2OGXYYAzWOef7oK47hjI+fw5du2W/YoQzEuOZ4+5h/eb9bxiLX455nGI9cj2ueu+vayclJJiYmWt9vkp6K7mGfvSTAGcCVsxXcSX666UeSo+nE/IPBRSlJkiTtmmH/b+XngRcClye5pGl7K3AIQFWdBjwH+O9J7gZ+DJxYwz48L0mSJM3BUIvuqroAyE76nAqcOpiIJEmSpP5bMGcvkSRJkkaVRbckSZLUMotuSZIkqWUW3ZIkSVLLLLolSZKklll0S5IkSS2z6JYkSZJaZtEtSZIktcyiW5IkSWqZRbckSZLUMotuSZIkqWUW3ZIkSVLLLLolSZKklll0S5IkSS2z6JYkSZJaZtEtSZIktWzoRXeS45JsTnJVkjfPsD5J/rpZf1mSnx1GnJIkSdJ8DbXoTrIEeC9wPHAk8IIkR07rdjxwRPOzFvi7gQYpSZIk7aJhH+k+Griqqq6uqq3AOuCEaX1OAD5cHV8B9klywKADlSRJkuZr2EX3gcB1Xctbmra59pEkSZIWrFTV8HaePBd4RlW9vFl+IXB0Vb2mq8+/ACdX1QXN8nnAm6pq4wzbW0tnCgrAo4DNLQ9huv2B7w94nxoOcz0+zPX4MNfjw1yPh0Hl+dCqeujOOu0+gEB2ZAtwcNfyQcD18+gDQFWdDpzezwDnIsmGqlo1rP1rcMz1+DDX48Ncjw9zPR4WWp6HPb3kYuCIJIclWQqcCHx2Wp/PAi9qzmLyZOC2qrph0IFKkiRJ8zXUI91VdXeSVwNfBJYAZ1bVFUle2aw/Dfgc8EzgKuBHwEuGFa8kSZI0H8OeXkJVfY5OYd3ddlrX/QJeNei45mloU1s0cOZ6fJjr8WGux4e5Hg8LKs9D/SKlJEmSNA6GPadbkiRJGnkW3X2ys8vZazQkOTjJ+UmuTHJFktcNOya1J8mSJF9Pcs6wY1F7kuyT5BNJNjXv7dXDjkntSPK7zWf3N5KcneRBw45J/ZHkzCQ3J/lGV9t+Sc5N8q3mdt9hxmjR3Qc9Xs5eo+Fu4A1V9RjgycCrzPVIex1w5bCDUOtOAb5QVY8GHo85H0lJDgReC6yqqqPonMDhxOFGpT76IHDctLY3A+dV1RHAec3y0Fh090cvl7PXCKiqG6rqa839O+j8cvYKqSMoyUHArwDvH3Ysak+SvYGnAmcAVNXWqvrhcKNSi3YH9kiyO/BgZrnuhxafqvoycMu05hOADzX3PwT82kCDmsaiuz+8VP0YSrICeCJw0XAjUUveA7wJuGfYgahVhwPfAz7QTCV6f5I9hx2U+q+qvgu8G/gOcAOd6358abhRqWXLt1/bpbl92DCDsejuj8zQ5mlhRliSZcAngddX1e3Djkf9leRZwM1VtXHYsah1uwM/C/xdVT0RuJMh/wta7Wjm854AHAY8HNgzyW8ONyqNE4vu/uj5UvVa/JI8gE7BfVZVfWrY8agVPw/8apJr6EwXe1qSfxxuSGrJFmBLVW3/j9Un6BThGj1PB75dVd+rqp8AnwKOGXJMatdNSQ4AaG5vHmYwFt390cvl7DUCkoTO3M8rq+ovhx2P2lFVb6mqg6pqBZ33879WlUfERlBV3Qhcl+RRTdOxwDeHGJLa8x3gyUke3HyWH4tfmh11nwVe3Nx/MfCZIcYy/CtSjoLZLmc/5LDUjp8HXghcnuSSpu2tzZVVJS1OrwHOag6aXA28ZMjxqAVVdVGSTwBfo3Mmqq+zwK5YqPlLcjYwAeyfZAvwR8A7gY8leRmdP7qeO7wIvSKlJEmS1Dqnl0iSJEkts+iWJEmSWmbRLUmSJLXMoluSJElqmUW3JEmS1DKLbkmSJKllFt2SJElSyyy6JWkEJHlMki8nuSzJG5Nc1bQ/J8lXklya5IIkD23aP57k1Kbt2iRPSfLhJP+e5Iyu7e6032z7kCT9J4tuSVrkkuwOnAW8rqoeBxwOfKNZfX5VPbmqHg+cCzyvaf8Z4OqqegrwIeAM4PeBo4BnJ3ngHPrNtg9JUsOiW5IWv2cDl1bV15vlbwKXNvd/K8lXk1wK/A7wH0keBOwDvKfp82PgjKq6oaq2Aj8Ctvbab6Z9tDpaSVqELLolafF7HHBJ1/JRwCVJXgQcDTytOQq9GbgCeCzwtaq6p+n/eOAigCQHAddXVfXSD3jhLPuQJHWx6Jakxe8HwCMBkjwB+E06R7p/BriwqqaS/AZwDHB5035p1+MfB1zW3H981/1e+s22D0lSF4tuSVr8/gFYleRi4KXANVV1NZ052K9N8m90ivKrq+pOOoXyJQDNFJI9qurWZlvdhXUv/WbbhySpSzr/QZQkLVZJllXVVHP/jcBDquoPhhyWJKmLR7olafH73SRXJLkEWAH82ZDjkSRN45FuSZIkqWUe6ZYkSZJaZtEtSZIktcyiW5IkSWqZRbckSZLUMotuSZIkqWUW3ZIkSVLLLLolSZKklll0S5IkSS2z6JYkSZJaZtEtSZIktcyiW5IkSWqZRbckSZLUMotuSZIkqWUW3ZIkSVLLLLolSZKklll0S5IkSS2z6JYkSZJaZtEtSZIktcyiW5IkSWqZRbckSZLUMotuSZIkqWUW3ZIkSVLLLLolSZKklll0S5IkSS2z6JYkSZJaZtEtSZIktcyiW5IkSWqZRbckSZLUMotuSZIkqWUW3ZIkSVLLLLolSZKklll0S5IkSS2z6JYkSZJatqCK7iQHJzk/yZVJrkjyuqb9j5N8N8klzc8zhx2rJEmS1KtU1bBjuFeSA4ADquprSfYCNgK/BjwPmKqqdw81QEmSJGkedh92AN2q6gbghub+HUmuBA4cblSSJEnSrllQR7q7JVkBfBk4Cvg94LeA24ENwBuq6tYdPX7//fevFStWtBrjTO6880723HPPge9Xg2Wex4N5Hg/meTyY5/EwjDxv3Ljx+1X10J31W5BFd5JlwP8B3lFVn0qyHPg+UMCf0ZmC8tIZHrcWWAuwfPnylevWrRtg1B1TU1MsW7Zs4PvVYJnn8WCex4N5Hg/meTwMI89r1qzZWFWrdtZvwRXdSR4AnAN8sar+//buP9iOu7zv+PsjyaSJZRcZxxfbyBYk1AYcbKJrSuW2uQoDGGaKw0xc1e0QSmkkpgmTtmZqxk0DCWEKnYo0baCYwR5IJ1gqhB+2x8G4TIShwo2l1FjGFrFjbGxj5BrL4GuGgKSnf5yjIN9I1pHu7tlz7r5fM2fuObt7v/uc++hcfbT67u77D7N+DXBDVZ33TOPMzs7Wjh07WqnxmWzbto25ubmx71fjZZ/7wT73g33uB/vcD130OclIoXvSrl4S4Grg7kMD9/AEy4PeANw57tokSZKk4zVRJ1ICFwFvBHYluX247ErgsiQXMJhecj+wqZvyJEmSpGM3UaG7qr4M5DCrbhx3LZIkSVJTJmp6yVJwx65dJOnV48zVZ3X9Y5ckSZpoE3Wkeyn40Q9/yIartnddxlht3bSu6xIkSZImmke6JUmSpJYZuiVJkqSWGbolSZKklhm6JUmSpJYZuiVJkqSWGbolSZKklhm6JUmSpJYZuiVJkqSWGbolSZKklhm6JUmSpJYZuiVJkqSWGbolSZKklhm6JUmSpJYZuiVJkqSWGbolSZKklhm6JUmSpJZNVOhOsjrJnya5O8nXkvzGcPkpSW5Ocs/w66qua5UkSZJGNVGhG9gHXF5VLwJeAfxakhcD7wC+UFUvBL4wfC1JkiRNhYkK3VX1SFX9+fD5k8DdwJnAJcDHhpt9DPilbiqUJEmSjt1Ehe5DJVkDvAz4P8BMVT0Cg2AOnNZdZZIkSdKxSVV1XcPfkGQl8EXgPVX1qSRPVNWzD1m/t6r+xrzuJBuBjQAzMzNrt2zZMraaD9qzZw9PLV859v12ae8Du1m7dm3XZYzV/Pw8K1f2q899ZJ/7wT73g33uhy76vH79+p1VNXu07SYudCc5AbgBuKmq3j9c9nVgrqoeSXI6sK2qznmmcWZnZ2vHjh3tF7zA5s2bue2kdWPfb5e2blrHpP05atu2bduYm5vrugy1zD73g33uB/vcD130OclIoXuippckCXA1cPfBwD10HfCm4fM3AZ8dd22SJEnS8VrRdQELXAS8EdiV5PbhsiuB9wL/M8lbgG8Cl3ZUnyRJknTMJip0V9WXgRxh9SvHWYskSZLUlImaXiJJkiQtRYZuSZIkqWWGbkmSJKllhm5JkiSpZYZuSZIkqWWGbkmSJKllhm4t3rIVJOnV445du7r+qUuSpCkyUdfp1pQ6sI8NV23vuoqx+tGT/Xq/kiRpcTzSLUmSJLXM0C1JkiS1zNAtSZIktczQLUmSJLXM0C1JkiS1zNAtSZIktczQLUmSJLXM0C1JkiS1rNXQnWR9kn/Y5j4kSZKkSddo6E7yxSQXDZ9fAWwBrk1yZZP7kSRJkqZJ00e6zwNuHT7/VWAOeAXw1lG+Ock1SR5Ncuchy96V5OEktw8fr2u4ZkmSJKlVTYfuZUAl+RkgVXV3VT0IrBrx+z8KXHyY5b9XVRcMHzc2VKskSZI0FisaHu/LwB8ApwOfBhgG8MdG+eaquiXJmoZrkiRJkjrV9JHufw48AdwBvHO47Fzg9xc57q8nuWM4/WTUo+aSJEnSREhVNTdYcmlVfeIwy3+5qj454hhrgBuq6rzh6xkGR8oLeDdwelX9iyN870ZgI8DMzMzaLVu2HM/bWJQ9e/bw1PKVY99vl/Y+sJtVZ5/bdRljdeL+eWZmZrouQy2bn59n5cp+fZ77yD73g33uhy76vH79+p1VNXu07ZoO3d+rqpMPs/zxqjplxDHWcEjoHnXdQrOzs7Vjx45RdtmozZs3c9tJ68a+3y5t3bSODVdt77qMsbrwye1cfvnlXZehlm3bto25ubmuy1DL7HM/2Od+6KLPSUYK3Y3M6U7yguHTZUmeD+SQ1S8AfrCIsU+vqkeGL98A3PlM20uSJEmTpqkTKe9lMP0jwF8uWPdt4F2jDJLkWgaXGTw1yUMM5oXPJblgOP79wKZGKpYkSZLGpJHQXVXLYHBznKr6hUWMc9lhFl993IVJkiRJE6DRSwYuJnBL0yUkOfpmS8gZz1vNww9+s+syJEmaSo2G7uF87vcAFwBPO3W0qs5qcl9St6p3J49u3dSvE4QlSWpS0zfH+TiDOd2XA99veGxJkiRpKjUdul8CXFRVBxoeV5IkSZpaTd+R8hbgZQ2PKUmSJE21po903w/clORTDC4V+Neq6rca3pckSZI0FZoO3ScC1wMnAKsbHluSJEmaSk1fMvDNTY4nSZIkLQVNX5rrwicAAAysSURBVDLwBUdaV1X3NbkvSZIkaVo0Pb3k0NvBH1TDr8sb3pckSZI0FZqeXvK0q6EkeS7wTuBLTe5HkiRJmiZNXzLwaarq28C/Bv5jm/uRJEmSJlmroXvoHOCnxrAfSZIkaSI1fSLll/jxHG4YhO2XAL/T5H4kSZKkadL0iZQfWfD6KeCrVXVPw/uRJEmSpkbTJ1J+rMnxJEmSpKWg0TndSU5I8ttJ7kvyg+HX307yrCb3I6kDy1aQpFePO3bt6vqnLklaIpqeXvKfgJcDbwUeAM4G/gNwMvBvGt6XpHE6sI8NV23vuoqx+tGT/Xq/kqT2NH31kkuB11fV56vq61X1eeANwD8e5ZuTXJPk0SR3HrLslCQ3J7ln+HVVwzVLkiRJrWo6dOcYly/0UeDiBcveAXyhql4IfGH4WpIkSZoaTYfuTwDXJ3lNkhcluRj4zHD5UVXVLcDjCxZfAhw8QfNjwC81VawkSZI0Dk3P6f53wG8CHwDOAB4GrgV+dxFjzlTVIwBV9UiS0xZdpSRJkjRGqaqjb3W0QZKLGMzlvuIw694HfLqqbh1xrDXADVV13vD1E1X17EPW762qw87rTrIR2AgwMzOzdsuWLcf6VhZtz549PLV85dj326W9D+xm1dnndl3GWJ24f94+98CJ++eZmZnpugy1bH5+npUr+/V57iP73A9d9Hn9+vU7q2r2aNs1daT7SuCDR1j3p8C/B/7RcY69J8npw6PcpwOPHmnDqvow8GGA2dnZmpubO85dHr/Nmzdz20nrxr7fLm19+9t7d1WLC5/cbZ974MInd7Nhw4auy1DLtm3bRhd/X2i87HM/THKfm5rTfQHwuSOs+1/A2kWMfR3wpuHzNwGfXcRYkiRJ0tg1FbpPBo50A5wTgJNGGSTJtcBXgHOSPJTkLcB7gVcluQd41fC1JEmSNDWaml6yG3g1hz8K/erh+qOqqsuOsOqVx1mXJEmS1LmmQvfvAVclWQ58pqoOJFnG4PJ+HwD+bUP7kSRJkqZOI6G7qj6e5LkMrqP9E0keA04FfgC8s6qubWI/kiRJ0jRq7DrdVfX+JB8B/h7wHOA7wFeq6ntN7UOSJEmaRo3eHGcYsG9qckxJkiRp2jV9G3hJkiRJCxi6JUmSpJY1Or1EkpaWkKTrIsZm+Qk/wf4f/VXXZYzVGc9bzR/9jz/sugxJPWDolqQjKjZctb3rIsZm66Z1vXq/MHjPkjQOTi+RJEmSWmboliRJklpm6JYkSZJaZuiWJEmSWmboliRJklpm6JYkSZJaZuiWJEmSWmboliRJklpm6JYk9deyFezcuZMkvXmcufqsrn/qUi95R0pJUn8d2Meqs8/t1Z04vQun1I2pCd1J7geeBPYD+6pqttuKJEmSpNFMTegeWl9Vj3VdhCRJknQsnNMtSZIktWyaQncBn0+yM8nGrouRJEmSRpWq6rqGkSQ5o6q+leQ04GbgbVV1y4JtNgIbAWZmZtZu2bJl7HXu2bOHp5avHPt+u7T3gd2sOvvcrssYqxP3z9vnHuhbn/vY470P7GbNC36W7+6fttmWx2/vA7tZu3Zt12WM3fz8PCtX9ufz3Fdd9Hn9+vU7RznXcGpC96GSvAuYr6r/fKRtZmdna8eOHeMramjz5s3cdlK/zgzfumldr878B7jwye32uQf61uc+9njrpnVc/Ykb+Pzjp3Rdyths3bSOafy7f7G2bdvG3Nxc12WoZV30OclIoXsqppckOTHJSQefA68G7uy2KkmSJGk00/L/aTPAp5PAoOaPV9Xnui1JkiRJGs1UhO6qug84v+s6JEmSpOMxFdNLJEmSjteZq89i586dJOnNY8Wz/lbnNYz7cebqs7r+o/aMpuJItyRJ0vH61kMPsursc3t1onBfT4yeZB7pliRJklpm6JYkSZJaZuiWJEmSWmboliRJklrmiZSSJPXJshUM73shaYwM3ZIk9cmBfV7VQuqA00skSZKklhm6JUmSpJYZuiVJkqSWGbolSZKklhm6JUmSpJYZuiVJkqSWGbolSZKklhm6JUmSpJYZuiVJkqSWGbolSZKklk1N6E5ycZKvJ7k3yTu6rkeSJEka1VSE7iTLgQ8ArwVeDFyW5MXdViVJkiSNZipCN/By4N6quq+qfghsAS7puCZJkiRpJNMSus8EHjzk9UPDZZIkSdLES1V1XcNRJbkUeE1V/cvh6zcCL6+qty3YbiOwcfjyHODrYy104FTgsQ72q/Gyz/1gn/vBPveDfe6HLvp8dlX99NE2WjGOShrwELD6kNfPA761cKOq+jDw4XEVdThJdlTVbJc1qH32uR/scz/Y536wz/0wyX2elukltwEvTPL8JM8C/glwXcc1SZIkSSOZiiPdVbUvya8DNwHLgWuq6msdlyVJkiSNZCpCN0BV3Qjc2HUdI+h0eovGxj73g33uB/vcD/a5Hya2z1NxIqUkSZI0zaZlTrckSZI0tQzdx+Fot6TPwH8drr8jyc93UacWZ4Q+/7Nhf+9Isj3J+V3UqcU5Wp8P2e7CJPuT/PI461MzRulzkrkktyf5WpIvjrtGLd4Iv7f/dpLrk3x12Oc3d1GnFifJNUkeTXLnEdZPZA4zdB+jEW9J/1rghcPHRuC/j7VILdqIff4G8AtV9VLg3UzwPDId3oh9Prjd+xiczK0pM0qfkzwb+CDw+qp6CXDp2AvVooz4ef414K6qOh+YAzYPr4qm6fJR4OJnWD+ROczQfexGuSX9JcAf1sCtwLOTnD7uQrUoR+1zVW2vqr3Dl7cyuH68psson2eAtwF/DDw6zuLUmFH6/E+BT1XVNwGqyl5Pn1H6XMBJSQKsBB4H9o23TC1WVd3CoHdHMpE5zNB97Ea5Jb23rZ9+x9rDtwB/0mpFasNR+5zkTOANwIfGWJeaNcrn+e8Aq5JsS7Izya+MrTo1ZZQ+/wHwIgY32NsF/EZVHRhPeRqjicxhU3PJwAmSwyxbeAmYUbbRZBu5h0nWMwjdf7/VitSGUfr8X4Arqmr/4OCYptAofV4BrAVeCfwk8JUkt1bVX7RdnBozSp9fA9wO/CLwM8DNSb5UVd9ruziN1UTmMEP3sRvllvQj3bZeE22kHiZ5KfAR4LVV9Z0x1abmjNLnWWDLMHCfCrwuyb6q+sx4SlQDRv29/VhVPQU8leQW4HzA0D09Runzm4H31uB6yfcm+QZwLvBn4ylRYzKROczpJcdulFvSXwf8yvDs2VcA362qR8ZdqBblqH1OchbwKeCNHg2bWkftc1U9v6rWVNUa4JPAvzJwT51Rfm9/FvgHSVYk+Sng7wJ3j7lOLc4off4mg//NIMkMcA5w31ir1DhMZA7zSPcxOtIt6ZO8dbj+QwzunPk64F7g+wz+Za0pMmKffwt4DvDB4VHQfVU121XNOnYj9llTbpQ+V9XdST4H3AEcAD5SVYe9HJkm04if53cDH02yi8EUhCuq6rHOitZxSXItg6vPnJrkIeCdwAkw2TnMO1JKkiRJLXN6iSRJktQyQ7ckSZLUMkO3JEmS1DJDtyRJktQyQ7ckSZLUMkO3JEmS1DJDtyT1QJIHk/x813VIUl8ZuiVpCUrycJILhs9XAWcAuxc7liTp+Bi6JWmJSXIqcBo/vo35zwHfqKrvNzCWJOk4GLolaQlJ8rPAgwx+v38nyXeAlwJ/meT3k/y/JN9K8qoF3/erSe5K8t0kf5LktMONlWTFcN11SfYk+V6S65OcPO73KknTxNAtSUtIVd0LvB34ZFWtrKrnMAjds8CNwAxwFXDFwe9JciXwVuD1wE8DDwO/e7ixqmofcDLw34CzgDXAqcCm8bxDSZpOhm5JWnrOB24/5PXPAe+pqpuq6gBw18EVSU4DfhO4rKruraofAlcDFx5hLIbb3VxVf1VVjwM3A6vaezuSNP0M3ZK09FwAfBUgSYDzgOsPWX8ePw7erwSeBfxZkieSPAF8DvjuwrEOSnJpkv+d5NHh9u8A/qKtNyNJS8GKrguQJDUnyTIGofrg0ennD7/ee8hmLwM+M3x+CvDpqrp0hLFI8ovA+4ANwP8dLr6fBUfDJUlP55FuSVpafnL4OPj7/aXArqqqQ7Z5GT8+ev3nwPqD1/BOcnKSS4ZHyBeOBYPpJg8yuPzgKuAaBlc3uQtJ0hEZuiVpCamqp4APAXcleYjBfO6/nh6S5DnAc4E7h9t/Bfgd4I+TzDMIzxfXwMKxAP4IOAH4NnADcA9w13AuuCTpCPL0gx+SJEmSmuaRbkmSJKllhm5JkiSpZYZuSZIkqWWGbkmSJKllhm5JkiSpZYZuSZIkqWWGbkmSJKllhm5JkiSpZYZuSZIkqWX/H+NkQZea7sKLAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 864x720 with 3 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "fig0 = plt.figure(figsize=(12, 10))\n",
    "gs = gridspec.GridSpec(nrows=3, ncols=1, hspace=0.5,wspace=0.3)\n",
    "\n",
    "# ================================\n",
    "# Plotting optimization history\n",
    "\n",
    "ax = fig0.add_subplot(gs[0, 0])\n",
    "ax.plot(range(1, len(trials_clf) + 1), [-x['result']['loss'] for x in trials_clf], \n",
    "        color='red', marker='.', linewidth=0)\n",
    "\n",
    "ax.set_xlabel('Iteration', fontsize=12)\n",
    "ax.set_ylabel('Accuracy', fontsize=12)\n",
    "ax.set_title('Optimization history', fontsize=14)\n",
    "\n",
    "ax.grid(True)\n",
    "\n",
    "# ================================\n",
    "# Plotting sampled points\n",
    "\n",
    "samples = [f_unpack_dict(f_wrap_space_eval(hp_space_gfmm, x)) for x in trials_clf.trials]\n",
    "\n",
    "ax = fig0.add_subplot(gs[1, 0])\n",
    "sns.histplot(x=[x['gamma'] for x in samples], bins=10, ax=ax)\n",
    "\n",
    "ax.set_xlabel('$gamma$', fontsize=10)\n",
    "ax.set_ylabel('Counts', fontsize=10)\n",
    "\n",
    "ax.grid(True)\n",
    "\n",
    "# ----------------\n",
    "\n",
    "ax = fig0.add_subplot(gs[2, 0])\n",
    "sns.histplot(x=[x['theta'] for x in samples], bins=10, ax=ax)\n",
    "\n",
    "ax.set_xlabel('$theta$', fontsize=12)\n",
    "ax.set_ylabel('Counts', fontsize=12)\n",
    "\n",
    "ax.grid(True)"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.7"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}