tutorials/basic_tutorial.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "still-passing",
   "metadata": {},
   "source": [
    "# EasyVVUQ - Basic Concepts"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "global-attitude",
   "metadata": {},
   "source": [
    "This tutorial shows a simple EasyVVUQ workflow in action. The example used here is a simulation of a vertical deflection of a tube. Description of it can be found [here](https://openturns.github.io/openturns/latest/usecases/use_case_deflection_tube.html). This model was chosen since it is intuitively easy to understand even without any background in the relative field. It is also easy to interpret the results. We will use EasyVVUQ to determine the influence each of the input parameters has on the vertical deflection at point ```a```."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "european-tradition",
   "metadata": {},
   "source": [
    "The usage of the application is:\n",
    "\n",
    "```beam <input_file>```\n",
    "\n",
    "It outputs a single file called output.json, which will look like ```{'g1': x, 'g2': y, 'g3': y}``` where ```g1``` is the vertical displacement at point ```a``` and ```g2```, ```g3``` are displaced angles of the tube at the left and right ends respectively.\n",
    "\n",
    "The beam.template is a template input file, in JSON format\n",
    "\n",
    "```{\"outfile\": \"$outfile\", \"F\": $F, \"L\": $L, \"a\": $a, \"D\": $D, \"d\": $d, \"E\": $E}```\n",
    "\n",
    "The values for each key are tags (signified by the $ delimiter) which will be substituted by EasyVVUQ with values to sample the parameter space. In the following tutorial, the template will be used to generate files called input.json that will be the input to each run of ```beam```."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "generous-alliance",
   "metadata": {},
   "source": [
    "So, for example (commands preceded by an exclamation mark are treated as shell commands):"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "supposed-master",
   "metadata": {},
   "outputs": [],
   "source": [
    "!echo \"{\\\"outfile\\\": \\\"output.json\\\", \\\"F\\\": 1.0, \\\"L\\\": 1.5, \\\"a\\\": 1.0, \\\"D\\\": 0.8, \\\"d\\\": 0.1, \\\"E\\\": 200000}\" > input.json"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "designing-spain",
   "metadata": {},
   "outputs": [],
   "source": [
    "!./beam input.json"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "legislative-return",
   "metadata": {},
   "outputs": [],
   "source": [
    "!cat output.json"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "nutritional-positive",
   "metadata": {},
   "source": [
    "In this tutorial we will see how to use EasyVVUQ to do variance based sensitivity analysis using stochastic collocation. It is one of several methods that EasyVVUQ supports for this purpose (others being Monte Carlo and Polynomial Chaos Expansion methods). While stochastic collocation supports more complicated scenarios we only explore the basic functionality."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "advance-strategy",
   "metadata": {},
   "source": [
    "# Campaign"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "surface-humor",
   "metadata": {},
   "source": [
    "We need to import EasyVVUQ as well as ChaosPy (we use it's distributions) and matplotlib for plotting later on."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "pregnant-montana",
   "metadata": {},
   "outputs": [],
   "source": [
    "import easyvvuq as uq\n",
    "import chaospy as cp\n",
    "import matplotlib.pyplot as plt"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "frequent-merit",
   "metadata": {},
   "source": [
    "We will describe the parameters. This is done for validation purposes (so that input parameters outside valid ranges given an error. Also this is where you can specify default values for input parameters that you don't want to vary in the analysis. Only the type and the default value fields are mandatory."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "centered-studio",
   "metadata": {},
   "outputs": [],
   "source": [
    "params = {\n",
    "    \"F\": {\"type\": \"float\", \"default\": 1.0}, \n",
    "    \"L\": {\"type\": \"float\", \"default\": 1.5}, \n",
    "    \"a\": {\"type\": \"float\", \"min\": 0.7, \"max\": 1.2, \"default\": 1.0}, \n",
    "    \"D\": {\"type\": \"float\", \"min\": 0.75, \"max\": 0.85, \"default\": 0.8},\n",
    "    \"d\": {\"type\": \"float\", \"default\": 0.1},\n",
    "    \"E\": {\"type\": \"float\", \"default\": 200000},\n",
    "    \"outfile\": {\"type\": \"string\", \"default\": \"output.json\"}\n",
    "}"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "subjective-carter",
   "metadata": {},
   "source": [
    "Next step is to specify how the input files for the simulation are to be created and how EasyVVUQ is to parse the output of the simulation. This is the job of the Encoder and Decoder classes. Our simulation takes a very simple JSON file as input. So we can just use the GenericEncoder which is a template based encoder. It will replace all keys in the template file with respective values. In this case they are identified by the ```$``` that precedes them. Alternatively, there are more complex encoders based on, for example, the [Jinja2](https://easyvvuq.readthedocs.io/en/dev/easyvvuq.encoders.html#module-easyvvuq.encoders.jinja_encoder) templating language. Encoders can also do more complicated things, such as prepare a [directory structure](https://easyvvuq.readthedocs.io/en/dev/easyvvuq.encoders.html#module-easyvvuq.encoders.directory_builder) if your simulation requires such. If it requires several input files you can use a [multiencoder](https://easyvvuq.readthedocs.io/en/dev/easyvvuq.encoders.html#module-easyvvuq.encoders.multiencoder) to combine several encoders, each of which responsible for a single input file. They can also be used to [copy](https://easyvvuq.readthedocs.io/en/dev/easyvvuq.encoders.html#module-easyvvuq.encoders.copy_encoder) files over to the run directory.\n",
    "\n",
    "Decoder is responsible for parsing the otuput of the simulation. We use the [JSONDecoder](https://easyvvuq.readthedocs.io/en/dev/easyvvuq.decoders.html#module-easyvvuq.decoders.json) to extract the needed value. There also exist ready made decoders for [YAML](https://easyvvuq.readthedocs.io/en/dev/easyvvuq.decoders.html#module-easyvvuq.decoders.yaml) and [CSV](https://easyvvuq.readthedocs.io/en/dev/easyvvuq.decoders.html#module-easyvvuq.decoders.simple_csv). You can also easily write your own by inheriting from the BaseDecoder class."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "id": "medium-front",
   "metadata": {},
   "outputs": [],
   "source": [
    "encoder = uq.encoders.GenericEncoder(template_fname='beam.template', delimiter='$', target_filename='input.json')\n",
    "decoder = uq.decoders.JSONDecoder(target_filename='output.json', output_columns=['g1'])"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "faced-canyon",
   "metadata": {},
   "source": [
    "Campaign is the central hub in which operations take place. It is responsible for running your simulations, gathering the results, storing them in the Database, retrieving them for analysis, etc. The Campaign in EasyVVUQ is very powerful and supports multiple applications, sampling, analysis and execution methods. It also lets you save progress and retrieve results later for analysis. Here we only look at a simple case."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "id": "scheduled-inspector",
   "metadata": {},
   "outputs": [],
   "source": [
    "campaign = uq.Campaign(name='beam', params=params, encoder=encoder, decoder=decoder)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "streaming-albert",
   "metadata": {},
   "source": [
    "First we need to define the input parameter distributions. We have chosen 4 of the 6 available inputs. This is partly because this means that we won't have to sample at too many points and partly because I've found that these influence the output variable the most."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "id": "competitive-anchor",
   "metadata": {},
   "outputs": [],
   "source": [
    "vary = {\n",
    "    \"F\": cp.Normal(1, 0.1),\n",
    "    \"L\": cp.Normal(1.5, 0.01),\n",
    "    \"a\": cp.Uniform(0.7, 1.2),\n",
    "    \"D\": cp.Triangle(0.75, 0.8, 0.85)\n",
    "}"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "respective-increase",
   "metadata": {},
   "source": [
    "We have to choose the sampler next. For this task we can use either [Stochastic Collocation](https://easyvvuq.readthedocs.io/en/dev/easyvvuq.sampling.html#module-easyvvuq.sampling.stochastic_collocation), [Polynomial Chaos Expansion](https://easyvvuq.readthedocs.io/en/dev/easyvvuq.sampling.html#module-easyvvuq.sampling.pce) or [QMC](https://easyvvuq.readthedocs.io/en/dev/easyvvuq.sampling.html#module-easyvvuq.sampling.qmc) samplers. Stochastic Collocation is fast for this problem size so that is what we chose."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "id": "comprehensive-nursing",
   "metadata": {},
   "outputs": [],
   "source": [
    "campaign.set_sampler(uq.sampling.SCSampler(vary=vary, polynomial_order=3))"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "guided-postcard",
   "metadata": {},
   "source": [
    "For this tutorial we have chosen to run the simulation on the local machine. This will done in parallel with up to 8 tasks running concurrently. Alternatives are execution in the Cloud (via the [ExecuteKubernetes](https://easyvvuq.readthedocs.io/en/dev/easyvvuq.actions.html#module-easyvvuq.actions.execute_kubernetes) action) or on HPC machines."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "id": "military-struggle",
   "metadata": {},
   "outputs": [],
   "source": [
    "execution = campaign.sample_and_apply(action=uq.actions.ExecuteLocalV2(\"beam input.json\"), batch_size=8)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "id": "under-judgment",
   "metadata": {},
   "outputs": [],
   "source": [
    "execution.start();"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "induced-mainland",
   "metadata": {},
   "source": [
    "The execution can take a bit since we need to generate several hundred samples. We asked it to evaluate 8 samples in parallel. You can track progress by using the ```progress``` method. You can also check progress automatically and resume execution after it is done if you want to run this inside a script rather than interactively."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "id": "tight-budget",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'ready': 188, 'active': 8, 'finished': 60, 'failed': 0}"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "execution.progress()"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "perceived-elizabeth",
   "metadata": {},
   "source": [
    "We then call the analyse method whose functionality will depend on the sampling method used. It returns an [AnalysisResults]() object which can be used to retrieve numerical values or plot the results. In this case Sobols indices."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "id": "logical-consent",
   "metadata": {},
   "outputs": [],
   "source": [
    "results = campaign.analyse(qoi_cols=['g1'])"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "perceived-sheet",
   "metadata": {},
   "source": [
    "We can plot the results in a treemap format. Each square representing the relative influence of that parameter to the variance of the output variable (vertical displacement at point ```a```). A square labeled ```higher orders``` represent the influence of the interactions between the input parameters."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "id": "focal-poetry",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAkUAAAI+CAYAAACym37DAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuMywgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/Il7ecAAAACXBIWXMAAAsTAAALEwEAmpwYAAAprElEQVR4nO3dd5hU5d248fu7lYWll6WDgIKoCCoqxgb2QtRYUBNNrInGqImKMcmrvia22F6TaBITTbG3GOvPGjuoYAUURBHpvRfZZef5/THDuksTCO4K3J/r8tKZOefMc86uO/ee8+xMpJSQJEna0uXV9QAkSZK+CYwiSZIkjCJJkiTAKJIkSQKMIkmSJMAokiRJAowiSdVExC8i4q9refy7EfFsbY4p97zfioixEbEoIo6s7effUBHRMTfm/Loei6SvFr5PkVRTRIwHyoDlQCXwIfBP4LaUUqYOh1arIqIz8BlQmFJaXsdjeQF4LKV08wasWwTcA+wCdAL6p5Re2rgjlLQ58EyRtHoDU0oNyb6IXgNcDNxet0PaonUCRv0X678GfA+YtnGG89UioqC2nkvSxmEUSWuRUpqfUnoMGAR8PyK2B4iI4oi4PiImRMT0iPhTRJSsWC8ijoiI9yJiQUR8GhEH5+5vGxGPRcSciPgkIs6ots7lEfFgRNwVEQsjYkREbBMRl0TEjIiYGBEHVlv+pYi4OiLeyj3PoxHRrNrj346IURExL7fsttUeuzgiJueeZ0xE7FdtDHflFnsl9+95uUtA/SLiBxHxWrXt7BERwyJifu7fe6w0vl9HxOu553k2Ilqs6VhHxBm5YzInd4za5u7/FOgCPJ4bR/Fq1t0pIt7NPc+DEXF/RPwm9zUsTyn9X0rpNbJn/tYoIgZFxPCV7vtpRDyW++/Dcs+zIPf1uLzacp0jIkXEaRExAfhPtfsKcsucEhEf5cY5LiJ+WG39fSNiUkRckPt6T42IU6o9XhIRN0TE57nj/dqK77mI2D0ihuS+1u9HxL5r209Jq2cUSesgpfQWMAnYK3fXNcA2QG+gG9AOuBQgInYle7ntIqAJsDcwPrfefbnttAWOAa6KiAHVnmogcCfQFHgXeIbs/6ftgCuAP680tJOBU4E2ZC/3/S43hm2Ae4HzgZbAU2SjoigiugPnAH1zZ8MOqja+6vbO/btJSqk0pTS0+oO5AHsy95zNgRuBJyOiebXFTgROAVoBRcCFq3kecsfgauC43L58njtWpJS6AhPInr0rTSktW2ndIuAR4O9As9x+H7W651kHjwPdI2Lrlfbhntx/LyZ7zJsAhwFnxapznPYBtiV7XFc2AzgcaET2uNwUETtVe7w10Jjs1/s04JaIaJp77HpgZ2APsvs5GMhERDuyX4ff5O6/EHg4Ilquz45LMoqk9TEFaBYRAZwJ/DSlNCeltBC4Cjg+t9xpwB0ppedSSpmU0uSU0uiI6AB8C7g4pfRFSuk94K9kX2RXeDWl9ExuDs+DZIPmmpRSBdlI6BwRTaotf2dKaWRKaTHwP8BxkZ3UOwh4MjeGCrIvqCVkX1ArgWKgZ0QUppTGp5Q+3YDjcRgwNqV0Z0ppeUrpXmA02bBb4W8ppY9TSkuBB8hG5Op8N3fM3slFzyVAv8jOa/oquwMFwO9SShUppX8Bb23A/pBSWgI8CpwAkIujHsBjucdfSimNyH1dPyAbYPustJnLU0qLc/u88vafTCl9mrJeBp7ly9AGqACuyO3HU8AispGWRzZ+z8t9P1WmlIbkjtX3gKdSSk/lxvUcMBw4dEOOgbQlM4qkddcOmEM2VOoDb+cuV8wDns7dD9ABWF1ktAVWRNQKn+e2u8L0av+9FJiVUqqsdhugtNoyE1faViHQIvdcn694IDdBfCLQLqX0CdkzSJcDMyLivhWXqtZTjedYw/5Un8OzZKWxr3FbKaVFwOyVtrW2cUxONf9qZOKaFl4H95CLIrJnif6diyUiYreIeDEiZkbEfOBHZI93dWt87og4JCLeyF0inEc2XKqvP3ulSe0rjlkLoB6r/77qBBy74nsxt909yZ5xk7QejCJpHUREX7Iv0K8Bs8gGynYppSa5fxqnlFa84E8Euq5mMyvONDWsdl9HYPJ/MbQOK22rIje+KWRfLFeMP3LLTgZIKd2TUtozt0wCrl3Ntr/qT1NrPEe1MWzI/qw83gZkL8mty7amAu1y+7hChzUtvA6eA1pGRG+ycXRPtcfuIXvWqENKqTHwJyBWWn+1xy03F+phsmftylJKTche1lx5/dWZBXzB6r+vJpI9Y9ik2j8NUkrXrMN2JVVjFElrERGNIuJwspeu7lpx6QT4C9n5IK1yy7WLiBVzSG4HTomI/SIiL/dYj5TSRGAIcHVE1IuIXmQvtd216jOvs+9FRM+IqE92ztFDuTNLDwCH5cZQCFwALAOGRET3iBiQe5H+gmzgre6tBmbm7u+yhud+CtgmIk6MiIKIGAT0BJ7YgP24l+wx650b11XAmyml8euw7lCylwTPyY3jCGDX6gtEdmJ8vdzNotzxX22M5C43PghcR3aOznPVHm5I9mzfF7m5Yyeu+y5SRPay5UxgeUQcAhy49lWqxpQB7gBujOxk/fzITnwvJvv9MzAiDsrdXy83abv9eoxNEkaRtCaPR8RCsr+F/5LsJOJTqj1+MfAJ8EZELACeB7pD1aTsU4CbgPnAy3x5FuQEoDPZMyOPAJellJ7/L8Z5J9kJxtPIXl45NzeGMWTnmvye7FmGgWQnKpeTfWG+Jnf/NLKToC9ZecO5S0ZXAq/nLsvsvtLjs8lOGr6A7KWuwcDhKaVZ67sTuWPwP2TPpEwle0bk+LWu9OW65cB3yAbmPLL7/QTZCFxhDNn4a0d28vpSVj3LVd09wP7AgytdzjobuCL3vXEp2fhcJ7nLpufm1plLNqgeW9f1yU6gHgEMI3sZ91ogLxfbRwC/IBtcE8lO8vfnu7SefPNGaRMVES+RPXu1xneg3lJFxJvAn1JKf6vrsUjadPibhKRNXkTsExGtc5fPvg/0Ijv5XZLWme+4Kmlz0J3sZakGwDjgmJTS1LodkqRNjZfPJEmS8PKZJEkSYBRJkiQBRpEkSRJgFEmSJAFGkSRJEmAUSZIkAUaRJEkSYBRJkiQBG/iO1oMeOd53fFyN+4+6b7Wfur3G5Sn0OEqSat0gKtb59ersMUd+I1+rbu3+7/V6zV0XnimSJEnCKJIkSQKMIkmSJMAokiRJAowiSZIkYBOOon+d+HBdD0GSJG1GNtkokiRJ2piMIkmSJIwiSZIkwCiSJEkCjCJJkiTAKJIkSQI28ANhvwmWL1vO46c/VnV7m293p/u3u9fhiCRJ0qZsk42i4x4eVNdDkCRJmxEvn0mSJGEUSZIkAXV0+WzqO1N57453SZnEVvt3YdvvbFvj8cqKSt66+U3mjptLUcMi+l2wBw1aNWDZwmUMuW4Icz+ZQ+f+ndnpjJ2B7PyiodcNYdH0RURe0HaXtvQ6aUcAZo6awbt3vMv8z+ez+8/60WGPDlXPM/7Fz/jwoQ8B6HlMTzr336qWjoAkSfqmqfUoylRmeOcvb7PPZftS0ryE5wc/R9u+bWncoXHVMp89P47C0iIOvfUwJrw2gQ/++T79LtyD/MJ8tj9he+ZPmM+CCfNrbLf7Ed1ptUMZlRWVvHz5S0x9ZyptdmpD/ZYN2PUnuzHm0dE1ll+2cBmjHhjF/r89gIjguYuepW3fdhSVFtXKcZAkSd8stX75bM4ncyht05DS1qXkF+bTcc+OTHlrco1lJg+bQuf+nQFo368900dMJ6VEQb0CWm7bkvzC/BrLFxQX0GqHMgDyC/Np2qUpS2YvAaBBqwY06dyEyIsa60x/bxplvcooblhMUWkRZb3KmPbu1K9pryVJ0jddrUfR0tlLqd+8pOp2SfP6LJ2zdKVlllC/eX0A8vLzKKxfSPnC8nXafvnicqYMn0JZLpLWZMnspdRvUb/GOJbMXrqWNSRJ0uZss5ponanM8MaNQ9n60K0pbV1a18ORJEmbkFqPopLmJTXOyCydvYSSZiUrLVO/6vJXpjJDxZIKihp+9Vyf4X8cTmmbhmwz8KvfxLF+8xKWzFpSYxzVz2BJkqQtS61HUbNuzVg0dSGLpi+isqKSCa9NoG3fdjWWadu3LeNfHA/ApKGTaLVDGRGxmq19acQ9I6hYUkGfU/us0zjKerdm+vvTKV9UTvmicqa/P52y3q03aJ8kSdKmr9b/+iwvP4+dTt+JV654Ofsn+ft1oXHHxoy8dwRNuzaj3a7t6LJfF968+Q2eOvtJikqL2P1n/arWf+KHj7N86XIyyzNMfnMye1+2D4UlhXz00Ic0bNeQ5y58FoBuh3SjywFdmTN2Nq9f+3p2rtGwKYy6fyQH33wIxQ2L2fbYnjw/+DkAeh7bk+KGxbV9OCRJ0jdEpJTWe6VBjxy//ittAe4/6r61n85aeXkKPY6SpFo3iIp1fr06e8yR38jXqlu7/3u9XnPXxWY10VqSJGlDGUWSJEkYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgRs4Dtar++bFErSxnBC/nI67gCVFZBXAHufnMehPw3y8vyRJK3NjPGJ3x5eyfUjV33Zj4grgFdSSs+vaf1hvx9NYf0Cep/W7esc5lotmLSEp856g+MfH/C1PUetf8yHJG2oohK49r3sj635MxK/PzHD0gWJY/83v45HJm26UkqXft3PkalM5OWv3y8vmeUZ8go2/IJWRBSklJavzzpGkaRNUuNWwRm35fHLvpUcc3n6yg+NlrZ0mUq47YxKPh6SOP7DeBY4IqW0NCL+DjyRUnooIg4FbgQWA68DXc4afQQAcz9dyKMnvcbCqUvpdXIXep3cFYCPH5vIiDvHUVmRoaxXU/a6bEfy8oO/7PQE2x3XmUlDZ7LXpb1os3PzqrHM+mg+L1/+PsuXVtK4Y336X9mH4sZFPHrSazTftjHT3p5Nt8Pa027XFrz4y3cBaP+tVtX2JRER1wH7AsXALSmlP0fEvsCvgblAj4joAzwAtAfygV+nlO5f0zFyTpGkTVZZlyBTCfNn1PVIpG++aWPhwB/ncf2oAoB5wNHVH4+IesCfgUNSSjsDLas/PnfcQg6/vR9HP7g3w28ZQ2VFhrmfLuSTpyZz5D17cdy/+xP5wdjHJwKwfEklrXZsynGP9q8RRAAvXPwO/S7oyaDH+tNsm0YMu2VM1WOZigzHPLwvvU/txn9+8S57/moHjnu0f431Rz/0OcD8lFJfoC9wRkRslXt4J+C8lNI2wMHAlJTSjiml7YGn13aMjCJJkrYArbaCzr2rzqi+DXReaZEewLiU0me52/dWf7DTvmXkF+VT0rSYkubFLJ29jElDZzJz1DwePvZlHjjyRSYNncmCiUsAiPygy4FtVxnHsoUVlC+soO2uLQDofmRHpg6fXfV4t0PaZZdbkFuub265I9pXLTPx9RkAJ0fEe8CbQHNg69zDb1XbhxHAARFxbUTslVKav7Zj5OUzSZus6eMSefnQuNVXLytt6QqKa9ysBErWZ/38wi/n7kV+kFmeIGWjZvcLeq66fHHees8jAigo+eo5gikB8JOU0jPV789dPlv85XLp44jYCTgU+E1EvJBSumJN2/VMkaRN0oKZib/+KMNB54TziaSNYwzQJSI6524P+qoV2vVrwbhnp7Bk9jIAvphXzsLJS9a6TnHDQoobFTIld3bo40cn0rZv81WXa1RIUcNCpr6dW+7xSVWPddyzFcBZEVEIEBHbRESDlbcREW2BJSmlu4DryF5aWyPPFEnaZJQvhYt7L6/6k/y9TsrjsJ8ZRNLGkJt0fTbwdEQsBoZ91TrNujVi1/O25YnThpAykFcQ7HVpLxq2q7/W9QZcs1PVROtGHeoz4Ko+q1/uqj7ZidYBHapNtN722E68fNn7HwLvRPa3opnAkavZxA7AdRGRASqAs9Y2rki5c1CqffdT6MGXJNW6QVSs9reJiChNKS3KhcYtwNizRh9xY+2Obt3c2v3fG/03Ii+fSZKkFc7ITV4eBTQm+9doWwyjSJIkAZBSuiml1Dul1DOl9N2U0tonCG1mNmhO0cOvfuxln9U4eq9tnNwgrcV7T2f4x3kZMpUw4PQ8jvh5zd/LPnol8Y/zK5nwAZx7Xx67H1Pz8SULEhf2rGSXI4NT/5D9C5X7flnJK/9MLJ4L/1j05Y+0J2/M8J+/ZsgvgIYtgx/dkUfLTsGoFzP886eZquWmjM4+V98j/R1RWp0Jr07ntStHkDKw7TEd2enMbWo8XlleyQsXv8PMUfOp16SQA27sS6P29flibjnPnDeMGSPn0uPIjux1aa9q62R49dcfMOWtWUResOv529L1oLZMGTaL168eyewxCzjghl3oenDNP+kvX1TBfYf9h632awN3b/x9daK1pFqRqUzc8eMMv3wun+bt4Rd9K9n520H7nl/+LtG8I5z193yeuD6z2m088D8Zeuxd83ePnQfmcdA5cP7WlTXu79wHrhqeT3H94Nk/Zrh7cIbz789nu/55XPteNoAWzUmc162SXgf6+4y0OhGR36hDfQbesQcNykp4+NiX6TygNc26Napa5qOHJlDcqIjvPrs/Y5+cxBs3jOLAm/qSX5zHruf1YM7YBcz5eGGN7b79p48paV7Mic/sT8okvphfDkBpm/oMuLoP793xyWrH89bNo2mzy6p/qbax+KuRpFrxyVvQultQ1iUoKAr2OD6P4Y/WPOncqnPQqVcQq/nJNO7txPzprBIwW+8eNG2zatRs1z+P4vpRtcycSaue4H7joUTvQ6JqOUmr2LVxxwY06tCA/KI8uh3ajvEvTKuxwPgXptL9yA4AdD2oLZOHziKlRGH9Atrs3Jz8olXfd2j0vz5npzOz77UYeUFJ0+ybKDVqX5/m3Ruv9m02Zo6cx9LZy2r8FdrGZhRJqhVzJiead/jydrP22fvWRSaTuPOCSr53/Yb9yHrx9gy9D1l13aH3JfY4wSCS1qJdgzZfvsdjg9YlLJ7+RY0FFs34gtLcMnkFeRQ1LOCLeeVr3OCyBRVA9qzPg995iWfOG8aSWV+scXmAlEkMuXYk/QZvt6H7sU6MIknfeM/emuhzaB7N269/wLx6V4ZxwxMDL6q57typiQkjEjseZBRJtSlTmWHxtC9o3acZx/5rX1r3bsrQ345a6zoj7/mMjvuUUdp6vd6Ee705p0hSrWjWLpg98cszQ3MmZe9bF2OHJka/mnj21gzLFsHycqhXWsmJ16z94wBGPJ/hkSszXPZyPoXFNZ9r6AOJvkcFBYVGkbQWkxdPXVp1Y/G0pTQoq1djgdJW9Vg0dSmlrUvILM9QvnA59ZoUrXGD9ZoUUVCST5cD2wDQ9eB2fPTwhLUOYvp7c5n69mxG3fMZFUsqqazIEBHXpJR+/l/s2yqMIkm1omtfmDY2MeOzRLN2MOS+DD+556s/4wjgJ3d/udxLf8+e+fmqIPrs3cRffpjhkqfzadxq1fAZcm+GE672ZLn0FYbN+3wxCyYtpkGrEj55ajL7X79zjQU6D2jNmH9PpHWfZnz6zBTa7d5irR+9ExF07t+ayW/Nov3uLZk0dCZNuzZc6yCqP+fof01g5sh5jLh73EYNIjCKJNWS/ILglD/kcdVBlWQqof+peXTYLnjg0kq67BLs8u08Ph2WuOGoShbPhXceTzx0WYbrR639x9Tdgyt5/Z5E+RI4u/1y+p8eHHt5PndflD2r9H/HZv8qrUXH4KLHsiE1Y3xi9kTYdh/PEklrk1Jaftht/XjitKGkTKLH0R1ptnUj3vrdR7TcvglbDWhDj2M68cLgd7j7wOep17iQA27cpWr9uwY8S/ni5VRWZPjshakcfns/mnVrxO4X9OSFi9/h9atGUtKsiP65j/mYMWIuT5/zFssWVDD+xWkM+8Nojn9iQK3t7wZ9zIfvU7R66/s+RX7MhySpLqzpYz5W5+wxR34jX6v8mA9JkqSviVEkSZKEUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBEBBXQ9gSzaIiqjrMUiStDa3dv/3FvNa5ZkiSZIkjCJJkiTAKJIkSQKMIkmSJMAokiRJAowiSZIkwCiSJEkCjCJJkiTAKJIkSQKMIkmSJMCP+ahTj992XqrrMUiStCkaeObNG/3jRzxTJEmShFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEkAFNT1ADbUcftuS8cu21TdHnzlLbRq074ORyRJkjZlm2wUFRXX4/o7Hq3rYUiSpM2El88kSZLYhM8UlS/7ggtPPQKAVm3aM/jKW+p4RJIkaVO2yUaRl88kSdLG5OUzSZIkjCJJkiTAKJIkSQI24Si665l363oIkiRpM7LJRpEkSdLGZBRJkiRRR1H07puvcO53D+KcEw7gkbtuW+XxD98bxkWnHcVx/Xsy9KWnq+6fOW0yF512FBeeegTnn3wYzzx67yrrXvPzH/HT7x++yv2P3XcHx+zdnQXz5gDw1qvP87MfDOTCU49g8Bnf4aMPhm/EPZQkSZuaWn+fosrKSv560xVceuPfaNayjJ+feQy77DmADp27VS3ToqwNP/7F1Tx23x011m3SvCVX/fF+CouKWLpkMT/7wUD6fmsAzVqUAfDGy89Sr36DVZ5z1vSpvD/sdVqUta26b4ed+9F3z/2ICMZ/OpobLzuf39319CrrSpKkLUOtnyn65KMPaN2uE2VtO1BYWMS39juMYa+9UGOZVm3a07lrD/Ki5vAKC4soLCoCYHlFOSmTqXps6ZLFPPHA3zj65LNWec6//+FqTjrrIiKi6r6S+g2qbi9bupQgVllPkiRtOWr9TNGcWdNp0ap11e3mLcsY++EH67z+rOlTueriM5k2eQInnTW46izRfbffzMBBp1JcXK/G8m+9+jzNWrSic7ceq2zrzVee4+7bbmDB3Dlccu2fN3CPJEnS5mCTm2jdoqwNN/79cf5w77O8/PQjzJszi8/GfsT0yRPYbe8Daiy77Iul/OuuPzPotPNWu63d9j6A3931NIOvvIX7br+5NoYvSZK+oWo9ipq1KGPWjGlVt2fPnE6zlmUbtJ0OXbbmow+G8/God/l0zEjOOm4AvzrnRKZOHM+l557EtMkTmDF1EheeegRnHTeA2TOnMfj07zB39swa2+rZuy/Tp0ysmoQtSZK2PLV++axbjx2YOmk806dMpFnLMl5/4UnOv/SGdVp39oxplDZuQnFxPRYtnM/oD97h8GN/QL99D+agI08EYMbUSVz98x9xxe/uBOCOx4ZWrX/WcQO49raHaNSkGVMnfU7rdh2JCMaNGcXyinIaNm668XdYkiRtEmo9ivILCjj9/Ev5zYWnk8lUMuDQo+mw1dbcd/vNdO2+PX333I9PPvqA3/7qHBYvXMDwIS9y/x2/5//++SSTPv+Uf9xyDRFBSolvH38qnbp236BxvPHyM7z8zKMUFBRQVFyPn15+U42J2JIkacsSKaX1XunhVz9e/5W2AEfvtc16VdXjt53ncZQkaQMMPPPmjX4mY5ObaC1JkvR1MIokSZIwiiRJkgCjSJIkCTCKJEmSAKNIkiQJMIokSZIAo0iSJAkwiiRJkoA6+JgPSfqmu/LWJ5g1dyHlFZUMHNCbg/fevq6HJKkWGEWStJJzv78/DRvUY1n5ci64+j722KkrjUpL6npYkr5mRpEkreTx/7zHG++NA2DWnEVMmTHPKJK2AEaRJFUzYswk3v9oItddfCzFRYX84oaHqaiorOthSaoFTrSWpGoWL11Gaf1iiosKmTRtDmPGTavrIUmqJUaRJFWz83adqMwkzr7sTv7xryF079K6rockqZZ4+UySqiksLODyc4+o62FIqgOeKZIkScIokiRJAowiSZIkwDlFkjYjb48cz18feIXKTOLAPbfjmIN3WWWZ14Z/zL1PvAkEW7VvwYWnHwzA3x9+neEjPwNg0KG7slffbQBIKXHXo0N5/e1PyMsLDtlnBwYO6E1Kib/c/wrDR46nuKiA839wAF07tgJg5pyF/P6fzzNr7iIi4NJzjqCsRaPaOQiSNphRJGmzUJnJ8Od7X+KK84+iedNSLrj6fnbttRUd2zavWmbK9Hk8+PRwrr3oWEob1GPegiUADBvxGZ9OnMHNvzqRiuWV/OKGh9l5+07ULynmhSEfMWvuIm7935PIy4uqdd4e+TlTZszjz78+mTGfTeOPd7/I9ZcMAuCmvz3LsYf0pU/Pjiz9opy8vKj9AyJpvXn5TNJmYexn02nTqgmtWzamsCCfvXbZmjffH1djmWdeG8lh+/aitEE9AJo0qg/AxClz2G7rduTn51GvuJDO7VvwzqjPAfh/r4xg0GG7VoXNinXefH8c/XfvQUTQo0sbFi9dxpz5i5kwZTaVlRn69OwIQEm9IoqLCmvlGEj673imSNJmYfa8RbRoWlp1u0XTUsZ8Nr3GMlOmzwNg8G8fJJPJcMLhu7Hz9p3ZqkML7n3iLY46oA/LypczYswkOrRpBsC0mfN5bfhY3nj3Uxo1LOHMQfvQtqwJs+ctomWzhlXbbt6klNlzFzF73iIa1C/mqj8+yfTZ8+ndoyMnf2cP8vP8HVT6pvP/UklbjMpMhqkz5nHVBd/hwtMP5pa7/sOiJcvo07MTu2zfmcHXPsh1f32aHl3akBfZM0MVyyspLMznxl8ez4F7bsfv/vn82p+jMsOHY6dw6jF7cuMlxzNt1nxeGPJRbeyepP+SUSRps9C8SSmz5i6quj1r7iKaN2lQY5kWTUvZtVcXCvLzad2iMW1bNWHqjHkAHHdoX27+nxP59flHkVKiXVnTqu3269MVgH59ujJ+0qyq+2fOWVi17dnzFtG8aSnNm5ayVYcWtG7ZmPz8PHbv3YVxE2Z8nbsuaSMxiiRtFrbuXMaUGfOYNms+FcsreXX4WHbbsUuNZXbbsQsjPp4EwIJFS5kyYx5lLRpRmcmwYNFSAD6bNIvxk2dVzQnavXcXRozJrjPy48m0LWsCwK47bsWLb4wmpcTocVOpX1JMs8YN2LpzGYuXljN/YXZC9gejv7wUJ+mbzTlFkjYL+fl5/PD4fbn85kfJZDLs/63t6Ni2OXc/9gbdOrVitx27sNN2nXjvwwn8+PI7yYs8fnD0njQqLaG8YjmXXP8QkJ0Y/bNTDyI/P/s749EH78KNtz/DY8+/R73iQn5y0n4A7LJ9Z94eMZ4f/uofFBcVcu7398+OIy+PU47ek1/d9Agk6NqpFQfutX3dHBRJ6yVSSuu90sOvfrz+K20Bjt5rm/X6u9vHbzvP4yhJ0gYYeObNG/29Lrx8JkmShFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEQKSU6noMkiRJdc4zRZIkSRhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSYBRJEmSBBhFkiRJgFEkSZIEGEWSJEmAUSRJkgQYRZIkSQD8f22VbxmRrHQ5AAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 720x720 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "results.plot_sobols_treemap('g1', figsize=(10, 10))\n",
    "plt.axis('off');"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "talented-promise",
   "metadata": {},
   "source": [
    "Alternatively you can get the Sobol index values using the method call below."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "explicit-catering",
   "metadata": {},
   "outputs": [],
   "source": [
    "results.sobols_first()"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.6"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}