lessons/3-NeuralNetworks/05-Frameworks/IntroPyTorch.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "En2vX4FuwHlu"
      },
      "source": [
        "## Introduction to PyTorch\n",
        "\n",
        "> This notebook is a part of [AI for Beginners Curricula](http://github.com/microsoft/ai-for-beginners). Visit the repository for complete set of learning materials.\n",
        "\n",
        "### Neural Frameworks\n",
        "\n",
        "We have learnt that to train neural networks you need:\n",
        "* Quickly multiply matrices (tensors)\n",
        "* Compute gradients to perform gradient descent optimization\n",
        "\n",
        "What neural network frameworks allow you to do:\n",
        "* Operate with tensors on whatever compute is available, CPU or GPU, or even TPU\n",
        "* Automatically compute gradients (they are explicitly programmed for all built-in tensor functions)\n",
        "\n",
        "Optionally:\n",
        "* Neural Network constructor / higher level API (describe network as a sequence of layers)\n",
        "* Simple training functions (`fit`, as in Scikit Learn)\n",
        "* A number of optimization algorithms in addition to gradient descent\n",
        "* Data handling abstractions (that will ideally work on GPU, too)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "8cACQoFMwHl3"
      },
      "source": [
        "### Most Popular Frameworks\n",
        "\n",
        "* Tensorflow 1.x - first widely available framework (Google). Allowed to define static computation graph, push it to GPU, and explicitly evaluate it\n",
        "* PyTorch - a framework from Facebook that is growing in popularity\n",
        "* Keras - higher level API on top of Tensorflow/PyTorch to unify and simplify using neural networks (Francois Chollet)\n",
        "* Tensorflow 2.x + Keras - new version of Tensorflow with integrated Keras functionality, which supports **dynamic computation graph**, allowing to perform tensor operations very similar to numpy (and PyTorch)\n",
        "\n",
        "In this Notebook, we will learn to use PyTorch. You need to make sure that you have recent version of PyTorch installed - to do it, follow the [instructions on their site](https://pytorch.org/get-started/locally/). It is normally as simple as doing\n",
        "```\n",
        "pip install torch torchvision\n",
        "```\n",
        "or\n",
        "```\n",
        "conda install pytorch -c pytorch\n",
        "```"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 36
        },
        "id": "xwqVx9-bwHl3",
        "outputId": "7fdf1bd8-a54b-4eb0-cb09-dbb81a42d99c",
        "tags": []
      },
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "'1.11.0+cu113'"
            ],
            "application/vnd.google.colaboratory.intrinsic+json": {
              "type": "string"
            }
          },
          "metadata": {},
          "execution_count": 10
        }
      ],
      "source": [
        "import torch\n",
        "torch.__version__"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "6tp2xGV7wHl4"
      },
      "source": [
        "## Basic Concepts: Tensor\n",
        "\n",
        "**Tensor** is a multi-dimensional array. It is very convenient to use tensors to represent different types of data:\n",
        "* 400x400 - black-and-white picture\n",
        "* 400x400x3 - color picture \n",
        "* 16x400x400x3 - minibatch of 16 color pictures\n",
        "* 25x400x400x3 - one second of 25-fps video\n",
        "* 8x25x400x400x3 - minibatch of 8 1-second videos"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "qG2bsaR7wHl4"
      },
      "source": [
        "### Simple Tensors\n",
        "\n",
        "You can easily create simple tensors from lists of np-arrays, or generate random ones:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "ybpnk08HwHl4",
        "outputId": "377e6e25-bc5a-4d2e-fe8e-17dac1d20c2c",
        "trusted": true
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "tensor([[1, 2],\n",
            "        [3, 4]])\n",
            "tensor([[ 0.8995, -1.6137,  1.4489],\n",
            "        [-0.2796, -2.1443, -2.4618],\n",
            "        [-0.2358, -0.4249, -0.0716],\n",
            "        [-0.1267, -0.6382,  0.0593],\n",
            "        [-0.4956,  1.7054,  0.3874],\n",
            "        [ 1.3479, -1.6329,  0.2793],\n",
            "        [ 1.1211, -1.5430,  0.7186],\n",
            "        [-1.5197,  0.5559, -1.6421],\n",
            "        [ 0.1900, -0.4175, -0.3922],\n",
            "        [ 1.8994,  0.1497, -0.7039]])\n"
          ]
        }
      ],
      "source": [
        "a = torch.tensor([[1,2],[3,4]])\n",
        "print(a)\n",
        "a = torch.randn(size=(10,3))\n",
        "print(a)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "AXFMsV3r09Ux"
      },
      "source": [
        "You can use arithmetic operations on tensors, which are performed element-wise, as in numpy. Tensors are automatically expanded to required dimension, if needed. To extract numpy-array from tensor, use `.numpy()`:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "e5Nu5Xgj1DnQ",
        "outputId": "c1fbcd86-dde6-40b6-8edf-7a37f9d60901"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "tensor([[ 0.0000,  0.0000,  0.0000],\n",
            "        [-2.0583, -0.5631,  1.4932],\n",
            "        [-1.0613, -1.0738,  2.2078],\n",
            "        [-1.5101,  0.5896,  2.4722],\n",
            "        [-2.8219, -2.0846,  1.2405],\n",
            "        [ 0.8706, -0.2485,  2.3679],\n",
            "        [-1.6590,  0.1935,  1.8698],\n",
            "        [-0.3316,  0.8065,  1.6490],\n",
            "        [-1.5788, -1.1844, -0.4816],\n",
            "        [ 0.0680, -1.4526,  1.8159]])\n",
            "[3.887189   2.1276016  0.17371987]\n"
          ]
        }
      ],
      "source": [
        "print(a-a[0])\n",
        "print(torch.exp(a)[0].numpy())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "uQ5zN6cVyrG7"
      },
      "source": [
        "## In-place and out-of-place Operations\n",
        "\n",
        "Tensor operations such as `+`/`add` return new tensors. However, sometimes you need to modify the existing tensor in-place. Most of the operations have their in-place counterparts, which end with `_`:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "Mjkbcw3-ACKS",
        "outputId": "ca021008-9ab6-4b09-c5a5-bbe854cd1493"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Result when adding out-of-place: tensor(8)\n",
            "Result after adding in-place: tensor(8)\n"
          ]
        }
      ],
      "source": [
        "u = torch.tensor(5)\n",
        "print(\"Result when adding out-of-place:\",u.add(torch.tensor(3)))\n",
        "u.add_(torch.tensor(3))\n",
        "print(\"Result after adding in-place:\", u)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "DLPUcVsXACKT"
      },
      "source": [
        "This is how we can compute the sum or all rows in a matrix in a naive way:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "7pu0UZ-_yqfB",
        "outputId": "bd2e8c6a-39e1-4f29-990b-9591e866936c"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "tensor([ 3.4945,  2.5325, -2.8684])\n"
          ]
        }
      ],
      "source": [
        "s = torch.zeros_like(a[0])\n",
        "for i in a:\n",
        "  s.add_(i)\n",
        "\n",
        "print(s)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "rIh1EHcezlNo"
      },
      "source": [
        "But it is much better to use"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "aQIdWZ1kzn6P",
        "outputId": "89000bb4-f45e-493b-a7b0-39fa4e7d92c1"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "tensor([ 3.4945,  2.5325, -2.8684])"
            ]
          },
          "execution_count": 6,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "torch.sum(a,axis=0)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "5UzUmEZhACKT"
      },
      "source": [
        "You can read more on PyTorch tensors in the [official documentation](https://pytorch.org/tutorials/beginner/basics/tensorqs_tutorial.html)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "U-auwezDwHl6"
      },
      "source": [
        "## Computing Gradients\n",
        "\n",
        "For back propagation, you need to compute gradients. We can set any PyTorch Tensor's attribute `requires_grad` to `True`, which will result in all operations with this tensor being tracked for gradient calculations. To compute the gradients, you need to call `backward()` method, after which the gradient will become available using `grad` attribute:\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "m8vFOXr7wHl6",
        "outputId": "7054c2b1-0b61-4938-937d-813f75f0b195",
        "trusted": true
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "tensor([[-0.1728,  0.0913],\n",
            "        [-0.1666, -0.1942]])\n"
          ]
        }
      ],
      "source": [
        "a = torch.randn(size=(2, 2), requires_grad=True)\n",
        "b = torch.randn(size=(2, 2))\n",
        "\n",
        "c = torch.mean(torch.sqrt(torch.square(a) + torch.square(b)))  # Do some math using `a`\n",
        "c.backward() # call backward() to compute all gradients\n",
        "# What's the gradient of `c` with respect to `a`?\n",
        "print(a.grad)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "nPj3rtrtACKU"
      },
      "source": [
        "To be more precise, PyTorch automatically **accumulates** gradients. If you specify `retain_graph=True` when calling `backward`, computational graph will be preserved, and new gradient is added to the `grad` field. In order to restart computing gradients from scratch, we need to reset `grad` field to 0 explicitly by calling `zero_()`:  "
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "z_VIw8MoACKU",
        "outputId": "36a28b11-6919-47ab-c3f9-c7f1d8500423"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "tensor([[-0.5185,  0.2739],\n",
            "        [-0.4998, -0.5826]])\n",
            "tensor([[-0.1728,  0.0913],\n",
            "        [-0.1666, -0.1942]])\n"
          ]
        }
      ],
      "source": [
        "c = torch.mean(torch.sqrt(torch.square(a) + torch.square(b)))\n",
        "c.backward(retain_graph=True)\n",
        "c.backward(retain_graph=True)\n",
        "print(a.grad)\n",
        "a.grad.zero_()\n",
        "c.backward()\n",
        "print(a.grad)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "HM9sUkVgCiG9"
      },
      "source": [
        "To compute gradients, PyTorch creates and maintains **compute graph**. For each tensor that has the `requires_grad` flag set to `True`, PyTorch maintains a special function called `grad_fn`, which computes the derivative of the expression according to chain differentiation rule:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "PcxHb-7jC7Vv",
        "outputId": "3b3fa138-6d09-4636-8a71-f4a4051c7827"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "tensor(0.9143, grad_fn=<MeanBackward0>)\n"
          ]
        }
      ],
      "source": [
        "print(c)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "rvLfNiblACKV"
      },
      "source": [
        "Here `c` is computed using `mean` function, thus `grad_fn` point to a function called `MeanBackward`.\n",
        "\n",
        "In most of the cases, we want PyTorch to compute gradient of a scalar function (such as loss function). However, if we want to compute the gradient of a tensor with respect to another tensor, PyTorch allows us to compute the product of a Jacobian matrix and a given vector.\n",
        "\n",
        "Suppose we have a vector function $\\vec{y}=f(\\vec{x})$, where\n",
        "$\\vec{x}=\\langle x_1,\\dots,x_n\\rangle$ and\n",
        "$\\vec{y}=\\langle y_1,\\dots,y_m\\rangle$, then a gradient of $\\vec{y}$ with respect to $\\vec{x}$ is defined by a **Jacobian**:\n",
        "\n",
        "$$\n",
        "\\begin{align}J=\\left(\\begin{array}{ccc}\n",
        "   \\frac{\\partial y_{1}}{\\partial x_{1}} & \\cdots & \\frac{\\partial y_{1}}{\\partial x_{n}}\\\\\n",
        "   \\vdots & \\ddots & \\vdots\\\\\n",
        "   \\frac{\\partial y_{m}}{\\partial x_{1}} & \\cdots & \\frac{\\partial y_{m}}{\\partial x_{n}}\n",
        "\\end{array}\\right)\\end{align}\n",
        "$$\n",
        "\n",
        "Instead of giving us access to the whole Jacobian, PyTorch computes the product $v^T\\cdot J$ of Jacobian with some vector\n",
        "$v=(v_1 \\dots v_m)$. In order to do that, we need to call ``backward`` and pass `v` as an argument. The size of `v` should be the same as the size of the original tensor, with respect to which we compute the gradient.\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "VUNYiQCOACKV",
        "outputId": "e3127c21-fce6-420d-f347-ec40cc827e7e"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "tensor([[-0.8642,  0.0913],\n",
            "        [-0.1666, -0.9710]])\n"
          ]
        }
      ],
      "source": [
        "c = torch.sqrt(torch.square(a) + torch.square(b))\n",
        "c.backward(torch.eye(2)) # eye(2) means 2x2 identity matrix\n",
        "print(a.grad)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "dGHlkVlvACKV"
      },
      "source": [
        "More on computing Jacobians in PyTorch can be found in [official documentation](https://pytorch.org/tutorials/beginner/basics/autogradqs_tutorial.html)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "FnVvj4LkD15r"
      },
      "source": [
        "# Example 0: Optimization Using Gradient Descent\n",
        "\n",
        "Let's try to use automatic differentiation to find a minimum of a simple two-variable function $f(x_1,x_2)=(x_1-3)^2+(x_2+2)^2$. Let tensor `x` hold the current coordinates of a point. We start with some starting point $x^{(0)}=(0,0)$, and compute the next point in a sequence using gradient descent formula:\n",
        "$$\n",
        "x^{(n+1)} = x^{(n)} - \\eta\\nabla f\n",
        "$$\n",
        "Here $\\eta$ is so-called **learning rage** (we will denote it by `lr` in the code), and $\\nabla f = (\\frac{\\partial f}{\\partial x_1},\\frac{\\partial f}{\\partial x_2})$ - gradient of $f$.\n",
        "\n",
        "To begin, let's define starting value of `x` and the function `f`:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "nDw5mV9KEeOa"
      },
      "outputs": [],
      "source": [
        "x = torch.zeros(2,requires_grad=True)\n",
        "f = lambda x : (x-torch.tensor([3,-2])).pow(2).sum()\n",
        "lr = 0.1"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Wt815LWdEj77"
      },
      "source": [
        "Now let's do 15 iterations of gradient descent. In each iteration, we will update `x` coordinates and print them, to make sure that we are approaching the minimum point at (3,-2):"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "KfwMf555EyWJ",
        "outputId": "67e2199c-61ff-4ad1-9c48-b4a646bf8bbd"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Step 0: x[0]=0.6000000238418579, x[1]=-0.4000000059604645\n",
            "Step 1: x[0]=1.0800000429153442, x[1]=-0.7200000286102295\n",
            "Step 2: x[0]=1.4639999866485596, x[1]=-0.9760000705718994\n",
            "Step 3: x[0]=1.7711999416351318, x[1]=-1.1808000802993774\n",
            "Step 4: x[0]=2.0169599056243896, x[1]=-1.3446400165557861\n",
            "Step 5: x[0]=2.2135679721832275, x[1]=-1.4757120609283447\n",
            "Step 6: x[0]=2.370854377746582, x[1]=-1.5805696249008179\n",
            "Step 7: x[0]=2.4966835975646973, x[1]=-1.6644556522369385\n",
            "Step 8: x[0]=2.597346782684326, x[1]=-1.7315645217895508\n",
            "Step 9: x[0]=2.677877426147461, x[1]=-1.7852516174316406\n",
            "Step 10: x[0]=2.7423019409179688, x[1]=-1.8282012939453125\n",
            "Step 11: x[0]=2.793841600418091, x[1]=-1.8625609874725342\n",
            "Step 12: x[0]=2.835073232650757, x[1]=-1.8900487422943115\n",
            "Step 13: x[0]=2.868058681488037, x[1]=-1.912039041519165\n",
            "Step 14: x[0]=2.894446849822998, x[1]=-1.929631233215332\n"
          ]
        }
      ],
      "source": [
        "for i in range(15):\n",
        "    y = f(x)\n",
        "    y.backward()\n",
        "    gr = x.grad\n",
        "    x.data.add_(-lr*gr)\n",
        "    x.grad.zero_()\n",
        "    print(\"Step {}: x[0]={}, x[1]={}\".format(i,x[0],x[1]))"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "8sfjBMBu59B5"
      },
      "source": [
        "## Example 1: Linear Regression\n",
        "\n",
        "Now we know enough to solve the classical problem of **Linear regression**. Let's generate small synthetic dataset:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "j723455WwHl7",
        "trusted": true
      },
      "outputs": [],
      "source": [
        "import numpy as np\n",
        "import matplotlib.pyplot as plt\n",
        "from sklearn.datasets import make_classification, make_regression\n",
        "from sklearn.model_selection import train_test_split\n",
        "import random"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 282
        },
        "id": "WJNK_J6v6I-Z",
        "outputId": "09e6386e-a6d4-4b81-c8d2-153f0acf9696"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "<matplotlib.collections.PathCollection at 0x20b8e1f1ca0>"
            ]
          },
          "execution_count": 14,
          "metadata": {},
          "output_type": "execute_result"
        },
        {
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAWoAAAD4CAYAAADFAawfAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjQuMiwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8rg+JYAAAACXBIWXMAAAsTAAALEwEAmpwYAAAbVklEQVR4nO3df4ylVXkH8O+zw0XuAjJaphVGx8XULKkQdtmJoZnGyGrFij82YNTGtKltsmmTNkIo7egfRf9iEmPVxqbNxNJqSnVpFzYGVDRZDHWj2Bl2EZClUXErs7aMZQfEmbqzw9M/7n2XO++85z3nve857z3n3u8n2bC795075903PPfMc57zHFFVEBFRvLYNegBERFSOgZqIKHIM1EREkWOgJiKKHAM1EVHkzgnxphdffLHu2LEjxFsTEQ2lxcXFn6nqRNFrQQL1jh07sLCwEOKtiYiGkoicML3G1AcRUeQYqImIIsdATUQUOQZqIqLIMVATEUUuSNUHEdEoOXR0CZ+4/0mcXFnDpeNt3HrdTuzbPent/RmoiYhqOHR0CR+5+1GsrW8AAJZW1vCRux8FAG/BmqkPIqIaPnH/k2eDdGZtfQOfuP9Jb9+DgZqIqIaTK2uV/r4fDNRERDVcOt6u9Pf9YKAmIkIn1zwzdxiXzd6HmbnDOHR0yenrbr1uJ9qtsU1/126N4dbrdnobGxcTiWjk1VkQzF5n1QcRUUBlC4IuAXff7kmvgTmPqQ8iGnlNLAjWYQ3UIrJTRI71/HpeRG5qYGxERI1oYkGwDmugVtUnVXWXqu4CsAfAKoB7Qg+MiKgpTSwI1lE1R/0WAD9UVWODayKi1FRZEOzdLn5RuwURYGV1PcgiYkZU1f1ikTsAPKyqny14bT+A/QAwNTW158QJxnIiGi756pC8dmsMt99wZV/BWkQWVXW66DXnxUQRORfAuwH8a9HrqjqvqtOqOj0xUXjsFxFR9MrqqYuqQ3r53jqeqZL6+B10ZtP/430UREQRsNVTu1SBhKgUqVKe97sAvuh9BEREkbA1WHKpAglRKeIUqEVkO4DfBnC39xEQEUXCVk9dVB3SK1SliFPqQ1VXAfyK9+9ORBSRS8fbWCoI1tksOV8d0lTVB7eQExF13Xrdzi1VHflZcujt4kUYqImIupposNQPBmoioh6DmDHbsCkTEVHkGKiJiCLHQE1EFDnmqIloJPQ2U4plkdAVAzURDYWyQNzvUVvZey6trGFMBBuqmBxAkGegJqJKYpyZlgViALjlrkewkesUajtqK/+e2ddXOU/Rl0ptTl1NT0/rwsKC9/closEqavNZp7WnLzNzhwt3FI63W/jlmRdLO95NjrcLP3RM79n7dUdm99YffJeXNqdERLamRYNi6tGxsrZeGqQFnRmy4qWZctbW1NYFr8nzFBmoichZrIfA9tOxTgDk8wlVOuU1eZ4iAzUROTMFp4vaLWOz/SaYzjx8xfZW4fVjIluCdMalU17T5ykyUBORs6Lg1dom+MXpM8YUQgj5U1gA4PYbrsTkeBuCTv749huuxG3vekNhAP/k+67CpOXk8X27J8++J9AJ7uh5b1Z9EFGUipoWrZ4+g1Or65uus1VU1GGq8Lj9hiuNi3umKpUYO+UVYdUHEdVy2ex9hWkEAfDU3PXev5+pGqOfKoyYSg3Lqj44oyaiWmzN9n3zuaAZy4zZhjlqIqrFtJAXarHN9AHQZBVG0xioiaiW3kW33oW8UDPVpj8YYsDUBxHV1mQKIdZTWEJyCtQiMg7gcwCuQKdG/A9V9dsBx0VEZJRKbtkX1xn1ZwB8TVXfKyLnAtgecExERIViqtJokjVQi8jLAbwJwB8AgKqeBnA67LCIiDbrt1XpMHBZTHwdgGUA/ygiR0XkcyJyfv4iEdkvIgsisrC8vOx9oEQ0WPndgE1vE4+1IVQTXAL1OQCuBvB3qrobwC8AzOYvUtV5VZ1W1emJiQnPwySiQcpms01uE+/93mUtRwfdEKoJLjnqpwE8raoPdf/8bygI1EQ0vEyz2Y99+fHSU1Xq5pOL+l/nDXP9dMYaqFX1v0XkJyKyU1WfBPAWAN8PPzQiikVZv+eVtU6fj/ypKj7yyUUfEL2GvX4641r18WcA7uxWfPwIwIfCDYmIYmPaJp7XmzM25ZOrBOqytMYgzi4cFKdArarHABQ2CyGi4XfrdTutKYhMWXCtmk82fUD4PgYrdtxCTkRWRdvETU35Lx1vO/XjcKkiGcXt4kW4hZyInOR3A5oOus2CaNlrLjXR2WLk2voGxkSwoTpS6Y5eDNREI6xOZYZLzw3Ta2U10ft2T24J5BuqZwP9qAVpgAcHEI0s04y4iWOmTIcNAJ20imnhsig3PSzbyssODmCOmmhEDXKnnymHLUBpdUl+MXKQG3GaxEBNNKJ8npRSVdEioQDGWXYmH+BHZVs5AzXRkDNVV5hmtQoE7+WRryIZb7esQbqo2mOQHzZN4mIi0RArq64oq4323ZnOlEfuXTgsY6r2aPq8xkFhoCYaQllgLApiWWogW5SzXVc3UNtK8cq2idsWN4s+bNqtMVx7+QRm5g4nv8CYYeqDyINBtwDNjyVbYDPJUgP7dk/iyOxeiOW6Omx55LLvYatAKdqIc+OeSRxcXBqqBUbOqIlqiq2hva2REbA1NeAzhZBPc9jak5ZtE3f598tvxJmZO+ylz0hMOKMmqmkQlQdlM3jbLLhoUc7XVu2icjnTbD37EPC9TdxlgTGmn4BccEZNVFPTlQe2GXzZLHZMZNOHSDbD9HWyd9GHlqK49G719BkcOrrk/VRx208Hsf0E5IKBmqimpisPbNuvixbYWtsEEGB9oxMui4KTj5O9TR9Oik4JXta7GgBOra5vGoOvIGlaYMxm6LZ/vxgx9UFUU9Md3mwz+KIFtgvOO+dskM6Y0jN10gKmD6fJ8TbOf9nWeWGIFFHR/fcuSqZYe80ZNVFNvn90t3GZwednqJfN3lf4XqYt2f2mBcpmszcfOOY0Bh/KZugp1l5zRk3kQVbm9tTc9Tgyuzfoj9D9zOBd+kMD9RdGy2azrmMILcUe15xREyWmnxm8LW+b8ZEWMM1mXccQWtM/AfnAQE2UoKqLb67BKWRaIKYA6XPxsgnsR00UqUH0WR5kj+pRV9aPmjNqoggNqtY3plkvvcQpUIvIjwH8HMAGgDOmqE9Efgyy1je1tMAoqDKjvlZVfxZsJER0Voq1vhQOUx9EEcjno8e3t3BqdX3LdTHX+lI4rnXUCuDrIrIoIvuLLhCR/SKyICILy8vL/kZINOSKGhm98H9n0Brb3M4o9lpfCsd1Rj2jqidF5FcBfENEjqvqg70XqOo8gHmgU/XheZxEQyM/e149fWZLPnr9RcV4u4XzX3YOF/XILVCr6snuf58RkXsAvBHAg+VfRUR5RdUcJs+trePYbW9ramgUMWvqQ0TOF5ELs98DeBuAx0IPjGgYuTT1zzAfTRmXGfWvAbhHRLLr/0VVvxZ0VERDyrVqg/lo6mUN1Kr6IwBXNTAWoqFn2qLNfDSVYXkeJWkQ26t9MDUm+ti732Acf++9XtRuQQRYWV1P6r6pHgZqSk6T26ttHwhVPzCqbtHO32vvCSlF953qBxiVY1MmSs7M3GHjqdVHZvd6+z62BkVNNDAy3Wuv7L7ZUCltZU2ZeHAAJaep7dW2JvpNnD7uck/ZNYM4DZ2awUBNyWnqpBDbB0ITHxgu95Rdw/4gw4uBmpLT1FFKtg+EJj4wiu61V+99x3LUFfnHQE3JsZ0y7YvtA6GJD4z8vY63W3jF9lbhfYcYT50TyckfLiYSlfBd9THo8VZ9Ly5ONqdsMZGBmihxoT4smqquoQ4exUWUiKpBN2RNORcn48EcNVHOoPKyRX2pP3L3o6XfP2RJHhcn48FATUkJHUT7CZau72sbdz9BN+Sst6nqGrJjoKZkhAqivULMUF3H3U/QDTnrbaq6huyYo6ZkNHEyd4gZquu4TZ31yoKuqcmTr1kvTySPAwM1JaOpnYBVg6WNaXxLK2uYmTt8duHw2ssncHBxqVLQrdrkidLEQE3JCBFE80LMUE3jFrx0FNfSyhoOLi7hxj2TeOD4cqWgy1nv8GOgpmSE/jEfKJ+h9luvXDRuAZDfwbC2voEHji83UqMc20YdKscNL5SUQQWYol16APCK7S3c9q7ipv9lDf9NrUsFwFNz14e4hU3j4o7D+HDDCw0N24/5oQK56VDaU6vrhRtMihr+t1tj+NT7d2Hf7knjrr8mapSbWJQlv1ieR17E0LwnZPle2YJlUfmercxvkDXK3HGYHudALSJjInJURO4NOSBKTxP1zS5MwfGWux6pPRbbTDcf5GzBcJA1ytxxmJ4qqY8PA3gCwMsDjYUSFcuP0qbguKFau/9F0YJgr94gd+joEraJYKNg/af3ukFVazSxKEt+Oc2oReTVAK4H8Lmww6EUxfKjdNmMsO7uwmwGPN5ubXmtN8hlP10UBelYgiF3HKbHdUb9aQB/AeBC0wUish/AfgCYmpqqPTBKRxP1zS5ss966HxzZDLhswdK06DgmElUwZO11WqyBWkTeCeAZVV0UkTebrlPVeQDzQKc8z9cAKX6x/CidBZ5b7nrEmnao+31MQc70YfCiKgMj9c0l9TED4N0i8mMAXwKwV0T+OeioKCkx/Si9b/ckPvm+qwZWUcGFOgqh0oaX7oz6z1X1nWXXccMLDVpMG2O4mYRccMMLjZxB5WDZJIlC4BZyGphB9ptgrwuKDWfUFB2fZ/35Omdw4cSzlTvXETWBM2oaCFOvC6CzGOkaJKvkhLOAXtYQqff/BuaWqUllM2r2+qCBKKtprrIF3eXorENHl7Dr41/HTQeOGYM0UNx21MchsUR1MVDTQNjK1VyDpG1XZDbjXllbrz7IkvcnahIDNTnz2SGvqHtcnkuQtNUtm3YK5knF9ydqEgM1OfHdIa93k4yJS5C0tQt1CfaT42188JqpgW2SIbJh1Qc5CdEhr7d3Rr9b0G11y2WnqeQXC6df+0qW7FGUGKjJScgOeXU3iZRtbjE1aio6QouNiihWDNRDoInNG6E75IUKktwpSMOAgTpxPjeOlImlQ14/OFOm1HExMXEudcQ+xNQhj2jUcEaduCZPV2liZtqbxrmo3YJI56Tvse7RVlV2LRINCwbqxMVyuoqNSx49n8bp3aSSHQQQKrVDFDOmPhJnqyOOgWsNtuvmFG7tplHDQJ24FHLHpjz6TQeObdrhWCVdw63dNEqY+hgCsVc1uDRgAso3p+TFltohComBmrzL56PHt7dwatXcFClLZdhOEc/EltohCo2BmrwqqutubRO0xgTrG+be5ydX1rZsTmHVB1EHAzV5VZSPXn9RMd5u4fyXnWNMbWSpjKbTODySi1LAxUTyypSPfm5tHUdm9+LT798VTZWK746ARKFYA7WInCci3xWRR0TkcRH5eBMDo5f47AMdmq0/dExVKk3t6iSqyyX18UsAe1X1BRFpAfiWiHxVVb8TeGyE5np5+OLSEySWKpUmd3US1WEN1No5/faF7h9b3V/+T8SlQj77QDeRj02pW10quzqJnE4hF5ExAIsAfh3A36rqXxZcsx/AfgCYmprac+LECc9DHU2Xzd5X+KkoAJ6au975fYqa82enbhdVUozCIluVE8yJQis7hdyp6kNVNwDsEpFxAPeIyBWq+ljumnkA8wAwPT3NGbcnvmZ9RTPz7CHl0ym2dEtR46SV1fXkAnpKs38abZXK81R1RUS+CeDtAB6zXD60mpxt+uoDbcu79qZTbItspsZJsefPi8SSLycq41L1MdGdSUNE2gDeCuB44HFFq+mSLl9VEi4z8CyYly2y2RonsWqCyD+XGfUlAD7fzVNvA3CXqt4bdljxCnHIq42PWZ/L9uwsmJvSLdtEnHpxsGqCyC+Xqo/vAdjdwFiSkGJJV5aqWVvfOLsVO1tIzPSmU0xBvejrimQBfxQWJImawJ2JFdk2dMSmN1UDdIJtuzWGD14zZUynZOmWMZEt76foVIuYZAGfu/6I/GGvj4piOuTVZcZqStU8cHwZR2b3Gt973+5J3HzgWOFrWUlfWdXHzNzhxlNERMOKgbqiWEq6XHcs1knVmHLVk+Pt0iBf9/sS0WYM1H2IoaTLdVGzTh12nZ8euOuPyB/mqAML1VDJdcZa50zFOqWBKZzlSJQKzqgDCtlQyXXGWjdV0+9PD7GkiIiGgVOvj6qmp6d1YWHB+/umZmbucGEwHRPBJ993Va2gxT4VRMOldq8P6o8pPbGhWntmzRkr0ehgoA6o7FRtH6Vqvhc1uUGFKE5cTAyoaEGtV0ylatygQhQvBuqAynb4AXGVqvFYKqJ4MfURWJY6aHo3Y9U0BjeoEMWLgboBLgt/PvPD/ZQFcoMKUbwYqBtStvDnu966n1asMfUwIaLNmKOOgM/88KGjS8ZKk7I0hq8DCojIP86oI+ArP5zNzE1saYwYepgQ0VacUUfAV4/rsmOymMYgShdn1DX5WAQ05YevvXwCM3OHa1duAGAagyhhDNQ1+FoELKoKufbyCRxcXPJSuTE53maQJkrY0AbqujPdOqenuG4NL/se/ZyQwsoNouFkDdQi8hoAXwDwKgAvAphX1c+EHlgddWe6TZyeYvse/bx3P42a2N+DKH4uM+ozAG5R1YdF5EIAiyLyDVX9fuCx9a3uTLeJ01Ns36Pf965SuRGyXzYR+WOt+lDVn6rqw93f/xzAEwCi/r+4brlbE6en2L5HEyeksL8HURoqleeJyA4AuwE8VPDafhFZEJGF5eVlT8PrT91yN9evr7NJxPY9mtiAwv4eRGlwXkwUkQsAHARwk6o+n39dVecBzAOdE168jdBBPs+ar5gAqs1GqyzK9btJxOV7hN6Awv4eRGlwmlGLSAudIH2nqt4ddkjVFPVRPri4hBv3TPY9G+1nNlv1ENsYtmzzAFqiNFjPTBQRAfB5AM+q6k0ub9rkmYmmcwknx9s4Mru39vu7VEWkfH4hqz6I4lB2ZqJLoP4tAP8O4FF0yvMA4KOq+hXT14QM1PnAYmpAJACemru+8vv1BqqiACwAFJ0Pguza0B8WRDT8ah1uq6rfQic+DVxROVkWOPNc8qy28rSiqojse/Vey0U5IgopqaZMpsCZ/xRxzbPaytNsgTa71ldTJSKiIkkFalPgzFIRAmC83cJ5rW24+cAx66KebSbsEmhPrqxxUY6IgkoqUJsCZ5YL/tT7d+GXZ17EqdV1p5O0bTNh2yni2bUxVHAQ0fBKqimTrfa46tZx2/v19s4oyofnr2VgJqIQkgrUtqZDVRf1XJoY9QbgGErZYhgDETXLWp7XjybrqHsNe5lcyvXaRFSurDwvqRy1TSqLelV3MWbYRIloNCWV+rDppx9z0+q0FmW9NtFoSjpQm/K1/QZmX/nfsvep0yubTZSIRlOygdp303tf71f35JayIM+jtohGU7I5at/5Wl/vZ3ufstrtok6AvXXgrNcmGk3Rzahd0w++87W+3s/l5BbTrNglLcJ6baLRE1WgNqUNFk48iweOL28K3r7ztb7ez/Y+ZQueNx84VvieXCwkGm1RBWrTjPLO7/zXlq51N+6ZrHWKS56v/G+dk1u4WEhERaLKUZc1Xeq1tr6BB44ve83X+sr/1nmfVOrAiahZUe1MNO0sLOJ6MEBquEWcaDTVOjigSUVpgzoHA6SIi4VElBdV6qMobfDBa6aYDiCikRbVjBoonlFOv/aVTAcQ0ciKLlAXYTqAiEaZNVCLyB0A3gngGVW9IvyQwuFCHRGlyGVG/U8APgvgC2GHspXPwOq7NwgRUVOsi4mq+iCAZxsYyya2vhdVsZczEaUqqqqPXr4DK3s5E1GqvAVqEdkvIgsisrC8vFz7/XwHVtuJ40REsfIWqFV1XlWnVXV6YmKi9vv5Dqzcnk1EqYo29eEzsGaLkmvrGxgTAQCMt1s4r7UNNx84VuncQiKiplkDtYh8EcC3AewUkadF5I/CD8tfk6TeRUkA2FBFa5vgF6fP4NTqupeFSiKikKJqyhRClUZPk+NtHJndG3hERERblTVlijb14UuVxUdWgBBRjIY+UFdZfGQFCBHFaOgDddGiZGuboDUmm/6OFSBEFKskmjLVYTqjsOjvuJWciGI09IuJREQpSOKEF3a2IyIqFkWgZmc7IiKzKBYT2dmOiMgsikDNznZERGZRBGp2tiMiMosiULOzHRGRWRSLiaZaZy4kEhFFEqgBnjRORGQSReqDiIjMGKiJiCLHQE1EFDkGaiKiyDFQExFFLkj3PBFZBnCizy+/GMDPPA5nkIblXoblPgDeS4yG5T6AevfyWlWdKHohSKCuQ0QWTK3+UjMs9zIs9wHwXmI0LPcBhLsXpj6IiCLHQE1EFLkYA/X8oAfg0bDcy7DcB8B7idGw3AcQ6F6iy1ETEdFmMc6oiYioBwM1EVHkBhKoReTtIvKkiPxARGYLXhcR+Zvu698TkasHMU4XDvfyZhF5TkSOdX/91SDGaSMid4jIMyLymOH1lJ6J7V5SeSavEZEHROQJEXlcRD5ccE0Sz8XxXlJ5LueJyHdF5JHuvXy84Bq/z0VVG/0FYAzADwG8DsC5AB4B8Bu5a94B4KsABMA1AB5qepwe7+XNAO4d9Fgd7uVNAK4G8Jjh9SSeieO9pPJMLgFwdff3FwL4z4T/X3G5l1SeiwC4oPv7FoCHAFwT8rkMYkb9RgA/UNUfqeppAF8C8J7cNe8B8AXt+A6AcRG5pOmBOnC5lySo6oMAni25JJVn4nIvSVDVn6rqw93f/xzAEwDyTduTeC6O95KE7r/1C90/trq/8lUZXp/LIAL1JICf9Pz5aWx9YC7XxMB1nL/Z/THpqyLyhmaG5l0qz8RVUs9ERHYA2I3O7K1Xcs+l5F6ARJ6LiIyJyDEAzwD4hqoGfS6DOOFFCv4u/2nkck0MXMb5MDp7+F8QkXcAOATg9aEHFkAqz8RFUs9ERC4AcBDATar6fP7lgi+J9rlY7iWZ56KqGwB2icg4gHtE5ApV7V0T8fpcBjGjfhrAa3r+/GoAJ/u4JgbWcarq89mPSar6FQAtEbm4uSF6k8ozsUrpmYhIC53Adqeq3l1wSTLPxXYvKT2XjKquAPgmgLfnXvL6XAYRqP8DwOtF5DIRORfABwB8OXfNlwH8fnfl9BoAz6nqT5seqAPrvYjIq0REur9/Izr/5v/b+EjrS+WZWKXyTLpj/AcAT6jqXxsuS+K5uNxLQs9lojuThoi0AbwVwPHcZV6fS+OpD1U9IyJ/CuB+dKom7lDVx0Xkj7uv/z2Ar6CzavoDAKsAPtT0OF043st7AfyJiJwBsAbgA9pdFo6JiHwRnVX3i0XkaQC3obNIktQzAZzuJYlnAmAGwO8BeLSbDwWAjwKYApJ7Li73kspzuQTA50VkDJ0Pk7tU9d6QMYxbyImIIsediUREkWOgJiKKHAM1EVHkGKiJiCLHQE1EFDkGaiKiyDFQExFF7v8B4SC4LI9GLoEAAAAASUVORK5CYII=",
            "text/plain": [
              "<Figure size 432x288 with 1 Axes>"
            ]
          },
          "metadata": {
            "needs_background": "light"
          },
          "output_type": "display_data"
        }
      ],
      "source": [
        "np.random.seed(13) # pick the seed for reproducibility - change it to explore the effects of random variations\n",
        "\n",
        "train_x = np.linspace(0, 3, 120)\n",
        "train_labels = 2 * train_x + 0.9 + np.random.randn(*train_x.shape) * 0.5\n",
        "\n",
        "plt.scatter(train_x,train_labels)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Ng4rZmGc6oxk"
      },
      "source": [
        "Linear regression is defined by a straight line $f_{W,b}(x) = Wx+b$, where $W, b$ are model parameters that we need to find. An error on our dataset $\\{x_i,y_u\\}_{i=1}^N$ (also called **loss function**) can be defined as mean square error:\n",
        "$$\n",
        "\\mathcal{L}(W,b) = {1\\over N}\\sum_{i=1}^N (f_{W,b}(x_i)-y_i)^2\n",
        "$$\n",
        "\n",
        "Let's define our model and loss function:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "QxhI4GlB6aiH"
      },
      "outputs": [],
      "source": [
        "input_dim = 1\n",
        "output_dim = 1\n",
        "learning_rate = 0.1\n",
        "\n",
        "# This is our weight matrix\n",
        "w = torch.tensor([100.0],requires_grad=True,dtype=torch.float32)\n",
        "# This is our bias vector\n",
        "b = torch.zeros(size=(output_dim,),requires_grad=True)\n",
        "\n",
        "def f(x):\n",
        "  return torch.matmul(x,w) + b\n",
        "\n",
        "def compute_loss(labels, predictions):\n",
        "  return torch.mean(torch.square(labels - predictions))"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "JUxwj3367gD2"
      },
      "source": [
        "We will train the model on a series of minibatches. We will use gradient descent, adjusting model parameters using the following formulae:\n",
        "$$\n",
        "\\begin{array}{l}\n",
        "W^{(n+1)}=W^{(n)}-\\eta\\frac{\\partial\\mathcal{L}}{\\partial W} \\\\\n",
        "b^{(n+1)}=b^{(n)}-\\eta\\frac{\\partial\\mathcal{L}}{\\partial b} \\\\\n",
        "\\end{array}\n",
        "$$"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "-991PErM7fJU"
      },
      "outputs": [],
      "source": [
        "def train_on_batch(x, y):\n",
        "  predictions = f(x)\n",
        "  loss = compute_loss(y, predictions)\n",
        "  loss.backward()\n",
        "  w.data.sub_(learning_rate * w.grad)\n",
        "  b.data.sub_(learning_rate * b.grad)\n",
        "  w.grad.zero_()\n",
        "  b.grad.zero_()\n",
        "  return loss"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "idr2VEWb9rr0"
      },
      "source": [
        "Let's do the training. We will do several passes through the dataset (so-called **epochs**), divide it into minibatches and call the function defined above:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "nOuu0qpx-wAp"
      },
      "outputs": [],
      "source": [
        "# Shuffle the data.\n",
        "indices = np.random.permutation(len(train_x))\n",
        "features = torch.tensor(train_x[indices],dtype=torch.float32)\n",
        "labels = torch.tensor(train_labels[indices],dtype=torch.float32)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "3zdIf6c_85Ht",
        "outputId": "6520288c-da59-4a9f-c37e-cd99779c3073"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Epoch 0: last batch loss = 94.5247\n",
            "Epoch 1: last batch loss = 9.3428\n",
            "Epoch 2: last batch loss = 1.4166\n",
            "Epoch 3: last batch loss = 0.5224\n",
            "Epoch 4: last batch loss = 0.3807\n",
            "Epoch 5: last batch loss = 0.3495\n",
            "Epoch 6: last batch loss = 0.3413\n",
            "Epoch 7: last batch loss = 0.3390\n",
            "Epoch 8: last batch loss = 0.3384\n",
            "Epoch 9: last batch loss = 0.3382\n"
          ]
        }
      ],
      "source": [
        "batch_size = 4\n",
        "for epoch in range(10):\n",
        "  for i in range(0,len(features),batch_size):\n",
        "    loss = train_on_batch(features[i:i+batch_size].view(-1,1),labels[i:i+batch_size])\n",
        "  print('Epoch %d: last batch loss = %.4f' % (epoch, float(loss)))"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "JPO9xs4bToPb"
      },
      "source": [
        "We now have obtained optimized parameters $W$ and $b$. Note that their values are similar to the original values used when generating the dataset ($W=2, b=1$)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "US6q0nCBD-LL",
        "outputId": "c804b779-3231-4f6f-c854-032d211b2853"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "(tensor([1.8617], requires_grad=True), tensor([1.0711], requires_grad=True))"
            ]
          },
          "execution_count": 19,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "w,b"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 282
        },
        "id": "_e6xRMZFDnyI",
        "outputId": "79e6c360-265a-401d-ce39-8f211917a13d"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "[<matplotlib.lines.Line2D at 0x20b8e30a850>]"
            ]
          },
          "execution_count": 20,
          "metadata": {},
          "output_type": "execute_result"
        },
        {
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAWoAAAD4CAYAAADFAawfAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjQuMiwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8rg+JYAAAACXBIWXMAAAsTAAALEwEAmpwYAAArG0lEQVR4nO3deXhU1f3H8fdJiBBBCSKLBBGUxQUEBK02rmhdQePSuvxcaq1YxSouSLQu4BpFpXWpihbBrW5IQEGpNoqIoobFFVFBUYMKFMMaIAnn98fNxGEyy53Mncm94fN6njwNmTt3zvU+/d4z53zP9xhrLSIi4l9Zjd0AERGJT4FaRMTnFKhFRHxOgVpExOcUqEVEfK5ZOk668847265du6bj1CIiTdLcuXNXWmvbRXstLYG6a9eulJWVpePUIiJNkjFmaazXNPQhIuJzCtQiIj6nQC0i4nMK1CIiPqdALSLic2nJ+hAR2ZaUzC9nzIxFLKuopFNeLiOO6UVh/3zPzq9ALSKSgpL55Vz70idUVtUAUF5RybUvfQLgWbDW0IeISArGzFhUF6RDKqtqGDNjkWefoUAtIpKCZRWVSf29IRSoRURS0CkvN6m/N4QCtYgIzlhzQXEp3YqmUVBcSsn8clfvG3FML3Jzsrf6W25ONiOO6eVZ2zSZKCLbvFQmBEOvK+tDRCSN4k0Iugm4hf3zPQ3MkTT0ISLbvExMCKYiYaA2xvQyxiwI+1ljjBmegbaJiGREJiYEU5EwUFtrF1lr+1lr+wEDgA3A5HQ3TEQkUzIxIZiKZMeojwQWW2tjFrgWEQmaZCYEw5eLt87NwRio2FCVlknEEGOtdX+wMeOBedbaB6K8NhQYCtClS5cBS5cqlotI0xKZHRIpNyebO07p06BgbYyZa60dGO0115OJxpjtgBOBF6K9bq0dZ60daK0d2K5d1G2/RER8L14+dbTskHBeLx0PSWbo4zic3vTPnrdCRMQHEuVTu8kCSUemSDLpeWcC//a8BSIiPpGowJKbLJB0ZIq4CtTGmO2B3wEved4CERGfSJRPHS07JFy6MkVcDX1YazcAbT3/dBERH+mUl0t5lGAd6iVHZodkKutDS8hFRGqNOKZXvayOyF5yupeLR6NALSJSKxMFlhpCgVpEJExj9JgTUVEmEREvzJsHjzySllMrUIuIpOLrr+GMM2DAABg9GjZs8PwjFKhFRBrip59g2DDYay94+WW4/npYuBC2397zj9IYtYhsE8KLKaU0SbhmDYwZA2PHwqZNcOGFcOON0LGj942upUAtIk1CvEDc0K22Qucsr6gkt6aaM+dN46/vP0+b9avh9NPh1luhe/e0X5sCtYgkxbOeqcdtihWIAa56/iNqIiqFJtpqK3TOTZs2c/LnM7lq1lN0XrOcWbv14+9n/Ilzhp1CYffMXHdSZU7dGjhwoC0rK/P8vCLSuKKV+UyltKdXCopLo64ozMvNYVP1lrgV7/LzcqM+dAru+C89583impkT2WvFt3zcsTt3HvZHZnftV/e+2UWDPLuGeGVO1aMWEddS3QQ2XWLV6KiorIr7PgN1AX6r4ZBN33PvQ8P5zfef8k2bXbj0xGuYtufBWPNr/kUm91NUoBYR1/y6CWysGh3xGCByPKHTj9/S5uxb4fPZdG/VhuuPvoRn9z2a6uz6oTKT+ykqUIuIa7ECYuvcHAqKSxtt3DpWjY4WOVn8sqF+rzrbmK3GrDuuWcnw2c/w+0/eYENOc7jlFt494g9Mem0J1VGGTTK9n6LyqEXEtWhlPnOyDOs3V1NeUYnl1yGE8J1RvBa5CwvAHaf0IT8vF4MzfnzHKX24acg+UTetvecPfcnPy6V15VqK3hzPW48O5eTPSnl8wBBOv+ZpuP56hhT0rDsnOMGdsHNn8kGkHrWIuBataNGGzdX1eq3pHLeOleFxxyl9Yk7u1ctS6dWGHhPeoPO4+9lh43om9z6Cew8+m1U778Idp/TZ6nobO6MFlPUhIinqVjSt3lgvOGPA3xSf4PnnxcrwcJWFUV0Njz8Oo0bBsmX8dMhRjNjvdN5psUujpxoq60NE0iZRsX2vNWhC01qYPBmuuw4WLYKDDoJnn6XjIYfwZFpa6S2NUYtISqKNW6dzsi3WAyDmg+Gtt5zAfOqpkJ0NJSUwezYcckha2pcOCtQikpLC/vlRJ/LSNYTg+sHw0Udw3HFwxBFQXg7jx8PHH8NJJ0HtxGBQaOhDRFKWyUm3hLuwfPMN3HADPPMM5OU5BZSGDYPczOU9e81VoDbG5AGPAb1xcsT/ZK19L43tEhGJKeqDYflyp0jSww9Ds2YwcqTzk5fXKG30ktse9T+A16y1pxljtgO8L7gqIpJA1IJQ3XeEe++Fu++Gykq44AK46Sbo1Kmxm+uZhIHaGLMjcCjwRwBr7WZgc3qbJSKytcj86eX/W8On197KcR+8QPNf/udMFt52G/TK3IrBTHHTo94dWAE8bozpC8wFLrfWrg8/yBgzFBgK0KVLF6/bKSKNrLHLm4YKQhm7hSEL3+aqWU+xW8VPzN29HwNemw4HHJCxtmSam6yPZsB+wEPW2v7AeqAo8iBr7Thr7UBr7cB27dp53EwRaUyh3mwml4mHf3ZBcSnlv2zgsCVzeWXCcO57+W7Wb5fLub8fzWmn3dKkgzS461H/APxgrX2/9t8vEiVQi0jTFau86aipn8XdVSXVHnjoAdFz6eeMmTmR3373Md+17sBlQ67m5b0OxZqsulocTVnCQG2t/ckY870xppe1dhFwJPB5+psmIn4Rr95zqOZz5K4qDdn6KtKzT73B3dMe5YRFs1m5fWtuOuoinul3LFXZOUDmq9g1FrdZH38Fnq7N+FgCnJ++JomI37it9xwqxhT6PdprrgL1smUwejRPPfoYG3OaM7bgLB7bv5D1zX9NOMv3yTZgmeAqUFtrFwBRi4WISNMXrd5zLPFqbiTcYKCiAu66C/7+d6iuZvKBJ1E84FT+1zJvq8O83gbL77QyUUQSclveFH6tuZGoUFP4GHbXltncv2o2vSc+6ATrs86Cm28mZ3VzNrz0CURsCLAtDHeEU6AWEVciVwPG2ug2FETjvRa+w/dpn5ZyxTtP02ntSn7+7eF0eHAs9OtXF8grq2rqdmTZloY7wilQi2zDUsnMSFhzI85rY177goM/n82ImU/Q83/fsWCXnlw5+Eq+3/c3zK4N0uGBvsbaukC/rQVp0MYBItusWD3itG8zNWsWZWdexMDyhSzeqTN3HXouM3oeVFfRLj/OxGW0senGXojjFW0cICL1xMqNTtcWWnzyiVO4/5VX2G3HthQdcykv7Ps7arJ+LVlqiD62HRI5GRlrWy5ILg3Q71SPWmQb1aCdUhpi6VI47zzo2xdmzYLiYua8Oocp+59QL0gn+n4fuTlAvIdNU6JALdLERe7YHVr2HWtHFAtbHddgK1fClVdCz57w3HNw9dWwZAmMHMmQ33bfarOBvNychEE6WrZHxh42jUyBWqQJi1ejI9pOKSEp1fJYv96pC73HHvCPf8DZZzNj8iwKdjqWbne9V/cQKOyfz+yiQYw9vR+bqrfEPWWsXWOS3pYroDRGLdIEhSbYoo33hoYGQpNyiY5zPdZbVQWPPQY33ww//QSFhXDbbZRsah13HDna8EVIosnNaAtxcnOyOWLPdhQUlwZ+gjFEPWoRD8QaXmistoR60bGEhgZCvdpYOwi6GkLYssUZ2th7b7jkEujRA95919n1e++9E44jx/uMRBko0fZrPHVAPpPmljdKpb90UY9aJEV+yzyI10MNiRwaiFXLI+EQwhtvQFERzJ0LffrAK69QsktfxvznS5ZNmRa3RkgoQMc6Jj8v19V/v8iFOAXFpZnNZskA9ahFUtQYmQfxevCJesHRJuVc7+wdMncu/O53zs/KlfDEEzB/PiWd+nHt5E+36s3G6q2HHgJJf3YCbiYY/fQNyA31qEVSlOnMg0Q9+Hi92GxjtnqIhHqYblYZAvD113D99c5QR9u2MHYsXHwxNG9e9/7Ih5Yleurdhs3VdZOKrj7bpUTfDvz2DcgNBWqRFDV42KCBEi1UiTbBlpNlwEBVjRMuowWnqDt7h/z0kzNJ+OijsN12TrC++mpo3Xqrw2I9nCxOCl6odjXALxuqtmqDV0Ey1gRjqIee8YU+HtDQh0iKvP7qnkiiHny0CbZWLZrVBemQWMMz4cMCvxv1MosuHO6k2j36KAwdCosXwy231AvSEPvhlJ+XS8vm9fuF6Rgiinb94ZOSQcy9Vo9aJEVef3VPxE0PPrKH2q1oWtRzxVqSXVO5kfPnT+fS955jp8o1/HD0iXR+8B7o3j1u2+L1Zq94boGrNnghXg8909+AvKBALeIBL7+6J5Loq300boPTPa9+znHz/8OVs56m85rlvN21P3cddh6/7NmH2QmCNMR/aMXK1850gGzIf7/GpkAtEjAN6cEnDE7WwvTpPDp2GHuuXMrHHbsz8rjLmN21HwAmiV5vrIeWXwJkpr8BeUGBWiSAku3Bxw1O770HI0fCrFm0bJvPsBNHMn3PAqz5dQrLi16vnwJkJr8BeUGBWsSnvK6zXC84ff45FA6DKVOgY0d46CHm7XcspS9/gU1TrzdoAdIvFKhFfCitub7ffw+jRsGECdCqlVNAafhwaNmSkwCbk+OLXq/8ylWgNsZ8C6wFaoDqWLsQiIg30pLru2oV3HEH3H+/MyY9fDhcey3svPNWh6nX6z/J9KiPsNauTFtLRKSOp7m+GzbAffdBcTGsWQPnngujR8Nuu6XYSskUDX2I+EDkeHTe9jn8sqGq3nFJTepVV8P48U5QXrYMBg+G2293iidJoLhdmWiB/xhj5hpjhkY7wBgz1BhTZowpW7FihXctFGniohX3X7exmpzsrcsZuZ7UsxYmTYLeveGii6BrV2cLrJdfVpAOKLc96gJr7TJjTHvgdWPMF9bat8MPsNaOA8aBswu5x+0UaTIie88bNlfXG4+u2mLJy82hZfNmyU3qvfmmU3b0gw+c+tBTpsCQIXU7fEswuQrU1tpltf+73BgzGTgAeDv+u0QkUrRsjlhWV1ax4Kaj3Z14wQJnYvC112DXXZ0hj3PPhezoW21JsCQc+jDGtDTG7BD6HTga+DTdDRNpitwU9Q9xNR69ZAn83/9B//7w/vtw993w5Zdw/vkK0k2Imx51B2Cycb46NQOesda+ltZWiTRRbrM2Eo5HL1/u5D8//DA0a+b0pq+5BvLyvGmo+ErCQG2tXQL0zUBbRJq8WMWRXI9Hr10L99zj/FRWwgUXwE03QadOGWi9NBal50kgeb28OlNiFSYadeI+MdtfMr+csdM+5YiZk7ns3WfZacNqpvcq4MkTLuT0s4+iUEG6yVOglsDJ5FZKiR4IyT4wki1MVDL3e9659QGefHMiXVb/zLtd9uXOw87jo07OsMiCiOsO6gNM4jPWep9JN3DgQFtWVub5eUXA2WU61q7Vs4sGefY5kQ8EcHq/od1CEr2eEmthxgy+/NNf6fnj13zWfnfuPOw83u62X71Uu9B1p7U9knbGmLmxynNoKy4JnExtpZRod/G07T7+wQcwaBAcdxzNK9dx2ZARDP7j33l79wFR86FD190Yu6FLZmjoQwInU1spJXogeP7AWLQI/vY3Z1Vh+/Zw//2cW9GDpeuq474tdN1B3AtQ3FGPWgInU5vJxgr8ob8net218nJn09h99oEZM5zaHF9/DZdeyhUn9K53reHCr9uz9ojvKFBL4CTaZdoriR4IKT8wKiqc/OcePZza0MOGOTt833gj7LADUP9a83JzaLN9TtTrTscDLHxH8oLiUkrmlzf4XNJwmkwUicPrrA/AyX9+4AGnNnRFhbOy8OaboVu3tLc32XNpcjJz4k0mKlCLZEp1NTzxhLNA5Ycf4LjjnGDdN7X1ZOlKyctUdo044gVqTSaKpJu1ThW7666DhQvhgAPgySfh8MPrHZps0E1nTrkmJ/1DY9QiETwdl501CwoK4OSTYcsWJ6NjzpyYQTqyLvW1L30S9/PTmZKnyUn/UKCWQEn35FZDgmVUn3zi7Khy6KGwdCnzb7iLQ8+5n24fNKfgzjejnq8hQTedvd5MZddIYgrUEhieBdE4Uu6hLl0K553njDvPng3Fxbz8wkzOsn34bu3muO1uSNBNZ683U9k1kpjGqCUw0rIzd4QG91BXroTbboN//hOysmDECGenlTZtKC4uddXuhizkiVXkyater3Yk9wcFagmMTExuJR0s16+HsWPhrruc388/H0aNgs6dE7avvKKSguLSuonDI/Zsx6S55UkF3WSLPEkwKVBLYGRi6bjrHmpVFTz6qJP//PPPUFjo7PC9116u2234dSuu8opKJs0t59QB+bz5xYqkgq56vU2fArUERrq/5kP8HmrJ/HLufnUh/d5/naJ3nqLzqmXOZOHkyXDQQUm12wCRKxgqq2p484sVGclRVjnUYFGglsDI1Nf8aD3UkvnlvHz3RB7673j6/LyYhe268sfTbuKj3gdxU4suFEY5T3gwbJ2bQ4ucLCo2VMXsYUNmcpQzWc9bvKFALYGS6Gt+WnqKZWXkn3ER/1o8jx92bM8VJ1zJlL0PY0tWNlRWRw1ykcGworKK3Jxsxp7ej8L++TFX/WUiRzkTk7LiLaXniSf8ULzH8/S9r76C00+H/fdn92VfM/rICxl04SNM7j3ICdK1oqXvJUrza8wcZa04DB7XPWpjTDZQBpRbawenr0kSNH75Kh0rOF71/EfJteWnn5xJwkcfhebN4YYbOCNrf77aGLtfExnkEgXDxszWyFQ9b/FOMkMflwMLgR3T1BYJKL98lY4VHGusdffgWL0axoxx0u02b4aLLoIbboAOHRgWpZJcuPAgVzK/nCxjqIlS8Cz8uMbK1sjEpKx4y9XQhzGmM3AC8Fh6myNB5Jev0vF6hHFXF27c6ATnPfZwFq2ceKJTPOmBB6BDB+DXVXp5uTn13h4e5ELfLqIFab8EQ604DB63Peq/A9cAO8Q6wBgzFBgK0KVLl5QbJsHhl6/S0XqK4eo9OGpq4KmnnEL9330HRx/tlB3db7+o7w/1gONNWEb7dgGQbYyvgqFyr4MlYaA2xgwGlltr5xpjDo91nLV2HDAOnHrUXjVQ/M8vX6VDgeeq5z+KP+xgLUyb5uyu8umnMHAgjB8PRx7p+nNiBblY3yK2WKvAKA3mZuijADjRGPMt8CwwyBjzVFpbJYHip6/Shf3zuecPfWNnVLz7rrNIZcgQZ8jj+eedXb9dBulEVBpU0iGpHV5qe9RXJ8r60A4v0tgihydu7g5HPvkPmDoVOnZ0dlm54ALIqT/mnOrnavsqaQjt8CLbnLrhie+/d4Ly3yZCq1bOZOHll0PLlmn7XFCRJPGW9kyURpPWehOrVjkTg/ff74xJX3qpsxVW27bp/2yRBlCPWnzHy0Uy4UG32/aG+1fMYp8nH4I1a5wi/qNHQ1gmUqzPLlu6KunKdSKZoB61NIpYtS7AmYx0GyRDQXfzps384ePXGT77GTqsW8WPh/6OXR68F3r33urYMTMWxfzcyIp2GluWTFKPWnwn3mKYZHrXY177gsM/mcnVs55kj1XllOXvxbCTRvJj74HMrg3SJfPLGTX1Myoqq+KeK1rZURUqEj9QoJZGEa/UJ7gMkm++yT/vv5i+P37Fl2278OdTbuCN7geAMZjac0fLwkiGChWJHyhQi2teTsAlWkUIcYLk/PnOYpUZM+jQuj1XHz+cl/Y5YquKdqG85VgrBSNFK+Qffh6RxqQyp+KK1yVEwxfJxFIvSC5ZAmed5Szx/vBDuPtuPnjtXabtd8xWQTp8VaSbHnF+Xi7/d2CXRis7KpKIetTiSjoq5IXXzoi7BP3nn+HWW+GRR6BZMyfNbsQIyMvjRGBL8xYxe/rxhlgiJwsH7raTUvbElxSoxZV0VsiLuUik+47OYpV77nGWe//5z04BpU6d6r0/VkCNNcTSZvscbhqyz1bvU6Ei8SsF6iYgE4s30l0hb6sguWmT03s+5lZYsQJ+/3unR92zZ4POC1opKMGmQB1wmdpdJSMV8rZsgX//G66/Hr79FgYNguJi2H//lE6rnrIEnSYTAy7R3nxeSWuFPGvh1VedScKzz4a8PJgxA954I+UgLdIUqEcdcJncXSUtPdP334eRI2HmTNh9dz68/QGusL0oL91E6/dexxj4ZUMV2bVbWyWzalGkqVCgDji/7K6SSOQ4+uie2Rz19H3w0kvQvj088ABT9j+eopcXUVm1CWCrlYShjQAaa+NckcakoY+AG3FML9/n/4bnYLdfu5JL/30nh582iKrXZjgFkxYvhmHDuKv0G1eLU9IxtCPiZ+pRB1wQshrGzFhEztrVXDbnRc6fO5WsLVt4Yr/BPPDb08ndriMjvlpNYf9WSQ3XaGm3bEsUqJsAX2c1VFYyZMaT/GXOi+y4cT0l+xzOvQf/Hz/kdXReDxvKSFT/I5zfhnZE0kmBWjxXMr+ce6d/zkHvvMJV7z5D0ZqVlO4+kLsOO48v2nerd3xoKMNN/Q/w39COSLopUIunSub9wBvF4/hX6QR6/O975u/SiyuGXM0Hu/WhqiZ27fNlFZX1hnFa5+Yo60MEBWrx0ttvs8c5F1P43ed8vVNnLjr5Omb0OAiMIW+7ZrRs3izm0EZoKCPTwzjakkuCQIFaUvfxx07Z0enT2blVW0Ye+1de7HMUNWEV7VZXVrHgpqMTF2DKoEyt6hRJVcJAbYxpAbwNNK89/kVr7U3pbpj8yre9vm+/dYokPfUUtG4Nd97JWZv68M36LfUODe8xgz+yVNJREVAkHdz0qDcBg6y164wxOcA7xphXrbVz0tw2wae9vhUr4Lbb4KGHICvLKTlaVARt2nC5ix6zX7JUMrmqUyQVCQO1dXa/XVf7z5zaH+93xJWovOz1pdwzX7cOxo6FMWNg/Xr405+cMqSdO9cd4qcecyJBWdUp4moXcmNMNjAX6A48aK0dGeWYocBQgC5dugxYunSpx03dNnUrmhb1qWiAb4pPcH2eaGPDoe2nomVShAf1Lq2acd+6MvpOuN8p4n/yyU6Peq+9GnxdfhBrvFw7j0tjSHkXcmttDdDPGJMHTDbG9LbWfhpxzDhgHMDAgQPV4/aIV72+aD3z0E2KHE4JBbCNm6sYvHAWV816iq4VP7JywIHsXFJCSfNdGTNlEcsmLqlLoavYUOXr3nM0Qer9y7YtqawPa22FMeYt4Fjg0wSHN1mZnNzzqg50onHX8OGUMTMWMeDLMopmTqD3z4tZ2K4rfzxtFF/tdzAjmu+6VXvCCyf5Yvw8SX4ZLxeJx03WRzugqjZI5wJHAXemvWU+lenJPa96fW6WZy+rqISyMu58+EoOXvoRP+zYnuGDr2LK3odhTRZm9caEu3ora0LEe2561LsAE2vHqbOA5621r6S3Wf7VGCldXvT6Ei3P7rqqnBvmPAN3zmSflq0ZfeSFPN3veDY3y6k7JssYV7U4lDUh4i03WR8fA/0z0JZACGJKV2ioprKqpm4pdmgisd26VVw++9+c8dEMaNECbryR2UedybP/+ZbNEUE9/H3xhMbPfZv/LRIwWpmYpKCldEUO1dRYS25ONmftuSNdHnuQ38+exHY11Xz3+3PY/b47oUMHBgPVrXbgquc/qivYH2IhbrAOjZ/7Mv9bJKC0cUCS/FSov2R+OQXFpXQrmkZBcSkl88vrHRM5VNO8ejNnzX6Ryy48lvPeeobtTzuFZl8uYvfnJkCHDnXHFfbPZ0uM1M1QSp8B8nJzaLN9Tr19FDO1l6PItkA96iT5JaXLbY81NCSTtaWGUz57k+HvPE3nNSt4u2t/Dp30mLOhbAyxvj3k5+Uyu2hQ3PYFcYhIxK8UqBvADyldbic1O7VuwZ5zZ3LNzIn0WvkdH3XswYjjh/Nd3wOZHSdIQ2qpgUEbIhLxMwXqNEvXhJqrHuvs2Ux9/lraLviQJW06cclJRUzvVUDuds24w0WwTeXbg1f53yKiQJ1W6ZxQi9tj/ewzuO46mDqVtrvswoLrirls+/58v7Yq6cL7Df324JchIpGmwFWtj2QNHDjQlpWVeX7eoCkoLo0aTLON4Z4/9E0paEWrU7H7hv/x+LfT2G3ai9CqFYwcCZdfDi1bNvhzRCQzUq71IQ0Ta3iixtqUe9bhPdYNP/7MiPmTOf39qWQb4IornEL+bds26Nwi4i8K1GkUb9m2F6sZC3vmUfjqHJhwp1OC9NxzYfRo6NKlQefTAhURf1IedRpFy7kO1+BUtaoqeOQR6NED/vY3OPxwZzusxx9PKUhf+9InlFdUYvl1PD1abraIZJYCdRoV9s/njlP6kG1M1NeTTlWzFl54AfbZB/7yF9h9d3jnHZgyxflbCrRARcS/NPSRZqGhg5RT1UpLne2uPvzQCcpTp8LgwRDjIZDsMIYWqIj4lwJ1BrhJVYsZWOfPdwL0f/4Du+4KEybA2WdDduwhlYakBWqBioh/KT3PB6Kl2vVc+zP/WjKVXV+bAjvt5IxFX3KJU+EugVhpgfGWfmtbKpHGpfQ8nwsfH955/S/89d1nOWvBa9RkN3MWrlxzDbRu7epcJfPLY2aaxBvG0AIVEf9SoPaBZRWVtNq0gQs/mMyfP5xM8+rNPNv3GO4rOJMPbjvH9XlCveJYEg1j+KGGiYjUp0Dd2DZt4vLPpnPOf5+ibeUaXul1MPcceg7f7JRPvgcb2IaozoZIcClQp6jBi0S2bIFnnoEbbmD4t9/yXte+3H7oH/lklx6AE1iP2LMdBcWlKWduABprFgkw5VGnoEGLRKyF6dOhf3845xxo0wZmzODnSa+waq996wrwnzogn0lzy5M6d6yhjfy8XAVpkQBrsj3qVJdDu3l/0hvdzpnjpNrNnAl77MGHdzzIFVt6Ul66iU55X271GQXFpUlvoqvSoiJNU8JAbYzZFXgC6AhsAcZZa/+R7oalItXyosnunhKp3t+/+MLJ3pg8Gdq3hwceYMr+x1P08iIqqzZF/YyGLEBpSOaG6nuI+J+bHnU1cJW1dp4xZgdgrjHmdWvt52luW4Ml3dNt4PsTLhIpL4dRo2D8eKfU6M03O5XtWrXirgQ95oYuQEkmc0Mb0IoEQ8Ixamvtj9baebW/rwUWAr7+f3Gqy6Hdvj/WRrfXHdTBqQXdvTtMnAh//SssXgw33ODUiXbxGZnYRFf1PUSCIakxamNMV6A/8H6U14YCQwG6NLCCm1dSXQ7t9v2RQw1dW2Zx/8pZ9C78J6xe7Sz1vvlm6No16c/IxAIU1fcQCQbXgdoY0wqYBAy31q6JfN1aOw4YB84Scs9a6ELkOOsRe7Zj0tzyBk+qJTMpV9g/n8I+HZwaHKNGOcMdxx8Pd9wB++6b0mekewGK6nuIBIOr9DxjTA5OkH7aWvtSepuUnGgpcpPmlnPqAGfBSCjdLZk84lB50oTvt9aZIOzTBy68kE+zduT0s4opOOQqSmri767i+jPSKBPDKyKSuoRFmYwxBpgIrLLWDndz0kwWZWpIAaJkxMyKmDnTSbWbM4e1Xbtz7f5n8kq3A+rKjgaloJGyPkT8IV5RJjeB+mBgFvAJTnoewHXW2umx3pPOQB0ZWGIVIDLAN8UnJH2+8EAVraLcXsu/YcTMiQxaUkZl+47k3n4rh/7Uhe/Wbq53bq8eFiLS9KVUPc9a+w5O3Gt00dLJDBDtUeNmnDVRelp4VkTn1T9z5aynKPzsLdY2357bDz+f539zEqP2G8j3zy2Ien5NyomIFwK1MjFaOpmFesHa7ThronzpZRWV7LRhNZe++xxnz5/OlqwsHvnNqTx04GmsadGq7hyalBORdApUrY9YPVQLdZNyebk5tMjJ4ornFlBQXBq3Nkbc9LR16/jb3BeY+cifOW/eK0zqPYjDLxzHnYf/sS5Ih47VpJyIpFOgetSxeq6hseBkV9pFO19OTRUXLyqFPf7En5cv5z97FnDnwWezuO2uMdukovsikk6BCtSJco+TXToefj5jtzBk4SyunvUkXSp+gsMOgylT2NB8VzbOWARRxsPDP1tF90UkXQIVqBP1XJNdaVfYPx+sZeYDz3DB9HH0/nkxq3vsBc+Mh2OPBWMoDPtcP6Sy+aENIpJZgQrUEL/nmvSk3ocfUlhURGFpqbPM+8knaX3WWZAVfei+sXvNKqIksm0K1GRiIq4n9b78Ev7wBzjgAPj4Y/jHP5xSpGefHTNIe6lkfjkFxaV0K5qWcMIznIooiWybAtejjifhpN6PP8Lo0fDYY9CiBdx4I1x1Fey4Y8bamEqvWEWURLZNgQ7UscZr6wW81avhrrtg7FioroaLL4brr4cOHVydz6t2QWq1spWvLbJtCmygdtUz3bgRHnwQbr8dVq2CM8+EW26BPfZo2Pk8aFeiXnG8IK+ttkS2TYEdo447XltT45Qd7dkTrr4a9t8f5s1zdv2OEqQTns+rdhG799spLzfhZrl+qLgnIpnnux612+GHqD1Ta9n7w7eg72Xw2WdOgJ4wAQYlLozk1fivm51bYvWK3QyLNHbmiYhknq8Cdaxhg7Klq3jzixVbBe/I8dqBP3zGyLcmsn/5505P+oUX4NRT68qOJuLV+G8qO7dcoeJOIhKFrwJ1rB7l03O+q1sRGArepw7IZ9LccnZdtpgRbz/B777+gOWtdmL+34rpf9OVkJOT1Gd7Nf6bys4tmiwUkWh8FajjFV0KV1lVw+dzPuW1z0vY9ZUXWLfd9jx8zAXk31jEkN92b9Bne1WvI5XzaLJQRKJJuHFAQzR044BYu7WEy6tcw7D3nufcedNo3izL2eG7qAjaxt/6Kii0RFxk25TSxgGZFK1HGSqElLt5I38qm8JF70+iZdVGXt3vaAa/9Ag08o7nXtNkoYhE8lWgjjZscGT3PLLGP84lbz9N+/W/8Hr333DfkedzwUWDoYsCmog0fb4K1BDWo7TWydy47i/w1Vd81LU3lxRey4+9B2g4QES2Kb4L1AD897/OuHNZGeyzD0ydSt/Bg3nRZaqdiEhTkjBQG2PGA4OB5dba3mltzbx5ToB+/XVn7HnCBKeiXXZ2wre6oYk6EQkiN0vIJwDHprkdUFEBhxwCc+fCvffCokWU7HsUBWNmJl0ONJpEy7NFRPwqYY/aWvu2MaZr2luSlweTJ8NvfgOtW3teJD+VqnUiIo3JX0WZjj4aWrcGvC+Sr1rOIhJUngVqY8xQY0yZMaZsxYoVKZ/P68Aar2qdiIifeRaorbXjrLUDrbUD27Vrl/L5vA6srrfpEhHxGX8NfYTxMrCGsj0qq2rIrk3xy8vNoUVOFlc8tyDliUoRkXRKGKiNMf8G3gN6GWN+MMZckP5meVckPzzbA6DGWnKyDOs3V/PLhiplgIiI7/mqKFM6uCn0FJKfl8vsosSbDIiIeC1eUSbfDn14JZnJR2WAiIgfNflAnczkozJARMSPmnygjjYpmZNlyMneum6IMkBExK/8WZTJQ7F2XIn2N61QFBE/avKTiSIiQRCIHV5U2U5EJDpfBGqvCzCJiDQlvphM9LoAk4hIU+KLQK3KdiIisfkiUKuynYhIbL4I1KpsJyISmy8mE2PlOmsiUUTEJ4EanGCtwCwiUp8vhj5ERCQ2BWoREZ9ToBYR8TkFahERn1OgFhHxubRUzzPGrACWNvDtOwMrPWxOY2oq19JUrgN0LX7UVK4DUruW3ay17aK9kJZAnQpjTFmsUn9B01SupalcB+ha/KipXAek71o09CEi4nMK1CIiPufHQD2usRvgoaZyLU3lOkDX4kdN5TogTdfiuzFqERHZmh971CIiEkaBWkTE5xolUBtjjjXGLDLGfG2MKYryujHG3Ff7+sfGmP0ao51uuLiWw40xq40xC2p/bmyMdiZijBlvjFlujPk0xutBuieJriUo92RXY8ybxpiFxpjPjDGXRzkmEPfF5bUE5b60MMZ8YIz5qPZaRkc5xtv7Yq3N6A+QDSwGdge2Az4C9o445njgVcAABwLvZ7qdHl7L4cArjd1WF9dyKLAf8GmM1wNxT1xeS1DuyS7AfrW/7wB8GeD/r7i5lqDcFwO0qv09B3gfODCd96UxetQHAF9ba5dYazcDzwInRRxzEvCEdcwB8owxu2S6oS64uZZAsNa+DayKc0hQ7ombawkEa+2P1tp5tb+vBRYCkUXbA3FfXF5LINT+t15X+8+c2p/IrAxP70tjBOp84Puwf/9A/Rvm5hg/cNvOg2q/Jr1qjNknM03zXFDuiVuBuifGmK5Af5zeW7jA3Zc41wIBuS/GmGxjzAJgOfC6tTat96UxdngxUf4W+TRyc4wfuGnnPJw1/OuMMccDJUCPdDcsDYJyT9wI1D0xxrQCJgHDrbVrIl+O8hbf3pcE1xKY+2KtrQH6GWPygMnGmN7W2vA5EU/vS2P0qH8Adg37d2dgWQOO8YOE7bTWrgl9TbLWTgdyjDE7Z66JngnKPUkoSPfEGJODE9ietta+FOWQwNyXRNcSpPsSYq2tAN4Cjo14ydP70hiB+kOghzGmmzFmO+AMYGrEMVOBc2tnTg8EVltrf8x0Q11IeC3GmI7GGFP7+wE4/83/l/GWpi4o9yShoNyT2jb+C1horb03xmGBuC9uriVA96VdbU8aY0wucBTwRcRhnt6XjA99WGurjTGXAjNwsibGW2s/M8b8pfb1h4HpOLOmXwMbgPMz3U43XF7LacDFxphqoBI4w9ZOC/uJMebfOLPuOxtjfgBuwpkkCdQ9AVfXEoh7AhQA5wCf1I6HAlwHdIHA3Rc31xKU+7ILMNEYk43zMHneWvtKOmOYlpCLiPicViaKiPicArWIiM8pUIuI+JwCtYiIzylQi4j4nAK1iIjPKVCLiPjc/wPCCvjKMZGi9wAAAABJRU5ErkJggg==",
            "text/plain": [
              "<Figure size 432x288 with 1 Axes>"
            ]
          },
          "metadata": {
            "needs_background": "light"
          },
          "output_type": "display_data"
        }
      ],
      "source": [
        "plt.scatter(train_x,train_labels)\n",
        "x = np.array([min(train_x),max(train_x)])\n",
        "with torch.no_grad():\n",
        "  y = w.numpy()*x+b.numpy()\n",
        "plt.plot(x,y,color='red')"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "0giuwC9GHzi8"
      },
      "source": [
        "## Computations on GPU\n",
        "\n",
        "To use GPU for computations, PyTorch supports moving tensors to GPU and building computational graph for GPU. Traditionally, in the beginning of our code we define available computation device `device` (which is either `cpu` or `cuda`), and then move all tensors to this device using a call `.to(device)`. We can also create tensors on the specified device upfront, by passing the parameter `device=...` to tensor creation code. Such code works without changes both on CPU and GPU: "
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "HK7HPLz3Hyrl",
        "outputId": "7e14cccb-d376-4e59-be66-4ab3f5c3f6f4"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Doing computations on cpu\n",
            "Epoch 0: last batch loss = 94.5247\n",
            "Epoch 1: last batch loss = 9.3428\n",
            "Epoch 2: last batch loss = 1.4166\n",
            "Epoch 3: last batch loss = 0.5224\n",
            "Epoch 4: last batch loss = 0.3807\n",
            "Epoch 5: last batch loss = 0.3495\n",
            "Epoch 6: last batch loss = 0.3413\n",
            "Epoch 7: last batch loss = 0.3390\n",
            "Epoch 8: last batch loss = 0.3384\n",
            "Epoch 9: last batch loss = 0.3382\n"
          ]
        }
      ],
      "source": [
        "device = 'cuda' if torch.cuda.is_available() else 'cpu'\n",
        "\n",
        "print('Doing computations on '+device)\n",
        "\n",
        "### Changes here: indicate device\n",
        "w = torch.tensor([100.0],requires_grad=True,dtype=torch.float32,device=device)\n",
        "b = torch.zeros(size=(output_dim,),requires_grad=True,device=device)\n",
        "\n",
        "def f(x):\n",
        "  return torch.matmul(x,w) + b\n",
        "\n",
        "def compute_loss(labels, predictions):\n",
        "  return torch.mean(torch.square(labels - predictions))\n",
        "\n",
        "def train_on_batch(x, y):\n",
        "  predictions = f(x)\n",
        "  loss = compute_loss(y, predictions)\n",
        "  loss.backward()\n",
        "  w.data.sub_(learning_rate * w.grad)\n",
        "  b.data.sub_(learning_rate * b.grad)\n",
        "  w.grad.zero_()\n",
        "  b.grad.zero_()\n",
        "  return loss\n",
        "\n",
        "batch_size = 4\n",
        "for epoch in range(10):\n",
        "  for i in range(0,len(features),batch_size):\n",
        "    ### Changes here: move data to required device\n",
        "    loss = train_on_batch(features[i:i+batch_size].view(-1,1).to(device),labels[i:i+batch_size].to(device))\n",
        "  print('Epoch %d: last batch loss = %.4f' % (epoch, float(loss)))"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "A10prCPowHl7"
      },
      "source": [
        "## Example 2: Classification\n",
        "\n",
        "Now we will consider binary classification problem. A good example of such a problem would be a tumour classification between malignant and benign based on it's size and age.\n",
        "\n",
        "The core model is similar to regression, but we need to use different loss function. Let's start by generating sample data:\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "j0OTPkGpwHl7",
        "scrolled": false,
        "trusted": true
      },
      "outputs": [],
      "source": [
        "np.random.seed(0) # pick the seed for reproducibility - change it to explore the effects of random variations\n",
        "\n",
        "n = 100\n",
        "X, Y = make_classification(n_samples = n, n_features=2,\n",
        "                           n_redundant=0, n_informative=2, flip_y=0.1,class_sep=1.5)\n",
        "X = X.astype(np.float32)\n",
        "Y = Y.astype(np.int32)\n",
        "\n",
        "split = [ 70*n//100, (15+70)*n//100 ]\n",
        "train_x, valid_x, test_x = np.split(X, split)\n",
        "train_labels, valid_labels, test_labels = np.split(Y, split)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "c-_BjSHPwHl8",
        "scrolled": false,
        "trusted": true
      },
      "outputs": [],
      "source": [
        "def plot_dataset(features, labels, W=None, b=None):\n",
        "    # prepare the plot\n",
        "    fig, ax = plt.subplots(1, 1)\n",
        "    ax.set_xlabel('$x_i[0]$ -- (feature 1)')\n",
        "    ax.set_ylabel('$x_i[1]$ -- (feature 2)')\n",
        "    colors = ['r' if l else 'b' for l in labels]\n",
        "    ax.scatter(features[:, 0], features[:, 1], marker='o', c=colors, s=100, alpha = 0.5)\n",
        "    if W is not None:\n",
        "        min_x = min(features[:,0])\n",
        "        max_x = max(features[:,1])\n",
        "        min_y = min(features[:,1])*(1-.1)\n",
        "        max_y = max(features[:,1])*(1+.1)\n",
        "        cx = np.array([min_x,max_x],dtype=np.float32)\n",
        "        cy = (0.5-W[0]*cx-b)/W[1]\n",
        "        ax.plot(cx,cy,'g')\n",
        "        ax.set_ylim(min_y,max_y)\n",
        "    fig.show()"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 283
        },
        "id": "tq0vFchQwHl8",
        "outputId": "919f1922-f789-4779-cbdc-4f9e742c358b",
        "scrolled": false,
        "trusted": true
      },
      "outputs": [
        {
          "name": "stderr",
          "output_type": "stream",
          "text": [
            "C:\\Users\\dmitryso\\AppData\\Local\\Temp/ipykernel_89704/2721537645.py:17: UserWarning: Matplotlib is currently using module://matplotlib_inline.backend_inline, which is a non-GUI backend, so cannot show the figure.\n",
            "  fig.show()\n"
          ]
        },
        {
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYQAAAEKCAYAAAASByJ7AAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjQuMiwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8rg+JYAAAACXBIWXMAAAsTAAALEwEAmpwYAABPHElEQVR4nO2dd3zcdf3HX+9cdtI0bVZX0rSllFE6IGUIlD1lCKKADAeKA1DABeJGFMWJCtIfAqKIioJI2UihjIIU6KSFriTdTbN3crn374/XfXuX5HKjuZm8n4/HPZL73vfu3rc+7897i6rCMAzDMNISLYBhGIaRHJhCMAzDMACYQjAMwzC8mEIwDMMwAJhCMAzDMLyYQjAMwzAAAOmJFmA4FBcXa2VlZaLFMAzDSCnefvvtvapaMvB4SiuEyspKLF++PNFiGIZhpBQiUhPouLmMDMMwDACmEAzDMFKLvj6guxuIQZeJlHYZGYZhjBo2bwZeeAF4803A4wHy8oDTTweOPx4YNy4qT2EKwTAMI9lZsgT405+AzExg0iTA5QK6uoDHHgOefx74xjeA8vJhP425jAzDMJKZDz4A7r+fisBRBgCQnQ1Mncr/f/UrKohhYgrBMAwjmXnqKSA/n9ZBIIqKgIYGYMWKYT+VKQTDMIxkpb0dWLUKKC4Ofl5BAfDKK8N+OlMIhmEYyYrjBkoLsVRnZgItLcN+uqRRCCKSLSL/E5GVIrJWRH6QaJkMwzASSl4eIMJU02B0ddF1NEySRiEA6AZwsqrOBTAPwJkicnRiRTIMw0gg2dnA0UcDe/YEP6+tDTjxxGE/XdIoBCVt3qsZ3ovN9zQMY3Rz5pmA2814QiB27QKmTAEOPXTYT5U0CgEARMQlIisA7AHwvKq+GeCcq0VkuYgsr6uri7uMhmEYcaW8HPjKV4DmZqC2loqhpwdobAS2bAHGjwduuAHIyBj2U4nGoPx5uIhIIYDHAFynqmuGOq+qqkqtuZ1hGKOC+npg2TJmE3V2AqWlwGmnAfPmAVlZET2UiLytqlUDjydlpbKqNonISwDOBDCkQjAMwxg1FBUB55zDS4xIGpeRiJR4LQOISA6AUwGsT6hQhmEYo4hkshAmAviTiLhARfUPVV2cYJkMwzBGDUmjEFR1FYD5iZbDMAxjtJI0LiPDMAwjsSSNhWAYRoLo62NHzZ072UmzogKorGSFbLLR1wesWwds2MCZAFOnAocdFnGWjREYUwjGkHg8rIgXYcFkMq4PxjBZuxa47z52y/RPQa+oAD73uaj02I8aGzYAd9/N/Pu0NF56e4HcXOBTnwKOPDLREqY8SVmHEC5WhxAbOjuB119n192GBh6bOhU4+2zgiCN87diNFGfNGuDnP2dhU0GB77gqc97dbuDb32YVbKLZvBm47TbKOXZs/9s6Olite+21phTCZKg6BIshGP1oaQF+8hPgwQdpEUydys1iYyPw298CixZxnTBSHLcbuPde5rb7KwOAH3xxMf8+9FBi5PNHFfjLX4CcnMHKAKCFMGECJ4r19MRfvhGEKQSjH/feC+zYAUybxpkcANeFceOA6dOBN96g5WCkOOvWAU1NwJgxQ59TWsrzdu6M/vN3dACrVwPvvMPdv8cz9LnbtvGcYN08c3PZ0mHt2ujLOoqwGIKxj+3bOYvDmco3EBFO8HvmGeCMMyyOl9LU1obusS/Cc3buBCZOjM7zdnUB//438OKLtFJEqAzKyoCLLwbmB8g837OHcoQKYrlc/BIHegwjLMxCMPaxejV/c8F+d1lZ/E1v3hw/uYwEEs0YY08P8JvfcEdRUkJfZHk5dyA9PZwLHGjqV1paeHJ4PBbgGiZmIRj7aGsD0sP4RohEZZ63kUimTQvupgF4uyoweXJ0nvOll+jSmTZt8K6joIBTvx54gGboli0MXBUU+DKdPJ7gVo0q/ZrGfmMKwdjH+PHM4guFxxPc9WykALNm0Sff3Bw4UAvQVXPYYXTnDJe+PuDpp/lYQ5mg6enA+vXAF75AJZSR4ftCtrfTzVVZGfi+DQ10a82cOXxZRzHmMjL2MX8+N2DBpvW1tVFx2EYsxXG5gKuvZlrZwBoEVWD3bi7Ql10WnedraOBz5eUFvt3jAZYv53l9fVz4J0/m36lTaT1s2ADU1PT/gjqydncDn/986LiIERSzEIx9jBsHnHwy8Nxz/B0O/G319vK398Uv2u9uRDBrFnDTTUzXrKnx7dxVgYMPBq68kumc0SCUe6qujsHrgoLBFoQIcMABVARFRQwcO8c9HuCQQ4BLLkmuIroUxRSC0Y+LL6Z1/vrrrE4uLOT60NDApJBLLwWOOSbRUhpRY+ZM4NZb6bPfvZuLbHl59OIGDuPG0QXU3R04PW3zZloBPT00QQciQpdQTg7wi18AW7fyi1lWFj2lZZhCMPqTkUFPwsknMzNw40Z6F049FVi4kPE+Y4QhQh9gLP2AmZmc7rV4ceC85oYGntPbO3Tec0EBLZmCAmDOnNjJOooxhWAMQoQbR4vPGVAFqquBTZtoIk6YwGHu+zO/99RTWdm4cycfx981pMpCuUMO8VVEBpIlVF60MSxMIRiGEZgdO4B77uGuHGDgyOPhgn355cDRR0f2eGPHMmZxzz3sripC89Ptpito/HgqhKGor6cysgBWzDCFYBjGYHbvBn78Y+7Kp07tvyvv6ADuuovK4UMfiuxxi4qAm29mDGDtWnZSLClhsOoXv2DgOFAxjMcDtLayRN6IGaYQjLBpbuZvMivL1/vMGKE88ggDvIGCRrm5PP6nPzFXOScnsscWYZVyRYXvmCpw3nnAY4/RneSfntrZSWvllFNoIRgxI2kUgoiUA3gQwAQAHgCLVPU3iZXKAJgA8p//sM+R4zUoLwfOPZftsE0xjDAaGth0Lljb6+xsZgy9+27kVkIgRIALLqAF8dhj/dNg8/JYD3H66eYuijFJoxAAuAF8VVXfEZExAN4WkedV9b1ECzaaeftt4He/4yZwyhRfW5nmZralueACXkwpjCB27fI1tgtGVhbTVaOhEAA+5wknAMcdx11IWxu/eDNm7F8Q24iYpFEIqroTwE7v/60isg7AZACmEBJEQwPwhz/QxZub6zsuQpdvfj4bVx54IDB7dqKkTEJUuaAtX04fW1ERB7dEO7c/VoiE10xONTY7dpfLUtwSRNIoBH9EpBLAfABvBrjtagBXA0CFvw/SiDqvv84Yn78y8Cc9nT2NnnnGFMI+GhuB3/+eBRzp6cyt7+oCHn8cqKoCrroqcp97vJk8mUrB7Q7e7bCnh9XOxogh6RSCiOQD+BeA61W1ZeDtqroIwCKAIzTjLN6Ip74e+N//OJPkiSeYKRisyWRREScxDlWAOqpobwd+9jO+iQMzc1Tpf+vqAm64IbnbNBcUAMceC7z22tDtINraaCLaTmBEkVQKQUQyQGXwkKo+mmh5RhN9fcCjj7IhJcCYodNHbONGejzGjRt8P/9Z56NeISxb5hs3NxAns2b1ak4hS/aF9MILKef27WwZ4ewInAKylhbgxhtpARkjhqQJ2YuIAPgjgHWq+stEyzPa+Oc/mUk0eTLXrdJSZv/l5NBCeO01usMH0tXFc5LdCxJzVKlNS0uHPkeEu+rnn4+fXPtLYSHwrW8B8+axZqC2lpeaGvoJb7qJrbGNEUUyWQjHArgCwGoRWeE99i1VtQm+MaaujnGAysr+nozp05lwUlhID8H779MN7s+ePUwfT2YPSFzo7mYUfqg+PA5OP55UYNw44Jpr6AKrrqa5WFLCL4qllY1IkkYhqOqrAOxblgDeeMPXRcCfkhIWoDU0cGO7fTs9HdnZvH3vXm4WTzgh/jLHHLeb7p/eXi6MgTpw+uO8eU6/naEYqhLXD4+HbroVK1gUXFYGLFjAzyIhFBUFH3BvjBiSRiEYiaOmJvDckrQ04KijgLfeohXR2cmOBjk5XKhKS4Hrrw8cW0hZ3G7ghRfo/mlt9U0MmjOHBRdDTezKyGAVbXV18JW7vp4FVkOwZw+TlGpqqDcyMuiW+/vf2YH20kstJd+IHaYQDGRkDD0lLTOTdUeNjSxKnTiRMYZjjmEfshG1OLndwN13M81q4kSfpvN42Izt1luBr32Nw2MCccYZwB138H6BfGg9PXyshQsD3r2pCbj9diregXrH46Ge6ulh5qp5bIxYkDRBZSNxzJ/PHf9QiNAqmDcP+MEPOPJ27twRpgwAYOlSKoPp0/sXX6Sl0W9TWAj89rdcsQMxezaVQnU1gy4OTmbO1q3sEjpxYsC7//e/PC3QCOO0NCqJV19NnRCEkXqYQjAwdy5jBC2Dqj6IKlvYn3nmCFQCDn19HN4SbAj8mDHUnO++G/h2Efp0PvtZXq+p8WXojBkDfPWrbNAWgJ4eJh8Fm2eflsb3f+nSCF6XYUSAuYwMZGUB113HmiqnG7GTdt7VRWVw2GEceDUUqgw679zJdXHy5CE3wslJXR2356Gq3/Pz2ZJiqP49aWm+fjzbtvENzM9nd9Agfp7WViqFULUcBQVsH2QYscAUggGAHQi+8x0Wp61e7Wtil5MDfPSjtA6GqkGqrQX+/Ge62dPS+s8+v+KKFFEMbnd4fXlcLq7c4ZwXKgXVD+f9DpWk5PGETFIyjP3GvlrGPiorWXy6dy+DyOnp3OkHK0atqeEclfT0/unpTn+3H/0IuOWWFJjFXFhIoUP172lvj2ihj+TpJ0ygpVBQMPR5TU02I8aIHRZDMAZRXMxmk9OmBVcGqsC99/KckpL+O1sRLnAeD/Dgg7GXedjk59MNtHv30Od4PFQYxx4b9acXAT78YXquhmo02tlJwyPSyZWGES6mEIz9ZvNmxkyD1WyVlrLCefv2+Mm135xzDqO2jY2Db/N4mD100kkxM3eOOYaL/ZYt/ROZVFkcuGsX49WFhTF5esMwl5Gx/9TW8m8wn7dz29atKTAOoKwM+OY3gTvv5OKfnU33UUcHFcKppwKf+ETMnt7lAj7/ebrennmG1oITj6ms5G02QdKIJaYQjEF4PNyltrTQHTRjhq9dhT+BXBseD6ttt29n14cxY3yLWkowdSqrw957z9euesoUlmwHywmNEunpdB2dfjoVbk8PW5BPnGjFaEbsMYVg7EOVdVmPPMIOC84C5PFwTczJ4bEZM4Djjx+cPdTSwr5IHR1c2FwuuuRbW1lle/jhgRVL0pGRweKMuXMTKsKMGQl7emOUYgrB2McLLzB9tKTEl0hTU8M6rFdeoVKYNw/YtImtfk4/nT3Pmpu5gL36Ku8z0Mc9aRLv83//B1x7re10DSNZsaCyAYBunocf5qI/ZgyP7dwJvPMOr0+ZwlhrayuHaJWXUylMncpUyDVr6CLy7/jQ1cVj8+bRB/7221QMhmEkJ6YQDADc3Yv40kxVucjn5tL9I8L/N2zgbU7d1apVbLa2bRszMpuafBeXiwW748fz/llZwMsvJ/BFRhNVFmzs3MnaBMMYAZjLyADA3vv+rp6mJsYCxo71HcvKYpzAabGQnu5TAkccwRiD0w+psJDuJH/3UH4+s42GhSozgJYsAdav57HZs9kuoqIi9v4oj4eBksWLqQyc0uwPfQg466wUKcs2jMCYQjAAcJ3z79zQ1TX4HP8qZIf0dObIA4w9BJsg2dc3zBG8fX30az3/PDXSuHEUZulStgo991z22YiVUvB4gD/9CXjxRb5YRwG53Zyn/OabwDe+YdFgI2Uxl5EBgGtYc7PveqB2/r29XND9F3WPh5XNFRX97x+I5uZhVtkuXgw8+yyfbNIkmiS5uQxwlJcDjz8OPPfcMJ4gBMuWURlMm8b+Ev5pWCI0lb773f6trw0jhUgqhSAi94nIHhFZk2hZRhsnnsixwE69gDMbpqmJBVL19bxMm+ZzndfXc9M+ezZz5+vrh643aG+nIlmwYD8F7OgAnnySyiCQtnIaLz3+eHjN5yJFFXjiif6tYN1uBlGeeYb5uu+/TyvhU5+ixTJUDwrDSFIidhmJSB6ALlUdYsbWsHgAwO8ApEL3mxFFZSWVwpIlXHO3baMycFJK3W5eGhtpEWRmAh0ditJxbmxf2YwjF2bjlFPy8d//0m3kZCp5PFQgnZ3ADTf4jkfM2rVc6IMNZMjOZrrU+vUceRlN6ur42OXlvN7XRyWwezcDLY6SyMzkG/fAAwyoXHBBdOUw9o/6elZLqjLOE8y3OYoJqRBEJA3AJQAuA7AAQDeALBGpA/AUgEWquiEawqjqUhGpjMZjGZEhwlbVubnA/fczmyg/n1aD01cnK4vrXn29oji/E8XdezEHH+CuG3LROuN1XHluLqafeyEWL5+A2lo+pipnKZx/PgeR7Teh/FEOqsyNjTa9vXxBjpto2zYqg8LC/jELJ8g8dSqtlQUL6NIyEkNdHfC3vzF/2j8IdthhwCWXpEAb3vgSjoWwBMALAG4GsEZVPQAgIuMBnATgdhF5TFX/EjsxjXiQng6cfTY9M0VFtAhE6B5au9a7CVZFVkcjKnrex9zpbcjKS8dYjxsP7zoZ8956GAtd38JxX74eu0rn7Gu74LifhoV/gUMoYlEO7aRb9fXxjdiwgTINDGD39NAMSk/n5ZVXOEXNiD979gC33UZ3Y3m5z4pzZmT/6EfAt75lCtuPcGIIp6rqraq6ylEGAKCqDar6L1X9KIC/x07E/ojI1SKyXESW19XVxetpRw3Ll9NFP3MmZ8nPmsXfzwEHMPB8yIS9OD17KcZmdMKVnQGIINPlQVoa8GpXFVBUhLS7f49JuU2orIySMgCAgw7i4tsXxFPpdlP4WbOi9KR+5Oezn9Hu3bQW2toGp0yp8s1ypq6NG8dpQ0ZiePBBpstNntw/hS4tjb3ZRdi/3WI9+wipEFS1V0QOEpFTRCTf/zYROdM5J1YCBpBnkapWqWpVSUlJvJ521LB5M5N3HHp6uPZlZdF9P7F1A5CeAaSloauLm6+ODiA/vQsrdpUBeXm805tvRlew8eM5h2DbtsA/YFXedtJJXLxjwYc/zOdpbu7vPnKev6mJi49/8YYtNolh1y5WVk6YMPQ5xcWsaamujpdUSU9IhSAiXwbwOIDrAKwRkfP9bv5xrAQzEkNaWv9MIWc9EwHS+nqR174H3em56OxkN07nUlOjqN0qdPWPG8cUzWhz2WXAgQf6WrE6AjY389icOcBFF0X/eR0mTwa+/nX+39vL5+3qoizNzbx9/nyfomhqomVjxJ+amsFKeyDObTU18ZEpBQjHZfQ5AEeo6kcAnAjgOyLyFe9tUa0AEpGHASwDMEtEtonIVdF8fCM0hx7avyjNqTvo7QVEPVAVNDcLurtpNWRn89LrykKhpwFLlwKNren9J7xEi5wczvj87GcpVE0NL3l5HBZw3XWhp9QPlwMPBH7+c+Dqq+meystjAPnEExlAdsZv9vXRUjrxxNjKYwQmkn7rwdyQo4xwgsouVW0DAFWtFpETAfxTRKYiygpBVS36lmDmzuUa19ZGz0taGuMHa9cCmWMz0NHjgrvbjbz89H3lAB4VuDUdR0+oQQaANW+240OfmokA1QLDJysLWLiQ/bc7O7nLy86ObwvVnBwqhJYW+timTOnvo+7tpdl05pm+eIIRX0pLaT2qhv5uBHMrjTLCsRB2icg854pXOZwDoBjAYTGSy0gQWVnAF7/ItO2GBv6epk5lYW5DUxre752OAlf7vqSfPhXs6hqLeYVbUJbVhOwshXS0Y2PFKbEV1Om25wxpiDfZ2SysOPJINmiqrqa1Ul3NVMePfYzZRdbrOzFMn86U0qamoc9pbaV709x6+wjHQrgSgNv/gKq6AVwpIvfERCojocyeDdx8M/DXv3J9S0vjRnfVKmBn9nSUajPSOz3oceVCRPGhog9wfMl6CBRjWrahdtxM1HYcjBjk+iQXjqvqxBN9eblTptDvFkmarBF9RFgx/pOf0LVXUND/9vZ2VkzeeGPgyvdRSkiFoKrbgtz2WnTFMZKFAw8Evvc9Ju7s3cvfTE8P8POfZ6OgewYq1z6JUs9OTC9oQE5mHzLaOuDq68be4oPwUsU1mO8Z4X0TnfFyTzzBCliXi37ruXNZxDGsKjwjKhx4IJMAFi2i9eYs/G43a0Wuvz6hU/GSkRH+qzWGg4hvGA5AxZCTA0w4sBR9sy+DZ9dKdG19HZ7edrTnlaK24ng0FM1ES23avolrIxJV4O9/ZwWf09nPGRy9fj17iX/lK5wMZCSWQw5hEsB773E6kyobcs2eHbwNyijFFIIRNsXFrPjfsAEoK8vEjskLsGNy/251vb30nFRVJUjIeLBqFfDUU2wA5e9uSEsDyspYmPH73wN33DF4nmgonM6pFnuIHunpTEmOdn+rEUjYCkFEBOxnNF1VfygiFQAmqOr/YiadkXRcdBEr/puauNZ5PIyhbtzIv21tTAKqrqYrPS2ctIVU46mnWHw2lO85N5dvxptvAmecEfrxWls5dOfZZ2mGZWVx4M7JJ/vMM8OIA5H8XO8CcAwAJzW0FcDvoy6RkdRUVADf/CY3sJs3czzAiy/6JqEtWMAEnDvuAP7v/+iuHVF0dLDN9fjxwc8Ltzhv1y4Ga/76V19TvOJizjT97nc5/Mcw4kQkLqOjVPVwEXkXAFS1UUSGM//KSFFmzOCC/4tfsED4oINoLUya5KsLKy4GXnuNfz/60YSKG116e2kZhHLppKezVWwwenqAX/6SlYD+QZeMDFY9d3cDf/wj2zXPnDl82Q0jBJEohF4RcQFQABCREgARlAMaqUBtLfDSS0yg6e3lunTGGezI4N/LrauLsYQTTvAV5/qTlkZvxzPPcNTwiMnCzMvjG+GUag9Fayt9ZsFYtYodOSsrA9+elcU37qmnGKQeLnV1lCsri0omWfx5TU1sqQtQrkjjLkbUiEQh3AngMQClInIbgIsAfDsmUhkJ4bnn6LlIT2ehJ2cfAHfdxSzKG27wpXO/9x4r/gMpAwdnsM66dcARR8TnNcSc9HTg1FN909sCoUrX0sknB3+sV14J3YivpARYudJXOr4/rF8PPPooNbjTrKq0lDOojz02cQHs+nrgn/9krMV/VsGCBQxWWfPKuBOWQvAGlJcCeBvAKWDLio+o6roYymbEkRUrgD//mbt6f0tg3Dhetm4F7r6bM+RFuN6p+iapOe3/A9HREZeXED9OOolm1N699In5o0oza/bs0G24m5tD915yBu50du6fQli2DPjDH6jJnfRYgG037rmHsiaiorqujrMK2ttphjoB+r4+DrNZv56zCsrK4ivXKCcshaCqKiL/VtUjAKyPsUxGnFEFHnuMcdKBLf4dJk+mVbBlC62F5mbOGFm50ndOeTnjC/7dn4ER5C5yGD8euOkm4Ne/ZjpVbi7NoY4O+tkOO4z9P0JVwI4bx4Vx4FxRt5suKREqDNX9exP37mW//4kTBw8NKiig++uZZ6i84p2S+cADVHKTJ/c/7nLx2K5dHN3nZDAYcSESl9EbIrJAVd+KmTRGQti9mxvFYH3YRKgs/vc/rjOPPMJeR8XFtAw8Hhbsbt3K9j4TJ3JtzMjgoJ0Rx+TJwI9/zJYVb7xBl05ZGV0w06aFt4idcALw7rs+10hHB4unqqv7d+s88cT9mwL32mtUJkPd12np8PTT8VUIzgi+YNWLZWW0ErZvt4lmcSQShXASgM+LSA2AdtBtpKpq1R4pTnu7zzMRjKwsppo+/zzXQyewXFjI+48ZQyXw1ltcw+rrgfPOG4EWgkNGBquR97ci+dBDmZq1axd366++ysyj/Hwu1r29DLhu2cL2C07L7XB5883Q6bFFRVx4u7piM3o0EFu28G84swqqq00hxJFIFMJZMZPCSCi5udyQBusU3NkJ7NjBpBiXi2vHwQfz+LZttB5ycnhbZyfw9tvA5ZcD558f+PEMUKHccAPws5/RdePs2D0e+uQA4JhjqH2XLaOvLpxCN4eentAKxPnA4zkTIJJZBZGcawybsBWCqtpYoRHKhAlcc1paBvv/u7o4iXDbNnpFHHf2rl10lR9xBF1NmzbRlQTQXTRxInDVVcmT2Zi0lJQAl1xCF0pbG8219HQOoZg61RdInjCB6aennBI8tcuf8nIW0fnPRB2IE6wOdk60CTd7SGRw0N6IKZG0rvhuoOOq+sPoiWMkAhHu5O+8k54LZ73p6mJmZGenr7NzUxM3se3tvO3YY+nu9U8G8XhoTZgyCJP33uObO2nS0Ofk5lLjbts2dN3CQE49lRk7wUy/PXtYORjPD2vmTC70LS2D21I7OLMKQmVqGVElkm9Bu9+lD3QhVcZAJiOG9PQAy5ezTfyXv8zuwI89xs3oxz/OoPDOnfQgrF1LBdDXx03k0UdzXXK7+Tc7m4810Kpvb7eNXUR0dITXeTMtjXGFcDnoIJpxtbW+4dj+7N7NGMPCheE/ZjRISwOuvJJBpvb2wbd3dFD5XXmlzSqIM5G4jH7hf11Efg7gP1GXyNiHMz/e7eZGaqiU0HBpaQF+9SsGhseO5SLvdrOl/+LFwOc+B3znO8B//8sElfXrWb904IHcvGZk0I29Zg1lycqiwtizp/8Uwvp6/paNMJk4kelbwVClZi4s5P+bN/sCOpWV/KAG4nIBX/oSm0q9+y5Nv+xsKpXublolX/7y0Lv0WDJnDquv//hHpt469Rjd3XRfXXedtQ9PAMNpf50LIKpTQETkTAC/AeACcK+q3h7Nx08VPB5m6ixezKw7gAvwySfTCxAqcWSox/ztb2kBTJvmO56ZyRhAZycLz77zHQ4BO+44tpEfmBlYXs7Oph0dtBKcamZHIdTVUb4jj+x/v+ZmJoz09dF6KC+39PJ9HHUUzTSPZ2jXTX09d/x1dex/tHNn/zdw7lzgiiu44G/ZQk0/fjzf6C9/mR/8smXceefn8wM68MDE7sAPP5yZVitX+mYVHHAAX0uogj0jJkQSQ1gNbx8jcMEuAXBrtATx9kn6PYDTAGwD8JaI/EdV34vWc6QCHg/rcV56iRmBzsLZ08NElFdfZU1UMHdzIDZs4GWo1O+cHMYPnniCiS+qgdcmpzPzsmW0DtxuxhoaGuj2LSoCvvpVXyy0tRX4xz9ocfi/xqlTgU98wlzEABiAWbgQWLKEu/2Bb3x7OwPOhx7KjKTCQr6BjkLweNgX6bLLGLDNyOBtfX0875JLmBIWrNAkUWRlUTkN3EEYCSESC+Ecv//dAHZ7ZytHiyMBbFTVzQAgIn8DcD6AUaUQXn6ZymDatP7rgrOT37sX+M1vWBMVyebu1Vf52wu2Ky8uBlav5m6+rIzrTKBNa0EBk1127qQnwul0etJJ3Nw56extbcDtt/M8/+4EqkBjI2+78Ua6uUc9l1/OBfzVV+naKSjg9ZYWfvjXXgv86U/8kAa2sOjro1WwfTs/LGdxVaXW/ulPOS7SXDBGCCIJKn9JVWu8l+2q6haRn0ZRlskAtvpd3+Y91g8RuVpElovI8rq6uig+feLp6+MOfcKEoT0HxcV0Ha+LsIuUM/4yGGlpvLS1caN52GF8rkCkp/OcBQvoor7pJno+/Gub/vMfZhtVVPRXXiL0ZhQVsc1OqC7Ro4KMDObp/vCHrGAuKqIWveIK+u7S0mhuBepntHEjNeyECdS+XV08LsJMnZISvtGdnfF9TUbKEYlCOC3AsWgWqwXauw5KjVDVRapapapVJSOsG+KOHdzQ5eUFPy8zk9k9kVBQQLdTMJy4pbOoX3wx/9bXDz63s5Mb0ssvD1zg2tFBSyeYays/n94Q/35IoxoRas8rrgBuuYWdBE8+mSXgGzYEziro62OAOT/ft4tobe1/Tl4elcTbb8f+NRgpTUiFICJf9MYPZonIKr/LFgCroyjLNgD+8wKnANgRxcdPenp6wksHz8gInK0XjA99KHTX0cZGNqdzgtaTJwM338y1prqa2YvbtvH/1lbgC19g8DkQO3ZwrQqVTZmdzTR8IwRDVey2tfnazToESjHNy6M/0DCCEE4M4a8AngbwEwA3+R1vVdWGKMryFoCZIjINwHYAlwD4RBQfP+kZO5aLaLA6IoC784kTI3vsQw+lR2HPnsAZik7bnKuu6v/cU6eyS7ETlO7r465/zpzgiSBOa+zaWrrBXS56LoqK+j++iHUnCIvp0zlzeSD+i7/z/8DuqYC90UZYhFQIqtoMoBnApSIyDsBMANkAICJQ1agMffXGJK4F8CyYxXSfqq6NxmOnCsXFTAapqRm6ul+Vv+ujj47ssdPTGVf82c98j+/0MNqzh0rm4osDN71MS2M2ULgZQarcjL7xBi0Apxvq++/T2liwwNcio6urfxqsMQROtN7J93Vw/vd4aDZOnBg4WNTRQaViGEEIO4YgIp8Fh+Q8C+AH3r/fj6YwqvqUqh6oqjNU9bZoPnaqcOGF/F0Hcu+o0l1zzDGRp50CtBC+/31WJHd3UzFs28bg8S23AB/+cHRqA559lmn106bRMhgzhgqgsJBusVdeocvJ6b22YMHwn3PEk50NfOYzbCLl7y/MzGRucl0d38xDDhl8X6e6OdJdhDHqEA3kbwx0IuMICwC8oarzROQgAD9Q1YtjKWAwqqqqdHmk0dUU4J13mBTS28uF1OXyLaBHHkm3znDrdlT5eOnp0a1NamlhHUNZGR9/6VJfQzxH2Tj1ChMmAJ/8JFNYjTBZvpyj7VpafC6iri6mnR58cP/6BIAfwtat3AWce25iZDaSDhF5W1WrBh6PpA6hS1W7RAQikqWq60XEyopiwOGHM9PwzTd9w+5nz2Y2YrizV0LhDOOKNk5vo8xMXo47jsecbs5paYxD1NQwtT7U2GFjAFVVrCdYt469iFwufikyM7mLqK3lh+vMU8jIYAXgmWcmWnIjBYhEIWwTkUIA/wbwvIg0YpRlAcWTggLgtNN4SSW2bOnvwi4oYMFaYyNrITwexhF6e7mhtfYVEdDayo6Dzc18E6uq6Idz+MEP2AJi3Tr6BCdMAObPD53HbBheImlud4H33++LyBIAYwE8ExOpjJTF5RqczOIUovn3YKqttfbYYdPbCzz6KEfVud18Q53eIgsXApde6itDP+AAXgxjP4ikl5EAuAzAdFX9oYhUAJgHIESbRmM0MXs2C9KC0dNDT8b+BMZHHR4PcN99bAZVUdG/3qCvj71OGhrYwC7cwTmGMQSR7NHuAnAMgEu911vBZnSGsY85c+jNGFgsC3BTq8qitZNPju+QrpRl/Xoqg8rKwQu+y0UlsWIFm0oZxjCJZEtxlKoeLiLvAoCqNorIMDv0GyONzEzgmmuAO+6gG7uwkJmSGzdyI9vZybWtsjJ4t2fDy3PP9W9LMRCnX9HTT1v+rjFsIvk59npbVCsAiEgJACt9NAZx8MGsayguZsvul17yzXI59FAmxfz+92zzHc/Z7inJhg1c8INRWMhofrwqkVWp5Tdv5t8wU9eN5CcSC+FOAI8BKBWR2wBcBODbMZHKSHlmzGCMYMYMrmcuF2sqnP5sHg/d3xMmsCDOGAIngJwMqNI19fjjvqwAj4duq498hOmwljaW0oTT3O7P3n+LAXwD7Gm0E8BHVPWRGMpmpDB793KIzqxZXPRLSvo360xLY/O8J5/s3/66tZXV2Fu3RjY+eMRyyCH0tQWjoYFvdKz9b08/Dfz610x7rahghXRFBa//6lc0B42UJhwL4QgRmQrgMwAeBPCwc4OIjI9ygztjhLB69dBT1xyyslhku3Ej3Uv/+Q/7Hzmb4pwc4IwzgNNPH8UTFU89lRWKfX2BS8qdwdtXXRVbObZs4ei78vL+LWxF6LLKywP+/nf6CysrYyuLETPCUQh/AOsNpgPwb6guYDxh1HTM6upiUDQrq39/MWMwTofTcNiyBbjrLqajTprku19XF/DPf7IW6/rrA89dGPHMnEml8NxzwJQp/TVjTw+HUhxzTOzHzi1ZQhNvqH7mGRm8/cUX2XPJSEnC6XZ6J4A7ReRuVf1iHGRKOrZtY8O2ZcvoMlVlAehZZ/H3moq43Vxo33iDvdLKyjgzobIyOm5gp5V3KFSBf/+b1sDkAfPxsrMpz7p1wOLFwEUXDV+ulEOEs5KLijhOz5mGBnARPu884Pzzo9uQKhD/+9/QLXgdSkp4nimElCWkQhARUTKkMnDOia5oycHq1XSbulz0hTutnNet4wCqT38aOPHEREsZGdu38zXV1XEhzsjg63nuOcYFP//54VtAc+f65rwPtVZ1dvo6nk6ZEvgcESqK558HzjlnlFoJaWnA2WezC+D773MoTm4u4wbxKubo7Q2tdJz+SVHA4wE++IDxJI+HnqqDD7bau1gTztu7RET+BeBxVa11DnprEI4D8EkASwA8EBMJE0hDA/Db37Llgn87mLQ07qi7uzn3fOrU1Onp39DA4faqg129qsCqVXTf3Hjj8GKU48ZRUb74YmCro6+PBWqVlUPPbXbIzOQ6U1sLHHjg/suU8mRlBR5YEQ8mTWLE3xlkEYjW1sFm3n6wcSOwaBG/FyK+2T6FhTQ+EvUWjAbC+cmfCaAPwMMiskNE3hORzQA2gFXLv1LVB2IoY8J4/XW6VobqDZaVxcXqhRcC3+7x0N20aVPoRS9eLFlCF1Fx8eDbnJG+a9ZwIzpcLr2U/de2bKE14nbTIti5k4v72WfT5RaOt0OE9x+x7NlDv9iiRcBf/kJ/XjIVaZx5Zuhsp8bGYXdV3bKFG5bubm4Wpk7ld7Kykt+TX/7SJoHGknBiCF1g24q7RCQDTD/tVNWmGMuWcF55ha7bYJSW0g//mc/4FjaPh90GnniC6ZdOy+eZMzkA56CDYi97INxuKq+ysqHPEaEXYskSmujDITMT+NKXODP5uee480tLY/zllFPYg23JEs5MCIYzJc6/Od6IobcXePhhYMkStLuz8HbrTNQ2u+DyLMWhM57HId//ONIrkqDp0xFHcHXevp3Wgr/J5/Qjqahg7/b9RBV48EF+/wLV4jmTQe+7j+3hYx02GY1E5JFT1V6wBmFU0NUVunOw093T7eb/qsBDD3EBLC3lbwTg8Z07gZ/8BPjiFxMzvKqtjTv0UCmc+fm0bKKBy8UEmKGSYI44ghvigXPi/amvp6towoToyJQ0eFdAfellvKgn4W/vzUGvJw1Zrj4oBM8u60Xhee/jmkU5mHlkiGrlWJOdDXz1qywx37CBH1ZWFrfybjd3O9dcM6wgz9attBCmTh36nDFjOEtj/XpWvRvRJSlCNCLyMXAc58EAjlTVpBiDVlJCV0dmkI5NXV2M7znnrFzJAOi0af198CK0NnJzgXvv5e8nlPURbTIyaKmoBs8k6uujUogHY8cyUeZf/+JCMFAptLXRxfXxj8dHnriydSvwyitYgpNw/6rDUV7Qgqx0PzfRGKC5rhc//WY9vn3/uMSn948dC9x8M32gb7wBNDVxK3/00ZzXPMz0tJ07fTGDUGzfbgohFiSFQgCwBsCFAO5JtCD+nHoqh1AFayWzZw+z/pxiqief5O9mqIBsTg4timXLmDUTT3JzudPeuTO4MmpsZEFYvDjvPL4nTzzB9zEvzzczPjeXG9MZM+InT9x45RV0SB7+9t6cwcrAy9jxLvTs3oq/PzQV37xliBqAeBLDmQvh6pNQBY/G/rNfCkFEJqjqrmgJoarrvI8brYeMCvPn0126a1dgd0VDAxeshQt5vbOTfnLHTTQU48ax+DTeCkGEgdxf/IIZG4F8sB0d3KUfdVT85EpLY2zlhBOoKKurac3MmcPPYMSmmtbU4J32WejtSwuoDAAALheKM5uxbpUbu3ZljDy3mR8VFb4W6UMtBU5yezC3krH/7K+F8BSA/Y8epQhZWdyd/vKXXKTy87nD7+lht4DCQuBrX/NZEM4wq1B6zeXiYySCuXNZUPf008w0KijwpfXt3Uuldt11/SczxouiovgryYSSkYFtLQXIcAXPJhIBXOn8fMJWCDt3ss3sq6/yQy0uZg+Qo4+Onz8wQiZM4ICljRuHfp2Njdyk2VC42LC/CiHirbyIvAAg0Md8i6o+HsHjXA3gagCoCLUVjwJFRcD3v89UzCVLaBUUFQEXX8zdq39dUF4eLYauruC72tbW2HcaGAoRpoNOm0YXTW2tLzB+2GF034xI90wyUlWF9CfXwqNBfk7d3UBuLjQzK3w3yZtvAvfcQ9OrpIRf2I4ORu+ffBL4xjeAiROj8hKizRVXAD/6EfXZhAm+zZUqFWJvL2tkksyZMGLYX4Xwf5HeQVVP3c/nGvg4iwAsAoCqqqq4VEdnZHDxnz8/+HkuFzdhjz02tEmryt/mySdHX85wEWH7m6OPZgyku5uWQiKsglHNggU4uORlLN47xBwDVaC9He65RyDNlRbSFQmAaTp/+ANT3Px3K/n5vNTV0Wd4221J2TGwrAz49repu9as4TEnPnfAAVQYcdgHjlr2VyE8GlUpRhAnnEBLfffuwfn+qkyZmzcvOSpuRYLXJBjDw+1mDcYLLzAOlZ1NRXzMMV7lm5+Pg276CIqv3InGhmy6Hp2tb28vU6ymTMEOVzlOXBimp+fZZ5nyNlRLi5IS+j9XrgSOPDIqrzPalJXRVbt7N9OfVWnQDCx/MKKP7E8LIhF5R1WjFkMQkQsA/BZACYAmACtUNWSeS1VVlS5fnhQZqv3Yswe4805+mbOyaGF0dXGBqKpip+KRPE+4r48/3NGcCdLaCvzmN0zZdzbnbjddjhkZwLXX+lowbHlxC26/uQlpTY0oyWlFmgDIzETvtAOxI7sSk6e4cNNNYSiEri5WAk6eHLxqq6GBzaO+8Y1ovVwjxRCRt1W1auDxuMUQgqGqj4HT2EYEpaXAD3/I9g//+x83emVldNFMnjwydzk9PWz299RTTK8XYaXzmWcyUDialIPHwx5YW7YM7uM0ZgzTaX/9a+B73/P2wTp5Gr79T+CR+1qxeqUHaRlpQG4e0tLTcPJC4IILwrQOOju9EegQJbxZWawhMIwBxC2GMNpIS+OCONz2D6lARwd3w+vWsb2EEz+prWWLgRNOAD71qdHTamDDmm588FozpvZtgdS6GaCpqNiX0pWXRwviySe5oQfYzfPG741BXR3d/GlpPBaqUr4fOTn0rwRrMQswaFRaOqzXaIxM9kshqOpd0RbESF0efJCukWnT+u+Gi4upIEbV7OQNG7D0+reQvX0iZGwnV/b6elb3TpnCzASXCyUlwPLltB79d/8lJaHHDgxJdjYLSN55J3gWUUsLtXS4tLVRS4nwgxyxhSFGslQqGynKnj3MciwvD+wK85+dfNppwduApDzbtwM/+xnquj+CnHHZQLb3DcnO5s5961ZeP+IIuFwCkcEKYdiccQbbSnR2Bg5U7dlDjTN3bujH2ruXc01ff91XEeZyse/K5Ml8XdOm0Sc41CQ1I6UwhWAMi1Wr+Dfc2cmHHBIfuRKCt/dG3hjBjoYBLhtn9vC2bcDMmdCCsfB4YpD5WVlJP9Qf/sDrpaVcrDs6aKmMG8dE/lBPvHs38OMfM+DhTIbas4dBsRdfpBZzpiDl5wOf/SzT54yUJpyJaeE0HfaMhnbYxmBaW8OPDXR0xFaWhNLaysVy8mR8SLfh3V0TUTxw6pyTerV1KxonjcWMGTGq/ViwgO6pl1/2VSoXFQGXX06XUiiTRJWFbT09vlF2e/fSUsjJ4bHmZpYNH344lcavfsVcUZtek9KEYyHs8F6C5ca4AFi5yChk3LjwZycnaceE6NDcvC/DZ+6E3Rif04n6jhwU5Xb2Py8jA+6mVjTlcoZGzDLOJk4ELrmEl0iprgY2b/ZlB6gCK1bQReRYFmPG0AV2yCGMfBcXAw88ANxxx9A7hMZGzk1wCgvi3e7XCEk4CmGdqgat0RWRd6Mkj5FiOBvCULOTCwpGeP+Z9PR9fvZMVx9uOPoN/PS1Y1HbXICyvHZkpffBo8De9ly06ThceG14bvyE8MEH/Otoq8ZGBjv8x2empfH1NjZycXcGFbz//mC/4N69wCOP0IJy7qfKAPvFF1t1ZBIRTnb4MVE6xxiBjB/P2cm1tb64oz/O7OTzzhvhA9JLS7lLbm0FAJSPbcEPT3oJ5xy4AU1dWahtHoutLWNxQM4O3HRjz76W6UlJT09/7d7ezr8DBXZ6SjiosiTbn7o6Nid65x26msrLmYJbXs7eFLfeysZFRlIQ7gjNgIjIp1X1/mDnGCOfSy9lJuNbb9EtNG4ci7Pq65nyfu65/Xs3dXezc8KKFezQUFHBdg6B5jynDGlpzKu99166UNLSMD6nExcevA7nz1qPjt4MZLQ1Ilu6gQsujHJpZ5SZMKG/HzCQ5nJ2+QMzmQaaiQ8+SBNx8uT+x9PS2Itizx6+Z9/+dhJryNHDcPdsPwBwfzQEiRduN61cJ+ljRO9a44QzO3ndOk6Lc2YnL1hAReA/TGv9euB3v6MHIjeX5739NiemnXUW77N5MxVFWRmnYiW6B1tLC70dy5ZxbZs4ka/roIMGrH/HHceCjJdfpsXgHQLsUjfG1G/nOd/8ZuJfUCgOO8w3HjMry+cq8h9U0N3N1+dExR1LwX+s265dwOrVwYcXlJSwRqO21oYcJAHhZBmtGuomACnj/OvoYLbcs8/6sl3y89la4cQTR3ZvoXjgcjEdffbsoc+prmbMcexYDBoH2dLCedOFhVwXnJbcubmMix5/fGI2kGvXsg1Fd7dvA7FuHYvKZs0Cvvxlv2C5ywV8+tPsXPjkk/SpO4O2jz6aFsSkSfF/EZGSnU3f/v3307UzZgwX7oYG/t/bS804f77vQ6mro+b3b0VaXR16QIhzW3W1KYQkIJz9cRmAMwA0DjguAF6PukQxoLUV+NnPuAmZMMGX3NDRATz8MF0dX/1qhG0CRiBtbVzoli/3uXKOP37oorNI+de/uOEsKOh/vKODGY0uF623o47yKeiuLnoU3O74twzfupXDkcaN6z+wJS+Pa/ymTZw5//Wv+9VhuFwcoXfccVwk3W5qwGRJsXL8da+/7qsxOP54Rvz9i0lOOolfgn/8g5q5vJw7/h07qBSOOoomnMdDt4/LxVoE/y+KZ4i23oEIJ1XNiDnhKITFAPJVdcXAG0TkpWgLFAsefJBxq2nT+h/PzeWmprqaiuGzn02IeEnBqlXAXXf5PAEuF103zz/Pte2TnxxeMerevYwhlpcPvu399xnHLChg9ub27b6MpOxsup//+le6k7xemLjw5JO0CAKt5SKMka5bRxfZoHbmaWnJlz1TU8N6gaYmvqiMDO6SXnmFTbeuucb3YkVY9Xz00fSXbdpE/922bfww3W7e1+NhutQllwxul1FaGjjTYCDWhz1pCCeofFWQ2z4RXXGiT10dd7yBFiKHyZO5YbrootE5JGbTJq4TxcX9d8Jjx/L3vnSpzxsykPZ2unvS03n/oSyJhgaukQMrmru7uRN31qH0dD6eP1lZ3EC+9Vb8rIT2dj5fMA+PCGVbujQ55lsEpa6OZrLL1d9fN3YsF+3332dw5+tf7x8YGTuWPUdOO813rL6eWhugEhiq+dL06fxCNTf3T1n1x0lnPeigYb08IzqM+JDqBx/w+x6stYLj5v3gg6SdGRJTHnuMLppALrO0NK4fS5cy6OsojB072Op62TJeV+Vt55zDTeXA99svTb8fTkajc77HEzjQn5vLnXi8FII3ezRkFXZeHrs8JD3//S/9b4F2RiI8vm5d4DqCgRQVhVdUlpYGXHmlr1htoKnV0UFFdf31o6cVbpITsg5BRN6JxjmJors7vPNUEzf4PpHs3cvAabAOm87O/s03eX3TJuAHP6AnYdIkriXl5Vxv7r6bLrqB7uMpU+j+6RqQoDwwlb2vL7D3IJRSjzZZWXwNoTwePT0pEHvq7eVA8GBuGRFq3RdfjO5zH3IIeyd1d9M3u307dxPV1bQOrrsu9GxaI26EYyEcHCTTCGBweQh7MPGMGxfeeU4a6mijqYkLbaigcXY2f8ddXRzukpvb3wsgwhhAfj43ozNnAsce67s9M5Pzph99tH+b7Px8Pn9fHxfXnJzAyqmzM76zJQoL6fHYuzf4d6itDfjQh+Im1v7R3k6lEKrVbH5+bIrEDjuM0fk1a5iWC/BLMGdO8qfgjjLCUQjhOPeSNkXgkEO4yDgp1YHo7ORvYdas+MqWDGRmhhf3c7upBFaupDtlYNqoQ1oaF/TFi7lQ+iuas87ierB6NV3POTmMa1ZU0EopKGCB2kBLoKODn93hURvaGhoRZon++tcMZAdyYzU2UnEkbQsKh4wMn7kTTPO73YNTwKIpw/z5Zg0kOSGNcFWt8b8AuArA1QCOBJDpPb4t1oLuL1lZwEc/yuQIt3vw7b293Pl+7GOjs6X7pElcA0J1Iu3p4YL8xhuhMyjHjGGGYl1d/+NZWcBXvgJ8/ON8vtpaX0B5+nQGZgdmETU300f/2c/Gv1Zk/nzgIx+hnHv3+hRnTw/ldruBG25IgU1uXh6Dtg0Nwc9rakoBc8eIJREHlVX1uyJSBmA+gI+KyAxV/dxwhBCROwCcC6AHwCYAn45mO+1TTuEC9Nhj3H06m6DmZv697DKmYieK9nbuNl0uZurFM76Wns6d8IMP9q8o9qe+nhlEBx/MQHKo6m6ny3Nv7+DbMjMZeD7jDHon+vp88cmHH2acwt9iKSsDvvY1eh3ijQjnGc+cyde9bh1fV0YG3V+nnJJC7TbOPpvzTAsLA3/B2tqo2RYsiLtoRvIgGo6/AICI/BrADRruHSIRQuR0AC+qqltEfgoAqvrNUPerqqrS5cuXh/08e/awPfz69bx+6KH0cyfqR71nD3PdX3uN1z0eKquzz2ZdULwslr4+YNEipt76dVxAby93+jk5wE03MTD8l7+wM8PA1jQDH2/HDs5ZjrQeq7GR9Q+Oopg2Lb7B5GB0dPiCyClnTaoygPP44wyKFBZS4/X18YvodjP4e+ihsZOht5dvYmamtQZIMCLytqpWDTweiYXQBuA/InKJqrZ7F/Hvqeqxoe4YClV9zu/qGwAuGu5jBqK0FLjwwlg8cuRs28ZWDd3dvoFUAK2Fv/yF8bdrr43PyEmXC7j6asZbnnqKLhJnl3/SSdzNO4He444DXnghuDt69+7w5rAEYtw44Igj9v+1xJLcXF5SEhF++adNY4Bnyxafpl2wgLsQ/7YT0WTvXn5pliyhUlCl4jnrLH7prKld0hC2hQAAIvIJADcA6AbQDuBHqvpKVAUSeQLA31X1L0PcfjUYw0BFRcURNTU10Xz6uNDXB9x8s2+Q1UBUmZV30UXsFBpPPB66mp2OCwM3cqps1/DWWwwsD/wtt7TQ+/C97wW3IowE4swx6Omh1o5lW43qahbEdXfT/5eZ6WuF29rq+5KbUogrw7YQROQUAJ8DFcFEAFep6vsR3P8FABMC3HSLqj7uPecWAG4ADw31OKq6CMAigC6jcJ8/mVi/ngHXoXp5iTAL55lnuDuP52D6tLTgLjQRX4uP5cvpOsnLo5JrbeXa8vWvmzJIakQ4yCLWdHWxBD4jg+a5g5OKNm4c8M9/0mpJRJDIGEQkLqNbAHxHVV8VkcMA/F1EblTVsCpZVPXUYLeLyCcBnAPglFjEKZKJlStD+6Czs+na3boVmDEjPnKFS3Y2297U1LANzvbtPHbUUZyzbu5hAwAHXjQ3D52jnJ5OM3Tx4pGtEFpa2AbBadg1a1bSBqHCVgiqerLf/6tF5CwA/wIw7Dw1ETkTwDcBnKCqI3kUOwBunMLJJBIJnCqbDIjwdz7Ub90w8Oqroesaxo9ncUqwfkepSlcXu8W+/HL/0v38fObCn3BC0rnK9ruXkaru9LqRosHvAGQBeF74Br2hql+I0mMnHZMmhW6pocrv0GisnjZGCO3toXfCzryEkdY3pqeHVY3r1zM9zz9Xu7MTuO8++ljjHSQMwbAS+lS1MxpCqOoBqlquqvO8lxGrDABfA71gLeDr61lLZF2BjZSltDR0xWNfHxVC0jeEipDXXmP5/dSpgwt3cnLY/OvRRwfPoE4wSZLhPboYP56FTTU1gZVCWxs3VxfFJPnWMOLECSdQIQQLCTo5yimbzxsAj4cFRmVlQ7uEMjIYXH8lqkmaw8YUQoL42Mc4vnPrVl4aG5muXVNDZXDjjckXTDaMiJg1i/1Itm8PrBTa2rh4nnVW/GWLJa2tNPFDpfMWFrLgKIkY8fMQkhWXC/jEJ9jf//XXma6dns5+QYcfPrI2TMYoxeVie+s772TgOD+frqHeXvZNyspiM6gpUxItaXQJ1UTQYWDv9yTAFEKCmTAheaqnDSPqFBSw78m6deyLvmsXd8Yf/jCDabHqrppIxoxhxlR7e/DYSFNT0pXlm0IwDCO2pKezzmAk1xr443LRDfbQQ4MHuTv09TGnfOHC+MoWAoshGIZhRJvjj6cyqK0dPD6wp4c+4rPPDj60OwGYhWAYhhFtcnLYt/3BB9n4y+PxxRWysoBLLqEVMVIK0wzDMIwg5OcDX/oS0wfXr2flcmEhO70maX8XUwiGYRixpLiYfeNTAIshGIZhGABMIRiGYRheTCEYhmEYACyGYKQoHg+waRNre9LT2eZjJNY4GUY8MYVgpBzvvAP87W+cOgf4Oigfdxxw8cXW9sMw9hdTCEZK8dprwD33cAKj/whStxtYupSNAr/+9aTN6jOMpMZiCEbK0NIC3H8/izvHjOl/W3o6FcSmTWyZYxhG5JiFYKQMb73FFjDZ2UOfM3Ei8MwzwBlnJO3Y2tSkpQVYtQpoaKBPbvZsdmY0RhSmEIyw2b4d2LKFi3JxMdvdDxwGFUtWrRpsGQwkO5uxhbq6pGsTk5r09QH/+hfw7LP83+XyTXWaPx/4zGdCfyhGypAUCkFEbgVwPgAPgD0APqWqOxIrleFQV8cRsOvW8boqhz0VFABXXAFUVcVHjhRuM5+aqAJ//jPw4otARUV/7a9KDf3zn7O9tQVtRgTJEkO4Q1XnqOo8AIsBfDfB8hhe6uuB224DNm+mj76ykk0cp06lS+bOO4Fly+Ijy8yZHLIVjJ4ebmKLiuIj04hmyxbgpZf4oQ80BUU4F7i6mhOejBFBUigEVW3xu5oHwPZ3ScK//81FeOLEwbvz/Hwef+ABoLMz9rIccww3pr29Q5+zcyen0AWLMxhh8tJLQGYmzcGhKC3l/OCBLZ6NlCQpFAIAiMhtIrIVwGUIYiGIyNUislxEltc5iehGTGhp4eYvWOwwJwfo7mZtQKwpLgYuuIAt5ru7+9+mSmVQVMRZ1UYU+OADducMRl4eqwM7OuIhkRFj4qYQROQFEVkT4HI+AKjqLapaDuAhANcO9TiqukhVq1S1qqSkJF7ij0p27eLfUIHjnByOzI0H55wDXH45k12qq6kcqquBmhq6sm6+mdMLjSjgcoUOxqiGH9wxkp64BZVV9dQwT/0rgCcBfC+G4hhRJJ4BXBGmlC5cCKxezYB3VhZw0EHA5Mm2LkWVOXOA558PPhe4pYVvvJWHjwiSJctopqo6e8zzAKxPpDwGmTiRf93u4FZCVxdw4IHxkckhJ4cz2o0YsnAh8PTTDNoEKupQ5fCXj33MNPEIIVliCLd73UerAJwO4CuJFshgevmxx9I3PxQdHQzgHn54/OQy4sTEiVzsa2uB9vb+tzlzgauqTDOPIJLCQlDVjyZaBiMwF1wArF0L7NjB4LJ/wklrK102111nWT0jlrPPZsHJo48yUOMUeWRmAueeC5x/fnyrE42YIprCFTxVVVW6fPnyRIsx4qmv56zwlSt9x0SA8eNZmDZvXsJEM+JFXx+wcSN3AVlZwAEHWDFaCiMib6vqoJJSU+1GSIqKgBtuAHbvZoGa07pi5kwmohijAJeLvUqMEY0pBCNsysp4MQxjZJIsQWXDMAwjwZhCMAzDMACYQjAMwzC8mEIwDMMwAJhCMAzDMLyYQjAMwzAAmEIwDMMwvJhCMAzDMACYQjAMwzC8mEIwDMMwAJhCMAzDMLyYQjAMwzAAmEIwDMMwvJhCMAzDMACYQjAMwzC8JJVCEJGviYiKSHGiZUl2VDnWcsUKYNUqoKkp0RIZhpHqJM2AHBEpB3AagNpEy5LsVFcDf/0rsGEDZxw7U1CPOgq4+GKgsDCR0hmGkaokjUIA8CsA3wDweKIFSWY2bgRuv51jbSsqONsY4FjLt94CNm0CvvUtUwqGYUROUriMROQ8ANtVdWXIk0cxfX3A3XcD+flASYlPGQAceTtlClBfDzzySOJkNAwjdYmbhSAiLwCYEOCmWwB8C8DpYT7O1QCuBoCKioqoyZcKrFvHBb+ycuhzJk0Cli0DPv5xYOzYuIlmGMYIIG4KQVVPDXRcRA4DMA3ASuGWdwqAd0TkSFXdFeBxFgFYBABVVVUaO4mTjw8+ANJDfGIuFy2HrVtNIRiGERkJjyGo6moApc51EakGUKWqexMmVJLS19ffTTQUqoDHE3t5DMMYWSRFDMEIj4oKoLc3+DmOMigri49MhmGMHBJuIQxEVSsTLUOyMncukJ0NdHYCOTmBz6mrAw491BSCYRiRYxZCCpGdDVxxBQvSOjsH397YCLjdrEUwDMOIlKSzEIzgHHss//75z8Du3Qwyq1IRlJUB119P15JhGEakmEJIQY49FqiqYsuKrVupFGbOBGbNYuWyYRjG/mAKIUXJygIWLODFMAwjGth+0jAMwwBgCsEwDMPwYgrBMAzDAACIaup2fxCROgA1foeKASRbhXMyygSYXJGSjHIlo0yAyRUpiZBrqqqWDDyY0gphICKyXFWrEi2HP8koE2ByRUoyypWMMgEmV6Qkk1zmMjIMwzAAmEIwDMMwvIw0hbAo0QIEIBllAkyuSElGuZJRJsDkipSkkWtExRAMwzCM/WekWQiGYRjGfmIKwTAMwwAwQhWCiHxNRFREihMtCwCIyK0iskpEVojIcyIyKdEyAYCI3CEi672yPSYihYmWCQBE5GMislZEPCKS0HQ8ETlTRN4XkY0iclMiZXEQkftEZI+IrEm0LP6ISLmILBGRdd7P7ytJIFO2iPxPRFZ6ZfpBomXyR0RcIvKuiCxOtCzACFQIIlIO4DQAtYmWxY87VHWOqs4DsBjAdxMsj8PzAGar6hwAHwC4OcHyOKwBcCGApYkUQkRcAH4P4CwAhwC4VEQOSaRMXh4AcGaihQiAG8BXVfVgAEcDuCYJ3q9uACer6lwA8wCcKSJHJ1akfnwFwLpEC+Ew4hQCgF8B+AaApImWq2qL39U8JIlsqvqcqrq9V98AMCWR8jio6jpVfT/RcgA4EsBGVd2sqj0A/gbg/ATLBFVdCqAh0XIMRFV3quo73v9bwYVucoJlUlVt817N8F6S4vcnIlMAfBjAvYmWxWFEKQQROQ/AdlVdmWhZBiIit4nIVgCXIXksBH8+A+DpRAuRZEwGsNXv+jYkeIFLFUSkEsB8AG8mWBTHLbMCwB4Az6tqwmXy8mtw8+pJsBz7SLl5CCLyAoAJAW66BcC3AJweX4lIMLlU9XFVvQXALSJyM4BrAXwvGeTynnMLaO4/FA+ZwpUrCZAAx5Jid5nMiEg+gH8BuH6AdZwQVLUPwDxvjOwxEZmtqgmNv4jIOQD2qOrbInJiImXxJ+UUgqqeGui4iBwGYBqAlSIC0P3xjogcqaq7EiVXAP4K4EnESSGEkktEPgngHACnaByLUiJ4vxLJNgDlftenANiRIFlSAhHJAJXBQ6r6aKLl8UdVm0TkJTD+kuiA/LEAzhORswFkAygQkb+o6uWJFGrEuIxUdbWqlqpqpapWgj/mw+OhDEIhIjP9rp4HYH2iZPFHRM4E8E0A56lqR6LlSULeAjBTRKaJSCaASwD8J8EyJS3CndgfAaxT1V8mWh4AEJESJ3tORHIAnIok+P2p6s2qOsW7Vl0C4MVEKwNgBCmEJOd2EVkjIqtAl1bC0/G8/A7AGADPe1Ni/5BogQBARC4QkW0AjgHwpIg8mwg5vAH3awE8CwZI/6GqaxMhiz8i8jCAZQBmicg2Ebkq0TJ5ORbAFQBO9n6fVnh3wIlkIoAl3t/eW2AMISlSPJMRa11hGIZhADALwTAMw/BiCsEwDMMAYArBMAzD8GIKwTAMwwBgCsEwDMPwYgrBMAzDAGAKwRghiEiliHR6e9Y4xwa1rhaRHG9+fM9w26N7H+tlb1dUiMiXva2fI2oBIiKFIvKl4cgSxnMMapktIpkislREUq5jgREbTCEYI4lN3hbjQ7auVtVO7znRaEHxGQCPenvlAMCXAJytqpdF+DiF3vtGhJBwf8MPYEDLbG8H1/8CuDjS5zZGJqYQjJTBO3zlNO//PxKRO4OcHo/W1ZcBcBoE/gHAdAD/EZEbRORy72CWFSJyj58V8W8Reds7rOVq7+PcDmCG99w7vNaO/07+ayLyfe//lV4r5C4A7wAoH+q5/AnSMvvf3tdhGKYQjJTie2DH2MvA1so3BDk3pq2rvb2NpqtqNQCo6hdAq+MkAM+Au+5jvdZIH3yL7mdU9QgAVQC+LCJFAG6C17pR1a+H8fSzADyoqvMB5AZ5rnBYA2BBBOcbIxjzHRopg6ou9TZQuxHAiY6rRkRuBZuq+RPr1tXFAJqGuO0UAEcAeMvbeTcH7MUPUAlc4P2/HMBMAJE2YKxR1TfCeK6QqGqfN54yxjvUxhjFmEIwUgZvi/OJAPY6i5eITEDg73HEratF5BoAn/NePRvABf7XVdX//p1g2+KADwXgT6rabySpt+/9qQCOUdUObyvmQI/hRn/rfeA57aGeK0KyAHQN4/7GCMFcRkZKICITwQE+5wNoF5EzvDfNB7AiwF0ibl2tqr/3um3mqeqOgdcHnNsIwCUigRb0/wK4SERKvbKPF5GpAMYCaPQqg4PAucMA0Ap2nXXYDaBURIpEJAucVzEUQz1XWHhdVnWq2hvufYyRiykEI+kRkVwAj4ID3NcBuBXA9703z0MAhRCn1tXPATguwHO/B+DbAJ7ztl1+HrRsngGQ7j12KzjHGqpaD+A1b4v0O7yL8w/B8ZOLEaR/f5Dn6keQltknAXhqf168MfKw9tdGSiMifwTdOhUAFqvq7DDvVw2gSlX3DuO55wO4UVWv2N/HSDQi8iiAm1X1/UTLYiQesxCMlEZVr1JVD5hdM9a/MC0QTmEagAwMc7i5qr4LDl8ZlOaZCnhdaf82ZWA4mIVgGIZhADALwTAMw/BiCsEwDMMAYArBMAzD8GIKwTAMwwBgCsEwDMPwYgrBMAzDAGAKwTAMw/BiCsEwDMMAAPw/yjotrlRUg/EAAAAASUVORK5CYII=",
            "text/plain": [
              "<Figure size 432x288 with 1 Axes>"
            ]
          },
          "metadata": {
            "needs_background": "light"
          },
          "output_type": "display_data"
        }
      ],
      "source": [
        "plot_dataset(train_x, train_labels)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "SjPlpf2-wHl8"
      },
      "source": [
        "## Training One-Layer Perceptron\n",
        "\n",
        "Let's use PyTorch gradient computing machinery to train one-layer perceptron.\n",
        "\n",
        "Our neural network will have 2 inputs and 1 output. The weight matrix $W$ will have size $2\\times1$, and bias vector $b$ -- $1$.\n",
        "\n",
        "To make our code more structured, let's group all parameters into a single class:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "J1KaixW-cMWJ"
      },
      "outputs": [],
      "source": [
        "class Network():\n",
        "  def __init__(self):\n",
        "     self.W = torch.randn(size=(2,1),requires_grad=True)\n",
        "     self.b = torch.zeros(size=(1,),requires_grad=True)\n",
        "\n",
        "  def forward(self,x):\n",
        "    return torch.matmul(x,self.W)+self.b\n",
        "\n",
        "  def zero_grad(self):\n",
        "    self.W.data.zero_()\n",
        "    self.b.data.zero_()\n",
        "\n",
        "  def update(self,lr=0.1):\n",
        "    self.W.data.sub_(lr*self.W.grad)\n",
        "    self.b.data.sub_(lr*self.b)\n",
        "\n",
        "net = Network()"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "rQ7W6TOacIAI"
      },
      "source": [
        "> Note that we use `W.data.zero_()` instead of `W.zero_()`. We need to do this, because we cannot directly modify a tensor that is being tracked using *Autograd* mechanism.\n",
        "\n",
        "Core model will be the same as in previous example, but loss function will be a logistic loss. To apply logistic loss, we need to get the value of **probability** as the output of our network, i.e. we need to bring the output $z$ to the range [0,1] using `sigmoid` activation function: $p=\\sigma(z)$.\n",
        "\n",
        "If we get the probability $p_i$ for the i-th input value corresponding to the actual class $y_i\\in\\{0,1\\}$, we compute the loss as $\\mathcal{L_i}=-(y_i\\log p_i + (1-y_i)log(1-p_i))$. \n",
        "\n",
        "In PyTorch, both those steps (applying sigmoid and then logistic loss) can be done using one call to `binary_cross_entropy_with_logits` function. Since we are training our network in minibatches, we need to average out the loss across all elements of a minibatch - and that is also done automatically by `binary_cross_entropy_with_logits` function: \n",
        "\n",
        "> The call to `binary_crossentropy_with_logits` is equivalent to a call to `sigmoid`, followed by a call to `binary_crossentropy`"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "kdDxWeCqwHl8",
        "trusted": true
      },
      "outputs": [],
      "source": [
        "def train_on_batch(net, x, y):\n",
        "  z = net.forward(x).flatten()\n",
        "  loss = torch.nn.functional.binary_cross_entropy_with_logits(input=z,target=y)\n",
        "  net.zero_grad()\n",
        "  loss.backward()\n",
        "  net.update()\n",
        "  return loss"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "zAAgw0h6KzUd"
      },
      "source": [
        "To loop through our data, we will use built-in PyTorch mechanism for managing datasets. It is based on two concepts:\n",
        "* **Dataset** is the main source of data, it can be either **Iterable** or **Map-style**\n",
        "* **Dataloader** is responsible for loading the data from a dataset and splitting it into minibatches.\n",
        "\n",
        "In our case, we will define a dataset based on a tensor, and split it into minibatches of 16 elements. Each minibatch contains two tensors, input data (size=16x2) and labels (a vector of length 16 of integer type - class number)."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "PfyqjVb2wHl8",
        "outputId": "f9f5af23-005e-42e0-928b-9890b6c4e0cf",
        "trusted": true
      },
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "[tensor([[ 1.5442,  2.5290],\n",
              "         [-1.6284,  0.0772],\n",
              "         [-1.7141,  2.4770],\n",
              "         [-1.4951,  0.7320],\n",
              "         [-1.6899,  0.9243],\n",
              "         [-0.9474, -0.7681],\n",
              "         [ 3.8597, -2.2951],\n",
              "         [-1.3944,  1.4300],\n",
              "         [ 4.3627,  3.1333],\n",
              "         [-1.0973, -1.7011],\n",
              "         [-2.5532, -0.0777],\n",
              "         [-1.2661, -0.3167],\n",
              "         [ 0.3921,  1.8406],\n",
              "         [ 2.2091, -1.6045],\n",
              "         [ 1.8383, -1.4861],\n",
              "         [ 0.7173, -0.9718]]),\n",
              " tensor([1., 0., 0., 0., 0., 0., 1., 0., 1., 0., 0., 0., 1., 1., 1., 1.])]"
            ]
          },
          "metadata": {},
          "execution_count": 14
        }
      ],
      "source": [
        "# Create a tf.data.Dataset object for easy batched iteration\n",
        "dataset = torch.utils.data.TensorDataset(torch.tensor(train_x),torch.tensor(train_labels,dtype=torch.float32))\n",
        "dataloader = torch.utils.data.DataLoader(dataset,batch_size=16)\n",
        "\n",
        "list(dataloader)[0]"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "xrwgkbQjhkEp"
      },
      "source": [
        "Now we can loop through the whole dataset to train our network for 15 epochs:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "QGchp9D6gVJa",
        "outputId": "b4c4751d-cb56-4104-d5b5-f1ae9d3d858d"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Epoch 0: last batch loss = 0.6491\n",
            "Epoch 1: last batch loss = 0.6064\n",
            "Epoch 2: last batch loss = 0.5822\n",
            "Epoch 3: last batch loss = 0.5679\n",
            "Epoch 4: last batch loss = 0.5592\n",
            "Epoch 5: last batch loss = 0.5537\n",
            "Epoch 6: last batch loss = 0.5501\n",
            "Epoch 7: last batch loss = 0.5478\n",
            "Epoch 8: last batch loss = 0.5463\n",
            "Epoch 9: last batch loss = 0.5454\n",
            "Epoch 10: last batch loss = 0.5447\n",
            "Epoch 11: last batch loss = 0.5443\n",
            "Epoch 12: last batch loss = 0.5441\n",
            "Epoch 13: last batch loss = 0.5439\n",
            "Epoch 14: last batch loss = 0.5438\n"
          ]
        }
      ],
      "source": [
        "for epoch in range(15):\n",
        "  for (x, y) in dataloader:\n",
        "    loss = train_on_batch(net,x,y)\n",
        "  print('Epoch %d: last batch loss = %.4f' % (epoch, float(loss)))"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "nnyEjYAWToPd"
      },
      "source": [
        "Obtained parameters:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "5QaDiCQUkFOT",
        "outputId": "45b4a66b-1222-40f4-c758-d58f1c7daf8c"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "tensor([[ 0.1330],\n",
            "        [-0.2810]], requires_grad=True) tensor([0.], requires_grad=True)\n"
          ]
        }
      ],
      "source": [
        "print(net.W,net.b)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "s4_Atvn5K4K9"
      },
      "source": [
        "To make sure our training worked, let's plot the line that separates two classes. Separation line is defined by the equation $W\\times x + b = 0.5$"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 283
        },
        "id": "PgRTHttLwHl9",
        "outputId": "d9abf92f-cb70-4c56-ccd0-5e027239da58",
        "trusted": true
      },
      "outputs": [
        {
          "name": "stderr",
          "output_type": "stream",
          "text": [
            "C:\\Users\\dmitryso\\AppData\\Local\\Temp/ipykernel_89704/2721537645.py:17: UserWarning: Matplotlib is currently using module://matplotlib_inline.backend_inline, which is a non-GUI backend, so cannot show the figure.\n",
            "  fig.show()\n"
          ]
        },
        {
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYQAAAEKCAYAAAASByJ7AAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjQuMiwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8rg+JYAAAACXBIWXMAAAsTAAALEwEAmpwYAABbH0lEQVR4nO2dd3jUVfaH3zvpPSEJJbTQERAIBFGwIYJYsCL2QnbXLe6u61Zdt7tVV1fX1d+uqwMiit21gIgFRFGUktBBioReQkivM3N/f5wZ0yaTSTItk/s+Tx7I5JuZkyn33HvK5yitNQaDwWAwWIJtgMFgMBhCA+MQDAaDwQAYh2AwGAwGJ8YhGAwGgwEwDsFgMBgMToxDMBgMBgMAkcE2oDNkZGTo7OzsYJthMBgMXYr169cXaa0zm9/epR1CdnY269atC7YZBoPB0KVQShW6u92EjAwGg8EAdPETgsFgMHQrampg716orYWUFMjOBovv9vXGIRgMBkOoU18Pb70F774r/wfQGnr2hGuvhdxcnzyMCRkZDAZDKGOzweOPwxtvQHo6DBggXwMHinN49FFYscInD2UcgsFgMIQyn34KGzZIeCg6uunPkpOhXz9YtAiKijr9UMYhGAwGQ6iiNSxdChkZoJT7a2Ji5LpPP+30wxmHYDAYDKFKaSkcOyYnAU+kpkJBQacfzjgEg8FgCFW0bv1k0BiLBez2Tj9cyDgEpVSsUuoLpdRGpdRWpdTvg22TwWAwBJWkJEhIgOpqz9eVlMCQIZ1+uJBxCEAtcIHWehwwHpillDozuCYZDAZDEImMhIsukrBRazgcUol03nmdfriQcQhaqHB+G+X8MvM9DQZD9+b886F3bzh8WEJIjbHZYN8+mDZNSlE7Scg4BAClVIRSqgA4Dryntf7czTV3KKXWKaXWnThxIuA2GgwGQ0BJTIRf/AIGD4bCQti/Hw4dEkdw+DBceincdJN3uYY2ULq5xwkBlFKpwOvAD7TWW1q7Ljc3VxtxO4PB0C3QGg4ehE2boKpKSlEnTBAJi3ailFqvtW7R3hyS0hVa6xKl1EpgFtCqQzAYDIZug1LQv798+YmQCRkppTKdJwOUUnHAhcCOoBplMBgM3YhQOiH0AZ5RSkUgjuolrfXbQbbJYDAYug0h4xC01puAnGDbYTAYDN2VkAkZGQwGgyG4GIdgMBgMBsA4BIPB0BVxOHyi3WNoSsjkEAwGQxBwOGD7dnjvPdi9W0TSTj8dLrhAGqF80OzkMxwO2LIFli0Tm7WWITEXXyz1+M1nBRjajXEIhlY5fly+LBaZwdGWAq+hi1FXB//9L3z+uXTDpqbKIrtuHXzyiXTAXnttaDgFux3mz4dVq+SN6JJpKC2FJ56A0aPhhz+EuLjg2tnFMQ7B0IKDB+Gll2Dz5qbzu6dOhWuu6VBjpCEUeeEF+OILGDSo6aLfp48swG+9BT16wIUXBs9GF0uXijNoPlQ+NVXekDt2wMKF8O1vB8vCsMDkEAxN2LcP7r8fdu1qaIrs31/WiNWr4S9/kU2ZoYtTUgIrV8pO290JICICsrJkjq9rqHuwqK0Vh9C3b1Nn4MLVwbtmDRh9s05hHILhaxwO+L//k4l8vXo1/exFRspnrqhITg+GLs7GjfKCR0S0fk1cHFRUSG7B19TWwpdfwtatciT1pKm2a5dcHxPT+jUWi9zH5s2+t7UbYUJGhq/58kuRXc/Obv2aPn3gs89g7lwTOurSlJZ6dgYulBKn4Cvq6mS3v3w51NTI/dvt8qa79lrJBTSnpsa7+46IgPJy39naDTEnBMPXfPll22uE6+eFhf63x+BHkpK8L9v0VaK2vh4efxxef112EwMGyLFz4EA4dQoeeADWrm35ewkJ3t2/3Q5pab6xtZtiTgiGr7HZvCsoUUqiDYYuzJgxDS+ku7g8SJgmOhqGDfPNY378MWzY0LKcVSlZyGNj4cknYcQIeTNWVoozGjKkYYxka87Jbm8omTV0GOMQDF/Tr598Dj2htXz2MjMDY5PBT2RmwuTJUnLqLrHscMgQljlzPMfuvcXhkFBRr16t7zri4iRJ9eMfy5ssIkL+HTxYQkmffCIVUc2PsVrL0Jjp080JoZMYh2D4mrFjZZNWUyP/uuPkSdkwZmUF1jaDH7jtNqk22rZNyktdSaGTJ6GsDM45R3oRfMHJk1Bc7HnM4/79Uj6algYzZojj0FqcxJdfyo5l/355c6any89PnZIcxxlnwPXX+8bWboxxCIaviY2VSXxPPikVfs2dQmmpOIsbbwyNXiVDJ4mLk934hg2wZIkkhpSCkSNh1iwJv7QWTmovDofnN015OeTnS2goLq7hWlc4KTERDhwQJ7Znj1QTORyyO5kxA047zbskucEjxiEYmnD22bIpe+45KQiJipLvbTbpAfr5z+XUbggToqPhzDPly26XBdhXTqAxqalSu1xX515iwlWl4HC4D/tERYmj2L3bNJ/5EeMQDE1QCs49FyZNkg1bYaFsvEaOhFGj5DNtCFP8ucOOiYFp06Tc1F3Y6OBBWfCrqloPK/XsKTmPO+4wR1Q/YT7eBrfExcGUKfJlMPiEiy6SBf3YMVncGy/q9fVyehg2rHXRLIulQeXU7Ez8gnlWDQaDZw4fFk0TV3nZsGEdO02kpcE994gYnevo6QojaS2JqzFjWv/9qipJJhtn4DfMM2swGNxz4gQsWCDyEo1JT5fk7tix7b/PXr3gd7+TXMDmzbLI9+4t1QzPPus5f3HiBNxyS/sf0+A1xiEYDIaWnDwJf/qTNIMNHNg0vFNeDg89JHLTEye2/76VklNG44a3ujppXDt4UMpLm3P0aEPvhMFvGOkKg8HQkldflU7hPn1aJnCTkiQH8PTT0s3sC6KjpQR20CAJTx05Ij0GR4/K9xkZUuKWmOibxzO4JWROCEqp/sBCoDfgAJ7UWj8aXKsMIHm83btlA3fihHwmp0yRMvWoqGBbZ/A5JSUiJd23b+vXJCRIw9jGjdIU5gtSUuDee+XNtnq1nFJSUuTNNnKk6TMIACHjEAAb8BOt9QalVBKwXin1ntZ6W7AN686Ul4se2Y4dUjkYHy/9QevWyabt7rs9rxuGLsiRI3IqaGsBjo4WaWpfOQSQHMLw4fJlCDghEzLSWh/RWm9w/r8c2A6YpSaI2Gzwz3/KZ37gQIkepKRIKDc7W7qW//pXOdkbDIauTyidEL5GKZUN5ACfB9mUbs22bSIhk53tvg8oI0OkZVauhKuuCrR1IUxJCXz6KXz0kejsuMZQ5uZ6L+UcTPr0aVAx9HRKqK31nRKqISQImROCC6VUIvAq8COtdZmbn9+hlFqnlFp3wozL8yvvvy/5Ak9Nob16wXvveS+tH/bs3Cm19i+/LE9KaqokZ+fPh1//Wmr6Q53UVAkDHTnS+jVVVdK9OG5cwMwy+J+QcghKqSjEGTyntX7N3TVa6ye11rla69xMo8Hsc44fhzffhH/9C959Vza4nhb7mBgJHVVXB87GkOX4cSnHjI+XGFtiomTdk5PlmFVbKz+vqgq2pW0zZ47Yf+RIy/GW5eXSbfyNb/hGGtsQMoRMyEgppYCnge1a64eDbU93w2aTWcnvvScngvh4KSI5eFASypMnS+SjOQ6HfJlqI+DDD8V7tia9kJkpHbobNoiKYCiTkQG//CVYrfIGcElRg7wR7r4bxo8PqokG3xMyDgGYCtwCbFZKFThv+6XWemnwTOo+vPiinAgGDmwIG48cKU2qSkkV4HnntVzrTp6U8tNuv1F0OGDFComheSI1VWJxoe4QQHoN7rlHBuU0lq4YPtyUgIYpIeMQtNafAEbCMAgcPy4ng8bOAKRhdMeOBjWBnTtFBdWFzSbRg1mzAmtvSFJX17q0c2NiY7teWVbfvqa2uJsQUjkEQ3D49FNxBM03fXFxUhjjyg8cOiT5Aq1lTSsslOqiUaMCb3PIERUlT2BbM0jr6qTTtw20Fkd94IAMLzMYAkHInBAMwePgQckZuKNPH5mPsGuXNJDu3SuVk4MGwe23Sxg57KTpKyth7Vr44gtJBPfrJ+Mkhwxp/Y+NiJAw0OrVnnfTxcVw882t/lhraRJ+6y1RbXCF7idMgNmz5RRnMPgL4xAMREd7riRKS5MqxPR00TMbMkRuCztHANJ88dhjcixKSZGF/sAB6SmYMEGGs7Q2cHr6dFi1Sn43Lq7lz0tLxfM2jrs1QmtYtEhmyGRmQv/+8hw7HLBliwwsuvtuzwrRBkNnMCEjAxMmtF0JWVUlxSU5OfJvWDqD/fvh4Ydl0c7OFq+XnAxZWbI137AB/vvflmWYLvr3h+98RwSfDh2SoS8gp4z9+8VR/PjHrVYhrVsnzmDQILnE9RxbLKIQnZYmMiIVFb7/0w0GMCcEAyJrn5wsG9iUlJY/11rCFzfeGOazSd5+W/5AdzF+pcQprF8vi3trsZszzhAH8uGHogZYXy8OZvZsib2lp7v9Na1lzn2PHq2PBEhMlKqutWtlGqXB4GvC+eNt8JLoaAkFPfCAnAR69WpYlKqqxBnk5EhEJGwpK5MtujstfhdKicP45BPPwfx+/eDWW2WYi80mv9PGkaqsTJL0rY0TdpGcLFMojUMw+APjEAwADB0Kv/kNvPGGbIJdycykJDkZTJ/edvPZ0aMNagf9+kkcvMtQViZ/tKeJXSAZdU+SDo1RyuuOvfp6eei2QnGRkb4bQWAwNMc4BMPX9OsHd94p2mynTsni06dP22GiQ4fgueckH2uxNITYx44VZ9JWr1ZIEBUl2VutPa/KNpv7hHEnSUqS/HV9vWcfUlEBp53m84c3GACTVDa4ITVVEpv9+7ftDA4cgPvvh6++kijKgAHyb//+0tT2xz/KySHk6dlTMrfl5Z6vq6z0yxjHmBjpBD92rPVrtJbTwXnn+fzhDQbAOARDJ9AannpKdra9ejXdWFsscrqor4dnngmejV6jFFx2mXSDORzurzl1Skp9OjJc3gtmzhTHUFzc8mdaS45h3Dgp+zUY/IFxCIYOs2+fLFIZGa1f06sXbN/eNVSfOessmDFDjjslJQ2xr/p66d6rq4O77mpbnqKDZGbCL34hp7J9+6R69dQpCckVFkp58He+03aaw2DoKCaHYOgwhYXyr6eQu1LytX+/VGOGNBaLVAaNHCk1oPv3y20Wi5SMzpoloSU/MmCATKHbvFmqiaqqJJJ19tkSigvL/g9DyGAcgqHDtBZZAdlcOxwNu9nWerlCDotFcgRnnCGnBJtNMr6tdSf7gehomDhRvgyGQGIcgqEFx45J89OxY9IMlZMjZamu3anr3969W/7uqVOid3TokDiE6GhZT1vTSgpZlJJ8gcHQjTAOwfA1dXWwcKH0XVkssimurYXFi0V1ISNDFvjsbLj4Ysmt9ughJfzJyRJ637hRksyJiXIf5eUyaMdqhZ//3KgoGwyhjElPGQAJ6fz3v6K2MGCAfGVmSsXLV19JTnXPHkkSFxfLiM1HH4UbbpDv9++HggI5DSQliTOoqZFTwrnninjeww+bpiqDIZRpt0NQSiUopcy4pDBj925Re87Oboj779kjX6mp4hxqaiSRnJYmfQo7dkhX849/LPLYtbXSOFVaKuF3pWDqVJHvycgQx7FxYxD/SIPB4JE2Q0ZKKQtwPXATMAmoBWKUUieApcCTWutdfrXS4HdWrpQQkSs/YLfDl182Vd1MTBTHMWyYOI3+/aUS5qKLpDZ+1KgGBYjUVHECjUskExPlBHLGGYH+6/xIW53NBkMXwpscwgrgfeBeYIvW2gGglOoBTAP+qpR6XWu9yH9mGvzNvn1NVZmLixuEOl1ERkqjbl2dOA/XYr9hg+QN+vSRr9aIjvbR9K+aGhkOsHu3LMbDh0vHVqAGOxcWyvzkNWvkWNS7t3jFM87ogtlzg6EBbxzChVrr+uY3aq2LgVeBV5VS3il4GUKWqChZZ124mwSptXw13vU3Fluz2z3PXq+p8cHErzVrYMECubPYWDHogw9EX+iOO2SEmz/58EPJvEdFSU9CZKTEyRYsgGXL4Gc/a1Xi2mAIddrMIWit65VSI5VS05VSiY1/ppSa5brGXwYaAkNubtPZ71FRLXsHamokFNRYfM1mk0Rzbq6oPniisrKTOjzr1sETT8jQhuxs2Zn36SNeJiEBHnlERov5i61bZeHPypJyqagoOaEkJYk9JSVig6fxcwZDCNOmQ1BK/RB4A/gBsEUpdUWjH//ZX4YZAstZZ8na5jol9OghIR7X0C+tpfR02LCGkLmrMW3cOClDra9vffLakSOScxg9uoMG2mzw7LPifdypjSYkiNHPPuu5Y64zvPmmOKPG0hVVVbBzp4w6W79ehiE/95w8WQZDF8ObKqNvARO11lcC5wO/Vkrd5fyZT7NpSimrUuq4UsqP2zyDO9LTIS9PNIdOnZI1NSNDqoy2bWvYeFdUSNPa6tUSRh8+XH43Oxu+/3353f37ZZ2sq5NN8759cs2PftSJiWs7dkgCIiGh9WuSk+WYsmdPBx/EA8XFkmXv0aPhtmPHJFy1Y4d8Hxsrp4N//1uGS7R1ZDIYQgxvPp4RWusKAK31PqXU+cArSqmB+NghAAuAfwELfXy/Bi+YOlU2wIsXw9Klsv5GRMjmPDFRdvn798s1cXGQmmxj2ydl/OPucr5zWw0Txg7hL3+J5JNPpLmtrEzC7NdfL6H9Tqk/HD/uvf7FiRNylPElVVXyZLiOR2Vlks+Ii2t6YkhIkMRyRQU89BD84Q+BS3Yb3FNXJzuaXbvkPTR4cGCLELoQ3jiEo0qp8VrrAgCtdYVS6jLACpzuS2O01quUUtm+vE9D+xg9WvoMRoyQzXBEhMT+339f1sLYWKirdTCl11cMs21HHbSx+ct0Hv/kMD+Z8n9kzLmaK684hyuv9PFeoT1HC0+Z7Y6SkCC7f1eZ6d698m9z5VObTRxCr14NrdthVWfbxdi0STouy8sbXqtly+Q1mjcPJk0Krn0hhjcho1uBJiNOtNY2rfWtwLl+scoDSqk7lFLrlFLrTpw4EeiHD3v275fN1PDh0ozmkqbo0UP6DE4b4eDcmC9I3rcJlRCHSktlQJadLbYR7KzsJx++JUt8b9igQfKvp1OCK3fgutaXpKWJCurJk+IY9u+XY1NzbDZJloAcpVas8L0tBu/Ytg3+8Q85CWRnSzFAVpb8PzERHntM8j6Gr/Gmyuig1trtzCut9Wrfm9SmPU9qrXO11rmZXWpob9dg7dqmkRG7XTa6rrUvqewgaTWHKVWp1NlkJ64UxEfWs+LoSNG8eOUV3w9A6NdPwkCe4vJHj4rAkr8kqi+/XLxjZWXL+luQXWhqakPZaWys+2k3Bv/jcEiBQUqKe8cdHy/vk4UL3ddYd1OMlpGhCcXFTWP99fWN+gu0Jv3kLuqj4kEp7Ha+/kqIquNgWbKUYkZEwKpVvjVMKfjmN+X+Dx1qWtpps8ksz6QkuPVW3z5uY047TTLvRUWSU6ivl4Wnpkay5/HxIp3tchR1dWKTIfDs3SsbhNTU1q9JTBSdFVdRgMGonRqakpbWVIDOYmloSItw1BNdV05NTAr11ZJkdpWl1mBhQM866uogukcPmfBy/fW+Na5XL/j1r+G110Qzw2UcwJQpcPXV/pesPv980QL/9a9F/CkmRhaWUaOkJ6Jxk0ZJCcyZ4197DO5pTzj52DEYM8Z/tnQhvHYISimF6BkN1lr/QSk1AOittf7CV8YopRYjpa0ZSqmDwG+11k/76v4NbTNpkqQAXLnT6GiJgJSXQ1IMgKKsTH0tXxETI9cVV8WSVrmLjz6Csyco4iL91AuQmQnf/jZcd53sAEHiwo11N/xNv35SVvr730tznLvyqeJiCVdMmBA4uwwNeDtnVGv/FCF0UdoTMnoCOAu4wfl9OfC4L43RWt+gte6jtY7SWvczziDwDBwokZFDhxpuGzZMTg31RFFhi8VWVUdSUkOjbo09iugIO5P6HKKmBrZ/VoL2ddlnc1JTJck7cmRgnYGLQYPgW9+S3eWhQw1x6JoaSTg7HCIDa7SNgkN2dsPYvtZwnS79UYTQRWmPQ5istb4TqAHQWp8C/DNt3BA0lILvflc2wV99JSHWnj2ldPvwEUV+7UjSoiuJiQGHVhTXJVBaH8+VWWtJjKwlKcFBVUkt+wdPC/af4n+mTpVTwtSpclopLJSE85VXwv33+0C4ydBhevWSXoNjx1q/5vhxkekdMCBwdoU47ckh1DvnIGgApVQm4Ke4gCGYJCfDPfdIRd6yZZKvTU+HCy6A1SuzOFF2kuiKCuqiEhmaeJQp6V/SJ64Ei8NGSul+1mVdwNET2XSL5XDAALj9drjtNjklREYaOexQ4ZZb4E9/khNc794NoSGHQxx4dLSc8szr9TXtcQj/BF4Heiql/gTMAX7lF6sMQSc2Vja+U6c2nKx37ACbLYreSSMYuelFsovWkRRRha6LwFJrx2GJZMfwy1nf4yrOqOwmH7KqqobpQMnJknDusD6HwadkZMCvfiVl0J9/3lSEa+JEuPZaOUkYvsard64zobwKWA9MRyQrrtRab/ejbYYQwfU5SkoS5xCVmsDe8/I4VnEpmSe2ElVXRU1cGsd6jaUuJoma/fJZDGvq6uD116WF22aTJ0lrcQrXXAPnnGN2nqFAenpDEYIrMdanT1NNKsPXeOUQtNZaKfU/rfVEwBTtdlP69pXcQmmp5HQrE3tRmdh0h+VwyFdYKwLU18tQ6U2bGmSwXVRVSbd2WRlcdlnwbDQ0JTXVc0+CAWhfUnmNUiqcP+aGNlBKyuqLi5v2KrjQWgpspk4N85P4mjVQUCBJ48bOAKSqaMAAePVVadQwGLoQ7Ql2TgO+rZQqBCqRsJHWWo/1i2WGkGTcOGnWXejUo+3RQ6T/v/xSGnhdLQHHjoWpU9BapGAzMloPCUVFSR38xx/D3Llt36fdLgmaFSsk2RkXJ412kya5l10wGPyE0l5KCjvlrlugtS70qUXtIDc3V69bty5YD9+tOX5c1rvFi2UtS04WQby0NImWOBwSSr/00jALpZeXww9/KKcAT39YRYVk5v/4x7bv77HHZMhOQoJ81ddLl3NcnAyRGDHCl3+BwYBSar3WOrf57V6fEIK58BtCj549xQnExUnZfePCmpQUWdNeeEE2uOefHywr/YCrhbstL+dKMnvCbhdnsGePNFI1vs/UVPGsf/+79DpkZXXWcoOhTdojXfEbd7drrf/gO3MMoUBxsWiD2WxSpDFkSEslgNpakRTq1899lWVUlORbX3lFcgrNQ+1dlsRE8XiVlZ6nt5WUwNlne76vnTsl1jZwoHsHk5wsJ4h33xXtfoPBz7Qnh1DZ6P+xwGWAKTsNI8rKZBzwF051KtcmNzMTbrxRpp652LZNVBo8DZ2Ki5PQ0vbtokodFlgsMkD6uedalzyw2+WIdN55nu/ro4/kSfJ02ujVS+aVXn+9+1nS3nLkiGibnzghTm3iRPH0wY7nlZZKj8D27fJmGzkSzjzTVAQFifaEjB5q/L1S6u/Amz63yBAUysvhr3+VBbxfv6Z6X2VlMmfkzjsbhn+Vlno30VJruTasOOccWaQPHpRjUONF1WYTCYuZM9uWrjh2rG2to8hIeRIrKzvmEGpqYMECqYyyWJwj7+rgnXdEj+TOOxvmNwQSrWHlSli0SBJOruT5xo3w8stwww0wfXrwHVY3ozMtlfHAYF8ZYgguS5bIJtLdGpbsHHPw1FOiEhwfL13/Wosjsdnk5wkJ7j+/zadMdnni4uCnP4X58yE/v0Ex026XBfyqq+CKK9pezOLj2x6g4xJo68iT6HDAf/4jNjYPS2ktjVoPPCBS3oGuZvr0U3n++vZtesxMTxeH9cwzcvs55wTWrm5Oe3IIm3HqGAERQCZwvz+MMgSW6mr48ENp4GwNV/hn/XoJjdfUSCk+NIwlcAmQ9u4tt9vt8rOwLJJJSpJqo2PHYOtWaUjr0UNiY94urlOnipdt3jVbVydPsFLy7/DhHVN03bkTNmxombAG+b5PH9i3T8rFLr64/fffUWw2eOkleaO4izlGR0sS/aWXJHwUNgmo0Kc9J4TGbZc24JjW2syeCwOOHZPPaFub0Ph4yR2UlcGLL8pm7tQpybFqLWvXp5/Kmjh0qGxAp0wJ83Bwr14db7iYMEGcR0mJPEkVFaKLdOBAw1SiujopPXUJ57WHDz6QF83TSaVnT0laX3SR9zMEOsuOHfIm8hRSi4uTN2ZYJaBCn/a8A76ntS50fh3SWtuUUn/zm2WGgOGqpPSG48clxNu/v2zeUlLEKdhsEp5OSZGTw+bNsjG98UZ/Wt7FiYuDu++WI5qrMe3AAYm9RUXJCzN8uOzgn3iiYTydtxQWtn2yiI+Xxbm6uuN/R3s5dcq7BJTrWkPAaI9DmOHmtgCeMw3+omdPcQieZo27ksNHj8paFRUlJ4qpUyWvYLPJzysq5PpBg+DnPzfzYdpk8GCZvlZeLkcsV2ImOVmOV+PGyTXr1sF777XvviMjPQ+IgUbzUQM4Naw9ISCjHBtQ2ny2lVLfBb4HDFZKbWr0oyTgU38ZZggcCQmSu1u1Snb+jXE44PBhObmfONGQK6iqkhN/dLRMVBsypEHfSClZ09xNljS4obhYvPKECRIiiohoGb/r00cqg2bM8H5Bdc1D9dQvUVwsL6Cn+mFfM3SovEkcjtbDVA6HXOPvyXuGJnhzQngemI2UmM5u9DVRa32TH20zBJDZsyXcc+RIw2ne4ZAk8mefybpxxhkN0YytW8WBuCINFotEQOLi5Od1dcH7W7ocGzaIA4iIkCfQXTInLk5KTxvPNm2Ls8+WF9OdEiHIC1xSApdcEtjyzowMyM2VnUZrHD4MOTniKA0Bo02HoLUu1Vrv01rfAJQBvYCBwBil1Ln+NtDge7SWUPXmzRK6rqmRQpd775W4f2GhFJ98+qn8PC5O8gVDhjTMREhNFWewbl3LcHB5uVFaaBc1Nd6FRiyW9uURevaUSW4HD8rC3/iFqqyUGakXXihhqUBzyy1i3759TR1Wba28ATMy4NZbA29XN6c9ZaffBO4C+gEFwJnAZ8AFfrHM4Be2bpVqvsLChtN6VJREImbPltGZhw5JNdFjj8G55zZtVBs2TE4NMTFSIHPyZMN8BBenTkljrcFL+vaVbl1PaC11vGlp7bvv886T33n1VdEmd9UIp6SIHMb55wen+Ss5GX75S6lweu+9BkcXFSUnllmzZPdhCCjtydjcBUwC1mitpymlRgK/96UxSqlZwKNIn8NTWuu/+vL+uxrl5bKJc2kKtSWw2RZr18pcl9TUpn1KdXXw1lvyWHfdJQ6gqkokK5rPH8/Kgt27pTAlKUnu4+hRuU+t5aQ/aJCc9g1eMnmyLNh2e+vJ3RMnYPRo2TmfPClxvH375Ppx4+QJb62TeexYOP10eXFcyZ3+/QObSHZHYqJI4l52mWing/x9gcxnGJrQHodQo7WuUUqhlIrRWu9QSvms5UgpFQE8jlQzHQTWKqXe1Fpv89VjdBUqK6W085NPGnJrdrt8hm+4AUaNav99lpfLIK/evVuuG9HREiravFnUBGbOlJO7O+cTGSnFL198IXmFmhr599Ah2eSNGCFqCI0/01rLiWT3brmmd29Z28Kug7mjZGZK6Obdd+WFaJ5oraiQJ/qqq2Rs51tvye0JCfIG+fxzKef67ncl9rdrlzzRGRkNT7RSchIJRWJiQte2bkZ7HMJBpVQq8D/gPaXUKcBDVqjdnAHs1lrvBVBKvQBcAXQrh1BZKWoCBw7IbtwVWtZawsAPPCB9So2F5rxh7VpZI1rbRColC/XSpXDBBXKidzjc9yjExkpV0qlT0nMwfLg4icmTpUKy8fVHj8KTT4p6Ksha53DI+nXjjVK2auRqkJm/dru0jEdEyO7ZbhdnEB8PP/mJxPtee02Od41zDpmZcoKYN0+OdElJDaGh+HiJ35kZzwYvaI+43VXO//5OKbUCSAGW+dCWvsCBRt8fBCb78P67BEuXym46O7vp7UpJKDg6Gv79bxGba4/WWUFB2yHZ+HiJRhQVybrSu7eEhlJSWl6rlNw+dCj84Q/uZ5afOAF//rOEvJpL6VRXi8yOzRZm8xI6SmSkJFFnzBDhvH375MWeOFHKUevr4eGH5YVpnoCurha9oupq8dKnn97wZFdXy9Gwvl7E4gwGD3jdmKaEm5VSv9Faf4Qklsf70BZ325cW7YxKqTuUUuuUUutOnDjhw4cPPjU1ojbgqUInIUGuy89v3327dIXawlUe7pqffPKk+6pFh0Mc1/nnu3cGINGNqqqGxrfGxMVJruK55+RUZHDSp4888T/9qWglTZ0qT9b69fKku+tB2LVLFv6MDHEIru5AkN/t3x+ef168u8HggfZ0Kj8BnAXc4Py+HIn5+4qDQOO2qH64CUlprZ/UWudqrXMzMzN9+PDB5+hR2ch5oym0ZUv77nvIEMkjeKK+XpyGq5Bl4kSJQhw7JiGs8nJZvI8ckYKVc86RnIY7SktFcdmTYF5MjDymmYLqBYcPu39j1NfLaSIxsWGSW3MZiujohlyDweCB9jiEyVrrO4EaAK31KcCXacG1wDCl1CClVDRwPd1s3kJbKgMuXEnm9jBlivyOp987cgSmTWsaipo2Df72NykEcTWlTZokisnf/GbrTbPHj4udbRWyxMU15BcMHoiJcf/iVVa2lJ5wdxRMSJDpbAaDB9qTVK53VgJpAKVUJuDlEtY2TrG87wPvImWnVq31Vl/df1fAdeBpS9iyqkp2/O2hd28p7V6ypGVOUmuJ9ycni+ilO7uuukq+vMU1bU1r2cQqJY/ZPHTUHmG9bs2YMfD2256vccUF3SV9zBNt8IL2OIR/Aq8DPZVSfwLmAL/ypTFa66XAUl/eZ1ciKUl28p99JvF1d7jCOpM7kG6fO1eiB0uWNISjXaeGgQPhe99rPR/QXhITpRR182ZxcFrLfQ8bJs7JtTbV1soMBUMbDB8u8beiIskVuEhMlDeEzSa5g6FD3R/bqqo6Vq9s6FZ4I273rNb6FiAD+DkwHUkAX6m1NjOVfczll0tF0PHjsjNvvKmrrRUVghtvdL8JbAuLBa6+WopNNmyQnEVsrBSl+HK8blERPPSQrEE1NdJUp7WsV599JqWp48bJz+Pi2l9C2y2xWOD734e//EXeBL17y5ErMlJ2D1u3ild3511d0hi5uYG329ClULoNXXKl1DZE5vpN4HyaVQNprduYAeg/cnNz9bowzEgeOSKlpS55CdcGMDoarr1WephC9fTvcEgZ6tGjkpz++GMJcycnN4SRioulgS0xsWM9Fd2a48elMe3TTxue0IgIqS5KTJSKosY5hPJyiQd+5zty/DQYAKXUeq11ix2CNw7hh8B3kfnJjaUWFaC11kGbqxyuDgHkc753r0xBrK2VaMG4cR2bsx5Idu2CP/2poY+ipkbCRocONTix+nqplHrqKTMMq8OUl0tNsMUib47qaqnh/eKLptelp0sp2MSJwbEzhLE77JTXlZMamxpsUwJOhx1Cozv4P631d31uWScIZ4fQVXnhBemlaK5E4OqZcjXPlpXB737neYqioQMUF8OePXKk7NFDcgrB1iwKMfae2suCggUsKFjABYMuYMGVC4JtUsBpzSF4k0NQWmjVGbiu6ayRhq5Pebn7nKZrVoKLiorWZfoNrVBXJ6WjlZXyZA4f3nIKUY8evqsMCCOq6qt4bftrWPOtrNi3AoVi5pCZXDnyymCbFlJ4U2W0Qin1KvCG1nq/60Znr8DZwG3ACmCBXyw0dCkyMyVM5AmtJddg1I29xOGA5cvhzTflqOXKHURHw8UXS5OIGTXZAq01aw+vxZpvZfGWxZTVljE4bTD3T7uf28bdRv+U/m3fSTfDm3fRLCAPWKyUGgSUALFIr8By4B9a6wJ/GWjoWpxxBvzvf57L3ktKJMfQu3cADeuqaA2LF8OyZRKHazxBrK5OxO6OH5cuQW+0SboBxyuPs2jTIqz5Vrae2EpcZBzXjr6WvPF5nDPwHCzKPE+t0aZD0FrXILIVTyilopDy02qtdYmfbTN0QbKypEfi889bCtqBhIlOnZL1K1QrpUKK3bvldJCd3TIX4NIt/+QTedKDMfksRLA5bCzbvQxrvpW3vnwLm8PGmf3O5MnLnmTu6LmkxHagTrsb0q5zpta6HjjiJ1sMYcK8ebJ53bBBEsiJidKbcOSIOIHbbpPGW4MXfPCB5AlaSwxbLFLTu2xZt3QIO4t2Mr9gPs9sfIajFUfpmdCTH03+EfNy5jEq0zTitRcTeDT4nNhY+MEPJP/57LOywa2tlQbbnj1l7dq6Fb71rZYT2QzN2LJFSkc9kZ4uw68djm4RNiqvLeflbS9jzbey+sBqIlQElw6/lLzxeVwy7BKiIloR2DK0iXEIBr/gmgd/6JCooiYnN/xMaymh//Of4Ve/al2mw0BoahCdPAmbNkntcHKyNJO05bQ6idaa1QdWY8238tLWl6isr2RE+ggeuPABbhl3C70TTULKF3TIISilemutj/raGEP4YLPB00/LOtG8mkgpOS0cOya9VL/4RXBs7BIMHSrdfo2Tyc1xZen9fTqorYVFi2SAj8MhlU02mzzu1Klw880+n4d8uPwwCzcuxJpvZVfxLhKjE7lhzA3k5eRxZr8zUaHmLLs4HT0hLAUm+NIQQ3ixfbvMRPDUeNazp0Q6Dh9uGApUVCRKCxERcnKIjw+MvSHLzJkyDam5sJULrSVLf9NN/rXDZoPHH5eTwYABTZ2PwyEaJaWlMtSnkyWwdfY63v7ybaz5Vt7Z/Q4O7eDcgedy3zn3MWfUHBKiEzr5xxhao6OvnHHLBo8UFrYd6XDNczlyRBRXX35ZZC5c44AjI2Uew+WXi5x/t+S00+Css0QVcODApsllh0MmF51+OuTk+NeOzZtFdXHQoJYvrMUitm3cKNd10JbNxzYzv2A+z256lqKqIrKSsrhn6j3cPv52hqUP6/zfYGiTjjqE//rUCkPY0Z6T/KFDMl85IqKpNlt9vSSkd+yAn/+8mzoFi0VqdJOT4cMPG2YeuOacnn22nA5am1TkK5YtE4nd1l5YpRqqndrhEEpqSli8eTHWAivrDq8jyhLFFSOvIG98HjOHzCTCYmQ3AklHHcJrPrUixCkvF82w996T03lCgswSnjrV77k0v1JUJIttdTWkpkopqK/E8wYNkl2+JxwOWd+WLpXQUGpq059HRcnGs7BQmnRbG9cZ9kRFyaJ/2WVSdVRaKrW8Y8YETqZizx7Pw75B5G337GnzrhzawYqvVmAtsPLa9teosdVwes/TeeSiR7hp7E1kxGe0eR8G/2ByCG1w8CA8+KAUVKSnS9y7thbeeEMGzdx1V9ebO1JZKeWga9Y0vT06WsIzl1zS+fzkiBGyVpWWtj674dgxCY2fPOm5azkrC1asgCuu6OY5hZQU2YUEA5dchidcp5ZWKCwpZEHBAuYXzKewtJDU2FTyxueRl5PHhD4TWiSIbTZ5b7iGK7U1a9zQeUwOwQOVlfD3v8v7vHFyND5evsrL4ZFH4P77oVevoJnZLmpqZHhNYWHL3GBdHbz4ogjPXXdd56odIyLg29+Wecx2u2weXfentTiD6GiZoFZW5vm+oqJkcThwQByNIQicfrpUCnh6o588Kdc1osZWw+vbX8daYOWDvR+g0Vw4+EL+Mv0vXDnySuKiWh5Jq6ulH+/dd2WIEkjx0oUXwowZRgPLn5gcggfWrm2o6HNHUpLsgFesgOuvD6RlHWf1alFDGOxmioVLCeGdd2Qj2r+T2l/Dh8O998KCBU2TzFpLrvS22+D99707jSjlfsZ8WGGzyWoYFdVSxTTYzJgB69a13vzmcMgOasYMtNZsOLIBa76V57c8T0lNCQNTBvLb837LbeNvIzs1u9WHqaqSTdiePXJqdIVka2slbPjFF3DPPS3Diwbf0CGHoLV+wteGhCIffNB2iLZnT3EIc+c2/Zy4Btxs2CA77sxMmDQpuCcJh0PCXJ5siIgQx/DRR1JW3lmGDpUT1L59MkXNYhFH4wpH9+vXtgy2Sx01I1xDyydPwsqV4h1ra+UPHj1alExHjQqNxrSRI2WL/t57IrLX2GHV1MChQxRdcCbPlb6L9T/Xs+nYJmIiYrhm1DXkjc9j2qBpXonKvfACfPWV5KAaExMjm5VDh8BqhR//2Ld/nkEwncoecOXuPBEdLaGWurqGz8jJk/Cvf8kbOzJSNny1tfDqq7LzvuUWn/fveEVFhZx42pKLSE2VZLOvUEo+4M0/5CBjfhctkuevtRjxiROyPnrqzeqyHDgAf/sbtspatqoxvHvgNL46lUrkukpyXvuUabcdIvtbM1CWIDsFpWSHkJkJb78tCquAHQfLU4qwTirljYMvUr+/ntysXJ645AmuH3M9aXFpXj9EWZmcYD11rmdlSSvEkSMyKM7gW4xD8EByspzgPSWz6utlwXddU14ucfOyspZqn67+ndpa+O53Q1d2JpCjjhITYc4c6Vju37/lc11aKs/x3LmBsylg1NbCP/5BjSOaxw9dxqZjvUmKqaVHXA06LpI1FeNY9UAtV1bt44ofDQr+QcFikVPL9OnsLviA+V++zDOHl3Go+hjpNencOelO5uXMY2yvjs1F3bVLPiOeBry5cts7dxqH4A+8mZjmTV2bozNy2Eqpa4HfAacBZ2itQ2Iu5rRpsnv1lMQ6fhzOO69hcV+1Sm5zl3ewWOT2L76QkOzw4f6wunUSEyXsUl7u+W8qKZHoQKC46CL595VXJIweGysLQ12dJKN/8YswFcHbtAmKi3mm6Go2H+9FdmpJk0U/K6UKW2Qtrz5TTnqu5pxzgusRKusqeWXbK1gLrKwqXIVFWZg1dBaPjs9j9ojZREd0rgyovt676JjF0vYQJkPH8OaEcNj55emligA685HdAlwN/KcT9+FzXMNeTp2Shak5VVWyW7ngAvnebpfKCE8xeqWk1v/DDwPvECwWKSl9+mlxDu4+fDab/B3nnhs4u5SCWbMknLZ+vSSgo6IkTDR6dBgPA1u9mmOWPnx2sD8DUkrdvh6R8dH0KjrEGy8OZ8qU2ICPR9Zas+bgGqz5Vl7Y+gIVdRUM6zGMv0z/C7eMvYW+yX3bvhMvSUvz7nSqdRjnk4KMNx+17Vprj62HSqn8zhihtd7uvJ/O3I3PSUqS5NXf/w7790v4NDZWdjLHjslCduedDQnSqiqJ07eViE5OliRrMJgyRYbX7NghucHGi211tegKXXtt2z1I/iApSRr+ug2VleSfysaioNUUgVIkRtex/6SDwkL31WH+4GjFUZ7d+CzWAis7inaQEJXA3NFzycvJY2r/qX75rA4dKk6hoqL13F1treTfzDwN/+CNQzjLR9f4BKXUHcAdAAMCEEcYNAj++EdJdi1fLo4gLk40x847r2lDVUSE7F7aUix2OILXZBMdLc10L70klUQOh9yutXwI582TUJkhAPTsSXGZIsrioZ7W9QJFRVFR0Y77rquTkNSaNVIO2quXyFwMGdLqm7PeXs/SXUuxFlhZ8uUS7NrO1P5Tefryp7l21LUkxfi3ASAiQvpf/vUvOSE2L7yw2aRR9OabQ68qN1zwdoSmW5RS87TW8z1d0+ja9wF3/aj3aa3faOv3G9nzJPAkQG5ubkDSn2lpohpw2WWeZ5DExYkDOXnSfYjJRXGxdAQHi9hYuPVWuOoqGWJTWyunlhEj/C+JY2jEOeeQvHgJ9Q4P1QWVlZCVhY6I8l5WZP9+6Zg8dUo6KKOipLB/5UrZWn/3u02Eobad2Mb8/Pks3LSQ45XH6Z3Ym59O+Snzxs9jREZgOwEnT5aT6rPPymctOVn8V1mZbFquvVY2Ywb/0Nno7O+B+d5cqLUOYJrSf3iqDFJKYvT//KeoDLi71lVzHywFgsYkJcHEicG2ohszfDg5k5bzymvV6CTdsrS0rg4cDqr6DSc51n3ZbguKiuCBBxoUSF2kpsqKum0b/OtflP3gDl7cLgniNQfXEGmJZPbw2eTl5DFr6CwiLcFL3Jx/vkwDXbNGpJscjgbtsMzMoJnVLfCmymhTaz8CuohgQ+CYMEFCSStXSlmcS3tHaymhLC4W8Urzxu4+nDghlVtRUVJj/3XexmKh76/mMX7zZ2z+MoZ+qRWomGhZAaurISIC+6QzOVKVwu1zvUyuf/CB/K6bNnOtYFV/O9YTT/Lyw7+j2l7DqMxRPDTzIW4eezM9E0Kn0SMtTSpcL7442JZ0L7x5i/UCLgJONbtdAZ/6wgil1FXAY0AmsEQpVaC1vsgX9x1oLBa4/XbZnL39tmzYlJLP+IABkJcnEwcN4c/u3dKMuGNHw4yHpCRZ5C680LnAJyXxzecv4B+/KmL358X0qC0iOd6OHjSEorj+VNTEcNFFXuZ16uulbb5ZmdtByniGAuZTwB7LKZITork16gzy5j3EpKxJIVfMYQge3jiEt4FErXVB8x8opVb6wgit9evA6764r1AgIkI+8OefL+FcV4w+Kys0VAj8SVWV5FCUks7i7qpQuXGjhPETEmQj4Hrdq6rg+eclpP+d78h7JTE1kp8/1Jt163rzzjtQeFAcyOljJF7utXpFZeXXLd+12HiTnVgp4F12oxVM09n8Tp/P1VUDiLclQN8z/PkUGLog3iSVv+HhZzf61pzwIjIycGWCwaa4WHSSVq1qKIyJiZGms5kzfTdnoStQUQH/939SK998qE98vOQC1qyR/O5558ntMTESI586tWEGTrs3D1FRFEQWYWUrz7GZYlVNf53MrziX2/V4BuOsdLCVQrIp0zG0JFxbfgwB5Phx+MtfJEfSp09DpVJNDbz2mkxe/NnPus8sg7UfVVHzVQm9bXukVjI5WVrUe/QApb4+PS1ZAuec07L4oL3NZ8XVxTy/+Xms+Vby++YTrS1cxWnk6RymM4gImj1ASYlUPxgMzfAmqbxBa+1xGI431xjCE61l/GV1dUt5iVhnZUxhocxLvu224NgYULZsYf0fd5Bckgwpzhrlw4dFxK5XL1Hzi4oiKUnCicXFHeu6tTvsfPDVB1jzrby+43Xq7HXk9M7hsbH3cOMbe+nRf7h7z1JRIXG8yZO9fzCbTby9UlKtFKoiXIZO480J4TQPlUYgyeVWZmIZwp3CQomHN65wbE5Wloj6XXNN2+qxXZp9++Dhh6mLnENEShLEOmuMo6MbpgJt2CCaKM6Tgs3WvofYe2ovCwoWsKBgAQfKDpAWm8a3J36beePnkdMnRx6n/mV46y0ZJuCag+xwyFGurg7uvltOLW1RUSEaK8uXN0yqSUuDM88U7x8ZKS+uUZkLG7xxCCO9uCbcR5cYWmHHDllvPMW7IyNlPdqzR+rLw5a33oLoaLJ7VvHVV71IcTkEkCcoJUV0m0tLqU9IJSLCu0EvVfVVvLb9Naz5VlbsW4FCMXPITP4+8+9cPuJyYiMb5QOUku6tQYOkzO3AgQaJ0IkTpbvSk/d2UVIisr1Hjkg7fkaGOIi1a0XgKy1Nst0REdLRePPNnnWrDV0Cb5LKhY2/V0r9ARGzKwAKtNa7/GOaoStQW+t9zLu9u+EuRWkp5OdDv36cHXeA5XuG4tDNNIqUknDL/v0cTUtl2rTWJRi01qw9vBZrvpXFWxZTVlvG4LTB3D/tfm4bdxv9UzyMs1NKpjHl5krJV12dHM28ORW4ePppqZl2yfaWl8sxz+EQEayyMqlqGjNGjol//CPcd1/nx+wZgkq7k8pa698opXoBOcA1SqkhWutv+d40Q1egZ8+2R1u69J3aEv3r0pSVfb3g908u5ZwBhXxUOJDs1FIsqpHCSlQURcdsxPcVhdfmHK88zqJNi7DmW9l6YitxkXHMGTWHvJw8zh14rldTx75GqY4lKA4dkhbhxkmhjRvFGbhifklJMgFqxAjJjRQVwVNPwe9+F/611WGM1w5BKfUIcLcWjgHLnF+Gbsy4cVJV5GniWVmZhJlbm00dFkQ7O4y1RinFreM2EmWxs2LfIJTSxEXasDks1FbG0GsA/PCehrXa5rCxbPcyrPlW3vryLWwOG5P7TuY/l/2H60ZfR0psgFN027bJv66FvaxMFvyURnZERMjfW1zcMPy4sFDyKO40NoqK4NNPxdGAjOScOjW4M2UNLWjPCaECeFMpdb3WulIpNRP4rdY6BFR5DMEiPh6uvlomng0Y0FIcr7pa1oyf/jTMN449e4rXKy+H5GSiIhzcOn4Ts4bt4fODfTlSkUhcpI0JjnWM/NUcIvrCzqKdzC+YzzMbn+FoxVEy4zO5a/JdzBs/j9E9Rwfvb6mpaVpJVFYm/zZ/AZVqOB66frZ/f1OHoLUkpV98Ub53OZU9eyTncsUV8hXWb46ug9cOQWv9K6XUjcBKpVQtUAnc4zfLDF2Giy4S1YTXXpPPdUKCrAOVleIg7rwTTj892Fb6GaVg9mx4/HEJqzgX1J4Jlcwe8aVcU1xMeZTmGdZhtf6Q1QdWE6EiuHT4peSNz+OSYZcQFRECcrPp6U3jgK1NrdG6ZRLE1ZXo4pNPZOxg8/moKSmSVHr1VXnDzJjhG9sNnaI9IaPpwLcQR9AH+IbWeqe/DDN0HVxr4ZQp8NlnsHevrIdjxkhes3mp6cmTct3ateJIBg0SmY8hQ7p4ifuZZ4qA0fLlkjBJTQWl0PV1rD61EWvyXl5K2k/l0ipGpI/ggQsf4JZxt9A70Z0qfBAZO1ZKw1wDw10vYONBH3V1cjxsnhhqPCDEZpPBG336uI8nRkZKZdKrr8qIvuYDEAwBpz0ho/uAX2utP1FKnQ68qJT6sdb6Qz/Z5hccjob8X1JSF1+AQoz0dKlq9MSnn0oBi9ZSuWixwLp1spHMzZXTRmGhrEW9eolTCfY6UVwsdn/2mURTeveWDe3o0c1CZEpJ+eVpp8GSJRw+sI2FiXuwJu1mV69SEqMSuGHMjeTl5HFmvzNDV1QuMVE8/CuvSOInNVUqlGpqRIPEbpcSVGc/BSAfqowMSTK72LlTrktPb/2xYmKkVG3rVpEKNgSV9oSMLmj0/81KqYuBV4Ep/jDM19TUSNXcO+9IiTXI5uaSSyS3FexFpzuwdSv8+9/Sy9Q40pCQIKH3p5+GxYtl1rRLHTQuTqZonXtucMLM+fmiS2SzyfslKkoc1j/+ITpVzXu86hz1vJ2wH+uwtbyj3sGhHZzb/2zum/BN5oyaQ0J0QusPFkrMni0JoHfflQTy0KEye9XV6Tx+fEPfQXm5eM2f/azpDsv1QWsLrWWYjyHodFjLSGt9xBlGCnkqK+GhhySP1bNnQzVdRQUsWCBCY3ff3b0E2NyhtTxHO3fKpi0rS6qIfPG8aC2RgdTUlmHnqioZURoRIa9VRkZDlKKmRqoZ7Xa44IIWd+tX9u2Dxx6TDW5jkbrYWLHxwAH5+b33wraiLVjzrTy76VmKqorISsrinqn3cPv42xmWPiywhntCaykr3bpVnuz0dMjJadmjYLHA9deL2NLHH8OuXRL337tX3hCRkZJAdjjkRf3pT+XI1Jj2SN2aHVlI0ClxO611ta8M8SeLFsmurnk1XGKifNB37YIXXpB5wt2VI0dkJ7x/v+zEIyJkVxwdLY2vF17YuR360aNStu5uDPbOnRKSTk6W/q5DhxoiD7Gxko98/nnptUry71jfJixZIn9/c8VSF+l9S3j76Au8+LiVzcVribJEccXIK8gbn8eMITOCOnXMLSUl8N//ijNQShZ1mw0WLpRY3dVXt5zC07evOAYXdru8YPv2iXMZMEBCZO6m9wwb1lCJ1Fr3osMh1zQONRmCRoi9Y33PyZNyAmitgVIpOfl+8olo7bSnmTNcOHEC/vxn+dwOHNh04a+tlfXCbnffSOUtZWXuJZ1ra2Wn7ToRREbSYph8dLQ8/tq1gTslVFTA+vUt1Rg0DvaxknysbFevYsuooW/Z6Txy0SPcNPYmMuI70AgWCCor4cEHRc+o+Ytss4nMRVWVKBB68vwRESJZMWpU24+Zmirx2NWr3e8EQIT/JkwwIwRDhLB3CDt3ykbGU/LY1WOzc6fsQrsb//ufhIvdSdHExMhn+eWX4ayzmvYmHT0qidbDh2UnP3Gim0Rro/txV71YWSn/ul4fu9199CA+Xgp4AukQXEoTACUUstE5d6xE7SNGpzCePIaX53Fa6gTuOjNEE8QuPvpIjl7uugMjI+X2lSul3MuXHYQ33CCPu3u3ZONdGujV1fIG6t+/m8jgdg3C3iHU1Hh3ndayW+1ulJXJCSorq/VroqLEYX7xhVTX1NdLGO6jj2TBjI+XTebHH0tI+oc/bKmf1r+/nL4qK5uGYFy6ay4cDvfimW05dV8TGwt1uobN+nUK1Hz28j4ozWB9IRfoPzOSK4kijqKawIaxOoTdLsnhnh5mJlss8kKvXCkzYH1FfDz8/Ocy2nPZsoaZsvHxEoucNq31mJwh4IS9Q3Cp/7aFS4yyu1FUJP+2JVAXHy/5RK3hmWdkMlp2dstFurgY/vpXkbRprEoQESGFKwsWSC7H9XuuHi67XTaNKSnuNY+qqiRU7W+01mw4soGn8628MvB5aighRQ/kPH7LeH0bqWQ3ub6iQqIiIU1FhVQCpaV5vi4lRXbyviY2VgZJz5gheQxXzbG7vIMhqIT9KzJ6tMSga2tbL2SoqZEFb6Q3Qt9hRvMdemtoLYv6oUOSb3HnDEAW84MHYenSlkn688+XXOTKlQ19W1FRcjrZvl3CyI1L211UVcma4s8y9aKqIp7b9BzWAiubjm0iJiKG6f2uoe6LPM7InEZUZMs/9uRJORGNHes/u3yC60Vu3FjmDteL7C8iIzsmtmcIGGHvEGJj4corpUpl4MCWmxKbTRa52293H/sOd1wjLz2J04EsyqNHizOIjPQcvundW/KIc+c2jQZERIiTGDtWHMa+fXI/vXuLs46Pb1qSqrWEtIqL4Qc/8H1ZsN1hZ/me5VgLrLyx4w3qHfXkZuXyxCVPcP2Y60mNTWNJL8mfxMeLw7JYZANx/Lj8bXff3b7qyqCQlCRPslNnqVVOneoCxx2DPwkJh6CUehCYDdQBe4B5WusSX93/RRdJ7HrJEr4eSqK1nF7tdgllBrrGPVSIjZWS0iVLWs8lVlbKYpyTI6GitqaeRUbK81ta2jI8bLE0SPVXVsrzn5AgDmfxYul9cm1ktZZ17Gc/k45lX7G7eDfz80VU7lD5IdLj0rlz0p3My5nH2F5Nt/uXXio9We++K7OhQZzD5ZfDeee1HYUJCZSSP+TJJ8U5uDsl1NXJv2efHVjbDCFFSDgE4D3gXq21TSn1N+Be4Be+unOLBebMkSqZVatkyhfIWNlzzgn+BECt5aRisfj3xN4al1wiqsT790v4xnWKcjnNsjL40Y/EecTEtD3/wPW7nv4WpZo6luRk+Pa35VTx1VfyfKSnSzewLzqUK+sqeWXbK1gLrKwqXIVFWZg1dBaPznqU2SNmEx3hfpuvlIQSR46UNbO+Xpxjl5M8OfNM0QjJz5fegsbHmooKOfLceqvnxLMh7FHamwByAFFKXQXM0Vrf1Na1ubm5et26dQGwyj9UV0uFzzvvSC8ASDhl5kwp8w6kVENFhUjXfPxxQ07B4ZCS0xtuaEjofvKJSEx4msJYXi7O4K9/De7CqbVmzcE1WPOtvLj1RcrryhnaYyh54/O4ddyt9E3uGzzjgkF9vUhOv/uu/B/kxc7IkB2TuwSOISxRSq3XWue2uD0EHcJbwIta60VtXduVHUJJichp7N8vsenERFmAi4pkcb74YmkQDfTns7xcduh2uyR+BwxoakNVlagUxMW5L7fUWqqRvvENSSIHg6MVR3l247NYC6zsKNpBfFQ8c0fPJW98HmcPODt0ReUCRU2NaJTU1srRbPBg/3puh0PkAFatkqaVuDiRxp0woaEvwRBQgu4QlFLvA+50fu/TWr/hvOY+IBe4WrdimFLqDuAOgAEDBkwsLCx0d1lIo7XsnvfuldN7c+x2kdr4xjckTh1qbN0KDz8sUQdXohUkJ3D0qITmvv3twIa/6u31LN21FGuBlSVfLsGu7UzpP4W88XnMHT2XpJhQbxYIUyor4YknJCYZFycJo/p62XkkJMBdd4nEhSGgBN0htIVS6jbgO8B0rXWVN7/TVU8IX30Fv/99SwWBxrjkGx54IDTj1fv2SYfzpk1in8Mhm81LL5Veo0CVmG87sY35+fNZuGkhxyuP0zuxN7eOvZV5OfMYmdEN64hDCYdDjsHbt0tnYvM3e2mpOIzf/z74ibxuRmsOISSSykqpWUgS+TxvnUFXZv16WTA9RS4SEyWcdOCA53h9sMjOlkRzcbGEv1z9BIE4FZTVlvHilhexFlhZc3ANkZZIZg+fTV5OHrOGzgo9Ubnuyq5dcjLIznb/Zk9JkZ3Pu+/6tjva0GFC5ZPzLyAGeM8Z312jtf5OcE3yH6Wl3tWuWyySeA5levRw31nsa7TWrCpchbXAystbX6baVs2ozFE8NPMhbh57Mz0TTHVMyPHRRxIm8rTz6dVLmlauuy489edtNti2Teqpq6rk750yxf2JKQQICYegtR4abBsCSXp627pJWksuoa2a/3DnYNlBnil4hvkF89lzag/JMcncOu5W8nLymJQ1ySSIQ5kjR9rWKYqMlNBSRUX4OYRDh+DRR6WEMDZWjtFbtoim08SJ8M1vhtzfHBIOobsxaZLE3z0pCZSVScLZXdI53Km11fLmzjexFlhZvmc5Du1gWvY0fnveb7lm1DXER5nKlC5BXJzoe3jCJakRbjIBLlEvrVvGfLWWuLHNJkn1EEoSGocQBPr2lU7d9etblnWCNECdPCnjebvTBnjj0Y1Y860s2ryI4upi+iX3475z7uP28bczOG1wsM0ztJcpU6RpxVNM8dQpKXsNN2XJDz6QEJG7QSxKiZMoKBAxweHDA25eaxiHECTy8iQ/sGWL1PMnJzf0Idjt4gy6w8zx4upiFm9ejLXAyoYjG4iOiOaqkVeRl5PH9EHTibAEoXXb4BsmTJBRhKWl7hd8u10qEm6/Pbx2PvX14hAay/02Ryk5Qa1YYRyCQfpx7r5b8k3Ll0vfQWSklGyed577YTXhgt1h58OvPsRaYOX17a9Ta68lp3cOj138GDeefiM94gKQpTb4n/h4KUV74AHJEfTq1SB0deqUfM2eLSJZ4URFhTiFtipHkpKkjDCEMA4hiERGilRFyMsn+4ivTn3FgoIFLNi4gP2l+0mLTeOOiXcwb/w8cvqE2aJgEIYOlT6Dd9+VaiKHQxzC4MFyMsjJCa/TATQkytuSG7fZQm5mr3EIBr9SVV/Fa9tfw5pvZcW+FSgUM4fM5MEZD3L5iMuJjYxt+04MXZs+fWTxv+462T1HR8tCGG6OwEVioji8oiLPcrglJaJRE0IYh2DwOVpr1h5eizXfyuItiymrLWNw2mDun3Y/t427jf4pbhJthvAnLi7kyiz9glIiIfzoo5I7cVdFVFUlJ4nJkwNvnweMQzD4jOOVx1m0aRHWfCtbT2wlLjKOOaPmkJeTx7kDz8WiQqe8zmDwKxMmyMjQ5ctFUtylBOmqHKmuluHjIVZdZRyCoVPYHDaW7V6GNd/KW1++hc1hY3Lfyfznsv9w3ejrSIkNrTe8wRAQlIKbbpIB4m+/LVUjLtGv00+HK66AIUOCbWULjEMwdIidRTuZXzCfhRsXcqTiCJnxmdw1+S7mjZ/H6J6jg22ewRB8LBaZQDdlChw71iA3Hgitlw5iHILBa8pry3l528tY862sPrCaCBXBJcMuIS8nj0uHXUpURJh1mxoMvsBi6TJqrsYhGDyitWb1gdVY8628tPUlKusrGZE+gr9d+DduGXsLfZK6xhvdYDC0jXEIBrccLj/Mwo0LseZb2VW8i8ToRK4fcz15OXmc1e8sIypnMIQhxiEYvqbOXsfbX76NNd/KO7vfwaEdnDPgHH55zi+ZM2oOidHdXHrVYAhzjEMwsOX4Fqz5Vp7d9CxFVUVkJWVxz9R7uH387QxLN+MNDYbugnEI3ZSSmhJe2PIC1nwraw+vJcoSxRUjryBvfB4zhswwU8cMhm6I+dR3Ixzawcp9K7HmW3l1+6vU2Go4vefpPHLRI9w09iYy4jOCbaJX2O2wcyd8+KHMIImNhTPPlKbP1NRgW2cwdF2MQ+gGFJYU8sxGmTq2r2QfKTEp5I3PIy8njwl9JnSpBHFlJTz+OGzdKmKaSUmirvzCC/DKK/D978O4ccG20mDomhiHEKbU2Gr4347/Yc238v7e99FoLhx8IX++4M9cOfJK4qK6nqaM1vDvf8OOHS3nticni7N45BH4zW+kQdRgMLQP4xDCCK01+UfzseZbeW7zc5TUlDAwZSC/Pe+33Db+NrJTs4NtYqf46ivYvFmGTbk71CQkiJjmW2+JTIzBYGgfxiGEASerTvLc5uew5lvZeGwjMRExXDPqGvLG5zFt0LSwEZX75BNRTvYU4crMhPz81od0GTpIeTls2iRDbeLjYfRozxPBDF0S4xC6KHaHnff2voc138obO9+gzl5HblYuT1zyBNePuZ60OA867B2kogL27ZOkbkYGZGUFVtL+2LG21ZMtFvkqLzcOwSfY7fD667BsmQx0iYiQ20AUPefNa1DyNHR5QsIhKKXuB64AHMBx4Hat9eHgWhWa7C7ezfz8+Tyz8RkOlR8iPS6d7+V+j3k58xjbyz+j1yoq4NVX4eOPJY7v+hoyBG64IXCijYmJMpnQEy7b2ppeaPACrWHRIpkPPGCA6Pe7cDhg40Z46CH4xS+6x5yDbkBIOATgQa31rwGUUj8EfgN8J7gmhQ6VdZW8su0VrAVWVhWuwqIszBo6i0dnPcrsEbOJjvDf6ldRAX/7m5R3ZmU1rAlay479T3+Cn/0MTjvNbyZ8zZlnwuefe76mtBT69pXQkaGT7NsnQ+Czs1sOebFYoH9/Sex8+ilMnx4MCw0+JiQcgta6rNG3CYAOli2hgtaaNQfXYM238uLWFymvK2doj6H8+YI/c+u4W+mb3Dcgdrz1Fhw8KIncxigF6emyE3/8cXj4Yf/vyseMkVBVUZH82xy7HU6ehBtvDN/pjAFl5Up5Ud1N/HKRmQlLl8K0aZ6vM3QJQsIhACil/gTcCpQC0zxcdwdwB8CAAQMCY1wAOVpxlGc3Pou1wMqOoh3ER8Uzd/Rc8sbncfaAswPaM1BVJRvErKzWr0lKkkV40ybIzfWvPVFR8KMfyYll/37JacbEyGnl5EkoK4NLL4VJk/xrR7dh5862O/0SE+XFqKqS/xu6NAFzCEqp94Hebn50n9b6Da31fcB9Sql7ge8Dv3V3P1rrJ4EnAXJzc8PiJFFvr2fprqVYC6ws+XIJdm1nSv8pPDX7KeaOnktSTHCSdocPSx4xqo0xBzExsG2b/x0CQL9+8Pvfi6N6/32oq5Nw9ogRMq987FhzOvAZSom39YQraWOe9LAgYA5Ba32hl5c+DyyhFYcQTmw/sR1rvpWFmxZyvPI4vRJ68ZOzfsK8nHmMzBgZbPOw2737nFssDYUngaBHD7jmGplCWFkpeY2EhMA9frdh3Djxup6e3LIyOULGxwfOLoPfCImQkVJqmNZ6l/Pby4EdwbTHn5TVlvHilhexFlhZc3ANkZZILht+GXnj85g1dFZITR3r2VM2fw6H5/BwdbXkHQNNZKQpLfUr554r5ab19e6Pia5Y3Zw55oQQJoSEQwD+qpQagZSdFhJmFUZaa1YVrsJaYOXlrS9TbatmVOYo/j7j79w89mZ6JYZmg09ampSab9rUeh6hrk4W5kCEiwwBJitLFvsXX5QRkI1PAfX1Um2QkyOqgoawICQcgtb6mmDb4A8Olh3kmQIRldtzag9J0UncMvYW8nLyOKPvGV1CVO6aa0RI7uRJqSpqTG2trAm33GJ6k8KWSy8VoahXX4UTJxpuj4qSn115ZdP+BEOXRum2kkYhTG5url63bl2wzWhCra2WN3e+ibXAyvI9y3FoB9OypzFv/DyuGXUN8VFdL9Z64AA88QQcOSKNqhZLQ7J57lwpQe8Cvs3QGWw22L1bcgYxMTBsmMkbdGGUUuu11i3O9cYh+IiNRzdizbeyaPMiiquL6Zfcj3nj53H7+NsZnDY42OZ1GocDdu2C7dslTNSvH4wfb9YEg6Er0ppDMGe9TlBcXczizYuxFljZcGQD0RHRXDXyKvJy8pg+aDoRlohgm+gzLBYp7RwxItiWGAwGf2EcQjtxaAcf7P0Aa4GV17e/Tq29lvG9x/PYxY9x4+k30iOuR7BNNBgMhg5hHIKXfHXqKxYULGDBxgXsL91PWmwad0y8g3nj55HTJyfY5hkMBkOnMQ7BA9X11by2/TWsBVY+/OpDFIqZQ2by4IwHuXzE5cRGxgbbRIPBYPAZxiE0Q2vNusPrsOZbWbxlMaW1pQxKHcT90+7n1nG3MiAl/PSTDAaDAYxD+JoTlSdYtGkR1gIrW45vIS4yjjmj5pCXk8e5A88Nm6ljBoPB0Brd2iHYHDaW7V7G/IL5vLnzTWwOG5P7TuY/l/2H60ZfR0qs0UUwGAzdh27pEHYW7WR+wXwWblzIkYojZMZnctfku5g3fh6je44OtnkGg8EQFLqlQ7julevYcnwLlwy7hLycPC4ddmlIicoZDAZDMOiWDuGpy5+ib1Jf+iT1CbYpBoPBEDJ0S4eQm2WkOQ0Gg6E5pnTGYDAYDIBxCAaDwWBw0qXVTpVSJ5CBOi4ygKIgmdMaoWgTGLvaSyjaFYo2gbGrvQTDroFa68zmN3Zph9AcpdQ6d5KuwSQUbQJjV3sJRbtC0SYwdrWXULLLhIwMBoPBABiHYDAYDAYn4eYQngy2AW4IRZvA2NVeQtGuULQJjF3tJWTsCqscgsFgMBg6TridEAwGg8HQQYxDMBgMBgMQpg5BKfVTpZRWSmUE2xYApdT9SqlNSqkCpdRypVRWsG0CUEo9qJTa4bTtdaVUarBtAlBKXauU2qqUciilglqOp5SapZTaqZTarZS6J5i2uFBKWZVSx5VSW4JtS2OUUv2VUiuUUtudr99dIWBTrFLqC6XURqdNvw+2TY1RSkUopfKVUm8H2xYIQ4eglOoPzAD2B9uWRjyotR6rtR4PvA38Jsj2uHgPGKO1Hgt8CdwbZHtcbAGuBlYF0wilVATwOHAxMAq4QSk1Kpg2OVkAzAq2EW6wAT/RWp8GnAncGQLPVy1wgdZ6HDAemKWUOjO4JjXhLmB7sI1wEXYOAfgH8HMgZLLlWuuyRt8mECK2aa2Xa61tzm/XAP2CaY8LrfV2rfXOYNsBnAHs1lrv1VrXAS8AVwTZJrTWq4DiYNvRHK31Ea31Buf/y5GFrm+QbdJa6wrnt1HOr5D4/Cml+gGXAk8F2xYXYeUQlFKXA4e01huDbUtzlFJ/UkodAG4idE4IjckD3gm2ESFGX+BAo+8PEuQFrquglMoGcoDPg2yKKyxTABwH3tNaB90mJ48gm1dHkO34mi4nf62Ueh/o7eZH9wG/BGYG1iLBk11a6ze01vcB9yml7gW+D/w2FOxyXnMfctx/LhA2eWtXCKDc3BYSu8tQRimVCLwK/KjZ6TgoaK3twHhnjux1pdQYrXVQ8y9KqcuA41rr9Uqp84NpS2O6nEPQWl/o7nal1OnAIGCjUgok/LFBKXWG1vposOxyw/PAEgLkENqySyl1G3AZMF0HsCmlHc9XMDkI9G/0fT/gcJBs6RIopaIQZ/Cc1vq1YNvTGK11iVJqJZJ/CXZCfipwuVLqEiAWSFZKLdJa3xxMo8ImZKS13qy17qm1ztZaZyMf5gmBcAZtoZQa1ujby4EdwbKlMUqpWcAvgMu11lXBticEWQsMU0oNUkpFA9cDbwbZppBFyU7saWC71vrhYNsDoJTKdFXPKaXigAsJgc+f1vperXU/51p1PfBhsJ0BhJFDCHH+qpTaopTahIS0gl6O5+RfQBLwnrMk9t/BNghAKXWVUuogcBawRCn1bjDscCbcvw+8iyRIX9Jabw2GLY1RSi0GPgNGKKUOKqW+EWybnEwFbgEucL6fCpw74GDSB1jh/OytRXIIIVHiGYoY6QqDwWAwAOaEYDAYDAYnxiEYDAaDATAOwWAwGAxOjEMwGAwGA2AcgsFgMBicGIdgMBgMBsA4BEOYoJTKVkpVOzVrXLe1kK5WSsU56+PrOiuP7ryvj5yqqCilfuiUfm6XBIhSKlUp9b3O2OLFY7SQzFZKRSulVimlupxigcE/GIdgCCf2OCXGW5Wu1lpXO6/xhQRFHvCaUysH4HvAJVrrm9p5P6nO320XSvD2M7yAZpLZTgXXD4Dr2vvYhvDEOARDl8E5fGWG8/9/VEr908PlgZCuvglwCQT+GxgMvKmUulspdbNzMEuBUuo/jU4R/1NKrXcOa7nDeT9/BYY4r33QedppvJP/qVLqd87/ZztPIU8AG4D+rT1WYzxIZv/P+XcYDMYhGLoUv0UUY29CpJXv9nCtX6WrndpGg7XW+wC01t9BTh3TgGXIrnuq8zRip2HRzdNaTwRygR8qpdKBe3CebrTWP/Pi4UcAC7XWOUC8h8fyhi3ApHZcbwhjTOzQ0GXQWq9yCqj9GDjfFapRSt2PiKo1xt/S1RlASSs/mw5MBNY6lXfjEC1+ECdwlfP//YFhQHsFGAu11mu8eKw20VrbnfmUJOdQG0M3xjgEQ5fBKXHeByhyLV5Kqd64fx+3W7paKXUn8C3nt5cAVzX+Xmvd+PerEdlit3cFPKO1bjKS1Kl7fyFwlta6yinF7O4+bDQ9vTe/prKtx2onMUBNJ37fECaYkJGhS6CU6oMM8LkCqFRKXeT8UQ5Q4OZX2i1drbV+3Bm2Ga+1Ptz8+2bXngIilFLuFvQPgDlKqZ5O23sopQYCKcAppzMYicwdBihHVGddHAN6KqXSlVIxyLyK1mjtsbzCGbI6obWu9/Z3DOGLcQiGkEcpFQ+8hgxw3w7cD/zO+ePxuHEIAZKuXg6c7eaxtwG/ApY7ZZffQ042y4BI5233I3Os0VqfBFY7JdIfdC7Of0DGT76NB/1+D4/VBA+S2dOApR354w3hh5G/NnRplFJPI2GdAcDbWusxXv7ePiBXa13UicfOAX6stb6lo/cRbJRSrwH3aq13BtsWQ/AxJwRDl0Zr/Q2ttQOprklp3JjmDldjGhBFJ4eba63zkeErLco8uwLOUNr/jDMwuDAnBIPBYDAA5oRgMBgMBifGIRgMBoMBMA7BYDAYDE6MQzAYDAYDYByCwWAwGJwYh2AwGAwGwDgEg8FgMDgxDsFgMBgMAPw/B/f7IPKRLS0AAAAASUVORK5CYII=",
            "text/plain": [
              "<Figure size 432x288 with 1 Axes>"
            ]
          },
          "metadata": {
            "needs_background": "light"
          },
          "output_type": "display_data"
        }
      ],
      "source": [
        "plot_dataset(train_x,train_labels,net.W.detach().numpy(),net.b.detach().numpy())"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "1W4TZfXOmIlS"
      },
      "source": [
        "Not let's compute the accuracy on the validation dataset:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "HUjdeIefsIsg",
        "outputId": "a1a363d4-a307-4769-9ccf-fe8a857b62af"
      },
      "outputs": [
        {
          "data": {
            "text/plain": [
              "tensor(0.7333)"
            ]
          },
          "execution_count": 31,
          "metadata": {},
          "output_type": "execute_result"
        }
      ],
      "source": [
        "pred = torch.sigmoid(net.forward(torch.tensor(valid_x)))\n",
        "torch.mean(((pred.view(-1)>0.5)==(torch.tensor(valid_labels)>0.5)).type(torch.float32))"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Fv7JxC3uToPe"
      },
      "source": [
        "Let's explain what is going on here:\n",
        "* `pred` is the vector of predicted probabilities for the whole validation dataset. We compute it by running original validation data `valid_x` through our network, and applying `sigmoid` to get probabilities.\n",
        "* `pred.view(-1)` creates a flattened view of the original tensor. `view` is similar to `reshape` function in numpy.\n",
        "* `pred.view(-1)>0.5` returns a boolean tensor or truth value showing the predicted class (False = class 0, True = class 1)\n",
        "* Similarly, `torch.tensor(valid_labels)>0.5)` creates the boolean tensor of truth values for validation labels\n",
        "* We compare those two tensors element-wise, and get another boolean tensor, where `True` corresponds to correct prediction, and `False` - to incorrect.\n",
        "* We convert that tensor to floating point, and take it's mean value using `torch.mean` - that is the desired accuracy "
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "_95qF9lY2kHp"
      },
      "source": [
        "## Neural Networks and Optimizers\n",
        "\n",
        "In PyTorch, a special module `torch.nn.Module` is defined to represent a neural network. There are two methods to define your own neural network:\n",
        "* **Sequential**, where you just specify a list of layers that comprise your network\n",
        "* As a **class** inherited from `torch.nn.Module`\n",
        "\n",
        "First method allows you to specify standard networks with sequential composition of layers, while the second one is more flexible, and gives an opportunity to express networks of arbitrary complex architectures. \n",
        "\n",
        "Inside modules, you can use standard **layers**, such as:\n",
        "* `Linear` - dense linear layer, equivalent to one-layered perceptron. It has the same architecture as we have defined above for our network\n",
        "* `Softmax`, `Sigmoid`, `ReLU` - layers that correspond to activation functions \n",
        "* There are also other layers for special network types - convolution, recurrent, etc. We will revisit many of them later in the course.\n",
        "\n",
        "> Most of the activation function and loss functions in PyTorch are available in two form: as a **function** (inside `torch.nn.functional` namespace) and **as a layer** (inside `torch.nn` namespace). For activation functions, it is often easier to use functional elements from `torch.nn.functional`, without creating separate layer object.\n",
        "\n",
        "If we want to train one-layer perceptron, we can just use one built-in `Linear` layer:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "D77pXPR6oFRs",
        "outputId": "efa49e5c-72d4-4781-89d4-4ab6597d2b0e"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "[Parameter containing:\n",
            "tensor([[-0.0422,  0.1821]], requires_grad=True), Parameter containing:\n",
            "tensor([0.6582], requires_grad=True)]\n"
          ]
        }
      ],
      "source": [
        "net = torch.nn.Linear(2,1) # 2 inputs, 1 output\n",
        "\n",
        "print(list(net.parameters()))"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "0tbe0Et_oiNo"
      },
      "source": [
        "As you can see, `parameters()` method returns all the parameters that need to be adjusted during training. They correspond to weight matrix $W$ and bias $b$. You may note that they have `requires_grad` set to `True`, because we need to compute gradients with respect to parameters.\n",
        "\n",
        "PyTorch also contains built-in **optimizers**, which implement optimization methods such as **gradient descent**. Here is how we can define a **stochastic gradient descent optimizer**:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "B4AxyrFMozh0"
      },
      "outputs": [],
      "source": [
        "optim = torch.optim.SGD(net.parameters(),lr=0.05)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "6eB8v58eo9pp"
      },
      "source": [
        "Using the optimizer, our training loop will look like this:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "ups7nlV22ofp",
        "outputId": "503d8ae9-35f3-4ecb-e2ff-4da2ec2914eb"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Epoch 0: last batch loss = 0.7596041560173035, val acc = 0.5333333611488342\n",
            "Epoch 1: last batch loss = 0.6602361798286438, val acc = 0.6000000238418579\n",
            "Epoch 2: last batch loss = 0.5847358107566833, val acc = 0.6666666865348816\n",
            "Epoch 3: last batch loss = 0.5263020992279053, val acc = 0.7333333492279053\n",
            "Epoch 4: last batch loss = 0.48015740513801575, val acc = 0.800000011920929\n",
            "Epoch 5: last batch loss = 0.4430023431777954, val acc = 0.8666666746139526\n",
            "Epoch 6: last batch loss = 0.41254672408103943, val acc = 0.8666666746139526\n",
            "Epoch 7: last batch loss = 0.3871781527996063, val acc = 0.800000011920929\n",
            "Epoch 8: last batch loss = 0.3657420873641968, val acc = 0.800000011920929\n",
            "Epoch 9: last batch loss = 0.34739670157432556, val acc = 0.800000011920929\n"
          ]
        }
      ],
      "source": [
        "val_x = torch.tensor(valid_x)\n",
        "val_lab = torch.tensor(valid_labels)\n",
        "\n",
        "for ep in range(10):\n",
        "  for (x,y) in dataloader:\n",
        "    z = net(x).flatten()\n",
        "    loss = torch.nn.functional.binary_cross_entropy_with_logits(z,y)\n",
        "    optim.zero_grad()\n",
        "    loss.backward()\n",
        "    optim.step()\n",
        "  acc = ((torch.sigmoid(net(val_x).flatten())>0.5).float()==val_lab).float().mean()\n",
        "  print(f\"Epoch {ep}: last batch loss = {loss}, val acc = {acc}\")"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "vRLXEQ4Qrcvx"
      },
      "source": [
        "> You may notice that to apply our network to input data we can use `net(x)` instead of `net.forward(x)`, because `nn.Module` implements Python `__call__()` function\n",
        "\n",
        "Taking this into account, we can define generic `train` function:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "5c6WsBhlrlIs",
        "outputId": "54de8404-4170-4a15-abba-039d06d5e946"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Epoch 0: last batch loss = 0.48486900329589844, val acc = 0.7333333492279053\n",
            "Epoch 1: last batch loss = 0.41338109970092773, val acc = 0.800000011920929\n",
            "Epoch 2: last batch loss = 0.35756850242614746, val acc = 0.800000011920929\n",
            "Epoch 3: last batch loss = 0.31495171785354614, val acc = 0.800000011920929\n",
            "Epoch 4: last batch loss = 0.2824164032936096, val acc = 0.800000011920929\n",
            "Epoch 5: last batch loss = 0.2572754919528961, val acc = 0.800000011920929\n",
            "Epoch 6: last batch loss = 0.23751722276210785, val acc = 0.800000011920929\n",
            "Epoch 7: last batch loss = 0.2217157930135727, val acc = 0.800000011920929\n",
            "Epoch 8: last batch loss = 0.2088666558265686, val acc = 0.800000011920929\n",
            "Epoch 9: last batch loss = 0.19824868440628052, val acc = 0.800000011920929\n"
          ]
        }
      ],
      "source": [
        "def train(net, dataloader, val_x, val_lab, epochs=10, lr=0.05):\n",
        "  optim = torch.optim.Adam(net.parameters(),lr=lr)\n",
        "  for ep in range(epochs):\n",
        "    for (x,y) in dataloader:\n",
        "      z = net(x).flatten()\n",
        "      loss = torch.nn.functional.binary_cross_entropy_with_logits(z,y)\n",
        "      optim.zero_grad()\n",
        "      loss.backward()\n",
        "      optim.step()\n",
        "    acc = ((torch.sigmoid(net(val_x).flatten())>0.5).float()==val_lab).float().mean()\n",
        "    print(f\"Epoch {ep}: last batch loss = {loss}, val acc = {acc}\")\n",
        "\n",
        "net = torch.nn.Linear(2,1)\n",
        "\n",
        "train(net,dataloader,val_x,val_lab,lr=0.03)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "KzuIDqJ8sFYm"
      },
      "source": [
        "## Defining Network as a Sequence of Layers\n",
        "\n",
        "Now let's train multi-layered perceptron. It can be defined just by specifying a sequence of layers. The resulting object will automatically inherit from `Module`, e.g. it will also have `parameters` method that will return all parameters of the whole network."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "tBtytmEAsq-O",
        "outputId": "06ad840b-c2b7-409e-e01e-a9170548151d"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Sequential(\n",
            "  (0): Linear(in_features=2, out_features=5, bias=True)\n",
            "  (1): Sigmoid()\n",
            "  (2): Linear(in_features=5, out_features=1, bias=True)\n",
            ")\n"
          ]
        }
      ],
      "source": [
        "net = torch.nn.Sequential(torch.nn.Linear(2,5),torch.nn.Sigmoid(),torch.nn.Linear(5,1))\n",
        "print(net)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "5r5RbLB1s6YB"
      },
      "source": [
        "We can train this multi-layered network using the function `train` that we have defined above:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "ogXKdcfIs_ND",
        "outputId": "957ccd8d-0076-4e9b-89f1-edc1de75f18e"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Epoch 0: last batch loss = 0.5835739970207214, val acc = 0.800000011920929\n",
            "Epoch 1: last batch loss = 0.4642275869846344, val acc = 0.800000011920929\n",
            "Epoch 2: last batch loss = 0.35158076882362366, val acc = 0.800000011920929\n",
            "Epoch 3: last batch loss = 0.26132312417030334, val acc = 0.800000011920929\n",
            "Epoch 4: last batch loss = 0.19465585052967072, val acc = 0.800000011920929\n",
            "Epoch 5: last batch loss = 0.14735405147075653, val acc = 0.800000011920929\n",
            "Epoch 6: last batch loss = 0.11454981565475464, val acc = 0.800000011920929\n",
            "Epoch 7: last batch loss = 0.09244414418935776, val acc = 0.800000011920929\n",
            "Epoch 8: last batch loss = 0.07805468142032623, val acc = 0.800000011920929\n",
            "Epoch 9: last batch loss = 0.06894762068986893, val acc = 0.800000011920929\n"
          ]
        }
      ],
      "source": [
        "train(net,dataloader,val_x,val_lab)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "jY4R1XEGtEzJ"
      },
      "source": [
        "## Defining a Network as a Class\n",
        "\n",
        "Using a class inherited from `torch.nn.Module` is a more flexible method, because we can define any computations inside it. `Module` automates a lot of things, eg. it automatically understands all internal variables that are PyTorch layers, and gathers their parameters for optimization. You just need to define all layers of the network as members of the class:"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "SlsJmGu0tMsZ",
        "outputId": "240d5c89-096c-4392-99cd-1ade5ff3e3e1"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "MyNet(\n",
            "  (fc1): Linear(in_features=2, out_features=10, bias=True)\n",
            "  (func): ReLU()\n",
            "  (fc2): Linear(in_features=10, out_features=1, bias=True)\n",
            ")\n"
          ]
        }
      ],
      "source": [
        "class MyNet(torch.nn.Module):\n",
        "  def __init__(self,hidden_size=10,func=torch.nn.Sigmoid()):\n",
        "    super().__init__()\n",
        "    self.fc1 = torch.nn.Linear(2,hidden_size)\n",
        "    self.func = func\n",
        "    self.fc2 = torch.nn.Linear(hidden_size,1)\n",
        "\n",
        "  def forward(self,x):\n",
        "    x = self.fc1(x)\n",
        "    x = self.func(x)\n",
        "    x = self.fc2(x)\n",
        "    return x\n",
        "  \n",
        "net = MyNet(func=torch.nn.ReLU())\n",
        "print(net)"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "HwdapRxft-7M",
        "outputId": "6eb900cf-4902-4a04-c62b-497b68455406"
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Epoch 0: last batch loss = 0.7821246981620789, val acc = 0.46666666865348816\n",
            "Epoch 1: last batch loss = 0.7457502484321594, val acc = 0.5333333611488342\n",
            "Epoch 2: last batch loss = 0.7120334506034851, val acc = 0.5333333611488342\n",
            "Epoch 3: last batch loss = 0.6811249256134033, val acc = 0.6666666865348816\n",
            "Epoch 4: last batch loss = 0.6533011794090271, val acc = 0.7333333492279053\n",
            "Epoch 5: last batch loss = 0.627849280834198, val acc = 0.7333333492279053\n",
            "Epoch 6: last batch loss = 0.6030643582344055, val acc = 0.800000011920929\n",
            "Epoch 7: last batch loss = 0.5775002837181091, val acc = 0.800000011920929\n",
            "Epoch 8: last batch loss = 0.5522137880325317, val acc = 0.8666666746139526\n",
            "Epoch 9: last batch loss = 0.5250465869903564, val acc = 0.8666666746139526\n"
          ]
        }
      ],
      "source": [
        "train(net,dataloader,val_x,val_lab,lr=0.005)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "dvAiaj_JndyP"
      },
      "source": [
        "**Task 1**: Plot the graphs of loss function and accuracy on training and validation data during training\n",
        "\n",
        "**Task 2**: Try to solve MNIST classificiation problem using this code. Hint: use `crossentropy_with_logits` as a loss function."
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Defining a Network as PyTorch Lightning Module"
      ],
      "metadata": {
        "id": "7THJ0lhITxDi"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "Let's wrap the written PyTorch model code in PyTorch Lightining module. This allows to work with your model more conveniently and flexibly using various Lightining methods for training and accuracy testing."
      ],
      "metadata": {
        "id": "bPpYZFQAXNMV"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "First we need to install and import PyTorch Lightining. This can be done with the command\n",
        "\n",
        "```\n",
        "pip install pytorch-lightning\n",
        "```\n",
        "or\n",
        "```\n",
        "conda install -c conda-forge pytorch-lightning\n",
        "```"
      ],
      "metadata": {
        "id": "Crqwpx6gZUm3"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "import pytorch_lightning as pl"
      ],
      "metadata": {
        "id": "_bBSXSELVlRK"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "In order for our code to work in Lightning, we need to do the following:\n",
        "\n",
        "1. Create a subclass of `pl.LightningModule` and add to it model architecture in `__init__` method and `forward` pass method.\n",
        "2. Move used optimizer to the `configure_optimizers()` method.\n",
        "3. Define the training and validation process in methods `training_step` and `validation_step` respectively.\n",
        "4. (Optional) Implement a testing (`test_step` method) and prediction process (`predict_step` method).\n",
        "\n",
        "It should also be understood that PyTorch Lightning has a built-in translation of models to different devices, depending on where the incoming data from the `DataLoaders` is located. Therefore, all calls `.cuda()` or `.to(device)` should be removed from the code."
      ],
      "metadata": {
        "id": "_Aaz4FNpZjqL"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "class MyNetPL(pl.LightningModule):\n",
        "    def __init__(self, hidden_size = 10, func = torch.nn.Sigmoid()):\n",
        "        super().__init__()\n",
        "        self.fc1 = torch.nn.Linear(2,hidden_size)\n",
        "        self.func = func\n",
        "        self.fc2 = torch.nn.Linear(hidden_size,1)\n",
        "\n",
        "        self.val_epoch_num = 0 # for logging\n",
        "\n",
        "    def forward(self, x):\n",
        "        x = self.fc1(x)\n",
        "        x = self.func(x)\n",
        "        x = self.fc2(x)\n",
        "        return x\n",
        "\n",
        "    def training_step(self, batch, batch_nb):\n",
        "        x, y = batch\n",
        "        y_res = self(x).view(-1)\n",
        "        loss = torch.nn.functional.binary_cross_entropy_with_logits(y_res, y)\n",
        "        return loss\n",
        "\n",
        "    def configure_optimizers(self):\n",
        "        optimizer = torch.optim.SGD(self.parameters(), lr = 0.005)\n",
        "        return optimizer\n",
        "    \n",
        "    def validation_step(self, batch, batch_nb):\n",
        "        x, y = batch\n",
        "        y_res = self(x).view(-1)\n",
        "        val_loss = torch.nn.functional.binary_cross_entropy_with_logits(y_res, y)\n",
        "        print(\"Epoch \", self.val_epoch_num, \": val loss = \", val_loss.item(), \" val acc = \",((torch.sigmoid(y_res.flatten())>0.5).float()==y).float().mean().item(),  sep = \"\")\n",
        "        self.val_epoch_num += 1"
      ],
      "metadata": {
        "id": "0vp2ROQ9UHeE"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "Let's also add validation `Dataset` and `DataLoader`:"
      ],
      "metadata": {
        "id": "tuWOgQabncMG"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "valid_dataset = torch.utils.data.TensorDataset(torch.tensor(valid_x),torch.tensor(valid_labels,dtype=torch.float32))\n",
        "valid_dataloader = torch.utils.data.DataLoader(valid_dataset, batch_size = 16)"
      ],
      "metadata": {
        "id": "h3bAMM8RVckT"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "Now our model is ready for training. In Pytorch Lightning, this process is implemented through an object of the `Trainer` class, which essentially \"mixes\" the model with any datasets."
      ],
      "metadata": {
        "id": "yj0Cd6OOnoyy"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "net = MyNetPL(func=torch.nn.ReLU())\n",
        "trainer = pl.Trainer(max_epochs = 30, log_every_n_steps = 1, accelerator='gpu', devices=1)\n",
        "trainer.fit(model = net, train_dataloaders = dataloader, val_dataloaders = valid_dataloader)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 864,
          "referenced_widgets": [
            "1657a223e5524ca682ea081b9e4addea",
            "4f111fbdbc3440f783adc3df3df46494",
            "cc048e2c91ce48258934ef577cf229d1",
            "d3c01678943341c5b814430145692a69",
            "9b55455cc9b541ef9634be2d790bb831",
            "15d7c09876074047afac1e41cb9ac121",
            "90137ba0ff814f71ad964f45d704ee89",
            "0919c9545ef64ed1a65f3f489d51cccc",
            "12cad77b8027415b82937ad33f793a63",
            "25ff491870eb4bf6ad4a320e5c99bd31",
            "238a42e032c34b9183e1e6a75f886da0",
            "a4fb1b2e0f8b4346bbde1b949dbce0fd",
            "18876b0e4f0f4b21ad1802f36637c067",
            "92ef8d6e24604b2f895e3876dc9996ee",
            "d4bc1057a59c4666a7dc0f9627c45901",
            "3355e659c40e4e42bbad6c8690f5055e",
            "0ab539031d80478685164ce470246d57",
            "271fdffaef854a67b294c0ccdfb6fe91",
            "0bd01bf4a9954fe2ba2760d10b9d7971",
            "bd5250b6001c4cd282a25d498ee4e673",
            "21538a0928e04ca08562dda0322385a1",
            "5301b071e422430e9bff6cd23c2853b5",
            "3e63509c89304bccb2c7371ec5e7ca62",
            "ff10f2e47185425eaa1229be76092ee5",
            "03cbfa5d29d548498035ba7bf7e0b659",
            "561c5a5b02894df2a66b2991877e1231",
            "569851b1958f49e281770b65bf78b60a",
            "2b49a1491afb4946975395080b9117e9",
            "79737a473e0b4b59bb4d6f190d92b94c",
            "d8a3af0177fc4707b928629952396ad5",
            "34852db50a91487795451f76b57da6b2",
            "046c75ea1598416497c2ef218d1f268a",
            "16e49dd0c2094a87a398416bac89ef69",
            "e6c4eb3c595c43ef9722654dcfabfcc6",
            "62f1b983740e47cd8664eccafc926e32",
            "9861f59fd71a4e3c879858ef8b4b40fb",
            "d9960d4519ec42bcb8678359b278c7b5",
            "118e90e145994312897584085642c03b",
            "db156fc5cbfd426e8460232b8f760733",
            "e68df50870c5469a9dc86346d7ad9a4e",
            "c89c5ec1ca1549cbbc7dd57b3672d74e",
            "84e423587f4244938844cd74d2f86dc0",
            "a31f6ff7fbc54df5bd1745816b2176f8",
            "d6d02c0963c54a6bbbd6753f3c3e6503",
            "69eedcfbe5c14a4cbe119364ce973690",
            "72eb0dd423f4486b9a63f100670e03a5",
            "4b7e9cfd822d48db848319a78548b0db",
            "a52a0bc61ed14e0d93f0c4768687fee8",
            "d1c60311d2bc4f4c826da5c7a634202d",
            "08426ffc99c44d6290ef9cb9363a5737",
            "161c5cea83dc42f6b87c904303dad688",
            "79c04563af9646dd9a7e82db11894c24",
            "235b2edd90bf4d1383b5a0d49905a241",
            "24ead65d14c54fbcb174b06b7dadbcc5",
            "20b85c48964d4c85890f8a0ebc04dd1d",
            "7287a9afffb5470c920734840c5d72fe",
            "ae3232c87db9469fa19cb59f78be2f57",
            "e2a292f657c342569a080a3d9e25852b",
            "f56858c5843d446286d416e9bbc7e7c8",
            "6ddb0e10ea78488aa8358ec3a7bb0780",
            "df7172162b6542f08662614b084d7521",
            "ca6221d153a94b4898e5a1b5043b843d",
            "54e9275a7f074eeca9a5995653d16036",
            "4454290d993f4350a6dc4e464c61c0a9",
            "6e5f99b5aec44fff9d4cecb28dd59188",
            "39ae0b5e8b8a41b79ea1a209f2aacc87",
            "08a690202bbe48bf9434a3354cb560c1",
            "7311cc83255f46ffa31f461c485111b5",
            "6f484c87ff3e4582aad771a703151f2b",
            "ab9c536f94b84922877071f760111f55",
            "427f04eec07f4d94a010664b12139f0f",
            "cd7f66fdfe224994a31a3c985cb7a1de",
            "b74e5502e4e54847b1191b7b0304f66a",
            "dbfcbe2df4f74df594606dd0bb6873b4",
            "ac62ad773e7a4694b57dd8c71b81f23d",
            "f20824d8dfc84640bee1cdc9b7277caa",
            "fd9a33d8f6ad459594d9939fd635730c",
            "e2900fe753754ede94abc1847dda4d5c",
            "0c1832e2d1ab4ca4a882d76f1d896c02",
            "10a5f4a004bc4a81a485604f67bab642",
            "fe260f7a9c66497cad723b44c1addbe7",
            "ef7d39cc71074a7faa299da2621abe03",
            "3f58e2aea843451b83e3aba8c1eefc74",
            "fd38fbd015e6471392cfee4464e6370e",
            "a95c45bcb67f4a569fb9f88af8108fde",
            "bf3bf33f0c474b54a4b472a4a7626da7",
            "afcc785f069b433ba8747b01e5840763",
            "ec27c6b290be4adc8d2df034fd3bb143",
            "0d2b1608b987468791e1a7ffedfd0079",
            "016a5fc3757c480b9c905867c4892864",
            "c7c7cc7d1c0647abb11ade78ef451007",
            "d0e4462fee034a67b3682e27d5cb6e27",
            "ac3a80de351440e7a279f3efce37e430",
            "d6204036abba495785a3674ea841746c",
            "3df8a54d12604c1ebe7229f88d5811bf",
            "5236935ed5874a0986f953ee21477be9",
            "1355273e058041efa299727d17949855",
            "68acf21436374d5eb393ada1b2298e28",
            "57d592b9768545869080fc2505e5a770",
            "b650b7b4420541298ea255d741f8a518",
            "3d0949a3f0504bf0802082ec86ce8e17",
            "3f71570951c94959ba0eea6692b2d671",
            "15f97cc51d594cca91dc43cbf019ffbc",
            "23e7ec609ed649e29f2c274bd76ee3dd",
            "47af905082094cd5b8a4cb4ab02ec431",
            "87aa955f31054e7da3fc1c93a8e1f335",
            "2f79b8377db841b5b14650ed14d7c5cb",
            "0560fb1045034e4b865a199dc0fba636",
            "e35861641d664e2ea8140ff988b65576",
            "4d683f5e6ccb4328bfd33829e05e2e35",
            "8eb84c34c1a54dad903371885051bef2",
            "424d7efa1e1d4c79a5a9e1e0eea97bc3",
            "0d6619a581884191a205c9e1b91b3790",
            "035553232bbc40c789c35bdcd78d7b88",
            "6648bcb6b46e4dc893654f139a7b73df",
            "d4302a261e334336b71459e74fee95a4",
            "5ae44fb9f67b40bb8261defbc07bf689",
            "5097652e46cf4d1d88933903e37387dd",
            "82e9918bb5b648058fe32b19b0ab7059",
            "28913620d1dc406db67ff7876db5d414",
            "2e5b502d9c0e47449a6e7b5095d5b6ec",
            "044439bda84b4d24935a46be5c14ca02",
            "3aa9793c2771435b892c70a5ca86a372",
            "490c7d65abaf46a1a6f781395f846b83",
            "b3ad1dfdecf649988c4060e76f0c9164",
            "6f0bd0ab209348d2a76ae70cfbfa47ff",
            "95dc3afa44174e9f8e715dab0a3dfd7d",
            "d2f7362dee2b4100930a7a1f288e649e",
            "c92364fa157f4212a9a9811925605382",
            "aec5035eeab04627b3d61c05bf53ef4f",
            "035f91d8fd1d4ff6932f9d01aa334f3a",
            "8a56ba2f8d384c0fb285ac9cf7b5e421",
            "675520bc1a7e4aca9e17f7410d6380cf",
            "9b19f80d8f5648b9b575515d2f8085f8",
            "c0065e721652472996f40eb47071589c",
            "b236adc069d049c288d81702cc0dd62c",
            "5eefa033732941b39bf3bfa62fd9185e",
            "5aefc7d586ae4be4aa33c1383f494b9f",
            "5e0c000321a64c28a81a1e167d88bd22",
            "438661c89c034656b86e936360474b24",
            "ed1fca3c73ad446db422e30f5ec44b0e",
            "4421eb7516c04af1972c6f5df5315bc4",
            "6d52bfaf6be54d90a53e1fb465dfaf7d",
            "3cd65d1d3cd0438ea94b8c4d964bc65c",
            "a4653a04856c47a0b1907d864e3f1a15",
            "02e9029cbe8a4db0b6ef00c4df0ae302",
            "258629893fa14d178577ee19efdff31e",
            "fe82872822b749ae87fac7eb4df0791e",
            "07655ba9152647df80ad1efe4b117135",
            "b6e87d03766a4185ad2c4d716aa456d7",
            "c6f304a0747d40fea9571f99f5289986",
            "5722085f090c4851a1cde4daf7db77df",
            "7aed32af8b134b56a041ebb25c32640c",
            "a723ce7408e14b63b6d4311051dca322",
            "3a9c42437ab34710a3fd3a75cf9cfac4",
            "80a0d8b6e16b4ceb98bb8911b0fa596c",
            "9310b29cec49404b8dfc9feb8e5bac9f",
            "44341f0cb29440a2bef7f711517a01ff",
            "9739202e0849427d9fe61210e231837c",
            "c43c9d3bbacf478b9fafc076ea58ad29",
            "abfa8dc54e654a61b93ec9a15f5fe67e",
            "979514f924c6441098f7b7231ae15900",
            "bbef9cf5cf2d42adb650caba73919e06",
            "3b8da849443f401bb51a038f5bb82ad9",
            "36f417b9e7e247b68e3bb18519af98b4",
            "71643356b8954af5ab6cdf03df2825e3",
            "8d50b1a8e0ce4d018fe4a51240ddb35d",
            "654d72723ed8474ca360102e896331d5",
            "049d95dcfbb34e84a0060919fdb8f454",
            "54955fa5560041c09f847a3afb39eecd",
            "34b2c78ef1254853a377efc6fead2e95",
            "4eda8d394bff4fbf98bc086737c75219",
            "4ca134b9e1df4136bd0d2660a82960cf",
            "87cf68c4e8a245c686fbbe439f176b87",
            "6009ded338de4e5b9a204e6f1243bf05",
            "f01a1f50e0a74faaacc35695590cea30",
            "a76a4846aa11422785c1d0218c94b827",
            "373e3dd821954f33becb388c82ffebc2",
            "9f532b8a64b3410f9a2e2a99755dac55",
            "b457e104ad194032ba15070b89d42e6e",
            "81fc3a7b94554a1980724ac6092fc88a",
            "68908006e8eb4b31a55d1c0be51453bd",
            "8f5c49525abe4d7a9ea746db18135f26",
            "70eb5ab30ffb4b5bbe58832c6386a536",
            "970d8a7e2b5c47a5bff8a036cadc9b84",
            "3ad7904ba48048bfa4b7a866cf4aa4a6",
            "a20c551e949842f881c6def753eb81ed",
            "67e1192ed6774aa9bb17f1d5a27695f9",
            "5aea05cbd78843bcb2a9d3df9e3abefd",
            "4693d306ecaf44f2b6b505ca072e22bb",
            "2e46fda9b283487ba4f118bad5a880c6",
            "55a8b90a0a6c44eda0bedd43fda69c41",
            "a7e64bcbd09644a198b9f1c7d8a8d1c6",
            "87a7b1169e1f404d81fddc56c0ba2145",
            "921d621e89a64e1aab62397758e26592",
            "da9024d63c56460b9ca061d5cd1bb985",
            "503e7b032b3d44d49e15587060b25e56",
            "1361830025974670a174df70957feabc",
            "6adb0fc2977b41e7bce4e81909c6c931",
            "ab9b58483e0145aab2f22a8bbf0422cf",
            "6725fd421a9344feb552ee1a1ce84dda",
            "0d712617055b45a3b6f5783dfe6a5842",
            "1c5fdfd620eb47c28dcb91ff04ea6155",
            "db2185de343a4f76a2b2ecfad4e658ad",
            "bb1efececaef471c90c3bc9cc2fb5ac7",
            "7a49920285474268b1cb3f57e73a450e",
            "b0e5dea19289434ebe98002e3cfe6086",
            "92a8cbc6f6344e49a455c9e3df2c552f",
            "b41986dd9910458e95ddfff0b1a508d1",
            "f2fb2d0dfed54272abbc0560a467c97e",
            "08c1e9701d0b4f2e8b34027af81ab586",
            "1ea2399f27404d5cbfffd68efbd472fc",
            "affc022e069a41af877cf9fbe3889012",
            "65490339b12e47d6b35cbf4a16d1bfeb",
            "10247683189c43b6abf3df0b7818bcd9",
            "10b0f64c86714778919d55c643550ff5",
            "a702202230484af5b32a4653f0eac288",
            "5e38b9f21ce04bcc820f711c9c47678d",
            "2771553d801f4961ad94344e2d5caacd",
            "134808b58f1f42b09c4b2353a94bbb0e",
            "02bda666a850468086acea36156397c7",
            "9abed88d016f4822bf19e71dcf997571",
            "6ea72db4ae8b45ec96508a51c21b6974",
            "7baafb061feb455e9b37622dc9a4c724",
            "ba06f72e44694ecd9fa51e984b4dc8bf",
            "136c4f60a8734c578129fd843ee7ab5f",
            "28f475b19b08458c81ee0cfb11c9d9c3",
            "604fd938ec7d41f285e1f1b9cb9c6eac",
            "07bb79027e20401e84d02a33a628b397",
            "288ab1d98c7a4e21af429773a9fe3534",
            "19a6a91b0d4e46d9be72aee530a974ce",
            "0de2ddf45f754c5991a62ae8e822c4b7",
            "a6fb10bec45f4f1a9243b466eb95c017",
            "44ce5ef7a8af4fb291da012fa53e0c5a",
            "9c40cc6348cb4bcfb59e0457399cd72b",
            "3f9455a7a52947638545cff45b1e807d",
            "22550ebc70ef4671a65bb1a041c9def7",
            "67f022dd80234c08849906615a1191dc",
            "2e5e169b1ad64407ad8c3494a70b314f",
            "277e7a95b41447b4a52824c212e6fa7c",
            "d07c7bcf6a934fae9e015be66a1f860d",
            "c5e484430b0843689d7cfb434d0aa8da",
            "814e2827e8d647069f05c5b4c89deb52",
            "0c8b616aecfd4e5e80a0b7c3aabd290f",
            "e0f4261c913d42c9a7dcdf79a9914d4a",
            "80a819740bb44d589858d4780b100255",
            "5caf7d1fdd564dc2bebe48dd918d9c8f",
            "10ab820d989c44b98a8bde85780c3deb",
            "7e787283e4434da6b5d3f9245745547c",
            "b8c86419aa4f43a3a0c9443f23298c0a",
            "0270acbb7ed94626adc932afa0655eaa",
            "ab0b7e4f05b24205b5e4b9e975cb8e71",
            "70c85ee15c0c4427b6538acbbd0de481",
            "b38c3345647c4db68a2321e3a4d9e215",
            "8c7b852936ca400aa04ec3f95e9afcb3",
            "3099fea4c655407582c196176cc2108c",
            "a5cb3ea273f9454fbb9dcd8877f2aa33",
            "b4a722f06b614e9cbb259c8fa1e9f664",
            "228014c8ccd543a6af4c554cf60137bf",
            "6e7ea147348f40c8acc919af41047189",
            "7c315c5b62e14d2c9af6fecf536d8df5",
            "a9e1b08f5ff24e1b8d652cd9ad649b54",
            "df097748d93e4254be82e6dae9696167",
            "ac30029d30c34fd58a7f3d1826d94d6b",
            "6daac3cee4b9409cba48efa0d06bee24",
            "db45da82b3594a1db11322289253a132",
            "d4891374cfde42adac3f2218b879f082",
            "2a009696a36748b2937ac6746460483a",
            "979c7269c8394082b277435040052f45",
            "42ff3dacbeb34fc79e60d382c93180d6",
            "d5156d7ec0e14a60bc67ac5e3c5b32a6",
            "e82400379100428a915968d7ba060fd5",
            "f25f7aabffb046a388ba71ad7c3ab7de",
            "5088dea18c1146d8841e50e76697b7e5",
            "e36d59055aee4a48b521109b96c9faff",
            "d4b061b8a44646a8b4ccc4839fe769a8",
            "354425d2d3cc4be4891499c8c252e585",
            "84c2e850cd944480bf1cc9bd79ca40f4",
            "ecb0caf0ebd2458789aee04fd0468723",
            "0689a7b924674988a587d498cb946549",
            "ea131342791043d48673da5ccb559c26",
            "6936e031b7f74f45998232f819666b45",
            "ae8efd2c29bb4008a13be5b0483928b4",
            "7728374b25ec4b45b3d9171e69173bf5",
            "a7456e34baef4c89979963a8e61b98e4",
            "1db1f8a2985947639120d9bccdf3208e",
            "ac7a77f2fd1b4cdaab3ae8ff2bb8b963",
            "2486dff82a4b41809b4a8ac2569b7e10",
            "bcb064131d464033be2a95b5df8e2c82",
            "4614b06d5a974ecf86238f938e58bccb",
            "7d3a28c174ff4c2791039495b544b507",
            "58a114346ac44a8c992da25fb7c721f8",
            "58e96bfc8f6a449eafa644edf4b75228",
            "3bafea3ba4b347e186da01e279f41084",
            "d8fa48e20376478e9e89438aa57de80d",
            "5d9aaed3cf2e451595690e72ed4c2495",
            "ab7aabf047e34d5899bc3dcfa972f7fd",
            "8a006c7b0f0d431c8c024aad2ea8e427",
            "cc122dc799da42948360712d0b809ed9",
            "d3186548246149feaa9228782d7adaab",
            "96660986fcd1451d8565790e961277b5",
            "e6d820247bfc42acbff367b5794b6655",
            "b7ff8b76997a4235a3205fac9c531502",
            "00e7a13db6174f3182a898345dd1d38d",
            "adcdbc5f4ee045a2bc8c7b3b7f4cac5b",
            "f4920d0dce6c4d2b8528f8b098722cfc",
            "51f3bf496ca146b18b93fb58846f591e",
            "78672ae9cde346c09d3a7f7701dfd151",
            "a866149ec74144b385f55fdf7eb105a8",
            "26b866aceb8342b5830ca76815d6fa73",
            "861f32fe95c04198b9dd81c8fa1fbacb",
            "963f20a5be194830b08bb215b9ee97a1",
            "ddeba74ba1ba4dd1a1c4f47c358eeae5",
            "7d8c57299000460680a250aa23c7b2cd",
            "4aced1e370fc4b2c88d4283bcbe97ebf",
            "44a36016b20647efa05d9aee60aaedb8",
            "9efd3613e80e4aa78248e979a44bd88b",
            "288cff3f48ab4cf2b27cfc5c37c716f7",
            "179d01e55e5142acaddfff4b1975860e",
            "db881594d4b9483bab4d09b536a6602a",
            "1b4e9bc9196d4c7e98005bc5de040202",
            "8754e0214d6c495ca4f7e75d11738f73",
            "3fbb5b3e332d4444ab7623422347d7ce",
            "85520aaa9c464b7f927c043a323e45f3",
            "bd18214cd9624c0c97d6e5d73bd84b9e",
            "67a7e78833b141778d290e31b5006277",
            "67139d0ae82f4ca7be9506a5bdd2f603",
            "73b4b4d832f446259513cff2c764a544",
            "442b0033175d4d38ac1633814f8919b3",
            "08664ffa89a04048aa7a6eecf55169a8",
            "d89e128b65424ced9d2ea19e42facb67",
            "6c135337a5db4da8867d9c9bb1bad8b2",
            "63b03fea35f64af49787d6253d1e8aa2",
            "5408ba6a5d5e4d3e8371e6d8a156aae6",
            "dce0aaa1839b493a8bfa93820f85bf0b",
            "aa01e299117447e692e719426dc7f53e",
            "1183926027a04b39a81c603be4b7860d",
            "edee1e5620214adcb701876812fd55df",
            "2ddca395a3ea42c6a422cea781e4262f",
            "8fc852abdc384fbfada6505cd96ea825",
            "239d49bd1d6c4cc2a95548c5634a3b9a",
            "40eaa223a6ef48628829d45f576c5293",
            "8a9155146377424cbc114127816ba8ba",
            "beda87842b744bd984629e34e8fae0b5",
            "1a4e7e57b95a41869ab5642ed0e6571c",
            "25b3cab0e79a4762a8cc170309e7489e",
            "9f2c5a74769249b997c1558bdf4c94ce",
            "71b773f3ead4430cbfac09127b801c6a",
            "d6e0253023874b6faa6bf6664e55e160",
            "5031681c504544388ece6bbfb3b5ad69",
            "34d4e2de5bea4b7f89d44a4e7fcedbb0",
            "1fd81f69f417476a95e4594e2c8b605d"
          ]
        },
        "id": "o3ebde8VWKdi",
        "outputId": "7c60f8aa-67e6-4343-c72e-d6e356d60e6c"
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "GPU available: True, used: True\n",
            "TPU available: False, using: 0 TPU cores\n",
            "IPU available: False, using: 0 IPUs\n",
            "HPU available: False, using: 0 HPUs\n",
            "LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0]\n",
            "\n",
            "  | Name | Type   | Params\n",
            "--------------------------------\n",
            "0 | fc1  | Linear | 30    \n",
            "1 | func | ReLU   | 0     \n",
            "2 | fc2  | Linear | 11    \n",
            "--------------------------------\n",
            "41        Trainable params\n",
            "0         Non-trainable params\n",
            "41        Total params\n",
            "0.000     Total estimated model params size (MB)\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Sanity Checking: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "1657a223e5524ca682ea081b9e4addea"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 0: val loss = 0.7213451266288757 val acc = 0.3333333432674408\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Training: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "a4fb1b2e0f8b4346bbde1b949dbce0fd"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "3e63509c89304bccb2c7371ec5e7ca62"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 1: val loss = 0.7164624333381653 val acc = 0.3333333432674408\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "e6c4eb3c595c43ef9722654dcfabfcc6"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 2: val loss = 0.7117107510566711 val acc = 0.3333333432674408\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "69eedcfbe5c14a4cbe119364ce973690"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 3: val loss = 0.7070826292037964 val acc = 0.3333333432674408\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "7287a9afffb5470c920734840c5d72fe"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 4: val loss = 0.7025845050811768 val acc = 0.3333333432674408\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "08a690202bbe48bf9434a3354cb560c1"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 5: val loss = 0.6982313990592957 val acc = 0.2666666805744171\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "e2900fe753754ede94abc1847dda4d5c"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 6: val loss = 0.6939730644226074 val acc = 0.2666666805744171\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "0d2b1608b987468791e1a7ffedfd0079"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 7: val loss = 0.6897947192192078 val acc = 0.2666666805744171\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "b650b7b4420541298ea255d741f8a518"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 8: val loss = 0.6857149004936218 val acc = 0.2666666805744171\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "8eb84c34c1a54dad903371885051bef2"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 9: val loss = 0.6817294359207153 val acc = 0.46666669845581055\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "044439bda84b4d24935a46be5c14ca02"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 10: val loss = 0.6778346300125122 val acc = 0.46666669845581055\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "675520bc1a7e4aca9e17f7410d6380cf"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 11: val loss = 0.6740307807922363 val acc = 0.46666669845581055\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "3cd65d1d3cd0438ea94b8c4d964bc65c"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 12: val loss = 0.6703100204467773 val acc = 0.5333333611488342\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "3a9c42437ab34710a3fd3a75cf9cfac4"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 13: val loss = 0.6666661500930786 val acc = 0.5333333611488342\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "71643356b8954af5ab6cdf03df2825e3"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 14: val loss = 0.663104772567749 val acc = 0.6000000238418579\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "a76a4846aa11422785c1d0218c94b827"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 15: val loss = 0.6596227884292603 val acc = 0.6000000238418579\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "67e1192ed6774aa9bb17f1d5a27695f9"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 16: val loss = 0.6562108993530273 val acc = 0.6000000238418579\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "6adb0fc2977b41e7bce4e81909c6c931"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 17: val loss = 0.652866542339325 val acc = 0.6666666865348816\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "f2fb2d0dfed54272abbc0560a467c97e"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 18: val loss = 0.649587094783783 val acc = 0.6666666865348816\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "02bda666a850468086acea36156397c7"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 19: val loss = 0.6463660597801208 val acc = 0.7333333492279053\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "0de2ddf45f754c5991a62ae8e822c4b7"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 20: val loss = 0.6432054042816162 val acc = 0.7333333492279053\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "814e2827e8d647069f05c5b4c89deb52"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 21: val loss = 0.6401029229164124 val acc = 0.7333333492279053\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "b38c3345647c4db68a2321e3a4d9e215"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 22: val loss = 0.6370567679405212 val acc = 0.7333333492279053\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "6daac3cee4b9409cba48efa0d06bee24"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 23: val loss = 0.6340654492378235 val acc = 0.7333333492279053\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "d4b061b8a44646a8b4ccc4839fe769a8"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 24: val loss = 0.6311267018318176 val acc = 0.7333333492279053\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "ac7a77f2fd1b4cdaab3ae8ff2bb8b963"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 25: val loss = 0.6282366514205933 val acc = 0.7333333492279053\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "8a006c7b0f0d431c8c024aad2ea8e427"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 26: val loss = 0.6253498792648315 val acc = 0.7333333492279053\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "a866149ec74144b385f55fdf7eb105a8"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 27: val loss = 0.6225143671035767 val acc = 0.7333333492279053\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "db881594d4b9483bab4d09b536a6602a"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 28: val loss = 0.6197248101234436 val acc = 0.7333333492279053\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "d89e128b65424ced9d2ea19e42facb67"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 29: val loss = 0.6169812679290771 val acc = 0.7333333492279053\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "Validation: 0it [00:00, ?it/s]"
            ],
            "application/vnd.jupyter.widget-view+json": {
              "version_major": 2,
              "version_minor": 0,
              "model_id": "40eaa223a6ef48628829d45f576c5293"
            }
          },
          "metadata": {}
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Epoch 30: val loss = 0.6142613887786865 val acc = 0.8000000715255737\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "iC7doHoWToPg"
      },
      "source": [
        "## Takeaways\n",
        "\n",
        "* PyTorch allows you to operate on tensors at low level, you have most flexibility.\n",
        "* There are convenient tools to work with data, such as Datasets and Dataloaders.\n",
        "* You can define neural network architectures using `Sequential` syntax, or inheriting a class from `torch.nn.Module`\n",
        "* For even simpler approach to defining and training a network - look into PyTorch Lightning"
      ]
    }
  ],
  "metadata": {
    "accelerator": "GPU",
    "celltoolbar": "Slideshow",
    "colab": {
      "collapsed_sections": [],
      "name": "IntroPyTorch.ipynb",
      "provenance": []
    },
    "interpreter": {
      "hash": "0cb620c6d4b9f7a635928804c26cf22403d89d98d79684e4529119355ee6d5a5"
    },
    "kernelspec": {
      "display_name": "Python 3.8.12 64-bit (conda)",
      "name": "python3"
    },
    "language_info": {
      "codemirror_mode": {
        "name": "ipython",
        "version": 3
      },
      "file_extension": ".py",
      "mimetype": "text/x-python",
      "name": "python",
      "nbconvert_exporter": "python",
      "pygments_lexer": "ipython3",
      "version": "3.8.12"
    },
    "livereveal": {
      "start_slideshow_at": "selected"
    },
    "widgets": {
      "application/vnd.jupyter.widget-state+json": {
        "1657a223e5524ca682ea081b9e4addea": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_4f111fbdbc3440f783adc3df3df46494",
              "IPY_MODEL_cc048e2c91ce48258934ef577cf229d1",
              "IPY_MODEL_d3c01678943341c5b814430145692a69"
            ],
            "layout": "IPY_MODEL_9b55455cc9b541ef9634be2d790bb831"
          }
        },
        "4f111fbdbc3440f783adc3df3df46494": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_15d7c09876074047afac1e41cb9ac121",
            "placeholder": "​",
            "style": "IPY_MODEL_90137ba0ff814f71ad964f45d704ee89",
            "value": "Sanity Checking DataLoader 0: 100%"
          }
        },
        "cc048e2c91ce48258934ef577cf229d1": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_0919c9545ef64ed1a65f3f489d51cccc",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_12cad77b8027415b82937ad33f793a63",
            "value": 1
          }
        },
        "d3c01678943341c5b814430145692a69": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_25ff491870eb4bf6ad4a320e5c99bd31",
            "placeholder": "​",
            "style": "IPY_MODEL_238a42e032c34b9183e1e6a75f886da0",
            "value": " 1/1 [00:00&lt;00:00, 273.19it/s]"
          }
        },
        "9b55455cc9b541ef9634be2d790bb831": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "15d7c09876074047afac1e41cb9ac121": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "90137ba0ff814f71ad964f45d704ee89": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "0919c9545ef64ed1a65f3f489d51cccc": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "12cad77b8027415b82937ad33f793a63": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "25ff491870eb4bf6ad4a320e5c99bd31": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "238a42e032c34b9183e1e6a75f886da0": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "a4fb1b2e0f8b4346bbde1b949dbce0fd": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_18876b0e4f0f4b21ad1802f36637c067",
              "IPY_MODEL_92ef8d6e24604b2f895e3876dc9996ee",
              "IPY_MODEL_d4bc1057a59c4666a7dc0f9627c45901"
            ],
            "layout": "IPY_MODEL_3355e659c40e4e42bbad6c8690f5055e"
          }
        },
        "18876b0e4f0f4b21ad1802f36637c067": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_0ab539031d80478685164ce470246d57",
            "placeholder": "​",
            "style": "IPY_MODEL_271fdffaef854a67b294c0ccdfb6fe91",
            "value": "Epoch 29: 100%"
          }
        },
        "92ef8d6e24604b2f895e3876dc9996ee": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "success",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_0bd01bf4a9954fe2ba2760d10b9d7971",
            "max": 6,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_bd5250b6001c4cd282a25d498ee4e673",
            "value": 6
          }
        },
        "d4bc1057a59c4666a7dc0f9627c45901": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_21538a0928e04ca08562dda0322385a1",
            "placeholder": "​",
            "style": "IPY_MODEL_5301b071e422430e9bff6cd23c2853b5",
            "value": " 6/6 [00:00&lt;00:00, 44.67it/s, loss=0.597, v_num=18]"
          }
        },
        "3355e659c40e4e42bbad6c8690f5055e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "0ab539031d80478685164ce470246d57": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "271fdffaef854a67b294c0ccdfb6fe91": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "0bd01bf4a9954fe2ba2760d10b9d7971": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "bd5250b6001c4cd282a25d498ee4e673": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "21538a0928e04ca08562dda0322385a1": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "5301b071e422430e9bff6cd23c2853b5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "3e63509c89304bccb2c7371ec5e7ca62": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_ff10f2e47185425eaa1229be76092ee5",
              "IPY_MODEL_03cbfa5d29d548498035ba7bf7e0b659",
              "IPY_MODEL_561c5a5b02894df2a66b2991877e1231"
            ],
            "layout": "IPY_MODEL_569851b1958f49e281770b65bf78b60a"
          }
        },
        "ff10f2e47185425eaa1229be76092ee5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_2b49a1491afb4946975395080b9117e9",
            "placeholder": "​",
            "style": "IPY_MODEL_79737a473e0b4b59bb4d6f190d92b94c",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "03cbfa5d29d548498035ba7bf7e0b659": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d8a3af0177fc4707b928629952396ad5",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_34852db50a91487795451f76b57da6b2",
            "value": 1
          }
        },
        "561c5a5b02894df2a66b2991877e1231": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_046c75ea1598416497c2ef218d1f268a",
            "placeholder": "​",
            "style": "IPY_MODEL_16e49dd0c2094a87a398416bac89ef69",
            "value": " 1/1 [00:00&lt;00:00, 73.83it/s]"
          }
        },
        "569851b1958f49e281770b65bf78b60a": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "2b49a1491afb4946975395080b9117e9": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "79737a473e0b4b59bb4d6f190d92b94c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "d8a3af0177fc4707b928629952396ad5": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "34852db50a91487795451f76b57da6b2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "046c75ea1598416497c2ef218d1f268a": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "16e49dd0c2094a87a398416bac89ef69": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "e6c4eb3c595c43ef9722654dcfabfcc6": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_62f1b983740e47cd8664eccafc926e32",
              "IPY_MODEL_9861f59fd71a4e3c879858ef8b4b40fb",
              "IPY_MODEL_d9960d4519ec42bcb8678359b278c7b5"
            ],
            "layout": "IPY_MODEL_118e90e145994312897584085642c03b"
          }
        },
        "62f1b983740e47cd8664eccafc926e32": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_db156fc5cbfd426e8460232b8f760733",
            "placeholder": "​",
            "style": "IPY_MODEL_e68df50870c5469a9dc86346d7ad9a4e",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "9861f59fd71a4e3c879858ef8b4b40fb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_c89c5ec1ca1549cbbc7dd57b3672d74e",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_84e423587f4244938844cd74d2f86dc0",
            "value": 1
          }
        },
        "d9960d4519ec42bcb8678359b278c7b5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_a31f6ff7fbc54df5bd1745816b2176f8",
            "placeholder": "​",
            "style": "IPY_MODEL_d6d02c0963c54a6bbbd6753f3c3e6503",
            "value": " 1/1 [00:00&lt;00:00, 97.96it/s]"
          }
        },
        "118e90e145994312897584085642c03b": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "db156fc5cbfd426e8460232b8f760733": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "e68df50870c5469a9dc86346d7ad9a4e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "c89c5ec1ca1549cbbc7dd57b3672d74e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "84e423587f4244938844cd74d2f86dc0": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "a31f6ff7fbc54df5bd1745816b2176f8": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "d6d02c0963c54a6bbbd6753f3c3e6503": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "69eedcfbe5c14a4cbe119364ce973690": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_72eb0dd423f4486b9a63f100670e03a5",
              "IPY_MODEL_4b7e9cfd822d48db848319a78548b0db",
              "IPY_MODEL_a52a0bc61ed14e0d93f0c4768687fee8"
            ],
            "layout": "IPY_MODEL_d1c60311d2bc4f4c826da5c7a634202d"
          }
        },
        "72eb0dd423f4486b9a63f100670e03a5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_08426ffc99c44d6290ef9cb9363a5737",
            "placeholder": "​",
            "style": "IPY_MODEL_161c5cea83dc42f6b87c904303dad688",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "4b7e9cfd822d48db848319a78548b0db": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_79c04563af9646dd9a7e82db11894c24",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_235b2edd90bf4d1383b5a0d49905a241",
            "value": 1
          }
        },
        "a52a0bc61ed14e0d93f0c4768687fee8": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_24ead65d14c54fbcb174b06b7dadbcc5",
            "placeholder": "​",
            "style": "IPY_MODEL_20b85c48964d4c85890f8a0ebc04dd1d",
            "value": " 1/1 [00:00&lt;00:00, 108.34it/s]"
          }
        },
        "d1c60311d2bc4f4c826da5c7a634202d": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "08426ffc99c44d6290ef9cb9363a5737": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "161c5cea83dc42f6b87c904303dad688": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "79c04563af9646dd9a7e82db11894c24": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "235b2edd90bf4d1383b5a0d49905a241": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "24ead65d14c54fbcb174b06b7dadbcc5": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "20b85c48964d4c85890f8a0ebc04dd1d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "7287a9afffb5470c920734840c5d72fe": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_ae3232c87db9469fa19cb59f78be2f57",
              "IPY_MODEL_e2a292f657c342569a080a3d9e25852b",
              "IPY_MODEL_f56858c5843d446286d416e9bbc7e7c8"
            ],
            "layout": "IPY_MODEL_6ddb0e10ea78488aa8358ec3a7bb0780"
          }
        },
        "ae3232c87db9469fa19cb59f78be2f57": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_df7172162b6542f08662614b084d7521",
            "placeholder": "​",
            "style": "IPY_MODEL_ca6221d153a94b4898e5a1b5043b843d",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "e2a292f657c342569a080a3d9e25852b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_54e9275a7f074eeca9a5995653d16036",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_4454290d993f4350a6dc4e464c61c0a9",
            "value": 1
          }
        },
        "f56858c5843d446286d416e9bbc7e7c8": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_6e5f99b5aec44fff9d4cecb28dd59188",
            "placeholder": "​",
            "style": "IPY_MODEL_39ae0b5e8b8a41b79ea1a209f2aacc87",
            "value": " 1/1 [00:00&lt;00:00, 126.25it/s]"
          }
        },
        "6ddb0e10ea78488aa8358ec3a7bb0780": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "df7172162b6542f08662614b084d7521": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "ca6221d153a94b4898e5a1b5043b843d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "54e9275a7f074eeca9a5995653d16036": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "4454290d993f4350a6dc4e464c61c0a9": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "6e5f99b5aec44fff9d4cecb28dd59188": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "39ae0b5e8b8a41b79ea1a209f2aacc87": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "08a690202bbe48bf9434a3354cb560c1": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_7311cc83255f46ffa31f461c485111b5",
              "IPY_MODEL_6f484c87ff3e4582aad771a703151f2b",
              "IPY_MODEL_ab9c536f94b84922877071f760111f55"
            ],
            "layout": "IPY_MODEL_427f04eec07f4d94a010664b12139f0f"
          }
        },
        "7311cc83255f46ffa31f461c485111b5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_cd7f66fdfe224994a31a3c985cb7a1de",
            "placeholder": "​",
            "style": "IPY_MODEL_b74e5502e4e54847b1191b7b0304f66a",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "6f484c87ff3e4582aad771a703151f2b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_dbfcbe2df4f74df594606dd0bb6873b4",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_ac62ad773e7a4694b57dd8c71b81f23d",
            "value": 1
          }
        },
        "ab9c536f94b84922877071f760111f55": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_f20824d8dfc84640bee1cdc9b7277caa",
            "placeholder": "​",
            "style": "IPY_MODEL_fd9a33d8f6ad459594d9939fd635730c",
            "value": " 1/1 [00:00&lt;00:00, 105.91it/s]"
          }
        },
        "427f04eec07f4d94a010664b12139f0f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "cd7f66fdfe224994a31a3c985cb7a1de": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "b74e5502e4e54847b1191b7b0304f66a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "dbfcbe2df4f74df594606dd0bb6873b4": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "ac62ad773e7a4694b57dd8c71b81f23d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "f20824d8dfc84640bee1cdc9b7277caa": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "fd9a33d8f6ad459594d9939fd635730c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "e2900fe753754ede94abc1847dda4d5c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_0c1832e2d1ab4ca4a882d76f1d896c02",
              "IPY_MODEL_10a5f4a004bc4a81a485604f67bab642",
              "IPY_MODEL_fe260f7a9c66497cad723b44c1addbe7"
            ],
            "layout": "IPY_MODEL_ef7d39cc71074a7faa299da2621abe03"
          }
        },
        "0c1832e2d1ab4ca4a882d76f1d896c02": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_3f58e2aea843451b83e3aba8c1eefc74",
            "placeholder": "​",
            "style": "IPY_MODEL_fd38fbd015e6471392cfee4464e6370e",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "10a5f4a004bc4a81a485604f67bab642": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_a95c45bcb67f4a569fb9f88af8108fde",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_bf3bf33f0c474b54a4b472a4a7626da7",
            "value": 1
          }
        },
        "fe260f7a9c66497cad723b44c1addbe7": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_afcc785f069b433ba8747b01e5840763",
            "placeholder": "​",
            "style": "IPY_MODEL_ec27c6b290be4adc8d2df034fd3bb143",
            "value": " 1/1 [00:00&lt;00:00, 110.76it/s]"
          }
        },
        "ef7d39cc71074a7faa299da2621abe03": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "3f58e2aea843451b83e3aba8c1eefc74": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "fd38fbd015e6471392cfee4464e6370e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "a95c45bcb67f4a569fb9f88af8108fde": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "bf3bf33f0c474b54a4b472a4a7626da7": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "afcc785f069b433ba8747b01e5840763": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "ec27c6b290be4adc8d2df034fd3bb143": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "0d2b1608b987468791e1a7ffedfd0079": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_016a5fc3757c480b9c905867c4892864",
              "IPY_MODEL_c7c7cc7d1c0647abb11ade78ef451007",
              "IPY_MODEL_d0e4462fee034a67b3682e27d5cb6e27"
            ],
            "layout": "IPY_MODEL_ac3a80de351440e7a279f3efce37e430"
          }
        },
        "016a5fc3757c480b9c905867c4892864": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d6204036abba495785a3674ea841746c",
            "placeholder": "​",
            "style": "IPY_MODEL_3df8a54d12604c1ebe7229f88d5811bf",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "c7c7cc7d1c0647abb11ade78ef451007": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_5236935ed5874a0986f953ee21477be9",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_1355273e058041efa299727d17949855",
            "value": 1
          }
        },
        "d0e4462fee034a67b3682e27d5cb6e27": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_68acf21436374d5eb393ada1b2298e28",
            "placeholder": "​",
            "style": "IPY_MODEL_57d592b9768545869080fc2505e5a770",
            "value": " 1/1 [00:00&lt;00:00, 97.42it/s]"
          }
        },
        "ac3a80de351440e7a279f3efce37e430": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "d6204036abba495785a3674ea841746c": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "3df8a54d12604c1ebe7229f88d5811bf": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "5236935ed5874a0986f953ee21477be9": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "1355273e058041efa299727d17949855": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "68acf21436374d5eb393ada1b2298e28": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "57d592b9768545869080fc2505e5a770": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "b650b7b4420541298ea255d741f8a518": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_3d0949a3f0504bf0802082ec86ce8e17",
              "IPY_MODEL_3f71570951c94959ba0eea6692b2d671",
              "IPY_MODEL_15f97cc51d594cca91dc43cbf019ffbc"
            ],
            "layout": "IPY_MODEL_23e7ec609ed649e29f2c274bd76ee3dd"
          }
        },
        "3d0949a3f0504bf0802082ec86ce8e17": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_47af905082094cd5b8a4cb4ab02ec431",
            "placeholder": "​",
            "style": "IPY_MODEL_87aa955f31054e7da3fc1c93a8e1f335",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "3f71570951c94959ba0eea6692b2d671": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_2f79b8377db841b5b14650ed14d7c5cb",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_0560fb1045034e4b865a199dc0fba636",
            "value": 1
          }
        },
        "15f97cc51d594cca91dc43cbf019ffbc": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_e35861641d664e2ea8140ff988b65576",
            "placeholder": "​",
            "style": "IPY_MODEL_4d683f5e6ccb4328bfd33829e05e2e35",
            "value": " 1/1 [00:00&lt;00:00, 101.72it/s]"
          }
        },
        "23e7ec609ed649e29f2c274bd76ee3dd": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "47af905082094cd5b8a4cb4ab02ec431": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "87aa955f31054e7da3fc1c93a8e1f335": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "2f79b8377db841b5b14650ed14d7c5cb": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "0560fb1045034e4b865a199dc0fba636": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "e35861641d664e2ea8140ff988b65576": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "4d683f5e6ccb4328bfd33829e05e2e35": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "8eb84c34c1a54dad903371885051bef2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_424d7efa1e1d4c79a5a9e1e0eea97bc3",
              "IPY_MODEL_0d6619a581884191a205c9e1b91b3790",
              "IPY_MODEL_035553232bbc40c789c35bdcd78d7b88"
            ],
            "layout": "IPY_MODEL_6648bcb6b46e4dc893654f139a7b73df"
          }
        },
        "424d7efa1e1d4c79a5a9e1e0eea97bc3": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d4302a261e334336b71459e74fee95a4",
            "placeholder": "​",
            "style": "IPY_MODEL_5ae44fb9f67b40bb8261defbc07bf689",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "0d6619a581884191a205c9e1b91b3790": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_5097652e46cf4d1d88933903e37387dd",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_82e9918bb5b648058fe32b19b0ab7059",
            "value": 1
          }
        },
        "035553232bbc40c789c35bdcd78d7b88": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_28913620d1dc406db67ff7876db5d414",
            "placeholder": "​",
            "style": "IPY_MODEL_2e5b502d9c0e47449a6e7b5095d5b6ec",
            "value": " 1/1 [00:00&lt;00:00, 91.51it/s]"
          }
        },
        "6648bcb6b46e4dc893654f139a7b73df": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "d4302a261e334336b71459e74fee95a4": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "5ae44fb9f67b40bb8261defbc07bf689": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "5097652e46cf4d1d88933903e37387dd": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "82e9918bb5b648058fe32b19b0ab7059": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "28913620d1dc406db67ff7876db5d414": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "2e5b502d9c0e47449a6e7b5095d5b6ec": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "044439bda84b4d24935a46be5c14ca02": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_3aa9793c2771435b892c70a5ca86a372",
              "IPY_MODEL_490c7d65abaf46a1a6f781395f846b83",
              "IPY_MODEL_b3ad1dfdecf649988c4060e76f0c9164"
            ],
            "layout": "IPY_MODEL_6f0bd0ab209348d2a76ae70cfbfa47ff"
          }
        },
        "3aa9793c2771435b892c70a5ca86a372": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_95dc3afa44174e9f8e715dab0a3dfd7d",
            "placeholder": "​",
            "style": "IPY_MODEL_d2f7362dee2b4100930a7a1f288e649e",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "490c7d65abaf46a1a6f781395f846b83": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_c92364fa157f4212a9a9811925605382",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_aec5035eeab04627b3d61c05bf53ef4f",
            "value": 1
          }
        },
        "b3ad1dfdecf649988c4060e76f0c9164": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_035f91d8fd1d4ff6932f9d01aa334f3a",
            "placeholder": "​",
            "style": "IPY_MODEL_8a56ba2f8d384c0fb285ac9cf7b5e421",
            "value": " 1/1 [00:00&lt;00:00, 98.04it/s]"
          }
        },
        "6f0bd0ab209348d2a76ae70cfbfa47ff": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "95dc3afa44174e9f8e715dab0a3dfd7d": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "d2f7362dee2b4100930a7a1f288e649e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "c92364fa157f4212a9a9811925605382": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "aec5035eeab04627b3d61c05bf53ef4f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "035f91d8fd1d4ff6932f9d01aa334f3a": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "8a56ba2f8d384c0fb285ac9cf7b5e421": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "675520bc1a7e4aca9e17f7410d6380cf": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_9b19f80d8f5648b9b575515d2f8085f8",
              "IPY_MODEL_c0065e721652472996f40eb47071589c",
              "IPY_MODEL_b236adc069d049c288d81702cc0dd62c"
            ],
            "layout": "IPY_MODEL_5eefa033732941b39bf3bfa62fd9185e"
          }
        },
        "9b19f80d8f5648b9b575515d2f8085f8": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_5aefc7d586ae4be4aa33c1383f494b9f",
            "placeholder": "​",
            "style": "IPY_MODEL_5e0c000321a64c28a81a1e167d88bd22",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "c0065e721652472996f40eb47071589c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_438661c89c034656b86e936360474b24",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_ed1fca3c73ad446db422e30f5ec44b0e",
            "value": 1
          }
        },
        "b236adc069d049c288d81702cc0dd62c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_4421eb7516c04af1972c6f5df5315bc4",
            "placeholder": "​",
            "style": "IPY_MODEL_6d52bfaf6be54d90a53e1fb465dfaf7d",
            "value": " 1/1 [00:00&lt;00:00, 85.71it/s]"
          }
        },
        "5eefa033732941b39bf3bfa62fd9185e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "5aefc7d586ae4be4aa33c1383f494b9f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "5e0c000321a64c28a81a1e167d88bd22": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "438661c89c034656b86e936360474b24": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "ed1fca3c73ad446db422e30f5ec44b0e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "4421eb7516c04af1972c6f5df5315bc4": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6d52bfaf6be54d90a53e1fb465dfaf7d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "3cd65d1d3cd0438ea94b8c4d964bc65c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_a4653a04856c47a0b1907d864e3f1a15",
              "IPY_MODEL_02e9029cbe8a4db0b6ef00c4df0ae302",
              "IPY_MODEL_258629893fa14d178577ee19efdff31e"
            ],
            "layout": "IPY_MODEL_fe82872822b749ae87fac7eb4df0791e"
          }
        },
        "a4653a04856c47a0b1907d864e3f1a15": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_07655ba9152647df80ad1efe4b117135",
            "placeholder": "​",
            "style": "IPY_MODEL_b6e87d03766a4185ad2c4d716aa456d7",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "02e9029cbe8a4db0b6ef00c4df0ae302": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_c6f304a0747d40fea9571f99f5289986",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_5722085f090c4851a1cde4daf7db77df",
            "value": 1
          }
        },
        "258629893fa14d178577ee19efdff31e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_7aed32af8b134b56a041ebb25c32640c",
            "placeholder": "​",
            "style": "IPY_MODEL_a723ce7408e14b63b6d4311051dca322",
            "value": " 1/1 [00:00&lt;00:00, 127.66it/s]"
          }
        },
        "fe82872822b749ae87fac7eb4df0791e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "07655ba9152647df80ad1efe4b117135": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "b6e87d03766a4185ad2c4d716aa456d7": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "c6f304a0747d40fea9571f99f5289986": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "5722085f090c4851a1cde4daf7db77df": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "7aed32af8b134b56a041ebb25c32640c": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "a723ce7408e14b63b6d4311051dca322": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "3a9c42437ab34710a3fd3a75cf9cfac4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_80a0d8b6e16b4ceb98bb8911b0fa596c",
              "IPY_MODEL_9310b29cec49404b8dfc9feb8e5bac9f",
              "IPY_MODEL_44341f0cb29440a2bef7f711517a01ff"
            ],
            "layout": "IPY_MODEL_9739202e0849427d9fe61210e231837c"
          }
        },
        "80a0d8b6e16b4ceb98bb8911b0fa596c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_c43c9d3bbacf478b9fafc076ea58ad29",
            "placeholder": "​",
            "style": "IPY_MODEL_abfa8dc54e654a61b93ec9a15f5fe67e",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "9310b29cec49404b8dfc9feb8e5bac9f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_979514f924c6441098f7b7231ae15900",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_bbef9cf5cf2d42adb650caba73919e06",
            "value": 1
          }
        },
        "44341f0cb29440a2bef7f711517a01ff": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_3b8da849443f401bb51a038f5bb82ad9",
            "placeholder": "​",
            "style": "IPY_MODEL_36f417b9e7e247b68e3bb18519af98b4",
            "value": " 1/1 [00:00&lt;00:00, 142.27it/s]"
          }
        },
        "9739202e0849427d9fe61210e231837c": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "c43c9d3bbacf478b9fafc076ea58ad29": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "abfa8dc54e654a61b93ec9a15f5fe67e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "979514f924c6441098f7b7231ae15900": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "bbef9cf5cf2d42adb650caba73919e06": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "3b8da849443f401bb51a038f5bb82ad9": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "36f417b9e7e247b68e3bb18519af98b4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "71643356b8954af5ab6cdf03df2825e3": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_8d50b1a8e0ce4d018fe4a51240ddb35d",
              "IPY_MODEL_654d72723ed8474ca360102e896331d5",
              "IPY_MODEL_049d95dcfbb34e84a0060919fdb8f454"
            ],
            "layout": "IPY_MODEL_54955fa5560041c09f847a3afb39eecd"
          }
        },
        "8d50b1a8e0ce4d018fe4a51240ddb35d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_34b2c78ef1254853a377efc6fead2e95",
            "placeholder": "​",
            "style": "IPY_MODEL_4eda8d394bff4fbf98bc086737c75219",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "654d72723ed8474ca360102e896331d5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_4ca134b9e1df4136bd0d2660a82960cf",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_87cf68c4e8a245c686fbbe439f176b87",
            "value": 1
          }
        },
        "049d95dcfbb34e84a0060919fdb8f454": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_6009ded338de4e5b9a204e6f1243bf05",
            "placeholder": "​",
            "style": "IPY_MODEL_f01a1f50e0a74faaacc35695590cea30",
            "value": " 1/1 [00:00&lt;00:00, 275.09it/s]"
          }
        },
        "54955fa5560041c09f847a3afb39eecd": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "34b2c78ef1254853a377efc6fead2e95": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "4eda8d394bff4fbf98bc086737c75219": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "4ca134b9e1df4136bd0d2660a82960cf": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "87cf68c4e8a245c686fbbe439f176b87": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "6009ded338de4e5b9a204e6f1243bf05": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "f01a1f50e0a74faaacc35695590cea30": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "a76a4846aa11422785c1d0218c94b827": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_373e3dd821954f33becb388c82ffebc2",
              "IPY_MODEL_9f532b8a64b3410f9a2e2a99755dac55",
              "IPY_MODEL_b457e104ad194032ba15070b89d42e6e"
            ],
            "layout": "IPY_MODEL_81fc3a7b94554a1980724ac6092fc88a"
          }
        },
        "373e3dd821954f33becb388c82ffebc2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_68908006e8eb4b31a55d1c0be51453bd",
            "placeholder": "​",
            "style": "IPY_MODEL_8f5c49525abe4d7a9ea746db18135f26",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "9f532b8a64b3410f9a2e2a99755dac55": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_70eb5ab30ffb4b5bbe58832c6386a536",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_970d8a7e2b5c47a5bff8a036cadc9b84",
            "value": 1
          }
        },
        "b457e104ad194032ba15070b89d42e6e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_3ad7904ba48048bfa4b7a866cf4aa4a6",
            "placeholder": "​",
            "style": "IPY_MODEL_a20c551e949842f881c6def753eb81ed",
            "value": " 1/1 [00:00&lt;00:00, 159.05it/s]"
          }
        },
        "81fc3a7b94554a1980724ac6092fc88a": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "68908006e8eb4b31a55d1c0be51453bd": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "8f5c49525abe4d7a9ea746db18135f26": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "70eb5ab30ffb4b5bbe58832c6386a536": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "970d8a7e2b5c47a5bff8a036cadc9b84": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "3ad7904ba48048bfa4b7a866cf4aa4a6": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "a20c551e949842f881c6def753eb81ed": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "67e1192ed6774aa9bb17f1d5a27695f9": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_5aea05cbd78843bcb2a9d3df9e3abefd",
              "IPY_MODEL_4693d306ecaf44f2b6b505ca072e22bb",
              "IPY_MODEL_2e46fda9b283487ba4f118bad5a880c6"
            ],
            "layout": "IPY_MODEL_55a8b90a0a6c44eda0bedd43fda69c41"
          }
        },
        "5aea05cbd78843bcb2a9d3df9e3abefd": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_a7e64bcbd09644a198b9f1c7d8a8d1c6",
            "placeholder": "​",
            "style": "IPY_MODEL_87a7b1169e1f404d81fddc56c0ba2145",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "4693d306ecaf44f2b6b505ca072e22bb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_921d621e89a64e1aab62397758e26592",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_da9024d63c56460b9ca061d5cd1bb985",
            "value": 1
          }
        },
        "2e46fda9b283487ba4f118bad5a880c6": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_503e7b032b3d44d49e15587060b25e56",
            "placeholder": "​",
            "style": "IPY_MODEL_1361830025974670a174df70957feabc",
            "value": " 1/1 [00:00&lt;00:00, 109.92it/s]"
          }
        },
        "55a8b90a0a6c44eda0bedd43fda69c41": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "a7e64bcbd09644a198b9f1c7d8a8d1c6": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "87a7b1169e1f404d81fddc56c0ba2145": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "921d621e89a64e1aab62397758e26592": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "da9024d63c56460b9ca061d5cd1bb985": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "503e7b032b3d44d49e15587060b25e56": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "1361830025974670a174df70957feabc": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "6adb0fc2977b41e7bce4e81909c6c931": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_ab9b58483e0145aab2f22a8bbf0422cf",
              "IPY_MODEL_6725fd421a9344feb552ee1a1ce84dda",
              "IPY_MODEL_0d712617055b45a3b6f5783dfe6a5842"
            ],
            "layout": "IPY_MODEL_1c5fdfd620eb47c28dcb91ff04ea6155"
          }
        },
        "ab9b58483e0145aab2f22a8bbf0422cf": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_db2185de343a4f76a2b2ecfad4e658ad",
            "placeholder": "​",
            "style": "IPY_MODEL_bb1efececaef471c90c3bc9cc2fb5ac7",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "6725fd421a9344feb552ee1a1ce84dda": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_7a49920285474268b1cb3f57e73a450e",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_b0e5dea19289434ebe98002e3cfe6086",
            "value": 1
          }
        },
        "0d712617055b45a3b6f5783dfe6a5842": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_92a8cbc6f6344e49a455c9e3df2c552f",
            "placeholder": "​",
            "style": "IPY_MODEL_b41986dd9910458e95ddfff0b1a508d1",
            "value": " 1/1 [00:00&lt;00:00, 197.98it/s]"
          }
        },
        "1c5fdfd620eb47c28dcb91ff04ea6155": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "db2185de343a4f76a2b2ecfad4e658ad": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "bb1efececaef471c90c3bc9cc2fb5ac7": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "7a49920285474268b1cb3f57e73a450e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "b0e5dea19289434ebe98002e3cfe6086": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "92a8cbc6f6344e49a455c9e3df2c552f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "b41986dd9910458e95ddfff0b1a508d1": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "f2fb2d0dfed54272abbc0560a467c97e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_08c1e9701d0b4f2e8b34027af81ab586",
              "IPY_MODEL_1ea2399f27404d5cbfffd68efbd472fc",
              "IPY_MODEL_affc022e069a41af877cf9fbe3889012"
            ],
            "layout": "IPY_MODEL_65490339b12e47d6b35cbf4a16d1bfeb"
          }
        },
        "08c1e9701d0b4f2e8b34027af81ab586": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_10247683189c43b6abf3df0b7818bcd9",
            "placeholder": "​",
            "style": "IPY_MODEL_10b0f64c86714778919d55c643550ff5",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "1ea2399f27404d5cbfffd68efbd472fc": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_a702202230484af5b32a4653f0eac288",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_5e38b9f21ce04bcc820f711c9c47678d",
            "value": 1
          }
        },
        "affc022e069a41af877cf9fbe3889012": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_2771553d801f4961ad94344e2d5caacd",
            "placeholder": "​",
            "style": "IPY_MODEL_134808b58f1f42b09c4b2353a94bbb0e",
            "value": " 1/1 [00:00&lt;00:00, 87.08it/s]"
          }
        },
        "65490339b12e47d6b35cbf4a16d1bfeb": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "10247683189c43b6abf3df0b7818bcd9": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "10b0f64c86714778919d55c643550ff5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "a702202230484af5b32a4653f0eac288": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "5e38b9f21ce04bcc820f711c9c47678d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "2771553d801f4961ad94344e2d5caacd": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "134808b58f1f42b09c4b2353a94bbb0e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "02bda666a850468086acea36156397c7": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_9abed88d016f4822bf19e71dcf997571",
              "IPY_MODEL_6ea72db4ae8b45ec96508a51c21b6974",
              "IPY_MODEL_7baafb061feb455e9b37622dc9a4c724"
            ],
            "layout": "IPY_MODEL_ba06f72e44694ecd9fa51e984b4dc8bf"
          }
        },
        "9abed88d016f4822bf19e71dcf997571": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_136c4f60a8734c578129fd843ee7ab5f",
            "placeholder": "​",
            "style": "IPY_MODEL_28f475b19b08458c81ee0cfb11c9d9c3",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "6ea72db4ae8b45ec96508a51c21b6974": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_604fd938ec7d41f285e1f1b9cb9c6eac",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_07bb79027e20401e84d02a33a628b397",
            "value": 1
          }
        },
        "7baafb061feb455e9b37622dc9a4c724": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_288ab1d98c7a4e21af429773a9fe3534",
            "placeholder": "​",
            "style": "IPY_MODEL_19a6a91b0d4e46d9be72aee530a974ce",
            "value": " 1/1 [00:00&lt;00:00, 94.33it/s]"
          }
        },
        "ba06f72e44694ecd9fa51e984b4dc8bf": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "136c4f60a8734c578129fd843ee7ab5f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "28f475b19b08458c81ee0cfb11c9d9c3": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "604fd938ec7d41f285e1f1b9cb9c6eac": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "07bb79027e20401e84d02a33a628b397": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "288ab1d98c7a4e21af429773a9fe3534": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "19a6a91b0d4e46d9be72aee530a974ce": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "0de2ddf45f754c5991a62ae8e822c4b7": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_a6fb10bec45f4f1a9243b466eb95c017",
              "IPY_MODEL_44ce5ef7a8af4fb291da012fa53e0c5a",
              "IPY_MODEL_9c40cc6348cb4bcfb59e0457399cd72b"
            ],
            "layout": "IPY_MODEL_3f9455a7a52947638545cff45b1e807d"
          }
        },
        "a6fb10bec45f4f1a9243b466eb95c017": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_22550ebc70ef4671a65bb1a041c9def7",
            "placeholder": "​",
            "style": "IPY_MODEL_67f022dd80234c08849906615a1191dc",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "44ce5ef7a8af4fb291da012fa53e0c5a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_2e5e169b1ad64407ad8c3494a70b314f",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_277e7a95b41447b4a52824c212e6fa7c",
            "value": 1
          }
        },
        "9c40cc6348cb4bcfb59e0457399cd72b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d07c7bcf6a934fae9e015be66a1f860d",
            "placeholder": "​",
            "style": "IPY_MODEL_c5e484430b0843689d7cfb434d0aa8da",
            "value": " 1/1 [00:00&lt;00:00, 102.23it/s]"
          }
        },
        "3f9455a7a52947638545cff45b1e807d": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "22550ebc70ef4671a65bb1a041c9def7": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "67f022dd80234c08849906615a1191dc": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "2e5e169b1ad64407ad8c3494a70b314f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "277e7a95b41447b4a52824c212e6fa7c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "d07c7bcf6a934fae9e015be66a1f860d": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "c5e484430b0843689d7cfb434d0aa8da": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "814e2827e8d647069f05c5b4c89deb52": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_0c8b616aecfd4e5e80a0b7c3aabd290f",
              "IPY_MODEL_e0f4261c913d42c9a7dcdf79a9914d4a",
              "IPY_MODEL_80a819740bb44d589858d4780b100255"
            ],
            "layout": "IPY_MODEL_5caf7d1fdd564dc2bebe48dd918d9c8f"
          }
        },
        "0c8b616aecfd4e5e80a0b7c3aabd290f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_10ab820d989c44b98a8bde85780c3deb",
            "placeholder": "​",
            "style": "IPY_MODEL_7e787283e4434da6b5d3f9245745547c",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "e0f4261c913d42c9a7dcdf79a9914d4a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_b8c86419aa4f43a3a0c9443f23298c0a",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_0270acbb7ed94626adc932afa0655eaa",
            "value": 1
          }
        },
        "80a819740bb44d589858d4780b100255": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_ab0b7e4f05b24205b5e4b9e975cb8e71",
            "placeholder": "​",
            "style": "IPY_MODEL_70c85ee15c0c4427b6538acbbd0de481",
            "value": " 1/1 [00:00&lt;00:00, 116.82it/s]"
          }
        },
        "5caf7d1fdd564dc2bebe48dd918d9c8f": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "10ab820d989c44b98a8bde85780c3deb": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "7e787283e4434da6b5d3f9245745547c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "b8c86419aa4f43a3a0c9443f23298c0a": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "0270acbb7ed94626adc932afa0655eaa": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "ab0b7e4f05b24205b5e4b9e975cb8e71": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "70c85ee15c0c4427b6538acbbd0de481": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "b38c3345647c4db68a2321e3a4d9e215": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_8c7b852936ca400aa04ec3f95e9afcb3",
              "IPY_MODEL_3099fea4c655407582c196176cc2108c",
              "IPY_MODEL_a5cb3ea273f9454fbb9dcd8877f2aa33"
            ],
            "layout": "IPY_MODEL_b4a722f06b614e9cbb259c8fa1e9f664"
          }
        },
        "8c7b852936ca400aa04ec3f95e9afcb3": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_228014c8ccd543a6af4c554cf60137bf",
            "placeholder": "​",
            "style": "IPY_MODEL_6e7ea147348f40c8acc919af41047189",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "3099fea4c655407582c196176cc2108c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_7c315c5b62e14d2c9af6fecf536d8df5",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_a9e1b08f5ff24e1b8d652cd9ad649b54",
            "value": 1
          }
        },
        "a5cb3ea273f9454fbb9dcd8877f2aa33": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_df097748d93e4254be82e6dae9696167",
            "placeholder": "​",
            "style": "IPY_MODEL_ac30029d30c34fd58a7f3d1826d94d6b",
            "value": " 1/1 [00:00&lt;00:00, 110.19it/s]"
          }
        },
        "b4a722f06b614e9cbb259c8fa1e9f664": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "228014c8ccd543a6af4c554cf60137bf": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6e7ea147348f40c8acc919af41047189": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "7c315c5b62e14d2c9af6fecf536d8df5": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "a9e1b08f5ff24e1b8d652cd9ad649b54": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "df097748d93e4254be82e6dae9696167": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "ac30029d30c34fd58a7f3d1826d94d6b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "6daac3cee4b9409cba48efa0d06bee24": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_db45da82b3594a1db11322289253a132",
              "IPY_MODEL_d4891374cfde42adac3f2218b879f082",
              "IPY_MODEL_2a009696a36748b2937ac6746460483a"
            ],
            "layout": "IPY_MODEL_979c7269c8394082b277435040052f45"
          }
        },
        "db45da82b3594a1db11322289253a132": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_42ff3dacbeb34fc79e60d382c93180d6",
            "placeholder": "​",
            "style": "IPY_MODEL_d5156d7ec0e14a60bc67ac5e3c5b32a6",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "d4891374cfde42adac3f2218b879f082": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_e82400379100428a915968d7ba060fd5",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_f25f7aabffb046a388ba71ad7c3ab7de",
            "value": 1
          }
        },
        "2a009696a36748b2937ac6746460483a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_5088dea18c1146d8841e50e76697b7e5",
            "placeholder": "​",
            "style": "IPY_MODEL_e36d59055aee4a48b521109b96c9faff",
            "value": " 1/1 [00:00&lt;00:00, 188.47it/s]"
          }
        },
        "979c7269c8394082b277435040052f45": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "42ff3dacbeb34fc79e60d382c93180d6": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "d5156d7ec0e14a60bc67ac5e3c5b32a6": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "e82400379100428a915968d7ba060fd5": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "f25f7aabffb046a388ba71ad7c3ab7de": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "5088dea18c1146d8841e50e76697b7e5": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "e36d59055aee4a48b521109b96c9faff": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "d4b061b8a44646a8b4ccc4839fe769a8": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_354425d2d3cc4be4891499c8c252e585",
              "IPY_MODEL_84c2e850cd944480bf1cc9bd79ca40f4",
              "IPY_MODEL_ecb0caf0ebd2458789aee04fd0468723"
            ],
            "layout": "IPY_MODEL_0689a7b924674988a587d498cb946549"
          }
        },
        "354425d2d3cc4be4891499c8c252e585": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_ea131342791043d48673da5ccb559c26",
            "placeholder": "​",
            "style": "IPY_MODEL_6936e031b7f74f45998232f819666b45",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "84c2e850cd944480bf1cc9bd79ca40f4": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_ae8efd2c29bb4008a13be5b0483928b4",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_7728374b25ec4b45b3d9171e69173bf5",
            "value": 1
          }
        },
        "ecb0caf0ebd2458789aee04fd0468723": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_a7456e34baef4c89979963a8e61b98e4",
            "placeholder": "​",
            "style": "IPY_MODEL_1db1f8a2985947639120d9bccdf3208e",
            "value": " 1/1 [00:00&lt;00:00, 113.24it/s]"
          }
        },
        "0689a7b924674988a587d498cb946549": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "ea131342791043d48673da5ccb559c26": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "6936e031b7f74f45998232f819666b45": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "ae8efd2c29bb4008a13be5b0483928b4": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "7728374b25ec4b45b3d9171e69173bf5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "a7456e34baef4c89979963a8e61b98e4": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "1db1f8a2985947639120d9bccdf3208e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "ac7a77f2fd1b4cdaab3ae8ff2bb8b963": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_2486dff82a4b41809b4a8ac2569b7e10",
              "IPY_MODEL_bcb064131d464033be2a95b5df8e2c82",
              "IPY_MODEL_4614b06d5a974ecf86238f938e58bccb"
            ],
            "layout": "IPY_MODEL_7d3a28c174ff4c2791039495b544b507"
          }
        },
        "2486dff82a4b41809b4a8ac2569b7e10": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_58a114346ac44a8c992da25fb7c721f8",
            "placeholder": "​",
            "style": "IPY_MODEL_58e96bfc8f6a449eafa644edf4b75228",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "bcb064131d464033be2a95b5df8e2c82": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_3bafea3ba4b347e186da01e279f41084",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_d8fa48e20376478e9e89438aa57de80d",
            "value": 1
          }
        },
        "4614b06d5a974ecf86238f938e58bccb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_5d9aaed3cf2e451595690e72ed4c2495",
            "placeholder": "​",
            "style": "IPY_MODEL_ab7aabf047e34d5899bc3dcfa972f7fd",
            "value": " 1/1 [00:00&lt;00:00, 69.60it/s]"
          }
        },
        "7d3a28c174ff4c2791039495b544b507": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "58a114346ac44a8c992da25fb7c721f8": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "58e96bfc8f6a449eafa644edf4b75228": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "3bafea3ba4b347e186da01e279f41084": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "d8fa48e20376478e9e89438aa57de80d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "5d9aaed3cf2e451595690e72ed4c2495": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "ab7aabf047e34d5899bc3dcfa972f7fd": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "8a006c7b0f0d431c8c024aad2ea8e427": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_cc122dc799da42948360712d0b809ed9",
              "IPY_MODEL_d3186548246149feaa9228782d7adaab",
              "IPY_MODEL_96660986fcd1451d8565790e961277b5"
            ],
            "layout": "IPY_MODEL_e6d820247bfc42acbff367b5794b6655"
          }
        },
        "cc122dc799da42948360712d0b809ed9": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_b7ff8b76997a4235a3205fac9c531502",
            "placeholder": "​",
            "style": "IPY_MODEL_00e7a13db6174f3182a898345dd1d38d",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "d3186548246149feaa9228782d7adaab": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_adcdbc5f4ee045a2bc8c7b3b7f4cac5b",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_f4920d0dce6c4d2b8528f8b098722cfc",
            "value": 1
          }
        },
        "96660986fcd1451d8565790e961277b5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_51f3bf496ca146b18b93fb58846f591e",
            "placeholder": "​",
            "style": "IPY_MODEL_78672ae9cde346c09d3a7f7701dfd151",
            "value": " 1/1 [00:00&lt;00:00, 101.89it/s]"
          }
        },
        "e6d820247bfc42acbff367b5794b6655": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "b7ff8b76997a4235a3205fac9c531502": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "00e7a13db6174f3182a898345dd1d38d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "adcdbc5f4ee045a2bc8c7b3b7f4cac5b": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "f4920d0dce6c4d2b8528f8b098722cfc": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "51f3bf496ca146b18b93fb58846f591e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "78672ae9cde346c09d3a7f7701dfd151": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "a866149ec74144b385f55fdf7eb105a8": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_26b866aceb8342b5830ca76815d6fa73",
              "IPY_MODEL_861f32fe95c04198b9dd81c8fa1fbacb",
              "IPY_MODEL_963f20a5be194830b08bb215b9ee97a1"
            ],
            "layout": "IPY_MODEL_ddeba74ba1ba4dd1a1c4f47c358eeae5"
          }
        },
        "26b866aceb8342b5830ca76815d6fa73": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_7d8c57299000460680a250aa23c7b2cd",
            "placeholder": "​",
            "style": "IPY_MODEL_4aced1e370fc4b2c88d4283bcbe97ebf",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "861f32fe95c04198b9dd81c8fa1fbacb": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_44a36016b20647efa05d9aee60aaedb8",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_9efd3613e80e4aa78248e979a44bd88b",
            "value": 1
          }
        },
        "963f20a5be194830b08bb215b9ee97a1": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_288cff3f48ab4cf2b27cfc5c37c716f7",
            "placeholder": "​",
            "style": "IPY_MODEL_179d01e55e5142acaddfff4b1975860e",
            "value": " 1/1 [00:00&lt;00:00, 111.90it/s]"
          }
        },
        "ddeba74ba1ba4dd1a1c4f47c358eeae5": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "7d8c57299000460680a250aa23c7b2cd": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "4aced1e370fc4b2c88d4283bcbe97ebf": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "44a36016b20647efa05d9aee60aaedb8": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "9efd3613e80e4aa78248e979a44bd88b": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "288cff3f48ab4cf2b27cfc5c37c716f7": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "179d01e55e5142acaddfff4b1975860e": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "db881594d4b9483bab4d09b536a6602a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_1b4e9bc9196d4c7e98005bc5de040202",
              "IPY_MODEL_8754e0214d6c495ca4f7e75d11738f73",
              "IPY_MODEL_3fbb5b3e332d4444ab7623422347d7ce"
            ],
            "layout": "IPY_MODEL_85520aaa9c464b7f927c043a323e45f3"
          }
        },
        "1b4e9bc9196d4c7e98005bc5de040202": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_bd18214cd9624c0c97d6e5d73bd84b9e",
            "placeholder": "​",
            "style": "IPY_MODEL_67a7e78833b141778d290e31b5006277",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "8754e0214d6c495ca4f7e75d11738f73": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_67139d0ae82f4ca7be9506a5bdd2f603",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_73b4b4d832f446259513cff2c764a544",
            "value": 1
          }
        },
        "3fbb5b3e332d4444ab7623422347d7ce": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_442b0033175d4d38ac1633814f8919b3",
            "placeholder": "​",
            "style": "IPY_MODEL_08664ffa89a04048aa7a6eecf55169a8",
            "value": " 1/1 [00:00&lt;00:00, 102.05it/s]"
          }
        },
        "85520aaa9c464b7f927c043a323e45f3": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "bd18214cd9624c0c97d6e5d73bd84b9e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "67a7e78833b141778d290e31b5006277": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "67139d0ae82f4ca7be9506a5bdd2f603": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "73b4b4d832f446259513cff2c764a544": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "442b0033175d4d38ac1633814f8919b3": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "08664ffa89a04048aa7a6eecf55169a8": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "d89e128b65424ced9d2ea19e42facb67": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_6c135337a5db4da8867d9c9bb1bad8b2",
              "IPY_MODEL_63b03fea35f64af49787d6253d1e8aa2",
              "IPY_MODEL_5408ba6a5d5e4d3e8371e6d8a156aae6"
            ],
            "layout": "IPY_MODEL_dce0aaa1839b493a8bfa93820f85bf0b"
          }
        },
        "6c135337a5db4da8867d9c9bb1bad8b2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_aa01e299117447e692e719426dc7f53e",
            "placeholder": "​",
            "style": "IPY_MODEL_1183926027a04b39a81c603be4b7860d",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "63b03fea35f64af49787d6253d1e8aa2": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_edee1e5620214adcb701876812fd55df",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_2ddca395a3ea42c6a422cea781e4262f",
            "value": 1
          }
        },
        "5408ba6a5d5e4d3e8371e6d8a156aae6": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_8fc852abdc384fbfada6505cd96ea825",
            "placeholder": "​",
            "style": "IPY_MODEL_239d49bd1d6c4cc2a95548c5634a3b9a",
            "value": " 1/1 [00:00&lt;00:00, 129.72it/s]"
          }
        },
        "dce0aaa1839b493a8bfa93820f85bf0b": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "aa01e299117447e692e719426dc7f53e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "1183926027a04b39a81c603be4b7860d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "edee1e5620214adcb701876812fd55df": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "2ddca395a3ea42c6a422cea781e4262f": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "8fc852abdc384fbfada6505cd96ea825": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "239d49bd1d6c4cc2a95548c5634a3b9a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "40eaa223a6ef48628829d45f576c5293": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HBoxModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HBoxModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HBoxView",
            "box_style": "",
            "children": [
              "IPY_MODEL_8a9155146377424cbc114127816ba8ba",
              "IPY_MODEL_beda87842b744bd984629e34e8fae0b5",
              "IPY_MODEL_1a4e7e57b95a41869ab5642ed0e6571c"
            ],
            "layout": "IPY_MODEL_25b3cab0e79a4762a8cc170309e7489e"
          }
        },
        "8a9155146377424cbc114127816ba8ba": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_9f2c5a74769249b997c1558bdf4c94ce",
            "placeholder": "​",
            "style": "IPY_MODEL_71b773f3ead4430cbfac09127b801c6a",
            "value": "Validation DataLoader 0: 100%"
          }
        },
        "beda87842b744bd984629e34e8fae0b5": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "FloatProgressModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "FloatProgressModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "ProgressView",
            "bar_style": "",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_d6e0253023874b6faa6bf6664e55e160",
            "max": 1,
            "min": 0,
            "orientation": "horizontal",
            "style": "IPY_MODEL_5031681c504544388ece6bbfb3b5ad69",
            "value": 1
          }
        },
        "1a4e7e57b95a41869ab5642ed0e6571c": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "HTMLModel",
          "model_module_version": "1.5.0",
          "state": {
            "_dom_classes": [],
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "HTMLModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/controls",
            "_view_module_version": "1.5.0",
            "_view_name": "HTMLView",
            "description": "",
            "description_tooltip": null,
            "layout": "IPY_MODEL_34d4e2de5bea4b7f89d44a4e7fcedbb0",
            "placeholder": "​",
            "style": "IPY_MODEL_1fd81f69f417476a95e4594e2c8b605d",
            "value": " 1/1 [00:00&lt;00:00, 136.36it/s]"
          }
        },
        "25b3cab0e79a4762a8cc170309e7489e": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": "inline-flex",
            "flex": null,
            "flex_flow": "row wrap",
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": "100%"
          }
        },
        "9f2c5a74769249b997c1558bdf4c94ce": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "71b773f3ead4430cbfac09127b801c6a": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        },
        "d6e0253023874b6faa6bf6664e55e160": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": "2",
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "5031681c504544388ece6bbfb3b5ad69": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "ProgressStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "ProgressStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "bar_color": null,
            "description_width": ""
          }
        },
        "34d4e2de5bea4b7f89d44a4e7fcedbb0": {
          "model_module": "@jupyter-widgets/base",
          "model_name": "LayoutModel",
          "model_module_version": "1.2.0",
          "state": {
            "_model_module": "@jupyter-widgets/base",
            "_model_module_version": "1.2.0",
            "_model_name": "LayoutModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "LayoutView",
            "align_content": null,
            "align_items": null,
            "align_self": null,
            "border": null,
            "bottom": null,
            "display": null,
            "flex": null,
            "flex_flow": null,
            "grid_area": null,
            "grid_auto_columns": null,
            "grid_auto_flow": null,
            "grid_auto_rows": null,
            "grid_column": null,
            "grid_gap": null,
            "grid_row": null,
            "grid_template_areas": null,
            "grid_template_columns": null,
            "grid_template_rows": null,
            "height": null,
            "justify_content": null,
            "justify_items": null,
            "left": null,
            "margin": null,
            "max_height": null,
            "max_width": null,
            "min_height": null,
            "min_width": null,
            "object_fit": null,
            "object_position": null,
            "order": null,
            "overflow": null,
            "overflow_x": null,
            "overflow_y": null,
            "padding": null,
            "right": null,
            "top": null,
            "visibility": null,
            "width": null
          }
        },
        "1fd81f69f417476a95e4594e2c8b605d": {
          "model_module": "@jupyter-widgets/controls",
          "model_name": "DescriptionStyleModel",
          "model_module_version": "1.5.0",
          "state": {
            "_model_module": "@jupyter-widgets/controls",
            "_model_module_version": "1.5.0",
            "_model_name": "DescriptionStyleModel",
            "_view_count": null,
            "_view_module": "@jupyter-widgets/base",
            "_view_module_version": "1.2.0",
            "_view_name": "StyleView",
            "description_width": ""
          }
        }
      }
    }
  },
  "nbformat": 4,
  "nbformat_minor": 0
}