examples/Constraints_Distributional_Measures.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "9a223b2f",
   "metadata": {},
   "source": [
    "# Automating data quality monitoring - Constraints Distributional Measures"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "dace09ab",
   "metadata": {},
   "source": [
    "Suppose you are training a model to predict whether a loan for a certain member of LendingClub will be accepted or not.\n",
    "\n",
    "Here we have sampled 1000 members' data to illustrate how the constraints can be used to automatically enforce data quality.\n",
    "\n",
    "When training an ML model and deploying it in production, sometimes we notice a significant performance degradation. This can often be a consequence of drift in the data that we used for training the model, and the data that needs to be predicted in some batch while the model runs in production."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "16e4db64",
   "metadata": {},
   "source": [
    "'Distributional Measures Constraints' can be used to make data quality checks in a data pipeline automatically. In some cases it's too expensive to perform manual inspection of incoming data every time, so automated checks save a lot of time and effort in these situations. If some of the defined constraints fail, then we might need to take some action before passing the data to the model for prediction."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "507332c6",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Requirement already satisfied: seaborn in /home/felipeadachi/miniconda3/envs/viewer-rename/lib/python3.8/site-packages (0.11.2)\n",
      "Requirement already satisfied: matplotlib>=2.2 in /home/felipeadachi/miniconda3/envs/viewer-rename/lib/python3.8/site-packages (from seaborn) (3.3.4)\n",
      "Requirement already satisfied: numpy>=1.15 in /home/felipeadachi/miniconda3/envs/viewer-rename/lib/python3.8/site-packages (from seaborn) (1.19.5)\n",
      "Requirement already satisfied: scipy>=1.0 in /home/felipeadachi/miniconda3/envs/viewer-rename/lib/python3.8/site-packages (from seaborn) (1.5.4)\n",
      "Requirement already satisfied: pandas>=0.23 in /home/felipeadachi/miniconda3/envs/viewer-rename/lib/python3.8/site-packages (from seaborn) (1.1.5)\n",
      "Requirement already satisfied: pillow>=6.2.0 in /home/felipeadachi/miniconda3/envs/viewer-rename/lib/python3.8/site-packages (from matplotlib>=2.2->seaborn) (8.4.0)\n",
      "Requirement already satisfied: kiwisolver>=1.0.1 in /home/felipeadachi/miniconda3/envs/viewer-rename/lib/python3.8/site-packages (from matplotlib>=2.2->seaborn) (1.3.1)\n",
      "Requirement already satisfied: cycler>=0.10 in /home/felipeadachi/miniconda3/envs/viewer-rename/lib/python3.8/site-packages (from matplotlib>=2.2->seaborn) (0.11.0)\n",
      "Requirement already satisfied: python-dateutil>=2.1 in /home/felipeadachi/miniconda3/envs/viewer-rename/lib/python3.8/site-packages (from matplotlib>=2.2->seaborn) (2.8.2)\n",
      "Requirement already satisfied: pyparsing!=2.0.4,!=2.1.2,!=2.1.6,>=2.0.3 in /home/felipeadachi/miniconda3/envs/viewer-rename/lib/python3.8/site-packages (from matplotlib>=2.2->seaborn) (3.0.7)\n",
      "Requirement already satisfied: pytz>=2017.2 in /home/felipeadachi/miniconda3/envs/viewer-rename/lib/python3.8/site-packages (from pandas>=0.23->seaborn) (2022.1)\n",
      "Requirement already satisfied: six>=1.5 in /home/felipeadachi/miniconda3/envs/viewer-rename/lib/python3.8/site-packages (from python-dateutil>=2.1->matplotlib>=2.2->seaborn) (1.16.0)\n"
     ]
    }
   ],
   "source": [
    "!pip install seaborn\n",
    "import pandas as pd\n",
    "import numpy as np\n",
    "import matplotlib.pyplot as plt\n",
    "import seaborn as sns"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "83ccd290",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "WARN: Missing config\n"
     ]
    }
   ],
   "source": [
    "from whylogs import get_or_create_session\n",
    "from whylogs.util.protobuf import message_to_json\n",
    "from whylogs.core.statistics.constraints import DatasetConstraints\n",
    "import warnings\n",
    "warnings.filterwarnings('ignore')\n",
    "\n",
    "# create session\n",
    "session = get_or_create_session()"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "35848545",
   "metadata": {},
   "source": [
    "Read the data for the example. The data contains features about 1000 LendingClub members."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "id": "9d5df16e",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>id</th>\n",
       "      <th>member_id</th>\n",
       "      <th>loan_amnt</th>\n",
       "      <th>funded_amnt</th>\n",
       "      <th>funded_amnt_inv</th>\n",
       "      <th>term</th>\n",
       "      <th>int_rate</th>\n",
       "      <th>installment</th>\n",
       "      <th>grade</th>\n",
       "      <th>sub_grade</th>\n",
       "      <th>...</th>\n",
       "      <th>hardship_payoff_balance_amount</th>\n",
       "      <th>hardship_last_payment_amount</th>\n",
       "      <th>disbursement_method</th>\n",
       "      <th>debt_settlement_flag</th>\n",
       "      <th>debt_settlement_flag_date</th>\n",
       "      <th>settlement_status</th>\n",
       "      <th>settlement_date</th>\n",
       "      <th>settlement_amount</th>\n",
       "      <th>settlement_percentage</th>\n",
       "      <th>settlement_term</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>90671227</td>\n",
       "      <td>NaN</td>\n",
       "      <td>4800.0</td>\n",
       "      <td>4800.0</td>\n",
       "      <td>4800.0</td>\n",
       "      <td>36 months</td>\n",
       "      <td>13.49</td>\n",
       "      <td>162.87</td>\n",
       "      <td>C</td>\n",
       "      <td>C2</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Cash</td>\n",
       "      <td>N</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>90060135</td>\n",
       "      <td>NaN</td>\n",
       "      <td>21600.0</td>\n",
       "      <td>21600.0</td>\n",
       "      <td>21600.0</td>\n",
       "      <td>60 months</td>\n",
       "      <td>9.49</td>\n",
       "      <td>453.54</td>\n",
       "      <td>B</td>\n",
       "      <td>B2</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Cash</td>\n",
       "      <td>N</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>90501423</td>\n",
       "      <td>NaN</td>\n",
       "      <td>24200.0</td>\n",
       "      <td>24200.0</td>\n",
       "      <td>24200.0</td>\n",
       "      <td>36 months</td>\n",
       "      <td>9.49</td>\n",
       "      <td>775.09</td>\n",
       "      <td>B</td>\n",
       "      <td>B2</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Cash</td>\n",
       "      <td>N</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>90186302</td>\n",
       "      <td>NaN</td>\n",
       "      <td>3600.0</td>\n",
       "      <td>3600.0</td>\n",
       "      <td>3600.0</td>\n",
       "      <td>36 months</td>\n",
       "      <td>11.49</td>\n",
       "      <td>118.70</td>\n",
       "      <td>B</td>\n",
       "      <td>B5</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Cash</td>\n",
       "      <td>N</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>90805192</td>\n",
       "      <td>NaN</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>36 months</td>\n",
       "      <td>10.49</td>\n",
       "      <td>259.99</td>\n",
       "      <td>B</td>\n",
       "      <td>B3</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Cash</td>\n",
       "      <td>N</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 151 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "         id  member_id  loan_amnt  funded_amnt  funded_amnt_inv        term  \\\n",
       "0  90671227        NaN     4800.0       4800.0           4800.0   36 months   \n",
       "1  90060135        NaN    21600.0      21600.0          21600.0   60 months   \n",
       "2  90501423        NaN    24200.0      24200.0          24200.0   36 months   \n",
       "3  90186302        NaN     3600.0       3600.0           3600.0   36 months   \n",
       "4  90805192        NaN     8000.0       8000.0           8000.0   36 months   \n",
       "\n",
       "   int_rate  installment grade sub_grade  ... hardship_payoff_balance_amount  \\\n",
       "0     13.49       162.87     C        C2  ...                            NaN   \n",
       "1      9.49       453.54     B        B2  ...                            NaN   \n",
       "2      9.49       775.09     B        B2  ...                            NaN   \n",
       "3     11.49       118.70     B        B5  ...                            NaN   \n",
       "4     10.49       259.99     B        B3  ...                            NaN   \n",
       "\n",
       "  hardship_last_payment_amount disbursement_method  debt_settlement_flag  \\\n",
       "0                          NaN                Cash                     N   \n",
       "1                          NaN                Cash                     N   \n",
       "2                          NaN                Cash                     N   \n",
       "3                          NaN                Cash                     N   \n",
       "4                          NaN                Cash                     N   \n",
       "\n",
       "  debt_settlement_flag_date settlement_status settlement_date  \\\n",
       "0                       NaN               NaN             NaN   \n",
       "1                       NaN               NaN             NaN   \n",
       "2                       NaN               NaN             NaN   \n",
       "3                       NaN               NaN             NaN   \n",
       "4                       NaN               NaN             NaN   \n",
       "\n",
       "  settlement_amount settlement_percentage  settlement_term  \n",
       "0               NaN                   NaN              NaN  \n",
       "1               NaN                   NaN              NaN  \n",
       "2               NaN                   NaN              NaN  \n",
       "3               NaN                   NaN              NaN  \n",
       "4               NaN                   NaN              NaN  \n",
       "\n",
       "[5 rows x 151 columns]"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data = pd.read_csv('data/lending_club_1000.csv')\n",
    "data.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "id": "1ea216a5",
   "metadata": {},
   "outputs": [],
   "source": [
    "# remove trailing whitespace characters from the feature 'term'\n",
    "data.loc[:, 'term'] = [str.strip(term) if not isinstance(term, float) else term for term in data['term'].values]"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "d995802d",
   "metadata": {},
   "source": [
    "Let's suppose that the first 80% of the data (800 rows) were used for training the ML model, and the last 20% of the data is a new unseen batch of data that needs to used to make a prediction."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "id": "d7081dfe",
   "metadata": {},
   "outputs": [],
   "source": [
    "# split the data according to the hypothetic situation\n",
    "data_train = data.iloc[:800, :]\n",
    "data_test = data.iloc[800:, :]"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "536f8a8e",
   "metadata": {},
   "source": [
    "We are going to log the 'data_train' dataframe, to obtain a DatasetProfile for the training data. This profile will later be used to check for drift with the production data. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "id": "29e7f093",
   "metadata": {},
   "outputs": [],
   "source": [
    "profile = session.log_dataframe(data_train, \"test.data\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "f943b3c4",
   "metadata": {},
   "source": [
    "Now, let's also log the 'data_test' dataframe, to obtain the target DatasetProfile for the comparison and for executing the data checks."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "id": "9c906fb0",
   "metadata": {},
   "outputs": [],
   "source": [
    "test_profile = session.log_dataframe(data_test, \"test.data\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "6a00e95c",
   "metadata": {},
   "source": [
    "In the following subsections of this notebook, we present some simple and efficient ways to check for data quality and drift."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "fce5bcc3",
   "metadata": {},
   "source": [
    "For visual inspection of the data we are going to use whylogs' NotebookProfileVisualizer. The assumption is that visually exploring the production data each time a new batch arrives is too expensive, but for the purpose of this notebook and for better understanding of the constraints, we are going to include visual representation."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "da4101ea",
   "metadata": {},
   "source": [
    "### Define the NotebookProfileVisualizer and set the target and reference profiles"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "id": "dc5e40f6",
   "metadata": {},
   "outputs": [],
   "source": [
    "from whylogs.viz import NotebookProfileVisualizer"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "id": "c917091d",
   "metadata": {},
   "outputs": [],
   "source": [
    "visualization = NotebookProfileVisualizer()  # create the profile visualizer\n",
    "# set the training data profile as the refrence profile, and the production data profile as the target profile\n",
    "# we want to use the training data features' distributions as the reference for incoming data\n",
    "visualization.set_profiles(target_profile=test_profile, reference_profile=profile) "
   ]
  },
  {
   "cell_type": "markdown",
   "id": "8dafe94e",
   "metadata": {},
   "source": [
    "## Distributional Measure: Chi-Squared test p-value"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "9bfac8b4",
   "metadata": {},
   "source": [
    "To compare two discrete distributions, we can use the Chi-Squared test, or the KL-Divergence. We first illustrate how to use the 'columnChiSquaredTestPValueGreaterThanConstraint' which defines a constraint on the Chi-Squared test's p-value, to be greater than some value (default is 0.05)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "id": "ef365cdc",
   "metadata": {},
   "outputs": [],
   "source": [
    "from whylogs.core.statistics.constraints import columnChiSquaredTestPValueGreaterThanConstraint"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "id": "3fcd24cb",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div></div><iframe srcdoc=\"&lt;!DOCTYPE html&gt;\n",
       "&lt;html lang=&quot;en&quot;&gt;\n",
       "  &lt;head&gt;\n",
       "    &lt;meta charset=&quot;UTF-8&quot; /&gt;\n",
       "    &lt;meta http-equiv=&quot;X-UA-Compatible&quot; content=&quot;IE=edge&quot; /&gt;\n",
       "    &lt;meta name=&quot;viewport&quot; content=&quot;width=device-width, initial-scale=1.0&quot; /&gt;\n",
       "    &lt;meta name=&quot;description&quot; content=&quot;&quot; /&gt;\n",
       "    &lt;meta name=&quot;author&quot; content=&quot;&quot; /&gt;\n",
       "\n",
       "    &lt;title&gt;Profile Viewer | whylogs&lt;/title&gt;\n",
       "\n",
       "    &lt;link rel=&quot;icon&quot; href=&quot;images/whylabs-favicon.png&quot; type=&quot;image/png&quot; sizes=&quot;16x16&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.googleapis.com&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.gstatic.com&quot; crossorigin /&gt;\n",
       "    &lt;link href=&quot;https://fonts.googleapis.com/css2?family=Asap:wght@400;500;600;700&amp;display=swap&quot; rel=&quot;stylesheet&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.gstatic.com&quot; /&gt;\n",
       "    &lt;link rel=&quot;stylesheet&quot; href=&quot;https://cdn.jsdelivr.net/npm/bootstrap@5.1.0/dist/css/bootstrap.min.css&quot; /&gt;\n",
       "\n",
       "    &lt;script\n",
       "      src=&quot;https://cdnjs.cloudflare.com/ajax/libs/handlebars.js/4.7.7/handlebars.min.js&quot;\n",
       "      integrity=&quot;sha512-RNLkV3d+aLtfcpEyFG8jRbnWHxUqVZozacROI4J2F1sTaDqo1dPQYs01OMi1t1w9Y2FdbSCDSQ2ZVdAC8bzgAg==&quot;\n",
       "      crossorigin=&quot;anonymous&quot;\n",
       "      referrerpolicy=&quot;no-referrer&quot;\n",
       "    &gt;&lt;/script&gt;\n",
       "\n",
       "    &lt;style type=&quot;text/css&quot;&gt;\n",
       "\n",
       "      :root {\n",
       "        /** Branded colors */\n",
       "        --brandSecondary900: #4f595b;\n",
       "        --secondaryLight1000: #313b3d;\n",
       "        /** Purpose colors */\n",
       "        --tealBackground: #eaf2f3;\n",
       "      }\n",
       "\n",
       "      /* RESET STYLE */\n",
       "      *,\n",
       "      *::after,\n",
       "      *::before {\n",
       "        margin: 0;\n",
       "        padding: 0;\n",
       "        box-sizing: border-box;\n",
       "        overflow-y: hidden;\n",
       "      }\n",
       "\n",
       "      /* Screen on smaller screens */\n",
       "      .no-responsive {\n",
       "        display: none;\n",
       "        position: fixed;\n",
       "        top: 0;\n",
       "        left: 0;\n",
       "        z-index: 1031;\n",
       "        width: 100vw;\n",
       "        height: 100vh;\n",
       "        background-color: var(--tealBackground);\n",
       "        display: flex;\n",
       "        align-items: center;\n",
       "        justify-content: center;\n",
       "      }\n",
       "\n",
       "      .desktop-content {\n",
       "        display: flex;\n",
       "        flex-direction: column;\n",
       "      }\n",
       "\n",
       "      .no-responsive__content {\n",
       "        max-width: 600px;\n",
       "        width: 100%;\n",
       "        padding: 0 24px;\n",
       "      }\n",
       "\n",
       "      .no-responsive__title {\n",
       "        font-size: 96px;\n",
       "        font-weight: 300;\n",
       "        color: var(--brandSecondary900);\n",
       "        line-height: 1.167;\n",
       "      }\n",
       "\n",
       "      .no-responsive__text {\n",
       "        margin: 0;\n",
       "        font-size: 16px;\n",
       "        font-weight: 400;\n",
       "        color: var(--brandSecondary900);\n",
       "        line-height: 1.5;\n",
       "      }\n",
       "\n",
       "      .svg-container {\n",
       "        display: inline-block;\n",
       "        position: relative;\n",
       "        width: 100%;\n",
       "        vertical-align: top;\n",
       "        overflow: hidden;\n",
       "      }\n",
       "\n",
       "      .svg-content-responsive {\n",
       "        display: inline-block;\n",
       "        position: absolute;\n",
       "        left: 0;\n",
       "      }\n",
       "\n",
       "      .circle-color {\n",
       "       display: inline-block;\n",
       "       padding: 5px;\n",
       "       border-radius: 50px;\n",
       "     }\n",
       "\n",
       "     .colors-for-distingushing-charts {\n",
       "       padding-right: 10px;\n",
       "     }\n",
       "\n",
       "     .display-flex{\n",
       "       display: flex;\n",
       "     }\n",
       "\n",
       "     .flex-direction-column {\n",
       "       flex-direction: column;\n",
       "     }\n",
       "\n",
       "     .align-items-flex-end {\n",
       "       align-items: flex-end;\n",
       "     }\n",
       "\n",
       "     .chart-box-title {\n",
       "       width: 98%;\n",
       "       justify-content: space-between;\n",
       "       margin: 10px;\n",
       "       margin-top: 15px;\n",
       "       bottom: 0;\n",
       "     }\n",
       "\n",
       "     .chart-box-title p{\n",
       "       margin-bottom: 0;\n",
       "       font-family: Asap;\n",
       "       font-weight: bold;\n",
       "       font-size: 18px;\n",
       "       line-height: 16px;\n",
       "       color: #4F595B;\n",
       "     }\n",
       "\n",
       "     .error-message {\n",
       "       display: flex;\n",
       "       justify-content: center;\n",
       "       align-items: center;\n",
       "       color: rgb(255, 114, 71);\n",
       "       font-size: 30px;\n",
       "       font-weight: 900;\n",
       "     }\n",
       "\n",
       "     @media screen and (min-width: 500px) {\n",
       "       .desktop-content {\n",
       "         display: block;\n",
       "       }\n",
       "       .no-responsive {\n",
       "         display: none;\n",
       "       }\n",
       "     }\n",
       "    &lt;/style&gt;\n",
       "  &lt;/head&gt;\n",
       "\n",
       "  &lt;body id=&quot;generated-html&quot;&gt;&lt;/body&gt;\n",
       "  &lt;script id=&quot;entry-template&quot; type=&quot;text/x-handlebars-template&quot;&gt;\n",
       "    \n",
       "      &lt;div class=&quot;desktop-content&quot;&gt;\n",
       "{{#each this}}              &lt;div class=&quot;chart-box&quot; id=&quot;chart-box&quot;&gt;\n",
       "                &lt;div class=&quot;chart-box-title display-flex&quot;&gt;\n",
       "                  &lt;p&gt;{{@key}}&lt;/p&gt;\n",
       "                  &lt;div class=&quot;display-flex&quot;&gt;\n",
       "                    &lt;div class=&quot;colors-for-distingushing-charts&quot;&gt;\n",
       "                      &lt;div class=&quot;circle-color&quot; style=&quot;background: #44C0E7;&quot;&gt;&lt;/div&gt;\n",
       "                      &lt;text alignment-baseline=&quot;middle&quot; style=&quot;font-size: 15px;&quot;&gt;Target&lt;/text&gt;\n",
       "                    &lt;/div&gt;\n",
       "                    &lt;div class=&quot;colors-for-distingushing-charts&quot;&gt;\n",
       "                      &lt;div class=&quot;circle-color&quot; style=&quot;background: #F5843C&quot;&gt;&lt;/div&gt;\n",
       "                      &lt;text alignment-baseline=&quot;middle&quot; style=&quot;font-size: 15px;&quot;&gt;Reference&lt;/text&gt;\n",
       "                    &lt;/div&gt;\n",
       "                  &lt;/div&gt;&lt;/div&gt;\n",
       "                &lt;div class=&quot;svg-container&quot;&gt;\n",
       "                  {{{getDoubleHistogramChart this}}}\n",
       "                &lt;/div&gt;\n",
       "              &lt;/div&gt;\n",
       "{{/each}}      &lt;/div&gt;\n",
       "      &lt;div class=&quot;no-responsive&quot;&gt;\n",
       "        &lt;div class=&quot;no-responsive__content&quot;&gt;\n",
       "          &lt;h1 class=&quot;no-responsive__title&quot;&gt;Hold on! :)&lt;/h1&gt;\n",
       "          &lt;p class=&quot;no-responsive__text&quot;&gt;\n",
       "            It looks like your current screen size or device is not yet supported by the WhyLabs Sandbox. The Sandbox is\n",
       "            best experienced on a desktop computer. Please try maximizing this window or switching to another device. We\n",
       "            are working on adding support for a larger variety of devices.\n",
       "          &lt;/p&gt;\n",
       "        &lt;/div&gt;\n",
       "      &lt;/div&gt;\n",
       "    \n",
       "  &lt;/script&gt;\n",
       "\n",
       "  &lt;script src=&quot;https://code.jquery.com/jquery-3.6.0.min.js&quot; integrity=&quot;sha256-/xUj+3OJU5yExlq6GSYGSHk7tPXikynS7ogEvDej/m4=&quot; crossorigin=&quot;anonymous&quot;&gt;&lt;/script&gt;\n",
       "\n",
       "  &lt;script src=&quot;https://cdnjs.cloudflare.com/ajax/libs/d3/6.7.0/d3.min.js&quot; integrity=&quot;sha512-cd6CHE+XWDQ33ElJqsi0MdNte3S+bQY819f7p3NUHgwQQLXSKjE4cPZTeGNI+vaxZynk1wVU3hoHmow3m089wA==&quot; crossorigin=&quot;anonymous&quot; referrerpolicy=&quot;no-referrer&quot;&gt;&lt;/script&gt;\n",
       "\n",
       "  &lt;script&gt;\n",
       "   function registerHandlebarHelperFunctions() {\n",
       "     \n",
       "    const findAndDeleteUndefined = (axisData) =&gt; {\n",
       "      const undefinedAxisIndex = axisData.findIndex((axis) =&gt; axis === undefined)\n",
       "      if (undefinedAxisIndex == -1) {\n",
       "        return axisData;\n",
       "      }\n",
       "\n",
       "      const result = [...axisData.slice(0, undefinedAxisIndex), ...axisData.slice(undefinedAxisIndex + 1)]\n",
       "      return result\n",
       "    }\n",
       "\n",
       "    const filterAndSortChartData = (overlappedHistogramData, histogramData) =&gt; {\n",
       "        const filteredData = overlappedHistogramData\n",
       "          .map((d) =&gt;\n",
       "            histogramData\n",
       "            .filter((ref) =&gt; d.axisX === ref.axisX )[0])\n",
       "            .sort((a, b) =&gt; {\n",
       "              if (+a.axisY &lt; +b.axisY) {\n",
       "                return 1;\n",
       "              }\n",
       "              if (+a.axisY &gt; +b.axisY) {\n",
       "                return -1;\n",
       "              }\n",
       "\n",
       "              return 0;\n",
       "            })\n",
       "            .slice(0, 20)\n",
       "\n",
       "        return findAndDeleteUndefined(filteredData)\n",
       "      }\n",
       "\n",
       "      class GenerateChartParams {\n",
       "        constructor(height, width, data, referenceData, bottomMargin=30, topMargin=5) {\n",
       "          this.MARGIN = {\n",
       "            TOP: topMargin,\n",
       "            RIGHT: 5,\n",
       "            BOTTOM: bottomMargin,\n",
       "            LEFT: 55,\n",
       "          };\n",
       "          this.SVG_WIDTH = width;\n",
       "          this.SVG_HEIGHT = height;\n",
       "          this.CHART_WIDTH = this.SVG_WIDTH - this.MARGIN.LEFT - this.MARGIN.RIGHT;\n",
       "          this.CHART_HEIGHT = this.SVG_HEIGHT - this.MARGIN.TOP - this.MARGIN.BOTTOM;\n",
       "          this.svgEl = d3.create(&quot;svg&quot;)\n",
       "             .attr(&quot;preserveAspectRatio&quot;, &quot;xMinYMin meet&quot;)\n",
       "             .attr(&quot;viewBox&quot;, `0 0 ${$(window).width()} ${$(window).height()-30}`)\n",
       "             .classed(&quot;svg-content-responsive&quot;, true)\n",
       "          this.maxYValue = d3.max([...data, ...referenceData], (d) =&gt; Math.abs(d.axisY));\n",
       "          this.xScale = d3\n",
       "            .scaleBand()\n",
       "            .domain(filterAndSortChartData(data, referenceData).map((sortedCounts) =&gt; sortedCounts?.axisX))\n",
       "            .range([this.MARGIN.LEFT, this.MARGIN.LEFT + this.CHART_WIDTH]);\n",
       "          this.yScale = d3\n",
       "            .scaleLinear()\n",
       "            .domain([0, this.maxYValue * 1.2])\n",
       "            .range([this.CHART_HEIGHT, 0]);\n",
       "        }\n",
       "      }\n",
       "\n",
       "      function chartData(column) {\n",
       "        const data = [];\n",
       "          if (column.stringSummary?.frequent) {\n",
       "            Object.entries(column.stringSummary.frequent.items).forEach(([key, {value, estimate}], index) =&gt; {\n",
       "              data.push({\n",
       "                axisY: estimate,\n",
       "                axisX: value,\n",
       "              });\n",
       "            });\n",
       "          } else if (column.stringSummary?.charPosTracker){\n",
       "            Object.entries(column.stringSummary.charPosTracker.charPosMap).forEach(([key, {count}], index) =&gt; {\n",
       "              data.push({\n",
       "                axisY: count,\n",
       "                axisX: key,\n",
       "              });\n",
       "            });\n",
       "          } else {\n",
       "            $(document).ready(() =&gt; \n",
       "              $(&quot;.desktop-content&quot;).html(`\n",
       "                &lt;p style=&quot;height: ${$(window).height()}px&quot; class=&quot;error-message&quot;&gt; \n",
       "                  Something went wrong. Please try again.\n",
       "                &lt;/p&gt;\n",
       "              `)\n",
       "            )\n",
       "          }\n",
       "\n",
       "        return data\n",
       "      }\n",
       "\n",
       "\n",
       "      function CheckNumberSummary(column) {\n",
       "        if (column.numberSummary) {\n",
       "          return true\n",
       "        } else {\n",
       "          return false\n",
       "        }\n",
       "      }\n",
       "\n",
       "      function generateBarChart(histogramData, overlappedHistogramData) {\n",
       "        let yFormat,\n",
       "            xFormat;\n",
       "        const data = filterAndSortChartData(chartData(histogramData), chartData(overlappedHistogramData)).map((axis, index) =&gt; {\n",
       "          if (axis) {\n",
       "            const findIndex = chartData(histogramData).findIndex((value) =&gt; value.axisX === axis.axisX)\n",
       "            return {\n",
       "              group: axis.axisX,\n",
       "              profile: axis.axisY,\n",
       "              reference_profile: chartData(histogramData)[findIndex].axisY\n",
       "            }\n",
       "          }\n",
       "          return 0;\n",
       "        })\n",
       "    \n",
       "        const sizes = new GenerateChartParams($(window).height()-60, $(window).width(), chartData(histogramData), chartData(overlappedHistogramData))\n",
       "        let {\n",
       "          MARGIN,\n",
       "          SVG_WIDTH,\n",
       "          SVG_HEIGHT,\n",
       "          CHART_WIDTH,\n",
       "          CHART_HEIGHT,\n",
       "          svgEl,\n",
       "          xScale,\n",
       "          yScale\n",
       "        } = sizes\n",
       "    \n",
       "        const rectColors = [&quot;#44C0E7&quot;, &quot;#F5843C&quot;]\n",
       "        const subgroups = [&#x27;reference_profile&#x27;, &#x27;profile&#x27;]\n",
       "    \n",
       "        xScale.padding([0.3])\n",
       "    \n",
       "        const xAxis = d3.axisBottom(xScale).ticks(SVG_WIDTH / 80, xFormat).tickSizeOuter(0);\n",
       "        const yAxis = d3.axisLeft(yScale).ticks(SVG_HEIGHT / 40, yFormat);\n",
       "        yFormat = yScale.tickFormat(100, yFormat);\n",
       "    \n",
       "        svgEl.append(&quot;g&quot;)\n",
       "          .attr(&quot;transform&quot;, `translate(${MARGIN.LEFT}, 0)`)\n",
       "          .attr(&quot;id&quot;, &quot;g1&quot;)\n",
       "          .call(yAxis)\n",
       "          .call(g =&gt; g.select(&quot;.domain&quot;).remove())\n",
       "          .call(g =&gt; g.selectAll(&quot;.tick line&quot;)\n",
       "              .attr(&quot;x2&quot;, CHART_WIDTH)\n",
       "              .attr(&quot;stroke-opacity&quot;, 0.1))\n",
       "          .call(g =&gt; g.append(&quot;text&quot;)\n",
       "              .attr(&quot;x&quot;, -MARGIN.LEFT)\n",
       "              .attr(&quot;y&quot;, 10)\n",
       "              .attr(&quot;fill&quot;, &quot;currentColor&quot;)\n",
       "              .attr(&quot;text-anchor&quot;, &quot;start&quot;));\n",
       "\n",
       "        svgEl.append(&quot;text&quot;)\n",
       "          .attr(&quot;transform&quot;,\n",
       "                &quot;translate(&quot; + (CHART_WIDTH/2) + &quot; ,&quot; + \n",
       "                               (CHART_HEIGHT + MARGIN.TOP + 40) + &quot;)&quot;)\n",
       "          .style(&quot;text-anchor&quot;, &quot;middle&quot;)\n",
       "          .text(&quot;Values&quot;)\n",
       "          .style(&quot;font-size&quot;, &quot;15&quot;)\n",
       "          .style(&quot;opacity&quot;, &quot;0.6&quot;)\n",
       "  \n",
       "        svgEl.append(&quot;text&quot;)\n",
       "          .attr(&quot;transform&quot;, &quot;rotate(-90)&quot;)\n",
       "          .attr(&quot;y&quot;, 0)\n",
       "          .attr(&quot;x&quot;, 0 - (SVG_HEIGHT / 2))\n",
       "          .attr(&quot;dy&quot;, &quot;1em&quot;)\n",
       "          .style(&quot;text-anchor&quot;, &quot;middle&quot;)\n",
       "          .text(&quot;Counts&quot;)\n",
       "          .style(&quot;font-size&quot;, &quot;15&quot;)   \n",
       "          .style(&quot;opacity&quot;, &quot;0.6&quot;)\n",
       "    \n",
       "        svgEl.append(&quot;g&quot;)\n",
       "            .attr(&quot;transform&quot;, `translate(0,${SVG_HEIGHT - MARGIN.BOTTOM})`)\n",
       "            .attr(&quot;id&quot;, &quot;g2&quot;)\n",
       "            .call(xAxis)\n",
       "            .call(g =&gt; g.select(&quot;.domain&quot;).remove())\n",
       "            .call(g =&gt; g.selectAll(&quot;.tick line&quot;).remove())\n",
       "            .call(g =&gt; g.append(&quot;text&quot;)\n",
       "                .attr(&quot;x&quot;, SVG_WIDTH - MARGIN.RIGHT)\n",
       "                .attr(&quot;y&quot;, 27)\n",
       "                .attr(&quot;fill&quot;, &quot;currentColor&quot;)\n",
       "                .attr(&quot;text-anchor&quot;, &quot;end&quot;));\n",
       "\n",
       "        const xSubgroup = d3.scaleBand()\n",
       "          .domain(subgroups)\n",
       "          .range([0, xScale.bandwidth()])\n",
       "\n",
       "        const color = d3.scaleOrdinal()\n",
       "          .domain(subgroups)\n",
       "          .range(rectColors)\n",
       "    \n",
       "        svgEl.append(&quot;g&quot;)\n",
       "           .attr(&quot;id&quot;, &quot;g3&quot;)\n",
       "           .selectAll(&quot;g&quot;)\n",
       "           .data(data)\n",
       "           .enter()\n",
       "           .append(&quot;g&quot;)\n",
       "             .attr(&quot;transform&quot;, function(d) { return &quot;translate(&quot; + xScale(d?.group) + &quot;,0)&quot;; })\n",
       "             .attr(&quot;id&quot;, &quot;g4&quot;)\n",
       "           .selectAll(&quot;rect&quot;)\n",
       "           .data(function(d) { return subgroups.map(function(key) { return {key: key, value: d &amp;&amp; d[key]}; }); })\n",
       "           .enter().append(&quot;rect&quot;)\n",
       "             .attr(&quot;x&quot;, function(d) { return xSubgroup(d.key); })\n",
       "             .attr(&quot;y&quot;, function(d) { return yScale(d.value); })\n",
       "             .attr(&quot;width&quot;, xSubgroup.bandwidth())\n",
       "             .attr(&quot;height&quot;, function(d) { return (CHART_HEIGHT - yScale(d.value)); })\n",
       "             .attr(&quot;fill&quot;, function(d) { return color(d.key); })\n",
       "             .style(&quot;opacity&quot;, &quot;0.8&quot;);\n",
       "    \n",
       "    \n",
       "         return svgEl._groups[0][0].outerHTML;\n",
       "      }    \n",
       "\n",
       "\n",
       "      const profileFromCSVfile = {&quot;grade&quot;: {&quot;counters&quot;: {&quot;count&quot;: &quot;800&quot;}, &quot;schema&quot;: {&quot;inferredType&quot;: {&quot;type&quot;: &quot;STRING&quot;, &quot;ratio&quot;: 1.0}, &quot;typeCounts&quot;: {&quot;STRING&quot;: &quot;800&quot;}}, &quot;stringSummary&quot;: {&quot;uniqueCount&quot;: {&quot;estimate&quot;: 7.0, &quot;upper&quot;: 7.0, &quot;lower&quot;: 7.0}, &quot;frequent&quot;: {&quot;items&quot;: [{&quot;value&quot;: &quot;C&quot;, &quot;estimate&quot;: 291.0}, {&quot;value&quot;: &quot;D&quot;, &quot;estimate&quot;: 221.0}, {&quot;value&quot;: &quot;B&quot;, &quot;estimate&quot;: 177.0}, {&quot;value&quot;: &quot;A&quot;, &quot;estimate&quot;: 56.0}, {&quot;value&quot;: &quot;E&quot;, &quot;estimate&quot;: 30.0}, {&quot;value&quot;: &quot;F&quot;, &quot;estimate&quot;: 23.0}, {&quot;value&quot;: &quot;G&quot;, &quot;estimate&quot;: 2.0}]}, &quot;length&quot;: {&quot;count&quot;: &quot;800&quot;, &quot;min&quot;: 1.0, &quot;max&quot;: 1.0, &quot;mean&quot;: 1.0, &quot;histogram&quot;: {&quot;start&quot;: 1.0, &quot;end&quot;: 1.0000001, &quot;counts&quot;: [&quot;800&quot;], &quot;max&quot;: 1.0, &quot;min&quot;: 1.0, &quot;bins&quot;: [1.0, 1.0000001], &quot;n&quot;: &quot;800&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;tokenLength&quot;: {&quot;count&quot;: &quot;800&quot;, &quot;min&quot;: 1.0, &quot;max&quot;: 1.0, &quot;mean&quot;: 1.0, &quot;histogram&quot;: {&quot;start&quot;: 1.0, &quot;end&quot;: 1.0000001, &quot;counts&quot;: [&quot;800&quot;], &quot;max&quot;: 1.0, &quot;min&quot;: 1.0, &quot;bins&quot;: [1.0, 1.0000001], &quot;n&quot;: &quot;800&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;charPosTracker&quot;: {&quot;characterList&quot;: &quot;!#$%&amp;()*+,-./0123456789?@[]^_abcdefghijklmnopqrstuvwyz{}&quot;, &quot;charPosMap&quot;: {&quot;c&quot;: {&quot;count&quot;: &quot;291&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;291&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;291&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;isDiscrete&quot;: true, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0}, &quot;g&quot;: {&quot;count&quot;: &quot;2&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;2&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;2&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0, &quot;isDiscrete&quot;: false}, &quot;d&quot;: {&quot;count&quot;: &quot;221&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;221&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;221&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;isDiscrete&quot;: true, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0}, &quot;a&quot;: {&quot;count&quot;: &quot;56&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;56&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;56&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;isDiscrete&quot;: true, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0}, &quot;e&quot;: {&quot;count&quot;: &quot;30&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;30&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;30&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;isDiscrete&quot;: true, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0}, &quot;f&quot;: {&quot;count&quot;: &quot;23&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;23&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;23&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;isDiscrete&quot;: true, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0}, &quot;b&quot;: {&quot;count&quot;: &quot;177&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;177&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;177&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;isDiscrete&quot;: true, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0}}}}, &quot;frequentItems&quot;: {&quot;items&quot;: [{&quot;estimate&quot;: &quot;291&quot;, &quot;jsonValue&quot;: &quot;C&quot;}, {&quot;estimate&quot;: &quot;221&quot;, &quot;jsonValue&quot;: &quot;D&quot;}, {&quot;estimate&quot;: &quot;177&quot;, &quot;jsonValue&quot;: &quot;B&quot;}, {&quot;estimate&quot;: &quot;56&quot;, &quot;jsonValue&quot;: &quot;A&quot;}, {&quot;estimate&quot;: &quot;30&quot;, &quot;jsonValue&quot;: &quot;E&quot;}, {&quot;estimate&quot;: &quot;23&quot;, &quot;jsonValue&quot;: &quot;F&quot;}, {&quot;estimate&quot;: &quot;2&quot;, &quot;jsonValue&quot;: &quot;G&quot;}]}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 7.000000104308129, &quot;upper&quot;: 7.000349609067664, &quot;lower&quot;: 7.0}}}\n",
       "\n",
       "      Handlebars.registerHelper(&quot;getDoubleHistogramChart&quot;,(column,key) =&gt; {\n",
       "        const columnKey = key.data.key\n",
       "        try {\n",
       "          if (profileFromCSVfile) {\n",
       "            return generateBarChart(\n",
       "                     column,\n",
       "                     profileFromCSVfile[columnKey]\n",
       "                   )\n",
       "          }\n",
       "        } catch (err) {\n",
       "          $(document).ready(() =&gt; \n",
       "            $(&quot;.desktop-content&quot;).html(`\n",
       "              &lt;p style=&quot;height: ${$(window).height()}px&quot; class=&quot;error-message&quot;&gt; \n",
       "                Something went wrong. Please try again.\n",
       "              &lt;/p&gt;\n",
       "            `)\n",
       "          )\n",
       "        }\n",
       "      });\n",
       "    }\n",
       "\n",
       "    function initWebsiteScripts() {\n",
       "      $(&quot;.svg-container&quot;).css(&quot;height&quot;, $(window).height() - 32)\n",
       "    }\n",
       "\n",
       "    function initHandlebarsTemplate() {\n",
       "      // Replace this context with JSON from .py file\n",
       "      const context = {&quot;grade&quot;: {&quot;counters&quot;: {&quot;count&quot;: &quot;200&quot;, &quot;nullCount&quot;: &quot;2&quot;}, &quot;schema&quot;: {&quot;inferredType&quot;: {&quot;type&quot;: &quot;STRING&quot;, &quot;ratio&quot;: 1.0}, &quot;typeCounts&quot;: {&quot;STRING&quot;: &quot;198&quot;, &quot;NULL&quot;: &quot;2&quot;}}, &quot;stringSummary&quot;: {&quot;uniqueCount&quot;: {&quot;estimate&quot;: 6.0, &quot;upper&quot;: 6.0, &quot;lower&quot;: 6.0}, &quot;frequent&quot;: {&quot;items&quot;: [{&quot;value&quot;: &quot;C&quot;, &quot;estimate&quot;: 109.0}, {&quot;value&quot;: &quot;B&quot;, &quot;estimate&quot;: 70.0}, {&quot;value&quot;: &quot;D&quot;, &quot;estimate&quot;: 14.0}, {&quot;value&quot;: &quot;A&quot;, &quot;estimate&quot;: 3.0}, {&quot;value&quot;: &quot;E&quot;, &quot;estimate&quot;: 1.0}, {&quot;value&quot;: &quot;F&quot;, &quot;estimate&quot;: 1.0}]}, &quot;length&quot;: {&quot;count&quot;: &quot;198&quot;, &quot;min&quot;: 1.0, &quot;max&quot;: 1.0, &quot;mean&quot;: 1.0, &quot;histogram&quot;: {&quot;start&quot;: 1.0, &quot;end&quot;: 1.0000001, &quot;counts&quot;: [&quot;198&quot;], &quot;max&quot;: 1.0, &quot;min&quot;: 1.0, &quot;bins&quot;: [1.0, 1.0000001], &quot;n&quot;: &quot;198&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;tokenLength&quot;: {&quot;count&quot;: &quot;198&quot;, &quot;min&quot;: 1.0, &quot;max&quot;: 1.0, &quot;mean&quot;: 1.0, &quot;histogram&quot;: {&quot;start&quot;: 1.0, &quot;end&quot;: 1.0000001, &quot;counts&quot;: [&quot;198&quot;], &quot;max&quot;: 1.0, &quot;min&quot;: 1.0, &quot;bins&quot;: [1.0, 1.0000001], &quot;n&quot;: &quot;198&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;charPosTracker&quot;: {&quot;characterList&quot;: &quot;!#$%&amp;()*+,-./0123456789?@[]^_abcdefghijklmnopqrstuvwyz{}&quot;, &quot;charPosMap&quot;: {&quot;c&quot;: {&quot;count&quot;: &quot;109&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;109&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;109&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;isDiscrete&quot;: true, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0}, &quot;b&quot;: {&quot;count&quot;: &quot;70&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;70&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;70&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;isDiscrete&quot;: true, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0}, &quot;e&quot;: {&quot;count&quot;: &quot;1&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;1&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;1&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0, &quot;isDiscrete&quot;: false}, &quot;a&quot;: {&quot;count&quot;: &quot;3&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;3&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;3&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0, &quot;isDiscrete&quot;: false}, &quot;d&quot;: {&quot;count&quot;: &quot;14&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;14&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;14&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;isDiscrete&quot;: true, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0}, &quot;f&quot;: {&quot;count&quot;: &quot;1&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;1&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;1&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0, &quot;isDiscrete&quot;: false}}}}, &quot;frequentItems&quot;: {&quot;items&quot;: [{&quot;estimate&quot;: &quot;109&quot;, &quot;jsonValue&quot;: &quot;C&quot;}, {&quot;estimate&quot;: &quot;70&quot;, &quot;jsonValue&quot;: &quot;B&quot;}, {&quot;estimate&quot;: &quot;14&quot;, &quot;jsonValue&quot;: &quot;D&quot;}, {&quot;estimate&quot;: &quot;3&quot;, &quot;jsonValue&quot;: &quot;A&quot;}, {&quot;estimate&quot;: &quot;1&quot;, &quot;jsonValue&quot;: &quot;E&quot;}, {&quot;estimate&quot;: &quot;1&quot;, &quot;jsonValue&quot;: &quot;F&quot;}]}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 6.000000074505807, &quot;upper&quot;: 6.000299650013235, &quot;lower&quot;: 6.0}}};\n",
       "      // Config handlebars and pass data to HBS template\n",
       "      const source = document.getElementById(&quot;entry-template&quot;).innerHTML;\n",
       "      const template = Handlebars.compile(source);\n",
       "      const html = template(context);\n",
       "      const target = document.getElementById(&quot;generated-html&quot;);\n",
       "      target.innerHTML = html;\n",
       "    }\n",
       "\n",
       "    // Invoke functions -- keep in mind invokation order\n",
       "    registerHandlebarHelperFunctions();\n",
       "    initHandlebarsTemplate();\n",
       "    initWebsiteScripts();\n",
       "  &lt;/script&gt;\n",
       "&lt;/html&gt;\n",
       "\" width=100% height=277px frameBorder=0></iframe>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "visualization.distribution_chart(feature_names=\"grade\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "bb2982b0",
   "metadata": {},
   "source": [
    "From the bar charts, we can see that there is some difference in the distribution of the feaure \"grade\" in the training and testing data set. But this visual inspection does not provide the statistical difference between the distribution and can't be used when implementing data checks automatically."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "4f4036f3",
   "metadata": {},
   "source": [
    "We are going to define a 'columnChiSquaredTestPValueGreaterThanConstraint' constraint which will use the values of the feature 'grade' from the training data set as a reference distribution, and we will set the p-value to 0.05.\n",
    "\n",
    "This constraint can then be applied on the profile of the production data set, so that we can check if the new distribution of the feature 'grade' in the production data successfully passes the constraint for the Chi-Squared test p-value to be greater than 0.05, with reference to the distribution of the same feature in the training data set. If so, then this means that the two features likely come from the same distribution."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "id": "2c9d6b00",
   "metadata": {},
   "outputs": [],
   "source": [
    "# define Chi-Squared test p-value greater than constraint\n",
    "grade_chi_squared_p_value_greater_than = columnChiSquaredTestPValueGreaterThanConstraint(\n",
    "    reference_distribution = data_train['grade'].values,\n",
    "    p_value=0.05\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "46cd0da4",
   "metadata": {},
   "source": [
    "<b>Note: It is not always necessary to pass every value in a feature as the reference distribution in the 'Distributional Measures Constraints'. You can pass values generated from a theoretical distribution, or a random sample created from a reference feature's values.<b>"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "c88cd356",
   "metadata": {},
   "source": [
    "## Distributiona Measure: KL-Divergence"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "dc6f7c29",
   "metadata": {},
   "source": [
    "### KL-Divergence constraint: Discrete distribution"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "3f72c632",
   "metadata": {},
   "source": [
    "Another constraint that can be used to detect data drift is the KL-Divergence constraint. This constraint can be applied to two discrete or two continuous distributions. In this subsection we illustrate both cases."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "id": "dfc20ab3",
   "metadata": {},
   "outputs": [],
   "source": [
    "from whylogs.core.statistics.constraints import columnKLDivergenceLessThanConstraint"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "11974d07",
   "metadata": {},
   "source": [
    "Let's plot the distribution of the feature 'term'. From the bar charts we can see that the frequency of the two categories of the feautre '36 months' and '60 months' have drastically changed in the testing data set, compared to the training data set."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "id": "6947451a",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div></div><iframe srcdoc=\"&lt;!DOCTYPE html&gt;\n",
       "&lt;html lang=&quot;en&quot;&gt;\n",
       "  &lt;head&gt;\n",
       "    &lt;meta charset=&quot;UTF-8&quot; /&gt;\n",
       "    &lt;meta http-equiv=&quot;X-UA-Compatible&quot; content=&quot;IE=edge&quot; /&gt;\n",
       "    &lt;meta name=&quot;viewport&quot; content=&quot;width=device-width, initial-scale=1.0&quot; /&gt;\n",
       "    &lt;meta name=&quot;description&quot; content=&quot;&quot; /&gt;\n",
       "    &lt;meta name=&quot;author&quot; content=&quot;&quot; /&gt;\n",
       "\n",
       "    &lt;title&gt;Profile Viewer | whylogs&lt;/title&gt;\n",
       "\n",
       "    &lt;link rel=&quot;icon&quot; href=&quot;images/whylabs-favicon.png&quot; type=&quot;image/png&quot; sizes=&quot;16x16&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.googleapis.com&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.gstatic.com&quot; crossorigin /&gt;\n",
       "    &lt;link href=&quot;https://fonts.googleapis.com/css2?family=Asap:wght@400;500;600;700&amp;display=swap&quot; rel=&quot;stylesheet&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.gstatic.com&quot; /&gt;\n",
       "    &lt;link rel=&quot;stylesheet&quot; href=&quot;https://cdn.jsdelivr.net/npm/bootstrap@5.1.0/dist/css/bootstrap.min.css&quot; /&gt;\n",
       "\n",
       "    &lt;script\n",
       "      src=&quot;https://cdnjs.cloudflare.com/ajax/libs/handlebars.js/4.7.7/handlebars.min.js&quot;\n",
       "      integrity=&quot;sha512-RNLkV3d+aLtfcpEyFG8jRbnWHxUqVZozacROI4J2F1sTaDqo1dPQYs01OMi1t1w9Y2FdbSCDSQ2ZVdAC8bzgAg==&quot;\n",
       "      crossorigin=&quot;anonymous&quot;\n",
       "      referrerpolicy=&quot;no-referrer&quot;\n",
       "    &gt;&lt;/script&gt;\n",
       "\n",
       "    &lt;style type=&quot;text/css&quot;&gt;\n",
       "\n",
       "      :root {\n",
       "        /** Branded colors */\n",
       "        --brandSecondary900: #4f595b;\n",
       "        --secondaryLight1000: #313b3d;\n",
       "        /** Purpose colors */\n",
       "        --tealBackground: #eaf2f3;\n",
       "      }\n",
       "\n",
       "      /* RESET STYLE */\n",
       "      *,\n",
       "      *::after,\n",
       "      *::before {\n",
       "        margin: 0;\n",
       "        padding: 0;\n",
       "        box-sizing: border-box;\n",
       "        overflow-y: hidden;\n",
       "      }\n",
       "\n",
       "      /* Screen on smaller screens */\n",
       "      .no-responsive {\n",
       "        display: none;\n",
       "        position: fixed;\n",
       "        top: 0;\n",
       "        left: 0;\n",
       "        z-index: 1031;\n",
       "        width: 100vw;\n",
       "        height: 100vh;\n",
       "        background-color: var(--tealBackground);\n",
       "        display: flex;\n",
       "        align-items: center;\n",
       "        justify-content: center;\n",
       "      }\n",
       "\n",
       "      .desktop-content {\n",
       "        display: flex;\n",
       "        flex-direction: column;\n",
       "      }\n",
       "\n",
       "      .no-responsive__content {\n",
       "        max-width: 600px;\n",
       "        width: 100%;\n",
       "        padding: 0 24px;\n",
       "      }\n",
       "\n",
       "      .no-responsive__title {\n",
       "        font-size: 96px;\n",
       "        font-weight: 300;\n",
       "        color: var(--brandSecondary900);\n",
       "        line-height: 1.167;\n",
       "      }\n",
       "\n",
       "      .no-responsive__text {\n",
       "        margin: 0;\n",
       "        font-size: 16px;\n",
       "        font-weight: 400;\n",
       "        color: var(--brandSecondary900);\n",
       "        line-height: 1.5;\n",
       "      }\n",
       "\n",
       "      .svg-container {\n",
       "        display: inline-block;\n",
       "        position: relative;\n",
       "        width: 100%;\n",
       "        vertical-align: top;\n",
       "        overflow: hidden;\n",
       "      }\n",
       "\n",
       "      .svg-content-responsive {\n",
       "        display: inline-block;\n",
       "        position: absolute;\n",
       "        left: 0;\n",
       "      }\n",
       "\n",
       "      .circle-color {\n",
       "       display: inline-block;\n",
       "       padding: 5px;\n",
       "       border-radius: 50px;\n",
       "     }\n",
       "\n",
       "     .colors-for-distingushing-charts {\n",
       "       padding-right: 10px;\n",
       "     }\n",
       "\n",
       "     .display-flex{\n",
       "       display: flex;\n",
       "     }\n",
       "\n",
       "     .flex-direction-column {\n",
       "       flex-direction: column;\n",
       "     }\n",
       "\n",
       "     .align-items-flex-end {\n",
       "       align-items: flex-end;\n",
       "     }\n",
       "\n",
       "     .chart-box-title {\n",
       "       width: 98%;\n",
       "       justify-content: space-between;\n",
       "       margin: 10px;\n",
       "       margin-top: 15px;\n",
       "       bottom: 0;\n",
       "     }\n",
       "\n",
       "     .chart-box-title p{\n",
       "       margin-bottom: 0;\n",
       "       font-family: Asap;\n",
       "       font-weight: bold;\n",
       "       font-size: 18px;\n",
       "       line-height: 16px;\n",
       "       color: #4F595B;\n",
       "     }\n",
       "\n",
       "     .error-message {\n",
       "       display: flex;\n",
       "       justify-content: center;\n",
       "       align-items: center;\n",
       "       color: rgb(255, 114, 71);\n",
       "       font-size: 30px;\n",
       "       font-weight: 900;\n",
       "     }\n",
       "\n",
       "     @media screen and (min-width: 500px) {\n",
       "       .desktop-content {\n",
       "         display: block;\n",
       "       }\n",
       "       .no-responsive {\n",
       "         display: none;\n",
       "       }\n",
       "     }\n",
       "    &lt;/style&gt;\n",
       "  &lt;/head&gt;\n",
       "\n",
       "  &lt;body id=&quot;generated-html&quot;&gt;&lt;/body&gt;\n",
       "  &lt;script id=&quot;entry-template&quot; type=&quot;text/x-handlebars-template&quot;&gt;\n",
       "    \n",
       "      &lt;div class=&quot;desktop-content&quot;&gt;\n",
       "{{#each this}}              &lt;div class=&quot;chart-box&quot; id=&quot;chart-box&quot;&gt;\n",
       "                &lt;div class=&quot;chart-box-title display-flex&quot;&gt;\n",
       "                  &lt;p&gt;{{@key}}&lt;/p&gt;\n",
       "                  &lt;div class=&quot;display-flex&quot;&gt;\n",
       "                    &lt;div class=&quot;colors-for-distingushing-charts&quot;&gt;\n",
       "                      &lt;div class=&quot;circle-color&quot; style=&quot;background: #44C0E7;&quot;&gt;&lt;/div&gt;\n",
       "                      &lt;text alignment-baseline=&quot;middle&quot; style=&quot;font-size: 15px;&quot;&gt;Target&lt;/text&gt;\n",
       "                    &lt;/div&gt;\n",
       "                    &lt;div class=&quot;colors-for-distingushing-charts&quot;&gt;\n",
       "                      &lt;div class=&quot;circle-color&quot; style=&quot;background: #F5843C&quot;&gt;&lt;/div&gt;\n",
       "                      &lt;text alignment-baseline=&quot;middle&quot; style=&quot;font-size: 15px;&quot;&gt;Reference&lt;/text&gt;\n",
       "                    &lt;/div&gt;\n",
       "                  &lt;/div&gt;&lt;/div&gt;\n",
       "                &lt;div class=&quot;svg-container&quot;&gt;\n",
       "                  {{{getDoubleHistogramChart this}}}\n",
       "                &lt;/div&gt;\n",
       "              &lt;/div&gt;\n",
       "{{/each}}      &lt;/div&gt;\n",
       "      &lt;div class=&quot;no-responsive&quot;&gt;\n",
       "        &lt;div class=&quot;no-responsive__content&quot;&gt;\n",
       "          &lt;h1 class=&quot;no-responsive__title&quot;&gt;Hold on! :)&lt;/h1&gt;\n",
       "          &lt;p class=&quot;no-responsive__text&quot;&gt;\n",
       "            It looks like your current screen size or device is not yet supported by the WhyLabs Sandbox. The Sandbox is\n",
       "            best experienced on a desktop computer. Please try maximizing this window or switching to another device. We\n",
       "            are working on adding support for a larger variety of devices.\n",
       "          &lt;/p&gt;\n",
       "        &lt;/div&gt;\n",
       "      &lt;/div&gt;\n",
       "    \n",
       "  &lt;/script&gt;\n",
       "\n",
       "  &lt;script src=&quot;https://code.jquery.com/jquery-3.6.0.min.js&quot; integrity=&quot;sha256-/xUj+3OJU5yExlq6GSYGSHk7tPXikynS7ogEvDej/m4=&quot; crossorigin=&quot;anonymous&quot;&gt;&lt;/script&gt;\n",
       "\n",
       "  &lt;script src=&quot;https://cdnjs.cloudflare.com/ajax/libs/d3/6.7.0/d3.min.js&quot; integrity=&quot;sha512-cd6CHE+XWDQ33ElJqsi0MdNte3S+bQY819f7p3NUHgwQQLXSKjE4cPZTeGNI+vaxZynk1wVU3hoHmow3m089wA==&quot; crossorigin=&quot;anonymous&quot; referrerpolicy=&quot;no-referrer&quot;&gt;&lt;/script&gt;\n",
       "\n",
       "  &lt;script&gt;\n",
       "   function registerHandlebarHelperFunctions() {\n",
       "     \n",
       "    const findAndDeleteUndefined = (axisData) =&gt; {\n",
       "      const undefinedAxisIndex = axisData.findIndex((axis) =&gt; axis === undefined)\n",
       "      if (undefinedAxisIndex == -1) {\n",
       "        return axisData;\n",
       "      }\n",
       "\n",
       "      const result = [...axisData.slice(0, undefinedAxisIndex), ...axisData.slice(undefinedAxisIndex + 1)]\n",
       "      return result\n",
       "    }\n",
       "\n",
       "    const filterAndSortChartData = (overlappedHistogramData, histogramData) =&gt; {\n",
       "        const filteredData = overlappedHistogramData\n",
       "          .map((d) =&gt;\n",
       "            histogramData\n",
       "            .filter((ref) =&gt; d.axisX === ref.axisX )[0])\n",
       "            .sort((a, b) =&gt; {\n",
       "              if (+a.axisY &lt; +b.axisY) {\n",
       "                return 1;\n",
       "              }\n",
       "              if (+a.axisY &gt; +b.axisY) {\n",
       "                return -1;\n",
       "              }\n",
       "\n",
       "              return 0;\n",
       "            })\n",
       "            .slice(0, 20)\n",
       "\n",
       "        return findAndDeleteUndefined(filteredData)\n",
       "      }\n",
       "\n",
       "      class GenerateChartParams {\n",
       "        constructor(height, width, data, referenceData, bottomMargin=30, topMargin=5) {\n",
       "          this.MARGIN = {\n",
       "            TOP: topMargin,\n",
       "            RIGHT: 5,\n",
       "            BOTTOM: bottomMargin,\n",
       "            LEFT: 55,\n",
       "          };\n",
       "          this.SVG_WIDTH = width;\n",
       "          this.SVG_HEIGHT = height;\n",
       "          this.CHART_WIDTH = this.SVG_WIDTH - this.MARGIN.LEFT - this.MARGIN.RIGHT;\n",
       "          this.CHART_HEIGHT = this.SVG_HEIGHT - this.MARGIN.TOP - this.MARGIN.BOTTOM;\n",
       "          this.svgEl = d3.create(&quot;svg&quot;)\n",
       "             .attr(&quot;preserveAspectRatio&quot;, &quot;xMinYMin meet&quot;)\n",
       "             .attr(&quot;viewBox&quot;, `0 0 ${$(window).width()} ${$(window).height()-30}`)\n",
       "             .classed(&quot;svg-content-responsive&quot;, true)\n",
       "          this.maxYValue = d3.max([...data, ...referenceData], (d) =&gt; Math.abs(d.axisY));\n",
       "          this.xScale = d3\n",
       "            .scaleBand()\n",
       "            .domain(filterAndSortChartData(data, referenceData).map((sortedCounts) =&gt; sortedCounts?.axisX))\n",
       "            .range([this.MARGIN.LEFT, this.MARGIN.LEFT + this.CHART_WIDTH]);\n",
       "          this.yScale = d3\n",
       "            .scaleLinear()\n",
       "            .domain([0, this.maxYValue * 1.2])\n",
       "            .range([this.CHART_HEIGHT, 0]);\n",
       "        }\n",
       "      }\n",
       "\n",
       "      function chartData(column) {\n",
       "        const data = [];\n",
       "          if (column.stringSummary?.frequent) {\n",
       "            Object.entries(column.stringSummary.frequent.items).forEach(([key, {value, estimate}], index) =&gt; {\n",
       "              data.push({\n",
       "                axisY: estimate,\n",
       "                axisX: value,\n",
       "              });\n",
       "            });\n",
       "          } else if (column.stringSummary?.charPosTracker){\n",
       "            Object.entries(column.stringSummary.charPosTracker.charPosMap).forEach(([key, {count}], index) =&gt; {\n",
       "              data.push({\n",
       "                axisY: count,\n",
       "                axisX: key,\n",
       "              });\n",
       "            });\n",
       "          } else {\n",
       "            $(document).ready(() =&gt; \n",
       "              $(&quot;.desktop-content&quot;).html(`\n",
       "                &lt;p style=&quot;height: ${$(window).height()}px&quot; class=&quot;error-message&quot;&gt; \n",
       "                  Something went wrong. Please try again.\n",
       "                &lt;/p&gt;\n",
       "              `)\n",
       "            )\n",
       "          }\n",
       "\n",
       "        return data\n",
       "      }\n",
       "\n",
       "\n",
       "      function CheckNumberSummary(column) {\n",
       "        if (column.numberSummary) {\n",
       "          return true\n",
       "        } else {\n",
       "          return false\n",
       "        }\n",
       "      }\n",
       "\n",
       "      function generateBarChart(histogramData, overlappedHistogramData) {\n",
       "        let yFormat,\n",
       "            xFormat;\n",
       "        const data = filterAndSortChartData(chartData(histogramData), chartData(overlappedHistogramData)).map((axis, index) =&gt; {\n",
       "          if (axis) {\n",
       "            const findIndex = chartData(histogramData).findIndex((value) =&gt; value.axisX === axis.axisX)\n",
       "            return {\n",
       "              group: axis.axisX,\n",
       "              profile: axis.axisY,\n",
       "              reference_profile: chartData(histogramData)[findIndex].axisY\n",
       "            }\n",
       "          }\n",
       "          return 0;\n",
       "        })\n",
       "    \n",
       "        const sizes = new GenerateChartParams($(window).height()-60, $(window).width(), chartData(histogramData), chartData(overlappedHistogramData))\n",
       "        let {\n",
       "          MARGIN,\n",
       "          SVG_WIDTH,\n",
       "          SVG_HEIGHT,\n",
       "          CHART_WIDTH,\n",
       "          CHART_HEIGHT,\n",
       "          svgEl,\n",
       "          xScale,\n",
       "          yScale\n",
       "        } = sizes\n",
       "    \n",
       "        const rectColors = [&quot;#44C0E7&quot;, &quot;#F5843C&quot;]\n",
       "        const subgroups = [&#x27;reference_profile&#x27;, &#x27;profile&#x27;]\n",
       "    \n",
       "        xScale.padding([0.3])\n",
       "    \n",
       "        const xAxis = d3.axisBottom(xScale).ticks(SVG_WIDTH / 80, xFormat).tickSizeOuter(0);\n",
       "        const yAxis = d3.axisLeft(yScale).ticks(SVG_HEIGHT / 40, yFormat);\n",
       "        yFormat = yScale.tickFormat(100, yFormat);\n",
       "    \n",
       "        svgEl.append(&quot;g&quot;)\n",
       "          .attr(&quot;transform&quot;, `translate(${MARGIN.LEFT}, 0)`)\n",
       "          .attr(&quot;id&quot;, &quot;g1&quot;)\n",
       "          .call(yAxis)\n",
       "          .call(g =&gt; g.select(&quot;.domain&quot;).remove())\n",
       "          .call(g =&gt; g.selectAll(&quot;.tick line&quot;)\n",
       "              .attr(&quot;x2&quot;, CHART_WIDTH)\n",
       "              .attr(&quot;stroke-opacity&quot;, 0.1))\n",
       "          .call(g =&gt; g.append(&quot;text&quot;)\n",
       "              .attr(&quot;x&quot;, -MARGIN.LEFT)\n",
       "              .attr(&quot;y&quot;, 10)\n",
       "              .attr(&quot;fill&quot;, &quot;currentColor&quot;)\n",
       "              .attr(&quot;text-anchor&quot;, &quot;start&quot;));\n",
       "\n",
       "        svgEl.append(&quot;text&quot;)\n",
       "          .attr(&quot;transform&quot;,\n",
       "                &quot;translate(&quot; + (CHART_WIDTH/2) + &quot; ,&quot; + \n",
       "                               (CHART_HEIGHT + MARGIN.TOP + 40) + &quot;)&quot;)\n",
       "          .style(&quot;text-anchor&quot;, &quot;middle&quot;)\n",
       "          .text(&quot;Values&quot;)\n",
       "          .style(&quot;font-size&quot;, &quot;15&quot;)\n",
       "          .style(&quot;opacity&quot;, &quot;0.6&quot;)\n",
       "  \n",
       "        svgEl.append(&quot;text&quot;)\n",
       "          .attr(&quot;transform&quot;, &quot;rotate(-90)&quot;)\n",
       "          .attr(&quot;y&quot;, 0)\n",
       "          .attr(&quot;x&quot;, 0 - (SVG_HEIGHT / 2))\n",
       "          .attr(&quot;dy&quot;, &quot;1em&quot;)\n",
       "          .style(&quot;text-anchor&quot;, &quot;middle&quot;)\n",
       "          .text(&quot;Counts&quot;)\n",
       "          .style(&quot;font-size&quot;, &quot;15&quot;)   \n",
       "          .style(&quot;opacity&quot;, &quot;0.6&quot;)\n",
       "    \n",
       "        svgEl.append(&quot;g&quot;)\n",
       "            .attr(&quot;transform&quot;, `translate(0,${SVG_HEIGHT - MARGIN.BOTTOM})`)\n",
       "            .attr(&quot;id&quot;, &quot;g2&quot;)\n",
       "            .call(xAxis)\n",
       "            .call(g =&gt; g.select(&quot;.domain&quot;).remove())\n",
       "            .call(g =&gt; g.selectAll(&quot;.tick line&quot;).remove())\n",
       "            .call(g =&gt; g.append(&quot;text&quot;)\n",
       "                .attr(&quot;x&quot;, SVG_WIDTH - MARGIN.RIGHT)\n",
       "                .attr(&quot;y&quot;, 27)\n",
       "                .attr(&quot;fill&quot;, &quot;currentColor&quot;)\n",
       "                .attr(&quot;text-anchor&quot;, &quot;end&quot;));\n",
       "\n",
       "        const xSubgroup = d3.scaleBand()\n",
       "          .domain(subgroups)\n",
       "          .range([0, xScale.bandwidth()])\n",
       "\n",
       "        const color = d3.scaleOrdinal()\n",
       "          .domain(subgroups)\n",
       "          .range(rectColors)\n",
       "    \n",
       "        svgEl.append(&quot;g&quot;)\n",
       "           .attr(&quot;id&quot;, &quot;g3&quot;)\n",
       "           .selectAll(&quot;g&quot;)\n",
       "           .data(data)\n",
       "           .enter()\n",
       "           .append(&quot;g&quot;)\n",
       "             .attr(&quot;transform&quot;, function(d) { return &quot;translate(&quot; + xScale(d?.group) + &quot;,0)&quot;; })\n",
       "             .attr(&quot;id&quot;, &quot;g4&quot;)\n",
       "           .selectAll(&quot;rect&quot;)\n",
       "           .data(function(d) { return subgroups.map(function(key) { return {key: key, value: d &amp;&amp; d[key]}; }); })\n",
       "           .enter().append(&quot;rect&quot;)\n",
       "             .attr(&quot;x&quot;, function(d) { return xSubgroup(d.key); })\n",
       "             .attr(&quot;y&quot;, function(d) { return yScale(d.value); })\n",
       "             .attr(&quot;width&quot;, xSubgroup.bandwidth())\n",
       "             .attr(&quot;height&quot;, function(d) { return (CHART_HEIGHT - yScale(d.value)); })\n",
       "             .attr(&quot;fill&quot;, function(d) { return color(d.key); })\n",
       "             .style(&quot;opacity&quot;, &quot;0.8&quot;);\n",
       "    \n",
       "    \n",
       "         return svgEl._groups[0][0].outerHTML;\n",
       "      }    \n",
       "\n",
       "\n",
       "      const profileFromCSVfile = {&quot;term&quot;: {&quot;counters&quot;: {&quot;count&quot;: &quot;800&quot;}, &quot;schema&quot;: {&quot;inferredType&quot;: {&quot;type&quot;: &quot;STRING&quot;, &quot;ratio&quot;: 1.0}, &quot;typeCounts&quot;: {&quot;STRING&quot;: &quot;800&quot;}}, &quot;stringSummary&quot;: {&quot;uniqueCount&quot;: {&quot;estimate&quot;: 2.0, &quot;upper&quot;: 2.0, &quot;lower&quot;: 2.0}, &quot;frequent&quot;: {&quot;items&quot;: [{&quot;value&quot;: &quot;36 months&quot;, &quot;estimate&quot;: 578.0}, {&quot;value&quot;: &quot;60 months&quot;, &quot;estimate&quot;: 222.0}]}, &quot;length&quot;: {&quot;count&quot;: &quot;800&quot;, &quot;min&quot;: 9.0, &quot;max&quot;: 9.0, &quot;mean&quot;: 9.0, &quot;histogram&quot;: {&quot;start&quot;: 9.0, &quot;end&quot;: 9.0000009, &quot;counts&quot;: [&quot;800&quot;], &quot;max&quot;: 9.0, &quot;min&quot;: 9.0, &quot;bins&quot;: [9.0, 9.0000009], &quot;n&quot;: &quot;800&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [9.0, 9.0, 9.0, 9.0, 9.0, 9.0, 9.0, 9.0, 9.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;tokenLength&quot;: {&quot;count&quot;: &quot;800&quot;, &quot;min&quot;: 2.0, &quot;max&quot;: 2.0, &quot;mean&quot;: 2.0, &quot;histogram&quot;: {&quot;start&quot;: 2.0, &quot;end&quot;: 2.0000002, &quot;counts&quot;: [&quot;800&quot;], &quot;max&quot;: 2.0, &quot;min&quot;: 2.0, &quot;bins&quot;: [2.0, 2.0000002], &quot;n&quot;: &quot;800&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;charPosTracker&quot;: {&quot;characterList&quot;: &quot;!#$%&amp;()*+,-./0123456789?@[]^_abcdefghijklmnopqrstuvwyz{}&quot;, &quot;charPosMap&quot;: {&quot;NITL&quot;: {&quot;count&quot;: &quot;800&quot;, &quot;min&quot;: 2.0, &quot;max&quot;: 2.0, &quot;mean&quot;: 2.0, &quot;histogram&quot;: {&quot;start&quot;: 2.0, &quot;end&quot;: 2.0000002, &quot;counts&quot;: [&quot;800&quot;], &quot;max&quot;: 2.0, &quot;min&quot;: 2.0, &quot;bins&quot;: [2.0, 2.0000002], &quot;n&quot;: &quot;800&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;3&quot;: {&quot;count&quot;: &quot;578&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;578&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;578&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;isDiscrete&quot;: true, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0}, &quot;t&quot;: {&quot;count&quot;: &quot;800&quot;, &quot;min&quot;: 6.0, &quot;max&quot;: 6.0, &quot;mean&quot;: 6.0, &quot;histogram&quot;: {&quot;start&quot;: 6.0, &quot;end&quot;: 6.0000006, &quot;counts&quot;: [&quot;800&quot;], &quot;max&quot;: 6.0, &quot;min&quot;: 6.0, &quot;bins&quot;: [6.0, 6.0000006], &quot;n&quot;: &quot;800&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;o&quot;: {&quot;count&quot;: &quot;800&quot;, &quot;min&quot;: 4.0, &quot;max&quot;: 4.0, &quot;mean&quot;: 4.0, &quot;histogram&quot;: {&quot;start&quot;: 4.0, &quot;end&quot;: 4.0000004, &quot;counts&quot;: [&quot;800&quot;], &quot;max&quot;: 4.0, &quot;min&quot;: 4.0, &quot;bins&quot;: [4.0, 4.0000004], &quot;n&quot;: &quot;800&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [4.0, 4.0, 4.0, 4.0, 4.0, 4.0, 4.0, 4.0, 4.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;h&quot;: {&quot;count&quot;: &quot;800&quot;, &quot;min&quot;: 7.0, &quot;max&quot;: 7.0, &quot;mean&quot;: 7.0, &quot;histogram&quot;: {&quot;start&quot;: 7.0, &quot;end&quot;: 7.0000007, &quot;counts&quot;: [&quot;800&quot;], &quot;max&quot;: 7.0, &quot;min&quot;: 7.0, &quot;bins&quot;: [7.0, 7.0000007], &quot;n&quot;: &quot;800&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [7.0, 7.0, 7.0, 7.0, 7.0, 7.0, 7.0, 7.0, 7.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;n&quot;: {&quot;count&quot;: &quot;800&quot;, &quot;min&quot;: 5.0, &quot;max&quot;: 5.0, &quot;mean&quot;: 5.0, &quot;histogram&quot;: {&quot;start&quot;: 5.0, &quot;end&quot;: 5.0000005, &quot;counts&quot;: [&quot;800&quot;], &quot;max&quot;: 5.0, &quot;min&quot;: 5.0, &quot;bins&quot;: [5.0, 5.0000005], &quot;n&quot;: &quot;800&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [5.0, 5.0, 5.0, 5.0, 5.0, 5.0, 5.0, 5.0, 5.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;s&quot;: {&quot;count&quot;: &quot;800&quot;, &quot;min&quot;: 8.0, &quot;max&quot;: 8.0, &quot;mean&quot;: 8.0, &quot;histogram&quot;: {&quot;start&quot;: 8.0, &quot;end&quot;: 8.0000008, &quot;counts&quot;: [&quot;800&quot;], &quot;max&quot;: 8.0, &quot;min&quot;: 8.0, &quot;bins&quot;: [8.0, 8.0000008], &quot;n&quot;: &quot;800&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [8.0, 8.0, 8.0, 8.0, 8.0, 8.0, 8.0, 8.0, 8.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;6&quot;: {&quot;count&quot;: &quot;800&quot;, &quot;max&quot;: 1.0, &quot;mean&quot;: 0.7225, &quot;stddev&quot;: 0.44804540043511626, &quot;histogram&quot;: {&quot;end&quot;: 1.0000001, &quot;counts&quot;: [&quot;219&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;581&quot;], &quot;max&quot;: 1.0, &quot;bins&quot;: [0.0, 0.03333333666666667, 0.06666667333333334, 0.10000001000000001, 0.13333334666666669, 0.16666668333333334, 0.20000002000000003, 0.2333333566666667, 0.26666669333333337, 0.30000003000000003, 0.3333333666666667, 0.3666667033333334, 0.40000004000000006, 0.4333333766666667, 0.4666667133333334, 0.50000005, 0.5333333866666667, 0.5666667233333335, 0.6000000600000001, 0.6333333966666668, 0.6666667333333334, 0.7000000700000001, 0.7333334066666668, 0.7666667433333334, 0.8000000800000001, 0.8333334166666668, 0.8666667533333334, 0.9000000900000001, 0.9333334266666669, 0.9666667633333335, 1.0000001], &quot;n&quot;: &quot;800&quot;, &quot;start&quot;: 0.0, &quot;width&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 2.0, &quot;upper&quot;: 2.0, &quot;lower&quot;: 2.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 1.0, 1.0, 1.0, 1.0, 1.0]}, &quot;isDiscrete&quot;: true, &quot;min&quot;: 0.0}, &quot;0&quot;: {&quot;count&quot;: &quot;222&quot;, &quot;min&quot;: 1.0, &quot;max&quot;: 1.0, &quot;mean&quot;: 1.0, &quot;histogram&quot;: {&quot;start&quot;: 1.0, &quot;end&quot;: 1.0000001, &quot;counts&quot;: [&quot;222&quot;], &quot;max&quot;: 1.0, &quot;min&quot;: 1.0, &quot;bins&quot;: [1.0, 1.0000001], &quot;n&quot;: &quot;222&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;m&quot;: {&quot;count&quot;: &quot;800&quot;, &quot;min&quot;: 3.0, &quot;max&quot;: 3.0, &quot;mean&quot;: 3.0, &quot;histogram&quot;: {&quot;start&quot;: 3.0, &quot;end&quot;: 3.0000003, &quot;counts&quot;: [&quot;800&quot;], &quot;max&quot;: 3.0, &quot;min&quot;: 3.0, &quot;bins&quot;: [3.0, 3.0000003], &quot;n&quot;: &quot;800&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [3.0, 3.0, 3.0, 3.0, 3.0, 3.0, 3.0, 3.0, 3.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}}}}, &quot;frequentItems&quot;: {&quot;items&quot;: [{&quot;estimate&quot;: &quot;578&quot;, &quot;jsonValue&quot;: &quot;36 months&quot;}, {&quot;estimate&quot;: &quot;222&quot;, &quot;jsonValue&quot;: &quot;60 months&quot;}]}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 2.000000004967054, &quot;upper&quot;: 2.000099863468538, &quot;lower&quot;: 2.0}}}\n",
       "\n",
       "      Handlebars.registerHelper(&quot;getDoubleHistogramChart&quot;,(column,key) =&gt; {\n",
       "        const columnKey = key.data.key\n",
       "        try {\n",
       "          if (profileFromCSVfile) {\n",
       "            return generateBarChart(\n",
       "                     column,\n",
       "                     profileFromCSVfile[columnKey]\n",
       "                   )\n",
       "          }\n",
       "        } catch (err) {\n",
       "          $(document).ready(() =&gt; \n",
       "            $(&quot;.desktop-content&quot;).html(`\n",
       "              &lt;p style=&quot;height: ${$(window).height()}px&quot; class=&quot;error-message&quot;&gt; \n",
       "                Something went wrong. Please try again.\n",
       "              &lt;/p&gt;\n",
       "            `)\n",
       "          )\n",
       "        }\n",
       "      });\n",
       "    }\n",
       "\n",
       "    function initWebsiteScripts() {\n",
       "      $(&quot;.svg-container&quot;).css(&quot;height&quot;, $(window).height() - 32)\n",
       "    }\n",
       "\n",
       "    function initHandlebarsTemplate() {\n",
       "      // Replace this context with JSON from .py file\n",
       "      const context = {&quot;term&quot;: {&quot;counters&quot;: {&quot;count&quot;: &quot;200&quot;, &quot;nullCount&quot;: &quot;2&quot;}, &quot;schema&quot;: {&quot;inferredType&quot;: {&quot;type&quot;: &quot;STRING&quot;, &quot;ratio&quot;: 1.0}, &quot;typeCounts&quot;: {&quot;STRING&quot;: &quot;198&quot;, &quot;NULL&quot;: &quot;2&quot;}}, &quot;stringSummary&quot;: {&quot;uniqueCount&quot;: {&quot;estimate&quot;: 2.0, &quot;upper&quot;: 2.0, &quot;lower&quot;: 2.0}, &quot;frequent&quot;: {&quot;items&quot;: [{&quot;value&quot;: &quot;60 months&quot;, &quot;estimate&quot;: 159.0}, {&quot;value&quot;: &quot;36 months&quot;, &quot;estimate&quot;: 39.0}]}, &quot;length&quot;: {&quot;count&quot;: &quot;198&quot;, &quot;min&quot;: 9.0, &quot;max&quot;: 9.0, &quot;mean&quot;: 9.0, &quot;histogram&quot;: {&quot;start&quot;: 9.0, &quot;end&quot;: 9.0000009, &quot;counts&quot;: [&quot;198&quot;], &quot;max&quot;: 9.0, &quot;min&quot;: 9.0, &quot;bins&quot;: [9.0, 9.0000009], &quot;n&quot;: &quot;198&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [9.0, 9.0, 9.0, 9.0, 9.0, 9.0, 9.0, 9.0, 9.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;tokenLength&quot;: {&quot;count&quot;: &quot;198&quot;, &quot;min&quot;: 2.0, &quot;max&quot;: 2.0, &quot;mean&quot;: 2.0, &quot;histogram&quot;: {&quot;start&quot;: 2.0, &quot;end&quot;: 2.0000002, &quot;counts&quot;: [&quot;198&quot;], &quot;max&quot;: 2.0, &quot;min&quot;: 2.0, &quot;bins&quot;: [2.0, 2.0000002], &quot;n&quot;: &quot;198&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;charPosTracker&quot;: {&quot;characterList&quot;: &quot;!#$%&amp;()*+,-./0123456789?@[]^_abcdefghijklmnopqrstuvwyz{}&quot;, &quot;charPosMap&quot;: {&quot;3&quot;: {&quot;count&quot;: &quot;39&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;39&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;39&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;isDiscrete&quot;: true, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0}, &quot;h&quot;: {&quot;count&quot;: &quot;198&quot;, &quot;min&quot;: 7.0, &quot;max&quot;: 7.0, &quot;mean&quot;: 7.0, &quot;histogram&quot;: {&quot;start&quot;: 7.0, &quot;end&quot;: 7.0000007, &quot;counts&quot;: [&quot;198&quot;], &quot;max&quot;: 7.0, &quot;min&quot;: 7.0, &quot;bins&quot;: [7.0, 7.0000007], &quot;n&quot;: &quot;198&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [7.0, 7.0, 7.0, 7.0, 7.0, 7.0, 7.0, 7.0, 7.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;o&quot;: {&quot;count&quot;: &quot;198&quot;, &quot;min&quot;: 4.0, &quot;max&quot;: 4.0, &quot;mean&quot;: 4.0, &quot;histogram&quot;: {&quot;start&quot;: 4.0, &quot;end&quot;: 4.0000004, &quot;counts&quot;: [&quot;198&quot;], &quot;max&quot;: 4.0, &quot;min&quot;: 4.0, &quot;bins&quot;: [4.0, 4.0000004], &quot;n&quot;: &quot;198&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [4.0, 4.0, 4.0, 4.0, 4.0, 4.0, 4.0, 4.0, 4.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;n&quot;: {&quot;count&quot;: &quot;198&quot;, &quot;min&quot;: 5.0, &quot;max&quot;: 5.0, &quot;mean&quot;: 5.0, &quot;histogram&quot;: {&quot;start&quot;: 5.0, &quot;end&quot;: 5.0000005, &quot;counts&quot;: [&quot;198&quot;], &quot;max&quot;: 5.0, &quot;min&quot;: 5.0, &quot;bins&quot;: [5.0, 5.0000005], &quot;n&quot;: &quot;198&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [5.0, 5.0, 5.0, 5.0, 5.0, 5.0, 5.0, 5.0, 5.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;0&quot;: {&quot;count&quot;: &quot;159&quot;, &quot;min&quot;: 1.0, &quot;max&quot;: 1.0, &quot;mean&quot;: 1.0, &quot;histogram&quot;: {&quot;start&quot;: 1.0, &quot;end&quot;: 1.0000001, &quot;counts&quot;: [&quot;159&quot;], &quot;max&quot;: 1.0, &quot;min&quot;: 1.0, &quot;bins&quot;: [1.0, 1.0000001], &quot;n&quot;: &quot;159&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;6&quot;: {&quot;count&quot;: &quot;198&quot;, &quot;max&quot;: 1.0, &quot;mean&quot;: 0.19696969696969696, &quot;stddev&quot;: 0.3987173713600565, &quot;histogram&quot;: {&quot;end&quot;: 1.0000001, &quot;counts&quot;: [&quot;159&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;39&quot;], &quot;max&quot;: 1.0, &quot;bins&quot;: [0.0, 0.03333333666666667, 0.06666667333333334, 0.10000001000000001, 0.13333334666666669, 0.16666668333333334, 0.20000002000000003, 0.2333333566666667, 0.26666669333333337, 0.30000003000000003, 0.3333333666666667, 0.3666667033333334, 0.40000004000000006, 0.4333333766666667, 0.4666667133333334, 0.50000005, 0.5333333866666667, 0.5666667233333335, 0.6000000600000001, 0.6333333966666668, 0.6666667333333334, 0.7000000700000001, 0.7333334066666668, 0.7666667433333334, 0.8000000800000001, 0.8333334166666668, 0.8666667533333334, 0.9000000900000001, 0.9333334266666669, 0.9666667633333335, 1.0000001], &quot;n&quot;: &quot;198&quot;, &quot;start&quot;: 0.0, &quot;width&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 2.0, &quot;upper&quot;: 2.0, &quot;lower&quot;: 2.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 1.0, 1.0, 1.0]}, &quot;isDiscrete&quot;: true, &quot;min&quot;: 0.0}, &quot;s&quot;: {&quot;count&quot;: &quot;198&quot;, &quot;min&quot;: 8.0, &quot;max&quot;: 8.0, &quot;mean&quot;: 8.0, &quot;histogram&quot;: {&quot;start&quot;: 8.0, &quot;end&quot;: 8.0000008, &quot;counts&quot;: [&quot;198&quot;], &quot;max&quot;: 8.0, &quot;min&quot;: 8.0, &quot;bins&quot;: [8.0, 8.0000008], &quot;n&quot;: &quot;198&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [8.0, 8.0, 8.0, 8.0, 8.0, 8.0, 8.0, 8.0, 8.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;NITL&quot;: {&quot;count&quot;: &quot;198&quot;, &quot;min&quot;: 2.0, &quot;max&quot;: 2.0, &quot;mean&quot;: 2.0, &quot;histogram&quot;: {&quot;start&quot;: 2.0, &quot;end&quot;: 2.0000002, &quot;counts&quot;: [&quot;198&quot;], &quot;max&quot;: 2.0, &quot;min&quot;: 2.0, &quot;bins&quot;: [2.0, 2.0000002], &quot;n&quot;: &quot;198&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0, 2.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;m&quot;: {&quot;count&quot;: &quot;198&quot;, &quot;min&quot;: 3.0, &quot;max&quot;: 3.0, &quot;mean&quot;: 3.0, &quot;histogram&quot;: {&quot;start&quot;: 3.0, &quot;end&quot;: 3.0000003, &quot;counts&quot;: [&quot;198&quot;], &quot;max&quot;: 3.0, &quot;min&quot;: 3.0, &quot;bins&quot;: [3.0, 3.0000003], &quot;n&quot;: &quot;198&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [3.0, 3.0, 3.0, 3.0, 3.0, 3.0, 3.0, 3.0, 3.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;t&quot;: {&quot;count&quot;: &quot;198&quot;, &quot;min&quot;: 6.0, &quot;max&quot;: 6.0, &quot;mean&quot;: 6.0, &quot;histogram&quot;: {&quot;start&quot;: 6.0, &quot;end&quot;: 6.0000006, &quot;counts&quot;: [&quot;198&quot;], &quot;max&quot;: 6.0, &quot;min&quot;: 6.0, &quot;bins&quot;: [6.0, 6.0000006], &quot;n&quot;: &quot;198&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0, 6.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}}}}, &quot;frequentItems&quot;: {&quot;items&quot;: [{&quot;estimate&quot;: &quot;159&quot;, &quot;jsonValue&quot;: &quot;60 months&quot;}, {&quot;estimate&quot;: &quot;39&quot;, &quot;jsonValue&quot;: &quot;36 months&quot;}]}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 2.000000004967054, &quot;upper&quot;: 2.000099863468538, &quot;lower&quot;: 2.0}}};\n",
       "      // Config handlebars and pass data to HBS template\n",
       "      const source = document.getElementById(&quot;entry-template&quot;).innerHTML;\n",
       "      const template = Handlebars.compile(source);\n",
       "      const html = template(context);\n",
       "      const target = document.getElementById(&quot;generated-html&quot;);\n",
       "      target.innerHTML = html;\n",
       "    }\n",
       "\n",
       "    // Invoke functions -- keep in mind invokation order\n",
       "    registerHandlebarHelperFunctions();\n",
       "    initHandlebarsTemplate();\n",
       "    initWebsiteScripts();\n",
       "  &lt;/script&gt;\n",
       "&lt;/html&gt;\n",
       "\" width=100% height=277px frameBorder=0></iframe>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "visualization.distribution_chart(feature_names=\"term\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "52e3bbc9",
   "metadata": {},
   "source": [
    "To check this in a data pipeline, we can define a 'columnKLDivergenceLessThanConstraint' using the values of the feature 'term' from the training data set as a reference distribution. We also need to define some threshold, above which we can consider the drift to be significant. In this case, let's assume that we did some research and came to the conclusion that the optimal threshold value is 0.5."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "id": "7cb8d72b",
   "metadata": {},
   "outputs": [],
   "source": [
    "term_kl_divergence_less_than = columnKLDivergenceLessThanConstraint(\n",
    "    reference_distribution = data_train['term'].values, \n",
    "    threshold = 0.5\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "247a8c95",
   "metadata": {},
   "source": [
    "### KL Divergence constraint - continuous distribution"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "id": "30718a9d",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div></div><iframe srcdoc=\"&lt;!DOCTYPE html&gt;\n",
       "&lt;html lang=&quot;en&quot;&gt;\n",
       "  &lt;head&gt;\n",
       "    &lt;meta charset=&quot;UTF-8&quot; /&gt;\n",
       "    &lt;meta http-equiv=&quot;X-UA-Compatible&quot; content=&quot;IE=edge&quot; /&gt;\n",
       "    &lt;meta name=&quot;viewport&quot; content=&quot;width=device-width, initial-scale=1.0&quot; /&gt;\n",
       "    &lt;meta name=&quot;description&quot; content=&quot;&quot; /&gt;\n",
       "    &lt;meta name=&quot;author&quot; content=&quot;&quot; /&gt;\n",
       "\n",
       "    &lt;title&gt;Profile Viewer | whylogs&lt;/title&gt;\n",
       "\n",
       "    &lt;link rel=&quot;icon&quot; href=&quot;images/whylabs-favicon.png&quot; type=&quot;image/png&quot; sizes=&quot;16x16&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.googleapis.com&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.gstatic.com&quot; crossorigin /&gt;\n",
       "    &lt;link href=&quot;https://fonts.googleapis.com/css2?family=Asap:wght@400;500;600;700&amp;display=swap&quot; rel=&quot;stylesheet&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.gstatic.com&quot; /&gt;\n",
       "    &lt;link rel=&quot;stylesheet&quot; href=&quot;https://cdn.jsdelivr.net/npm/bootstrap@5.1.0/dist/css/bootstrap.min.css&quot; /&gt;\n",
       "\n",
       "    &lt;script\n",
       "      src=&quot;https://cdnjs.cloudflare.com/ajax/libs/handlebars.js/4.7.7/handlebars.min.js&quot;\n",
       "      integrity=&quot;sha512-RNLkV3d+aLtfcpEyFG8jRbnWHxUqVZozacROI4J2F1sTaDqo1dPQYs01OMi1t1w9Y2FdbSCDSQ2ZVdAC8bzgAg==&quot;\n",
       "      crossorigin=&quot;anonymous&quot;\n",
       "      referrerpolicy=&quot;no-referrer&quot;\n",
       "    &gt;&lt;/script&gt;\n",
       "\n",
       "    &lt;style type=&quot;text/css&quot;&gt;\n",
       "\n",
       "      :root {\n",
       "        /** Branded colors */\n",
       "        --brandSecondary900: #4f595b;\n",
       "        --secondaryLight1000: #313b3d;\n",
       "        /** Purpose colors */\n",
       "        --tealBackground: #eaf2f3;\n",
       "      }\n",
       "\n",
       "      /* RESET STYLE */\n",
       "      *,\n",
       "      *::after,\n",
       "      *::before {\n",
       "        margin: 0;\n",
       "        padding: 0;\n",
       "        box-sizing: border-box;\n",
       "        overflow-y: hidden;\n",
       "      }\n",
       "\n",
       "      /* Screen on smaller screens */\n",
       "      .no-responsive {\n",
       "        display: none;\n",
       "        position: fixed;\n",
       "        top: 0;\n",
       "        left: 0;\n",
       "        z-index: 1031;\n",
       "        width: 100vw;\n",
       "        height: 100vh;\n",
       "        background-color: var(--tealBackground);\n",
       "        display: flex;\n",
       "        align-items: center;\n",
       "        justify-content: center;\n",
       "      }\n",
       "\n",
       "      .desktop-content {\n",
       "        display: flex;\n",
       "        flex-direction: column;\n",
       "      }\n",
       "\n",
       "      .no-responsive__content {\n",
       "        max-width: 600px;\n",
       "        width: 100%;\n",
       "        padding: 0 24px;\n",
       "      }\n",
       "\n",
       "      .no-responsive__title {\n",
       "        font-size: 96px;\n",
       "        font-weight: 300;\n",
       "        color: var(--brandSecondary900);\n",
       "        line-height: 1.167;\n",
       "      }\n",
       "\n",
       "      .no-responsive__text {\n",
       "        margin: 0;\n",
       "        font-size: 16px;\n",
       "        font-weight: 400;\n",
       "        color: var(--brandSecondary900);\n",
       "        line-height: 1.5;\n",
       "      }\n",
       "\n",
       "      .svg-container {\n",
       "        display: inline-block;\n",
       "        position: relative;\n",
       "        width: 100%;\n",
       "        vertical-align: top;\n",
       "        overflow: hidden;\n",
       "      }\n",
       "\n",
       "      .svg-content-responsive {\n",
       "        display: inline-block;\n",
       "        position: absolute;\n",
       "        left: 0;\n",
       "      }\n",
       "\n",
       "      .circle-color {\n",
       "       display: inline-block;\n",
       "       padding: 5px;\n",
       "       border-radius: 50px;\n",
       "     }\n",
       "\n",
       "     .colors-for-distingushing-charts {\n",
       "       padding-right: 10px;\n",
       "     }\n",
       "\n",
       "     .display-flex{\n",
       "       display: flex;\n",
       "     }\n",
       "\n",
       "     .align-items-flex-end {\n",
       "       align-items: flex-end;\n",
       "     }\n",
       "\n",
       "     .chart-box-title {\n",
       "       width: 88%;\n",
       "       justify-content: space-between;\n",
       "       margin: 10px;\n",
       "       margin-top: 15px;\n",
       "       bottom: 0;\n",
       "     }\n",
       "\n",
       "     .chart-box-title p{\n",
       "       margin-bottom: 0;\n",
       "       font-family: Asap;\n",
       "       font-weight: bold;\n",
       "       font-size: 18px;\n",
       "       line-height: 16px;\n",
       "       color: #4F595B;\n",
       "     }\n",
       "    \n",
       "    .bar {\n",
       "      font: 10px sans-serif;\n",
       "    }\n",
       "  \n",
       "    .bar path,\n",
       "    .bar line {\n",
       "      fill: none;\n",
       "      stroke: #000;\n",
       "      shape-rendering: crispEdges;\n",
       "    }\n",
       "\n",
       "    .error-message {\n",
       "      display: flex;\n",
       "      justify-content: center;\n",
       "      align-items: center;\n",
       "      color: rgb(255, 114, 71);\n",
       "      font-size: 30px;\n",
       "      font-weight: 900;\n",
       "    }\n",
       "\n",
       "     @media screen and (min-width: 500px) {\n",
       "       .desktop-content {\n",
       "         display: block;\n",
       "       }\n",
       "       .no-responsive {\n",
       "         display: none;\n",
       "       }\n",
       "     }\n",
       "    &lt;/style&gt;\n",
       "  &lt;/head&gt;\n",
       "\n",
       "  &lt;body id=&quot;generated-html&quot;&gt;&lt;/body&gt;\n",
       "  &lt;script id=&quot;entry-template&quot; type=&quot;text/x-handlebars-template&quot;&gt;\n",
       "    \n",
       "      &lt;div class=&quot;desktop-content&quot;&gt;\n",
       "{{#each this}}              &lt;div class=&quot;chart-box&quot; id=&quot;chart-box&quot;&gt;\n",
       "                &lt;div class=&quot;chart-box-title display-flex&quot;&gt;\n",
       "                  &lt;p&gt;{{@key}}&lt;/p&gt;\n",
       "                  &lt;div class=&quot;display-flex&quot;&gt;\n",
       "                    &lt;div class=&quot;colors-for-distingushing-charts&quot;&gt;\n",
       "                      &lt;div class=&quot;circle-color&quot; style=&quot;background: #44C0E7;&quot;&gt;&lt;/div&gt;\n",
       "                      &lt;text alignment-baseline=&quot;middle&quot; style=&quot;font-size: 15px;&quot;&gt;Target&lt;/text&gt;\n",
       "                    &lt;/div&gt;\n",
       "                    &lt;div class=&quot;colors-for-distingushing-charts&quot;&gt;\n",
       "                      &lt;div class=&quot;circle-color&quot; style=&quot;background: #F5843C&quot;&gt;&lt;/div&gt;\n",
       "                      &lt;text alignment-baseline=&quot;middle&quot; style=&quot;font-size: 15px;&quot;&gt;Reference&lt;/text&gt;\n",
       "                    &lt;/div&gt;\n",
       "                  &lt;/div&gt;&lt;/div&gt;\n",
       "                &lt;div class=&quot;svg-container&quot;&gt;{{{getDoubleHistogramChart this}}}&lt;/div&gt;\n",
       "              &lt;/div&gt;\n",
       "{{/each}}      &lt;/div&gt;\n",
       "      &lt;div class=&quot;no-responsive&quot;&gt;\n",
       "        &lt;div class=&quot;no-responsive__content&quot;&gt;\n",
       "          &lt;h1 class=&quot;no-responsive__title&quot;&gt;Hold on! :)&lt;/h1&gt;\n",
       "          &lt;p class=&quot;no-responsive__text&quot;&gt;\n",
       "            It looks like your current screen size or device is not yet supported by the WhyLabs Sandbox. The Sandbox is\n",
       "            best experienced on a desktop computer. Please try maximizing this window or switching to another device. We\n",
       "            are working on adding support for a larger variety of devices.\n",
       "          &lt;/p&gt;\n",
       "        &lt;/div&gt;\n",
       "      &lt;/div&gt;\n",
       "    \n",
       "  &lt;/script&gt;\n",
       "\n",
       "  &lt;script src=&quot;https://code.jquery.com/jquery-3.6.0.min.js&quot; integrity=&quot;sha256-/xUj+3OJU5yExlq6GSYGSHk7tPXikynS7ogEvDej/m4=&quot; crossorigin=&quot;anonymous&quot;&gt;&lt;/script&gt;\n",
       "\n",
       "  &lt;script src=&quot;https://cdnjs.cloudflare.com/ajax/libs/d3/6.7.0/d3.min.js&quot; integrity=&quot;sha512-cd6CHE+XWDQ33ElJqsi0MdNte3S+bQY819f7p3NUHgwQQLXSKjE4cPZTeGNI+vaxZynk1wVU3hoHmow3m089wA==&quot; crossorigin=&quot;anonymous&quot; referrerpolicy=&quot;no-referrer&quot;&gt;&lt;/script&gt;\n",
       "\n",
       "  &lt;script&gt;\n",
       "    function registerHandlebarHelperFunctions() {\n",
       "      //helper fun\n",
       "\n",
       "      class GenerateChartParams {\n",
       "        constructor(height, width, targetData, referenceData, bottomMargin=30, topMargin=5) {\n",
       "          this.MARGIN = {\n",
       "            TOP: topMargin,\n",
       "            RIGHT: 5,\n",
       "            BOTTOM: bottomMargin,\n",
       "            LEFT: 55,\n",
       "          };\n",
       "          this.SVG_WIDTH = width;\n",
       "          this.SVG_HEIGHT = height;\n",
       "          this.CHART_WIDTH = this.SVG_WIDTH - this.MARGIN.LEFT - this.MARGIN.RIGHT;\n",
       "          this.CHART_HEIGHT = this.SVG_HEIGHT - this.MARGIN.TOP - this.MARGIN.BOTTOM;\n",
       "          this.svgEl = d3.create(&quot;svg&quot;)\n",
       "             .attr(&quot;preserveAspectRatio&quot;, &quot;xMinYMin meet&quot;)\n",
       "             .attr(&quot;viewBox&quot;, `0 0 ${$(window).width()+100} ${$(window).height()-30}`)\n",
       "             .classed(&quot;svg-content-responsive&quot;, true)\n",
       "          this.maxYValue = d3.max(targetData, (d) =&gt; Math.abs(d.axisY));\n",
       "          this.minYValue = d3.min(targetData, (d) =&gt; Math.abs(d.axisY));\n",
       "          const mergedReferenceData = referenceData.map(({axisX, axisY}) =&gt; {\n",
       "            return {axisX, axisY}\n",
       "          })\n",
       "          const mergedTargetedData = targetData.map(({axisX, axisY}) =&gt; {\n",
       "            return {axisX, axisY}\n",
       "          })\n",
       "\n",
       "          this.charts2 = mergedReferenceData.concat(mergedTargetedData)\n",
       "          this.charts2 = this.charts2.sort(function(a, b) { return a - b; });\n",
       "\n",
       "          this.targetBinWidth = targetData[1]?.axisX - targetData[0]?.axisX\n",
       "          this.referenceBinWidth = referenceData[1]?.axisX - referenceData[0]?.axisX\n",
       "          this.maxTargetXValue = d3.max(targetData, (d) =&gt; d.axisX);\n",
       "\n",
       "          this.maxReferenceXValue = d3.max(referenceData, (d) =&gt; d.axisX);\n",
       "\n",
       "          this.xScale = d3\n",
       "              .scaleLinear()\n",
       "         .domain([d3.min(this.charts2, function(d) { return parseFloat(d.axisX); }),(this.maxTargetXValue+this.targetBinWidth &gt;= this.maxReferenceXValue+this.referenceBinWidth) ? this.maxTargetXValue+this.targetBinWidth:this.maxReferenceXValue+this.referenceBinWidth])     // I was too lazy to do basic math of max(bin_start + width for each distribution)\n",
       "         .range([0, this.CHART_WIDTH ]);\n",
       "\n",
       "         this.svgEl.append(&quot;g&quot;)\n",
       "             .attr(&quot;transform&quot;, &quot;translate(&quot;+ this.MARGIN.LEFT +&quot;,&quot; + this.SVG_HEIGHT + &quot;)&quot;)\n",
       "             .call(d3.axisBottom(this.xScale));\n",
       "          this.yScale = d3.scaleLinear()\n",
       "              .range([this.CHART_HEIGHT , 0])\n",
       "              this.yScale.domain([d3.min(this.charts2, function(d) { return parseFloat(d.axisY); }), d3.max(this.charts2, function(d) { return parseFloat(d.axisY); })]);\n",
       "        }\n",
       "      }\n",
       "\n",
       "      function chartData(column) {\n",
       "        const data = [];\n",
       "        if (column.numberSummary?.histogram) {\n",
       "          for (let i = 0; i&lt;column.numberSummary.histogram.bins.length; i++) {\n",
       "            data.push({\n",
       "              axisY: column.numberSummary.histogram.counts[i] || 0,\n",
       "              axisX: column.numberSummary.histogram.bins[i] || 0,\n",
       "            });\n",
       "          }\n",
       "        } else {\n",
       "            $(document).ready(() =&gt; \n",
       "              $(&quot;.desktop-content&quot;).html(`\n",
       "                &lt;p style=&quot;height: ${$(window).height()}px&quot; class=&quot;error-message&quot;&gt; \n",
       "                  Something went wrong. Please try again.\n",
       "                &lt;/p&gt;\n",
       "              `)\n",
       "            )\n",
       "          }\n",
       "\n",
       "        return data\n",
       "      }\n",
       "\n",
       "      function generateDoubleHistogramChart(targetData, referenceData) {\n",
       "        let histogramData = [],\n",
       "            overlappedHistogramData = [];\n",
       "        let yFormat;\n",
       "\n",
       "        histogramData = chartData(targetData)\n",
       "        overlappedHistogramData = chartData(referenceData)\n",
       "\n",
       "        const sizes = new GenerateChartParams($(window).height()-80, $(window).width(), histogramData, overlappedHistogramData)\n",
       "        const {\n",
       "          MARGIN,\n",
       "          SVG_WIDTH,\n",
       "          SVG_HEIGHT,\n",
       "          CHART_WIDTH,\n",
       "          CHART_HEIGHT,\n",
       "          svgEl,\n",
       "          maxYValue,\n",
       "          minYValue,\n",
       "          xScale,\n",
       "          yScale\n",
       "        } = sizes\n",
       "\n",
       "        const rectColors = [&quot;#44C0E7&quot;, &quot;#F5843C&quot;]\n",
       "        const yAxis = d3.axisLeft(yScale).ticks(SVG_HEIGHT / 40, yFormat);\n",
       "        yFormat = yScale.tickFormat(100, yFormat);\n",
       "\n",
       "        svgEl.append(&quot;g&quot;)\n",
       "          .attr(&quot;transform&quot;, `translate(${MARGIN.LEFT}, ${MARGIN.BOTTOM})`)\n",
       "          .call(yAxis)\n",
       "          .call(g =&gt; g.select(&quot;.domain&quot;).remove())\n",
       "          .call(g =&gt; g.selectAll(&quot;.tick line&quot;)\n",
       "              .attr(&quot;x2&quot;, CHART_WIDTH)\n",
       "              .attr(&quot;stroke-opacity&quot;, 0.1))\n",
       "          .call(g =&gt; g.append(&quot;text&quot;)\n",
       "              .attr(&quot;x&quot;, -MARGIN.LEFT)\n",
       "              .attr(&quot;y&quot;, 10)\n",
       "              .attr(&quot;fill&quot;, &quot;currentColor&quot;)\n",
       "              .attr(&quot;text-anchor&quot;, &quot;start&quot;))\n",
       "\n",
       "        svgEl.append(&quot;text&quot;)\n",
       "          .attr(&quot;transform&quot;,\n",
       "                &quot;translate(&quot; + (CHART_WIDTH/2) + &quot; ,&quot; +\n",
       "                               (CHART_HEIGHT + MARGIN.TOP + 75) + &quot;)&quot;)\n",
       "          .style(&quot;text-anchor&quot;, &quot;middle&quot;)\n",
       "          .text(&quot;Values&quot;)\n",
       "          .style(&quot;font-size&quot;, &quot;15&quot;)\n",
       "          .style(&quot;opacity&quot;, &quot;0.6&quot;)\n",
       "\n",
       "        svgEl.append(&quot;text&quot;)\n",
       "          .attr(&quot;transform&quot;, &quot;rotate(-90)&quot;)\n",
       "          .attr(&quot;y&quot;, 0)\n",
       "          .attr(&quot;x&quot;, 0 - (SVG_HEIGHT / 2))\n",
       "          .attr(&quot;dy&quot;, &quot;1em&quot;)\n",
       "          .style(&quot;text-anchor&quot;, &quot;middle&quot;)\n",
       "          .text(&quot;Counts&quot;)\n",
       "          .style(&quot;font-size&quot;, &quot;15&quot;)\n",
       "          .style(&quot;opacity&quot;, &quot;0.6&quot;)\n",
       "\n",
       "          const gChart = svgEl.append(&quot;g&quot;);\n",
       "          gChart\n",
       "          .attr(&quot;transform&quot;, &quot;translate(&quot;+ MARGIN.LEFT +&quot;,0)&quot;)\n",
       "          .selectAll(&quot;.bar&quot;)\n",
       "          .data(histogramData)\n",
       "          .enter()\n",
       "          .append(&quot;rect&quot;)\n",
       "          .style(&quot;stroke&quot;, &quot;#021826&quot;)\n",
       "          .classed(&quot;bar&quot;, true)\n",
       "          .attr(&quot;width&quot;, function(d) { return xScale(histogramData[1]?.axisX)-xScale(histogramData[0]?.axisX); })\n",
       "          .attr(&quot;height&quot;, (d) =&gt; CHART_HEIGHT - yScale(d.axisY))\n",
       "          .attr(&quot;x&quot;, 1)\n",
       "          .attr(&quot;transform&quot;, function(d) { return &quot;translate(&quot; + xScale(d.axisX) + &quot;,&quot; + 0  +  &quot;)&quot;; })\n",
       "          .attr(&quot;y&quot;, (d) =&gt; yScale(d.axisY) + MARGIN.TOP + MARGIN.BOTTOM)\n",
       "          .attr(&quot;fill&quot;, rectColors[0])\n",
       "          .style(&quot;opacity&quot;,&quot;0.6&quot;)\n",
       "\n",
       "          const gChart1 = svgEl.append(&quot;g&quot;);\n",
       "          gChart1\n",
       "          .attr(&quot;transform&quot;, &quot;translate(&quot;+ MARGIN.LEFT +&quot;,0)&quot;)\n",
       "          .selectAll(&quot;.bar&quot;)\n",
       "          .data(overlappedHistogramData)\n",
       "          .enter()\n",
       "          .append(&quot;rect&quot;)\n",
       "          .style(&quot;stroke&quot;, &quot;#021826&quot;)\n",
       "          .classed(&quot;bar&quot;, true)\n",
       "          .attr(&quot;width&quot;, function(d) { return xScale(overlappedHistogramData[1]?.axisX)-xScale(overlappedHistogramData[0]?.axisX); })\n",
       "          .attr(&quot;height&quot;, (d) =&gt; CHART_HEIGHT - yScale(d.axisY))\n",
       "          .attr(&quot;x&quot;, 1)\n",
       "          .attr(&quot;transform&quot;, function(d) { return &quot;translate(&quot; + xScale(d.axisX) + &quot;,&quot; + 0  +  &quot;)&quot;; })\n",
       "          .attr(&quot;y&quot;, (d) =&gt; yScale(d.axisY) + MARGIN.TOP + MARGIN.BOTTOM)\n",
       "          .attr(&quot;fill&quot;, rectColors[1])\n",
       "          .style(&quot;opacity&quot;,&quot;0.6&quot;)\n",
       "\n",
       "        return svgEl._groups[0][0].outerHTML;\n",
       "      }\n",
       "\n",
       "      const profileFromCSVfile = {&quot;int_rate&quot;: {&quot;counters&quot;: {&quot;count&quot;: &quot;800&quot;}, &quot;schema&quot;: {&quot;inferredType&quot;: {&quot;type&quot;: &quot;FRACTIONAL&quot;, &quot;ratio&quot;: 1.0}, &quot;typeCounts&quot;: {&quot;FRACTIONAL&quot;: &quot;800&quot;}}, &quot;numberSummary&quot;: {&quot;count&quot;: &quot;800&quot;, &quot;min&quot;: 5.32, &quot;max&quot;: 29.96, &quot;mean&quot;: 14.713449999999902, &quot;stddev&quot;: 4.69498948404777, &quot;histogram&quot;: {&quot;start&quot;: 5.320000171661377, &quot;end&quot;: 29.960002080472563, &quot;counts&quot;: [&quot;10&quot;, &quot;0&quot;, &quot;24&quot;, &quot;22&quot;, &quot;50&quot;, &quot;47&quot;, &quot;54&quot;, &quot;26&quot;, &quot;0&quot;, &quot;117&quot;, &quot;57&quot;, &quot;67&quot;, &quot;51&quot;, &quot;0&quot;, &quot;63&quot;, &quot;64&quot;, &quot;46&quot;, &quot;18&quot;, &quot;0&quot;, &quot;31&quot;, &quot;8&quot;, &quot;0&quot;, &quot;4&quot;, &quot;14&quot;, &quot;8&quot;, &quot;4&quot;, &quot;9&quot;, &quot;6&quot;, &quot;0&quot;, &quot;0&quot;], &quot;max&quot;: 29.959999084472656, &quot;min&quot;: 5.320000171661377, &quot;bins&quot;: [5.320000171661377, 6.14133356862175, 6.962666965582123, 7.784000362542495, 8.60533375950287, 9.426667156463242, 10.248000553423614, 11.069333950383987, 11.89066734734436, 12.712000744304733, 13.533334141265106, 14.35466753822548, 15.17600093518585, 15.997334332146224, 16.818667729106597, 17.64000112606697, 18.461334523027343, 19.282667919987716, 20.10400131694809, 20.925334713908462, 21.746668110868836, 22.56800150782921, 23.38933490478958, 24.210668301749955, 25.032001698710324, 25.853335095670698, 26.67466849263107, 27.496001889591444, 28.317335286551817, 29.13866868351219, 29.960002080472563], &quot;n&quot;: &quot;800&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 32.0, &quot;upper&quot;: 32.0, &quot;lower&quot;: 32.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [5.320000171661377, 5.320000171661377, 7.989999771118164, 10.989999771118164, 13.989999771118164, 17.989999771118164, 24.489999771118164, 26.989999771118164, 29.959999084472656]}, &quot;isDiscrete&quot;: false}, &quot;frequentItems&quot;: {&quot;items&quot;: [{&quot;estimate&quot;: &quot;68&quot;, &quot;jsonValue&quot;: &quot;14.49&quot;}, {&quot;estimate&quot;: &quot;66&quot;, &quot;jsonValue&quot;: &quot;17.99&quot;}, {&quot;estimate&quot;: &quot;63&quot;, &quot;jsonValue&quot;: &quot;16.99&quot;}, {&quot;estimate&quot;: &quot;62&quot;, &quot;jsonValue&quot;: &quot;12.79&quot;}, {&quot;estimate&quot;: &quot;57&quot;, &quot;jsonValue&quot;: &quot;13.99&quot;}, {&quot;estimate&quot;: &quot;52&quot;, &quot;jsonValue&quot;: &quot;15.59&quot;}, {&quot;estimate&quot;: &quot;52&quot;, &quot;jsonValue&quot;: &quot;13.49&quot;}, {&quot;estimate&quot;: &quot;48&quot;, &quot;jsonValue&quot;: &quot;18.99&quot;}, {&quot;estimate&quot;: &quot;48&quot;, &quot;jsonValue&quot;: &quot;8.99&quot;}, {&quot;estimate&quot;: &quot;47&quot;, &quot;jsonValue&quot;: &quot;9.49&quot;}, {&quot;estimate&quot;: &quot;35&quot;, &quot;jsonValue&quot;: &quot;21.49&quot;}, {&quot;estimate&quot;: &quot;30&quot;, &quot;jsonValue&quot;: &quot;19.99&quot;}, {&quot;estimate&quot;: &quot;30&quot;, &quot;jsonValue&quot;: &quot;10.49&quot;}, {&quot;estimate&quot;: &quot;27&quot;, &quot;jsonValue&quot;: &quot;8.59&quot;}, {&quot;estimate&quot;: &quot;27&quot;, &quot;jsonValue&quot;: &quot;25.69&quot;}, {&quot;estimate&quot;: &quot;27&quot;, &quot;jsonValue&quot;: &quot;10.99&quot;}, {&quot;estimate&quot;: &quot;26&quot;, &quot;jsonValue&quot;: &quot;11.49&quot;}, {&quot;estimate&quot;: &quot;26&quot;, &quot;jsonValue&quot;: &quot;27.79&quot;}]}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 32.00000246365887, &quot;upper&quot;: 32.00160019980166, &quot;lower&quot;: 32.0}}}\n",
       "\n",
       "      Handlebars.registerHelper(&quot;getDoubleHistogramChart&quot;,(column,key) =&gt; {\n",
       "          const columnKey = key.data.key\n",
       "        try {\n",
       "          if (profileFromCSVfile) {\n",
       "          return  generateDoubleHistogramChart (\n",
       "              column,\n",
       "              profileFromCSVfile[columnKey]\n",
       "            )\n",
       "          }\n",
       "        } catch (err) {\n",
       "          $(document).ready(() =&gt; \n",
       "            $(&quot;.desktop-content&quot;).html(`\n",
       "              &lt;p style=&quot;height: ${$(window).height()}px&quot; class=&quot;error-message&quot;&gt; \n",
       "                Something went wrong. Please try again.\n",
       "              &lt;/p&gt;\n",
       "            `)\n",
       "          )\n",
       "        }\n",
       "      });\n",
       "    }\n",
       "\n",
       "    function initWebsiteScripts() {\n",
       "      $(&quot;.svg-container&quot;).css(&quot;height&quot;, $(window).height() - 32)\n",
       "    }\n",
       "\n",
       "    function initHandlebarsTemplate() {\n",
       "      // Replace this context with JSON from .py file\n",
       "      const context = {&quot;int_rate&quot;: {&quot;counters&quot;: {&quot;count&quot;: &quot;200&quot;, &quot;nullCount&quot;: &quot;2&quot;}, &quot;schema&quot;: {&quot;inferredType&quot;: {&quot;type&quot;: &quot;FRACTIONAL&quot;, &quot;ratio&quot;: 1.0}, &quot;typeCounts&quot;: {&quot;FRACTIONAL&quot;: &quot;198&quot;, &quot;NULL&quot;: &quot;2&quot;}}, &quot;numberSummary&quot;: {&quot;count&quot;: &quot;198&quot;, &quot;min&quot;: 6.99, &quot;max&quot;: 26.49, &quot;mean&quot;: 13.170303030302986, &quot;stddev&quot;: 3.081443710207697, &quot;histogram&quot;: {&quot;start&quot;: 6.989999771118164, &quot;end&quot;: 26.49000242011814, &quot;counts&quot;: [&quot;1&quot;, &quot;0&quot;, &quot;2&quot;, &quot;30&quot;, &quot;0&quot;, &quot;18&quot;, &quot;22&quot;, &quot;0&quot;, &quot;19&quot;, &quot;17&quot;, &quot;21&quot;, &quot;24&quot;, &quot;0&quot;, &quot;28&quot;, &quot;0&quot;, &quot;3&quot;, &quot;2&quot;, &quot;0&quot;, &quot;0&quot;, &quot;6&quot;, &quot;0&quot;, &quot;0&quot;, &quot;3&quot;, &quot;0&quot;, &quot;0&quot;, &quot;0&quot;, &quot;1&quot;, &quot;0&quot;, &quot;0&quot;, &quot;1&quot;], &quot;max&quot;: 26.489999771118164, &quot;min&quot;: 6.989999771118164, &quot;bins&quot;: [6.989999771118164, 7.639999859418163, 8.289999947718162, 8.940000036018162, 9.590000124318161, 10.24000021261816, 10.89000030091816, 11.540000389218159, 12.190000477518158, 12.840000565818157, 13.490000654118155, 14.140000742418156, 14.790000830718155, 15.440000919018154, 16.090001007318154, 16.740001095618155, 17.39000118391815, 18.04000127221815, 18.69000136051815, 19.34000144881815, 19.990001537118147, 20.640001625418147, 21.290001713718148, 21.940001802018145, 22.590001890318145, 23.240001978618146, 23.890002066918143, 24.540002155218144, 25.190002243518144, 25.84000233181814, 26.49000242011814], &quot;n&quot;: &quot;198&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 18.0, &quot;upper&quot;: 18.0, &quot;lower&quot;: 18.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [6.989999771118164, 8.59000015258789, 8.989999771118164, 10.489999771118164, 13.489999771118164, 14.489999771118164, 19.989999771118164, 24.489999771118164, 26.489999771118164]}, &quot;isDiscrete&quot;: false}, &quot;frequentItems&quot;: {&quot;items&quot;: [{&quot;estimate&quot;: &quot;28&quot;, &quot;jsonValue&quot;: &quot;15.59&quot;}, {&quot;estimate&quot;: &quot;24&quot;, &quot;jsonValue&quot;: &quot;14.49&quot;}, {&quot;estimate&quot;: &quot;21&quot;, &quot;jsonValue&quot;: &quot;13.99&quot;}, {&quot;estimate&quot;: &quot;19&quot;, &quot;jsonValue&quot;: &quot;12.79&quot;}, {&quot;estimate&quot;: &quot;18&quot;, &quot;jsonValue&quot;: &quot;10.99&quot;}, {&quot;estimate&quot;: &quot;18&quot;, &quot;jsonValue&quot;: &quot;10.49&quot;}, {&quot;estimate&quot;: &quot;17&quot;, &quot;jsonValue&quot;: &quot;13.49&quot;}, {&quot;estimate&quot;: &quot;17&quot;, &quot;jsonValue&quot;: &quot;9.49&quot;}, {&quot;estimate&quot;: &quot;13&quot;, &quot;jsonValue&quot;: &quot;8.99&quot;}, {&quot;estimate&quot;: &quot;6&quot;, &quot;jsonValue&quot;: &quot;19.99&quot;}, {&quot;estimate&quot;: &quot;4&quot;, &quot;jsonValue&quot;: &quot;11.49&quot;}, {&quot;estimate&quot;: &quot;3&quot;, &quot;jsonValue&quot;: &quot;21.49&quot;}, {&quot;estimate&quot;: &quot;3&quot;, &quot;jsonValue&quot;: &quot;16.99&quot;}, {&quot;estimate&quot;: &quot;2&quot;, &quot;jsonValue&quot;: &quot;8.59&quot;}, {&quot;estimate&quot;: &quot;2&quot;, &quot;jsonValue&quot;: &quot;17.99&quot;}, {&quot;estimate&quot;: &quot;1&quot;, &quot;jsonValue&quot;: &quot;6.99&quot;}, {&quot;estimate&quot;: &quot;1&quot;, &quot;jsonValue&quot;: &quot;26.49&quot;}, {&quot;estimate&quot;: &quot;1&quot;, &quot;jsonValue&quot;: &quot;24.49&quot;}]}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 18.00000075995926, &quot;upper&quot;: 18.00089948650833, &quot;lower&quot;: 18.0}}};\n",
       "      // Config handlebars and pass data to HBS template\n",
       "      const source = document.getElementById(&quot;entry-template&quot;).innerHTML;\n",
       "      const template = Handlebars.compile(source);\n",
       "      const html = template(context);\n",
       "      const target = document.getElementById(&quot;generated-html&quot;);\n",
       "      target.innerHTML = html;\n",
       "    }\n",
       "\n",
       "    // Invoke functions -- keep in mind invokation order\n",
       "    registerHandlebarHelperFunctions();\n",
       "    initHandlebarsTemplate();\n",
       "    initWebsiteScripts();\n",
       "  &lt;/script&gt;\n",
       "&lt;/html&gt;\n",
       "\" width=100% height=300px frameBorder=0></iframe>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "visualization.double_histogram(feature_names=\"int_rate\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "8198a5dd",
   "metadata": {},
   "source": [
    "From this figure we can see that tthe distribution of the feature 'int_rate' in the training and the production data set is somewhat similar.\n",
    "\n",
    "We can define a KL-Divergence constraint in the same way for continuous distributions as for discrete. First, we specify that the reference distribution is the values of 'int_rate' in the training data set, and with some careful consideration (hypothetically), we have calculated that the drift should be identified as significant if it the KL-Divergence is larger than 2.5."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "id": "ef6a8105",
   "metadata": {},
   "outputs": [],
   "source": [
    "int_rate_kl_divergence_less_than = columnKLDivergenceLessThanConstraint(\n",
    "    reference_distribution = data_train['int_rate'].values,\n",
    "    threshold = 2.5,\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "990002f2",
   "metadata": {},
   "source": [
    "# Distributional Measures: KS test p-value"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "a0178ab6",
   "metadata": {},
   "source": [
    "Just like we had the Chi-Squared test p-value constraint for discrete features, we also have the KS test p-value constraint, which can be applied to test if two continuous features come from the same distribution."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "ddcfbbba",
   "metadata": {},
   "source": [
    "This is another constraint that can be used, instead of the KL-Divergence for continuous distributions. You are free to choose whichever suits your use case best."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "id": "fd1e3a38",
   "metadata": {},
   "outputs": [],
   "source": [
    "from whylogs.core.statistics.constraints import parametrizedKSTestPValueGreaterThanConstraint"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "id": "d95e71c0",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div></div><iframe srcdoc=\"&lt;!DOCTYPE html&gt;\n",
       "&lt;html lang=&quot;en&quot;&gt;\n",
       "  &lt;head&gt;\n",
       "    &lt;meta charset=&quot;UTF-8&quot; /&gt;\n",
       "    &lt;meta http-equiv=&quot;X-UA-Compatible&quot; content=&quot;IE=edge&quot; /&gt;\n",
       "    &lt;meta name=&quot;viewport&quot; content=&quot;width=device-width, initial-scale=1.0&quot; /&gt;\n",
       "    &lt;meta name=&quot;description&quot; content=&quot;&quot; /&gt;\n",
       "    &lt;meta name=&quot;author&quot; content=&quot;&quot; /&gt;\n",
       "\n",
       "    &lt;title&gt;Profile Viewer | whylogs&lt;/title&gt;\n",
       "\n",
       "    &lt;link rel=&quot;icon&quot; href=&quot;images/whylabs-favicon.png&quot; type=&quot;image/png&quot; sizes=&quot;16x16&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.googleapis.com&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.gstatic.com&quot; crossorigin /&gt;\n",
       "    &lt;link href=&quot;https://fonts.googleapis.com/css2?family=Asap:wght@400;500;600;700&amp;display=swap&quot; rel=&quot;stylesheet&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.gstatic.com&quot; /&gt;\n",
       "    &lt;link rel=&quot;stylesheet&quot; href=&quot;https://cdn.jsdelivr.net/npm/bootstrap@5.1.0/dist/css/bootstrap.min.css&quot; /&gt;\n",
       "\n",
       "    &lt;script\n",
       "      src=&quot;https://cdnjs.cloudflare.com/ajax/libs/handlebars.js/4.7.7/handlebars.min.js&quot;\n",
       "      integrity=&quot;sha512-RNLkV3d+aLtfcpEyFG8jRbnWHxUqVZozacROI4J2F1sTaDqo1dPQYs01OMi1t1w9Y2FdbSCDSQ2ZVdAC8bzgAg==&quot;\n",
       "      crossorigin=&quot;anonymous&quot;\n",
       "      referrerpolicy=&quot;no-referrer&quot;\n",
       "    &gt;&lt;/script&gt;\n",
       "\n",
       "    &lt;style type=&quot;text/css&quot;&gt;\n",
       "\n",
       "      :root {\n",
       "        /** Branded colors */\n",
       "        --brandSecondary900: #4f595b;\n",
       "        --secondaryLight1000: #313b3d;\n",
       "        /** Purpose colors */\n",
       "        --tealBackground: #eaf2f3;\n",
       "      }\n",
       "\n",
       "      /* RESET STYLE */\n",
       "      *,\n",
       "      *::after,\n",
       "      *::before {\n",
       "        margin: 0;\n",
       "        padding: 0;\n",
       "        box-sizing: border-box;\n",
       "        overflow-y: hidden;\n",
       "      }\n",
       "\n",
       "      /* Screen on smaller screens */\n",
       "      .no-responsive {\n",
       "        display: none;\n",
       "        position: fixed;\n",
       "        top: 0;\n",
       "        left: 0;\n",
       "        z-index: 1031;\n",
       "        width: 100vw;\n",
       "        height: 100vh;\n",
       "        background-color: var(--tealBackground);\n",
       "        display: flex;\n",
       "        align-items: center;\n",
       "        justify-content: center;\n",
       "      }\n",
       "\n",
       "      .desktop-content {\n",
       "        display: flex;\n",
       "        flex-direction: column;\n",
       "      }\n",
       "\n",
       "      .no-responsive__content {\n",
       "        max-width: 600px;\n",
       "        width: 100%;\n",
       "        padding: 0 24px;\n",
       "      }\n",
       "\n",
       "      .no-responsive__title {\n",
       "        font-size: 96px;\n",
       "        font-weight: 300;\n",
       "        color: var(--brandSecondary900);\n",
       "        line-height: 1.167;\n",
       "      }\n",
       "\n",
       "      .no-responsive__text {\n",
       "        margin: 0;\n",
       "        font-size: 16px;\n",
       "        font-weight: 400;\n",
       "        color: var(--brandSecondary900);\n",
       "        line-height: 1.5;\n",
       "      }\n",
       "\n",
       "      .svg-container {\n",
       "        display: inline-block;\n",
       "        position: relative;\n",
       "        width: 100%;\n",
       "        vertical-align: top;\n",
       "        overflow: hidden;\n",
       "      }\n",
       "\n",
       "      .svg-content-responsive {\n",
       "        display: inline-block;\n",
       "        position: absolute;\n",
       "        left: 0;\n",
       "      }\n",
       "\n",
       "      .circle-color {\n",
       "       display: inline-block;\n",
       "       padding: 5px;\n",
       "       border-radius: 50px;\n",
       "     }\n",
       "\n",
       "     .colors-for-distingushing-charts {\n",
       "       padding-right: 10px;\n",
       "     }\n",
       "\n",
       "     .display-flex{\n",
       "       display: flex;\n",
       "     }\n",
       "\n",
       "     .align-items-flex-end {\n",
       "       align-items: flex-end;\n",
       "     }\n",
       "\n",
       "     .chart-box-title {\n",
       "       width: 88%;\n",
       "       justify-content: space-between;\n",
       "       margin: 10px;\n",
       "       margin-top: 15px;\n",
       "       bottom: 0;\n",
       "     }\n",
       "\n",
       "     .chart-box-title p{\n",
       "       margin-bottom: 0;\n",
       "       font-family: Asap;\n",
       "       font-weight: bold;\n",
       "       font-size: 18px;\n",
       "       line-height: 16px;\n",
       "       color: #4F595B;\n",
       "     }\n",
       "    \n",
       "    .bar {\n",
       "      font: 10px sans-serif;\n",
       "    }\n",
       "  \n",
       "    .bar path,\n",
       "    .bar line {\n",
       "      fill: none;\n",
       "      stroke: #000;\n",
       "      shape-rendering: crispEdges;\n",
       "    }\n",
       "\n",
       "    .error-message {\n",
       "      display: flex;\n",
       "      justify-content: center;\n",
       "      align-items: center;\n",
       "      color: rgb(255, 114, 71);\n",
       "      font-size: 30px;\n",
       "      font-weight: 900;\n",
       "    }\n",
       "\n",
       "     @media screen and (min-width: 500px) {\n",
       "       .desktop-content {\n",
       "         display: block;\n",
       "       }\n",
       "       .no-responsive {\n",
       "         display: none;\n",
       "       }\n",
       "     }\n",
       "    &lt;/style&gt;\n",
       "  &lt;/head&gt;\n",
       "\n",
       "  &lt;body id=&quot;generated-html&quot;&gt;&lt;/body&gt;\n",
       "  &lt;script id=&quot;entry-template&quot; type=&quot;text/x-handlebars-template&quot;&gt;\n",
       "    \n",
       "      &lt;div class=&quot;desktop-content&quot;&gt;\n",
       "{{#each this}}              &lt;div class=&quot;chart-box&quot; id=&quot;chart-box&quot;&gt;\n",
       "                &lt;div class=&quot;chart-box-title display-flex&quot;&gt;\n",
       "                  &lt;p&gt;{{@key}}&lt;/p&gt;\n",
       "                  &lt;div class=&quot;display-flex&quot;&gt;\n",
       "                    &lt;div class=&quot;colors-for-distingushing-charts&quot;&gt;\n",
       "                      &lt;div class=&quot;circle-color&quot; style=&quot;background: #44C0E7;&quot;&gt;&lt;/div&gt;\n",
       "                      &lt;text alignment-baseline=&quot;middle&quot; style=&quot;font-size: 15px;&quot;&gt;Target&lt;/text&gt;\n",
       "                    &lt;/div&gt;\n",
       "                    &lt;div class=&quot;colors-for-distingushing-charts&quot;&gt;\n",
       "                      &lt;div class=&quot;circle-color&quot; style=&quot;background: #F5843C&quot;&gt;&lt;/div&gt;\n",
       "                      &lt;text alignment-baseline=&quot;middle&quot; style=&quot;font-size: 15px;&quot;&gt;Reference&lt;/text&gt;\n",
       "                    &lt;/div&gt;\n",
       "                  &lt;/div&gt;&lt;/div&gt;\n",
       "                &lt;div class=&quot;svg-container&quot;&gt;{{{getDoubleHistogramChart this}}}&lt;/div&gt;\n",
       "              &lt;/div&gt;\n",
       "{{/each}}      &lt;/div&gt;\n",
       "      &lt;div class=&quot;no-responsive&quot;&gt;\n",
       "        &lt;div class=&quot;no-responsive__content&quot;&gt;\n",
       "          &lt;h1 class=&quot;no-responsive__title&quot;&gt;Hold on! :)&lt;/h1&gt;\n",
       "          &lt;p class=&quot;no-responsive__text&quot;&gt;\n",
       "            It looks like your current screen size or device is not yet supported by the WhyLabs Sandbox. The Sandbox is\n",
       "            best experienced on a desktop computer. Please try maximizing this window or switching to another device. We\n",
       "            are working on adding support for a larger variety of devices.\n",
       "          &lt;/p&gt;\n",
       "        &lt;/div&gt;\n",
       "      &lt;/div&gt;\n",
       "    \n",
       "  &lt;/script&gt;\n",
       "\n",
       "  &lt;script src=&quot;https://code.jquery.com/jquery-3.6.0.min.js&quot; integrity=&quot;sha256-/xUj+3OJU5yExlq6GSYGSHk7tPXikynS7ogEvDej/m4=&quot; crossorigin=&quot;anonymous&quot;&gt;&lt;/script&gt;\n",
       "\n",
       "  &lt;script src=&quot;https://cdnjs.cloudflare.com/ajax/libs/d3/6.7.0/d3.min.js&quot; integrity=&quot;sha512-cd6CHE+XWDQ33ElJqsi0MdNte3S+bQY819f7p3NUHgwQQLXSKjE4cPZTeGNI+vaxZynk1wVU3hoHmow3m089wA==&quot; crossorigin=&quot;anonymous&quot; referrerpolicy=&quot;no-referrer&quot;&gt;&lt;/script&gt;\n",
       "\n",
       "  &lt;script&gt;\n",
       "    function registerHandlebarHelperFunctions() {\n",
       "      //helper fun\n",
       "\n",
       "      class GenerateChartParams {\n",
       "        constructor(height, width, targetData, referenceData, bottomMargin=30, topMargin=5) {\n",
       "          this.MARGIN = {\n",
       "            TOP: topMargin,\n",
       "            RIGHT: 5,\n",
       "            BOTTOM: bottomMargin,\n",
       "            LEFT: 55,\n",
       "          };\n",
       "          this.SVG_WIDTH = width;\n",
       "          this.SVG_HEIGHT = height;\n",
       "          this.CHART_WIDTH = this.SVG_WIDTH - this.MARGIN.LEFT - this.MARGIN.RIGHT;\n",
       "          this.CHART_HEIGHT = this.SVG_HEIGHT - this.MARGIN.TOP - this.MARGIN.BOTTOM;\n",
       "          this.svgEl = d3.create(&quot;svg&quot;)\n",
       "             .attr(&quot;preserveAspectRatio&quot;, &quot;xMinYMin meet&quot;)\n",
       "             .attr(&quot;viewBox&quot;, `0 0 ${$(window).width()+100} ${$(window).height()-30}`)\n",
       "             .classed(&quot;svg-content-responsive&quot;, true)\n",
       "          this.maxYValue = d3.max(targetData, (d) =&gt; Math.abs(d.axisY));\n",
       "          this.minYValue = d3.min(targetData, (d) =&gt; Math.abs(d.axisY));\n",
       "          const mergedReferenceData = referenceData.map(({axisX, axisY}) =&gt; {\n",
       "            return {axisX, axisY}\n",
       "          })\n",
       "          const mergedTargetedData = targetData.map(({axisX, axisY}) =&gt; {\n",
       "            return {axisX, axisY}\n",
       "          })\n",
       "\n",
       "          this.charts2 = mergedReferenceData.concat(mergedTargetedData)\n",
       "          this.charts2 = this.charts2.sort(function(a, b) { return a - b; });\n",
       "\n",
       "          this.targetBinWidth = targetData[1]?.axisX - targetData[0]?.axisX\n",
       "          this.referenceBinWidth = referenceData[1]?.axisX - referenceData[0]?.axisX\n",
       "          this.maxTargetXValue = d3.max(targetData, (d) =&gt; d.axisX);\n",
       "\n",
       "          this.maxReferenceXValue = d3.max(referenceData, (d) =&gt; d.axisX);\n",
       "\n",
       "          this.xScale = d3\n",
       "              .scaleLinear()\n",
       "         .domain([d3.min(this.charts2, function(d) { return parseFloat(d.axisX); }),(this.maxTargetXValue+this.targetBinWidth &gt;= this.maxReferenceXValue+this.referenceBinWidth) ? this.maxTargetXValue+this.targetBinWidth:this.maxReferenceXValue+this.referenceBinWidth])     // I was too lazy to do basic math of max(bin_start + width for each distribution)\n",
       "         .range([0, this.CHART_WIDTH ]);\n",
       "\n",
       "         this.svgEl.append(&quot;g&quot;)\n",
       "             .attr(&quot;transform&quot;, &quot;translate(&quot;+ this.MARGIN.LEFT +&quot;,&quot; + this.SVG_HEIGHT + &quot;)&quot;)\n",
       "             .call(d3.axisBottom(this.xScale));\n",
       "          this.yScale = d3.scaleLinear()\n",
       "              .range([this.CHART_HEIGHT , 0])\n",
       "              this.yScale.domain([d3.min(this.charts2, function(d) { return parseFloat(d.axisY); }), d3.max(this.charts2, function(d) { return parseFloat(d.axisY); })]);\n",
       "        }\n",
       "      }\n",
       "\n",
       "      function chartData(column) {\n",
       "        const data = [];\n",
       "        if (column.numberSummary?.histogram) {\n",
       "          for (let i = 0; i&lt;column.numberSummary.histogram.bins.length; i++) {\n",
       "            data.push({\n",
       "              axisY: column.numberSummary.histogram.counts[i] || 0,\n",
       "              axisX: column.numberSummary.histogram.bins[i] || 0,\n",
       "            });\n",
       "          }\n",
       "        } else {\n",
       "            $(document).ready(() =&gt; \n",
       "              $(&quot;.desktop-content&quot;).html(`\n",
       "                &lt;p style=&quot;height: ${$(window).height()}px&quot; class=&quot;error-message&quot;&gt; \n",
       "                  Something went wrong. Please try again.\n",
       "                &lt;/p&gt;\n",
       "              `)\n",
       "            )\n",
       "          }\n",
       "\n",
       "        return data\n",
       "      }\n",
       "\n",
       "      function generateDoubleHistogramChart(targetData, referenceData) {\n",
       "        let histogramData = [],\n",
       "            overlappedHistogramData = [];\n",
       "        let yFormat;\n",
       "\n",
       "        histogramData = chartData(targetData)\n",
       "        overlappedHistogramData = chartData(referenceData)\n",
       "\n",
       "        const sizes = new GenerateChartParams($(window).height()-80, $(window).width(), histogramData, overlappedHistogramData)\n",
       "        const {\n",
       "          MARGIN,\n",
       "          SVG_WIDTH,\n",
       "          SVG_HEIGHT,\n",
       "          CHART_WIDTH,\n",
       "          CHART_HEIGHT,\n",
       "          svgEl,\n",
       "          maxYValue,\n",
       "          minYValue,\n",
       "          xScale,\n",
       "          yScale\n",
       "        } = sizes\n",
       "\n",
       "        const rectColors = [&quot;#44C0E7&quot;, &quot;#F5843C&quot;]\n",
       "        const yAxis = d3.axisLeft(yScale).ticks(SVG_HEIGHT / 40, yFormat);\n",
       "        yFormat = yScale.tickFormat(100, yFormat);\n",
       "\n",
       "        svgEl.append(&quot;g&quot;)\n",
       "          .attr(&quot;transform&quot;, `translate(${MARGIN.LEFT}, ${MARGIN.BOTTOM})`)\n",
       "          .call(yAxis)\n",
       "          .call(g =&gt; g.select(&quot;.domain&quot;).remove())\n",
       "          .call(g =&gt; g.selectAll(&quot;.tick line&quot;)\n",
       "              .attr(&quot;x2&quot;, CHART_WIDTH)\n",
       "              .attr(&quot;stroke-opacity&quot;, 0.1))\n",
       "          .call(g =&gt; g.append(&quot;text&quot;)\n",
       "              .attr(&quot;x&quot;, -MARGIN.LEFT)\n",
       "              .attr(&quot;y&quot;, 10)\n",
       "              .attr(&quot;fill&quot;, &quot;currentColor&quot;)\n",
       "              .attr(&quot;text-anchor&quot;, &quot;start&quot;))\n",
       "\n",
       "        svgEl.append(&quot;text&quot;)\n",
       "          .attr(&quot;transform&quot;,\n",
       "                &quot;translate(&quot; + (CHART_WIDTH/2) + &quot; ,&quot; +\n",
       "                               (CHART_HEIGHT + MARGIN.TOP + 75) + &quot;)&quot;)\n",
       "          .style(&quot;text-anchor&quot;, &quot;middle&quot;)\n",
       "          .text(&quot;Values&quot;)\n",
       "          .style(&quot;font-size&quot;, &quot;15&quot;)\n",
       "          .style(&quot;opacity&quot;, &quot;0.6&quot;)\n",
       "\n",
       "        svgEl.append(&quot;text&quot;)\n",
       "          .attr(&quot;transform&quot;, &quot;rotate(-90)&quot;)\n",
       "          .attr(&quot;y&quot;, 0)\n",
       "          .attr(&quot;x&quot;, 0 - (SVG_HEIGHT / 2))\n",
       "          .attr(&quot;dy&quot;, &quot;1em&quot;)\n",
       "          .style(&quot;text-anchor&quot;, &quot;middle&quot;)\n",
       "          .text(&quot;Counts&quot;)\n",
       "          .style(&quot;font-size&quot;, &quot;15&quot;)\n",
       "          .style(&quot;opacity&quot;, &quot;0.6&quot;)\n",
       "\n",
       "          const gChart = svgEl.append(&quot;g&quot;);\n",
       "          gChart\n",
       "          .attr(&quot;transform&quot;, &quot;translate(&quot;+ MARGIN.LEFT +&quot;,0)&quot;)\n",
       "          .selectAll(&quot;.bar&quot;)\n",
       "          .data(histogramData)\n",
       "          .enter()\n",
       "          .append(&quot;rect&quot;)\n",
       "          .style(&quot;stroke&quot;, &quot;#021826&quot;)\n",
       "          .classed(&quot;bar&quot;, true)\n",
       "          .attr(&quot;width&quot;, function(d) { return xScale(histogramData[1]?.axisX)-xScale(histogramData[0]?.axisX); })\n",
       "          .attr(&quot;height&quot;, (d) =&gt; CHART_HEIGHT - yScale(d.axisY))\n",
       "          .attr(&quot;x&quot;, 1)\n",
       "          .attr(&quot;transform&quot;, function(d) { return &quot;translate(&quot; + xScale(d.axisX) + &quot;,&quot; + 0  +  &quot;)&quot;; })\n",
       "          .attr(&quot;y&quot;, (d) =&gt; yScale(d.axisY) + MARGIN.TOP + MARGIN.BOTTOM)\n",
       "          .attr(&quot;fill&quot;, rectColors[0])\n",
       "          .style(&quot;opacity&quot;,&quot;0.6&quot;)\n",
       "\n",
       "          const gChart1 = svgEl.append(&quot;g&quot;);\n",
       "          gChart1\n",
       "          .attr(&quot;transform&quot;, &quot;translate(&quot;+ MARGIN.LEFT +&quot;,0)&quot;)\n",
       "          .selectAll(&quot;.bar&quot;)\n",
       "          .data(overlappedHistogramData)\n",
       "          .enter()\n",
       "          .append(&quot;rect&quot;)\n",
       "          .style(&quot;stroke&quot;, &quot;#021826&quot;)\n",
       "          .classed(&quot;bar&quot;, true)\n",
       "          .attr(&quot;width&quot;, function(d) { return xScale(overlappedHistogramData[1]?.axisX)-xScale(overlappedHistogramData[0]?.axisX); })\n",
       "          .attr(&quot;height&quot;, (d) =&gt; CHART_HEIGHT - yScale(d.axisY))\n",
       "          .attr(&quot;x&quot;, 1)\n",
       "          .attr(&quot;transform&quot;, function(d) { return &quot;translate(&quot; + xScale(d.axisX) + &quot;,&quot; + 0  +  &quot;)&quot;; })\n",
       "          .attr(&quot;y&quot;, (d) =&gt; yScale(d.axisY) + MARGIN.TOP + MARGIN.BOTTOM)\n",
       "          .attr(&quot;fill&quot;, rectColors[1])\n",
       "          .style(&quot;opacity&quot;,&quot;0.6&quot;)\n",
       "\n",
       "        return svgEl._groups[0][0].outerHTML;\n",
       "      }\n",
       "\n",
       "      const profileFromCSVfile = {&quot;loan_amnt&quot;: {&quot;counters&quot;: {&quot;count&quot;: &quot;800&quot;}, &quot;schema&quot;: {&quot;inferredType&quot;: {&quot;type&quot;: &quot;FRACTIONAL&quot;, &quot;ratio&quot;: 1.0}, &quot;typeCounts&quot;: {&quot;FRACTIONAL&quot;: &quot;800&quot;}}, &quot;numberSummary&quot;: {&quot;count&quot;: &quot;800&quot;, &quot;min&quot;: 1000.0, &quot;max&quot;: 40000.0, &quot;mean&quot;: 16271.1875, &quot;stddev&quot;: 10051.962904086211, &quot;histogram&quot;: {&quot;start&quot;: 1000.0, &quot;end&quot;: 40000.004, &quot;counts&quot;: [&quot;10&quot;, &quot;30&quot;, &quot;17&quot;, &quot;70&quot;, &quot;46&quot;, &quot;53&quot;, &quot;78&quot;, &quot;15&quot;, &quot;57&quot;, &quot;25&quot;, &quot;55&quot;, &quot;23&quot;, &quot;18&quot;, &quot;26&quot;, &quot;50&quot;, &quot;15&quot;, &quot;9&quot;, &quot;20&quot;, &quot;29&quot;, &quot;9&quot;, &quot;16&quot;, &quot;1&quot;, &quot;32&quot;, &quot;6&quot;, &quot;2&quot;, &quot;5&quot;, &quot;69&quot;, &quot;0&quot;, &quot;0&quot;, &quot;14&quot;], &quot;max&quot;: 40000.0, &quot;min&quot;: 1000.0, &quot;bins&quot;: [1000.0, 2300.0001333333335, 3600.000266666667, 4900.000400000001, 6200.000533333334, 7500.000666666667, 8800.000800000002, 10100.000933333335, 11400.001066666668, 12700.0012, 14000.001333333334, 15300.001466666668, 16600.001600000003, 17900.001733333334, 19200.00186666667, 20500.002, 21800.002133333335, 23100.00226666667, 24400.0024, 25700.002533333336, 27000.002666666667, 28300.002800000002, 29600.002933333337, 30900.003066666668, 32200.003200000003, 33500.00333333334, 34800.00346666667, 36100.003600000004, 37400.00373333334, 38700.00386666667, 40000.004], &quot;n&quot;: &quot;800&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 183.0, &quot;upper&quot;: 183.0, &quot;lower&quot;: 183.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [1000.0, 2000.0, 4000.0, 8000.0, 14000.0, 23350.0, 35000.0, 40000.0, 40000.0]}, &quot;isDiscrete&quot;: false}, &quot;frequentItems&quot;: {&quot;items&quot;: [{&quot;estimate&quot;: &quot;61&quot;, &quot;jsonValue&quot;: &quot;35000.0&quot;}, {&quot;estimate&quot;: &quot;57&quot;, &quot;jsonValue&quot;: &quot;10000.0&quot;}, {&quot;estimate&quot;: &quot;45&quot;, &quot;jsonValue&quot;: &quot;15000.0&quot;}, {&quot;estimate&quot;: &quot;44&quot;, &quot;jsonValue&quot;: &quot;12000.0&quot;}, {&quot;estimate&quot;: &quot;42&quot;, &quot;jsonValue&quot;: &quot;20000.0&quot;}, {&quot;estimate&quot;: &quot;40&quot;, &quot;jsonValue&quot;: &quot;8000.0&quot;}, {&quot;estimate&quot;: &quot;32&quot;, &quot;jsonValue&quot;: &quot;5000.0&quot;}, {&quot;estimate&quot;: &quot;31&quot;, &quot;jsonValue&quot;: &quot;25000.0&quot;}, {&quot;estimate&quot;: &quot;29&quot;, &quot;jsonValue&quot;: &quot;18000.0&quot;}, {&quot;estimate&quot;: &quot;28&quot;, &quot;jsonValue&quot;: &quot;30000.0&quot;}, {&quot;estimate&quot;: &quot;27&quot;, &quot;jsonValue&quot;: &quot;28000.0&quot;}, {&quot;estimate&quot;: &quot;27&quot;, &quot;jsonValue&quot;: &quot;21000.0&quot;}, {&quot;estimate&quot;: &quot;27&quot;, &quot;jsonValue&quot;: &quot;24000.0&quot;}, {&quot;estimate&quot;: &quot;26&quot;, &quot;jsonValue&quot;: &quot;7000.0&quot;}, {&quot;estimate&quot;: &quot;26&quot;, &quot;jsonValue&quot;: &quot;12600.0&quot;}, {&quot;estimate&quot;: &quot;26&quot;, &quot;jsonValue&quot;: &quot;40000.0&quot;}, {&quot;estimate&quot;: &quot;26&quot;, &quot;jsonValue&quot;: &quot;12800.0&quot;}, {&quot;estimate&quot;: &quot;26&quot;, &quot;jsonValue&quot;: &quot;16925.0&quot;}, {&quot;estimate&quot;: &quot;26&quot;, &quot;jsonValue&quot;: &quot;16000.0&quot;}, {&quot;estimate&quot;: &quot;26&quot;, &quot;jsonValue&quot;: &quot;36000.0&quot;}, {&quot;estimate&quot;: &quot;26&quot;, &quot;jsonValue&quot;: &quot;14225.0&quot;}, {&quot;estimate&quot;: &quot;26&quot;, &quot;jsonValue&quot;: &quot;3000.0&quot;}, {&quot;estimate&quot;: &quot;26&quot;, &quot;jsonValue&quot;: &quot;17400.0&quot;}]}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 183.00008271638887, &quot;upper&quot;: 183.00921977338194, &quot;lower&quot;: 183.0}}}\n",
       "\n",
       "      Handlebars.registerHelper(&quot;getDoubleHistogramChart&quot;,(column,key) =&gt; {\n",
       "          const columnKey = key.data.key\n",
       "        try {\n",
       "          if (profileFromCSVfile) {\n",
       "          return  generateDoubleHistogramChart (\n",
       "              column,\n",
       "              profileFromCSVfile[columnKey]\n",
       "            )\n",
       "          }\n",
       "        } catch (err) {\n",
       "          $(document).ready(() =&gt; \n",
       "            $(&quot;.desktop-content&quot;).html(`\n",
       "              &lt;p style=&quot;height: ${$(window).height()}px&quot; class=&quot;error-message&quot;&gt; \n",
       "                Something went wrong. Please try again.\n",
       "              &lt;/p&gt;\n",
       "            `)\n",
       "          )\n",
       "        }\n",
       "      });\n",
       "    }\n",
       "\n",
       "    function initWebsiteScripts() {\n",
       "      $(&quot;.svg-container&quot;).css(&quot;height&quot;, $(window).height() - 32)\n",
       "    }\n",
       "\n",
       "    function initHandlebarsTemplate() {\n",
       "      // Replace this context with JSON from .py file\n",
       "      const context = {&quot;loan_amnt&quot;: {&quot;counters&quot;: {&quot;count&quot;: &quot;200&quot;, &quot;nullCount&quot;: &quot;2&quot;}, &quot;schema&quot;: {&quot;inferredType&quot;: {&quot;type&quot;: &quot;FRACTIONAL&quot;, &quot;ratio&quot;: 1.0}, &quot;typeCounts&quot;: {&quot;FRACTIONAL&quot;: &quot;198&quot;, &quot;NULL&quot;: &quot;2&quot;}}, &quot;numberSummary&quot;: {&quot;count&quot;: &quot;198&quot;, &quot;min&quot;: 2000.0, &quot;max&quot;: 40000.0, &quot;mean&quot;: 21416.035353535353, &quot;stddev&quot;: 9169.394569176375, &quot;histogram&quot;: {&quot;start&quot;: 2000.0, &quot;end&quot;: 40000.004, &quot;counts&quot;: [&quot;1&quot;, &quot;2&quot;, &quot;2&quot;, &quot;2&quot;, &quot;4&quot;, &quot;2&quot;, &quot;10&quot;, &quot;13&quot;, &quot;8&quot;, &quot;7&quot;, &quot;9&quot;, &quot;14&quot;, &quot;6&quot;, &quot;7&quot;, &quot;22&quot;, &quot;4&quot;, &quot;3&quot;, &quot;18&quot;, &quot;10&quot;, &quot;1&quot;, &quot;5&quot;, &quot;2&quot;, &quot;12&quot;, &quot;5&quot;, &quot;0&quot;, &quot;0&quot;, &quot;16&quot;, &quot;2&quot;, &quot;1&quot;, &quot;10&quot;], &quot;max&quot;: 40000.0, &quot;min&quot;: 2000.0, &quot;bins&quot;: [2000.0, 3266.6668, 4533.3336, 5800.0004, 7066.6672, 8333.333999999999, 9600.0008, 10866.6676, 12133.3344, 13400.001199999999, 14666.668, 15933.3348, 17200.0016, 18466.6684, 19733.3352, 21000.002, 22266.6688, 23533.3356, 24800.002399999998, 26066.6692, 27333.336, 28600.0028, 29866.6696, 31133.3364, 32400.0032, 33666.67, 34933.3368, 36200.0036, 37466.6704, 38733.3372, 40000.004], &quot;n&quot;: &quot;198&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 64.0, &quot;upper&quot;: 64.0, &quot;lower&quot;: 64.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [2000.0, 4500.0, 8000.0, 14400.0, 20000.0, 28000.0, 39000.0, 40000.0, 40000.0]}, &quot;isDiscrete&quot;: false}, &quot;frequentItems&quot;: {&quot;items&quot;: [{&quot;estimate&quot;: &quot;18&quot;, &quot;jsonValue&quot;: &quot;20000.0&quot;}, {&quot;estimate&quot;: &quot;16&quot;, &quot;jsonValue&quot;: &quot;24000.0&quot;}, {&quot;estimate&quot;: &quot;14&quot;, &quot;jsonValue&quot;: &quot;35000.0&quot;}, {&quot;estimate&quot;: &quot;12&quot;, &quot;jsonValue&quot;: &quot;16000.0&quot;}, {&quot;estimate&quot;: &quot;11&quot;, &quot;jsonValue&quot;: &quot;30000.0&quot;}, {&quot;estimate&quot;: &quot;10&quot;, &quot;jsonValue&quot;: &quot;10000.0&quot;}, {&quot;estimate&quot;: &quot;10&quot;, &quot;jsonValue&quot;: &quot;25000.0&quot;}, {&quot;estimate&quot;: &quot;9&quot;, &quot;jsonValue&quot;: &quot;40000.0&quot;}, {&quot;estimate&quot;: &quot;9&quot;, &quot;jsonValue&quot;: &quot;12000.0&quot;}, {&quot;estimate&quot;: &quot;7&quot;, &quot;jsonValue&quot;: &quot;32000.0&quot;}, {&quot;estimate&quot;: &quot;6&quot;, &quot;jsonValue&quot;: &quot;28000.0&quot;}, {&quot;estimate&quot;: &quot;6&quot;, &quot;jsonValue&quot;: &quot;15000.0&quot;}, {&quot;estimate&quot;: &quot;6&quot;, &quot;jsonValue&quot;: &quot;29400.0&quot;}, {&quot;estimate&quot;: &quot;6&quot;, &quot;jsonValue&quot;: &quot;18000.0&quot;}, {&quot;estimate&quot;: &quot;6&quot;, &quot;jsonValue&quot;: &quot;14000.0&quot;}, {&quot;estimate&quot;: &quot;6&quot;, &quot;jsonValue&quot;: &quot;11200.0&quot;}, {&quot;estimate&quot;: &quot;6&quot;, &quot;jsonValue&quot;: &quot;23800.0&quot;}]}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 64.00001001358214, &quot;upper&quot;: 64.00320548612167, &quot;lower&quot;: 64.0}}};\n",
       "      // Config handlebars and pass data to HBS template\n",
       "      const source = document.getElementById(&quot;entry-template&quot;).innerHTML;\n",
       "      const template = Handlebars.compile(source);\n",
       "      const html = template(context);\n",
       "      const target = document.getElementById(&quot;generated-html&quot;);\n",
       "      target.innerHTML = html;\n",
       "    }\n",
       "\n",
       "    // Invoke functions -- keep in mind invokation order\n",
       "    registerHandlebarHelperFunctions();\n",
       "    initHandlebarsTemplate();\n",
       "    initWebsiteScripts();\n",
       "  &lt;/script&gt;\n",
       "&lt;/html&gt;\n",
       "\" width=100% height=300px frameBorder=0></iframe>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "visualization.double_histogram(feature_names=\"loan_amnt\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "cfef0d1c",
   "metadata": {},
   "source": [
    "The distributions of 'loan_amnt' seems a bit different in both data sets."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "e4aea50f",
   "metadata": {},
   "source": [
    "We can define the 'parametrizedKSTestPValueGreaterThanConstraint' in a similar way to all of the other distributional measures constraints. We set the reference_distribution to be equal to the values of the feature 'loan_amnt' in the training data set, and we set the p-value to 0.05."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "id": "da7f0b90",
   "metadata": {},
   "outputs": [],
   "source": [
    "loan_amnt_ks_test_p_value_greater_than = parametrizedKSTestPValueGreaterThanConstraint(\n",
    "    reference_distribution = data_train['loan_amnt'].values,\n",
    "    p_value = 0.05,\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "87ac4b0e",
   "metadata": {},
   "source": [
    "# Single Feature Distributional Measure: Entropy"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "4d0168fa",
   "metadata": {},
   "source": [
    "Another use-case we might be interested in is deciding which features provide value, or don't have a large amount of uncertanity within their values. For these reason we can use the 'approximateEntropyBetweenConstraint'."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "id": "ed351f1a",
   "metadata": {},
   "outputs": [],
   "source": [
    "from whylogs.core.statistics.constraints import approximateEntropyBetweenConstraint"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "id": "64e4321f",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div></div><iframe srcdoc=\"&lt;!DOCTYPE html&gt;\n",
       "&lt;html lang=&quot;en&quot;&gt;\n",
       "  &lt;head&gt;\n",
       "    &lt;meta charset=&quot;UTF-8&quot; /&gt;\n",
       "    &lt;meta http-equiv=&quot;X-UA-Compatible&quot; content=&quot;IE=edge&quot; /&gt;\n",
       "    &lt;meta name=&quot;viewport&quot; content=&quot;width=device-width, initial-scale=1.0&quot; /&gt;\n",
       "    &lt;meta name=&quot;description&quot; content=&quot;&quot; /&gt;\n",
       "    &lt;meta name=&quot;author&quot; content=&quot;&quot; /&gt;\n",
       "\n",
       "    &lt;title&gt;Profile Viewer | whylogs&lt;/title&gt;\n",
       "\n",
       "    &lt;link rel=&quot;icon&quot; href=&quot;images/whylabs-favicon.png&quot; type=&quot;image/png&quot; sizes=&quot;16x16&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.googleapis.com&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.gstatic.com&quot; crossorigin /&gt;\n",
       "    &lt;link href=&quot;https://fonts.googleapis.com/css2?family=Asap:wght@400;500;600;700&amp;display=swap&quot; rel=&quot;stylesheet&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.gstatic.com&quot; /&gt;\n",
       "    &lt;link rel=&quot;stylesheet&quot; href=&quot;https://cdn.jsdelivr.net/npm/bootstrap@5.1.0/dist/css/bootstrap.min.css&quot; /&gt;\n",
       "\n",
       "    &lt;script\n",
       "      src=&quot;https://cdnjs.cloudflare.com/ajax/libs/handlebars.js/4.7.7/handlebars.min.js&quot;\n",
       "      integrity=&quot;sha512-RNLkV3d+aLtfcpEyFG8jRbnWHxUqVZozacROI4J2F1sTaDqo1dPQYs01OMi1t1w9Y2FdbSCDSQ2ZVdAC8bzgAg==&quot;\n",
       "      crossorigin=&quot;anonymous&quot;\n",
       "      referrerpolicy=&quot;no-referrer&quot;\n",
       "    &gt;&lt;/script&gt;\n",
       "\n",
       "    &lt;style type=&quot;text/css&quot;&gt;\n",
       "\n",
       "      :root {\n",
       "        /** Branded colors */\n",
       "        --brandSecondary900: #4f595b;\n",
       "        --secondaryLight1000: #313b3d;\n",
       "        /** Purpose colors */\n",
       "        --tealBackground: #eaf2f3;\n",
       "      }\n",
       "\n",
       "      /* RESET STYLE */\n",
       "      *,\n",
       "      *::after,\n",
       "      *::before {\n",
       "        margin: 0;\n",
       "        padding: 0;\n",
       "        box-sizing: border-box;\n",
       "        overflow-y: hidden;\n",
       "      }\n",
       "\n",
       "      /* Screen on smaller screens */\n",
       "      .no-responsive {\n",
       "        display: none;\n",
       "        position: fixed;\n",
       "        top: 0;\n",
       "        left: 0;\n",
       "        z-index: 1031;\n",
       "        width: 100vw;\n",
       "        height: 100vh;\n",
       "        background-color: var(--tealBackground);\n",
       "        display: flex;\n",
       "        align-items: center;\n",
       "        justify-content: center;\n",
       "      }\n",
       "\n",
       "      .desktop-content {\n",
       "        display: flex;\n",
       "        flex-direction: column;\n",
       "      }\n",
       "\n",
       "      .no-responsive__content {\n",
       "        max-width: 600px;\n",
       "        width: 100%;\n",
       "        padding: 0 24px;\n",
       "      }\n",
       "\n",
       "      .no-responsive__title {\n",
       "        font-size: 96px;\n",
       "        font-weight: 300;\n",
       "        color: var(--brandSecondary900);\n",
       "        line-height: 1.167;\n",
       "      }\n",
       "\n",
       "      .no-responsive__text {\n",
       "        margin: 0;\n",
       "        font-size: 16px;\n",
       "        font-weight: 400;\n",
       "        color: var(--brandSecondary900);\n",
       "        line-height: 1.5;\n",
       "      }\n",
       "\n",
       "      .svg-container {\n",
       "        display: inline-block;\n",
       "        position: relative;\n",
       "        width: 100%;\n",
       "        vertical-align: top;\n",
       "        overflow: hidden;\n",
       "      }\n",
       "\n",
       "      .svg-content-responsive {\n",
       "        display: inline-block;\n",
       "        position: absolute;\n",
       "        left: 0;\n",
       "      }\n",
       "\n",
       "      .circle-color {\n",
       "       display: inline-block;\n",
       "       padding: 5px;\n",
       "       border-radius: 50px;\n",
       "     }\n",
       "\n",
       "     .colors-for-distingushing-charts {\n",
       "       padding-right: 10px;\n",
       "     }\n",
       "\n",
       "     .display-flex{\n",
       "       display: flex;\n",
       "     }\n",
       "\n",
       "     .flex-direction-column {\n",
       "       flex-direction: column;\n",
       "     }\n",
       "\n",
       "     .align-items-flex-end {\n",
       "       align-items: flex-end;\n",
       "     }\n",
       "\n",
       "     .chart-box-title {\n",
       "       width: 98%;\n",
       "       justify-content: space-between;\n",
       "       margin: 10px;\n",
       "       margin-top: 15px;\n",
       "       bottom: 0;\n",
       "     }\n",
       "\n",
       "     .chart-box-title p{\n",
       "       margin-bottom: 0;\n",
       "       font-family: Asap;\n",
       "       font-weight: bold;\n",
       "       font-size: 18px;\n",
       "       line-height: 16px;\n",
       "       color: #4F595B;\n",
       "     }\n",
       "\n",
       "     .error-message {\n",
       "       display: flex;\n",
       "       justify-content: center;\n",
       "       align-items: center;\n",
       "       color: rgb(255, 114, 71);\n",
       "       font-size: 30px;\n",
       "       font-weight: 900;\n",
       "     }\n",
       "\n",
       "     @media screen and (min-width: 500px) {\n",
       "       .desktop-content {\n",
       "         display: block;\n",
       "       }\n",
       "       .no-responsive {\n",
       "         display: none;\n",
       "       }\n",
       "     }\n",
       "    &lt;/style&gt;\n",
       "  &lt;/head&gt;\n",
       "\n",
       "  &lt;body id=&quot;generated-html&quot;&gt;&lt;/body&gt;\n",
       "  &lt;script id=&quot;entry-template&quot; type=&quot;text/x-handlebars-template&quot;&gt;\n",
       "    \n",
       "      &lt;div class=&quot;desktop-content&quot;&gt;\n",
       "{{#each this}}              &lt;div class=&quot;chart-box&quot; id=&quot;chart-box&quot;&gt;\n",
       "                &lt;div class=&quot;chart-box-title display-flex&quot;&gt;\n",
       "                  &lt;p&gt;{{@key}}&lt;/p&gt;\n",
       "                  &lt;div class=&quot;display-flex&quot;&gt;\n",
       "                    &lt;div class=&quot;colors-for-distingushing-charts&quot;&gt;\n",
       "                      &lt;div class=&quot;circle-color&quot; style=&quot;background: #44C0E7;&quot;&gt;&lt;/div&gt;\n",
       "                      &lt;text alignment-baseline=&quot;middle&quot; style=&quot;font-size: 15px;&quot;&gt;Target&lt;/text&gt;\n",
       "                    &lt;/div&gt;\n",
       "                    &lt;div class=&quot;colors-for-distingushing-charts&quot;&gt;\n",
       "                      &lt;div class=&quot;circle-color&quot; style=&quot;background: #F5843C&quot;&gt;&lt;/div&gt;\n",
       "                      &lt;text alignment-baseline=&quot;middle&quot; style=&quot;font-size: 15px;&quot;&gt;Reference&lt;/text&gt;\n",
       "                    &lt;/div&gt;\n",
       "                  &lt;/div&gt;&lt;/div&gt;\n",
       "                &lt;div class=&quot;svg-container&quot;&gt;\n",
       "                  {{{getDoubleHistogramChart this}}}\n",
       "                &lt;/div&gt;\n",
       "              &lt;/div&gt;\n",
       "{{/each}}      &lt;/div&gt;\n",
       "      &lt;div class=&quot;no-responsive&quot;&gt;\n",
       "        &lt;div class=&quot;no-responsive__content&quot;&gt;\n",
       "          &lt;h1 class=&quot;no-responsive__title&quot;&gt;Hold on! :)&lt;/h1&gt;\n",
       "          &lt;p class=&quot;no-responsive__text&quot;&gt;\n",
       "            It looks like your current screen size or device is not yet supported by the WhyLabs Sandbox. The Sandbox is\n",
       "            best experienced on a desktop computer. Please try maximizing this window or switching to another device. We\n",
       "            are working on adding support for a larger variety of devices.\n",
       "          &lt;/p&gt;\n",
       "        &lt;/div&gt;\n",
       "      &lt;/div&gt;\n",
       "    \n",
       "  &lt;/script&gt;\n",
       "\n",
       "  &lt;script src=&quot;https://code.jquery.com/jquery-3.6.0.min.js&quot; integrity=&quot;sha256-/xUj+3OJU5yExlq6GSYGSHk7tPXikynS7ogEvDej/m4=&quot; crossorigin=&quot;anonymous&quot;&gt;&lt;/script&gt;\n",
       "\n",
       "  &lt;script src=&quot;https://cdnjs.cloudflare.com/ajax/libs/d3/6.7.0/d3.min.js&quot; integrity=&quot;sha512-cd6CHE+XWDQ33ElJqsi0MdNte3S+bQY819f7p3NUHgwQQLXSKjE4cPZTeGNI+vaxZynk1wVU3hoHmow3m089wA==&quot; crossorigin=&quot;anonymous&quot; referrerpolicy=&quot;no-referrer&quot;&gt;&lt;/script&gt;\n",
       "\n",
       "  &lt;script&gt;\n",
       "   function registerHandlebarHelperFunctions() {\n",
       "     \n",
       "    const findAndDeleteUndefined = (axisData) =&gt; {\n",
       "      const undefinedAxisIndex = axisData.findIndex((axis) =&gt; axis === undefined)\n",
       "      if (undefinedAxisIndex == -1) {\n",
       "        return axisData;\n",
       "      }\n",
       "\n",
       "      const result = [...axisData.slice(0, undefinedAxisIndex), ...axisData.slice(undefinedAxisIndex + 1)]\n",
       "      return result\n",
       "    }\n",
       "\n",
       "    const filterAndSortChartData = (overlappedHistogramData, histogramData) =&gt; {\n",
       "        const filteredData = overlappedHistogramData\n",
       "          .map((d) =&gt;\n",
       "            histogramData\n",
       "            .filter((ref) =&gt; d.axisX === ref.axisX )[0])\n",
       "            .sort((a, b) =&gt; {\n",
       "              if (+a.axisY &lt; +b.axisY) {\n",
       "                return 1;\n",
       "              }\n",
       "              if (+a.axisY &gt; +b.axisY) {\n",
       "                return -1;\n",
       "              }\n",
       "\n",
       "              return 0;\n",
       "            })\n",
       "            .slice(0, 20)\n",
       "\n",
       "        return findAndDeleteUndefined(filteredData)\n",
       "      }\n",
       "\n",
       "      class GenerateChartParams {\n",
       "        constructor(height, width, data, referenceData, bottomMargin=30, topMargin=5) {\n",
       "          this.MARGIN = {\n",
       "            TOP: topMargin,\n",
       "            RIGHT: 5,\n",
       "            BOTTOM: bottomMargin,\n",
       "            LEFT: 55,\n",
       "          };\n",
       "          this.SVG_WIDTH = width;\n",
       "          this.SVG_HEIGHT = height;\n",
       "          this.CHART_WIDTH = this.SVG_WIDTH - this.MARGIN.LEFT - this.MARGIN.RIGHT;\n",
       "          this.CHART_HEIGHT = this.SVG_HEIGHT - this.MARGIN.TOP - this.MARGIN.BOTTOM;\n",
       "          this.svgEl = d3.create(&quot;svg&quot;)\n",
       "             .attr(&quot;preserveAspectRatio&quot;, &quot;xMinYMin meet&quot;)\n",
       "             .attr(&quot;viewBox&quot;, `0 0 ${$(window).width()} ${$(window).height()-30}`)\n",
       "             .classed(&quot;svg-content-responsive&quot;, true)\n",
       "          this.maxYValue = d3.max([...data, ...referenceData], (d) =&gt; Math.abs(d.axisY));\n",
       "          this.xScale = d3\n",
       "            .scaleBand()\n",
       "            .domain(filterAndSortChartData(data, referenceData).map((sortedCounts) =&gt; sortedCounts?.axisX))\n",
       "            .range([this.MARGIN.LEFT, this.MARGIN.LEFT + this.CHART_WIDTH]);\n",
       "          this.yScale = d3\n",
       "            .scaleLinear()\n",
       "            .domain([0, this.maxYValue * 1.2])\n",
       "            .range([this.CHART_HEIGHT, 0]);\n",
       "        }\n",
       "      }\n",
       "\n",
       "      function chartData(column) {\n",
       "        const data = [];\n",
       "          if (column.stringSummary?.frequent) {\n",
       "            Object.entries(column.stringSummary.frequent.items).forEach(([key, {value, estimate}], index) =&gt; {\n",
       "              data.push({\n",
       "                axisY: estimate,\n",
       "                axisX: value,\n",
       "              });\n",
       "            });\n",
       "          } else if (column.stringSummary?.charPosTracker){\n",
       "            Object.entries(column.stringSummary.charPosTracker.charPosMap).forEach(([key, {count}], index) =&gt; {\n",
       "              data.push({\n",
       "                axisY: count,\n",
       "                axisX: key,\n",
       "              });\n",
       "            });\n",
       "          } else {\n",
       "            $(document).ready(() =&gt; \n",
       "              $(&quot;.desktop-content&quot;).html(`\n",
       "                &lt;p style=&quot;height: ${$(window).height()}px&quot; class=&quot;error-message&quot;&gt; \n",
       "                  Something went wrong. Please try again.\n",
       "                &lt;/p&gt;\n",
       "              `)\n",
       "            )\n",
       "          }\n",
       "\n",
       "        return data\n",
       "      }\n",
       "\n",
       "\n",
       "      function CheckNumberSummary(column) {\n",
       "        if (column.numberSummary) {\n",
       "          return true\n",
       "        } else {\n",
       "          return false\n",
       "        }\n",
       "      }\n",
       "\n",
       "      function generateBarChart(histogramData, overlappedHistogramData) {\n",
       "        let yFormat,\n",
       "            xFormat;\n",
       "        const data = filterAndSortChartData(chartData(histogramData), chartData(overlappedHistogramData)).map((axis, index) =&gt; {\n",
       "          if (axis) {\n",
       "            const findIndex = chartData(histogramData).findIndex((value) =&gt; value.axisX === axis.axisX)\n",
       "            return {\n",
       "              group: axis.axisX,\n",
       "              profile: axis.axisY,\n",
       "              reference_profile: chartData(histogramData)[findIndex].axisY\n",
       "            }\n",
       "          }\n",
       "          return 0;\n",
       "        })\n",
       "    \n",
       "        const sizes = new GenerateChartParams($(window).height()-60, $(window).width(), chartData(histogramData), chartData(overlappedHistogramData))\n",
       "        let {\n",
       "          MARGIN,\n",
       "          SVG_WIDTH,\n",
       "          SVG_HEIGHT,\n",
       "          CHART_WIDTH,\n",
       "          CHART_HEIGHT,\n",
       "          svgEl,\n",
       "          xScale,\n",
       "          yScale\n",
       "        } = sizes\n",
       "    \n",
       "        const rectColors = [&quot;#44C0E7&quot;, &quot;#F5843C&quot;]\n",
       "        const subgroups = [&#x27;reference_profile&#x27;, &#x27;profile&#x27;]\n",
       "    \n",
       "        xScale.padding([0.3])\n",
       "    \n",
       "        const xAxis = d3.axisBottom(xScale).ticks(SVG_WIDTH / 80, xFormat).tickSizeOuter(0);\n",
       "        const yAxis = d3.axisLeft(yScale).ticks(SVG_HEIGHT / 40, yFormat);\n",
       "        yFormat = yScale.tickFormat(100, yFormat);\n",
       "    \n",
       "        svgEl.append(&quot;g&quot;)\n",
       "          .attr(&quot;transform&quot;, `translate(${MARGIN.LEFT}, 0)`)\n",
       "          .attr(&quot;id&quot;, &quot;g1&quot;)\n",
       "          .call(yAxis)\n",
       "          .call(g =&gt; g.select(&quot;.domain&quot;).remove())\n",
       "          .call(g =&gt; g.selectAll(&quot;.tick line&quot;)\n",
       "              .attr(&quot;x2&quot;, CHART_WIDTH)\n",
       "              .attr(&quot;stroke-opacity&quot;, 0.1))\n",
       "          .call(g =&gt; g.append(&quot;text&quot;)\n",
       "              .attr(&quot;x&quot;, -MARGIN.LEFT)\n",
       "              .attr(&quot;y&quot;, 10)\n",
       "              .attr(&quot;fill&quot;, &quot;currentColor&quot;)\n",
       "              .attr(&quot;text-anchor&quot;, &quot;start&quot;));\n",
       "\n",
       "        svgEl.append(&quot;text&quot;)\n",
       "          .attr(&quot;transform&quot;,\n",
       "                &quot;translate(&quot; + (CHART_WIDTH/2) + &quot; ,&quot; + \n",
       "                               (CHART_HEIGHT + MARGIN.TOP + 40) + &quot;)&quot;)\n",
       "          .style(&quot;text-anchor&quot;, &quot;middle&quot;)\n",
       "          .text(&quot;Values&quot;)\n",
       "          .style(&quot;font-size&quot;, &quot;15&quot;)\n",
       "          .style(&quot;opacity&quot;, &quot;0.6&quot;)\n",
       "  \n",
       "        svgEl.append(&quot;text&quot;)\n",
       "          .attr(&quot;transform&quot;, &quot;rotate(-90)&quot;)\n",
       "          .attr(&quot;y&quot;, 0)\n",
       "          .attr(&quot;x&quot;, 0 - (SVG_HEIGHT / 2))\n",
       "          .attr(&quot;dy&quot;, &quot;1em&quot;)\n",
       "          .style(&quot;text-anchor&quot;, &quot;middle&quot;)\n",
       "          .text(&quot;Counts&quot;)\n",
       "          .style(&quot;font-size&quot;, &quot;15&quot;)   \n",
       "          .style(&quot;opacity&quot;, &quot;0.6&quot;)\n",
       "    \n",
       "        svgEl.append(&quot;g&quot;)\n",
       "            .attr(&quot;transform&quot;, `translate(0,${SVG_HEIGHT - MARGIN.BOTTOM})`)\n",
       "            .attr(&quot;id&quot;, &quot;g2&quot;)\n",
       "            .call(xAxis)\n",
       "            .call(g =&gt; g.select(&quot;.domain&quot;).remove())\n",
       "            .call(g =&gt; g.selectAll(&quot;.tick line&quot;).remove())\n",
       "            .call(g =&gt; g.append(&quot;text&quot;)\n",
       "                .attr(&quot;x&quot;, SVG_WIDTH - MARGIN.RIGHT)\n",
       "                .attr(&quot;y&quot;, 27)\n",
       "                .attr(&quot;fill&quot;, &quot;currentColor&quot;)\n",
       "                .attr(&quot;text-anchor&quot;, &quot;end&quot;));\n",
       "\n",
       "        const xSubgroup = d3.scaleBand()\n",
       "          .domain(subgroups)\n",
       "          .range([0, xScale.bandwidth()])\n",
       "\n",
       "        const color = d3.scaleOrdinal()\n",
       "          .domain(subgroups)\n",
       "          .range(rectColors)\n",
       "    \n",
       "        svgEl.append(&quot;g&quot;)\n",
       "           .attr(&quot;id&quot;, &quot;g3&quot;)\n",
       "           .selectAll(&quot;g&quot;)\n",
       "           .data(data)\n",
       "           .enter()\n",
       "           .append(&quot;g&quot;)\n",
       "             .attr(&quot;transform&quot;, function(d) { return &quot;translate(&quot; + xScale(d?.group) + &quot;,0)&quot;; })\n",
       "             .attr(&quot;id&quot;, &quot;g4&quot;)\n",
       "           .selectAll(&quot;rect&quot;)\n",
       "           .data(function(d) { return subgroups.map(function(key) { return {key: key, value: d &amp;&amp; d[key]}; }); })\n",
       "           .enter().append(&quot;rect&quot;)\n",
       "             .attr(&quot;x&quot;, function(d) { return xSubgroup(d.key); })\n",
       "             .attr(&quot;y&quot;, function(d) { return yScale(d.value); })\n",
       "             .attr(&quot;width&quot;, xSubgroup.bandwidth())\n",
       "             .attr(&quot;height&quot;, function(d) { return (CHART_HEIGHT - yScale(d.value)); })\n",
       "             .attr(&quot;fill&quot;, function(d) { return color(d.key); })\n",
       "             .style(&quot;opacity&quot;, &quot;0.8&quot;);\n",
       "    \n",
       "    \n",
       "         return svgEl._groups[0][0].outerHTML;\n",
       "      }    \n",
       "\n",
       "\n",
       "      const profileFromCSVfile = {&quot;debt_settlement_flag&quot;: {&quot;counters&quot;: {&quot;count&quot;: &quot;800&quot;}, &quot;schema&quot;: {&quot;inferredType&quot;: {&quot;type&quot;: &quot;STRING&quot;, &quot;ratio&quot;: 1.0}, &quot;typeCounts&quot;: {&quot;STRING&quot;: &quot;800&quot;}}, &quot;stringSummary&quot;: {&quot;uniqueCount&quot;: {&quot;estimate&quot;: 2.0, &quot;upper&quot;: 2.0, &quot;lower&quot;: 2.0}, &quot;frequent&quot;: {&quot;items&quot;: [{&quot;value&quot;: &quot;N&quot;, &quot;estimate&quot;: 774.0}, {&quot;value&quot;: &quot;Y&quot;, &quot;estimate&quot;: 26.0}]}, &quot;length&quot;: {&quot;count&quot;: &quot;800&quot;, &quot;min&quot;: 1.0, &quot;max&quot;: 1.0, &quot;mean&quot;: 1.0, &quot;histogram&quot;: {&quot;start&quot;: 1.0, &quot;end&quot;: 1.0000001, &quot;counts&quot;: [&quot;800&quot;], &quot;max&quot;: 1.0, &quot;min&quot;: 1.0, &quot;bins&quot;: [1.0, 1.0000001], &quot;n&quot;: &quot;800&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;tokenLength&quot;: {&quot;count&quot;: &quot;800&quot;, &quot;min&quot;: 1.0, &quot;max&quot;: 1.0, &quot;mean&quot;: 1.0, &quot;histogram&quot;: {&quot;start&quot;: 1.0, &quot;end&quot;: 1.0000001, &quot;counts&quot;: [&quot;800&quot;], &quot;max&quot;: 1.0, &quot;min&quot;: 1.0, &quot;bins&quot;: [1.0, 1.0000001], &quot;n&quot;: &quot;800&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;charPosTracker&quot;: {&quot;characterList&quot;: &quot;!#$%&amp;()*+,-./0123456789?@[]^_abcdefghijklmnopqrstuvwyz{}&quot;, &quot;charPosMap&quot;: {&quot;n&quot;: {&quot;count&quot;: &quot;774&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;774&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;774&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;isDiscrete&quot;: true, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0}, &quot;y&quot;: {&quot;count&quot;: &quot;26&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;26&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;26&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;isDiscrete&quot;: true, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0}}}}, &quot;frequentItems&quot;: {&quot;items&quot;: [{&quot;estimate&quot;: &quot;774&quot;, &quot;jsonValue&quot;: &quot;N&quot;}, {&quot;estimate&quot;: &quot;26&quot;, &quot;jsonValue&quot;: &quot;Y&quot;}]}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 2.000000004967054, &quot;upper&quot;: 2.000099863468538, &quot;lower&quot;: 2.0}}}\n",
       "\n",
       "      Handlebars.registerHelper(&quot;getDoubleHistogramChart&quot;,(column,key) =&gt; {\n",
       "        const columnKey = key.data.key\n",
       "        try {\n",
       "          if (profileFromCSVfile) {\n",
       "            return generateBarChart(\n",
       "                     column,\n",
       "                     profileFromCSVfile[columnKey]\n",
       "                   )\n",
       "          }\n",
       "        } catch (err) {\n",
       "          $(document).ready(() =&gt; \n",
       "            $(&quot;.desktop-content&quot;).html(`\n",
       "              &lt;p style=&quot;height: ${$(window).height()}px&quot; class=&quot;error-message&quot;&gt; \n",
       "                Something went wrong. Please try again.\n",
       "              &lt;/p&gt;\n",
       "            `)\n",
       "          )\n",
       "        }\n",
       "      });\n",
       "    }\n",
       "\n",
       "    function initWebsiteScripts() {\n",
       "      $(&quot;.svg-container&quot;).css(&quot;height&quot;, $(window).height() - 32)\n",
       "    }\n",
       "\n",
       "    function initHandlebarsTemplate() {\n",
       "      // Replace this context with JSON from .py file\n",
       "      const context = {&quot;debt_settlement_flag&quot;: {&quot;counters&quot;: {&quot;count&quot;: &quot;200&quot;, &quot;nullCount&quot;: &quot;2&quot;}, &quot;schema&quot;: {&quot;inferredType&quot;: {&quot;type&quot;: &quot;STRING&quot;, &quot;ratio&quot;: 1.0}, &quot;typeCounts&quot;: {&quot;STRING&quot;: &quot;198&quot;, &quot;NULL&quot;: &quot;2&quot;}}, &quot;stringSummary&quot;: {&quot;uniqueCount&quot;: {&quot;estimate&quot;: 2.0, &quot;upper&quot;: 2.0, &quot;lower&quot;: 2.0}, &quot;frequent&quot;: {&quot;items&quot;: [{&quot;value&quot;: &quot;N&quot;, &quot;estimate&quot;: 194.0}, {&quot;value&quot;: &quot;Y&quot;, &quot;estimate&quot;: 4.0}]}, &quot;length&quot;: {&quot;count&quot;: &quot;198&quot;, &quot;min&quot;: 1.0, &quot;max&quot;: 1.0, &quot;mean&quot;: 1.0, &quot;histogram&quot;: {&quot;start&quot;: 1.0, &quot;end&quot;: 1.0000001, &quot;counts&quot;: [&quot;198&quot;], &quot;max&quot;: 1.0, &quot;min&quot;: 1.0, &quot;bins&quot;: [1.0, 1.0000001], &quot;n&quot;: &quot;198&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;tokenLength&quot;: {&quot;count&quot;: &quot;198&quot;, &quot;min&quot;: 1.0, &quot;max&quot;: 1.0, &quot;mean&quot;: 1.0, &quot;histogram&quot;: {&quot;start&quot;: 1.0, &quot;end&quot;: 1.0000001, &quot;counts&quot;: [&quot;198&quot;], &quot;max&quot;: 1.0, &quot;min&quot;: 1.0, &quot;bins&quot;: [1.0, 1.0000001], &quot;n&quot;: &quot;198&quot;, &quot;width&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0]}, &quot;isDiscrete&quot;: true, &quot;stddev&quot;: 0.0}, &quot;charPosTracker&quot;: {&quot;characterList&quot;: &quot;!#$%&amp;()*+,-./0123456789?@[]^_abcdefghijklmnopqrstuvwyz{}&quot;, &quot;charPosMap&quot;: {&quot;y&quot;: {&quot;count&quot;: &quot;4&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;4&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;4&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0, &quot;isDiscrete&quot;: false}, &quot;n&quot;: {&quot;count&quot;: &quot;194&quot;, &quot;histogram&quot;: {&quot;counts&quot;: [&quot;194&quot;], &quot;bins&quot;: [0.0, 0.0], &quot;n&quot;: &quot;194&quot;, &quot;start&quot;: 0.0, &quot;end&quot;: 0.0, &quot;width&quot;: 0.0, &quot;max&quot;: 0.0, &quot;min&quot;: 0.0}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 1.0, &quot;upper&quot;: 1.0, &quot;lower&quot;: 1.0}, &quot;quantiles&quot;: {&quot;quantiles&quot;: [0.0, 0.01, 0.05, 0.25, 0.5, 0.75, 0.95, 0.99, 1.0], &quot;quantileValues&quot;: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0]}, &quot;isDiscrete&quot;: true, &quot;min&quot;: 0.0, &quot;max&quot;: 0.0, &quot;mean&quot;: 0.0, &quot;stddev&quot;: 0.0}}}}, &quot;frequentItems&quot;: {&quot;items&quot;: [{&quot;estimate&quot;: &quot;194&quot;, &quot;jsonValue&quot;: &quot;N&quot;}, {&quot;estimate&quot;: &quot;4&quot;, &quot;jsonValue&quot;: &quot;Y&quot;}]}, &quot;uniqueCount&quot;: {&quot;estimate&quot;: 2.000000004967054, &quot;upper&quot;: 2.000099863468538, &quot;lower&quot;: 2.0}}};\n",
       "      // Config handlebars and pass data to HBS template\n",
       "      const source = document.getElementById(&quot;entry-template&quot;).innerHTML;\n",
       "      const template = Handlebars.compile(source);\n",
       "      const html = template(context);\n",
       "      const target = document.getElementById(&quot;generated-html&quot;);\n",
       "      target.innerHTML = html;\n",
       "    }\n",
       "\n",
       "    // Invoke functions -- keep in mind invokation order\n",
       "    registerHandlebarHelperFunctions();\n",
       "    initHandlebarsTemplate();\n",
       "    initWebsiteScripts();\n",
       "  &lt;/script&gt;\n",
       "&lt;/html&gt;\n",
       "\" width=100% height=277px frameBorder=0></iframe>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "visualization.distribution_chart(feature_names=\"debt_settlement_flag\")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "6dfdfb37",
   "metadata": {},
   "source": [
    "Here we see that the distribution of the feature 'debt_settlement_flag' is very similar in both data sets."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "958ff9f4",
   "metadata": {},
   "source": [
    "To define the constraint, we can calculate the entropy on the training data, or take some apriori value for the entropy which we believe is the groud truth, and then define the bounds within which we expect this value to vary in the data sets."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "0aa3e20c",
   "metadata": {},
   "source": [
    "We define the 'approximateEntropyBetweenConstraint' by specifying the lower and upper values of the interval of valid entropy. In this case we have chosen some reference value 0.15 and we define the bounds to be in the range (0.15-0.05, 0.15+0.05)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "id": "4a08676e",
   "metadata": {},
   "outputs": [],
   "source": [
    "debt_settlement_flag_approx_entropy_between = approximateEntropyBetweenConstraint(\n",
    "    lower_value = 0.1,\n",
    "    upper_value = 0.20,\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "ca158648",
   "metadata": {},
   "source": [
    "We have now defined all of the constraints we are interested in. To apply them to a data set, we first create a DataSetConstraints object. This object has arguments for 'value_constraints', 'summary_constraints', 'table_shape_constraints', and 'multi_column_value_constraints'. Since the distributional measures are all of type 'SummaryConstraint' we will only set the 'summary_constraints' argument.\n",
    "\n",
    "We pass a dictionary with keys equalt to the featre names, and a value equal to the list of constraints we want to apply to that feature. The first argument in the initialization is a properties object, but we do not need to set it explicitly."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "id": "b1d022ac",
   "metadata": {},
   "outputs": [],
   "source": [
    "constraints = DatasetConstraints(\n",
    "    None,\n",
    "    summary_constraints = {\n",
    "        \"grade\": [grade_chi_squared_p_value_greater_than],\n",
    "        \"term\": [term_kl_divergence_less_than],\n",
    "        \"int_rate\": [int_rate_kl_divergence_less_than],\n",
    "        \"loan_amnt\": [loan_amnt_ks_test_p_value_greater_than],\n",
    "        \"debt_settlement_flag\": [debt_settlement_flag_approx_entropy_between]\n",
    "    }\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "70ae3961",
   "metadata": {},
   "source": [
    "Now, what really interests us is how the constraints behave on the new unseen data that our model needs to use for prediction.\n",
    "\n",
    "If we log the production data with the constraints and then apply them, we can see that some constraints have failed."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "c8e3e05b",
   "metadata": {},
   "source": [
    "According to this report, we have a failure in the features 'grade', 'term' and 'loan_amnt' for which we saw that the distributions were somewhat different in the two data sets. The outcomes of the constraints signify that there is a high drift for these features in the new data set.\n",
    "\n",
    "You can further automate the process of data quality checks by defining some behaviour in case a constraint fails, such as in the cases show in this example notebook."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "id": "ad25b25d",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div></div><iframe srcdoc=\"&lt;!DOCTYPE html&gt;\n",
       "&lt;html lang=&quot;en&quot;&gt;\n",
       "  &lt;head&gt;\n",
       "    &lt;meta charset=&quot;UTF-8&quot; /&gt;\n",
       "    &lt;meta http-equiv=&quot;X-UA-Compatible&quot; content=&quot;IE=edge&quot; /&gt;\n",
       "    &lt;meta name=&quot;viewport&quot; content=&quot;width=device-width, initial-scale=1.0&quot; /&gt;\n",
       "    &lt;meta name=&quot;description&quot; content=&quot;&quot; /&gt;\n",
       "    &lt;meta name=&quot;author&quot; content=&quot;&quot; /&gt;\n",
       "\n",
       "    &lt;title&gt;Profile Viewer | whylogs&lt;/title&gt;\n",
       "\n",
       "    &lt;link rel=&quot;icon&quot; href=&quot;images/whylabs-favicon.png&quot; type=&quot;image/png&quot; sizes=&quot;16x16&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.googleapis.com&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.gstatic.com&quot; crossorigin /&gt;\n",
       "    &lt;link href=&quot;https://fonts.googleapis.com/css2?family=Asap:wght@400;500;600;700&amp;display=swap&quot; rel=&quot;stylesheet&quot; /&gt;\n",
       "    &lt;link rel=&quot;preconnect&quot; href=&quot;https://fonts.gstatic.com&quot; /&gt;\n",
       "    &lt;link rel=&quot;stylesheet&quot; href=&quot;https://cdn.jsdelivr.net/npm/bootstrap@5.1.0/dist/css/bootstrap.min.css&quot; /&gt;\n",
       "\n",
       "    &lt;script\n",
       "      src=&quot;https://cdnjs.cloudflare.com/ajax/libs/handlebars.js/4.7.7/handlebars.min.js&quot;\n",
       "      integrity=&quot;sha512-RNLkV3d+aLtfcpEyFG8jRbnWHxUqVZozacROI4J2F1sTaDqo1dPQYs01OMi1t1w9Y2FdbSCDSQ2ZVdAC8bzgAg==&quot;\n",
       "      crossorigin=&quot;anonymous&quot;\n",
       "      referrerpolicy=&quot;no-referrer&quot;\n",
       "    &gt;&lt;/script&gt;\n",
       "\n",
       "    &lt;style type=&quot;text/css&quot;&gt;\n",
       "\n",
       "      /* Screen on smaller screens */\n",
       "      .no-responsive {\n",
       "        display: none;\n",
       "        position: fixed;\n",
       "        top: 0;\n",
       "        left: 0;\n",
       "        z-index: 1031;\n",
       "        width: 100vw;\n",
       "        height: 100vh;\n",
       "        background-color: var(--tealBackground);\n",
       "        display: flex;\n",
       "        align-items: center;\n",
       "        justify-content: center;\n",
       "      }\n",
       "\n",
       "      @media screen and (min-width: 1000px) {\n",
       "        .desktop-content {\n",
       "          display: block;\n",
       "        }\n",
       "        .no-responsive {\n",
       "          display: none;\n",
       "        }\n",
       "      }\n",
       "\n",
       "      .no-responsive__content {\n",
       "        max-width: 600px;\n",
       "        width: 100%;\n",
       "        padding: 0 24px;\n",
       "      }\n",
       "\n",
       "      .no-responsive__title {\n",
       "        font-size: 96px;\n",
       "        font-weight: 300;\n",
       "        color: var(--brandSecondary900);\n",
       "        line-height: 1.167;\n",
       "      }\n",
       "\n",
       "      .no-responsive__text {\n",
       "        margin: 0;\n",
       "        font-size: 16px;\n",
       "        font-weight: 400;\n",
       "        color: var(--brandSecondary900);\n",
       "        line-height: 1.5;\n",
       "      }\n",
       "\n",
       "      .header-title {\n",
       "        font-size: 26px;\n",
       "        font-weight: 700;\n",
       "        color: #444444;\n",
       "      }\n",
       "\n",
       "      .wl-compare-profile {\n",
       "        position: relative;\n",
       "        left: 0;\n",
       "        padding: 30px;\n",
       "        margin-bottom: 20px;\n",
       "        background: var(--white);;\n",
       "        border-bottom: 1px solid #CED4DA;\n",
       "      }\n",
       "\n",
       "      .alert-list {\n",
       "        padding: 30px;\n",
       "        padding-top: 0;\n",
       "      }\n",
       "\n",
       "    .drift-detection {\n",
       "       justify-content: space-between;\n",
       "       align-items: center;\n",
       "     }\n",
       "\n",
       "     .drift-detection-info-circle {\n",
       "       width: 15px;\n",
       "       height: 15px;\n",
       "       border-radius: 50px;\n",
       "       display: inline-block;\n",
       "       margin-right: 8px;\n",
       "     }\n",
       "\n",
       "     .drift-detection-info-drifts-item {\n",
       "         padding-right: 20px;\n",
       "     }\n",
       "\n",
       "     .drift-detection-info-title {\n",
       "       font-family: Arial;\n",
       "       font-weight: bold;\n",
       "       font-size: 22px;\n",
       "       line-height: 130%;\n",
       "       color: #313B3D;\n",
       "     }\n",
       "\n",
       "     .drift-detection-info-drifts-item-count {\n",
       "       font-family: Arial;\n",
       "       font-weight: bold;\n",
       "       font-size: 14px;\n",
       "       line-height: 16px;\n",
       "       color: #000000;\n",
       "       padding-right: 8px;\n",
       "     }\n",
       "\n",
       "     .drift-detection-info-drifts-item-name {\n",
       "       font-family: Arial;\n",
       "       font-style: normal;\n",
       "       font-weight: normal;\n",
       "       font-size: 12px;\n",
       "       line-height: 14px;\n",
       "       color: #000000;\n",
       "     }\n",
       "\n",
       "     .drift-detection-search-input {\n",
       "       display: flex;\n",
       "       align-items: center;\n",
       "       background: rgba(255, 255, 255, 0.7);\n",
       "       border: 1px solid #DBE5E7;\n",
       "       box-sizing: border-box;\n",
       "       border-radius: 4px;\n",
       "       width: 170px;\n",
       "       padding-left: 10px;\n",
       "     }\n",
       "\n",
       "     .drift-detection-search-input img{\n",
       "       margin-right: 5px;\n",
       "     }\n",
       "\n",
       "     .drift-detection-search-input input::placeholder {\n",
       "       font-family: Arial;\n",
       "       font-weight: normal;\n",
       "       font-size: 13px;\n",
       "       line-height: 16px;\n",
       "       color: #313B3D;\n",
       "     }\n",
       "\n",
       "     .dropdown-container {\n",
       "       position: absolute;\n",
       "       right: 30px;\n",
       "       top: 80px;\n",
       "       z-index: 999;\n",
       "       background: #FFFFFF;\n",
       "       border: 1px solid #DBE5E7;\n",
       "       box-sizing: border-box;\n",
       "       box-shadow: 0px 2px 8px rgba(0, 0, 0, 0.05);\n",
       "       border-radius: 4px;\n",
       "       padding: 10px !important;\n",
       "       border: none !important;\n",
       "     }\n",
       "\n",
       "     .filter-options-title {\n",
       "       width: 240px;\n",
       "     }\n",
       "\n",
       "     .filter-options-title p {\n",
       "       margin: 0;\n",
       "     }\n",
       "\n",
       "     .form-check-input:checked {\n",
       "       background-color: #0E7384;\n",
       "       border-color: #0E7384;\n",
       "     }\n",
       "\n",
       "     .form-check-input[type=checkbox] {\n",
       "       border-radius: 2px;\n",
       "     }\n",
       "\n",
       "     .search-input{\n",
       "       padding-top: 0 !important;\n",
       "       padding-bottom: 0 !important;\n",
       "     }\n",
       "\n",
       "     .search-input input{\n",
       "       border: none;\n",
       "       background: none;\n",
       "       outline: none;\n",
       "       height: 40px;\n",
       "       width: 100%;\n",
       "       font-size: 14px;\n",
       "     }\n",
       "\n",
       "     .search-input img{\n",
       "       height: 19px;\n",
       "       pointer-events: none;\n",
       "     }\n",
       "\n",
       "     input::placeholder {\n",
       "       color: var(--secondaryLight1000);\n",
       "     }\n",
       "\n",
       "      .statistics {\n",
       "        width: 100%;\n",
       "      }\n",
       "\n",
       "     .close-filter-button {\n",
       "       display: flex;\n",
       "       justify-content: center;\n",
       "       align-items: center;\n",
       "       background: rgba(255, 255, 255, 0.7);\n",
       "       border: 1px solid #369BAC;\n",
       "       box-sizing: border-box;\n",
       "       border-radius: 4px;\n",
       "       width: 40px;\n",
       "       height: 40px;\n",
       "       cursor: pointer;\n",
       "       margin-left: 10px;\n",
       "     }\n",
       "\n",
       "      .statistic-number-title {\n",
       "        font-family: Arial;\n",
       "        font-weight: normal;\n",
       "        font-size: 14px;\n",
       "        line-height: 20px;\n",
       "        color: #6C757D;\n",
       "      }\n",
       "\n",
       "      .statistic-number {\n",
       "        font-family: Arial;\n",
       "        font-weight: bold;\n",
       "        font-size: 20px;\n",
       "        line-height: 140%;\n",
       "        display: flex;\n",
       "        align-items: center;\n",
       "        color: #4F595B;\n",
       "      }\n",
       "\n",
       "      .full-summary-statistics-wrap {\n",
       "        padding: 20px;\n",
       "      }\n",
       "\n",
       "      .statistics {\n",
       "        width: 100%;\n",
       "      }\n",
       "\n",
       "      .statistics-list {\n",
       "        width: 100% ;\n",
       "      }\n",
       "\n",
       "      mark {\n",
       "        padding: 5px;\n",
       "        border-radius: 4px;\n",
       "        font-family: Arial;\n",
       "        font-weight: normal;\n",
       "        font-size: 14px;\n",
       "        line-height: 140%;\n",
       "      }\n",
       "\n",
       "      .blue-mark {\n",
       "        background-color:  #369BAC1A;\n",
       "        color: #369BAC;\n",
       "      }\n",
       "\n",
       "      .red-mark {\n",
       "        background-color: #FFEFEE;\n",
       "        color: #F5473C;\n",
       "      }\n",
       "\n",
       "      .alert-tag {\n",
       "        height: 27px;\n",
       "        padding: 5px;\n",
       "        border-radius: 4px;\n",
       "        font-family: Arial;\n",
       "        font-weight: bold;\n",
       "        font-size: 12px;\n",
       "        line-height: 140%;\n",
       "        color: #FFFFFF;\n",
       "      }\n",
       "\n",
       "      .turquoise-background-color {\n",
       "        background-color: #1DBB42;\n",
       "      }\n",
       "\n",
       "      .bordeaux-background-color {\n",
       "        background-color: #C6462A;\n",
       "      }\n",
       "\n",
       "      .border-solid-gray {\n",
       "        border: 1px solid #CED4DA;\n",
       "        border-radius: 4px;\n",
       "      }\n",
       "\n",
       "      .display-flex {\n",
       "        display: flex;\n",
       "      }\n",
       "\n",
       "      .justify-content-space-between {\n",
       "        justify-content: space-between;\n",
       "      }\n",
       "\n",
       "      .justify-content-center {\n",
       "        justify-content: center;\n",
       "      }\n",
       "\n",
       "      .align-items-center {\n",
       "        align-items: center;\n",
       "      }\n",
       "\n",
       "      .align-items-flex-start {\n",
       "        align-items: flex-start;\n",
       "      }\n",
       "\n",
       "      .padding-right-30 {\n",
       "        padding-right: 30px;\n",
       "      }\n",
       "\n",
       "      .notif-circle-container{\n",
       "        position: absolute;\n",
       "        top: 25px;\n",
       "        right: 25px;\n",
       "        padding: 5.3px;\n",
       "        border-radius: 50%;\n",
       "        background-color: white;\n",
       "        cursor: pointer;\n",
       "      }\n",
       "\n",
       "      .notif-circle {\n",
       "        position: absolute;\n",
       "        top: 2px;\n",
       "        right: 2px;\n",
       "        padding: 3.3px;\n",
       "        border-radius: 50%;\n",
       "        background-color: #F2994A;\n",
       "      }\n",
       "\n",
       "      .alert-list-text {\n",
       "        width: 70%\n",
       "      }\n",
       "\n",
       "     @media screen and (min-width: 500px) {\n",
       "       .desktop-content {\n",
       "         display: block;\n",
       "       }\n",
       "       .no-responsive {\n",
       "         display: none;\n",
       "       }\n",
       "     }\n",
       "    &lt;/style&gt;\n",
       "  &lt;/head&gt;\n",
       "\n",
       "  &lt;body id=&quot;generated-html&quot;&gt;&lt;/body&gt;\n",
       "\n",
       "  &lt;script id=&quot;entry-template&quot; type=&quot;text/x-handlebars-template&quot;&gt;\n",
       "    \n",
       "      &lt;div class=&quot;desktop-content&quot;&gt;\n",
       "        &lt;div class=&quot;full-summary-statistics-wrap&quot;&gt;\n",
       "          &lt;div class=&quot;full-summary-statistics&quot;&gt;\n",
       "            &lt;div&gt;\n",
       "              &lt;div class=&quot;display-flex justify-content-center&quot;&gt;\n",
       "                &lt;div class=&quot;statistics-list border-solid-gray&quot;&gt;\n",
       "                  &lt;div&gt;\n",
       "                    &lt;div class=&quot;wl-compare-profile&quot; id=&quot;compare-profile&quot;&gt;\n",
       "                        &lt;div class=&quot;drift-detection-wrap&quot;&gt;\n",
       "                          &lt;div class=&quot;drift-detection display-flex align-items-flex-start&quot;&gt;\n",
       "                            &lt;div class=&quot;drift-detection-info flex-direction-colum&quot;&gt;\n",
       "                              &lt;div class=&quot;drift-detection-info-title-wrap display-flex&quot;&gt;\n",
       "                                &lt;p class=&quot;drift-detection-info-title&quot;&gt;\n",
       "                                  Constraints Report\n",
       "                                &lt;/p&gt;\n",
       "                              &lt;/div&gt;\n",
       "\n",
       "                              &lt;!-- &lt;/div&gt; --&gt;\n",
       "                            &lt;/div&gt;\n",
       "                            &lt;div class=&quot;drift-detection-search-input-wrap display-flex&quot;&gt;\n",
       "                              &lt;div class=&quot;drift-detection-search-input search-input&quot;&gt;\n",
       "                                &lt;input type=&quot;text&quot; id=&quot;wl__feature-search&quot; placeholder=&quot;Quick search...&quot;/&gt;\n",
       "                                &lt;img src=&quot;data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAACXBIWXMAAAsTAAALEwEAmpwYAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAAGdSURBVHgBpZK7TkJBEIZnZoVocdTYyQNALxpNKPQBMEaNJsbCRMKhl8ISWwt6AaksCF5iTHgAGhJD4AHkAaAzGiwUsjvOQnO4SYh/cXbPzO43OxcEj9Zy92EiFSXNIfvPyE1kKFfdoxJMENpP6DrvLC0vJoEwCgwto7DWcxoIIHBYbA3NmKwnDltjAeuZhyul1DaTTlfPB6Nt5Z53DOgky4P875+nlctY2+unjZviLklkJhi5bPUa3y/7qJuQUM7PinMy7CdQc1Gh16vnBxPzrMROmlKQEgKNASAHLQCmSIGpS75O+O5pdQAgVXaIqTkNwDDXHmcnW3VmHZoGMLoTsOt88+NrAMCIZdu+iLTyTwKRa1Md6YKfOgXbzO7K8sWku5u5RxcRV5EpPezrzcHGbXEXWaUkgkweZ/UC9YrK3zqggFw5FBZfm8EUavHj7AjAKpIvBDrGn+pNnlcyhYgqbcC41idr1gvB4SdZkDbzQa21gwv0Vj07aPTtL07XdDOyDXohCDNoHIRmAVRie20f+RKybRDQDvxHkXy/7b/DrayncLbMwQAAAABJRU5ErkJggg==&quot;/&gt;\n",
       "                              &lt;/div&gt;\n",
       "                              &lt;div class=&quot;wl__dropdown_arrow-icon&quot;&gt;\n",
       "                                &lt;div onclick=&quot;openFilter()&quot; class=&quot;close-filter-button&quot;&gt;\n",
       "                                &lt;div class=&quot;display-flex close-filter-icon d-none&quot;&gt;\n",
       "                                  &lt;img src=&quot;data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAsAAAALCAYAAACprHcmAAAACXBIWXMAAAsTAAALEwEAmpwYAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAADFSURBVHgBfY+xDcIwEEXvnLQBZQkYAEhDwwKpEEK0CCZgAEjJCEmgjYSAygxAHTZgFRSOsyUjY5mcZFnn/+78PwBXf3+MoKWUPuYjVBPFnTwpr9t/oNJfcTfXsAhRAlDqDhhQIPYgpAqNMDqcUqSAYZT1epr9gAHt6uXshvYme4DYHQJNDKh0dD0m5WXB10Y3Fqjtuh7fROn3oREDWxfeMLyRsMnc0OgDzdduaA0Pi3Plgr7Q2kaAePeBqh6rueSNBVt6fgCwBV1JLF3rlAAAAABJRU5ErkJggg==&quot;/&gt;\n",
       "                                &lt;/div&gt;\n",
       "                                &lt;div class=&quot;display-flex filter-icon&quot;&gt;\n",
       "                                  &lt;img src=&quot;data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABAAAAAPCAYAAADtc08vAAAACXBIWXMAAAsTAAALEwEAmpwYAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAACSSURBVHgBrZLBCYAwDEWTUjw7igcdwI1cxkNXUJzBEVzFAbSVKoKmaVrEB6GHJv/w+AACtRk7P9IONv1QOYUl96k0zv61m2tjARoLtSDI3EFsgIJ4uoXrMLazO72CRG2mzg/8BSdVlEjhpGZJjAWdAZJECpWalEhJSs1pHuUlMad5FFai1Lwg4Ckx1TxKIPFL8w55mEWd8VjPGAAAAABJRU5ErkJggg==&quot;/&gt;\n",
       "                                &lt;/div&gt;\n",
       "                                &lt;/div&gt;\n",
       "                              &lt;span class=&quot;notif-circle-container&quot;&gt;\n",
       "                                &lt;span class=&quot;notif-circle&quot;&gt;&lt;/span&gt;\n",
       "                              &lt;/span&gt;\n",
       "                            &lt;/div&gt;\n",
       "                            &lt;/div&gt;\n",
       "                          &lt;/div&gt;\n",
       "                        &lt;/div&gt;\n",
       "                        &lt;div class=&quot;dropdown-container flex-direction-colum mb-2 d-none&quot; id=&quot;dropdown-container&quot;&gt;\n",
       "                          &lt;div class=&quot;filter-options&quot;&gt;\n",
       "                            &lt;div class=&quot;filter-options-title space-between dropdown&quot;&gt;\n",
       "                              &lt;p&gt;Select a view:&lt;/p&gt;\n",
       "                            &lt;/div&gt;\n",
       "                            &lt;div class=&quot;form-check mb-1 mt-2&quot;&gt;\n",
       "                              &lt;input\n",
       "                                class=&quot;form-check-input wl__feature-filter-input&quot;\n",
       "                                type=&quot;checkbox&quot;\n",
       "                                name=&quot;checkbox&quot;\n",
       "                                value=&quot;Discrete&quot;\n",
       "                                id=&quot;inferredDiscrete&quot;\n",
       "                                checked\n",
       "                              /&gt;\n",
       "                              &lt;label class=&quot;form-check-label&quot; for=&quot;inferredDiscrete&quot;&gt;\n",
       "                                Failed constraints (&lt;span class=&quot;wl__feature-count--discrete&quot;&gt;&lt;/span&gt;)\n",
       "                              &lt;/label&gt;\n",
       "                            &lt;/div&gt;\n",
       "                            &lt;div class=&quot;form-check mb-1&quot;&gt;\n",
       "                              &lt;input\n",
       "                                class=&quot;form-check-input wl__feature-filter-input&quot;\n",
       "                                type=&quot;checkbox&quot;\n",
       "                                name=&quot;checkbox&quot;\n",
       "                                value=&quot;Non-discrete&quot;\n",
       "                                id=&quot;inferredNonDiscrete&quot;\n",
       "                                checked\n",
       "                              /&gt;\n",
       "                              &lt;label class=&quot;form-check-label&quot; for=&quot;inferredNonDiscrete&quot;&gt;\n",
       "                                Passed constraints (&lt;span\n",
       "                                  class=&quot;wl__feature-count--non-discrete&quot;\n",
       "                                &gt;&lt;/span&gt;)\n",
       "                              &lt;/label&gt;\n",
       "                            &lt;/div&gt;\n",
       "                            &lt;div class=&quot;form-check mb-1&quot;&gt;\n",
       "                              &lt;input\n",
       "                                class=&quot;form-check-input wl__feature-filter-input&quot;\n",
       "                                type=&quot;checkbox&quot;\n",
       "                                name=&quot;checkbox&quot;\n",
       "                                value=&quot;Unknown&quot;\n",
       "                                id=&quot;inferredUnknown&quot;\n",
       "                                checked\n",
       "                              /&gt;\n",
       "                              &lt;label class=&quot;form-check-label&quot; for=&quot;inferredUnknown&quot;&gt;\n",
       "                                All constraints (&lt;span class=&quot;wl__feature-count--unknown&quot;&gt;&lt;/span&gt;)\n",
       "                              &lt;/label&gt;\n",
       "                            &lt;/div&gt;\n",
       "                          &lt;/div&gt;\n",
       "                        &lt;/div&gt;\n",
       "                      &lt;/div&gt;\n",
       "                    &lt;div class=&quot;alert-list&quot; id=&quot;alert-list&quot;&gt;\n",
       "                      {{{alertLIst this}}}\n",
       "                    &lt;/div&gt;\n",
       "                  &lt;/div&gt;\n",
       "                &lt;/div&gt;\n",
       "              &lt;/div&gt;\n",
       "            &lt;/div&gt;\n",
       "          &lt;/div&gt;\n",
       "        &lt;/div&gt;\n",
       "      &lt;/div&gt;\n",
       "      &lt;div class=&quot;no-responsive&quot;&gt;\n",
       "        &lt;div class=&quot;no-responsive__content&quot;&gt;\n",
       "          &lt;h1 class=&quot;no-responsive__title&quot;&gt;Hold on! :)&lt;/h1&gt;\n",
       "          &lt;p class=&quot;no-responsive__text&quot;&gt;\n",
       "            It looks like your current screen size or device is not yet supported by the WhyLabs Sandbox. The Sandbox is\n",
       "            best experienced on a desktop computer. Please try maximizing this window or switching to another device. We\n",
       "            are working on adding support for a larger variety of devices.\n",
       "          &lt;/p&gt;\n",
       "        &lt;/div&gt;\n",
       "      &lt;/div&gt;\n",
       "    \n",
       "  &lt;/script&gt;\n",
       "\n",
       "  &lt;script src=&quot;https://code.jquery.com/jquery-3.6.0.min.js&quot; integrity=&quot;sha256-/xUj+3OJU5yExlq6GSYGSHk7tPXikynS7ogEvDej/m4=&quot; crossorigin=&quot;anonymous&quot;&gt;&lt;/script&gt;\n",
       "\n",
       "  &lt;script src=&quot;https://cdnjs.cloudflare.com/ajax/libs/d3/6.7.0/d3.min.js&quot; integrity=&quot;sha512-cd6CHE+XWDQ33ElJqsi0MdNte3S+bQY819f7p3NUHgwQQLXSKjE4cPZTeGNI+vaxZynk1wVU3hoHmow3m089wA==&quot; crossorigin=&quot;anonymous&quot; referrerpolicy=&quot;no-referrer&quot;&gt;&lt;/script&gt;\n",
       "\n",
       "  &lt;script&gt;\n",
       "    function registerHandlebarHelperFunctions() {\n",
       "      //helper fun\n",
       "      function formatLabelDate(timestamp) {\n",
       "        const date = new Date(timestamp);\n",
       "        const format = d3.timeFormat(&quot;%Y-%m-%d %I:%M:%S %p %Z&quot;);\n",
       "        return format(date);\n",
       "      }\n",
       "\n",
       "      function fixNumberTo(number, decimals = 3) {\n",
       "        return parseFloat(number).toFixed(decimals);\n",
       "      }\n",
       "\n",
       "      const randomNumbers = (range) =&gt; Math.floor(Math.random() * range)\n",
       "\n",
       "      const findFetureWithNumberSummary = (column) =&gt; {\n",
       "        const fetureIndex = Object.values(column.columns)\n",
       "              .findIndex((feture) =&gt; feture.numberSummary)\n",
       "\n",
       "        return Object.keys(column.columns)[fetureIndex]\n",
       "      }\n",
       "\n",
       "      const alertListItemStatus = (status, passedItem, failedItem) =&gt; {\n",
       "        if (status) {\n",
       "          return passedItem\n",
       "        } else {\n",
       "          return failedItem\n",
       "        }\n",
       "      }\n",
       "\n",
       "      const alertListElement = (name, text, status) =&gt; {\n",
       "\n",
       "        return (\n",
       "          `&lt;div\n",
       "             data-inferred-type=${alertListItemStatus(status, &quot;passed&quot;, &quot;failed&quot;)}\n",
       "             class=&quot;alert-list-item display-flex justify-content-space-between align-items-center mb-2&quot;\n",
       "           &gt;\n",
       "            &lt;div class=&quot;alert-list-text&quot;&gt;\n",
       "              ${\n",
       "                name &amp;&amp;\n",
       "                alertListItemStatus(\n",
       "                  status,\n",
       "                  `&lt;mark class=&quot;blue-mark&quot;&gt;${name}&lt;/mark&gt;`,\n",
       "                  `&lt;mark class=&quot;red-mark&quot;&gt;${name}&lt;/mark&gt;`\n",
       "                )\n",
       "              }\n",
       "              ${text}\n",
       "            &lt;/div&gt;\n",
       "              ${\n",
       "                alertListItemStatus(\n",
       "                  status,\n",
       "                  `&lt;div class=&quot;turquoise-background-color alert-tag&quot;&gt;Passed&lt;/div&gt;`,\n",
       "                  `&lt;div class=&quot;bordeaux-background-color alert-tag&quot;&gt;Failed&lt;/div&gt;`\n",
       "                )\n",
       "              }\n",
       "          &lt;/div&gt;`\n",
       "        )\n",
       "      }\n",
       "\n",
       "      let failedConstraints = 0;\n",
       "\n",
       "      Handlebars.registerHelper(&quot;getProfileTimeStamp&quot;, function (column) {\n",
       "        return formatLabelDate(+column.properties.dataTimestamp)\n",
       "      });\n",
       "\n",
       "      Handlebars.registerHelper(&quot;getProfileName&quot;, function (column) {\n",
       "        return column.properties.tags.name\n",
       "      });\n",
       "\n",
       "\n",
       "      Handlebars.registerHelper(&quot;alertLIst&quot;, function (column) {\n",
       "        let alertListItem = column.map((value) =&gt; {\n",
       "          if (value[1][0]) {\n",
       "            let alertListValue = value[1].map((cstr)=&gt;{\n",
       "              return alertListElement(value[0],cstr[0],cstr[cstr.length - 1] === 0 || (failedConstraints++, false))\n",
       "            })\n",
       "            return alertListValue.join(&#x27; &#x27;)\n",
       "          } else {\n",
       "            return alertListElement(&#x27;&#x27;, value[0], value[value.length - 1] === 0 ||  (failedConstraints++, false))\n",
       "          }\n",
       "        })\n",
       "         $(document).ready(() =&gt; {\n",
       "           $(&quot;.wl__feature-count--discrete&quot;).append(failedConstraints)\n",
       "           $(&quot;.wl__feature-count--non-discrete&quot;).append(column.length - failedConstraints)\n",
       "           $(&quot;.wl__feature-count--unknown&quot;).append(column.length)\n",
       "         })\n",
       "        return alertListItem.join(&#x27; &#x27;)\n",
       "      });\n",
       "\n",
       "    }\n",
       "\n",
       "    function openFilter() {\n",
       "      const $filterOptions = $(&quot;.dropdown-container&quot;);\n",
       "      const filterClass = $filterOptions.attr(&quot;class&quot;);\n",
       "\n",
       "      if (filterClass.indexOf(&quot;d-none&quot;) &gt; 0) {\n",
       "        $filterOptions.removeClass(&quot;d-none&quot;);\n",
       "        $(&quot;.filter-icon&quot;).addClass(&quot;d-none&quot;)\n",
       "        $(&quot;.close-filter-icon&quot;).removeClass(&quot;d-none&quot;)\n",
       "      } else {\n",
       "        $filterOptions.addClass(&quot;d-none&quot;);\n",
       "        $(&quot;.close-filter-icon&quot;).addClass(&quot;d-none&quot;)\n",
       "        $(&quot;.filter-icon&quot;).removeClass(&quot;d-none&quot;)\n",
       "      }\n",
       "    }\n",
       "\n",
       "    function initHandlebarsTemplate() {\n",
       "      // Replace this context with JSON from .py file\n",
       "      const context = [[&quot;grade&quot;, [[&quot;Chi-Squared test p-value is greater than 0.05&quot;, 1, 1]]], [&quot;term&quot;, [[&quot;KL Divergence is less than 0.5&quot;, 1, 1]]], [&quot;int_rate&quot;, [[&quot;KL Divergence is less than 2.5&quot;, 1, 0]]], [&quot;loan_amnt&quot;, [[&quot;parametrized KS test p-value is greater than 0.05&quot;, 1, 1]]], [&quot;debt_settlement_flag&quot;, [[&quot;approximate entropy is between 0.1 and 0.2&quot;, 1, 0]]]];\n",
       "      // Config handlebars and pass data to HBS template\n",
       "      const source = document.getElementById(&quot;entry-template&quot;).innerHTML;\n",
       "      const template = Handlebars.compile(source);\n",
       "      const html = template(context);\n",
       "      const target = document.getElementById(&quot;generated-html&quot;);\n",
       "      target.innerHTML = html;\n",
       "    }\n",
       "\n",
       "    function initWebsiteScripts() {\n",
       "      const $featureSearch = document.getElementById(&quot;wl__feature-search&quot;);\n",
       "      const $alertList = document.getElementById(&quot;alert-list&quot;);\n",
       "      const $discrete = document.getElementById(&quot;inferredDiscrete&quot;);\n",
       "      const $nonDiscrete = document.getElementById(&quot;inferredNonDiscrete&quot;);\n",
       "      const $unknown = document.getElementById(&quot;inferredUnknown&quot;);\n",
       "\n",
       "      const activeTypes = {\n",
       "        passed: true,\n",
       "        failed: true\n",
       "      };\n",
       "\n",
       "      let searchString = &quot;&quot;;\n",
       "\n",
       "      function debounce(func, wait, immediate) {\n",
       "        let timeout;\n",
       "\n",
       "        return function () {\n",
       "          const context = this;\n",
       "          const args = arguments;\n",
       "          const later = function () {\n",
       "            timeout = null;\n",
       "            if (!immediate) func.apply(context, args);\n",
       "          };\n",
       "\n",
       "          const callNow = immediate &amp;&amp; !timeout;\n",
       "          clearTimeout(timeout);\n",
       "          timeout = setTimeout(later, wait);\n",
       "          if (callNow) func.apply(context, args);\n",
       "        };\n",
       "      }\n",
       "\n",
       "      function filterNotification() {\n",
       "        const $notifCircleContainer = $(&quot;.notif-circle-container&quot;)\n",
       "        const $boxes = $(&#x27;.wl_filter-options&gt;.form-check&gt;input[name=checkbox]:checked&#x27;);\n",
       "        const item = Object.values($boxes).find(function(value) { return $(value)[0] === undefined});\n",
       "        if (item === undefined) {\n",
       "          $notifCircleContainer.removeClass(&quot;d-none&quot;)\n",
       "        } else {\n",
       "          $notifCircleContainer.addClass(&quot;d-none&quot;)\n",
       "        }\n",
       "      }\n",
       "\n",
       "      function handleSearch() {\n",
       "        const tableBodyChildren = $alertList.children;\n",
       "\n",
       "        for (let i = 0; i &lt; tableBodyChildren.length; i++) {\n",
       "          const type = tableBodyChildren[i].dataset.inferredType.toLowerCase();\n",
       "          const name = $(tableBodyChildren[i].children[0]).find(&quot;mark&quot;).text().toLowerCase();\n",
       "\n",
       "          if (activeTypes[type] &amp;&amp; name.startsWith(searchString)) {\n",
       "            tableBodyChildren[i].style.display = &quot;&quot;;\n",
       "          } else {\n",
       "            tableBodyChildren[i].style.display = &quot;none&quot;;\n",
       "          }\n",
       "        }\n",
       "      }\n",
       "\n",
       "      const checkedBoxes = () =&gt; {\n",
       "        if ($(&#x27;.form-check-input:checked&#x27;).length === $(&quot;.form-check-input&quot;).length - 1) {\n",
       "          $($(&quot;.form-check-input&quot;)[$(&quot;.form-check-input&quot;).length - 1]).prop( &quot;checked&quot;, true );\n",
       "        }\n",
       "      }\n",
       "\n",
       "      $featureSearch.addEventListener(\n",
       "        &quot;keyup&quot;,\n",
       "        debounce((event) =&gt; {\n",
       "          searchString = event.target.value.toLowerCase();\n",
       "          handleSearch();\n",
       "        }, 100),\n",
       "      );\n",
       "\n",
       "      $discrete.addEventListener(&quot;change&quot;, (event) =&gt; {\n",
       "        const currentCheckbox = $(event.currentTarget);\n",
       "\n",
       "        if (event.currentTarget.checked) {\n",
       "          activeTypes[&quot;failed&quot;] = true;\n",
       "          checkedBoxes();\n",
       "        } else {\n",
       "          activeTypes[&quot;failed&quot;] = false;\n",
       "          $($(&quot;.form-check-input&quot;)[$(&quot;.form-check-input&quot;).length - 1]).prop( &quot;checked&quot;, false );\n",
       "        }\n",
       "        handleSearch();\n",
       "      });\n",
       "\n",
       "      $nonDiscrete.addEventListener(&quot;change&quot;, (event) =&gt; {\n",
       "        const currentCheckbox = $(event.currentTarget);\n",
       "\n",
       "        if (event.currentTarget.checked) {\n",
       "          activeTypes[&quot;passed&quot;] = true;\n",
       "          checkedBoxes();\n",
       "        } else {\n",
       "          activeTypes[&quot;passed&quot;] = false;\n",
       "          $($(&quot;.form-check-input&quot;)[$(&quot;.form-check-input&quot;).length - 1]).prop( &quot;checked&quot;, false );\n",
       "        }\n",
       "        handleSearch();\n",
       "      });\n",
       "\n",
       "      $unknown.addEventListener(&quot;change&quot;, (event) =&gt; {\n",
       "        const currentCheckbox = $(event.currentTarget);\n",
       "\n",
       "        if (event.currentTarget.checked) {\n",
       "          $(&quot;.form-check-input&quot;).prop( &quot;checked&quot;, true );\n",
       "          activeTypes[&quot;passed&quot;] = true;\n",
       "          activeTypes[&quot;failed&quot;] = true;\n",
       "          checkedBoxes();\n",
       "        } else {\n",
       "          $(&quot;.form-check-input&quot;).prop( &quot;checked&quot;, false );\n",
       "          activeTypes[&quot;passed&quot;] = false;\n",
       "          activeTypes[&quot;failed&quot;] = false;\n",
       "        }\n",
       "        handleSearch();\n",
       "      });\n",
       "    }\n",
       "\n",
       "    function checkedBoxes() {\n",
       "      const $boxes = $(&#x27;input[name=checkbox]:checked&#x27;);\n",
       "      const $notifCircleContainer = $(&quot;.notif-circle-container&quot;)\n",
       "\n",
       "      if ($boxes.length) {\n",
       "        $notifCircleContainer.removeClass(&quot;d-none&quot;)\n",
       "      }\n",
       "    }\n",
       "\n",
       "    function openFilter() {\n",
       "      const $filterOptions = $(&quot;.dropdown-container&quot;);\n",
       "      const $notifCircleContainer = $(&quot;.notif-circle-container&quot;)\n",
       "      const filterClass = $filterOptions.attr(&quot;class&quot;);\n",
       "\n",
       "      if (filterClass.indexOf(&quot;d-none&quot;) &gt; 0) {\n",
       "        $notifCircleContainer.addClass(&quot;d-none&quot;)\n",
       "        $filterOptions.removeClass(&quot;d-none&quot;);\n",
       "        $(&quot;.filter-icon&quot;).addClass(&quot;d-none&quot;)\n",
       "        $(&quot;.close-filter-icon&quot;).removeClass(&quot;d-none&quot;)\n",
       "      } else {\n",
       "        $filterOptions.addClass(&quot;d-none&quot;);\n",
       "        $(&quot;.close-filter-icon&quot;).addClass(&quot;d-none&quot;)\n",
       "        $(&quot;.filter-icon&quot;).removeClass(&quot;d-none&quot;)\n",
       "        checkedBoxes()\n",
       "      }\n",
       "    }\n",
       "\n",
       "    // Invoke functions -- keep in mind invokation order\n",
       "    registerHandlebarHelperFunctions();\n",
       "    initHandlebarsTemplate();\n",
       "    initWebsiteScripts();\n",
       "  &lt;/script&gt;\n",
       "&lt;/html&gt;\n",
       "\" width=100% height=750PX frameBorder=0></iframe>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "test_report = test_profile.apply_summary_constraints(constraints.summary_constraint_map)\n",
    "visualization.constraints_report(constraints)"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.13"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}