Retail_Scenario.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Smart Queue Monitoring System - Retail Scenario\n",
    "\n",
    "## Overview\n",
    "Now that you have your Python script and job submission script, you're ready to request an **IEI Tank-870** edge node and run inference on the different hardware types (CPU, GPU, VPU, FPGA).\n",
    "\n",
    "After the inference is completed, the output video and stats files need to be retrieved and stored in the workspace, which can then be viewed within the Jupyter Notebook.\n",
    "\n",
    "## Objectives\n",
    "* Submit inference jobs to Intel's DevCloud using the `qsub` command.\n",
    "* Retrieve and review the results.\n",
    "* After testing, go back to the proposal doc and update your original proposed hardware device."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Step 0: Set Up\n",
    "\n",
    "#### IMPORTANT: Set up paths so we can run Dev Cloud utilities\n",
    "You *must* run this every time you enter a Workspace session.\n",
    "(Tip: select the cell and use **Shift+Enter** to run the cell.)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "env: PATH=/opt/conda/bin:/opt/spark-2.4.3-bin-hadoop2.7/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/intel_devcloud_support\n"
     ]
    }
   ],
   "source": [
    "%env PATH=/opt/conda/bin:/opt/spark-2.4.3-bin-hadoop2.7/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/intel_devcloud_support\n",
    "import os\n",
    "import sys\n",
    "sys.path.insert(0, os.path.abspath('/opt/intel_devcloud_support'))\n",
    "sys.path.insert(0, os.path.abspath('/opt/intel'))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Step 0.1:  (Optional-step): Original Video\n",
    "\n",
    "If you are curious to see the input video, run the following cell to view the original video stream we'll be using for inference."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<h5>Retail</h5>\n",
       "        <video alt=\"\" controls autoplay muted height=\"480\"><source src=\"original_videos/Retail.mp4\" type=\"video/mp4\" /></video>\n",
       "        "
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import videoHtml\n",
    "videoHtml.videoHTML('Retail', ['original_videos/Retail.mp4'])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Step 1 : Inference on a Video\n",
    "\n",
    "In the next few cells, You'll submit your job using the `qsub` command and retrieving the results for each job. Each of the cells below should submit a job to different edge compute nodes.\n",
    "\n",
    "The output of the cell is the `JobID` of your job, which you can use to track progress of a job with `liveQStat`.\n",
    "\n",
    "You will need to submit a job for each of the following hardware types:\n",
    "* **CPU**\n",
    "* **GPU**\n",
    "* **VPU**\n",
    "* **FPGA**\n",
    "\n",
    "**Note** You will have to submit each job one at a time and retrieve their results. \n",
    "\n",
    "After submission, they will go into a queue and run as soon as the requested compute resources become available. \n",
    "(Tip: **shift+enter** will run the cell and automatically move you to the next cell.)\n",
    "\n",
    "If your job successfully runs and completes, once you retrieve your results, it should output a video and a stats text file in the `results/retail/<DEVICE>` directory.\n",
    "\n",
    "For example, your **CPU** job should output its files in this directory:\n",
    "> **results/retail/cpu**\n",
    "\n",
    "**Note**: To get the queue labels for the different hardware devices, you can go to [this link](https://devcloud.intel.com/edge/get_started/devcloud/).\n",
    "\n",
    "The following arguments should be passed to the job submission script after the `-F` flag:\n",
    "* Model path - `/data/models/intel/person-detection-retail-0013/<MODEL PRECISION>/`. You will need to adjust this path based on the model precision being using on the hardware.\n",
    "* Device - `CPU`, `GPU`, `MYRIAD`, `HETERO:FPGA,CPU`\n",
    "* Manufacturing video path - `/data/resources/retail.mp4`\n",
    "* Manufacturing queue_param file path - `/data/queue_param/retail.npy`\n",
    "* Output path - `/output/results/retail/<DEVICE>` This should be adjusted based on the device used in the job.\n",
    "* Max num of people - This is the max number of people in queue before the system would redirect them to another queue."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Step 1.1: Submit to an Edge Compute Node with an Intel CPU\n",
    "In the cell below, write a script to submit a job to an <a \n",
    "    href=\"https://software.intel.com/en-us/iot/hardware/iei-tank-dev-kit-core\">IEI \n",
    "    Tank* 870-Q170</a> edge node with an <a \n",
    "    href=\"https://ark.intel.com/products/88186/Intel-Core-i5-6500TE-Processor-6M-Cache-up-to-3-30-GHz-\">Intel® Core™ i5-6500TE processor</a>. The inference workload should run on the CPU."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0XBhNNjYMClCPBsdSXajCiEuNt892b5H\n"
     ]
    }
   ],
   "source": [
    "#Submit job to the queue\n",
    "cpu_job_id = !qsub queue_job.sh -d . -l nodes=1:tank-870:i5-6500te -F \"/data/models/intel/person-detection-retail-0013/FP32/person-detection-retail-0013 CPU /data/resources/retail.mp4 /data/queue_param/retail.npy /output/results/retail/cpu/ 5\" -N store_core\n",
    "\n",
    "print(cpu_job_id[0])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Check Job Status\n",
    "\n",
    "To check on the job that was submitted, use `liveQStat` to check the status of the job.\n",
    "\n",
    "Column `S` shows the state of your running jobs.\n",
    "\n",
    "For example:\n",
    "- If `JOB ID`is in Q state, it is in the queue waiting for available resources.\n",
    "- If `JOB ID` is in R state, it is running."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "import liveQStat\n",
    "liveQStat.liveQStat()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Get Results\n",
    "\n",
    "Run the next cell to retrieve your job's results."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "getResults() is blocking until results of the job (id:0XBhNNjYMClCPBsdSXajCiEuNt892b5H) are ready.\n",
      "Please wait...Success!\n",
      "output.tgz was downloaded in the same folder as this notebook.\n"
     ]
    }
   ],
   "source": [
    "import get_results\n",
    "get_results.getResults(cpu_job_id[0], filename='output.tgz', blocking=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Unpack your output files and view stdout.log"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "!tar zxf output.tgz"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 0\r\n",
      "Number of people in queue = {1: 0, 2: 0}\r\n",
      "results/\r\n",
      "results/retail/\r\n",
      "results/retail/cpu/\r\n",
      "results/retail/cpu/stats.txt\r\n",
      "results/retail/cpu/output_video.mp4\r\n",
      "stderr.log\r\n"
     ]
    }
   ],
   "source": [
    "!cat stdout.log"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### View stderr.log\n",
    "This can be used for debugging"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "person_detect.py:48: DeprecationWarning: Reading network using constructor is deprecated. Please, use IECore.read_network() method instead\r\n",
      "  self.model=IENetwork(self.model_structure, self.model_weights)\r\n"
     ]
    }
   ],
   "source": [
    "!cat stderr.log"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### View Output Video\n",
    "Run the cell below to view the output video. If inference was successfully run, you should see a video with bounding boxes drawn around each person detected."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<h5>Retail CPU</h5>\n",
       "        <video alt=\"\" controls autoplay muted height=\"480\"><source src=\"results/retail/cpu/output_video.mp4\" type=\"video/mp4\" /></video>\n",
       "        "
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import videoHtml\n",
    "\n",
    "videoHtml.videoHTML('Retail CPU', ['results/retail/cpu/output_video.mp4'])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Step 1.2: Submit to an Edge Compute Node with a CPU and IGPU\n",
    "In the cell below, write a script to submit a job to an <a \n",
    "    href=\"https://software.intel.com/en-us/iot/hardware/iei-tank-dev-kit-core\">IEI \n",
    "    Tank* 870-Q170</a> edge node with an <a href=\"https://ark.intel.com/products/88186/Intel-Core-i5-6500TE-Processor-6M-Cache-up-to-3-30-GHz-\">Intel® Core i5-6500TE</a>. The inference workload should run on the **Intel® HD Graphics 530** integrated GPU."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "f11pDwxnW1cuETkkXvOcwsP5wV4Af88W\n"
     ]
    }
   ],
   "source": [
    "#Submit job to the queue\n",
    "gpu_job_id = !qsub queue_job.sh -d . -l nodes=1:tank-870:i5-6500te:intel-hd-530 -F \"/data/models/intel/person-detection-retail-0013/FP32/person-detection-retail-0013 GPU /data/resources/retail.mp4 /data/queue_param/retail.npy /output/results/retail/gpu/ 5\" -N store_core\n",
    "\n",
    "print(gpu_job_id[0])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Check Job Status\n",
    "\n",
    "To check on the job that was submitted, use `liveQStat` to check the status of the job.\n",
    "\n",
    "Column `S` shows the state of your running jobs.\n",
    "\n",
    "For example:\n",
    "- If `JOB ID`is in Q state, it is in the queue waiting for available resources.\n",
    "- If `JOB ID` is in R state, it is running."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "import liveQStat\n",
    "liveQStat.liveQStat()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Get Results\n",
    "\n",
    "Run the next cell to retrieve your job's results."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "getResults() is blocking until results of the job (id:f11pDwxnW1cuETkkXvOcwsP5wV4Af88W) are ready.\n",
      "Please wait......Success!\n",
      "output.tgz was downloaded in the same folder as this notebook.\n"
     ]
    }
   ],
   "source": [
    "import get_results\n",
    "get_results.getResults(gpu_job_id[0], filename='output.tgz', blocking=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Unpack your output files and view stdout.log"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [],
   "source": [
    "!tar zxf output.tgz"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 0\r\n",
      "Number of people in queue = {1: 0, 2: 0}\r\n",
      "results/\r\n",
      "results/retail/\r\n",
      "results/retail/gpu/\r\n",
      "results/retail/gpu/stats.txt\r\n",
      "results/retail/gpu/output_video.mp4\r\n",
      "stderr.log\r\n"
     ]
    }
   ],
   "source": [
    "!cat stdout.log"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### View stderr.log\n",
    "This can be used for debugging"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "person_detect.py:48: DeprecationWarning: Reading network using constructor is deprecated. Please, use IECore.read_network() method instead\r\n",
      "  self.model=IENetwork(self.model_structure, self.model_weights)\r\n"
     ]
    }
   ],
   "source": [
    "!cat stderr.log"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### View Output Video\n",
    "Run the cell below to view the output video. If inference was successfully run, you should see a video with bounding boxes drawn around each person detected."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<h5>Retail GPU</h5>\n",
       "        <video alt=\"\" controls autoplay muted height=\"480\"><source src=\"results/retail/gpu/output_video.mp4\" type=\"video/mp4\" /></video>\n",
       "        "
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import videoHtml\n",
    "\n",
    "videoHtml.videoHTML('Retail GPU', ['results/retail/gpu/output_video.mp4'])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Step 1.3: Submit to an Edge Compute Node with an Intel® Neural Compute Stick 2\n",
    "In the cell below, write a script to submit a job to an <a \n",
    "    href=\"https://software.intel.com/en-us/iot/hardware/iei-tank-dev-kit-core\">IEI \n",
    "    Tank 870-Q170</a> edge node with an <a href=\"https://ark.intel.com/products/88186/Intel-Core-i5-6500TE-Processor-6M-Cache-up-to-3-30-GHz-\">Intel Core i5-6500te CPU</a>. The inference workload should run on an <a \n",
    "    href=\"https://software.intel.com/en-us/neural-compute-stick\">Intel Neural Compute Stick 2</a> installed in this  node."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "O5QbXLLH17jImED6qxEbsyho9G7c8Thn\n"
     ]
    }
   ],
   "source": [
    "#Submit job to the queue\n",
    "vpu_job_id = !qsub queue_job.sh -d . -l nodes=1:tank-870:i5-6500te:intel-ncs2 -F \"/data/models/intel/person-detection-retail-0013/FP32/person-detection-retail-0013 MYRIAD /data/resources/retail.mp4 /data/queue_param/retail.npy /output/results/retail/vpu/ 5\" -N store_core\n",
    "\n",
    "print(vpu_job_id[0])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Check Job Status\n",
    "\n",
    "To check on the job that was submitted, use `liveQStat` to check the status of the job.\n",
    "\n",
    "Column `S` shows the state of your running jobs.\n",
    "\n",
    "For example:\n",
    "- If `JOB ID`is in Q state, it is in the queue waiting for available resources.\n",
    "- If `JOB ID` is in R state, it is running."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [],
   "source": [
    "import liveQStat\n",
    "liveQStat.liveQStat()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Get Results\n",
    "\n",
    "Run the next cell to retrieve your job's results."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "getResults() is blocking until results of the job (id:O5QbXLLH17jImED6qxEbsyho9G7c8Thn) are ready.\n",
      "Please wait...Success!\n",
      "output.tgz was downloaded in the same folder as this notebook.\n"
     ]
    }
   ],
   "source": [
    "import get_results\n",
    "get_results.getResults(vpu_job_id[0], filename='output.tgz', blocking=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Unpack your output files and view stdout.log"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [],
   "source": [
    "!tar zxf output.tgz"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 0\r\n",
      "Number of people in queue = {1: 0, 2: 0}\r\n",
      "results/\r\n",
      "results/retail/\r\n",
      "results/retail/vpu/\r\n",
      "results/retail/vpu/stats.txt\r\n",
      "results/retail/vpu/output_video.mp4\r\n",
      "stderr.log\r\n"
     ]
    }
   ],
   "source": [
    "!cat stdout.log"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### View stderr.log\n",
    "This can be used for debugging"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "person_detect.py:48: DeprecationWarning: Reading network using constructor is deprecated. Please, use IECore.read_network() method instead\r\n",
      "  self.model=IENetwork(self.model_structure, self.model_weights)\r\n"
     ]
    }
   ],
   "source": [
    "!cat stderr.log"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### View Output Video\n",
    "Run the cell below to view the output video. If inference was successfully run, you should see a video with bounding boxes drawn around each person detected."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<h5>Retail VPU</h5>\n",
       "        <video alt=\"\" controls autoplay muted height=\"480\"><source src=\"results/retail/vpu/output_video.mp4\" type=\"video/mp4\" /></video>\n",
       "        "
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "execution_count": 23,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import videoHtml\n",
    "\n",
    "videoHtml.videoHTML('Retail VPU', ['results/retail/vpu/output_video.mp4'])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Step 1.4: Submit to an Edge Compute Node with IEI Mustang-F100-A10\n",
    "In the cell below, write a script to submit a job to an <a \n",
    "    href=\"https://software.intel.com/en-us/iot/hardware/iei-tank-dev-kit-core\">IEI \n",
    "    Tank 870-Q170</a> edge node with an <a href=\"https://ark.intel.com/products/88186/Intel-Core-i5-6500TE-Processor-6M-Cache-up-to-3-30-GHz-\">Intel Core™ i5-6500te CPU</a> . The inference workload will run on the <a href=\"https://www.ieiworld.com/mustang-f100/en/\"> IEI Mustang-F100-A10 </a> FPGA card installed in this node."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "4X8HKhvLPvwTUT5C3chOBxHW5hfkxch1\n"
     ]
    }
   ],
   "source": [
    "#Submit job to the queue\n",
    "fpga_job_id = !qsub queue_job.sh -d . -l nodes=1:tank-870:i5-6500te:iei-mustang-f100-a10 -F \"/data/models/intel/person-detection-retail-0013/FP32/person-detection-retail-0013 HETERO:FPGA,CPU /data/resources/retail.mp4 /data/queue_param/retail.npy /output/results/retail/fpga/ 5\" -N store_core\n",
    "\n",
    "print(fpga_job_id[0])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Check Job Status\n",
    "\n",
    "To check on the job that was submitted, use `liveQStat` to check the status of the job.\n",
    "\n",
    "Column `S` shows the state of your running jobs.\n",
    "\n",
    "For example:\n",
    "- If `JOB ID`is in Q state, it is in the queue waiting for available resources.\n",
    "- If `JOB ID` is in R state, it is running."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [],
   "source": [
    "import liveQStat\n",
    "liveQStat.liveQStat()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Get Results\n",
    "\n",
    "Run the next cell to retrieve your job's results."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "getResults() is blocking until results of the job (id:4X8HKhvLPvwTUT5C3chOBxHW5hfkxch1) are ready.\n",
      "Please wait...Success!\n",
      "output.tgz was downloaded in the same folder as this notebook.\n"
     ]
    }
   ],
   "source": [
    "import get_results\n",
    "get_results.getResults(fpga_job_id[0], filename='output.tgz', blocking=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Unpack your output files and view stdout.log"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [],
   "source": [
    "!tar zxf output.tgz"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INTELFPGAOCLSDKROOT is not set\r\n",
      "Using script's current directory (/opt/altera/aocl-pro-rte/aclrte-linux64)\r\n",
      "\r\n",
      "aoc was not found, but aocl was found. Assuming only RTE is installed.\r\n",
      "\r\n",
      "AOCL_BOARD_PACKAGE_ROOT is set to /opt/intel/openvino/bitstreams/a10_vision_design_sg2_bitstreams/BSP/a10_1150_sg2. Using that.\r\n",
      "Adding /opt/altera/aocl-pro-rte/aclrte-linux64/bin to PATH\r\n",
      "Adding /opt/altera/aocl-pro-rte/aclrte-linux64/linux64/lib to LD_LIBRARY_PATH\r\n",
      "Adding /opt/altera/aocl-pro-rte/aclrte-linux64/host/linux64/lib to LD_LIBRARY_PATH\r\n",
      "Adding /opt/intel/openvino/bitstreams/a10_vision_design_sg2_bitstreams/BSP/a10_1150_sg2/linux64/lib to LD_LIBRARY_PATH\r\n",
      "aocl program: Running program from /opt/intel/openvino/bitstreams/a10_vision_design_sg2_bitstreams/BSP/a10_1150_sg2/linux64/libexec\r\n",
      "Failed to open file: /opt/intel/openvino/bitstreams/a10_vision_design_sg2_bitstreams/2020-2_PL2_FP16_MobileNet_Clamp.aocx\r\n",
      "Error: Failed to find aocx\r\n",
      "aocl program: Program failed.\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 6\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 5\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 2, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 4\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 3\r\n",
      "Number of people in queue = {1: 1, 2: 1}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 2\r\n",
      "Number of people in queue = {1: 1, 2: 0}\r\n",
      "preprocess input\r\n",
      "Start async inference\r\n",
      "Waiting for output of inference\r\n",
      "Obtain coords of the conf threshold\r\n",
      "Return coords and images\r\n",
      "Inference success\r\n",
      "Total People in frame = 0\r\n",
      "Number of people in queue = {1: 0, 2: 0}\r\n",
      "results/\r\n",
      "results/retail/\r\n",
      "results/retail/fpga/\r\n",
      "results/retail/fpga/stats.txt\r\n",
      "results/retail/fpga/output_video.mp4\r\n",
      "stderr.log\r\n"
     ]
    }
   ],
   "source": [
    "!cat stdout.log"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### View stderr.log\n",
    "This can be used for debugging"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Couldn't open file /opt/intel/openvino/bitstreams/a10_vision_design_sg2_bitstreams/2020-2_PL2_FP16_MobileNet_Clamp.aocx for reading\r\n",
      "person_detect.py:48: DeprecationWarning: Reading network using constructor is deprecated. Please, use IECore.read_network() method instead\r\n",
      "  self.model=IENetwork(self.model_structure, self.model_weights)\r\n"
     ]
    }
   ],
   "source": [
    "!cat stderr.log"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### View Output Video\n",
    "Run the cell below to view the output video. If inference was successfully run, you should see a video with bounding boxes drawn around each person detected."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<h5>Retail FPGA</h5>\n",
       "        <video alt=\"\" controls autoplay muted height=\"480\"><source src=\"results/retail/fpga/output_video.mp4\" type=\"video/mp4\" /></video>\n",
       "        "
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "execution_count": 30,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import videoHtml\n",
    "\n",
    "videoHtml.videoHTML('Retail FPGA', ['results/retail/fpga/output_video.mp4'])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "***Wait!***\n",
    "\n",
    "Please wait for all the inference jobs and video rendering to complete before proceeding to the next step.\n",
    "\n",
    "## Step 2: Assess Performance\n",
    "\n",
    "Run the cells below to compare the performance across all 4 devices. The following timings for the model are being comapred across all 4 devices:\n",
    "\n",
    "- Model Loading Time\n",
    "- Average Inference Time\n",
    "- FPS"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [],
   "source": [
    "import matplotlib.pyplot as plt\n",
    "\n",
    "device_list=['cpu', 'gpu', 'fpga', 'vpu']\n",
    "inference_time=[]\n",
    "fps=[]\n",
    "model_load_time=[]\n",
    "\n",
    "for device in device_list:\n",
    "    with open('results/retail/'+device+'/stats.txt', 'r') as f:\n",
    "        inference_time.append(float(f.readline().split(\"\\n\")[0]))\n",
    "        fps.append(float(f.readline().split(\"\\n\")[0]))\n",
    "        model_load_time.append(float(f.readline().split(\"\\n\")[0]))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYIAAAEKCAYAAAAfGVI8AAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4wLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvpW3flQAAF2VJREFUeJzt3XuYJVV57/HvDxRBLgoyKFFwjGIUoiCOxASIKGoAbxhBj0+84WVE5aiPehRvEfVovCSaeLzgqAgaxRjFiIgCosBB5TKMgIMoKpIE4TijIhcjIvCeP6paOmP37prprr2Zru/nefazd62qXfWymO63V61Va6WqkCQN1yaTDkCSNFkmAkkaOBOBJA2ciUCSBs5EIEkDZyKQpIEzEUjSwJkIJGngTASSNHB3mHQAXWy//fa1dOnSSYchSRuVCy644OdVtWSu4zaKRLB06VJWrlw56TAkaaOS5N+7HOetIUkaOBOBJA2ciUCSBs5EIEkD11siSLJTkm8kuTTJJUle1pYfleSnSS5sXwf1FYMkaW59jhq6GXhlVa1KsjVwQZLT2n3vraq/7/HakqSOeksEVXU1cHX7+foklwL37Ot6kqQNM5Y+giRLgYcA57ZFRyS5OMkxSbYdRwySpJn1ngiSbAV8Hnh5VV0HfAi4L7AHTYvhH2b53vIkK5OsXLt2bd9hStJg9fpkcZI70iSBT1XVCQBV9bNp+z8CnDTTd6tqBbACYNmyZdVnnJJun5Ye+eVJhzBxV7zjcb1fo89RQwE+BlxaVe+ZVr7jtMOeDKzuKwZJ0tz6bBHsDTwT+G6SC9uy1wFPT7IHUMAVwAt7jEGSNIc+Rw2dDWSGXSf3dU1J0vrzyWJJGjgTgSQNnIlAkgbORCBJA2cikKSBMxFI0sCZCCRp4EwEkjRwJgJJGjgTgSQNnIlAkgbORCBJA2cikKSBMxFI0sCZCCRp4EwEkjRwcyaCJEck2ab9/OEk5yXZv//QJEnj0KVFsLyqrkvyWOCewIuAd/UbliRpXLokgmrfDwQ+XlUXdPyeJGkj0OUX+kVJTgaeAHwlyVbclhwkSRu5LovXHwY8FPhRVf1Xku2B5/UbliRpXGZNBEkePG3zRuBeSe7Vbt/Sa1SSpLEZ1SL4QPt+J+AhwCVAgN2A84E/7zc0SdI4zNpHUFX7VtW+wI+Bh1XVHlW1O81tokvHFaAkqV9dOosfWFUXTm1U1UXAnv2FJEkapy6dxZclORr4Z5rRQs8ALus1KknS2HRpETyb5vbQa4AjgcvbMknSIjBni6CqfgO8u31JkhaZORNBkocDbwLuPf34qrp/j3FJksakSx/Bx4FXAxfg8wOStOh0SQTXVdWXeo9EkjQRXRLB15P8HXAC8Nupwqq6uLeoJElj0yUR7LPOOzTDSP9y4cORJI1bl1FD+27IiZPsBHwCuAdwK7Ciqv4pyXbAvwBLgSuAp1bVNRtyDUnS/HVZoWzrJO9Kck77emeSrTuc+2bglVX1QODhwEuS7ErzLMLpVbULcHq7LUmakC4PlB0D/A54Vvu6iWYk0UhVdXVVrWo/X08zP9E9gScBx7WHHQccvP5hS5IWSpc+gl2q6tBp229McuGsR88gyVKaGUzPBe5eVVdDkyyS7DDLd5YDywF23nnn9bmcJGk9dGkR3Jjk91NOtw+Y3dj1Au2KZp8HXl5V13X9XlWtqKplVbVsyZIlXb8mSVpPXVoELwY+meRO7fZvaG4RzSnJHWmSwKeq6oS2+GdJdmxbAzsCa9Y3aEnSwukyamgVsFs72idV9YsuJ04S4GPApVX1nmm7TqSZtO4d7fsX1ztqSdKC6TJq6K1J7lpVv6yqXyTZNsmbO5x7b+CZwKOSXNi+DqJJAI9J8kPgMe22JGlCutwaenxVvXFqo6quSfIEmonoZlVVZ9MsbTmT/buHKEnqU5fO4k2TbDa1kWRzYLMRx0uSNiJdWgSfAU5LcgzN1BLPAz7Va1SSpLHp0ln89iQXA4+mudXzrqr6cu+RSZLGokuLAOBC4NdV9Y0kmyfZsqp+3WdgkqTx6DJq6Lk0Qz4/2hbtjEM+JWnR6NJZ/FKaSeOuA6iqy4AZp4WQJG18Ok0xUVU3TW0k2ZTZh4VKkjYyXRLBN5O8Gtg8ySNp1hI4qd+wJEnj0iURvBq4Hvg+8DKaNQRe32dQkqTx6TJ89BbgQ0k+CjwAuKqqbu09MknSWMzaIkjygSS7tZ+3Ab4DfBZYneSpY4pPktSzUbeG9quqS9rPhwGXt8tOPhSXl5SkRWNUIrhp2ufHACcAVNVVOGpIkhaNUYng2iQHJHkQsA9wCvx++OgW4whOktS/UZ3FhwPvB+4BvHJqnWGaOYe+2ndgkqTxmDURVNX3aX7pr1t+Cm3rQJK08evyHIEkaREzEUjSwJkIJGng5nyyuF2m8mBg6fTjq+rt/YUlSRqXLgvTfAG4EbgAuKXfcCRJ49YlEdy7qv6090gkSRPRpY/gnCS79h6JJGkiurQI/gz4TpIfAb+lmV6iqmrPXiOTJI1Fl0RwcO9RSJImZtZEkGTLqvo1sHaM8UiSxmxUi+BzwIHAJUDR3hKa9r5z79FJkno3aq6hA9v3ncYXjiRp3HyyWJIGzkQgSQNnIpCkgeuUCJI8PMmz2s93S2JHsSQtEnMmgiRvAN4EvKEt2hz4dIfvHZNkTZLV08qOSvLTJBe2r4M2NHBJ0sLo0iI4BDgI+DVAVf0U2KbD944FDpih/L1VtUf7OrlroJKkfnRJBL+tqqJ5doAkd+5y4qo6C/jlPGKTJI1Bl0RwQpIPAHdJchhwKnDMPK55RJKL21tH287jPJKkBTBnIqiqdwInAScCuwNvq6p/3MDrfQi4L7AHcDXwD7MdmGR5kpVJVq5d6ywXktSXLpPOUVVfSXLm1PFJtqmq69b3YlX1s6nPST5Ck2BmO3YFsAJg2bJltb7XkiR102WpyucDb6VZnexW5jHXUJIdq+rqdvPJwOpRx0uS+telRfAaYPeqWrM+J05yPLAfsH2SK2mGoO6XZA+aRHIF8ML1ilaStOC6JILLgQ25DfT0GYo/tr7nkST1q0siOBL4ZpJzaFYoA6CqXtFbVJKksemSCI4Gvgl8l6aPQJK0iHRJBLdW1Ut7j0SSNBFdHig7PclzkyxJss3Uq/fIJElj0aVF8Oz2/c3TylyqUpIWiTkTgUtVStLiNmsiSPKIqjozyRNn2l9VJ/YXliRpXEa1CB4NnAkcOsO+opl7SJK0kRuVCFYCVNUzxxSLJGkCRo0aetPYopAkTYyL10vSwI26NfSAJKtmKA9QVbVnTzFJksZoVCL4CTN3FEuSFpFRieCmqvrx2CKRJE3EqD6Cc8YWhSRpYmZNBFX1onEGIkmaDEcNSdLAmQgkaeDmTARJtkjy2iRHt9v3S3Jg/6FJksahS4vgGJpnB/Zpt68C3t5bRJKkseqSCHapqrcDvwOoqv+iSQySpEWgSyK4KcnmNDOOkuQ+wE29RiVJGpsuK5S9BfgqcK8kxwGPAJ7Xa1SSpLHpskLZV5NcAPwFzS2h/1VVa3qPTJI0Fl1GDT2RZrqJL1bVv9HcKnp8/6FJksahSx/BW6rq2qmNqvoV8Nb+QpIkjVOXRDDTMV36FiRJG4EuiWBVkncluXeSnZO8G/hO34FJksajSyI4oj3ui8CX2rIX9xaRJGmsuowaugF41RhikSRNwJyJIMn9gFcAS6cfX1WP7S8sSdK4dOn0/RzwMeCfgVv6DUeSNG5dEsGtVfV/eo9EkjQRXTqLv5hkeZIlSbaZes31pSTHJFmTZPW0su2SnJbkh+37tvOKXpI0b10SwfOBNwKrgEva1+qR32gcCxywTtmRwOlVtQtwerstSZqgLqOGdtqQE1fVWUmWrlP8JGC/9vNxwBnAazbk/JKkhdF1hbIjk3yo3Z7PCmV3r6qrAdr3HTbwPJKkBdJ1hbJNgH3b7bGsUNb2S6xMsnLt2rV9X06SBmvcK5T9LMmOAO37rNNZV9WKqlpWVcuWLFmygZeTJM1l3CuUnQg8u/38bJppKyRJE9TbCmVJjqfpGN4+yZXAm4B3AJ9N8jzgP4BDNzBuSdICGZkIkgS4iOYX9nqtUFZVT59l1/7rG6QkqT8jE0FVVZKTquqheBtHkhalLn0E5yXZs/dIJEkT0aWPYB/gBUl+DPya5vZQVZXJQZIWgS6J4ODeo5AkTcyct4aq6sfAEmDv9vOvaJ8pkCRt/LosTPMGYG/gvsAngM2BT9PcMpIkbeS6dBYfAhxE0z9AVf0UmHMaaknSxqFLIvhtVRW3PVl8535DkiSNU5dEcEKSDwB3SXIYcCrNRHSSpEVg1j6CJHeoqpur6p3ttNM3AbsDb6uqr4wtQklSr0Z1Fp8LPDTJsVX1HMBf/pK0CI1KBHdK8jfAvkmeuO7Oqjqxv7AkSeMyKhG8BHgGcFf+cJbQoplSWpK0kZs1EVTVmcCZSVZW1YfHGJMkaYy6LF7/4SR7AUunH19Vn+4xLknSmHR5svhYYFfgQuCWtrhoni6WJG3kukw693Bg16q6te9gJEnj1+WBskuA7fsORJI0GV1aBHcBLk1yDvDbqcKq+uveopIkjU2XRPB3vUchSZqYLqOGTh9HIJKkyRg119A1tDOOrruLZqnK7XqLSpI0NqNaBHYQS9IAjHqy+JbZ9kmSFo8uw0clSYuYiUCSBs5EIEkD56ghSRo4Rw1J0sB1HjWUZDtg82lFV/UVlCRpfObsI0jyuCSXAVfSrGN8JfD1vgOTJI1Hl87itwF7Az+oqp2AvwLO6DMoSdL4dEkEN1fVWmCTJKmq04A9e45LkjQmXWYfvTbJlsDZwCeSrAHmtUhNkiuA62lWPLu5qpbN53ySpA3XJREcDNwIvBx4Fs36BI9fgGs/sqp+vgDnkSTNQ5dE8Nqqeh3NX+8fA0jyduB1fQYmLQZLj/zypEOYqCve8bhJh6AOuvQRHDBD2Xz/7xZwapILkiyf6YAky5OsTLJy7dq187ycJGk2o54sfiFwOHD/JKum7doaWDnP6+5dVVcl2QE4Lcn3q+qs6QdU1QpgBcCyZctmesJZkrQARt0a+ixwOs1SlUdOK7++qtbM56JVdVX7vibJF4C9gLNGf0uS1IdZbw1V1TVV9aOqOhTYAnhM+1oynwsm2TLJ1lOfgccCq+dzTknShuvyZPFLaFoHO7evzyZ58TyueXfg7CQXAecBX66qr87jfJKkeegyauiFwF5VdQP8fsTQt4APbsgFq+pyYPcN+e6GcNSGozYkjdZl1FCA303b/l1bJklaBEaNGrpDVd0MfBI4J8nn211PBo4bR3CSpP6NujV0HrBnVb0ryTeAfWlaAodX1fljiU6S1LtRieD3t3/aX/z+8pekRWhUIliS5BWz7ayq9/QQjyRpzEYlgk2BrbBjeNAcdeWoKy1+oxLB1VX1lrFFIkmaiFHDR20JSNIAjEoE+48tCknSxIyaa+iX4wxEkjQZXZ4sliQtYiYCSRo4E4EkDZyJQJIGzkQgSQNnIpCkgTMRSNLAmQgkaeBMBJI0cCYCSRo4E4EkDZyJQJIGzkQgSQNnIpCkgTMRSNLAmQgkaeBMBJI0cCYCSRo4E4EkDZyJQJIGzkQgSQNnIpCkgZtIIkhyQJIfJPlRkiMnEYMkqTH2RJBkU+ADwIHArsDTk+w67jgkSY1JtAj2An5UVZdX1U3AZ4AnTSAOSRKTSQT3BP5z2vaVbZkkaQLuMIFrZoay+oODkuXA8nbzhiQ/6DWq/mwP/HxSF887J3XlBWP9zY/1Nz8TrT+Ydx3eu8tBk0gEVwI7Tdu+F3DVugdV1QpgxbiC6kuSlVW1bNJxbKysv/mx/uZnKPU3iVtD5wO7JLlPks2A/wGcOIE4JElMoEVQVTcnOQI4BdgUOKaqLhl3HJKkxiRuDVFVJwMnT+LaE7DR396aMOtvfqy/+RlE/aXqD/ppJUkD4hQTkjRwJgJNRJKXJrk0yacmHYs0dN4a0kQk+T5wYFX9ZNKxSENni2ABJHlWkouTXJTkk0mOTXJ0kv+b5LIkj2+Pe06S90/73klJ9ptY4BOS5Gjgj4ETk1zb1tnXk/wwyQvaYzZJ8sEkl7T1dHKSQ9p9f5vk/CSrk6xIMtNDioOQ5I1Jvp/ktCTHJ3lVkjOS/GOSb7V1tFd77FFJXjXtu6uTLJ1U7LcHSd6Z5MXTto9K8sokZyX5QpLvtT/Lm7T7b5h27CFJjp1A2AvORDBPSXYDXg88qqp2B17W7loKPAJ4HHB0ks0nE+HtT1UdTvMQ4SOB9wIPpqmnPwf+NskfAX9NU4cPAp7f7pvy/qp6WFX9KbAF8PjxRX/7kWQZ8BTgITT1Nf3Bpy2r6i+AFwPHTCC8jcVngKdN234qsJZmTrRX0vz7uy9N/S5aJoL5exTwuar6OUBV/bIt/2xV3VpVPwQuBx4wqQA3Al+sqt+0dfgNmh/CfYB/bevw/7XlUx6Z5Nwk36Wp/93GH/Ltwj7cVnfXA1+atu94gKo6C9gmyV0nEeDtXVV9B9ghyR8l2R24BvgP4Lx2YsxbaOpyn0nG2beJPEewyIQZ5kqaoayAm/nvyddWQmOmuprxdk/bsvogsKyq/jPJUQy3HkfdEvPfX3efAw4B7kHTQoCZ62/d8kVTf7YI5u904KlJ7gaQZLu2/ND2Pvd9ae6H/wC4AtijLd+J5i9fwZOSbN7W4X4005CcDTylrau7t+Vw2w/fz5NsRfMDPFRnA09o624rmttrU54GkGQf4Nqqupbm39+ebfmewH3GG+7t1mdopro5hCYpAOzVToOzCU1dnt2W/yzJA9vyJ48/1H7YIpinqrokyduAM5PcAnyn3fUD4Ezg7sDhVXVjkm8CPwG+C6wGVk0i5tuh84AvAzsDb62qq5J8Htifpp4uA86l+YX2qyQfoanDK2iSxiBV1flJTgQuAv4dWAlc2+6+Jsm3gG2A57ZlnweeleRCmnq7bMwh3y61P8NbAz+tqquT/AnwbeAdNH0EZwFfaA8/EjiJZir91cBWEwh5wTl8tAftSIKTqupzcx07dO2tnRuq6u9n2LdVVd3QthTOA/Zu+wvUmlZHd6b5hbUceA/wqqpaOdnoNk7tSL5XVdVgBiHYItDt2UltJ+dmNC0Fk8AfWtEu9bo5cFxVrRrwaFptIFsEkjRwdhZL0sCZCCRp4EwEkjRwJgItCkluSXJhOzfRRUleMTU/zAaca1mS9y1ATGe000BMbS9NsnoBzvvf5qyS5stRQ1osflNVewAk2QH4NHAX4E3re6J22KVDLzUYtgi06FTVGprx9EeksWmSd7czll6c5IUASf4lyUFT30sza+xTkuyX5KS2bKskH0/y3fa7T2nLH5vk20lWJfnX9snezpLsluS8thVzcZJd2vJnTCv/cJJN2/LD0sxkeyaw94JUlNQyEWhRqqrLaf597wA8j+ap5IcBDwNekOQ+TJt5MslmNE8yr7uW9hvb7z6oqh4MfD3J9sAbgEdX1Z40rYdXrGeIhwP/1LZilgFXJnlgG8/ebfktwN8k2RF4M00CeAyw63peSxrJW0NazKaerHos8OC06xnQ3DLaBfgK8L4kdwIOAM6qqt+s80DWo2nmoQGgqq5Js77ErsA322M3o5mSYF2jJiP8NvD6JPcCTqiqHybZH3gocH573i2ANcCfAWdU1VpoWjLA/TvXgjQHE4EWpSR/TPMX9RqahPA/q+qUGY47A/grmr/Ej5/pVPzhL/QAp1XV0+cI4xfAttO2twOmpiv/dJJzaSaKOyXJ89vzHldVr10nxoNniEFaMN4a0qKTZAlwNM0CNgWcArwoyR3b/fdPsmV7+GeAw4B92+PWdSpwxLRzbwucA+yd5H5t2Z2TzPQX+hnAM3JbE+PZtOsqtInq8qp6H3AizeI8pwOHtJ3dJNkuyb1pJtzbL8nd2v+GQzegWqRZmQi0WGwxNXwU+BrNL/A3t/s+CnwPWNUO3/wwt7WGTwX+EvhaVd00w3n/N7BtmmUdLwIe2d6ieQ5wfJKLaRLDTAsPrQCuBy5qv7sVMDW53tOA1e1MoA8APlFV36Ppezi1Pe9pwI5VdTVwFM3tpK/hrLVaYM41JEkDZ4tAkgbORCBJA2cikKSBMxFI0sCZCCRp4EwEkjRwJgJJGjgTgSQN3P8H3zNDvAHcPY8AAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7fd16c0b35f8>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.bar(device_list, inference_time)\n",
    "plt.xlabel(\"Device Used\")\n",
    "plt.ylabel(\"Total Inference Time in Seconds\")\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYIAAAEKCAYAAAAfGVI8AAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4wLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvpW3flQAAFJBJREFUeJzt3Xu0JWV95vHvQwPhpuHWOESUg4oXiICkJTowCXJxUDRgICoxE0KMxImKEZ0JjhpxqUm74lLDSlymvYwkQTCiBgJGQKQhCAGbewNqG0BFGWkMIEQjAr/5o+qEk/b06epL1e4+9f2stdfZ9e6qXb9+V59++q3LW6kqJEnjtdmkC5AkTZZBIEkjZxBI0sgZBJI0cgaBJI2cQSBJI2cQSNLIGQSSNHIGgSSN3OaTLqCLnXfeuaampiZdhiRtUq655pp7qmrhmtbbJIJgamqKZcuWTboMSdqkJPlWl/U8NCRJI2cQSNLIGQSSNHIGgSSNnEEgSSNnEEjSyBkEkjRyBoEkjZxBIEkjt0ncWazJmTrl/EmXMFF3LD5y0iVIvXNEIEkjZxBI0sgZBJI0cgaBJI2cQSBJI2cQSNLIGQSSNHIGgSSNnEEgSSNnEEjSyBkEkjRyBoEkjZxBIEkjZxBI0sgZBJI0cgaBJI2cQSBJI2cQSNLI9R4ESRYkuS7Jee3yHkmuSrIiyaeTbNl3DZKk1RtiRPBG4NYZy+8DPlhVewL3Aq8eoAZJ0mr0GgRJdgOOBD7WLgc4BDi7XeV04Og+a5Akza3vEcGHgP8NPNou7wTcV1UPt8t3Ak+cbcMkJyZZlmTZypUrey5TksartyBI8hLg7qq6ZmbzLKvWbNtX1ZKqWlRVixYuXNhLjZIk2LzH7z4Q+LUkLwa2Ah5PM0LYPsnm7ahgN+B7PdYgSVqD3kYEVfXWqtqtqqaAVwJfrqpXAZcAx7arHQ+c01cNkqQ1m8R9BH8EnJzkmzTnDD4+gRokSa0+Dw39h6paCixt398GHDDEfiVJa+adxZI0cgaBJI2cQSBJI2cQSNLIGQSSNHKDXDU0SVOnnD/pEibqjsVHTroESRs5RwSSNHIGgSSNnEEgSSNnEEjSyBkEkjRyBoEkjZxBIEkjZxBI0sgZBJI0cgaBJI2cQSBJI2cQSNLIGQSSNHIGgSSNnEEgSSNnEEjSyBkEkjRyBoEkjdxqH1WZ5OS5NqyqD2z4ciRJQ5vrmcWPa38+A3gucG67/FLgsj6LkiQNZ7VBUFXvAkhyIbB/VT3QLp8KfGaQ6iRJvetyjuDJwEMzlh8CpnqpRpI0uLkODU37G+DqJJ8HCngZ8Ne9ViVJGswag6Cq3pvki8BBbdMJVXVdv2VJ88PUKedPuoSJumPxkZMuQR10GREAXA/cNb1+kidX1bd7q0qSNJg1BkGSNwDvBL4PPAKE5hDRPv2WJkkaQpcRwRuBZ1TVD/ouRpI0vC5XDX0HuL/vQiRJk9FlRHAbsDTJ+cBPphu9s1iS5ocuQfDt9rVl+5IkzSNdLh+dvsP4cc1iPdh7VZKkwazxHEGSX0xyHbAcuDnJNUn27rDdVkmuTnJDkpuTTAfKHkmuSrIiyaeTOMqQpAnqcrJ4CXByVe1eVbsDbwY+2mG7nwCHVNW+wH7AEUmeB7wP+GBV7QncC7x63UqXJG0IXYJg26q6ZHqhqpYC265po2pMH0baon0VcAhwdtt+OnD02hQsSdqwugTBbUnekWSqfb0duL3LlydZkOR64G7gIuBfgPuq6uF2lTuBJ65m2xOTLEuybOXKlV12J0laB12C4HeBhcDn2tfOwAldvryqHqmq/YDdgAOAZ8222mq2XVJVi6pq0cKFC7vsTpK0DrpcNXQvcNL67KSq7kuyFHgesH2SzdtRwW7A99bnuyVJ66fLVUMXJdl+xvIOSS7osN3C6e2SbA0cBtwKXAIc2652PHDOuhQuSdowutxQtnNV3Te9UFX3Jtmlw3a7AqcnWUATOH9XVecluQU4K8l7gOuAj69L4ZKkDaNLEDw6c9rpJLuzmuP6M1XVjcBzZmm/jeZ8gSRpI9AlCN4GXJ7k0nb5V4AT+ytJkjSkLieLv5hkf5oTvQHeVFX39F6ZJGkQXU4WBzgC2L+q/gHYJomHdiRpnuhyH8GHgecDx7XLDwB/2VtFkqRBdTlH8MtVtX878dz0VUNOFCdJ80SXEcFP20tAC5r7A4BHe61KkjSYLkFwGvB5YJck7wUuB/6k16okSYPpctXQGUmuAQ5tm46uqlv7LUuSNJTVjgiSbJNkC4Cq+hrwJZpHVc42cZwkaRM116GhLwJTAEmeBlwJPAV4XZI/7b80SdIQ5gqCHapqRfv+eODMqnoD8CLgJb1XJkkaxFxBMHM+oUNoHixDVT2EVw1J0rwx18niG5O8H/gu8DTgQoCZU1JLkjZ9c40IXgPcQ3Oe4IVV9aO2fS/g/T3XJUkayGpHBFX1Y2DxLO1XAFf0WZQkaThdbiiTJM1jBoEkjdycQZBkQZI/G6oYSdLw5gyCqnoE+KX2mQSSpHmoyzTU1wHnJPkM8G/TjVX1ud6qkiQNpksQ7Aj8gOamsmkFGASSNA90mX30hCEKkSRNRpdnFj89ycVJlrfL+yR5e/+lSZKG0OXy0Y8CbwV+ClBVNwKv7LMoSdJwugTBNlV19SptD/dRjCRpeF2C4J4kT+WxZxYfC9zVa1WSpMF0uWrodcAS4JlJvgvcDryq16okSYPpctXQbcBhSbYFNquqB/ovS5I0lC5XDe2U5DTgn4ClSf48yU79lyZJGkKXcwRnASuBY4Bj2/ef7rMoSdJwOt1ZXFXvnrH8niRH91WQJGlYXUYElyR5ZZLN2tfLgfP7LkySNIwuQfD7wKeAn7Svs4CTkzyQ5Id9FidJ6l+Xq4YeN0QhkqTJ8AllkjRyBoEkjZxBIEkj1+WGsqcm+bn2/cFJTkqyfYftnpTkkiS3Jrk5yRvb9h2TXJRkRftzh/X/Y0iS1lWXEcFngUeSPA34OLAHzVVEa/Iw8OaqehbwPOB1SfYCTgEurqo9gYvbZUnShHQJgker6mHgZcCHqupNwK5r2qiq7qqqa9v3DwC3Ak8EjgJOb1c7HfDmNEmaoC5B8NMkxwHHA+e1bVuszU6STAHPAa4CnlBVd0ETFsAuq9nmxCTLkixbuXLl2uxOkrQWugTBCcDzgfdW1e1J9gD+tusOkmxHc3jpD6uq8w1oVbWkqhZV1aKFCxd23UyStJbWGARVdQvwR8D0YZ7bq2pxly9PsgVNCJxRVZ9rm7+fZNf2812Bu9elcEnShtHlqqGXAtcDX2yX90tyboftQnNy+daq+sCMj86lOcxE+/OctS1akrThdDk0dCpwAHAfQFVdT3Pl0JocCPwP4JAk17evFwOLgcOTrAAOb5clSRPSZRrqh6vq/uY/+P+h1rRRVV0OZDUfH9phv5KkAXQJguVJfhNYkGRP4CTgin7LkiQNpcuhoTcAe9NMQX0m8EPgD/ssSpI0nC7TUP8IeFv7kiTNM2sMgiSLgP8DTM1cv6r26a8sSdJQupwjOAP4X8BNwKP9liNJGlqXIFhZVWu8b0CStGnqEgTvTPIxmplCfzLdOONOYUnSJqxLEJwAPJNmornpQ0MFGASSNA90CYJ9q+rZvVciSZqILvcR/HP7QBlJ0jzUZURwEHB8kttpzhEEKC8flaT5oUsQHNF7FZKkielyZ/G3AJLsAmzVe0WSpEF1eR7Br7VTRt8OXArcAfxjz3VJkgbS5WTxu4HnAd+oqj1oppD+Sq9VSZIG0+nh9VX1A2CzJJtV1SXAfj3XJUkaSJeTxfe1D6C/DDgjyd3Aw/2WJUkaSpcRwVHAj4A30Ty3+F+Al/ZZlCRpOHOOCJIsAM6pqsNoppc4fZCqJEmDmXNEUFWPAD9K8vMD1SNJGliXcwT/DtyU5CLg36Ybq+qk3qqSJA2mSxCc374kSfPQaoMgyZOr6ttV5XkBSZrH5jpH8PfTb5J8doBaJEkTMFcQZMb7p/RdiCRpMuYKglrNe0nSPDLXyeJ9k/yQZmSwdfseHnseweN7r06S1LvVBkFVLRiyEEnSZHSZYkKSNI8ZBJI0cgaBJI2cQSBJI2cQSNLIGQSSNHIGgSSNnEEgSSNnEEjSyPUWBEk+keTuJMtntO2Y5KIkK9qfO/S1f0lSN32OCD4JHLFK2ynAxVW1J3BxuyxJmqDegqCqLgP+dZXmo4DpB92cDhzd1/4lSd0MfY7gCVV1F0D7c5eB9y9JWsVGe7I4yYlJliVZtnLlykmXI0nz1tBB8P0kuwK0P+9e3YpVtaSqFlXVooULFw5WoCSNzdBBcC5wfPv+eOCcgfcvSVpFn5ePnglcCTwjyZ1JXg0sBg5PsgI4vF2WJE3QXI+qXC9VddxqPjq0r31KktbeRnuyWJI0DINAkkbOIJCkkTMIJGnkDAJJGjmDQJJGziCQpJEzCCRp5AwCSRo5g0CSRq63KSYkaX1NnXL+pEuYqDsWHznIfhwRSNLIGQSSNHIGgSSNnEEgSSNnEEjSyBkEkjRyBoEkjZxBIEkjZxBI0sgZBJI0cgaBJI2cQSBJI2cQSNLIGQSSNHIGgSSNnEEgSSNnEEjSyBkEkjRyBoEkjZxBIEkjZxBI0sgZBJI0cgaBJI2cQSBJI2cQSNLIGQSSNHITCYIkRyT5epJvJjllEjVIkhqDB0GSBcBfAi8C9gKOS7LX0HVIkhqTGBEcAHyzqm6rqoeAs4CjJlCHJInJBMETge/MWL6zbZMkTcDmE9hnZmmrn1kpORE4sV18MMnXe62qPzsD90xq53nfpPa8wdh/68f+Wz+bev/t3mWlSQTBncCTZizvBnxv1ZWqagmwZKii+pJkWVUtmnQdmyr7b/3Yf+tnLP03iUNDXwX2TLJHki2BVwLnTqAOSRITGBFU1cNJXg9cACwAPlFVNw9dhySpMYlDQ1TVF4AvTGLfE7DJH96aMPtv/dh/62cU/ZeqnzlPK0kaEaeYkKSRMwg0EUlOSnJrkjMmXYs0dh4a0kQk+Rrwoqq6fdK1SGPniGADSPLbSW5MckOSv0nyySQfSfJPSb6R5CXter+T5C9mbHdekoMnVviEJPkI8BTg3CT3t3325SQrkrymXWezJB9OcnPbT19Icmz72R8n+WqS5UmWJJntJsVRSPKOJF9LclGSM5O8JcnSJB9KckXbRwe0656a5C0ztl2eZGpStU9akvcl+YMZy6cmeXOSy5J8Pskt7e/xZu3nD85Y99gkn5xA2b0wCNZTkr2BtwGHVNW+wBvbj6aAXwWOBD6SZKvJVLjxqarX0txE+ALgg8A+NP30fOCPk/wC8Os0ffhs4Pfaz6b9RVU9t6p+EdgaeMlw1W88kiwCjgGeQ9NfM2982raq/ivwB8AnJlDepuAs4BUzll8OrKSZD+3NNH/3nkrTt/OaQbD+DgHOrqp7AKrqX9v2v6uqR6tqBXAb8MxJFbgJOKeqftz24SU0v4gHAZ9p+/D/te3TXpDkqiQ30fT/3sOXvFE4iMf67gHgH2Z8diZAVV0GPD7J9pMocGNWVdcBuyT5hST7AvcC3waubifFfISmHw+aZJ1DmMh9BPNMmGWupFnaCniY/xy+jhIas/XVrId72pHVh4FFVfWdJKcy3n6c65CYf/+6ORs4FvgvNCMEmL3vVm2fV33niGD9XQy8PMlOAEl2bNt/oz3O/VSa4+FfB+4A9mvbn0TzP1/BUUm2avvwYJppSC4Hjmn76gltOzz2C3hPku1ofonH6nLgpW3fbUdzeG3aKwCSHATcX1X30/z9279t3x/YY9hyN0pn0UxzcyxNKAAc0E6BsxlNP17etn8/ybPa9pcNX2p/HBGsp6q6Ocl7gUuTPAJc1370deBS4AnAa6vq35N8BbgduAlYDlw7iZo3QlcD5wNPBt5dVd9L8lngUJp++gZwFc0/aPcl+ShNH95BExqjVFVfTXIucAPwLWAZcH/78b1JrgAeD/xu2/ZZ4LeTXE/Tb98YuOSNTvv7+zjgu1V1V5JnAFcCi2nOEVwGfL5d/RTgPJpp9JcD202g5F54+WgP2qsJzquqs9e07ti1h3YerKr3z/LZdlX1YDtSuBo4sD1foNaMPtqG5h+tE4EPAG+pqmWTrW7T017F95aqGtUFCI4ItDE7rz3JuSXNSMEQ+FlL2ke9bgWcXlXXjvhqWq0jRwSSNHKeLJakkTMIJGnkDAJJGjmDQPNCkkeSXN/OTXRDkpOn54hZh+9alOS0DVDT0nYaiOnlqSTLN8D3/qc5q6T15VVDmi9+XFX7ASTZBfgU8PPAO9f2i9rLLr30UqPhiEDzTlXdTXM9/evTWJDkz9oZS29M8vsAST6d5MXT26WZNfaYJAcnOa9t2y7J/01yU7vtMW37C5NcmeTaJJ9p7+ztLMneSa5uRzE3Jtmzbf+tGe1/lWRB235CmplsLwUO3CAdJbUMAs1LVXUbzd/vXYBX09yV/FzgucBrkuzBjNknk2xJcyfzqs/Sfke77bOrah/gy0l2Bt4OHFZV+9OMHk5eyxJfC/x5O4pZBNyZ5FltPQe27Y8Ar0qyK/AumgA4HNhrLfclzclDQ5rPpu+seiGwT9rnGdAcMtoT+EfgtCQ/BxwBXFZVP17lhqzDaOaiAaCq7k3zfIm9gK+0625JMy3BquaajPBK4G1JdgM+V1UrkhwK/BLw1fZ7twbuBn4ZWFpVK6EZyQBP79wL0hoYBJqXkjyF5n/Ud9MEwhuq6oJZ1lsK/Hea/4mfOdtX8bP/oAe4qKqOW0MZPwB2mLG8IzA9XfmnklxFM1HcBUl+r/3e06vqravUePQsNUgbjIeGNO8kWQh8hOYBNgVcAPzPJFu0nz89ybbt6mcBJwD/rV1vVRcCr5/x3TsA/wwcmORpbds2SWb7H/pS4Lfy2BDjeNrnKrRBdVtVnQacS/NwnouBY9uT3STZMcnuNBPuHZxkp/bP8Bvr0C3SahkEmi+2nr58FPgSzT/g72o/+xhwC3Bte/nmX/HYaPhC4FeAL1XVQ7N873uAHdI81vEG4AXtIZrfAc5MciNNMMz24KElwAPADe222wHTk+u9AljezgT6TOCvq+oWmnMPF7bfexGwa1XdBZxKczjpSzhrrTYw5xqSpJFzRCBJI2cQSNLIGQSSNHIGgSSNnEEgSSNnEEjSyBkEkjRyBoEkjdz/BylWKyVefEfsAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7fd14ae71550>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.bar(device_list, fps)\n",
    "plt.xlabel(\"Device Used\")\n",
    "plt.ylabel(\"Frames per Second\")\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYIAAAEKCAYAAAAfGVI8AAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4wLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvpW3flQAAGExJREFUeJzt3XuUZWV55/HvDxBBELWlQRSbBsULCio2qAMTBdTRgMIooo4oItoxiYIDToJRE5zoDBoTExONdtTQ3kBEEEQQEWkIXoBuro2omAYUYQQUuSQqgs/8sXdJ2dZld1Wdc+ja389atc7Z79mXp/aqqqfey37fVBWSpP7aYNQBSJJGy0QgST1nIpCknjMRSFLPmQgkqedMBJLUcyYCSeo5E4Ek9ZyJQJJ6bqNRB9DFlltuWYsXLx51GJK0Xlm1atWtVbVwuv3Wi0SwePFiVq5cOeowJGm9kuT6LvvZNCRJPWcikKSeMxFIUs+ZCCSp50wEktRzJgJJ6jkTgST1nIlAknrORCBJPbdePFksra8WH/3lUYcwUtcdu++oQ1AH1ggkqedMBJLUcyYCSeo5E4Ek9ZyJQJJ6zkQgST1nIpCknjMRSFLPmQgkqedMBJLUcyYCSeo5E4Ek9ZyJQJJ6zkQgST1nIpCknjMRSFLPmQgkqecGukJZkuuAO4F7gXuqakmSBcDngMXAdcBBVXXbIOOQJE1uGDWCvarqqVW1pN0+GjinqnYEzmm3JUkjMm0iSLJZkg3a949L8uIkD5jFNfcHlrfvlwMHzOJckqRZ6lIjOB/YJMmjaP6DPxQ4ruP5C/hqklVJlrZlW1fVTQDt61brFrIkaS516SNIVf1nksOAf6yq9yW5tOP596iqG5NsBZyd5LtdA2sTx1KARYsWdT1MkrSOutQIkuRZwKuAL7dlnTqZq+rG9vVm4BRgd+AnSbZpT7wNcPMkxy6rqiVVtWThwoVdLidJmoEuieAtwNuAU6rqqiQ7AOdOd1Dbt/DgsffA84HVwGnAIe1uhwCnziRwSdLcmPY/+6o6Dzhv3PYa4PAO594aOCXJ2HU+W1VfSXIxcGLb1PRD4GUzCVySNDcmTQRJvkTT2TuhqnrxVCduE8ZTJij/KbDPOsQoSRqgqWoE729fXwI8Avh0u/1KmgfBJEnzwKSJoG0SIslfV9UfjPvoS0nOH3hkkqSh6NJZvLDtIAYgyfaAw3gkaZ7oMgz0fwIrkqxptxcDfzSwiCRJQ9Vl1NBXkuwIPKEt+m5V/WqwYUmShqXr7KNPp6kJbAQ8JQlV9cmBRSVJGpppE0GSTwGPAS6jmU4ammGlJgJJmge61AiWADtV1aTPFEiS1l9dRg2tpnmOQJI0D3WpEWwJfCfJRcBvO4mne7JYkrR+6JIIjhl0EJKk0ek06VySrYHd2qKL2mmlJUnzQJelKg8CLqKZJfQg4MIkBw46MEnScHRpGno7sNtYLSDJQuBrwEmDDEySNBxdRg1tsFZT0E87HidJWg90qRF8JclZwPHt9suBMwcXkiRpmLp0Fv+vJC8B9gQCLKuqUwYemSRpKLpMMbE9cEZVndxub5pkcVVdN+jgJEmD16Wt//PAb8Zt39uWSZLmgS6JYKOquntso32/8eBCkiQNU5dEcEuS304nkWR/4NbBhSRJGqYuo4beCHwmyYdopp++AXjNQKOSJA1Nl1FD/w48M8nmQKrqzsGHJUkali5TTGyd5OPA56vqziQ7JTlsCLFJkoagSx/BccBZwCPb7e8DbxlUQJKk4eqSCLasqhNph5BW1T3ct2SlJGk91yUR/EeSh9N0FJPkmcDtA41KkjQ0XUYNHQmcBjwmyTeAhYDTUEvSPNFl1NAlSZ4NPJ5mrqHvVdWvu14gyYbASuDHVbVfO2XFCcAC4BLg1eMfWJMkDdekTUNJdkvyCPhtv8DTgfcAf5tkwTpc4wjg6nHb7wU+UFU7ArcBjkCSpBGaqo/go8DdAEn+ADgW+CRN/8CyLidPsi2wL/CxdjvA3ty3qM1y4ICZBC5JmhtTNQ1tWFU/a9+/nGb66S8AX0hyWcfz/z3wZ8CD2+2HAz9vaxjQPKX8qHWMWZI0h6aqEWyYZCxR7AN8fdxnXaav3g+4uapWjS+eYNea5PilSVYmWXnLLbdMdzlJ0gxN9Qf9eOC8JLcCvwD+DSDJY+k2fHQP4MVJ/hDYBNiCpobw0CQbtbWCbYEbJzq4qpbRNkEtWbJkwmQhSZq9SWsEVfUe4CiaJ4v3rKoad8ybpztxVb2tqratqsXAK4CvV9WrgHO5b/jpIcCpM45ekjRrUzbxVNW3Jyj7/iyv+efACUneDVwKfHyW55MkzUKXB8pmrapWACva92uA3YdxXUnS9LpMMSFJmsdMBJLUc13WI3hJkmuS3J7kjiR3JrljGMFJkgavSx/B+4AXVdXV0+4pSVrvdGka+olJQJLmry41gpVJPgd8EfjVWGFVnTywqCRJQ9MlEWwB/Cfw/HFlBZgIJGke6LIewaHDCESSNBqTJoIkf1ZV70vyj0wwMVxVHT7QyCRJQzFVjWCsg3jlMAKRJI3GpImgqr7Uvi4fXjiSpGHzyWJJ6jkTgST1nIlAknquy1xDj0tyTpLV7fYuSd4x+NAkScPQpUbwL8DbgF8DVNUVNCuOSZLmgS6J4EFVddFaZfcMIhhJ0vB1SQS3JnkM7UNlSQ4EbhpoVJKkoeky19CfAsuAJyT5MXAtcPBAo5IkDU2XuYbWAM9NshmwQVXdOfiwJEnDMm0iSPJQ4DXAYmCjJIBzDUnSfNGlaegM4NvAlcBvBhuOJGnYuiSCTarqyIFHIkkaiS6jhj6V5A1JtkmyYOxr4JFJkoaiS43gbuBvgLdz37oEBewwqKAkScPTJREcCTy2qm4ddDCSpOHr0jR0Fc2axZKkeahLjeBe4LIk5wK/Git0+KgkzQ9dEsEX2691kmQT4Hzgge11Tqqqv0qyPXACsAC4BHh1Vd29rueXJM2NLk8Wz3Spyl8Be1fVXUkeAFyQ5EyaPocPVNUJST4CHAb88wyvIUmapUn7CJKc2L5emeSKtb+mO3E17mo3H9B+FbA3cFJbvhw4YFbfgSRpVqaqERzRvu4305Mn2RBYBTwW+BDw78DPq2psGusbgEfN9PySpNmbKhEsB55fVdfP9ORVdS/w1Ha+olOAJ06020THJlkKLAVYtGjRTEOQJE1jquGjC+fqIlX1c2AF8EzgoUnGEtC2wI2THLOsqpZU1ZKFC+csFEnSWqaqETwkyUsm+7CqTp7qxEkWAr+uqp8n2RR4LvBe4FzgQJqRQ4cAp65z1JKkOTNlIqDpH8gEnxUwZSIAtgGWt/0EGwAnVtXpSb4DnJDk3cClwMfXPWwNy+KjvzzqEEbqumP3HXUI0sBNlQiur6rXzfTE7SL3T5ugfA2w+0zPK0maW1P1EUxUE5AkzTNTJYJXDy0KSdLITJoIqmr1MAORJI1Gl9lHJUnzmIlAknpu2knnklzJ7z/9ezuwEnh3Vf10EIFJkoajyzTUZ9KsSfDZdvsV7esdwHHAi+Y+LEnSsHRJBHtU1R7jtq9M8o2q2iPJwYMKTJI0HF36CDZP8oyxjSS7A5u3m/dMfIgkaX3RpUbweuATSTanecjsDuD1STYD/u8gg5MkDV6XFcouBnZO8hAg7UyiY04cWGSSpKHoMmrogcBLgcXARkkz80RV/e+BRiZJGoouTUOn0gwXXUWzDrEkaR7pkgi2raoXDDwSSdJIdBk19M0kOw88EknSSHSpEewJvDbJtTRNQwGqqnYZaGSSpKHokgheOPAoJEkjM2kiSLJFVd0B3DnEeCRJQzZVjeCzNGsWr6KZdG78imUF7DDAuCRJQzJpIqiq/drX7YcXjiRp2KZqGtp1qgOr6pK5D0eSNGxTNQ39bfu6CbAEuJymeWgX4EKa0USSpPXcVGsW71VVewHXA7tW1ZKqejrwNOAHwwpQkjRYXR4oe0JVXTm20S5q/9TBhSRJGqYuzxFcneRjwKdpRgsdDFw90KgkSUPTJREcCvwxcES7fT7wzwOLSJI0VF3WI/gl8IH2S5I0z3RZj2BHmpXIdqIZQQRAVflAmSTNA106i/+VpinoHmAv4JPAp6Y7KMmjk5yb5OokVyU5oi1fkOTsJNe0rw+bzTcgSZqdLolg06o6h2aZyuur6hhg7w7H3QMcVVVPBJ4J/GmSnYCjgXOqakfgnHZbkjQiXTqLf5lkA+CaJG8CfgxsNd1BVXUTcFP7/s4kVwOPAvYHntPuthxYAfz5OkcuSZoTXWoEbwEeBBwOPB14NXDIulwkyWKaB9EuBLZuk8RYspg2qUiSBqfLqKGLAdKsWv/mqrprXS6QZHPgC8BbquqO5jSdjlsKLAVYtGjRulxSkrQOpq0RJNk5yaXAauCqJKuSPLnLyZM8gCYJfKaqTm6Lf5Jkm/bzbYCbJzq2qpa101osWbhwYZfLSZJmoEvT0EeBI6tqu6raDjgKWDbdQW0N4uPA1VX1d+M+Oo37mpYOAU5dt5AlSXOpS2fxZlV17thGVa1IslmH4/ag6U+4MsllbdlfAMcCJyY5DPgh8LJ1jFmSNIe6JII1Sd7Jfc8OHAxcO91BVXUBv7uq2Xj7dAtPkjRoXZqGXgcsBE5uv7YEXjvAmCRJQ9Rl1NBtNENHfyvJ+4G3DiooSdLwdKkRTOSgOY1CkjQyM00E3R4GkCTd7021eP2CyT7CRCBJ88ZUfQSraFYkm+iP/t2DCUeSNGyTJoKq2n6YgUiSRmOmfQSSpHnCRCBJPWcikKSem8moIQCq6mdzH44kadhmOmqoABevl6R5wFFDktRzXRamSZKD2xlISbIoye6DD02SNAxdOos/DDwL+B/t9p3AhwYWkSRpqLqsR/CMqtq1Xa6SqrotycYDjkuSNCRdagS/TrIhTQcxSRYCvxloVJKkoemSCD4InAJsleQ9wAXA/xloVJKkoemyMM1nkqyiWV4ywAFVdfXAI5MkDUXXB8puBo4f/5kPlEnS/ND1gbJFwG3t+4cCPwR8zkCS5oFJ+wiqavuq2gE4C3hRVW1ZVQ8H9qNZxF6SNA906SzerarOGNuoqjOBZw8uJEnSMHV5juDWJO8APk3TVHQw8NOBRiVJGpouNYJXAgtphpB+EdiqLZMkzQNdho/+DDgiyRbAb6rqrsGHJUkali6Tzu3cTi9xJXBVklVJnjz40CRJw9ClaeijwJFVtV1VbQccBSwbbFiSpGHpkgg2q6pzxzaqagWw2XQHJflEkpuTrB5XtiDJ2UmuaV8fNqOoJUlzpksiWJPknUkWt1/vAK7tcNxxwAvWKjsaOKeqdgTOabclSSPUJRG8jmbU0Mk0I4cWAodOd1BVnQ+sPQ3F/sDy9v1y4IDOkUqSBqLLqKHbgMPn6HpbV9VN7XlvSrLVHJ1XkjRDU006d9pUB1bVi+c+nN+5/lJgKcCiRYsGeSlJ6rWpagTPAn5EM+vohTQTzs3WT5Js09YGtqGZ1XRCVbWMdnTSkiVLag6uLUmawFR9BI8A/gJ4MvAPwPOAW6vqvKo6b4bXOw04pH1/CHDqDM8jSZojU80+em9VfaWqDgGeCfwAWJHkzV1OnOR44FvA45PckOQw4FjgeUmuoUksx876O5AkzcqUncVJHgjsSzO30GKaZSs7TUFdVZPNR7TPOsQnSRqwqTqLl9M0C50JvKuqVk+2ryRp/TVVjeDVwH8AjwMOT37bVxygqmqLAccmSRqCSRNBVXV52EyStJ7zj70k9ZyJQJJ6zkQgST1nIpCknjMRSFLPmQgkqedMBJLUcyYCSeo5E4Ek9ZyJQJJ6zkQgST1nIpCknjMRSFLPmQgkqedMBJLUcyYCSeo5E4Ek9ZyJQJJ6bqo1iyVppBYf/eVRhzBS1x2771CuY41AknrORCBJPWcikKSeMxFIUs/N+85iO5uG09kkaf1ljUCSem4kiSDJC5J8L8kPkhw9ihgkSY2hJ4IkGwIfAl4I7AS8MslOw45DktQYRY1gd+AHVbWmqu4GTgD2H0EckiRGkwgeBfxo3PYNbZkkaQRGMWooE5TV7+2ULAWWtpt3JfneQKManC2BW0d18bx3VFeeM96/2fH+zc76fv+267LTKBLBDcCjx21vC9y49k5VtQxYNqygBiXJyqpaMuo41lfev9nx/s1OX+7fKJqGLgZ2TLJ9ko2BVwCnjSAOSRIjqBFU1T1J3gScBWwIfKKqrhp2HJKkxkieLK6qM4AzRnHtEVjvm7dGzPs3O96/2enF/UvV7/XTSpJ6xCkmJKnnTAQaiSSHJ7k6yWdGHYvUdzYNaSSSfBd4YVVdO+pYpL6zRjAHkrwmyRVJLk/yqSTHJflIkn9L8v0k+7X7vTbJP4077vQkzxlZ4COS5CPADsBpSW5v79nXk1yT5A3tPhsk+XCSq9r7dEaSA9vP/jLJxUlWJ1mWZKKHFHshyTuTfDfJ2UmOT/LWJCuS/H2Sb7b3aPd232OSvHXcsauTLB5V7KOW5L1J/mTc9jFJjkpyfpJTknyn/T3eoP38rnH7HpjkuBGEPRAmgllK8iTg7cDeVfUU4Ij2o8XAs4F9gY8k2WQ0Ed7/VNUbaR4i3Av4ALALzX16FvCXSR4JvITmHu4MvL79bMw/VdVuVfVkYFNgv+FFf/+RZAnwUuBpNPdr/INPm1XVfwH+BPjECMJbH5wAvHzc9kHALTTzoR1F87P3GJp7O6+ZCGZvb+CkqroVoKp+1pafWFW/qaprgDXAE0YV4Hrg1Kr6RXsPz6X5RdwT+Hx7D/9fWz5mryQXJrmS5v4/afgh3y/syX337k7gS+M+Ox6gqs4Htkjy0FEEeH9WVZcCWyV5ZJKnALcBPwQuaifFvJfmPu45yjiHYd6vUDYEYYK5kiYoK+Aefjf5WktoTHSvJmzuaWtWHwaWVNWPkhxDf+/jVE1i/vx1cxJwIPAImhoCTHzv1i6fV/fOGsHsnQMclOThAEkWtOUva9u5H0PTHv494DrgqW35o2n+8xXsn2ST9h4+h2YakguAl7b3auu2HO77Bbw1yeY0v8R9dQHwovbebU7TvDbm5QBJ9gRur6rbaX7+dm3LdwW2H26490sn0ExzcyBNUgDYvZ0CZwOa+3hBW/6TJE9sy//78EMdHGsEs1RVVyV5D3BeknuBS9uPvgecB2wNvLGqfpnkG8C1wJXAauCSUcR8P3QR8GVgEfDXVXVjki8A+9Dcp+8DF9L8Qft5kn+huYfX0SSNXqqqi5OcBlwOXA+sBG5vP74tyTeBLYDXtWVfAF6T5DKa+/b9IYd8v9P+/j4Y+HFV3ZTk8cC3gGNp+gjOB05pdz8aOJ1mGv3VwOYjCHkgHD46AO1ogtOr6qTp9u27tmnnrqp6/wSfbV5Vd7U1hYuAPdr+ArXG3aMH0fzRWgr8HfDWqlo52ujWP+0ovrdWVa8GIFgj0P3Z6W0n58Y0NQWTwO9b1i71ugmwvKou6fFoWs2QNQJJ6jk7iyWp50wEktRzJgJJ6jkTgeaFJPcmuaydm+jyJEeOzREzg3MtSfLBOYhpRTsNxNj24iSr5+C8vzNnlTRbjhrSfPGLqnoqQJKtgM8CDwH+al1P1A67dOilesMageadqrqZZjz9m9LYMMnftDOWXpHkjwCSfC7JH44dl2bW2JcmeU6S09uyzZP8a5Ir22Nf2pY/P8m3klyS5PPtk72dJXlSkovaWswVSXZsyw8eV/7RJBu25Yemmcn2PGCPOblRUstEoHmpqtbQ/HxvBRxG81TybsBuwBuSbM+42SeTbEzzJPPaa2m/sz1256raBfh6ki2BdwDPrapdaWoPR65jiG8E/qGtxSwBbkjyxDaePdrye4FXJdkGeBdNAngesNM6Xkuakk1Dms/Gnqx6PrBL2vUMaJqMdgTOBD6Y5IHAC4Dzq+oXaz2Q9VyauWgAqKrb0qwvsRPwjXbfjWmmJVjbVJMRfgt4e5JtgZOr6pok+wBPBy5uz7spcDPwDGBFVd0CTU0GeFznuyBNw0SgeSnJDjT/Ud9MkxDeXFVnTbDfCuC/0fwnfvxEp+L3/6AHOLuqXjlNGD8FHjZuewEwNl35Z5NcSDNR3FlJXt+ed3lVvW2tGA+YIAZpztg0pHknyULgIzQL2BRwFvDHSR7Qfv64JJu1u58AHAr813a/tX0VeNO4cz8M+DawR5LHtmUPSjLRf+grgINzXxXjENp1FdpEtaaqPgicRrM4zznAgW1nN0kWJNmOZsK95yR5ePs9vGwGt0WalIlA88WmY8NHga/R/AF/V/vZx4DvAJe0wzc/yn214a8CfwB8rarunuC87wYelmZZx8uBvdommtcCxye5giYxTLTw0DLgTuDy9tjNgbHJ9V4OrG5nAn0C8Mmq+g5N38NX2/OeDWxTVTcBx9A0J30NZ63VHHOuIUnqOWsEktRzJgJJ6jkTgST1nIlAknrORCBJPWcikKSeMxFIUs+ZCCSp5/4/WY6MtbHbg1cAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7fd14ad8ce80>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.bar(device_list, model_load_time)\n",
    "plt.xlabel(\"Device Used\")\n",
    "plt.ylabel(\"Model Loading Time in Seconds\")\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Step 3: Update Proposal Document\n",
    "\n",
    "Now that you've completed your hardware testing, you should go back to the proposal document and validate or update your originally proposed hardware. Once you've updated your proposal, you can move onto the next scenario."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}