example/notebooks/composite_symbol.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Composite symbols into component\n",
    "In this example we will show how to make an Inception network by forming single symbol into component.\n",
    "\n",
    "Inception is currently best model. Compared to other models, it has much less parameters, and with best performance. However, it is much more complex than sequence feedforward network.\n",
    "\n",
    "The Inception network in this example is refer to ```Ioffe, Sergey, and Christian Szegedy. \"Batch normalization: Accelerating deep network training by reducing internal covariate shift.\" arXiv preprint arXiv:1502.03167 (2015).```\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "import mxnet as mx"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "For complex network such as inception network, building from single symbol is painful, we can make simple ```ComponentFactory``` to simplfiy the procedure.\n",
    "\n",
    "Except difference in number of filter, we find 2 major differences in each Inception module, so we can build two factories plus one basic ```Convolution + BatchNorm + ReLU``` factory to simplfiy the problem.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# Basic Conv + BN + ReLU factory\n",
    "def ConvFactory(data, num_filter, kernel, stride=(1,1), pad=(0, 0), name=None, suffix=''):\n",
    "    conv = mx.symbol.Convolution(data=data, num_filter=num_filter, kernel=kernel, stride=stride, pad=pad, name='conv_%s%s' %(name, suffix))\n",
    "    bn = mx.symbol.BatchNorm(data=conv, name='bn_%s%s' %(name, suffix))\n",
    "    act = mx.symbol.Activation(data=bn, act_type='relu', name='relu_%s%s' %(name, suffix))\n",
    "    return act"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can visualize our basic component"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.36.0 (20140111.2315)\n",
       " -->\n",
       "<!-- Title: plot Pages: 1 -->\n",
       "<svg width=\"102pt\" height=\"348pt\"\n",
       " viewBox=\"0.00 0.00 102.00 348.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 344)\">\n",
       "<title>plot</title>\n",
       "<polygon fill=\"white\" stroke=\"none\" points=\"-4,4 -4,-344 98,-344 98,4 -4,4\"/>\n",
       "<!-- Previos Output -->\n",
       "<g id=\"node1\" class=\"node\"><title>Previos Output</title>\n",
       "<polygon fill=\"#8dd3c7\" stroke=\"black\" points=\"94,-58 -7.10543e-15,-58 -7.10543e-15,-3.55271e-15 94,-3.55271e-15 94,-58\"/>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-25.3\" font-family=\"Times,serif\" font-size=\"14.00\">Previos Output</text>\n",
       "</g>\n",
       "<!-- conv_None -->\n",
       "<g id=\"node2\" class=\"node\"><title>conv_None</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"94,-152 -7.10543e-15,-152 -7.10543e-15,-94 94,-94 94,-152\"/>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-126.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-111.8\" font-family=\"Times,serif\" font-size=\"14.00\">7x7/2, 64</text>\n",
       "</g>\n",
       "<!-- conv_None&#45;&gt;Previos Output -->\n",
       "<g id=\"edge1\" class=\"edge\"><title>conv_None&#45;&gt;Previos Output</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M47,-83.7443C47,-75.2043 47,-66.2977 47,-58.2479\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"47,-93.8971 42.5001,-83.897 47,-88.8971 47.0001,-83.8971 47.0001,-83.8971 47.0001,-83.8971 47,-88.8971 51.5001,-83.8971 47,-93.8971 47,-93.8971\"/>\n",
       "</g>\n",
       "<!-- bn_None -->\n",
       "<g id=\"node3\" class=\"node\"><title>bn_None</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"94,-246 -7.10543e-15,-246 -7.10543e-15,-188 94,-188 94,-246\"/>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-213.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_None&#45;&gt;conv_None -->\n",
       "<g id=\"edge2\" class=\"edge\"><title>bn_None&#45;&gt;conv_None</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M47,-177.744C47,-169.204 47,-160.298 47,-152.248\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"47,-187.897 42.5001,-177.897 47,-182.897 47.0001,-177.897 47.0001,-177.897 47.0001,-177.897 47,-182.897 51.5001,-177.897 47,-187.897 47,-187.897\"/>\n",
       "</g>\n",
       "<!-- relu_None -->\n",
       "<g id=\"node4\" class=\"node\"><title>relu_None</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"94,-340 -7.10543e-15,-340 -7.10543e-15,-282 94,-282 94,-340\"/>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-314.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-299.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_None&#45;&gt;bn_None -->\n",
       "<g id=\"edge3\" class=\"edge\"><title>relu_None&#45;&gt;bn_None</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M47,-271.744C47,-263.204 47,-254.298 47,-246.248\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"47,-281.897 42.5001,-271.897 47,-276.897 47.0001,-271.897 47.0001,-271.897 47.0001,-271.897 47,-276.897 51.5001,-271.897 47,-281.897 47,-281.897\"/>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f2bc2d10748>"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "prev = mx.symbol.Variable(name=\"Previos Output\")\n",
    "conv_comp = ConvFactory(data=prev, num_filter=64, kernel=(7,7), stride=(2, 2))\n",
    "mx.viz.plot_network(symbol=conv_comp)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The next step is making a component factory with all ```stride=(1, 1)```"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# param mapping to paper:\n",
    "# num_1x1      >>>  #1x1\n",
    "# num_3x3red   >>>  #3x3 reduce\n",
    "# num_3x3      >>>  #3x3\n",
    "# num_d3x3red  >>>  double #3x3 reduce\n",
    "# num_d3x3     >>>  double #3x3\n",
    "# pool         >>>  Pool\n",
    "# proj         >>>  proj\n",
    "def InceptionFactoryA(data, num_1x1, num_3x3red, num_3x3, num_d3x3red, num_d3x3, pool, proj, name):\n",
    "    # 1x1\n",
    "    c1x1 = ConvFactory(data=data, num_filter=num_1x1, kernel=(1, 1), name=('%s_1x1' % name))\n",
    "    # 3x3 reduce + 3x3\n",
    "    c3x3r = ConvFactory(data=data, num_filter=num_3x3red, kernel=(1, 1), name=('%s_3x3' % name), suffix='_reduce')\n",
    "    c3x3 = ConvFactory(data=c3x3r, num_filter=num_3x3, kernel=(3, 3), pad=(1, 1), name=('%s_3x3' % name))\n",
    "    # double 3x3 reduce + double 3x3\n",
    "    cd3x3r = ConvFactory(data=data, num_filter=num_d3x3red, kernel=(1, 1), name=('%s_double_3x3' % name), suffix='_reduce')\n",
    "    cd3x3 = ConvFactory(data=cd3x3r, num_filter=num_d3x3, kernel=(3, 3), pad=(1, 1), name=('%s_double_3x3_0' % name))\n",
    "    cd3x3 = ConvFactory(data=cd3x3, num_filter=num_d3x3, kernel=(3, 3), pad=(1, 1), name=('%s_double_3x3_1' % name))\n",
    "    # pool + proj\n",
    "    pooling = mx.symbol.Pooling(data=data, kernel=(3, 3), stride=(1, 1), pad=(1, 1), pool_type=pool, name=('%s_pool_%s_pool' % (pool, name)))\n",
    "    cproj = ConvFactory(data=pooling, num_filter=proj, kernel=(1, 1), name=('%s_proj' %  name))\n",
    "    # concat\n",
    "    concat = mx.symbol.Concat(*[c1x1, c3x3, cd3x3, cproj], name='ch_concat_%s_chconcat' % name)\n",
    "    return concat"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.36.0 (20140111.2315)\n",
       " -->\n",
       "<!-- Title: plot Pages: 1 -->\n",
       "<svg width=\"454pt\" height=\"1376pt\"\n",
       " viewBox=\"0.00 0.00 454.00 1376.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 1372)\">\n",
       "<title>plot</title>\n",
       "<polygon fill=\"white\" stroke=\"none\" points=\"-4,4 -4,-1372 450,-1372 450,4 -4,4\"/>\n",
       "<!-- Previos Output -->\n",
       "<g id=\"node1\" class=\"node\"><title>Previos Output</title>\n",
       "<polygon fill=\"#8dd3c7\" stroke=\"black\" points=\"236,-58 142,-58 142,-3.55271e-15 236,-3.55271e-15 236,-58\"/>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-25.3\" font-family=\"Times,serif\" font-size=\"14.00\">Previos Output</text>\n",
       "</g>\n",
       "<!-- conv_in3a_1x1 -->\n",
       "<g id=\"node2\" class=\"node\"><title>conv_in3a_1x1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"99,-878 5,-878 5,-820 99,-820 99,-878\"/>\n",
       "<text text-anchor=\"middle\" x=\"52\" y=\"-852.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"52\" y=\"-837.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 64</text>\n",
       "</g>\n",
       "<!-- conv_in3a_1x1&#45;&gt;Previos Output -->\n",
       "<g id=\"edge1\" class=\"edge\"><title>conv_in3a_1x1&#45;&gt;Previos Output</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M55.9633,-809.703C58.756,-779.421 62,-736.055 62,-698 62,-698 62,-698 62,-138 62,-94.5853 105.602,-64.9684 141.71,-47.8852\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"55.0003,-819.838 51.4664,-809.457 55.4733,-814.861 55.9462,-809.883 55.9462,-809.883 55.9462,-809.883 55.4733,-814.861 60.4261,-810.309 55.0003,-819.838 55.0003,-819.838\"/>\n",
       "<text text-anchor=\"middle\" x=\"86\" y=\"-431.3\" font-family=\"Times,serif\" font-size=\"14.00\">3x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3a_1x1 -->\n",
       "<g id=\"node3\" class=\"node\"><title>bn_in3a_1x1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"94,-1030 -7.10543e-15,-1030 -7.10543e-15,-972 94,-972 94,-1030\"/>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-997.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3a_1x1&#45;&gt;conv_in3a_1x1 -->\n",
       "<g id=\"edge2\" class=\"edge\"><title>bn_in3a_1x1&#45;&gt;conv_in3a_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M48.2831,-961.507C49.1516,-935.451 50.2793,-901.621 51.0638,-878.087\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"47.9405,-971.786 43.7762,-961.642 48.1071,-966.789 48.2737,-961.792 48.2737,-961.792 48.2737,-961.792 48.1071,-966.789 52.7712,-961.942 47.9405,-971.786 47.9405,-971.786\"/>\n",
       "<text text-anchor=\"middle\" x=\"78.5\" y=\"-921.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3a_1x1 -->\n",
       "<g id=\"node4\" class=\"node\"><title>relu_in3a_1x1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"116,-1182 22,-1182 22,-1124 116,-1124 116,-1182\"/>\n",
       "<text text-anchor=\"middle\" x=\"69\" y=\"-1156.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"69\" y=\"-1141.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3a_1x1&#45;&gt;bn_in3a_1x1 -->\n",
       "<g id=\"edge3\" class=\"edge\"><title>relu_in3a_1x1&#45;&gt;bn_in3a_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M57.6921,-1114.13C57.0611,-1111.39 56.4871,-1108.66 56,-1106 51.3706,-1080.69 49.1078,-1051.46 48.0106,-1030.44\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"60.1724,-1123.98 53.3655,-1115.38 58.9508,-1119.13 57.7292,-1114.28 57.7292,-1114.28 57.7292,-1114.28 58.9508,-1119.13 62.0928,-1113.18 60.1724,-1123.98 60.1724,-1123.98\"/>\n",
       "<text text-anchor=\"middle\" x=\"83.5\" y=\"-1073.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3a_3x3_reduce -->\n",
       "<g id=\"node5\" class=\"node\"><title>conv_in3a_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"214,-464 120,-464 120,-406 214,-406 214,-464\"/>\n",
       "<text text-anchor=\"middle\" x=\"167\" y=\"-438.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"167\" y=\"-423.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 64</text>\n",
       "</g>\n",
       "<!-- conv_in3a_3x3_reduce&#45;&gt;Previos Output -->\n",
       "<g id=\"edge4\" class=\"edge\"><title>conv_in3a_3x3_reduce&#45;&gt;Previos Output</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M167,-395.747C167,-370.079 167,-335.51 167,-305 167,-305 167,-305 167,-138 167,-110.446 173.961,-79.7179 180.052,-58.1054\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"167,-405.816 162.5,-395.815 167,-400.816 167,-395.816 167,-395.816 167,-395.816 167,-400.816 171.5,-395.816 167,-405.816 167,-405.816\"/>\n",
       "<text text-anchor=\"middle\" x=\"191\" y=\"-245.3\" font-family=\"Times,serif\" font-size=\"14.00\">3x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3a_3x3_reduce -->\n",
       "<g id=\"node6\" class=\"node\"><title>bn_in3a_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"214,-650 120,-650 120,-592 214,-592 214,-650\"/>\n",
       "<text text-anchor=\"middle\" x=\"167\" y=\"-617.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3a_3x3_reduce&#45;&gt;conv_in3a_3x3_reduce -->\n",
       "<g id=\"edge5\" class=\"edge\"><title>bn_in3a_3x3_reduce&#45;&gt;conv_in3a_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M167,-581.315C167,-546.245 167,-495.392 167,-464.077\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"167,-591.653 162.5,-581.653 167,-586.653 167,-581.653 167,-581.653 167,-581.653 167,-586.653 171.5,-581.653 167,-591.653 167,-591.653\"/>\n",
       "<text text-anchor=\"middle\" x=\"194.5\" y=\"-562.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3a_3x3_reduce -->\n",
       "<g id=\"node7\" class=\"node\"><title>relu_in3a_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"214,-802 120,-802 120,-744 214,-744 214,-802\"/>\n",
       "<text text-anchor=\"middle\" x=\"167\" y=\"-776.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"167\" y=\"-761.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3a_3x3_reduce&#45;&gt;bn_in3a_3x3_reduce -->\n",
       "<g id=\"edge6\" class=\"edge\"><title>relu_in3a_3x3_reduce&#45;&gt;bn_in3a_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M167,-733.507C167,-707.451 167,-673.621 167,-650.087\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"167,-743.786 162.5,-733.786 167,-738.786 167,-733.786 167,-733.786 167,-733.786 167,-738.786 171.5,-733.786 167,-743.786 167,-743.786\"/>\n",
       "<text text-anchor=\"middle\" x=\"194.5\" y=\"-693.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3a_3x3 -->\n",
       "<g id=\"node8\" class=\"node\"><title>conv_in3a_3x3</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"214,-954 120,-954 120,-896 214,-896 214,-954\"/>\n",
       "<text text-anchor=\"middle\" x=\"167\" y=\"-928.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"167\" y=\"-913.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 64</text>\n",
       "</g>\n",
       "<!-- conv_in3a_3x3&#45;&gt;relu_in3a_3x3_reduce -->\n",
       "<g id=\"edge7\" class=\"edge\"><title>conv_in3a_3x3&#45;&gt;relu_in3a_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M167,-885.507C167,-859.451 167,-825.621 167,-802.087\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"167,-895.786 162.5,-885.786 167,-890.786 167,-885.786 167,-885.786 167,-885.786 167,-890.786 171.5,-885.786 167,-895.786 167,-895.786\"/>\n",
       "<text text-anchor=\"middle\" x=\"194.5\" y=\"-845.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3a_3x3 -->\n",
       "<g id=\"node9\" class=\"node\"><title>bn_in3a_3x3</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"214,-1106 120,-1106 120,-1048 214,-1048 214,-1106\"/>\n",
       "<text text-anchor=\"middle\" x=\"167\" y=\"-1073.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3a_3x3&#45;&gt;conv_in3a_3x3 -->\n",
       "<g id=\"edge8\" class=\"edge\"><title>bn_in3a_3x3&#45;&gt;conv_in3a_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M167,-1037.51C167,-1011.45 167,-977.621 167,-954.087\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"167,-1047.79 162.5,-1037.79 167,-1042.79 167,-1037.79 167,-1037.79 167,-1037.79 167,-1042.79 171.5,-1037.79 167,-1047.79 167,-1047.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"194.5\" y=\"-997.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3a_3x3 -->\n",
       "<g id=\"node10\" class=\"node\"><title>relu_in3a_3x3</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"214,-1258 120,-1258 120,-1200 214,-1200 214,-1258\"/>\n",
       "<text text-anchor=\"middle\" x=\"167\" y=\"-1232.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"167\" y=\"-1217.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3a_3x3&#45;&gt;bn_in3a_3x3 -->\n",
       "<g id=\"edge9\" class=\"edge\"><title>relu_in3a_3x3&#45;&gt;bn_in3a_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M167,-1189.51C167,-1163.45 167,-1129.62 167,-1106.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"167,-1199.79 162.5,-1189.79 167,-1194.79 167,-1189.79 167,-1189.79 167,-1189.79 167,-1194.79 171.5,-1189.79 167,-1199.79 167,-1199.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"194.5\" y=\"-1149.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3a_double_3x3_reduce -->\n",
       "<g id=\"node11\" class=\"node\"><title>conv_in3a_double_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"299,-168 205,-168 205,-110 299,-110 299,-168\"/>\n",
       "<text text-anchor=\"middle\" x=\"252\" y=\"-142.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"252\" y=\"-127.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 64</text>\n",
       "</g>\n",
       "<!-- conv_in3a_double_3x3_reduce&#45;&gt;Previos Output -->\n",
       "<g id=\"edge10\" class=\"edge\"><title>conv_in3a_double_3x3_reduce&#45;&gt;Previos Output</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M230.425,-101.015C222.276,-87.0445 213.14,-71.3822 205.525,-58.3283\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"235.612,-109.906 226.686,-103.536 233.093,-105.587 230.573,-101.268 230.573,-101.268 230.573,-101.268 233.093,-105.587 234.46,-99.001 235.612,-109.906 235.612,-109.906\"/>\n",
       "<text text-anchor=\"middle\" x=\"248\" y=\"-80.3\" font-family=\"Times,serif\" font-size=\"14.00\">3x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3a_double_3x3_reduce -->\n",
       "<g id=\"node12\" class=\"node\"><title>bn_in3a_double_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"327,-278 233,-278 233,-220 327,-220 327,-278\"/>\n",
       "<text text-anchor=\"middle\" x=\"280\" y=\"-245.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3a_double_3x3_reduce&#45;&gt;conv_in3a_double_3x3_reduce -->\n",
       "<g id=\"edge11\" class=\"edge\"><title>bn_in3a_double_3x3_reduce&#45;&gt;conv_in3a_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M270.204,-210.215C266.635,-196.449 262.664,-181.134 259.344,-168.328\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"272.716,-219.906 265.851,-211.356 271.462,-215.066 270.207,-210.226 270.207,-210.226 270.207,-210.226 271.462,-215.066 274.563,-209.097 272.716,-219.906 272.716,-219.906\"/>\n",
       "<text text-anchor=\"middle\" x=\"294.5\" y=\"-190.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3a_double_3x3_reduce -->\n",
       "<g id=\"node13\" class=\"node\"><title>relu_in3a_double_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"327,-388 233,-388 233,-330 327,-330 327,-388\"/>\n",
       "<text text-anchor=\"middle\" x=\"280\" y=\"-362.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"280\" y=\"-347.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3a_double_3x3_reduce&#45;&gt;bn_in3a_double_3x3_reduce -->\n",
       "<g id=\"edge12\" class=\"edge\"><title>relu_in3a_double_3x3_reduce&#45;&gt;bn_in3a_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M280,-319.813C280,-306.152 280,-291.009 280,-278.328\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"280,-329.906 275.5,-319.906 280,-324.906 280,-319.906 280,-319.906 280,-319.906 280,-324.906 284.5,-319.906 280,-329.906 280,-329.906\"/>\n",
       "<text text-anchor=\"middle\" x=\"307.5\" y=\"-300.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3a_double_3x3_0 -->\n",
       "<g id=\"node14\" class=\"node\"><title>conv_in3a_double_3x3_0</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"326,-540 232,-540 232,-482 326,-482 326,-540\"/>\n",
       "<text text-anchor=\"middle\" x=\"279\" y=\"-514.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"279\" y=\"-499.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 96</text>\n",
       "</g>\n",
       "<!-- conv_in3a_double_3x3_0&#45;&gt;relu_in3a_double_3x3_reduce -->\n",
       "<g id=\"edge13\" class=\"edge\"><title>conv_in3a_double_3x3_0&#45;&gt;relu_in3a_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M279.257,-471.507C279.43,-445.451 279.656,-411.621 279.813,-388.087\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"279.188,-481.786 274.755,-471.756 279.221,-476.786 279.255,-471.786 279.255,-471.786 279.255,-471.786 279.221,-476.786 283.755,-471.816 279.188,-481.786 279.188,-481.786\"/>\n",
       "<text text-anchor=\"middle\" x=\"306.5\" y=\"-431.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3a_double_3x3_0 -->\n",
       "<g id=\"node15\" class=\"node\"><title>bn_in3a_double_3x3_0</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"326,-650 232,-650 232,-592 326,-592 326,-650\"/>\n",
       "<text text-anchor=\"middle\" x=\"279\" y=\"-617.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3a_double_3x3_0&#45;&gt;conv_in3a_double_3x3_0 -->\n",
       "<g id=\"edge14\" class=\"edge\"><title>bn_in3a_double_3x3_0&#45;&gt;conv_in3a_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M279,-581.813C279,-568.152 279,-553.009 279,-540.328\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"279,-591.906 274.5,-581.906 279,-586.906 279,-581.906 279,-581.906 279,-581.906 279,-586.906 283.5,-581.906 279,-591.906 279,-591.906\"/>\n",
       "<text text-anchor=\"middle\" x=\"306.5\" y=\"-562.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3a_double_3x3_0 -->\n",
       "<g id=\"node16\" class=\"node\"><title>relu_in3a_double_3x3_0</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"326,-802 232,-802 232,-744 326,-744 326,-802\"/>\n",
       "<text text-anchor=\"middle\" x=\"279\" y=\"-776.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"279\" y=\"-761.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3a_double_3x3_0&#45;&gt;bn_in3a_double_3x3_0 -->\n",
       "<g id=\"edge15\" class=\"edge\"><title>relu_in3a_double_3x3_0&#45;&gt;bn_in3a_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M276.314,-733.731C276.189,-731.116 276.082,-728.52 276,-726 275.161,-700.236 275.161,-693.764 276,-668 276.188,-662.241 276.507,-656.083 276.869,-650.205\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"276.869,-743.795 271.826,-734.058 276.594,-738.802 276.319,-733.81 276.319,-733.81 276.319,-733.81 276.594,-738.802 280.812,-733.562 276.869,-743.795 276.869,-743.795\"/>\n",
       "<text text-anchor=\"middle\" x=\"303.5\" y=\"-693.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3a_double_3x3_1 -->\n",
       "<g id=\"node17\" class=\"node\"><title>conv_in3a_double_3x3_1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"326,-954 232,-954 232,-896 326,-896 326,-954\"/>\n",
       "<text text-anchor=\"middle\" x=\"279\" y=\"-928.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"279\" y=\"-913.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 96</text>\n",
       "</g>\n",
       "<!-- conv_in3a_double_3x3_1&#45;&gt;relu_in3a_double_3x3_0 -->\n",
       "<g id=\"edge16\" class=\"edge\"><title>conv_in3a_double_3x3_1&#45;&gt;relu_in3a_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M279,-885.507C279,-859.451 279,-825.621 279,-802.087\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"279,-895.786 274.5,-885.786 279,-890.786 279,-885.786 279,-885.786 279,-885.786 279,-890.786 283.5,-885.786 279,-895.786 279,-895.786\"/>\n",
       "<text text-anchor=\"middle\" x=\"306.5\" y=\"-845.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3a_double_3x3_1 -->\n",
       "<g id=\"node18\" class=\"node\"><title>bn_in3a_double_3x3_1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"326,-1106 232,-1106 232,-1048 326,-1048 326,-1106\"/>\n",
       "<text text-anchor=\"middle\" x=\"279\" y=\"-1073.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3a_double_3x3_1&#45;&gt;conv_in3a_double_3x3_1 -->\n",
       "<g id=\"edge17\" class=\"edge\"><title>bn_in3a_double_3x3_1&#45;&gt;conv_in3a_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M279,-1037.51C279,-1011.45 279,-977.621 279,-954.087\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"279,-1047.79 274.5,-1037.79 279,-1042.79 279,-1037.79 279,-1037.79 279,-1037.79 279,-1042.79 283.5,-1037.79 279,-1047.79 279,-1047.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"306.5\" y=\"-997.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3a_double_3x3_1 -->\n",
       "<g id=\"node19\" class=\"node\"><title>relu_in3a_double_3x3_1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"326,-1258 232,-1258 232,-1200 326,-1200 326,-1258\"/>\n",
       "<text text-anchor=\"middle\" x=\"279\" y=\"-1232.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"279\" y=\"-1217.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3a_double_3x3_1&#45;&gt;bn_in3a_double_3x3_1 -->\n",
       "<g id=\"edge18\" class=\"edge\"><title>relu_in3a_double_3x3_1&#45;&gt;bn_in3a_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M279,-1189.51C279,-1163.45 279,-1129.62 279,-1106.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"279,-1199.79 274.5,-1189.79 279,-1194.79 279,-1189.79 279,-1189.79 279,-1189.79 279,-1194.79 283.5,-1189.79 279,-1199.79 279,-1199.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"306.5\" y=\"-1149.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- avg_pool_in3a_pool -->\n",
       "<g id=\"node20\" class=\"node\"><title>avg_pool_in3a_pool</title>\n",
       "<polygon fill=\"#80b1d3\" stroke=\"black\" points=\"434,-726 340,-726 340,-668 434,-668 434,-726\"/>\n",
       "<text text-anchor=\"middle\" x=\"387\" y=\"-700.8\" font-family=\"Times,serif\" font-size=\"14.00\">Pooling</text>\n",
       "<text text-anchor=\"middle\" x=\"387\" y=\"-685.8\" font-family=\"Times,serif\" font-size=\"14.00\">avg, 3x3/1</text>\n",
       "</g>\n",
       "<!-- avg_pool_in3a_pool&#45;&gt;Previos Output -->\n",
       "<g id=\"edge19\" class=\"edge\"><title>avg_pool_in3a_pool&#45;&gt;Previos Output</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M382.03,-657.82C379.115,-632.182 376,-597.621 376,-567 376,-567 376,-567 376,-138 376,-73.5159 291.585,-46.9294 236.188,-36.4247\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"383.214,-667.874 377.575,-658.47 382.629,-662.909 382.044,-657.943 382.044,-657.943 382.044,-657.943 382.629,-662.909 386.513,-657.416 383.214,-667.874 383.214,-667.874\"/>\n",
       "<text text-anchor=\"middle\" x=\"400\" y=\"-355.3\" font-family=\"Times,serif\" font-size=\"14.00\">3x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3a_proj -->\n",
       "<g id=\"node21\" class=\"node\"><title>conv_in3a_proj</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"438,-954 344,-954 344,-896 438,-896 438,-954\"/>\n",
       "<text text-anchor=\"middle\" x=\"391\" y=\"-928.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"391\" y=\"-913.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 32</text>\n",
       "</g>\n",
       "<!-- conv_in3a_proj&#45;&gt;avg_pool_in3a_pool -->\n",
       "<g id=\"edge20\" class=\"edge\"><title>conv_in3a_proj&#45;&gt;avg_pool_in3a_pool</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M390.324,-885.832C389.525,-840.644 388.212,-766.452 387.498,-726.165\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"390.501,-895.834 385.825,-885.915 390.413,-890.835 390.324,-885.835 390.324,-885.835 390.324,-885.835 390.413,-890.835 394.824,-885.756 390.501,-895.834 390.501,-895.834\"/>\n",
       "<text text-anchor=\"middle\" x=\"414\" y=\"-845.3\" font-family=\"Times,serif\" font-size=\"14.00\">3x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3a_proj -->\n",
       "<g id=\"node22\" class=\"node\"><title>bn_in3a_proj</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"438,-1106 344,-1106 344,-1048 438,-1048 438,-1106\"/>\n",
       "<text text-anchor=\"middle\" x=\"391\" y=\"-1073.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3a_proj&#45;&gt;conv_in3a_proj -->\n",
       "<g id=\"edge21\" class=\"edge\"><title>bn_in3a_proj&#45;&gt;conv_in3a_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M391,-1037.51C391,-1011.45 391,-977.621 391,-954.087\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"391,-1047.79 386.5,-1037.79 391,-1042.79 391,-1037.79 391,-1037.79 391,-1037.79 391,-1042.79 395.5,-1037.79 391,-1047.79 391,-1047.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"418.5\" y=\"-997.3\" font-family=\"Times,serif\" font-size=\"14.00\">32x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3a_proj -->\n",
       "<g id=\"node23\" class=\"node\"><title>relu_in3a_proj</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"438,-1258 344,-1258 344,-1200 438,-1200 438,-1258\"/>\n",
       "<text text-anchor=\"middle\" x=\"391\" y=\"-1232.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"391\" y=\"-1217.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3a_proj&#45;&gt;bn_in3a_proj -->\n",
       "<g id=\"edge22\" class=\"edge\"><title>relu_in3a_proj&#45;&gt;bn_in3a_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M391,-1189.51C391,-1163.45 391,-1129.62 391,-1106.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"391,-1199.79 386.5,-1189.79 391,-1194.79 391,-1189.79 391,-1189.79 391,-1189.79 391,-1194.79 395.5,-1189.79 391,-1199.79 391,-1199.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"418.5\" y=\"-1149.3\" font-family=\"Times,serif\" font-size=\"14.00\">32x28x28</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3a_chconcat -->\n",
       "<g id=\"node24\" class=\"node\"><title>ch_concat_in3a_chconcat</title>\n",
       "<polygon fill=\"#fdb462\" stroke=\"black\" points=\"275,-1368 181,-1368 181,-1310 275,-1310 275,-1368\"/>\n",
       "<text text-anchor=\"middle\" x=\"228\" y=\"-1335.3\" font-family=\"Times,serif\" font-size=\"14.00\">Concat</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3a_chconcat&#45;&gt;relu_in3a_1x1 -->\n",
       "<g id=\"edge23\" class=\"edge\"><title>ch_concat_in3a_chconcat&#45;&gt;relu_in3a_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M171.222,-1321.65C154.673,-1314.67 137.659,-1305.04 125,-1292 95.1902,-1261.3 80.5188,-1212.62 73.8711,-1182.04\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"180.876,-1325.46 169.922,-1325.97 176.225,-1323.62 171.573,-1321.78 171.573,-1321.78 171.573,-1321.78 176.225,-1323.62 173.225,-1317.6 180.876,-1325.46 180.876,-1325.46\"/>\n",
       "<text text-anchor=\"middle\" x=\"152.5\" y=\"-1280.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3a_chconcat&#45;&gt;relu_in3a_3x3 -->\n",
       "<g id=\"edge24\" class=\"edge\"><title>ch_concat_in3a_chconcat&#45;&gt;relu_in3a_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M197.098,-1301.59C194.915,-1298.42 192.85,-1295.21 191,-1292 184.943,-1281.5 179.817,-1269.19 175.877,-1258.31\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"203.08,-1309.78 193.549,-1304.36 200.132,-1305.74 197.183,-1301.7 197.183,-1301.7 197.183,-1301.7 200.132,-1305.74 200.817,-1299.05 203.08,-1309.78 203.08,-1309.78\"/>\n",
       "<text text-anchor=\"middle\" x=\"218.5\" y=\"-1280.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3a_chconcat&#45;&gt;relu_in3a_double_3x3_1 -->\n",
       "<g id=\"edge25\" class=\"edge\"><title>ch_concat_in3a_chconcat&#45;&gt;relu_in3a_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M245.654,-1300.62C252.203,-1286.75 259.517,-1271.26 265.623,-1258.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"241.267,-1309.91 241.468,-1298.94 243.402,-1305.38 245.537,-1300.86 245.537,-1300.86 245.537,-1300.86 243.402,-1305.38 249.606,-1302.79 241.267,-1309.91 241.267,-1309.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"283.5\" y=\"-1280.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3a_chconcat&#45;&gt;relu_in3a_proj -->\n",
       "<g id=\"edge26\" class=\"edge\"><title>ch_concat_in3a_chconcat&#45;&gt;relu_in3a_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M284.149,-1310.41C294.619,-1304.68 305.307,-1298.42 315,-1292 330.329,-1281.84 346.25,-1269.22 359.536,-1258.02\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"275.035,-1315.3 281.721,-1306.61 279.441,-1312.94 283.848,-1310.57 283.848,-1310.57 283.848,-1310.57 279.441,-1312.94 285.975,-1314.54 275.035,-1315.3 275.035,-1315.3\"/>\n",
       "<text text-anchor=\"middle\" x=\"363.5\" y=\"-1280.3\" font-family=\"Times,serif\" font-size=\"14.00\">32x28x28</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f2bc2d10320>"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# We can also visualize network with feature map shape information\n",
    "# In this case, we must provide all necessary input shape info as a dict\n",
    "prev = mx.symbol.Variable(name=\"Previos Output\")\n",
    "in3a = InceptionFactoryA(prev, 64, 64, 64, 64, 96, \"avg\", 32, name=\"in3a\")\n",
    "# shape info\n",
    "# Note shape info must contain batch size although we ignore batch size in graph to save space\n",
    "batch_size = 128\n",
    "shape = {\"Previos Output\" : (batch_size, 3, 28, 28)}\n",
    "# plot\n",
    "mx.viz.plot_network(symbol=in3a, shape=shape)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We will make the other factory with ```stride=(2, 2)```"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# param mapping to paper:\n",
    "# num_1x1      >>>  #1x1 (not exist!)\n",
    "# num_3x3red   >>>  #3x3 reduce\n",
    "# num_3x3      >>>  #3x3\n",
    "# num_d3x3red  >>>  double #3x3 reduce\n",
    "# num_d3x3     >>>  double #3x3\n",
    "# pool         >>>  Pool (not needed, all are max pooling)\n",
    "# proj         >>>  proj (not exist!)\n",
    "def InceptionFactoryB(data, num_3x3red, num_3x3, num_d3x3red, num_d3x3, name):\n",
    "    # 3x3 reduce + 3x3\n",
    "    c3x3r = ConvFactory(data=data, num_filter=num_3x3red, kernel=(1, 1), name=('%s_3x3' % name), suffix='_reduce')\n",
    "    c3x3 = ConvFactory(data=c3x3r, num_filter=num_3x3, kernel=(3, 3), pad=(1, 1), stride=(2, 2), name=('%s_3x3' % name))\n",
    "    # double 3x3 reduce + double 3x3\n",
    "    cd3x3r = ConvFactory(data=data, num_filter=num_d3x3red, kernel=(1, 1),  name=('%s_double_3x3' % name), suffix='_reduce')\n",
    "    cd3x3 = ConvFactory(data=cd3x3r, num_filter=num_d3x3, kernel=(3, 3), pad=(1, 1), stride=(1, 1), name=('%s_double_3x3_0' % name))\n",
    "    cd3x3 = ConvFactory(data=cd3x3, num_filter=num_d3x3, kernel=(3, 3), pad=(1, 1), stride=(2, 2), name=('%s_double_3x3_1' % name))\n",
    "    # pool + proj\n",
    "    pooling = mx.symbol.Pooling(data=data, kernel=(3, 3), stride=(2, 2), pool_type=\"max\", name=('max_pool_%s_pool' % name))\n",
    "    # concat\n",
    "    concat = mx.symbol.Concat(*[c3x3, cd3x3, pooling], name='ch_concat_%s_chconcat' % name)\n",
    "    return concat"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.36.0 (20140111.2315)\n",
       " -->\n",
       "<!-- Title: plot Pages: 1 -->\n",
       "<svg width=\"289pt\" height=\"1006pt\"\n",
       " viewBox=\"0.00 0.00 289.00 1006.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 1002)\">\n",
       "<title>plot</title>\n",
       "<polygon fill=\"white\" stroke=\"none\" points=\"-4,4 -4,-1002 285,-1002 285,4 -4,4\"/>\n",
       "<!-- Previos Output -->\n",
       "<g id=\"node1\" class=\"node\"><title>Previos Output</title>\n",
       "<polygon fill=\"#8dd3c7\" stroke=\"black\" points=\"169,-58 75,-58 75,-3.55271e-15 169,-3.55271e-15 169,-58\"/>\n",
       "<text text-anchor=\"middle\" x=\"122\" y=\"-25.3\" font-family=\"Times,serif\" font-size=\"14.00\">Previos Output</text>\n",
       "</g>\n",
       "<!-- conv_in3c_3x3_reduce -->\n",
       "<g id=\"node2\" class=\"node\"><title>conv_in3c_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"94,-340 -7.10543e-15,-340 -7.10543e-15,-282 94,-282 94,-340\"/>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-314.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-299.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 128</text>\n",
       "</g>\n",
       "<!-- conv_in3c_3x3_reduce&#45;&gt;Previos Output -->\n",
       "<g id=\"edge1\" class=\"edge\"><title>conv_in3c_3x3_reduce&#45;&gt;Previos Output</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M43.395,-271.621C40.754,-227.041 41.1764,-152.18 66,-94 71.6202,-80.8277 81.0213,-68.4491 90.5311,-58.1538\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"44.0782,-281.735 38.9144,-272.061 43.7412,-276.746 43.4041,-271.758 43.4041,-271.758 43.4041,-271.758 43.7412,-276.746 47.8939,-271.454 44.0782,-281.735 44.0782,-281.735\"/>\n",
       "</g>\n",
       "<!-- bn_in3c_3x3_reduce -->\n",
       "<g id=\"node3\" class=\"node\"><title>bn_in3c_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"94,-434 -7.10543e-15,-434 -7.10543e-15,-376 94,-376 94,-434\"/>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-401.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3c_3x3_reduce&#45;&gt;conv_in3c_3x3_reduce -->\n",
       "<g id=\"edge2\" class=\"edge\"><title>bn_in3c_3x3_reduce&#45;&gt;conv_in3c_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M47,-365.744C47,-357.204 47,-348.298 47,-340.248\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"47,-375.897 42.5001,-365.897 47,-370.897 47.0001,-365.897 47.0001,-365.897 47.0001,-365.897 47,-370.897 51.5001,-365.897 47,-375.897 47,-375.897\"/>\n",
       "</g>\n",
       "<!-- relu_in3c_3x3_reduce -->\n",
       "<g id=\"node4\" class=\"node\"><title>relu_in3c_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"94,-528 -7.10543e-15,-528 -7.10543e-15,-470 94,-470 94,-528\"/>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-502.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-487.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3c_3x3_reduce&#45;&gt;bn_in3c_3x3_reduce -->\n",
       "<g id=\"edge3\" class=\"edge\"><title>relu_in3c_3x3_reduce&#45;&gt;bn_in3c_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M47,-459.744C47,-451.204 47,-442.298 47,-434.248\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"47,-469.897 42.5001,-459.897 47,-464.897 47.0001,-459.897 47.0001,-459.897 47.0001,-459.897 47,-464.897 51.5001,-459.897 47,-469.897 47,-469.897\"/>\n",
       "</g>\n",
       "<!-- conv_in3c_3x3 -->\n",
       "<g id=\"node5\" class=\"node\"><title>conv_in3c_3x3</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"94,-622 -7.10543e-15,-622 -7.10543e-15,-564 94,-564 94,-622\"/>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-596.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-581.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/2, 160</text>\n",
       "</g>\n",
       "<!-- conv_in3c_3x3&#45;&gt;relu_in3c_3x3_reduce -->\n",
       "<g id=\"edge4\" class=\"edge\"><title>conv_in3c_3x3&#45;&gt;relu_in3c_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M47,-553.744C47,-545.204 47,-536.298 47,-528.248\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"47,-563.897 42.5001,-553.897 47,-558.897 47.0001,-553.897 47.0001,-553.897 47.0001,-553.897 47,-558.897 51.5001,-553.897 47,-563.897 47,-563.897\"/>\n",
       "</g>\n",
       "<!-- bn_in3c_3x3 -->\n",
       "<g id=\"node6\" class=\"node\"><title>bn_in3c_3x3</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"94,-716 -7.10543e-15,-716 -7.10543e-15,-658 94,-658 94,-716\"/>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-683.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3c_3x3&#45;&gt;conv_in3c_3x3 -->\n",
       "<g id=\"edge5\" class=\"edge\"><title>bn_in3c_3x3&#45;&gt;conv_in3c_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M47,-647.744C47,-639.204 47,-630.298 47,-622.248\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"47,-657.897 42.5001,-647.897 47,-652.897 47.0001,-647.897 47.0001,-647.897 47.0001,-647.897 47,-652.897 51.5001,-647.897 47,-657.897 47,-657.897\"/>\n",
       "</g>\n",
       "<!-- relu_in3c_3x3 -->\n",
       "<g id=\"node7\" class=\"node\"><title>relu_in3c_3x3</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"94,-810 -7.10543e-15,-810 -7.10543e-15,-752 94,-752 94,-810\"/>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-784.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-769.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3c_3x3&#45;&gt;bn_in3c_3x3 -->\n",
       "<g id=\"edge6\" class=\"edge\"><title>relu_in3c_3x3&#45;&gt;bn_in3c_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M47,-741.744C47,-733.204 47,-724.298 47,-716.248\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"47,-751.897 42.5001,-741.897 47,-746.897 47.0001,-741.897 47.0001,-741.897 47.0001,-741.897 47,-746.897 51.5001,-741.897 47,-751.897 47,-751.897\"/>\n",
       "</g>\n",
       "<!-- conv_in3c_double_3x3_reduce -->\n",
       "<g id=\"node8\" class=\"node\"><title>conv_in3c_double_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"169,-152 75,-152 75,-94 169,-94 169,-152\"/>\n",
       "<text text-anchor=\"middle\" x=\"122\" y=\"-126.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"122\" y=\"-111.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 64</text>\n",
       "</g>\n",
       "<!-- conv_in3c_double_3x3_reduce&#45;&gt;Previos Output -->\n",
       "<g id=\"edge7\" class=\"edge\"><title>conv_in3c_double_3x3_reduce&#45;&gt;Previos Output</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M122,-83.7443C122,-75.2043 122,-66.2977 122,-58.2479\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"122,-93.8971 117.5,-83.897 122,-88.8971 122,-83.8971 122,-83.8971 122,-83.8971 122,-88.8971 126.5,-83.8971 122,-93.8971 122,-93.8971\"/>\n",
       "</g>\n",
       "<!-- bn_in3c_double_3x3_reduce -->\n",
       "<g id=\"node9\" class=\"node\"><title>bn_in3c_double_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"169,-246 75,-246 75,-188 169,-188 169,-246\"/>\n",
       "<text text-anchor=\"middle\" x=\"122\" y=\"-213.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3c_double_3x3_reduce&#45;&gt;conv_in3c_double_3x3_reduce -->\n",
       "<g id=\"edge8\" class=\"edge\"><title>bn_in3c_double_3x3_reduce&#45;&gt;conv_in3c_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M122,-177.744C122,-169.204 122,-160.298 122,-152.248\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"122,-187.897 117.5,-177.897 122,-182.897 122,-177.897 122,-177.897 122,-177.897 122,-182.897 126.5,-177.897 122,-187.897 122,-187.897\"/>\n",
       "</g>\n",
       "<!-- relu_in3c_double_3x3_reduce -->\n",
       "<g id=\"node10\" class=\"node\"><title>relu_in3c_double_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"206,-340 112,-340 112,-282 206,-282 206,-340\"/>\n",
       "<text text-anchor=\"middle\" x=\"159\" y=\"-314.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"159\" y=\"-299.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3c_double_3x3_reduce&#45;&gt;bn_in3c_double_3x3_reduce -->\n",
       "<g id=\"edge9\" class=\"edge\"><title>relu_in3c_double_3x3_reduce&#45;&gt;bn_in3c_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M143.954,-272.588C140.417,-263.793 136.705,-254.563 133.361,-246.248\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"147.698,-281.897 139.791,-274.298 145.832,-277.258 143.966,-272.619 143.966,-272.619 143.966,-272.619 145.832,-277.258 148.141,-270.94 147.698,-281.897 147.698,-281.897\"/>\n",
       "</g>\n",
       "<!-- conv_in3c_double_3x3_0 -->\n",
       "<g id=\"node11\" class=\"node\"><title>conv_in3c_double_3x3_0</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"206,-434 112,-434 112,-376 206,-376 206,-434\"/>\n",
       "<text text-anchor=\"middle\" x=\"159\" y=\"-408.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"159\" y=\"-393.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 96</text>\n",
       "</g>\n",
       "<!-- conv_in3c_double_3x3_0&#45;&gt;relu_in3c_double_3x3_reduce -->\n",
       "<g id=\"edge10\" class=\"edge\"><title>conv_in3c_double_3x3_0&#45;&gt;relu_in3c_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M159,-365.744C159,-357.204 159,-348.298 159,-340.248\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"159,-375.897 154.5,-365.897 159,-370.897 159,-365.897 159,-365.897 159,-365.897 159,-370.897 163.5,-365.897 159,-375.897 159,-375.897\"/>\n",
       "</g>\n",
       "<!-- bn_in3c_double_3x3_0 -->\n",
       "<g id=\"node12\" class=\"node\"><title>bn_in3c_double_3x3_0</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"206,-528 112,-528 112,-470 206,-470 206,-528\"/>\n",
       "<text text-anchor=\"middle\" x=\"159\" y=\"-495.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3c_double_3x3_0&#45;&gt;conv_in3c_double_3x3_0 -->\n",
       "<g id=\"edge11\" class=\"edge\"><title>bn_in3c_double_3x3_0&#45;&gt;conv_in3c_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M159,-459.744C159,-451.204 159,-442.298 159,-434.248\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"159,-469.897 154.5,-459.897 159,-464.897 159,-459.897 159,-459.897 159,-459.897 159,-464.897 163.5,-459.897 159,-469.897 159,-469.897\"/>\n",
       "</g>\n",
       "<!-- relu_in3c_double_3x3_0 -->\n",
       "<g id=\"node13\" class=\"node\"><title>relu_in3c_double_3x3_0</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"206,-622 112,-622 112,-564 206,-564 206,-622\"/>\n",
       "<text text-anchor=\"middle\" x=\"159\" y=\"-596.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"159\" y=\"-581.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3c_double_3x3_0&#45;&gt;bn_in3c_double_3x3_0 -->\n",
       "<g id=\"edge12\" class=\"edge\"><title>relu_in3c_double_3x3_0&#45;&gt;bn_in3c_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M159,-553.744C159,-545.204 159,-536.298 159,-528.248\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"159,-563.897 154.5,-553.897 159,-558.897 159,-553.897 159,-553.897 159,-553.897 159,-558.897 163.5,-553.897 159,-563.897 159,-563.897\"/>\n",
       "</g>\n",
       "<!-- conv_in3c_double_3x3_1 -->\n",
       "<g id=\"node14\" class=\"node\"><title>conv_in3c_double_3x3_1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"206,-716 112,-716 112,-658 206,-658 206,-716\"/>\n",
       "<text text-anchor=\"middle\" x=\"159\" y=\"-690.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"159\" y=\"-675.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/2, 96</text>\n",
       "</g>\n",
       "<!-- conv_in3c_double_3x3_1&#45;&gt;relu_in3c_double_3x3_0 -->\n",
       "<g id=\"edge13\" class=\"edge\"><title>conv_in3c_double_3x3_1&#45;&gt;relu_in3c_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M159,-647.744C159,-639.204 159,-630.298 159,-622.248\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"159,-657.897 154.5,-647.897 159,-652.897 159,-647.897 159,-647.897 159,-647.897 159,-652.897 163.5,-647.897 159,-657.897 159,-657.897\"/>\n",
       "</g>\n",
       "<!-- bn_in3c_double_3x3_1 -->\n",
       "<g id=\"node15\" class=\"node\"><title>bn_in3c_double_3x3_1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"206,-810 112,-810 112,-752 206,-752 206,-810\"/>\n",
       "<text text-anchor=\"middle\" x=\"159\" y=\"-777.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3c_double_3x3_1&#45;&gt;conv_in3c_double_3x3_1 -->\n",
       "<g id=\"edge14\" class=\"edge\"><title>bn_in3c_double_3x3_1&#45;&gt;conv_in3c_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M159,-741.744C159,-733.204 159,-724.298 159,-716.248\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"159,-751.897 154.5,-741.897 159,-746.897 159,-741.897 159,-741.897 159,-741.897 159,-746.897 163.5,-741.897 159,-751.897 159,-751.897\"/>\n",
       "</g>\n",
       "<!-- relu_in3c_double_3x3_1 -->\n",
       "<g id=\"node16\" class=\"node\"><title>relu_in3c_double_3x3_1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"206,-904 112,-904 112,-846 206,-846 206,-904\"/>\n",
       "<text text-anchor=\"middle\" x=\"159\" y=\"-878.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"159\" y=\"-863.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3c_double_3x3_1&#45;&gt;bn_in3c_double_3x3_1 -->\n",
       "<g id=\"edge15\" class=\"edge\"><title>relu_in3c_double_3x3_1&#45;&gt;bn_in3c_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M159,-835.744C159,-827.204 159,-818.298 159,-810.248\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"159,-845.897 154.5,-835.897 159,-840.897 159,-835.897 159,-835.897 159,-835.897 159,-840.897 163.5,-835.897 159,-845.897 159,-845.897\"/>\n",
       "</g>\n",
       "<!-- max_pool_in3c_pool -->\n",
       "<g id=\"node17\" class=\"node\"><title>max_pool_in3c_pool</title>\n",
       "<polygon fill=\"#80b1d3\" stroke=\"black\" points=\"281,-246 187,-246 187,-188 281,-188 281,-246\"/>\n",
       "<text text-anchor=\"middle\" x=\"234\" y=\"-220.8\" font-family=\"Times,serif\" font-size=\"14.00\">Pooling</text>\n",
       "<text text-anchor=\"middle\" x=\"234\" y=\"-205.8\" font-family=\"Times,serif\" font-size=\"14.00\">max, 3x3/2</text>\n",
       "</g>\n",
       "<!-- max_pool_in3c_pool&#45;&gt;Previos Output -->\n",
       "<g id=\"edge16\" class=\"edge\"><title>max_pool_in3c_pool&#45;&gt;Previos Output</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M219.966,-178.223C209.944,-153.352 195.22,-120.596 178,-94 169.896,-81.4828 159.47,-68.8805 149.815,-58.2087\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"223.704,-187.679 215.842,-180.033 221.866,-183.029 220.027,-178.379 220.027,-178.379 220.027,-178.379 221.866,-183.029 224.212,-176.724 223.704,-187.679 223.704,-187.679\"/>\n",
       "</g>\n",
       "<!-- ch_concat_in3c_chconcat -->\n",
       "<g id=\"node18\" class=\"node\"><title>ch_concat_in3c_chconcat</title>\n",
       "<polygon fill=\"#fdb462\" stroke=\"black\" points=\"206,-998 112,-998 112,-940 206,-940 206,-998\"/>\n",
       "<text text-anchor=\"middle\" x=\"159\" y=\"-965.3\" font-family=\"Times,serif\" font-size=\"14.00\">Concat</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3c_chconcat&#45;&gt;relu_in3c_3x3 -->\n",
       "<g id=\"edge17\" class=\"edge\"><title>ch_concat_in3c_chconcat&#45;&gt;relu_in3c_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M124.54,-932.264C116.925,-923.413 109.268,-913.681 103,-904 83.4944,-873.873 67.1913,-835.844 57.2964,-810.321\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"131.185,-939.791 121.193,-935.273 127.876,-936.043 124.567,-932.294 124.567,-932.294 124.567,-932.294 127.876,-936.043 127.94,-929.316 131.185,-939.791 131.185,-939.791\"/>\n",
       "</g>\n",
       "<!-- ch_concat_in3c_chconcat&#45;&gt;relu_in3c_double_3x3_1 -->\n",
       "<g id=\"edge18\" class=\"edge\"><title>ch_concat_in3c_chconcat&#45;&gt;relu_in3c_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M159,-929.744C159,-921.204 159,-912.298 159,-904.248\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"159,-939.897 154.5,-929.897 159,-934.897 159,-929.897 159,-929.897 159,-929.897 159,-934.897 163.5,-929.897 159,-939.897 159,-939.897\"/>\n",
       "</g>\n",
       "<!-- ch_concat_in3c_chconcat&#45;&gt;max_pool_in3c_pool -->\n",
       "<g id=\"edge19\" class=\"edge\"><title>ch_concat_in3c_chconcat&#45;&gt;max_pool_in3c_pool</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M196.365,-932.319C203.566,-923.69 210.315,-914.038 215,-904 238.208,-854.273 234,-836.876 234,-782 234,-782 234,-782 234,-404 234,-347.974 234,-282.455 234,-246.045\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"189.671,-939.939 192.89,-929.456 192.971,-936.183 196.271,-932.426 196.271,-932.426 196.271,-932.426 192.971,-936.183 199.652,-935.396 189.671,-939.939 189.671,-939.939\"/>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f2bc2cc9710>"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "prev = mx.symbol.Variable(name=\"Previos Output\")\n",
    "in3c = InceptionFactoryB(prev, 128, 160, 64, 96, name='in3c')\n",
    "mx.viz.plot_network(symbol=in3c)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we can use these factories to build the whole network"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/svg+xml": [
       "<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n",
       "<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n",
       " \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n",
       "<!-- Generated by graphviz version 2.36.0 (20140111.2315)\n",
       " -->\n",
       "<!-- Title: plot Pages: 1 -->\n",
       "<svg width=\"611pt\" height=\"14984pt\"\n",
       " viewBox=\"0.00 0.00 611.00 14984.00\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\n",
       "<g id=\"graph0\" class=\"graph\" transform=\"scale(1 1) rotate(0) translate(4 14980)\">\n",
       "<title>plot</title>\n",
       "<polygon fill=\"white\" stroke=\"none\" points=\"-4,4 -4,-14980 607,-14980 607,4 -4,4\"/>\n",
       "<!-- data -->\n",
       "<g id=\"node1\" class=\"node\"><title>data</title>\n",
       "<polygon fill=\"#8dd3c7\" stroke=\"black\" points=\"236,-58 142,-58 142,-3.55271e-15 236,-3.55271e-15 236,-58\"/>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-25.3\" font-family=\"Times,serif\" font-size=\"14.00\">data</text>\n",
       "</g>\n",
       "<!-- conv_conv1 -->\n",
       "<g id=\"node2\" class=\"node\"><title>conv_conv1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"236,-168 142,-168 142,-110 236,-110 236,-168\"/>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-142.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-127.8\" font-family=\"Times,serif\" font-size=\"14.00\">7x7/2, 64</text>\n",
       "</g>\n",
       "<!-- conv_conv1&#45;&gt;data -->\n",
       "<g id=\"edge1\" class=\"edge\"><title>conv_conv1&#45;&gt;data</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M189,-99.8131C189,-86.1516 189,-71.0092 189,-58.3283\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"189,-109.906 184.5,-99.9062 189,-104.906 189,-99.9062 189,-99.9062 189,-99.9062 189,-104.906 193.5,-99.9062 189,-109.906 189,-109.906\"/>\n",
       "<text text-anchor=\"middle\" x=\"219.5\" y=\"-80.3\" font-family=\"Times,serif\" font-size=\"14.00\">3x224x224</text>\n",
       "</g>\n",
       "<!-- bn_conv1 -->\n",
       "<g id=\"node3\" class=\"node\"><title>bn_conv1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"236,-278 142,-278 142,-220 236,-220 236,-278\"/>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-245.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_conv1&#45;&gt;conv_conv1 -->\n",
       "<g id=\"edge2\" class=\"edge\"><title>bn_conv1&#45;&gt;conv_conv1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M189,-209.813C189,-196.152 189,-181.009 189,-168.328\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"189,-219.906 184.5,-209.906 189,-214.906 189,-209.906 189,-209.906 189,-209.906 189,-214.906 193.5,-209.906 189,-219.906 189,-219.906\"/>\n",
       "<text text-anchor=\"middle\" x=\"223\" y=\"-190.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x112x112</text>\n",
       "</g>\n",
       "<!-- relu_conv1 -->\n",
       "<g id=\"node4\" class=\"node\"><title>relu_conv1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"236,-388 142,-388 142,-330 236,-330 236,-388\"/>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-362.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-347.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_conv1&#45;&gt;bn_conv1 -->\n",
       "<g id=\"edge3\" class=\"edge\"><title>relu_conv1&#45;&gt;bn_conv1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M189,-319.813C189,-306.152 189,-291.009 189,-278.328\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"189,-329.906 184.5,-319.906 189,-324.906 189,-319.906 189,-319.906 189,-319.906 189,-324.906 193.5,-319.906 189,-329.906 189,-329.906\"/>\n",
       "<text text-anchor=\"middle\" x=\"223\" y=\"-300.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x112x112</text>\n",
       "</g>\n",
       "<!-- pool1 -->\n",
       "<g id=\"node5\" class=\"node\"><title>pool1</title>\n",
       "<polygon fill=\"#80b1d3\" stroke=\"black\" points=\"236,-498 142,-498 142,-440 236,-440 236,-498\"/>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-472.8\" font-family=\"Times,serif\" font-size=\"14.00\">Pooling</text>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-457.8\" font-family=\"Times,serif\" font-size=\"14.00\">max, 3x3/2</text>\n",
       "</g>\n",
       "<!-- pool1&#45;&gt;relu_conv1 -->\n",
       "<g id=\"edge4\" class=\"edge\"><title>pool1&#45;&gt;relu_conv1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M189,-429.813C189,-416.152 189,-401.009 189,-388.328\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"189,-439.906 184.5,-429.906 189,-434.906 189,-429.906 189,-429.906 189,-429.906 189,-434.906 193.5,-429.906 189,-439.906 189,-439.906\"/>\n",
       "<text text-anchor=\"middle\" x=\"223\" y=\"-410.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x112x112</text>\n",
       "</g>\n",
       "<!-- conv_conv2red -->\n",
       "<g id=\"node6\" class=\"node\"><title>conv_conv2red</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"236,-608 142,-608 142,-550 236,-550 236,-608\"/>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-582.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-567.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 64</text>\n",
       "</g>\n",
       "<!-- conv_conv2red&#45;&gt;pool1 -->\n",
       "<g id=\"edge5\" class=\"edge\"><title>conv_conv2red&#45;&gt;pool1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M189,-539.813C189,-526.152 189,-511.009 189,-498.328\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"189,-549.906 184.5,-539.906 189,-544.906 189,-539.906 189,-539.906 189,-539.906 189,-544.906 193.5,-539.906 189,-549.906 189,-549.906\"/>\n",
       "<text text-anchor=\"middle\" x=\"216.5\" y=\"-520.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x56x56</text>\n",
       "</g>\n",
       "<!-- bn_conv2red -->\n",
       "<g id=\"node7\" class=\"node\"><title>bn_conv2red</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"236,-718 142,-718 142,-660 236,-660 236,-718\"/>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-685.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_conv2red&#45;&gt;conv_conv2red -->\n",
       "<g id=\"edge6\" class=\"edge\"><title>bn_conv2red&#45;&gt;conv_conv2red</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M189,-649.813C189,-636.152 189,-621.009 189,-608.328\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"189,-659.906 184.5,-649.906 189,-654.906 189,-649.906 189,-649.906 189,-649.906 189,-654.906 193.5,-649.906 189,-659.906 189,-659.906\"/>\n",
       "<text text-anchor=\"middle\" x=\"216.5\" y=\"-630.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x56x56</text>\n",
       "</g>\n",
       "<!-- relu_conv2red -->\n",
       "<g id=\"node8\" class=\"node\"><title>relu_conv2red</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"236,-828 142,-828 142,-770 236,-770 236,-828\"/>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-802.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-787.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_conv2red&#45;&gt;bn_conv2red -->\n",
       "<g id=\"edge7\" class=\"edge\"><title>relu_conv2red&#45;&gt;bn_conv2red</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M189,-759.813C189,-746.152 189,-731.009 189,-718.328\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"189,-769.906 184.5,-759.906 189,-764.906 189,-759.906 189,-759.906 189,-759.906 189,-764.906 193.5,-759.906 189,-769.906 189,-769.906\"/>\n",
       "<text text-anchor=\"middle\" x=\"216.5\" y=\"-740.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x56x56</text>\n",
       "</g>\n",
       "<!-- conv_conv2 -->\n",
       "<g id=\"node9\" class=\"node\"><title>conv_conv2</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"236,-938 142,-938 142,-880 236,-880 236,-938\"/>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-912.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-897.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 192</text>\n",
       "</g>\n",
       "<!-- conv_conv2&#45;&gt;relu_conv2red -->\n",
       "<g id=\"edge8\" class=\"edge\"><title>conv_conv2&#45;&gt;relu_conv2red</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M189,-869.813C189,-856.152 189,-841.009 189,-828.328\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"189,-879.906 184.5,-869.906 189,-874.906 189,-869.906 189,-869.906 189,-869.906 189,-874.906 193.5,-869.906 189,-879.906 189,-879.906\"/>\n",
       "<text text-anchor=\"middle\" x=\"216.5\" y=\"-850.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x56x56</text>\n",
       "</g>\n",
       "<!-- bn_conv2 -->\n",
       "<g id=\"node10\" class=\"node\"><title>bn_conv2</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"236,-1048 142,-1048 142,-990 236,-990 236,-1048\"/>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-1015.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_conv2&#45;&gt;conv_conv2 -->\n",
       "<g id=\"edge9\" class=\"edge\"><title>bn_conv2&#45;&gt;conv_conv2</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M189,-979.813C189,-966.152 189,-951.009 189,-938.328\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"189,-989.906 184.5,-979.906 189,-984.906 189,-979.906 189,-979.906 189,-979.906 189,-984.906 193.5,-979.906 189,-989.906 189,-989.906\"/>\n",
       "<text text-anchor=\"middle\" x=\"219.5\" y=\"-960.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x56x56</text>\n",
       "</g>\n",
       "<!-- relu_conv2 -->\n",
       "<g id=\"node11\" class=\"node\"><title>relu_conv2</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"236,-1158 142,-1158 142,-1100 236,-1100 236,-1158\"/>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-1132.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-1117.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_conv2&#45;&gt;bn_conv2 -->\n",
       "<g id=\"edge10\" class=\"edge\"><title>relu_conv2&#45;&gt;bn_conv2</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M189,-1089.81C189,-1076.15 189,-1061.01 189,-1048.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"189,-1099.91 184.5,-1089.91 189,-1094.91 189,-1089.91 189,-1089.91 189,-1089.91 189,-1094.91 193.5,-1089.91 189,-1099.91 189,-1099.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"219.5\" y=\"-1070.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x56x56</text>\n",
       "</g>\n",
       "<!-- pool2 -->\n",
       "<g id=\"node12\" class=\"node\"><title>pool2</title>\n",
       "<polygon fill=\"#80b1d3\" stroke=\"black\" points=\"236,-1268 142,-1268 142,-1210 236,-1210 236,-1268\"/>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-1242.8\" font-family=\"Times,serif\" font-size=\"14.00\">Pooling</text>\n",
       "<text text-anchor=\"middle\" x=\"189\" y=\"-1227.8\" font-family=\"Times,serif\" font-size=\"14.00\">max, 3x3/2</text>\n",
       "</g>\n",
       "<!-- pool2&#45;&gt;relu_conv2 -->\n",
       "<g id=\"edge11\" class=\"edge\"><title>pool2&#45;&gt;relu_conv2</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M189,-1199.81C189,-1186.15 189,-1171.01 189,-1158.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"189,-1209.91 184.5,-1199.91 189,-1204.91 189,-1199.91 189,-1199.91 189,-1199.91 189,-1204.91 193.5,-1199.91 189,-1209.91 189,-1209.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"219.5\" y=\"-1180.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x56x56</text>\n",
       "</g>\n",
       "<!-- conv_in3a_1x1 -->\n",
       "<g id=\"node13\" class=\"node\"><title>conv_in3a_1x1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"95,-2088 1,-2088 1,-2030 95,-2030 95,-2088\"/>\n",
       "<text text-anchor=\"middle\" x=\"48\" y=\"-2062.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"48\" y=\"-2047.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 64</text>\n",
       "</g>\n",
       "<!-- conv_in3a_1x1&#45;&gt;pool2 -->\n",
       "<g id=\"edge12\" class=\"edge\"><title>conv_in3a_1x1&#45;&gt;pool2</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M49.189,-2019.66C50.0268,-1989.36 51,-1945.98 51,-1908 51,-1908 51,-1908 51,-1348 51,-1300.69 101.917,-1271.01 141.894,-1254.99\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"48.9001,-2029.8 44.6867,-2019.68 49.0425,-2024.81 49.1849,-2019.81 49.1849,-2019.81 49.1849,-2019.81 49.0425,-2024.81 53.683,-2019.94 48.9001,-2029.8 48.9001,-2029.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"81.5\" y=\"-1641.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3a_1x1 -->\n",
       "<g id=\"node14\" class=\"node\"><title>bn_in3a_1x1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"94,-2240 -7.10543e-15,-2240 -7.10543e-15,-2182 94,-2182 94,-2240\"/>\n",
       "<text text-anchor=\"middle\" x=\"47\" y=\"-2207.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3a_1x1&#45;&gt;conv_in3a_1x1 -->\n",
       "<g id=\"edge13\" class=\"edge\"><title>bn_in3a_1x1&#45;&gt;conv_in3a_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M47.2566,-2171.51C47.4303,-2145.45 47.6559,-2111.62 47.8128,-2088.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"47.1881,-2181.79 42.755,-2171.76 47.2215,-2176.79 47.2549,-2171.79 47.2549,-2171.79 47.2549,-2171.79 47.2215,-2176.79 51.7548,-2171.82 47.1881,-2181.79 47.1881,-2181.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"75.5\" y=\"-2131.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3a_1x1 -->\n",
       "<g id=\"node15\" class=\"node\"><title>relu_in3a_1x1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"105,-2392 11,-2392 11,-2334 105,-2334 105,-2392\"/>\n",
       "<text text-anchor=\"middle\" x=\"58\" y=\"-2366.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"58\" y=\"-2351.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3a_1x1&#45;&gt;bn_in3a_1x1 -->\n",
       "<g id=\"edge14\" class=\"edge\"><title>relu_in3a_1x1&#45;&gt;bn_in3a_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M55.1771,-2323.51C53.2664,-2297.45 50.7855,-2263.62 49.0597,-2240.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"55.931,-2333.79 50.7116,-2324.14 55.5653,-2328.8 55.1995,-2323.81 55.1995,-2323.81 55.1995,-2323.81 55.5653,-2328.8 59.6875,-2323.48 55.931,-2333.79 55.931,-2333.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"82.5\" y=\"-2283.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3a_3x3_reduce -->\n",
       "<g id=\"node16\" class=\"node\"><title>conv_in3a_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"211,-1674 117,-1674 117,-1616 211,-1616 211,-1674\"/>\n",
       "<text text-anchor=\"middle\" x=\"164\" y=\"-1648.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"164\" y=\"-1633.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 64</text>\n",
       "</g>\n",
       "<!-- conv_in3a_3x3_reduce&#45;&gt;pool2 -->\n",
       "<g id=\"edge15\" class=\"edge\"><title>conv_in3a_3x3_reduce&#45;&gt;pool2</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M161.741,-1605.76C160.416,-1580.1 159,-1545.53 159,-1515 159,-1515 159,-1515 159,-1348 159,-1320.17 168.361,-1289.73 176.625,-1268.29\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"162.279,-1615.83 157.251,-1606.08 162.012,-1610.83 161.745,-1605.84 161.745,-1605.84 161.745,-1605.84 162.012,-1610.83 166.239,-1605.6 162.279,-1615.83 162.279,-1615.83\"/>\n",
       "<text text-anchor=\"middle\" x=\"189.5\" y=\"-1455.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3a_3x3_reduce -->\n",
       "<g id=\"node17\" class=\"node\"><title>bn_in3a_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"211,-1860 117,-1860 117,-1802 211,-1802 211,-1860\"/>\n",
       "<text text-anchor=\"middle\" x=\"164\" y=\"-1827.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3a_3x3_reduce&#45;&gt;conv_in3a_3x3_reduce -->\n",
       "<g id=\"edge16\" class=\"edge\"><title>bn_in3a_3x3_reduce&#45;&gt;conv_in3a_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M164,-1791.32C164,-1756.25 164,-1705.39 164,-1674.08\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"164,-1801.65 159.5,-1791.65 164,-1796.65 164,-1791.65 164,-1791.65 164,-1791.65 164,-1796.65 168.5,-1791.65 164,-1801.65 164,-1801.65\"/>\n",
       "<text text-anchor=\"middle\" x=\"191.5\" y=\"-1772.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3a_3x3_reduce -->\n",
       "<g id=\"node18\" class=\"node\"><title>relu_in3a_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"213,-2012 119,-2012 119,-1954 213,-1954 213,-2012\"/>\n",
       "<text text-anchor=\"middle\" x=\"166\" y=\"-1986.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"166\" y=\"-1971.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3a_3x3_reduce&#45;&gt;bn_in3a_3x3_reduce -->\n",
       "<g id=\"edge17\" class=\"edge\"><title>relu_in3a_3x3_reduce&#45;&gt;bn_in3a_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M165.487,-1943.51C165.139,-1917.45 164.688,-1883.62 164.374,-1860.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"165.624,-1953.79 160.991,-1943.85 165.557,-1948.79 165.49,-1943.79 165.49,-1943.79 165.49,-1943.79 165.557,-1948.79 169.99,-1943.73 165.624,-1953.79 165.624,-1953.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"193.5\" y=\"-1903.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3a_3x3 -->\n",
       "<g id=\"node19\" class=\"node\"><title>conv_in3a_3x3</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"214,-2164 120,-2164 120,-2106 214,-2106 214,-2164\"/>\n",
       "<text text-anchor=\"middle\" x=\"167\" y=\"-2138.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"167\" y=\"-2123.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 64</text>\n",
       "</g>\n",
       "<!-- conv_in3a_3x3&#45;&gt;relu_in3a_3x3_reduce -->\n",
       "<g id=\"edge18\" class=\"edge\"><title>conv_in3a_3x3&#45;&gt;relu_in3a_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M166.743,-2095.51C166.57,-2069.45 166.344,-2035.62 166.187,-2012.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"166.812,-2105.79 162.245,-2095.82 166.779,-2100.79 166.745,-2095.79 166.745,-2095.79 166.745,-2095.79 166.779,-2100.79 171.245,-2095.76 166.812,-2105.79 166.812,-2105.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"194.5\" y=\"-2055.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3a_3x3 -->\n",
       "<g id=\"node20\" class=\"node\"><title>bn_in3a_3x3</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"214,-2316 120,-2316 120,-2258 214,-2258 214,-2316\"/>\n",
       "<text text-anchor=\"middle\" x=\"167\" y=\"-2283.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3a_3x3&#45;&gt;conv_in3a_3x3 -->\n",
       "<g id=\"edge19\" class=\"edge\"><title>bn_in3a_3x3&#45;&gt;conv_in3a_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M167,-2247.51C167,-2221.45 167,-2187.62 167,-2164.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"167,-2257.79 162.5,-2247.79 167,-2252.79 167,-2247.79 167,-2247.79 167,-2247.79 167,-2252.79 171.5,-2247.79 167,-2257.79 167,-2257.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"194.5\" y=\"-2207.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3a_3x3 -->\n",
       "<g id=\"node21\" class=\"node\"><title>relu_in3a_3x3</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"214,-2468 120,-2468 120,-2410 214,-2410 214,-2468\"/>\n",
       "<text text-anchor=\"middle\" x=\"167\" y=\"-2442.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"167\" y=\"-2427.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3a_3x3&#45;&gt;bn_in3a_3x3 -->\n",
       "<g id=\"edge20\" class=\"edge\"><title>relu_in3a_3x3&#45;&gt;bn_in3a_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M167,-2399.51C167,-2373.45 167,-2339.62 167,-2316.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"167,-2409.79 162.5,-2399.79 167,-2404.79 167,-2399.79 167,-2399.79 167,-2399.79 167,-2404.79 171.5,-2399.79 167,-2409.79 167,-2409.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"194.5\" y=\"-2359.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3a_double_3x3_reduce -->\n",
       "<g id=\"node22\" class=\"node\"><title>conv_in3a_double_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"294,-1378 200,-1378 200,-1320 294,-1320 294,-1378\"/>\n",
       "<text text-anchor=\"middle\" x=\"247\" y=\"-1352.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"247\" y=\"-1337.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 64</text>\n",
       "</g>\n",
       "<!-- conv_in3a_double_3x3_reduce&#45;&gt;pool2 -->\n",
       "<g id=\"edge21\" class=\"edge\"><title>conv_in3a_double_3x3_reduce&#45;&gt;pool2</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M227.137,-1311.01C219.635,-1297.04 211.224,-1281.38 204.213,-1268.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"231.913,-1319.91 223.217,-1313.23 229.547,-1315.5 227.181,-1311.1 227.181,-1311.1 227.181,-1311.1 229.547,-1315.5 231.146,-1308.97 231.913,-1319.91 231.913,-1319.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"252.5\" y=\"-1290.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3a_double_3x3_reduce -->\n",
       "<g id=\"node23\" class=\"node\"><title>bn_in3a_double_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"332,-1488 238,-1488 238,-1430 332,-1430 332,-1488\"/>\n",
       "<text text-anchor=\"middle\" x=\"285\" y=\"-1455.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3a_double_3x3_reduce&#45;&gt;conv_in3a_double_3x3_reduce -->\n",
       "<g id=\"edge22\" class=\"edge\"><title>bn_in3a_double_3x3_reduce&#45;&gt;conv_in3a_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M271.705,-1420.21C266.862,-1406.45 261.473,-1391.13 256.967,-1378.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"275.115,-1429.91 267.551,-1421.97 273.456,-1425.19 271.796,-1420.47 271.796,-1420.47 271.796,-1420.47 273.456,-1425.19 276.041,-1418.98 275.115,-1429.91 275.115,-1429.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"296.5\" y=\"-1400.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3a_double_3x3_reduce -->\n",
       "<g id=\"node24\" class=\"node\"><title>relu_in3a_double_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"331,-1598 237,-1598 237,-1540 331,-1540 331,-1598\"/>\n",
       "<text text-anchor=\"middle\" x=\"284\" y=\"-1572.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"284\" y=\"-1557.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3a_double_3x3_reduce&#45;&gt;bn_in3a_double_3x3_reduce -->\n",
       "<g id=\"edge23\" class=\"edge\"><title>relu_in3a_double_3x3_reduce&#45;&gt;bn_in3a_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M284.354,-1529.81C284.48,-1516.15 284.62,-1501.01 284.738,-1488.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"284.26,-1539.91 279.853,-1529.86 284.306,-1534.91 284.353,-1529.91 284.353,-1529.91 284.353,-1529.91 284.306,-1534.91 288.853,-1529.95 284.26,-1539.91 284.26,-1539.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"312.5\" y=\"-1510.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3a_double_3x3_0 -->\n",
       "<g id=\"node25\" class=\"node\"><title>conv_in3a_double_3x3_0</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"331,-1750 237,-1750 237,-1692 331,-1692 331,-1750\"/>\n",
       "<text text-anchor=\"middle\" x=\"284\" y=\"-1724.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"284\" y=\"-1709.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 96</text>\n",
       "</g>\n",
       "<!-- conv_in3a_double_3x3_0&#45;&gt;relu_in3a_double_3x3_reduce -->\n",
       "<g id=\"edge24\" class=\"edge\"><title>conv_in3a_double_3x3_0&#45;&gt;relu_in3a_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M284,-1681.51C284,-1655.45 284,-1621.62 284,-1598.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"284,-1691.79 279.5,-1681.79 284,-1686.79 284,-1681.79 284,-1681.79 284,-1681.79 284,-1686.79 288.5,-1681.79 284,-1691.79 284,-1691.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"311.5\" y=\"-1641.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3a_double_3x3_0 -->\n",
       "<g id=\"node26\" class=\"node\"><title>bn_in3a_double_3x3_0</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"328,-1860 234,-1860 234,-1802 328,-1802 328,-1860\"/>\n",
       "<text text-anchor=\"middle\" x=\"281\" y=\"-1827.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3a_double_3x3_0&#45;&gt;conv_in3a_double_3x3_0 -->\n",
       "<g id=\"edge25\" class=\"edge\"><title>bn_in3a_double_3x3_0&#45;&gt;conv_in3a_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M282.061,-1791.81C282.44,-1778.15 282.861,-1763.01 283.213,-1750.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"281.78,-1801.91 277.56,-1791.79 281.919,-1796.91 282.058,-1791.91 282.058,-1791.91 282.058,-1791.91 281.919,-1796.91 286.556,-1792.04 281.78,-1801.91 281.78,-1801.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"310.5\" y=\"-1772.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3a_double_3x3_0 -->\n",
       "<g id=\"node27\" class=\"node\"><title>relu_in3a_double_3x3_0</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"327,-2012 233,-2012 233,-1954 327,-1954 327,-2012\"/>\n",
       "<text text-anchor=\"middle\" x=\"280\" y=\"-1986.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"280\" y=\"-1971.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3a_double_3x3_0&#45;&gt;bn_in3a_double_3x3_0 -->\n",
       "<g id=\"edge26\" class=\"edge\"><title>relu_in3a_double_3x3_0&#45;&gt;bn_in3a_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M277.314,-1943.73C277.189,-1941.12 277.082,-1938.52 277,-1936 276.161,-1910.24 275.882,-1903.75 277,-1878 277.25,-1872.23 277.676,-1866.07 278.159,-1860.19\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"277.869,-1953.79 272.826,-1944.06 277.594,-1948.8 277.319,-1943.81 277.319,-1943.81 277.319,-1943.81 277.594,-1948.8 281.812,-1943.56 277.869,-1953.79 277.869,-1953.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"304.5\" y=\"-1903.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3a_double_3x3_1 -->\n",
       "<g id=\"node28\" class=\"node\"><title>conv_in3a_double_3x3_1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"326,-2164 232,-2164 232,-2106 326,-2106 326,-2164\"/>\n",
       "<text text-anchor=\"middle\" x=\"279\" y=\"-2138.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"279\" y=\"-2123.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 96</text>\n",
       "</g>\n",
       "<!-- conv_in3a_double_3x3_1&#45;&gt;relu_in3a_double_3x3_0 -->\n",
       "<g id=\"edge27\" class=\"edge\"><title>conv_in3a_double_3x3_1&#45;&gt;relu_in3a_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M279.257,-2095.51C279.43,-2069.45 279.656,-2035.62 279.813,-2012.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"279.188,-2105.79 274.755,-2095.76 279.221,-2100.79 279.255,-2095.79 279.255,-2095.79 279.255,-2095.79 279.221,-2100.79 283.755,-2095.82 279.188,-2105.79 279.188,-2105.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"307.5\" y=\"-2055.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3a_double_3x3_1 -->\n",
       "<g id=\"node29\" class=\"node\"><title>bn_in3a_double_3x3_1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"326,-2316 232,-2316 232,-2258 326,-2258 326,-2316\"/>\n",
       "<text text-anchor=\"middle\" x=\"279\" y=\"-2283.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3a_double_3x3_1&#45;&gt;conv_in3a_double_3x3_1 -->\n",
       "<g id=\"edge28\" class=\"edge\"><title>bn_in3a_double_3x3_1&#45;&gt;conv_in3a_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M279,-2247.51C279,-2221.45 279,-2187.62 279,-2164.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"279,-2257.79 274.5,-2247.79 279,-2252.79 279,-2247.79 279,-2247.79 279,-2247.79 279,-2252.79 283.5,-2247.79 279,-2257.79 279,-2257.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"306.5\" y=\"-2207.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3a_double_3x3_1 -->\n",
       "<g id=\"node30\" class=\"node\"><title>relu_in3a_double_3x3_1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"326,-2468 232,-2468 232,-2410 326,-2410 326,-2468\"/>\n",
       "<text text-anchor=\"middle\" x=\"279\" y=\"-2442.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"279\" y=\"-2427.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3a_double_3x3_1&#45;&gt;bn_in3a_double_3x3_1 -->\n",
       "<g id=\"edge29\" class=\"edge\"><title>relu_in3a_double_3x3_1&#45;&gt;bn_in3a_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M279,-2399.51C279,-2373.45 279,-2339.62 279,-2316.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"279,-2409.79 274.5,-2399.79 279,-2404.79 279,-2399.79 279,-2399.79 279,-2399.79 279,-2404.79 283.5,-2399.79 279,-2409.79 279,-2409.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"306.5\" y=\"-2359.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- avg_pool_in3a_pool -->\n",
       "<g id=\"node31\" class=\"node\"><title>avg_pool_in3a_pool</title>\n",
       "<polygon fill=\"#80b1d3\" stroke=\"black\" points=\"435,-1936 341,-1936 341,-1878 435,-1878 435,-1936\"/>\n",
       "<text text-anchor=\"middle\" x=\"388\" y=\"-1910.8\" font-family=\"Times,serif\" font-size=\"14.00\">Pooling</text>\n",
       "<text text-anchor=\"middle\" x=\"388\" y=\"-1895.8\" font-family=\"Times,serif\" font-size=\"14.00\">avg, 3x3/1</text>\n",
       "</g>\n",
       "<!-- avg_pool_in3a_pool&#45;&gt;pool2 -->\n",
       "<g id=\"edge30\" class=\"edge\"><title>avg_pool_in3a_pool&#45;&gt;pool2</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M383.03,-1867.82C380.115,-1842.18 377,-1807.62 377,-1777 377,-1777 377,-1777 377,-1348 377,-1283.26 292.134,-1256.76 236.44,-1246.34\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"384.214,-1877.87 378.575,-1868.47 383.629,-1872.91 383.044,-1867.94 383.044,-1867.94 383.044,-1867.94 383.629,-1872.91 387.513,-1867.42 384.214,-1877.87 384.214,-1877.87\"/>\n",
       "<text text-anchor=\"middle\" x=\"407.5\" y=\"-1565.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3a_proj -->\n",
       "<g id=\"node32\" class=\"node\"><title>conv_in3a_proj</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"438,-2164 344,-2164 344,-2106 438,-2106 438,-2164\"/>\n",
       "<text text-anchor=\"middle\" x=\"391\" y=\"-2138.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"391\" y=\"-2123.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 32</text>\n",
       "</g>\n",
       "<!-- conv_in3a_proj&#45;&gt;avg_pool_in3a_pool -->\n",
       "<g id=\"edge31\" class=\"edge\"><title>conv_in3a_proj&#45;&gt;avg_pool_in3a_pool</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M390.493,-2095.83C389.894,-2050.64 388.909,-1976.45 388.374,-1936.17\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"390.626,-2105.83 385.994,-2095.89 390.56,-2100.83 390.493,-2095.83 390.493,-2095.83 390.493,-2095.83 390.56,-2100.83 394.993,-2095.78 390.626,-2105.83 390.626,-2105.83\"/>\n",
       "<text text-anchor=\"middle\" x=\"420.5\" y=\"-2055.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3a_proj -->\n",
       "<g id=\"node33\" class=\"node\"><title>bn_in3a_proj</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"438,-2316 344,-2316 344,-2258 438,-2258 438,-2316\"/>\n",
       "<text text-anchor=\"middle\" x=\"391\" y=\"-2283.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3a_proj&#45;&gt;conv_in3a_proj -->\n",
       "<g id=\"edge32\" class=\"edge\"><title>bn_in3a_proj&#45;&gt;conv_in3a_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M391,-2247.51C391,-2221.45 391,-2187.62 391,-2164.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"391,-2257.79 386.5,-2247.79 391,-2252.79 391,-2247.79 391,-2247.79 391,-2247.79 391,-2252.79 395.5,-2247.79 391,-2257.79 391,-2257.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"418.5\" y=\"-2207.3\" font-family=\"Times,serif\" font-size=\"14.00\">32x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3a_proj -->\n",
       "<g id=\"node34\" class=\"node\"><title>relu_in3a_proj</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"438,-2468 344,-2468 344,-2410 438,-2410 438,-2468\"/>\n",
       "<text text-anchor=\"middle\" x=\"391\" y=\"-2442.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"391\" y=\"-2427.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3a_proj&#45;&gt;bn_in3a_proj -->\n",
       "<g id=\"edge33\" class=\"edge\"><title>relu_in3a_proj&#45;&gt;bn_in3a_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M391,-2399.51C391,-2373.45 391,-2339.62 391,-2316.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"391,-2409.79 386.5,-2399.79 391,-2404.79 391,-2399.79 391,-2399.79 391,-2399.79 391,-2404.79 395.5,-2399.79 391,-2409.79 391,-2409.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"418.5\" y=\"-2359.3\" font-family=\"Times,serif\" font-size=\"14.00\">32x28x28</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3a_chconcat -->\n",
       "<g id=\"node35\" class=\"node\"><title>ch_concat_in3a_chconcat</title>\n",
       "<polygon fill=\"#fdb462\" stroke=\"black\" points=\"269,-2578 175,-2578 175,-2520 269,-2520 269,-2578\"/>\n",
       "<text text-anchor=\"middle\" x=\"222\" y=\"-2545.3\" font-family=\"Times,serif\" font-size=\"14.00\">Concat</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3a_chconcat&#45;&gt;relu_in3a_1x1 -->\n",
       "<g id=\"edge34\" class=\"edge\"><title>ch_concat_in3a_chconcat&#45;&gt;relu_in3a_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M165.249,-2527.98C151.573,-2521.25 137.807,-2512.67 127,-2502 95.5498,-2470.95 75.9769,-2422.6 66.0357,-2392.14\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"174.666,-2532.35 163.701,-2532.22 170.129,-2530.24 165.593,-2528.14 165.593,-2528.14 165.593,-2528.14 170.129,-2530.24 167.485,-2524.06 174.666,-2532.35 174.666,-2532.35\"/>\n",
       "<text text-anchor=\"middle\" x=\"154.5\" y=\"-2490.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3a_chconcat&#45;&gt;relu_in3a_3x3 -->\n",
       "<g id=\"edge35\" class=\"edge\"><title>ch_concat_in3a_chconcat&#45;&gt;relu_in3a_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M197.888,-2510.9C196.175,-2507.92 194.525,-2504.93 193,-2502 187.397,-2491.23 182.055,-2478.98 177.687,-2468.23\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"203.15,-2519.72 194.163,-2513.44 200.589,-2515.43 198.028,-2511.13 198.028,-2511.13 198.028,-2511.13 200.589,-2515.43 201.893,-2508.83 203.15,-2519.72 203.15,-2519.72\"/>\n",
       "<text text-anchor=\"middle\" x=\"220.5\" y=\"-2490.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3a_chconcat&#45;&gt;relu_in3a_double_3x3_1 -->\n",
       "<g id=\"edge36\" class=\"edge\"><title>ch_concat_in3a_chconcat&#45;&gt;relu_in3a_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M243.165,-2510.93C244.819,-2507.92 246.449,-2504.92 248,-2502 253.823,-2491.06 259.979,-2478.88 265.257,-2468.24\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"238.178,-2519.91 239.102,-2508.98 240.607,-2515.54 243.036,-2511.16 243.036,-2511.16 243.036,-2511.16 240.607,-2515.54 246.969,-2513.35 238.178,-2519.91 238.178,-2519.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"283.5\" y=\"-2490.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3a_chconcat&#45;&gt;relu_in3a_proj -->\n",
       "<g id=\"edge37\" class=\"edge\"><title>ch_concat_in3a_chconcat&#45;&gt;relu_in3a_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M277.985,-2522.85C290.464,-2516.56 303.42,-2509.45 315,-2502 330.465,-2492.05 346.407,-2479.46 359.673,-2468.23\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"269.009,-2527.29 275.979,-2518.82 273.491,-2525.07 277.974,-2522.86 277.974,-2522.86 277.974,-2522.86 273.491,-2525.07 279.968,-2526.89 269.009,-2527.29 269.009,-2527.29\"/>\n",
       "<text text-anchor=\"middle\" x=\"364.5\" y=\"-2490.3\" font-family=\"Times,serif\" font-size=\"14.00\">32x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3b_1x1 -->\n",
       "<g id=\"node36\" class=\"node\"><title>conv_in3b_1x1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"126,-3398 32,-3398 32,-3340 126,-3340 126,-3398\"/>\n",
       "<text text-anchor=\"middle\" x=\"79\" y=\"-3372.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"79\" y=\"-3357.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 64</text>\n",
       "</g>\n",
       "<!-- conv_in3b_1x1&#45;&gt;ch_concat_in3a_chconcat -->\n",
       "<g id=\"edge38\" class=\"edge\"><title>conv_in3b_1x1&#45;&gt;ch_concat_in3a_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M79.3963,-3329.66C79.6756,-3299.35 80,-3255.97 80,-3218 80,-3218 80,-3218 80,-2658 80,-2609.37 133.408,-2579.77 174.716,-2564.15\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"79.3,-3339.8 74.8952,-3329.76 79.3475,-3334.8 79.395,-3329.8 79.395,-3329.8 79.395,-3329.8 79.3475,-3334.8 83.8948,-3329.84 79.3,-3339.8 79.3,-3339.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"110.5\" y=\"-2951.3\" font-family=\"Times,serif\" font-size=\"14.00\">256x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3b_1x1 -->\n",
       "<g id=\"node37\" class=\"node\"><title>bn_in3b_1x1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"125,-3550 31,-3550 31,-3492 125,-3492 125,-3550\"/>\n",
       "<text text-anchor=\"middle\" x=\"78\" y=\"-3517.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3b_1x1&#45;&gt;conv_in3b_1x1 -->\n",
       "<g id=\"edge39\" class=\"edge\"><title>bn_in3b_1x1&#45;&gt;conv_in3b_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M78.2566,-3481.51C78.4303,-3455.45 78.6559,-3421.62 78.8128,-3398.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"78.1881,-3491.79 73.755,-3481.76 78.2215,-3486.79 78.2549,-3481.79 78.2549,-3481.79 78.2549,-3481.79 78.2215,-3486.79 82.7548,-3481.82 78.1881,-3491.79 78.1881,-3491.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"106.5\" y=\"-3441.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3b_1x1 -->\n",
       "<g id=\"node38\" class=\"node\"><title>relu_in3b_1x1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"143,-3702 49,-3702 49,-3644 143,-3644 143,-3702\"/>\n",
       "<text text-anchor=\"middle\" x=\"96\" y=\"-3676.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"96\" y=\"-3661.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3b_1x1&#45;&gt;bn_in3b_1x1 -->\n",
       "<g id=\"edge40\" class=\"edge\"><title>relu_in3b_1x1&#45;&gt;bn_in3b_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M88.1991,-3633.77C87.7626,-3631.15 87.3571,-3628.54 87,-3626 83.4148,-3600.52 81.0378,-3571.3 79.6318,-3550.34\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"90.0003,-3643.86 83.8124,-3634.81 89.1213,-3638.94 88.2424,-3634.02 88.2424,-3634.02 88.2424,-3634.02 89.1213,-3638.94 92.6723,-3633.23 90.0003,-3643.86 90.0003,-3643.86\"/>\n",
       "<text text-anchor=\"middle\" x=\"114.5\" y=\"-3593.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3b_3x3_reduce -->\n",
       "<g id=\"node39\" class=\"node\"><title>conv_in3b_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"240,-2984 146,-2984 146,-2926 240,-2926 240,-2984\"/>\n",
       "<text text-anchor=\"middle\" x=\"193\" y=\"-2958.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"193\" y=\"-2943.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 64</text>\n",
       "</g>\n",
       "<!-- conv_in3b_3x3_reduce&#45;&gt;ch_concat_in3a_chconcat -->\n",
       "<g id=\"edge41\" class=\"edge\"><title>conv_in3b_3x3_reduce&#45;&gt;ch_concat_in3a_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M192.548,-2915.75C192.283,-2890.08 192,-2855.51 192,-2825 192,-2825 192,-2825 192,-2658 192,-2630.17 201.361,-2599.73 209.625,-2578.29\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"192.656,-2925.82 188.049,-2915.86 192.602,-2920.82 192.549,-2915.82 192.549,-2915.82 192.549,-2915.82 192.602,-2920.82 197.049,-2915.77 192.656,-2925.82 192.656,-2925.82\"/>\n",
       "<text text-anchor=\"middle\" x=\"222.5\" y=\"-2765.3\" font-family=\"Times,serif\" font-size=\"14.00\">256x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3b_3x3_reduce -->\n",
       "<g id=\"node40\" class=\"node\"><title>bn_in3b_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"240,-3170 146,-3170 146,-3112 240,-3112 240,-3170\"/>\n",
       "<text text-anchor=\"middle\" x=\"193\" y=\"-3137.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3b_3x3_reduce&#45;&gt;conv_in3b_3x3_reduce -->\n",
       "<g id=\"edge42\" class=\"edge\"><title>bn_in3b_3x3_reduce&#45;&gt;conv_in3b_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M193,-3101.32C193,-3066.25 193,-3015.39 193,-2984.08\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"193,-3111.65 188.5,-3101.65 193,-3106.65 193,-3101.65 193,-3101.65 193,-3101.65 193,-3106.65 197.5,-3101.65 193,-3111.65 193,-3111.65\"/>\n",
       "<text text-anchor=\"middle\" x=\"220.5\" y=\"-3082.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3b_3x3_reduce -->\n",
       "<g id=\"node41\" class=\"node\"><title>relu_in3b_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"243,-3322 149,-3322 149,-3264 243,-3264 243,-3322\"/>\n",
       "<text text-anchor=\"middle\" x=\"196\" y=\"-3296.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"196\" y=\"-3281.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3b_3x3_reduce&#45;&gt;bn_in3b_3x3_reduce -->\n",
       "<g id=\"edge43\" class=\"edge\"><title>relu_in3b_3x3_reduce&#45;&gt;bn_in3b_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M195.23,-3253.51C194.709,-3227.45 194.032,-3193.62 193.562,-3170.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"195.436,-3263.79 190.737,-3253.88 195.336,-3258.79 195.236,-3253.79 195.236,-3253.79 195.236,-3253.79 195.336,-3258.79 199.735,-3253.7 195.436,-3263.79 195.436,-3263.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"223.5\" y=\"-3213.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3b_3x3 -->\n",
       "<g id=\"node42\" class=\"node\"><title>conv_in3b_3x3</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"245,-3474 151,-3474 151,-3416 245,-3416 245,-3474\"/>\n",
       "<text text-anchor=\"middle\" x=\"198\" y=\"-3448.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"198\" y=\"-3433.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 96</text>\n",
       "</g>\n",
       "<!-- conv_in3b_3x3&#45;&gt;relu_in3b_3x3_reduce -->\n",
       "<g id=\"edge44\" class=\"edge\"><title>conv_in3b_3x3&#45;&gt;relu_in3b_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M197.487,-3405.51C197.139,-3379.45 196.688,-3345.62 196.374,-3322.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"197.624,-3415.79 192.991,-3405.85 197.557,-3410.79 197.49,-3405.79 197.49,-3405.79 197.49,-3405.79 197.557,-3410.79 201.99,-3405.73 197.624,-3415.79 197.624,-3415.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"225.5\" y=\"-3365.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3b_3x3 -->\n",
       "<g id=\"node43\" class=\"node\"><title>bn_in3b_3x3</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"245,-3626 151,-3626 151,-3568 245,-3568 245,-3626\"/>\n",
       "<text text-anchor=\"middle\" x=\"198\" y=\"-3593.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3b_3x3&#45;&gt;conv_in3b_3x3 -->\n",
       "<g id=\"edge45\" class=\"edge\"><title>bn_in3b_3x3&#45;&gt;conv_in3b_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M198,-3557.51C198,-3531.45 198,-3497.62 198,-3474.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"198,-3567.79 193.5,-3557.79 198,-3562.79 198,-3557.79 198,-3557.79 198,-3557.79 198,-3562.79 202.5,-3557.79 198,-3567.79 198,-3567.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"225.5\" y=\"-3517.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3b_3x3 -->\n",
       "<g id=\"node44\" class=\"node\"><title>relu_in3b_3x3</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"245,-3778 151,-3778 151,-3720 245,-3720 245,-3778\"/>\n",
       "<text text-anchor=\"middle\" x=\"198\" y=\"-3752.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"198\" y=\"-3737.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3b_3x3&#45;&gt;bn_in3b_3x3 -->\n",
       "<g id=\"edge46\" class=\"edge\"><title>relu_in3b_3x3&#45;&gt;bn_in3b_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M198,-3709.51C198,-3683.45 198,-3649.62 198,-3626.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"198,-3719.79 193.5,-3709.79 198,-3714.79 198,-3709.79 198,-3709.79 198,-3709.79 198,-3714.79 202.5,-3709.79 198,-3719.79 198,-3719.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"225.5\" y=\"-3669.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3b_double_3x3_reduce -->\n",
       "<g id=\"node45\" class=\"node\"><title>conv_in3b_double_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"327,-2688 233,-2688 233,-2630 327,-2630 327,-2688\"/>\n",
       "<text text-anchor=\"middle\" x=\"280\" y=\"-2662.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"280\" y=\"-2647.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 64</text>\n",
       "</g>\n",
       "<!-- conv_in3b_double_3x3_reduce&#45;&gt;ch_concat_in3a_chconcat -->\n",
       "<g id=\"edge47\" class=\"edge\"><title>conv_in3b_double_3x3_reduce&#45;&gt;ch_concat_in3a_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M260.137,-2621.01C252.635,-2607.04 244.224,-2591.38 237.213,-2578.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"264.913,-2629.91 256.217,-2623.23 262.547,-2625.5 260.181,-2621.1 260.181,-2621.1 260.181,-2621.1 262.547,-2625.5 264.146,-2618.97 264.913,-2629.91 264.913,-2629.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"285.5\" y=\"-2600.3\" font-family=\"Times,serif\" font-size=\"14.00\">256x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3b_double_3x3_reduce -->\n",
       "<g id=\"node46\" class=\"node\"><title>bn_in3b_double_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"365,-2798 271,-2798 271,-2740 365,-2740 365,-2798\"/>\n",
       "<text text-anchor=\"middle\" x=\"318\" y=\"-2765.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3b_double_3x3_reduce&#45;&gt;conv_in3b_double_3x3_reduce -->\n",
       "<g id=\"edge48\" class=\"edge\"><title>bn_in3b_double_3x3_reduce&#45;&gt;conv_in3b_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M304.705,-2730.21C299.862,-2716.45 294.473,-2701.13 289.967,-2688.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"308.115,-2739.91 300.551,-2731.97 306.456,-2735.19 304.796,-2730.47 304.796,-2730.47 304.796,-2730.47 306.456,-2735.19 309.041,-2728.98 308.115,-2739.91 308.115,-2739.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"329.5\" y=\"-2710.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3b_double_3x3_reduce -->\n",
       "<g id=\"node47\" class=\"node\"><title>relu_in3b_double_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"365,-2908 271,-2908 271,-2850 365,-2850 365,-2908\"/>\n",
       "<text text-anchor=\"middle\" x=\"318\" y=\"-2882.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"318\" y=\"-2867.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3b_double_3x3_reduce&#45;&gt;bn_in3b_double_3x3_reduce -->\n",
       "<g id=\"edge49\" class=\"edge\"><title>relu_in3b_double_3x3_reduce&#45;&gt;bn_in3b_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M318,-2839.81C318,-2826.15 318,-2811.01 318,-2798.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"318,-2849.91 313.5,-2839.91 318,-2844.91 318,-2839.91 318,-2839.91 318,-2839.91 318,-2844.91 322.5,-2839.91 318,-2849.91 318,-2849.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"345.5\" y=\"-2820.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3b_double_3x3_0 -->\n",
       "<g id=\"node48\" class=\"node\"><title>conv_in3b_double_3x3_0</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"364,-3060 270,-3060 270,-3002 364,-3002 364,-3060\"/>\n",
       "<text text-anchor=\"middle\" x=\"317\" y=\"-3034.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"317\" y=\"-3019.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 96</text>\n",
       "</g>\n",
       "<!-- conv_in3b_double_3x3_0&#45;&gt;relu_in3b_double_3x3_reduce -->\n",
       "<g id=\"edge50\" class=\"edge\"><title>conv_in3b_double_3x3_0&#45;&gt;relu_in3b_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M317.257,-2991.51C317.43,-2965.45 317.656,-2931.62 317.813,-2908.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"317.188,-3001.79 312.755,-2991.76 317.221,-2996.79 317.255,-2991.79 317.255,-2991.79 317.255,-2991.79 317.221,-2996.79 321.755,-2991.82 317.188,-3001.79 317.188,-3001.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"345.5\" y=\"-2951.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3b_double_3x3_0 -->\n",
       "<g id=\"node49\" class=\"node\"><title>bn_in3b_double_3x3_0</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"363,-3170 269,-3170 269,-3112 363,-3112 363,-3170\"/>\n",
       "<text text-anchor=\"middle\" x=\"316\" y=\"-3137.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3b_double_3x3_0&#45;&gt;conv_in3b_double_3x3_0 -->\n",
       "<g id=\"edge51\" class=\"edge\"><title>bn_in3b_double_3x3_0&#45;&gt;conv_in3b_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M316.354,-3101.81C316.48,-3088.15 316.62,-3073.01 316.738,-3060.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"316.26,-3111.91 311.853,-3101.86 316.306,-3106.91 316.353,-3101.91 316.353,-3101.91 316.353,-3101.91 316.306,-3106.91 320.853,-3101.95 316.26,-3111.91 316.26,-3111.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"344.5\" y=\"-3082.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3b_double_3x3_0 -->\n",
       "<g id=\"node50\" class=\"node\"><title>relu_in3b_double_3x3_0</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"360,-3322 266,-3322 266,-3264 360,-3264 360,-3322\"/>\n",
       "<text text-anchor=\"middle\" x=\"313\" y=\"-3296.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"313\" y=\"-3281.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3b_double_3x3_0&#45;&gt;bn_in3b_double_3x3_0 -->\n",
       "<g id=\"edge52\" class=\"edge\"><title>relu_in3b_double_3x3_0&#45;&gt;bn_in3b_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M309.44,-3253.62C308.146,-3233.97 307.359,-3209.69 309,-3188 309.439,-3182.2 310.184,-3176.02 311.03,-3170.14\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"310.175,-3263.72 304.961,-3254.07 309.812,-3258.73 309.449,-3253.74 309.449,-3253.74 309.449,-3253.74 309.812,-3258.73 313.937,-3253.42 310.175,-3263.72 310.175,-3263.72\"/>\n",
       "<text text-anchor=\"middle\" x=\"336.5\" y=\"-3213.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3b_double_3x3_1 -->\n",
       "<g id=\"node51\" class=\"node\"><title>conv_in3b_double_3x3_1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"357,-3474 263,-3474 263,-3416 357,-3416 357,-3474\"/>\n",
       "<text text-anchor=\"middle\" x=\"310\" y=\"-3448.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"310\" y=\"-3433.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 96</text>\n",
       "</g>\n",
       "<!-- conv_in3b_double_3x3_1&#45;&gt;relu_in3b_double_3x3_0 -->\n",
       "<g id=\"edge53\" class=\"edge\"><title>conv_in3b_double_3x3_1&#45;&gt;relu_in3b_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M310.77,-3405.51C311.291,-3379.45 311.968,-3345.62 312.438,-3322.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"310.564,-3415.79 306.265,-3405.7 310.664,-3410.79 310.764,-3405.79 310.764,-3405.79 310.764,-3405.79 310.664,-3410.79 315.263,-3405.88 310.564,-3415.79 310.564,-3415.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"340.5\" y=\"-3365.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3b_double_3x3_1 -->\n",
       "<g id=\"node52\" class=\"node\"><title>bn_in3b_double_3x3_1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"357,-3626 263,-3626 263,-3568 357,-3568 357,-3626\"/>\n",
       "<text text-anchor=\"middle\" x=\"310\" y=\"-3593.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3b_double_3x3_1&#45;&gt;conv_in3b_double_3x3_1 -->\n",
       "<g id=\"edge54\" class=\"edge\"><title>bn_in3b_double_3x3_1&#45;&gt;conv_in3b_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M310,-3557.51C310,-3531.45 310,-3497.62 310,-3474.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"310,-3567.79 305.5,-3557.79 310,-3562.79 310,-3557.79 310,-3557.79 310,-3557.79 310,-3562.79 314.5,-3557.79 310,-3567.79 310,-3567.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"337.5\" y=\"-3517.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3b_double_3x3_1 -->\n",
       "<g id=\"node53\" class=\"node\"><title>relu_in3b_double_3x3_1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"357,-3778 263,-3778 263,-3720 357,-3720 357,-3778\"/>\n",
       "<text text-anchor=\"middle\" x=\"310\" y=\"-3752.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"310\" y=\"-3737.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3b_double_3x3_1&#45;&gt;bn_in3b_double_3x3_1 -->\n",
       "<g id=\"edge55\" class=\"edge\"><title>relu_in3b_double_3x3_1&#45;&gt;bn_in3b_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M310,-3709.51C310,-3683.45 310,-3649.62 310,-3626.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"310,-3719.79 305.5,-3709.79 310,-3714.79 310,-3709.79 310,-3709.79 310,-3709.79 310,-3714.79 314.5,-3709.79 310,-3719.79 310,-3719.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"337.5\" y=\"-3669.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- avg_pool_in3b_pool -->\n",
       "<g id=\"node54\" class=\"node\"><title>avg_pool_in3b_pool</title>\n",
       "<polygon fill=\"#80b1d3\" stroke=\"black\" points=\"467,-3246 373,-3246 373,-3188 467,-3188 467,-3246\"/>\n",
       "<text text-anchor=\"middle\" x=\"420\" y=\"-3220.8\" font-family=\"Times,serif\" font-size=\"14.00\">Pooling</text>\n",
       "<text text-anchor=\"middle\" x=\"420\" y=\"-3205.8\" font-family=\"Times,serif\" font-size=\"14.00\">avg, 3x3/1</text>\n",
       "</g>\n",
       "<!-- avg_pool_in3b_pool&#45;&gt;ch_concat_in3a_chconcat -->\n",
       "<g id=\"edge56\" class=\"edge\"><title>avg_pool_in3b_pool&#45;&gt;ch_concat_in3a_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M415.482,-3177.81C412.832,-3152.16 410,-3117.6 410,-3087 410,-3087 410,-3087 410,-2658 410,-2593.26 325.134,-2566.76 269.44,-2556.34\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"416.559,-3187.86 411.019,-3178.4 416.026,-3182.89 415.494,-3177.92 415.494,-3177.92 415.494,-3177.92 416.026,-3182.89 419.968,-3177.44 416.559,-3187.86 416.559,-3187.86\"/>\n",
       "<text text-anchor=\"middle\" x=\"440.5\" y=\"-2875.3\" font-family=\"Times,serif\" font-size=\"14.00\">256x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3b_proj -->\n",
       "<g id=\"node55\" class=\"node\"><title>conv_in3b_proj</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"469,-3474 375,-3474 375,-3416 469,-3416 469,-3474\"/>\n",
       "<text text-anchor=\"middle\" x=\"422\" y=\"-3448.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"422\" y=\"-3433.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 64</text>\n",
       "</g>\n",
       "<!-- conv_in3b_proj&#45;&gt;avg_pool_in3b_pool -->\n",
       "<g id=\"edge57\" class=\"edge\"><title>conv_in3b_proj&#45;&gt;avg_pool_in3b_pool</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M421.662,-3405.83C421.262,-3360.64 420.606,-3286.45 420.249,-3246.17\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"421.751,-3415.83 417.162,-3405.87 421.706,-3410.83 421.662,-3405.83 421.662,-3405.83 421.662,-3405.83 421.706,-3410.83 426.162,-3405.79 421.751,-3415.83 421.751,-3415.83\"/>\n",
       "<text text-anchor=\"middle\" x=\"451.5\" y=\"-3365.3\" font-family=\"Times,serif\" font-size=\"14.00\">256x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3b_proj -->\n",
       "<g id=\"node56\" class=\"node\"><title>bn_in3b_proj</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"469,-3626 375,-3626 375,-3568 469,-3568 469,-3626\"/>\n",
       "<text text-anchor=\"middle\" x=\"422\" y=\"-3593.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3b_proj&#45;&gt;conv_in3b_proj -->\n",
       "<g id=\"edge58\" class=\"edge\"><title>bn_in3b_proj&#45;&gt;conv_in3b_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M422,-3557.51C422,-3531.45 422,-3497.62 422,-3474.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"422,-3567.79 417.5,-3557.79 422,-3562.79 422,-3557.79 422,-3557.79 422,-3557.79 422,-3562.79 426.5,-3557.79 422,-3567.79 422,-3567.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"449.5\" y=\"-3517.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3b_proj -->\n",
       "<g id=\"node57\" class=\"node\"><title>relu_in3b_proj</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"469,-3778 375,-3778 375,-3720 469,-3720 469,-3778\"/>\n",
       "<text text-anchor=\"middle\" x=\"422\" y=\"-3752.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"422\" y=\"-3737.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3b_proj&#45;&gt;bn_in3b_proj -->\n",
       "<g id=\"edge59\" class=\"edge\"><title>relu_in3b_proj&#45;&gt;bn_in3b_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M422,-3709.51C422,-3683.45 422,-3649.62 422,-3626.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"422,-3719.79 417.5,-3709.79 422,-3714.79 422,-3709.79 422,-3709.79 422,-3709.79 422,-3714.79 426.5,-3709.79 422,-3719.79 422,-3719.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"449.5\" y=\"-3669.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3b_chconcat -->\n",
       "<g id=\"node58\" class=\"node\"><title>ch_concat_in3b_chconcat</title>\n",
       "<polygon fill=\"#fdb462\" stroke=\"black\" points=\"297,-3888 203,-3888 203,-3830 297,-3830 297,-3888\"/>\n",
       "<text text-anchor=\"middle\" x=\"250\" y=\"-3855.3\" font-family=\"Times,serif\" font-size=\"14.00\">Concat</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3b_chconcat&#45;&gt;relu_in3b_1x1 -->\n",
       "<g id=\"edge60\" class=\"edge\"><title>ch_concat_in3b_chconcat&#45;&gt;relu_in3b_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M193.386,-3840.46C178.096,-3833.55 162.593,-3824.26 151,-3812 121.759,-3781.08 107.363,-3732.69 100.824,-3702.2\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"202.842,-3844.46 191.879,-3844.71 198.237,-3842.52 193.632,-3840.57 193.632,-3840.57 193.632,-3840.57 198.237,-3842.52 195.385,-3836.42 202.842,-3844.46 202.842,-3844.46\"/>\n",
       "<text text-anchor=\"middle\" x=\"178.5\" y=\"-3800.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3b_chconcat&#45;&gt;relu_in3b_3x3 -->\n",
       "<g id=\"edge61\" class=\"edge\"><title>ch_concat_in3b_chconcat&#45;&gt;relu_in3b_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M221.19,-3821.33C219.303,-3818.25 217.544,-3815.12 216,-3812 210.78,-3801.45 206.814,-3789.13 203.952,-3778.26\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"226.768,-3829.8 217.513,-3823.92 224.02,-3825.63 221.272,-3821.45 221.272,-3821.45 221.272,-3821.45 224.02,-3825.63 225.031,-3818.98 226.768,-3829.8 226.768,-3829.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"243.5\" y=\"-3800.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3b_chconcat&#45;&gt;relu_in3b_double_3x3_1 -->\n",
       "<g id=\"edge62\" class=\"edge\"><title>ch_concat_in3b_chconcat&#45;&gt;relu_in3b_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M270.547,-3821.01C278.309,-3807.04 287.01,-3791.38 294.262,-3778.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"265.608,-3829.91 266.53,-3818.98 268.036,-3825.54 270.464,-3821.16 270.464,-3821.16 270.464,-3821.16 268.036,-3825.54 274.398,-3823.35 265.608,-3829.91 265.608,-3829.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"311.5\" y=\"-3800.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3b_chconcat&#45;&gt;relu_in3b_proj -->\n",
       "<g id=\"edge63\" class=\"edge\"><title>ch_concat_in3b_chconcat&#45;&gt;relu_in3b_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M306.636,-3832.31C318.888,-3826.12 331.585,-3819.19 343,-3812 358.93,-3801.96 375.479,-3789.36 389.29,-3778.14\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"297.383,-3836.9 304.344,-3828.42 301.863,-3834.68 306.343,-3832.46 306.343,-3832.46 306.343,-3832.46 301.863,-3834.68 308.341,-3836.49 297.383,-3836.9 297.383,-3836.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"393.5\" y=\"-3800.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3c_3x3_reduce -->\n",
       "<g id=\"node59\" class=\"node\"><title>conv_in3c_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"171,-4336 77,-4336 77,-4278 171,-4278 171,-4336\"/>\n",
       "<text text-anchor=\"middle\" x=\"124\" y=\"-4310.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"124\" y=\"-4295.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 128</text>\n",
       "</g>\n",
       "<!-- conv_in3c_3x3_reduce&#45;&gt;ch_concat_in3b_chconcat -->\n",
       "<g id=\"edge64\" class=\"edge\"><title>conv_in3c_3x3_reduce&#45;&gt;ch_concat_in3b_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M124,-4267.66C124,-4237.35 124,-4193.97 124,-4156 124,-4156 124,-4156 124,-3968 124,-3924.93 166.971,-3895.33 202.724,-3878.16\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"124,-4277.8 119.5,-4267.8 124,-4272.8 124,-4267.8 124,-4267.8 124,-4267.8 124,-4272.8 128.5,-4267.8 124,-4277.8 124,-4277.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"154.5\" y=\"-4075.3\" font-family=\"Times,serif\" font-size=\"14.00\">320x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3c_3x3_reduce -->\n",
       "<g id=\"node60\" class=\"node\"><title>bn_in3c_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"171,-4488 77,-4488 77,-4430 171,-4430 171,-4488\"/>\n",
       "<text text-anchor=\"middle\" x=\"124\" y=\"-4455.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3c_3x3_reduce&#45;&gt;conv_in3c_3x3_reduce -->\n",
       "<g id=\"edge65\" class=\"edge\"><title>bn_in3c_3x3_reduce&#45;&gt;conv_in3c_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M124,-4419.51C124,-4393.45 124,-4359.62 124,-4336.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"124,-4429.79 119.5,-4419.79 124,-4424.79 124,-4419.79 124,-4419.79 124,-4419.79 124,-4424.79 128.5,-4419.79 124,-4429.79 124,-4429.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"154.5\" y=\"-4379.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3c_3x3_reduce -->\n",
       "<g id=\"node61\" class=\"node\"><title>relu_in3c_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"171,-4640 77,-4640 77,-4582 171,-4582 171,-4640\"/>\n",
       "<text text-anchor=\"middle\" x=\"124\" y=\"-4614.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"124\" y=\"-4599.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3c_3x3_reduce&#45;&gt;bn_in3c_3x3_reduce -->\n",
       "<g id=\"edge66\" class=\"edge\"><title>relu_in3c_3x3_reduce&#45;&gt;bn_in3c_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M124,-4571.51C124,-4545.45 124,-4511.62 124,-4488.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"124,-4581.79 119.5,-4571.79 124,-4576.79 124,-4571.79 124,-4571.79 124,-4571.79 124,-4576.79 128.5,-4571.79 124,-4581.79 124,-4581.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"154.5\" y=\"-4531.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3c_3x3 -->\n",
       "<g id=\"node62\" class=\"node\"><title>conv_in3c_3x3</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"171,-4792 77,-4792 77,-4734 171,-4734 171,-4792\"/>\n",
       "<text text-anchor=\"middle\" x=\"124\" y=\"-4766.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"124\" y=\"-4751.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/2, 160</text>\n",
       "</g>\n",
       "<!-- conv_in3c_3x3&#45;&gt;relu_in3c_3x3_reduce -->\n",
       "<g id=\"edge67\" class=\"edge\"><title>conv_in3c_3x3&#45;&gt;relu_in3c_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M124,-4723.51C124,-4697.45 124,-4663.62 124,-4640.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"124,-4733.79 119.5,-4723.79 124,-4728.79 124,-4723.79 124,-4723.79 124,-4723.79 124,-4728.79 128.5,-4723.79 124,-4733.79 124,-4733.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"154.5\" y=\"-4683.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3c_3x3 -->\n",
       "<g id=\"node63\" class=\"node\"><title>bn_in3c_3x3</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"171,-4944 77,-4944 77,-4886 171,-4886 171,-4944\"/>\n",
       "<text text-anchor=\"middle\" x=\"124\" y=\"-4911.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3c_3x3&#45;&gt;conv_in3c_3x3 -->\n",
       "<g id=\"edge68\" class=\"edge\"><title>bn_in3c_3x3&#45;&gt;conv_in3c_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M124,-4875.51C124,-4849.45 124,-4815.62 124,-4792.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"124,-4885.79 119.5,-4875.79 124,-4880.79 124,-4875.79 124,-4875.79 124,-4875.79 124,-4880.79 128.5,-4875.79 124,-4885.79 124,-4885.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"154.5\" y=\"-4835.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in3c_3x3 -->\n",
       "<g id=\"node64\" class=\"node\"><title>relu_in3c_3x3</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"181,-5096 87,-5096 87,-5038 181,-5038 181,-5096\"/>\n",
       "<text text-anchor=\"middle\" x=\"134\" y=\"-5070.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"134\" y=\"-5055.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3c_3x3&#45;&gt;bn_in3c_3x3 -->\n",
       "<g id=\"edge69\" class=\"edge\"><title>relu_in3c_3x3&#45;&gt;bn_in3c_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M131.434,-5027.51C129.697,-5001.45 127.441,-4967.62 125.872,-4944.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"132.119,-5037.79 126.964,-5028.11 131.786,-5032.8 131.454,-5027.81 131.454,-5027.81 131.454,-5027.81 131.786,-5032.8 135.944,-5027.51 132.119,-5037.79 132.119,-5037.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"161.5\" y=\"-4987.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in3c_double_3x3_reduce -->\n",
       "<g id=\"node65\" class=\"node\"><title>conv_in3c_double_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"297,-3998 203,-3998 203,-3940 297,-3940 297,-3998\"/>\n",
       "<text text-anchor=\"middle\" x=\"250\" y=\"-3972.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"250\" y=\"-3957.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 64</text>\n",
       "</g>\n",
       "<!-- conv_in3c_double_3x3_reduce&#45;&gt;ch_concat_in3b_chconcat -->\n",
       "<g id=\"edge70\" class=\"edge\"><title>conv_in3c_double_3x3_reduce&#45;&gt;ch_concat_in3b_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M250,-3929.81C250,-3916.15 250,-3901.01 250,-3888.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"250,-3939.91 245.5,-3929.91 250,-3934.91 250,-3929.91 250,-3929.91 250,-3929.91 250,-3934.91 254.5,-3929.91 250,-3939.91 250,-3939.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"280.5\" y=\"-3910.3\" font-family=\"Times,serif\" font-size=\"14.00\">320x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3c_double_3x3_reduce -->\n",
       "<g id=\"node66\" class=\"node\"><title>bn_in3c_double_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"297,-4108 203,-4108 203,-4050 297,-4050 297,-4108\"/>\n",
       "<text text-anchor=\"middle\" x=\"250\" y=\"-4075.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3c_double_3x3_reduce&#45;&gt;conv_in3c_double_3x3_reduce -->\n",
       "<g id=\"edge71\" class=\"edge\"><title>bn_in3c_double_3x3_reduce&#45;&gt;conv_in3c_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M250,-4039.81C250,-4026.15 250,-4011.01 250,-3998.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"250,-4049.91 245.5,-4039.91 250,-4044.91 250,-4039.91 250,-4039.91 250,-4039.91 250,-4044.91 254.5,-4039.91 250,-4049.91 250,-4049.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"277.5\" y=\"-4020.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3c_double_3x3_reduce -->\n",
       "<g id=\"node67\" class=\"node\"><title>relu_in3c_double_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"276,-4260 182,-4260 182,-4202 276,-4202 276,-4260\"/>\n",
       "<text text-anchor=\"middle\" x=\"229\" y=\"-4234.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"229\" y=\"-4219.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3c_double_3x3_reduce&#45;&gt;bn_in3c_double_3x3_reduce -->\n",
       "<g id=\"edge72\" class=\"edge\"><title>relu_in3c_double_3x3_reduce&#45;&gt;bn_in3c_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M221.017,-4191.74C218.3,-4171.82 217.224,-4147.25 223,-4126 224.652,-4119.92 227.331,-4113.83 230.375,-4108.16\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"222.56,-4201.69 216.581,-4192.49 221.794,-4196.75 221.028,-4191.8 221.028,-4191.8 221.028,-4191.8 221.794,-4196.75 225.475,-4191.12 222.56,-4201.69 222.56,-4201.69\"/>\n",
       "<text text-anchor=\"middle\" x=\"250.5\" y=\"-4151.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3c_double_3x3_0 -->\n",
       "<g id=\"node68\" class=\"node\"><title>conv_in3c_double_3x3_0</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"297,-4412 203,-4412 203,-4354 297,-4354 297,-4412\"/>\n",
       "<text text-anchor=\"middle\" x=\"250\" y=\"-4386.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"250\" y=\"-4371.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 96</text>\n",
       "</g>\n",
       "<!-- conv_in3c_double_3x3_0&#45;&gt;relu_in3c_double_3x3_reduce -->\n",
       "<g id=\"edge73\" class=\"edge\"><title>conv_in3c_double_3x3_0&#45;&gt;relu_in3c_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M244.659,-4343.85C241.005,-4317.75 236.242,-4283.73 232.932,-4260.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"246.05,-4353.79 240.207,-4344.51 245.357,-4348.83 244.663,-4343.88 244.663,-4343.88 244.663,-4343.88 245.357,-4348.83 249.12,-4343.26 246.05,-4353.79 246.05,-4353.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"271.5\" y=\"-4303.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3c_double_3x3_0 -->\n",
       "<g id=\"node69\" class=\"node\"><title>bn_in3c_double_3x3_0</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"297,-4564 203,-4564 203,-4506 297,-4506 297,-4564\"/>\n",
       "<text text-anchor=\"middle\" x=\"250\" y=\"-4531.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3c_double_3x3_0&#45;&gt;conv_in3c_double_3x3_0 -->\n",
       "<g id=\"edge74\" class=\"edge\"><title>bn_in3c_double_3x3_0&#45;&gt;conv_in3c_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M250,-4495.51C250,-4469.45 250,-4435.62 250,-4412.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"250,-4505.79 245.5,-4495.79 250,-4500.79 250,-4495.79 250,-4495.79 250,-4495.79 250,-4500.79 254.5,-4495.79 250,-4505.79 250,-4505.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"277.5\" y=\"-4455.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- relu_in3c_double_3x3_0 -->\n",
       "<g id=\"node70\" class=\"node\"><title>relu_in3c_double_3x3_0</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"297,-4716 203,-4716 203,-4658 297,-4658 297,-4716\"/>\n",
       "<text text-anchor=\"middle\" x=\"250\" y=\"-4690.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"250\" y=\"-4675.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3c_double_3x3_0&#45;&gt;bn_in3c_double_3x3_0 -->\n",
       "<g id=\"edge75\" class=\"edge\"><title>relu_in3c_double_3x3_0&#45;&gt;bn_in3c_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M250,-4647.51C250,-4621.45 250,-4587.62 250,-4564.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"250,-4657.79 245.5,-4647.79 250,-4652.79 250,-4647.79 250,-4647.79 250,-4647.79 250,-4652.79 254.5,-4647.79 250,-4657.79 250,-4657.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"277.5\" y=\"-4607.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- conv_in3c_double_3x3_1 -->\n",
       "<g id=\"node71\" class=\"node\"><title>conv_in3c_double_3x3_1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"297,-4868 203,-4868 203,-4810 297,-4810 297,-4868\"/>\n",
       "<text text-anchor=\"middle\" x=\"250\" y=\"-4842.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"250\" y=\"-4827.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/2, 96</text>\n",
       "</g>\n",
       "<!-- conv_in3c_double_3x3_1&#45;&gt;relu_in3c_double_3x3_0 -->\n",
       "<g id=\"edge76\" class=\"edge\"><title>conv_in3c_double_3x3_1&#45;&gt;relu_in3c_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M250,-4799.51C250,-4773.45 250,-4739.62 250,-4716.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"250,-4809.79 245.5,-4799.79 250,-4804.79 250,-4799.79 250,-4799.79 250,-4799.79 250,-4804.79 254.5,-4799.79 250,-4809.79 250,-4809.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"277.5\" y=\"-4759.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x28x28</text>\n",
       "</g>\n",
       "<!-- bn_in3c_double_3x3_1 -->\n",
       "<g id=\"node72\" class=\"node\"><title>bn_in3c_double_3x3_1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"297,-5020 203,-5020 203,-4962 297,-4962 297,-5020\"/>\n",
       "<text text-anchor=\"middle\" x=\"250\" y=\"-4987.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in3c_double_3x3_1&#45;&gt;conv_in3c_double_3x3_1 -->\n",
       "<g id=\"edge77\" class=\"edge\"><title>bn_in3c_double_3x3_1&#45;&gt;conv_in3c_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M250,-4951.51C250,-4925.45 250,-4891.62 250,-4868.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"250,-4961.79 245.5,-4951.79 250,-4956.79 250,-4951.79 250,-4951.79 250,-4951.79 250,-4956.79 254.5,-4951.79 250,-4961.79 250,-4961.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"277.5\" y=\"-4911.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in3c_double_3x3_1 -->\n",
       "<g id=\"node73\" class=\"node\"><title>relu_in3c_double_3x3_1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"297,-5172 203,-5172 203,-5114 297,-5114 297,-5172\"/>\n",
       "<text text-anchor=\"middle\" x=\"250\" y=\"-5146.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"250\" y=\"-5131.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in3c_double_3x3_1&#45;&gt;bn_in3c_double_3x3_1 -->\n",
       "<g id=\"edge78\" class=\"edge\"><title>relu_in3c_double_3x3_1&#45;&gt;bn_in3c_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M250,-5103.51C250,-5077.45 250,-5043.62 250,-5020.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"250,-5113.79 245.5,-5103.79 250,-5108.79 250,-5103.79 250,-5103.79 250,-5103.79 250,-5108.79 254.5,-5103.79 250,-5113.79 250,-5113.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"277.5\" y=\"-5063.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- max_pool_in3c_pool -->\n",
       "<g id=\"node74\" class=\"node\"><title>max_pool_in3c_pool</title>\n",
       "<polygon fill=\"#80b1d3\" stroke=\"black\" points=\"381,-4184 287,-4184 287,-4126 381,-4126 381,-4184\"/>\n",
       "<text text-anchor=\"middle\" x=\"334\" y=\"-4158.8\" font-family=\"Times,serif\" font-size=\"14.00\">Pooling</text>\n",
       "<text text-anchor=\"middle\" x=\"334\" y=\"-4143.8\" font-family=\"Times,serif\" font-size=\"14.00\">max, 3x3/2</text>\n",
       "</g>\n",
       "<!-- max_pool_in3c_pool&#45;&gt;ch_concat_in3b_chconcat -->\n",
       "<g id=\"edge79\" class=\"edge\"><title>max_pool_in3c_pool&#45;&gt;ch_concat_in3b_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M340.587,-4115.75C347.411,-4064.42 352.454,-3972.07 315,-3906 310.569,-3898.18 304.197,-3891.37 297.156,-3885.55\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"339.164,-4125.75 336.117,-4115.22 339.868,-4120.8 340.572,-4115.85 340.572,-4115.85 340.572,-4115.85 339.868,-4120.8 345.028,-4116.48 339.164,-4125.75 339.164,-4125.75\"/>\n",
       "<text text-anchor=\"middle\" x=\"376.5\" y=\"-4020.3\" font-family=\"Times,serif\" font-size=\"14.00\">320x28x28</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3c_chconcat -->\n",
       "<g id=\"node75\" class=\"node\"><title>ch_concat_in3c_chconcat</title>\n",
       "<polygon fill=\"#fdb462\" stroke=\"black\" points=\"297,-5282 203,-5282 203,-5224 297,-5224 297,-5282\"/>\n",
       "<text text-anchor=\"middle\" x=\"250\" y=\"-5249.3\" font-family=\"Times,serif\" font-size=\"14.00\">Concat</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3c_chconcat&#45;&gt;relu_in3c_3x3 -->\n",
       "<g id=\"edge80\" class=\"edge\"><title>ch_concat_in3c_chconcat&#45;&gt;relu_in3c_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M195.381,-5217.39C191.601,-5213.81 188.077,-5210.01 185,-5206 159.579,-5172.87 145.826,-5125.77 139.207,-5096.05\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"202.917,-5223.97 192.426,-5220.78 199.152,-5220.68 195.386,-5217.39 195.386,-5217.39 195.386,-5217.39 199.152,-5220.68 198.346,-5214 202.917,-5223.97 202.917,-5223.97\"/>\n",
       "<text text-anchor=\"middle\" x=\"215.5\" y=\"-5194.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3c_chconcat&#45;&gt;relu_in3c_double_3x3_1 -->\n",
       "<g id=\"edge81\" class=\"edge\"><title>ch_concat_in3c_chconcat&#45;&gt;relu_in3c_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M250,-5213.81C250,-5200.15 250,-5185.01 250,-5172.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"250,-5223.91 245.5,-5213.91 250,-5218.91 250,-5213.91 250,-5213.91 250,-5213.91 250,-5218.91 254.5,-5213.91 250,-5223.91 250,-5223.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"277.5\" y=\"-5194.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in3c_chconcat&#45;&gt;max_pool_in3c_pool -->\n",
       "<g id=\"edge82\" class=\"edge\"><title>ch_concat_in3c_chconcat&#45;&gt;max_pool_in3c_pool</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M299.361,-5216.98C302.852,-5213.49 306.122,-5209.82 309,-5206 326.885,-5182.27 334,-5173.71 334,-5144 334,-5144 334,-5144 334,-4306 334,-4263.55 334,-4214.35 334,-4184.2\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"291.943,-5223.87 296.208,-5213.76 295.607,-5220.46 299.271,-5217.06 299.271,-5217.06 299.271,-5217.06 295.607,-5220.46 302.333,-5220.36 291.943,-5223.87 291.943,-5223.87\"/>\n",
       "<text text-anchor=\"middle\" x=\"364.5\" y=\"-4759.3\" font-family=\"Times,serif\" font-size=\"14.00\">320x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4a_1x1 -->\n",
       "<g id=\"node76\" class=\"node\"><title>conv_in4a_1x1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"151,-6102 57,-6102 57,-6044 151,-6044 151,-6102\"/>\n",
       "<text text-anchor=\"middle\" x=\"104\" y=\"-6076.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"104\" y=\"-6061.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 224</text>\n",
       "</g>\n",
       "<!-- conv_in4a_1x1&#45;&gt;ch_concat_in3c_chconcat -->\n",
       "<g id=\"edge83\" class=\"edge\"><title>conv_in4a_1x1&#45;&gt;ch_concat_in3c_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M105.189,-6033.66C106.027,-6003.36 107,-5959.98 107,-5922 107,-5922 107,-5922 107,-5362 107,-5313 161.127,-5283.41 202.78,-5267.9\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"104.9,-6043.8 100.687,-6033.68 105.042,-6038.81 105.185,-6033.81 105.185,-6033.81 105.185,-6033.81 105.042,-6038.81 109.683,-6033.94 104.9,-6043.8 104.9,-6043.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"137.5\" y=\"-5655.3\" font-family=\"Times,serif\" font-size=\"14.00\">576x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4a_1x1 -->\n",
       "<g id=\"node77\" class=\"node\"><title>bn_in4a_1x1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"145,-6254 51,-6254 51,-6196 145,-6196 145,-6254\"/>\n",
       "<text text-anchor=\"middle\" x=\"98\" y=\"-6221.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4a_1x1&#45;&gt;conv_in4a_1x1 -->\n",
       "<g id=\"edge84\" class=\"edge\"><title>bn_in4a_1x1&#45;&gt;conv_in4a_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M99.5397,-6185.51C100.582,-6159.45 101.935,-6125.62 102.877,-6102.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"99.1286,-6195.79 95.0319,-6185.61 99.3284,-6190.79 99.5283,-6185.79 99.5283,-6185.79 99.5283,-6185.79 99.3284,-6190.79 104.025,-6185.97 99.1286,-6195.79 99.1286,-6195.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"133.5\" y=\"-6145.3\" font-family=\"Times,serif\" font-size=\"14.00\">224x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4a_1x1 -->\n",
       "<g id=\"node78\" class=\"node\"><title>relu_in4a_1x1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"157,-6406 63,-6406 63,-6348 157,-6348 157,-6406\"/>\n",
       "<text text-anchor=\"middle\" x=\"110\" y=\"-6380.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"110\" y=\"-6365.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4a_1x1&#45;&gt;bn_in4a_1x1 -->\n",
       "<g id=\"edge85\" class=\"edge\"><title>relu_in4a_1x1&#45;&gt;bn_in4a_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M106.921,-6337.51C104.836,-6311.45 102.13,-6277.62 100.247,-6254.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"107.743,-6347.79 102.46,-6338.18 107.344,-6342.8 106.945,-6337.82 106.945,-6337.82 106.945,-6337.82 107.344,-6342.8 111.431,-6337.46 107.743,-6347.79 107.743,-6347.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"137.5\" y=\"-6297.3\" font-family=\"Times,serif\" font-size=\"14.00\">224x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4a_3x3_reduce -->\n",
       "<g id=\"node79\" class=\"node\"><title>conv_in4a_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"268,-5688 174,-5688 174,-5630 268,-5630 268,-5688\"/>\n",
       "<text text-anchor=\"middle\" x=\"221\" y=\"-5662.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"221\" y=\"-5647.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 64</text>\n",
       "</g>\n",
       "<!-- conv_in4a_3x3_reduce&#45;&gt;ch_concat_in3c_chconcat -->\n",
       "<g id=\"edge86\" class=\"edge\"><title>conv_in4a_3x3_reduce&#45;&gt;ch_concat_in3c_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M220.548,-5619.75C220.283,-5594.08 220,-5559.51 220,-5529 220,-5529 220,-5529 220,-5362 220,-5334.17 229.361,-5303.73 237.625,-5282.29\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"220.656,-5629.82 216.049,-5619.86 220.602,-5624.82 220.549,-5619.82 220.549,-5619.82 220.549,-5619.82 220.602,-5624.82 225.049,-5619.77 220.656,-5629.82 220.656,-5629.82\"/>\n",
       "<text text-anchor=\"middle\" x=\"250.5\" y=\"-5469.3\" font-family=\"Times,serif\" font-size=\"14.00\">576x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4a_3x3_reduce -->\n",
       "<g id=\"node80\" class=\"node\"><title>bn_in4a_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"270,-5874 176,-5874 176,-5816 270,-5816 270,-5874\"/>\n",
       "<text text-anchor=\"middle\" x=\"223\" y=\"-5841.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4a_3x3_reduce&#45;&gt;conv_in4a_3x3_reduce -->\n",
       "<g id=\"edge87\" class=\"edge\"><title>bn_in4a_3x3_reduce&#45;&gt;conv_in4a_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M222.58,-5805.32C222.198,-5770.25 221.646,-5719.39 221.305,-5688.08\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"222.692,-5815.65 218.083,-5805.7 222.637,-5810.65 222.583,-5805.65 222.583,-5805.65 222.583,-5805.65 222.637,-5810.65 227.083,-5805.6 222.692,-5815.65 222.692,-5815.65\"/>\n",
       "<text text-anchor=\"middle\" x=\"250.5\" y=\"-5786.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4a_3x3_reduce -->\n",
       "<g id=\"node81\" class=\"node\"><title>relu_in4a_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"270,-6026 176,-6026 176,-5968 270,-5968 270,-6026\"/>\n",
       "<text text-anchor=\"middle\" x=\"223\" y=\"-6000.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"223\" y=\"-5985.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4a_3x3_reduce&#45;&gt;bn_in4a_3x3_reduce -->\n",
       "<g id=\"edge88\" class=\"edge\"><title>relu_in4a_3x3_reduce&#45;&gt;bn_in4a_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M223,-5957.51C223,-5931.45 223,-5897.62 223,-5874.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"223,-5967.79 218.5,-5957.79 223,-5962.79 223,-5957.79 223,-5957.79 223,-5957.79 223,-5962.79 227.5,-5957.79 223,-5967.79 223,-5967.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"250.5\" y=\"-5917.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4a_3x3 -->\n",
       "<g id=\"node82\" class=\"node\"><title>conv_in4a_3x3</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"271,-6178 177,-6178 177,-6120 271,-6120 271,-6178\"/>\n",
       "<text text-anchor=\"middle\" x=\"224\" y=\"-6152.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"224\" y=\"-6137.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 96</text>\n",
       "</g>\n",
       "<!-- conv_in4a_3x3&#45;&gt;relu_in4a_3x3_reduce -->\n",
       "<g id=\"edge89\" class=\"edge\"><title>conv_in4a_3x3&#45;&gt;relu_in4a_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M223.743,-6109.51C223.57,-6083.45 223.344,-6049.62 223.187,-6026.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"223.812,-6119.79 219.245,-6109.82 223.779,-6114.79 223.745,-6109.79 223.745,-6109.79 223.745,-6109.79 223.779,-6114.79 228.245,-6109.76 223.812,-6119.79 223.812,-6119.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"251.5\" y=\"-6069.3\" font-family=\"Times,serif\" font-size=\"14.00\">64x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4a_3x3 -->\n",
       "<g id=\"node83\" class=\"node\"><title>bn_in4a_3x3</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"271,-6330 177,-6330 177,-6272 271,-6272 271,-6330\"/>\n",
       "<text text-anchor=\"middle\" x=\"224\" y=\"-6297.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4a_3x3&#45;&gt;conv_in4a_3x3 -->\n",
       "<g id=\"edge90\" class=\"edge\"><title>bn_in4a_3x3&#45;&gt;conv_in4a_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M224,-6261.51C224,-6235.45 224,-6201.62 224,-6178.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"224,-6271.79 219.5,-6261.79 224,-6266.79 224,-6261.79 224,-6261.79 224,-6261.79 224,-6266.79 228.5,-6261.79 224,-6271.79 224,-6271.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"251.5\" y=\"-6221.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4a_3x3 -->\n",
       "<g id=\"node84\" class=\"node\"><title>relu_in4a_3x3</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"271,-6482 177,-6482 177,-6424 271,-6424 271,-6482\"/>\n",
       "<text text-anchor=\"middle\" x=\"224\" y=\"-6456.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"224\" y=\"-6441.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4a_3x3&#45;&gt;bn_in4a_3x3 -->\n",
       "<g id=\"edge91\" class=\"edge\"><title>relu_in4a_3x3&#45;&gt;bn_in4a_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M224,-6413.51C224,-6387.45 224,-6353.62 224,-6330.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"224,-6423.79 219.5,-6413.79 224,-6418.79 224,-6413.79 224,-6413.79 224,-6413.79 224,-6418.79 228.5,-6413.79 224,-6423.79 224,-6423.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"251.5\" y=\"-6373.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4a_double_3x3_reduce -->\n",
       "<g id=\"node85\" class=\"node\"><title>conv_in4a_double_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"355,-5392 261,-5392 261,-5334 355,-5334 355,-5392\"/>\n",
       "<text text-anchor=\"middle\" x=\"308\" y=\"-5366.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"308\" y=\"-5351.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 96</text>\n",
       "</g>\n",
       "<!-- conv_in4a_double_3x3_reduce&#45;&gt;ch_concat_in3c_chconcat -->\n",
       "<g id=\"edge92\" class=\"edge\"><title>conv_in4a_double_3x3_reduce&#45;&gt;ch_concat_in3c_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M288.137,-5325.01C280.635,-5311.04 272.224,-5295.38 265.213,-5282.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"292.913,-5333.91 284.217,-5327.23 290.547,-5329.5 288.181,-5325.1 288.181,-5325.1 288.181,-5325.1 290.547,-5329.5 292.146,-5322.97 292.913,-5333.91 292.913,-5333.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"313.5\" y=\"-5304.3\" font-family=\"Times,serif\" font-size=\"14.00\">576x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4a_double_3x3_reduce -->\n",
       "<g id=\"node86\" class=\"node\"><title>bn_in4a_double_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"393,-5502 299,-5502 299,-5444 393,-5444 393,-5502\"/>\n",
       "<text text-anchor=\"middle\" x=\"346\" y=\"-5469.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4a_double_3x3_reduce&#45;&gt;conv_in4a_double_3x3_reduce -->\n",
       "<g id=\"edge93\" class=\"edge\"><title>bn_in4a_double_3x3_reduce&#45;&gt;conv_in4a_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M332.705,-5434.21C327.862,-5420.45 322.473,-5405.13 317.967,-5392.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"336.115,-5443.91 328.551,-5435.97 334.456,-5439.19 332.796,-5434.47 332.796,-5434.47 332.796,-5434.47 334.456,-5439.19 337.041,-5432.98 336.115,-5443.91 336.115,-5443.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"357.5\" y=\"-5414.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4a_double_3x3_reduce -->\n",
       "<g id=\"node87\" class=\"node\"><title>relu_in4a_double_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"391,-5612 297,-5612 297,-5554 391,-5554 391,-5612\"/>\n",
       "<text text-anchor=\"middle\" x=\"344\" y=\"-5586.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"344\" y=\"-5571.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4a_double_3x3_reduce&#45;&gt;bn_in4a_double_3x3_reduce -->\n",
       "<g id=\"edge94\" class=\"edge\"><title>relu_in4a_double_3x3_reduce&#45;&gt;bn_in4a_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M344.707,-5543.81C344.96,-5530.15 345.241,-5515.01 345.475,-5502.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"344.52,-5553.91 340.206,-5543.82 344.613,-5548.91 344.706,-5543.91 344.706,-5543.91 344.706,-5543.91 344.613,-5548.91 349.205,-5543.99 344.52,-5553.91 344.52,-5553.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"373.5\" y=\"-5524.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4a_double_3x3_0 -->\n",
       "<g id=\"node88\" class=\"node\"><title>conv_in4a_double_3x3_0</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"390,-5764 296,-5764 296,-5706 390,-5706 390,-5764\"/>\n",
       "<text text-anchor=\"middle\" x=\"343\" y=\"-5738.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"343\" y=\"-5723.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 128</text>\n",
       "</g>\n",
       "<!-- conv_in4a_double_3x3_0&#45;&gt;relu_in4a_double_3x3_reduce -->\n",
       "<g id=\"edge95\" class=\"edge\"><title>conv_in4a_double_3x3_0&#45;&gt;relu_in4a_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M343.257,-5695.51C343.43,-5669.45 343.656,-5635.62 343.813,-5612.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"343.188,-5705.79 338.755,-5695.76 343.221,-5700.79 343.255,-5695.79 343.255,-5695.79 343.255,-5695.79 343.221,-5700.79 347.755,-5695.82 343.188,-5705.79 343.188,-5705.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"371.5\" y=\"-5655.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4a_double_3x3_0 -->\n",
       "<g id=\"node89\" class=\"node\"><title>bn_in4a_double_3x3_0</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"382,-5874 288,-5874 288,-5816 382,-5816 382,-5874\"/>\n",
       "<text text-anchor=\"middle\" x=\"335\" y=\"-5841.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4a_double_3x3_0&#45;&gt;conv_in4a_double_3x3_0 -->\n",
       "<g id=\"edge96\" class=\"edge\"><title>bn_in4a_double_3x3_0&#45;&gt;conv_in4a_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M337.829,-5805.81C338.841,-5792.15 339.962,-5777.01 340.902,-5764.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"337.081,-5815.91 333.332,-5805.6 337.45,-5810.92 337.82,-5805.93 337.82,-5805.93 337.82,-5805.93 337.45,-5810.92 342.308,-5806.27 337.081,-5815.91 337.081,-5815.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"370.5\" y=\"-5786.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4a_double_3x3_0 -->\n",
       "<g id=\"node90\" class=\"node\"><title>relu_in4a_double_3x3_0</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"382,-6026 288,-6026 288,-5968 382,-5968 382,-6026\"/>\n",
       "<text text-anchor=\"middle\" x=\"335\" y=\"-6000.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"335\" y=\"-5985.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4a_double_3x3_0&#45;&gt;bn_in4a_double_3x3_0 -->\n",
       "<g id=\"edge97\" class=\"edge\"><title>relu_in4a_double_3x3_0&#45;&gt;bn_in4a_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M331.419,-5957.74C331.253,-5955.12 331.109,-5952.52 331,-5950 329.882,-5924.25 329.882,-5917.75 331,-5892 331.25,-5886.23 331.676,-5880.07 332.159,-5874.19\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"332.159,-5967.81 326.938,-5958.16 331.793,-5962.82 331.426,-5957.83 331.426,-5957.83 331.426,-5957.83 331.793,-5962.82 335.914,-5957.5 332.159,-5967.81 332.159,-5967.81\"/>\n",
       "<text text-anchor=\"middle\" x=\"361.5\" y=\"-5917.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4a_double_3x3_1 -->\n",
       "<g id=\"node91\" class=\"node\"><title>conv_in4a_double_3x3_1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"383,-6178 289,-6178 289,-6120 383,-6120 383,-6178\"/>\n",
       "<text text-anchor=\"middle\" x=\"336\" y=\"-6152.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"336\" y=\"-6137.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 128</text>\n",
       "</g>\n",
       "<!-- conv_in4a_double_3x3_1&#45;&gt;relu_in4a_double_3x3_0 -->\n",
       "<g id=\"edge98\" class=\"edge\"><title>conv_in4a_double_3x3_1&#45;&gt;relu_in4a_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M335.743,-6109.51C335.57,-6083.45 335.344,-6049.62 335.187,-6026.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"335.812,-6119.79 331.245,-6109.82 335.779,-6114.79 335.745,-6109.79 335.745,-6109.79 335.745,-6109.79 335.779,-6114.79 340.245,-6109.76 335.812,-6119.79 335.812,-6119.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"366.5\" y=\"-6069.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4a_double_3x3_1 -->\n",
       "<g id=\"node92\" class=\"node\"><title>bn_in4a_double_3x3_1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"383,-6330 289,-6330 289,-6272 383,-6272 383,-6330\"/>\n",
       "<text text-anchor=\"middle\" x=\"336\" y=\"-6297.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4a_double_3x3_1&#45;&gt;conv_in4a_double_3x3_1 -->\n",
       "<g id=\"edge99\" class=\"edge\"><title>bn_in4a_double_3x3_1&#45;&gt;conv_in4a_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M336,-6261.51C336,-6235.45 336,-6201.62 336,-6178.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"336,-6271.79 331.5,-6261.79 336,-6266.79 336,-6261.79 336,-6261.79 336,-6261.79 336,-6266.79 340.5,-6261.79 336,-6271.79 336,-6271.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"366.5\" y=\"-6221.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4a_double_3x3_1 -->\n",
       "<g id=\"node93\" class=\"node\"><title>relu_in4a_double_3x3_1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"383,-6482 289,-6482 289,-6424 383,-6424 383,-6482\"/>\n",
       "<text text-anchor=\"middle\" x=\"336\" y=\"-6456.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"336\" y=\"-6441.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4a_double_3x3_1&#45;&gt;bn_in4a_double_3x3_1 -->\n",
       "<g id=\"edge100\" class=\"edge\"><title>relu_in4a_double_3x3_1&#45;&gt;bn_in4a_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M336,-6413.51C336,-6387.45 336,-6353.62 336,-6330.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"336,-6423.79 331.5,-6413.79 336,-6418.79 336,-6413.79 336,-6413.79 336,-6413.79 336,-6418.79 340.5,-6413.79 336,-6423.79 336,-6423.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"366.5\" y=\"-6373.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- avg_pool_in4a_pool -->\n",
       "<g id=\"node94\" class=\"node\"><title>avg_pool_in4a_pool</title>\n",
       "<polygon fill=\"#80b1d3\" stroke=\"black\" points=\"495,-5950 401,-5950 401,-5892 495,-5892 495,-5950\"/>\n",
       "<text text-anchor=\"middle\" x=\"448\" y=\"-5924.8\" font-family=\"Times,serif\" font-size=\"14.00\">Pooling</text>\n",
       "<text text-anchor=\"middle\" x=\"448\" y=\"-5909.8\" font-family=\"Times,serif\" font-size=\"14.00\">avg, 3x3/1</text>\n",
       "</g>\n",
       "<!-- avg_pool_in4a_pool&#45;&gt;ch_concat_in3c_chconcat -->\n",
       "<g id=\"edge101\" class=\"edge\"><title>avg_pool_in4a_pool&#45;&gt;ch_concat_in3c_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M443.482,-5881.81C440.832,-5856.16 438,-5821.6 438,-5791 438,-5791 438,-5791 438,-5362 438,-5297.26 353.134,-5270.76 297.44,-5260.34\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"444.559,-5891.86 439.019,-5882.4 444.026,-5886.89 443.494,-5881.92 443.494,-5881.92 443.494,-5881.92 444.026,-5886.89 447.968,-5881.44 444.559,-5891.86 444.559,-5891.86\"/>\n",
       "<text text-anchor=\"middle\" x=\"468.5\" y=\"-5579.3\" font-family=\"Times,serif\" font-size=\"14.00\">576x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4a_proj -->\n",
       "<g id=\"node95\" class=\"node\"><title>conv_in4a_proj</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"495,-6178 401,-6178 401,-6120 495,-6120 495,-6178\"/>\n",
       "<text text-anchor=\"middle\" x=\"448\" y=\"-6152.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"448\" y=\"-6137.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 128</text>\n",
       "</g>\n",
       "<!-- conv_in4a_proj&#45;&gt;avg_pool_in4a_pool -->\n",
       "<g id=\"edge102\" class=\"edge\"><title>conv_in4a_proj&#45;&gt;avg_pool_in4a_pool</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M448,-6109.83C448,-6064.64 448,-5990.45 448,-5950.17\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"448,-6119.83 443.5,-6109.83 448,-6114.83 448,-6109.83 448,-6109.83 448,-6109.83 448,-6114.83 452.5,-6109.83 448,-6119.83 448,-6119.83\"/>\n",
       "<text text-anchor=\"middle\" x=\"478.5\" y=\"-6069.3\" font-family=\"Times,serif\" font-size=\"14.00\">576x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4a_proj -->\n",
       "<g id=\"node96\" class=\"node\"><title>bn_in4a_proj</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"495,-6330 401,-6330 401,-6272 495,-6272 495,-6330\"/>\n",
       "<text text-anchor=\"middle\" x=\"448\" y=\"-6297.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4a_proj&#45;&gt;conv_in4a_proj -->\n",
       "<g id=\"edge103\" class=\"edge\"><title>bn_in4a_proj&#45;&gt;conv_in4a_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M448,-6261.51C448,-6235.45 448,-6201.62 448,-6178.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"448,-6271.79 443.5,-6261.79 448,-6266.79 448,-6261.79 448,-6261.79 448,-6261.79 448,-6266.79 452.5,-6261.79 448,-6271.79 448,-6271.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"478.5\" y=\"-6221.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4a_proj -->\n",
       "<g id=\"node97\" class=\"node\"><title>relu_in4a_proj</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"495,-6482 401,-6482 401,-6424 495,-6424 495,-6482\"/>\n",
       "<text text-anchor=\"middle\" x=\"448\" y=\"-6456.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"448\" y=\"-6441.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4a_proj&#45;&gt;bn_in4a_proj -->\n",
       "<g id=\"edge104\" class=\"edge\"><title>relu_in4a_proj&#45;&gt;bn_in4a_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M448,-6413.51C448,-6387.45 448,-6353.62 448,-6330.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"448,-6423.79 443.5,-6413.79 448,-6418.79 448,-6413.79 448,-6413.79 448,-6413.79 448,-6418.79 452.5,-6413.79 448,-6423.79 448,-6423.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"478.5\" y=\"-6373.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4a_chconcat -->\n",
       "<g id=\"node98\" class=\"node\"><title>ch_concat_in4a_chconcat</title>\n",
       "<polygon fill=\"#fdb462\" stroke=\"black\" points=\"326,-6592 232,-6592 232,-6534 326,-6534 326,-6592\"/>\n",
       "<text text-anchor=\"middle\" x=\"279\" y=\"-6559.3\" font-family=\"Times,serif\" font-size=\"14.00\">Concat</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4a_chconcat&#45;&gt;relu_in4a_1x1 -->\n",
       "<g id=\"edge105\" class=\"edge\"><title>ch_concat_in4a_chconcat&#45;&gt;relu_in4a_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M222.74,-6544.45C206.877,-6537.49 190.544,-6528.17 178,-6516 146.271,-6485.22 127.147,-6436.56 117.59,-6406.01\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"231.994,-6548.28 221.033,-6548.61 227.374,-6546.37 222.754,-6544.46 222.754,-6544.46 222.754,-6544.46 227.374,-6546.37 224.476,-6540.3 231.994,-6548.28 231.994,-6548.28\"/>\n",
       "<text text-anchor=\"middle\" x=\"208.5\" y=\"-6504.3\" font-family=\"Times,serif\" font-size=\"14.00\">224x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4a_chconcat&#45;&gt;relu_in4a_3x3 -->\n",
       "<g id=\"edge106\" class=\"edge\"><title>ch_concat_in4a_chconcat&#45;&gt;relu_in4a_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M254.888,-6524.9C253.175,-6521.92 251.525,-6518.93 250,-6516 244.397,-6505.23 239.055,-6492.98 234.687,-6482.23\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"260.15,-6533.72 251.163,-6527.44 257.589,-6529.43 255.028,-6525.13 255.028,-6525.13 255.028,-6525.13 257.589,-6529.43 258.893,-6522.83 260.15,-6533.72 260.15,-6533.72\"/>\n",
       "<text text-anchor=\"middle\" x=\"277.5\" y=\"-6504.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4a_chconcat&#45;&gt;relu_in4a_double_3x3_1 -->\n",
       "<g id=\"edge107\" class=\"edge\"><title>ch_concat_in4a_chconcat&#45;&gt;relu_in4a_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M300.165,-6524.93C301.819,-6521.92 303.449,-6518.92 305,-6516 310.823,-6505.06 316.979,-6492.88 322.257,-6482.24\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"295.178,-6533.91 296.102,-6522.98 297.607,-6529.54 300.036,-6525.16 300.036,-6525.16 300.036,-6525.16 297.607,-6529.54 303.969,-6527.35 295.178,-6533.91 295.178,-6533.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"343.5\" y=\"-6504.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4a_chconcat&#45;&gt;relu_in4a_proj -->\n",
       "<g id=\"edge108\" class=\"edge\"><title>ch_concat_in4a_chconcat&#45;&gt;relu_in4a_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M335.365,-6539.24C349.714,-6532.53 364.8,-6524.65 378,-6516 392.802,-6506.3 407.69,-6493.62 419.906,-6482.26\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"326.069,-6543.48 333.304,-6535.24 330.62,-6541.4 335.17,-6539.33 335.17,-6539.33 335.17,-6539.33 330.62,-6541.4 337.035,-6543.43 326.069,-6543.48 326.069,-6543.48\"/>\n",
       "<text text-anchor=\"middle\" x=\"428.5\" y=\"-6504.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4b_1x1 -->\n",
       "<g id=\"node99\" class=\"node\"><title>conv_in4b_1x1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"179,-7412 85,-7412 85,-7354 179,-7354 179,-7412\"/>\n",
       "<text text-anchor=\"middle\" x=\"132\" y=\"-7386.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"132\" y=\"-7371.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 192</text>\n",
       "</g>\n",
       "<!-- conv_in4b_1x1&#45;&gt;ch_concat_in4a_chconcat -->\n",
       "<g id=\"edge109\" class=\"edge\"><title>conv_in4b_1x1&#45;&gt;ch_concat_in4a_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M133.189,-7343.66C134.027,-7313.36 135,-7269.98 135,-7232 135,-7232 135,-7232 135,-6672 135,-6622.62 189.853,-6593.06 231.849,-6577.66\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"132.9,-7353.8 128.687,-7343.68 133.042,-7348.81 133.185,-7343.81 133.185,-7343.81 133.185,-7343.81 133.042,-7348.81 137.683,-7343.94 132.9,-7353.8 132.9,-7353.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"165.5\" y=\"-6965.3\" font-family=\"Times,serif\" font-size=\"14.00\">576x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4b_1x1 -->\n",
       "<g id=\"node100\" class=\"node\"><title>bn_in4b_1x1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"173,-7564 79,-7564 79,-7506 173,-7506 173,-7564\"/>\n",
       "<text text-anchor=\"middle\" x=\"126\" y=\"-7531.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4b_1x1&#45;&gt;conv_in4b_1x1 -->\n",
       "<g id=\"edge110\" class=\"edge\"><title>bn_in4b_1x1&#45;&gt;conv_in4b_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M127.54,-7495.51C128.582,-7469.45 129.935,-7435.62 130.877,-7412.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"127.129,-7505.79 123.032,-7495.61 127.328,-7500.79 127.528,-7495.79 127.528,-7495.79 127.528,-7495.79 127.328,-7500.79 132.025,-7495.97 127.129,-7505.79 127.129,-7505.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"161.5\" y=\"-7455.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4b_1x1 -->\n",
       "<g id=\"node101\" class=\"node\"><title>relu_in4b_1x1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"185,-7716 91,-7716 91,-7658 185,-7658 185,-7716\"/>\n",
       "<text text-anchor=\"middle\" x=\"138\" y=\"-7690.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"138\" y=\"-7675.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4b_1x1&#45;&gt;bn_in4b_1x1 -->\n",
       "<g id=\"edge111\" class=\"edge\"><title>relu_in4b_1x1&#45;&gt;bn_in4b_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M134.921,-7647.51C132.836,-7621.45 130.13,-7587.62 128.247,-7564.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"135.743,-7657.79 130.46,-7648.18 135.344,-7652.8 134.945,-7647.82 134.945,-7647.82 134.945,-7647.82 135.344,-7652.8 139.431,-7647.46 135.743,-7657.79 135.743,-7657.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"165.5\" y=\"-7607.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4b_3x3_reduce -->\n",
       "<g id=\"node102\" class=\"node\"><title>conv_in4b_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"297,-6998 203,-6998 203,-6940 297,-6940 297,-6998\"/>\n",
       "<text text-anchor=\"middle\" x=\"250\" y=\"-6972.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"250\" y=\"-6957.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 96</text>\n",
       "</g>\n",
       "<!-- conv_in4b_3x3_reduce&#45;&gt;ch_concat_in4a_chconcat -->\n",
       "<g id=\"edge112\" class=\"edge\"><title>conv_in4b_3x3_reduce&#45;&gt;ch_concat_in4a_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M249.548,-6929.75C249.283,-6904.08 249,-6869.51 249,-6839 249,-6839 249,-6839 249,-6672 249,-6644.17 258.361,-6613.73 266.625,-6592.29\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"249.656,-6939.82 245.049,-6929.86 249.602,-6934.82 249.549,-6929.82 249.549,-6929.82 249.549,-6929.82 249.602,-6934.82 254.049,-6929.77 249.656,-6939.82 249.656,-6939.82\"/>\n",
       "<text text-anchor=\"middle\" x=\"279.5\" y=\"-6779.3\" font-family=\"Times,serif\" font-size=\"14.00\">576x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4b_3x3_reduce -->\n",
       "<g id=\"node103\" class=\"node\"><title>bn_in4b_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"299,-7184 205,-7184 205,-7126 299,-7126 299,-7184\"/>\n",
       "<text text-anchor=\"middle\" x=\"252\" y=\"-7151.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4b_3x3_reduce&#45;&gt;conv_in4b_3x3_reduce -->\n",
       "<g id=\"edge113\" class=\"edge\"><title>bn_in4b_3x3_reduce&#45;&gt;conv_in4b_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M251.58,-7115.32C251.198,-7080.25 250.646,-7029.39 250.305,-6998.08\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"251.692,-7125.65 247.083,-7115.7 251.637,-7120.65 251.583,-7115.65 251.583,-7115.65 251.583,-7115.65 251.637,-7120.65 256.083,-7115.6 251.692,-7125.65 251.692,-7125.65\"/>\n",
       "<text text-anchor=\"middle\" x=\"279.5\" y=\"-7096.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4b_3x3_reduce -->\n",
       "<g id=\"node104\" class=\"node\"><title>relu_in4b_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"299,-7336 205,-7336 205,-7278 299,-7278 299,-7336\"/>\n",
       "<text text-anchor=\"middle\" x=\"252\" y=\"-7310.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"252\" y=\"-7295.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4b_3x3_reduce&#45;&gt;bn_in4b_3x3_reduce -->\n",
       "<g id=\"edge114\" class=\"edge\"><title>relu_in4b_3x3_reduce&#45;&gt;bn_in4b_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M252,-7267.51C252,-7241.45 252,-7207.62 252,-7184.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"252,-7277.79 247.5,-7267.79 252,-7272.79 252,-7267.79 252,-7267.79 252,-7267.79 252,-7272.79 256.5,-7267.79 252,-7277.79 252,-7277.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"279.5\" y=\"-7227.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4b_3x3 -->\n",
       "<g id=\"node105\" class=\"node\"><title>conv_in4b_3x3</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"299,-7488 205,-7488 205,-7430 299,-7430 299,-7488\"/>\n",
       "<text text-anchor=\"middle\" x=\"252\" y=\"-7462.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"252\" y=\"-7447.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 128</text>\n",
       "</g>\n",
       "<!-- conv_in4b_3x3&#45;&gt;relu_in4b_3x3_reduce -->\n",
       "<g id=\"edge115\" class=\"edge\"><title>conv_in4b_3x3&#45;&gt;relu_in4b_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M252,-7419.51C252,-7393.45 252,-7359.62 252,-7336.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"252,-7429.79 247.5,-7419.79 252,-7424.79 252,-7419.79 252,-7419.79 252,-7419.79 252,-7424.79 256.5,-7419.79 252,-7429.79 252,-7429.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"279.5\" y=\"-7379.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4b_3x3 -->\n",
       "<g id=\"node106\" class=\"node\"><title>bn_in4b_3x3</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"299,-7640 205,-7640 205,-7582 299,-7582 299,-7640\"/>\n",
       "<text text-anchor=\"middle\" x=\"252\" y=\"-7607.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4b_3x3&#45;&gt;conv_in4b_3x3 -->\n",
       "<g id=\"edge116\" class=\"edge\"><title>bn_in4b_3x3&#45;&gt;conv_in4b_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M252,-7571.51C252,-7545.45 252,-7511.62 252,-7488.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"252,-7581.79 247.5,-7571.79 252,-7576.79 252,-7571.79 252,-7571.79 252,-7571.79 252,-7576.79 256.5,-7571.79 252,-7581.79 252,-7581.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"282.5\" y=\"-7531.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4b_3x3 -->\n",
       "<g id=\"node107\" class=\"node\"><title>relu_in4b_3x3</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"299,-7792 205,-7792 205,-7734 299,-7734 299,-7792\"/>\n",
       "<text text-anchor=\"middle\" x=\"252\" y=\"-7766.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"252\" y=\"-7751.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4b_3x3&#45;&gt;bn_in4b_3x3 -->\n",
       "<g id=\"edge117\" class=\"edge\"><title>relu_in4b_3x3&#45;&gt;bn_in4b_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M252,-7723.51C252,-7697.45 252,-7663.62 252,-7640.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"252,-7733.79 247.5,-7723.79 252,-7728.79 252,-7723.79 252,-7723.79 252,-7723.79 252,-7728.79 256.5,-7723.79 252,-7733.79 252,-7733.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"282.5\" y=\"-7683.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4b_double_3x3_reduce -->\n",
       "<g id=\"node108\" class=\"node\"><title>conv_in4b_double_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"384,-6702 290,-6702 290,-6644 384,-6644 384,-6702\"/>\n",
       "<text text-anchor=\"middle\" x=\"337\" y=\"-6676.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"337\" y=\"-6661.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 96</text>\n",
       "</g>\n",
       "<!-- conv_in4b_double_3x3_reduce&#45;&gt;ch_concat_in4a_chconcat -->\n",
       "<g id=\"edge118\" class=\"edge\"><title>conv_in4b_double_3x3_reduce&#45;&gt;ch_concat_in4a_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M317.137,-6635.01C309.635,-6621.04 301.224,-6605.38 294.213,-6592.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"321.913,-6643.91 313.217,-6637.23 319.547,-6639.5 317.181,-6635.1 317.181,-6635.1 317.181,-6635.1 319.547,-6639.5 321.146,-6632.97 321.913,-6643.91 321.913,-6643.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"342.5\" y=\"-6614.3\" font-family=\"Times,serif\" font-size=\"14.00\">576x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4b_double_3x3_reduce -->\n",
       "<g id=\"node109\" class=\"node\"><title>bn_in4b_double_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"422,-6812 328,-6812 328,-6754 422,-6754 422,-6812\"/>\n",
       "<text text-anchor=\"middle\" x=\"375\" y=\"-6779.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4b_double_3x3_reduce&#45;&gt;conv_in4b_double_3x3_reduce -->\n",
       "<g id=\"edge119\" class=\"edge\"><title>bn_in4b_double_3x3_reduce&#45;&gt;conv_in4b_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M361.705,-6744.21C356.862,-6730.45 351.473,-6715.13 346.967,-6702.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"365.115,-6753.91 357.551,-6745.97 363.456,-6749.19 361.796,-6744.47 361.796,-6744.47 361.796,-6744.47 363.456,-6749.19 366.041,-6742.98 365.115,-6753.91 365.115,-6753.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"386.5\" y=\"-6724.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4b_double_3x3_reduce -->\n",
       "<g id=\"node110\" class=\"node\"><title>relu_in4b_double_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"422,-6922 328,-6922 328,-6864 422,-6864 422,-6922\"/>\n",
       "<text text-anchor=\"middle\" x=\"375\" y=\"-6896.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"375\" y=\"-6881.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4b_double_3x3_reduce&#45;&gt;bn_in4b_double_3x3_reduce -->\n",
       "<g id=\"edge120\" class=\"edge\"><title>relu_in4b_double_3x3_reduce&#45;&gt;bn_in4b_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M375,-6853.81C375,-6840.15 375,-6825.01 375,-6812.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"375,-6863.91 370.5,-6853.91 375,-6858.91 375,-6853.91 375,-6853.91 375,-6853.91 375,-6858.91 379.5,-6853.91 375,-6863.91 375,-6863.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"402.5\" y=\"-6834.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4b_double_3x3_0 -->\n",
       "<g id=\"node111\" class=\"node\"><title>conv_in4b_double_3x3_0</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"422,-7074 328,-7074 328,-7016 422,-7016 422,-7074\"/>\n",
       "<text text-anchor=\"middle\" x=\"375\" y=\"-7048.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"375\" y=\"-7033.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 128</text>\n",
       "</g>\n",
       "<!-- conv_in4b_double_3x3_0&#45;&gt;relu_in4b_double_3x3_reduce -->\n",
       "<g id=\"edge121\" class=\"edge\"><title>conv_in4b_double_3x3_0&#45;&gt;relu_in4b_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M375,-7005.51C375,-6979.45 375,-6945.62 375,-6922.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"375,-7015.79 370.5,-7005.79 375,-7010.79 375,-7005.79 375,-7005.79 375,-7005.79 375,-7010.79 379.5,-7005.79 375,-7015.79 375,-7015.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"402.5\" y=\"-6965.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4b_double_3x3_0 -->\n",
       "<g id=\"node112\" class=\"node\"><title>bn_in4b_double_3x3_0</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"418,-7184 324,-7184 324,-7126 418,-7126 418,-7184\"/>\n",
       "<text text-anchor=\"middle\" x=\"371\" y=\"-7151.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4b_double_3x3_0&#45;&gt;conv_in4b_double_3x3_0 -->\n",
       "<g id=\"edge122\" class=\"edge\"><title>bn_in4b_double_3x3_0&#45;&gt;conv_in4b_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M372.414,-7115.81C372.92,-7102.15 373.481,-7087.01 373.951,-7074.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"372.041,-7125.91 367.914,-7115.75 372.226,-7120.91 372.411,-7115.91 372.411,-7115.91 372.411,-7115.91 372.226,-7120.91 376.908,-7116.08 372.041,-7125.91 372.041,-7125.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"404.5\" y=\"-7096.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4b_double_3x3_0 -->\n",
       "<g id=\"node113\" class=\"node\"><title>relu_in4b_double_3x3_0</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"411,-7336 317,-7336 317,-7278 411,-7278 411,-7336\"/>\n",
       "<text text-anchor=\"middle\" x=\"364\" y=\"-7310.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"364\" y=\"-7295.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4b_double_3x3_0&#45;&gt;bn_in4b_double_3x3_0 -->\n",
       "<g id=\"edge123\" class=\"edge\"><title>relu_in4b_double_3x3_0&#45;&gt;bn_in4b_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M358.945,-7267.53C357.172,-7247.86 356.231,-7223.58 359,-7202 359.735,-7196.27 360.965,-7190.23 362.365,-7184.49\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"359.965,-7277.64 354.485,-7268.15 359.464,-7272.67 358.962,-7267.69 358.962,-7267.69 358.962,-7267.69 359.464,-7272.67 363.439,-7267.24 359.965,-7277.64 359.965,-7277.64\"/>\n",
       "<text text-anchor=\"middle\" x=\"389.5\" y=\"-7227.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4b_double_3x3_1 -->\n",
       "<g id=\"node114\" class=\"node\"><title>conv_in4b_double_3x3_1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"411,-7488 317,-7488 317,-7430 411,-7430 411,-7488\"/>\n",
       "<text text-anchor=\"middle\" x=\"364\" y=\"-7462.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"364\" y=\"-7447.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 128</text>\n",
       "</g>\n",
       "<!-- conv_in4b_double_3x3_1&#45;&gt;relu_in4b_double_3x3_0 -->\n",
       "<g id=\"edge124\" class=\"edge\"><title>conv_in4b_double_3x3_1&#45;&gt;relu_in4b_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M364,-7419.51C364,-7393.45 364,-7359.62 364,-7336.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"364,-7429.79 359.5,-7419.79 364,-7424.79 364,-7419.79 364,-7419.79 364,-7419.79 364,-7424.79 368.5,-7419.79 364,-7429.79 364,-7429.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"394.5\" y=\"-7379.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4b_double_3x3_1 -->\n",
       "<g id=\"node115\" class=\"node\"><title>bn_in4b_double_3x3_1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"411,-7640 317,-7640 317,-7582 411,-7582 411,-7640\"/>\n",
       "<text text-anchor=\"middle\" x=\"364\" y=\"-7607.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4b_double_3x3_1&#45;&gt;conv_in4b_double_3x3_1 -->\n",
       "<g id=\"edge125\" class=\"edge\"><title>bn_in4b_double_3x3_1&#45;&gt;conv_in4b_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M364,-7571.51C364,-7545.45 364,-7511.62 364,-7488.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"364,-7581.79 359.5,-7571.79 364,-7576.79 364,-7571.79 364,-7571.79 364,-7571.79 364,-7576.79 368.5,-7571.79 364,-7581.79 364,-7581.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"394.5\" y=\"-7531.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4b_double_3x3_1 -->\n",
       "<g id=\"node116\" class=\"node\"><title>relu_in4b_double_3x3_1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"411,-7792 317,-7792 317,-7734 411,-7734 411,-7792\"/>\n",
       "<text text-anchor=\"middle\" x=\"364\" y=\"-7766.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"364\" y=\"-7751.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4b_double_3x3_1&#45;&gt;bn_in4b_double_3x3_1 -->\n",
       "<g id=\"edge126\" class=\"edge\"><title>relu_in4b_double_3x3_1&#45;&gt;bn_in4b_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M364,-7723.51C364,-7697.45 364,-7663.62 364,-7640.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"364,-7733.79 359.5,-7723.79 364,-7728.79 364,-7723.79 364,-7723.79 364,-7723.79 364,-7728.79 368.5,-7723.79 364,-7733.79 364,-7733.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"394.5\" y=\"-7683.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- avg_pool_in4b_pool -->\n",
       "<g id=\"node117\" class=\"node\"><title>avg_pool_in4b_pool</title>\n",
       "<polygon fill=\"#80b1d3\" stroke=\"black\" points=\"523,-7260 429,-7260 429,-7202 523,-7202 523,-7260\"/>\n",
       "<text text-anchor=\"middle\" x=\"476\" y=\"-7234.8\" font-family=\"Times,serif\" font-size=\"14.00\">Pooling</text>\n",
       "<text text-anchor=\"middle\" x=\"476\" y=\"-7219.8\" font-family=\"Times,serif\" font-size=\"14.00\">avg, 3x3/1</text>\n",
       "</g>\n",
       "<!-- avg_pool_in4b_pool&#45;&gt;ch_concat_in4a_chconcat -->\n",
       "<g id=\"edge127\" class=\"edge\"><title>avg_pool_in4b_pool&#45;&gt;ch_concat_in4a_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M471.933,-7191.8C469.549,-7166.15 467,-7131.58 467,-7101 467,-7101 467,-7101 467,-6672 467,-6607.26 382.134,-6580.76 326.44,-6570.34\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"472.903,-7201.85 467.464,-7192.33 472.423,-7196.88 471.944,-7191.9 471.944,-7191.9 471.944,-7191.9 472.423,-7196.88 476.423,-7191.47 472.903,-7201.85 472.903,-7201.85\"/>\n",
       "<text text-anchor=\"middle\" x=\"497.5\" y=\"-6889.3\" font-family=\"Times,serif\" font-size=\"14.00\">576x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4b_proj -->\n",
       "<g id=\"node118\" class=\"node\"><title>conv_in4b_proj</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"523,-7488 429,-7488 429,-7430 523,-7430 523,-7488\"/>\n",
       "<text text-anchor=\"middle\" x=\"476\" y=\"-7462.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"476\" y=\"-7447.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 128</text>\n",
       "</g>\n",
       "<!-- conv_in4b_proj&#45;&gt;avg_pool_in4b_pool -->\n",
       "<g id=\"edge128\" class=\"edge\"><title>conv_in4b_proj&#45;&gt;avg_pool_in4b_pool</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M476,-7419.83C476,-7374.64 476,-7300.45 476,-7260.17\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"476,-7429.83 471.5,-7419.83 476,-7424.83 476,-7419.83 476,-7419.83 476,-7419.83 476,-7424.83 480.5,-7419.83 476,-7429.83 476,-7429.83\"/>\n",
       "<text text-anchor=\"middle\" x=\"506.5\" y=\"-7379.3\" font-family=\"Times,serif\" font-size=\"14.00\">576x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4b_proj -->\n",
       "<g id=\"node119\" class=\"node\"><title>bn_in4b_proj</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"523,-7640 429,-7640 429,-7582 523,-7582 523,-7640\"/>\n",
       "<text text-anchor=\"middle\" x=\"476\" y=\"-7607.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4b_proj&#45;&gt;conv_in4b_proj -->\n",
       "<g id=\"edge129\" class=\"edge\"><title>bn_in4b_proj&#45;&gt;conv_in4b_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M476,-7571.51C476,-7545.45 476,-7511.62 476,-7488.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"476,-7581.79 471.5,-7571.79 476,-7576.79 476,-7571.79 476,-7571.79 476,-7571.79 476,-7576.79 480.5,-7571.79 476,-7581.79 476,-7581.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"506.5\" y=\"-7531.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4b_proj -->\n",
       "<g id=\"node120\" class=\"node\"><title>relu_in4b_proj</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"523,-7792 429,-7792 429,-7734 523,-7734 523,-7792\"/>\n",
       "<text text-anchor=\"middle\" x=\"476\" y=\"-7766.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"476\" y=\"-7751.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4b_proj&#45;&gt;bn_in4b_proj -->\n",
       "<g id=\"edge130\" class=\"edge\"><title>relu_in4b_proj&#45;&gt;bn_in4b_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M476,-7723.51C476,-7697.45 476,-7663.62 476,-7640.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"476,-7733.79 471.5,-7723.79 476,-7728.79 476,-7723.79 476,-7723.79 476,-7723.79 476,-7728.79 480.5,-7723.79 476,-7733.79 476,-7733.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"506.5\" y=\"-7683.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4b_chconcat -->\n",
       "<g id=\"node121\" class=\"node\"><title>ch_concat_in4b_chconcat</title>\n",
       "<polygon fill=\"#fdb462\" stroke=\"black\" points=\"355,-7902 261,-7902 261,-7844 355,-7844 355,-7902\"/>\n",
       "<text text-anchor=\"middle\" x=\"308\" y=\"-7869.3\" font-family=\"Times,serif\" font-size=\"14.00\">Concat</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4b_chconcat&#45;&gt;relu_in4b_1x1 -->\n",
       "<g id=\"edge131\" class=\"edge\"><title>ch_concat_in4b_chconcat&#45;&gt;relu_in4b_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M251.453,-7855.84C234.314,-7848.82 216.479,-7839.12 203,-7826 171.588,-7795.43 153.625,-7746.71 144.849,-7716.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"260.871,-7859.47 249.922,-7860.07 256.206,-7857.67 251.54,-7855.87 251.54,-7855.87 251.54,-7855.87 256.206,-7857.67 253.158,-7851.67 260.871,-7859.47 260.871,-7859.47\"/>\n",
       "<text text-anchor=\"middle\" x=\"233.5\" y=\"-7814.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4b_chconcat&#45;&gt;relu_in4b_3x3 -->\n",
       "<g id=\"edge132\" class=\"edge\"><title>ch_concat_in4b_chconcat&#45;&gt;relu_in4b_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M279.392,-7835.22C277.46,-7832.17 275.635,-7829.07 274,-7826 268.369,-7815.41 263.657,-7803.08 260.056,-7792.21\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"285.052,-7843.66 275.744,-7837.86 282.267,-7839.51 279.481,-7835.35 279.481,-7835.35 279.481,-7835.35 282.267,-7839.51 283.218,-7832.85 285.052,-7843.66 285.052,-7843.66\"/>\n",
       "<text text-anchor=\"middle\" x=\"304.5\" y=\"-7814.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4b_chconcat&#45;&gt;relu_in4b_double_3x3_1 -->\n",
       "<g id=\"edge133\" class=\"edge\"><title>ch_concat_in4b_chconcat&#45;&gt;relu_in4b_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M330.251,-7834.76C331.891,-7831.81 333.491,-7828.87 335,-7826 340.752,-7815.06 346.617,-7802.78 351.553,-7792.05\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"325.27,-7843.52 326.299,-7832.61 327.74,-7839.18 330.211,-7834.83 330.211,-7834.83 330.211,-7834.83 327.74,-7839.18 334.123,-7837.05 325.27,-7843.52 325.27,-7843.52\"/>\n",
       "<text text-anchor=\"middle\" x=\"373.5\" y=\"-7814.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4b_chconcat&#45;&gt;relu_in4b_proj -->\n",
       "<g id=\"edge134\" class=\"edge\"><title>ch_concat_in4b_chconcat&#45;&gt;relu_in4b_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M364.602,-7849.64C379.222,-7842.88 394.606,-7834.88 408,-7826 422.649,-7816.29 437.264,-7803.48 449.17,-7792.02\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"355.132,-7853.89 362.411,-7845.69 359.693,-7851.84 364.255,-7849.79 364.255,-7849.79 364.255,-7849.79 359.693,-7851.84 366.098,-7853.9 355.132,-7853.89 355.132,-7853.89\"/>\n",
       "<text text-anchor=\"middle\" x=\"458.5\" y=\"-7814.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4c_1x1 -->\n",
       "<g id=\"node122\" class=\"node\"><title>conv_in4c_1x1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"190,-8722 96,-8722 96,-8664 190,-8664 190,-8722\"/>\n",
       "<text text-anchor=\"middle\" x=\"143\" y=\"-8696.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"143\" y=\"-8681.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 160</text>\n",
       "</g>\n",
       "<!-- conv_in4c_1x1&#45;&gt;ch_concat_in4b_chconcat -->\n",
       "<g id=\"edge135\" class=\"edge\"><title>conv_in4c_1x1&#45;&gt;ch_concat_in4b_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M143.793,-8653.66C144.351,-8623.35 145,-8579.97 145,-8542 145,-8542 145,-8542 145,-7982 145,-7925.99 212.714,-7897.31 260.854,-7884.01\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"143.6,-8663.8 139.291,-8653.72 143.695,-8658.8 143.79,-8653.8 143.79,-8653.8 143.79,-8653.8 143.695,-8658.8 148.289,-8653.89 143.6,-8663.8 143.6,-8663.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"175.5\" y=\"-8275.3\" font-family=\"Times,serif\" font-size=\"14.00\">576x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4c_1x1 -->\n",
       "<g id=\"node123\" class=\"node\"><title>bn_in4c_1x1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"184,-8874 90,-8874 90,-8816 184,-8816 184,-8874\"/>\n",
       "<text text-anchor=\"middle\" x=\"137\" y=\"-8841.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4c_1x1&#45;&gt;conv_in4c_1x1 -->\n",
       "<g id=\"edge136\" class=\"edge\"><title>bn_in4c_1x1&#45;&gt;conv_in4c_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M138.54,-8805.51C139.582,-8779.45 140.935,-8745.62 141.877,-8722.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"138.129,-8815.79 134.032,-8805.61 138.328,-8810.79 138.528,-8805.79 138.528,-8805.79 138.528,-8805.79 138.328,-8810.79 143.025,-8805.97 138.129,-8815.79 138.129,-8815.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"172.5\" y=\"-8765.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4c_1x1 -->\n",
       "<g id=\"node124\" class=\"node\"><title>relu_in4c_1x1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"198,-9026 104,-9026 104,-8968 198,-8968 198,-9026\"/>\n",
       "<text text-anchor=\"middle\" x=\"151\" y=\"-9000.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"151\" y=\"-8985.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4c_1x1&#45;&gt;bn_in4c_1x1 -->\n",
       "<g id=\"edge137\" class=\"edge\"><title>relu_in4c_1x1&#45;&gt;bn_in4c_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M146.776,-8957.73C146.507,-8955.11 146.246,-8952.52 146,-8950 143.5,-8924.39 141.004,-8895.19 139.277,-8874.27\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"147.835,-8967.79 142.313,-8958.32 147.311,-8962.82 146.788,-8957.85 146.788,-8957.85 146.788,-8957.85 147.311,-8962.82 151.263,-8957.37 147.835,-8967.79 147.835,-8967.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"176.5\" y=\"-8917.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4c_3x3_reduce -->\n",
       "<g id=\"node125\" class=\"node\"><title>conv_in4c_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"306,-8308 212,-8308 212,-8250 306,-8250 306,-8308\"/>\n",
       "<text text-anchor=\"middle\" x=\"259\" y=\"-8282.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"259\" y=\"-8267.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 128</text>\n",
       "</g>\n",
       "<!-- conv_in4c_3x3_reduce&#45;&gt;ch_concat_in4b_chconcat -->\n",
       "<g id=\"edge138\" class=\"edge\"><title>conv_in4c_3x3_reduce&#45;&gt;ch_concat_in4b_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M258.548,-8239.75C258.283,-8214.08 258,-8179.51 258,-8149 258,-8149 258,-8149 258,-7982 258,-7952.87 273.168,-7923.06 286.795,-7902.16\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"258.656,-8249.82 254.049,-8239.86 258.602,-8244.82 258.549,-8239.82 258.549,-8239.82 258.549,-8239.82 258.602,-8244.82 263.049,-8239.77 258.656,-8249.82 258.656,-8249.82\"/>\n",
       "<text text-anchor=\"middle\" x=\"288.5\" y=\"-8089.3\" font-family=\"Times,serif\" font-size=\"14.00\">576x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4c_3x3_reduce -->\n",
       "<g id=\"node126\" class=\"node\"><title>bn_in4c_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"306,-8494 212,-8494 212,-8436 306,-8436 306,-8494\"/>\n",
       "<text text-anchor=\"middle\" x=\"259\" y=\"-8461.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4c_3x3_reduce&#45;&gt;conv_in4c_3x3_reduce -->\n",
       "<g id=\"edge139\" class=\"edge\"><title>bn_in4c_3x3_reduce&#45;&gt;conv_in4c_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M259,-8425.32C259,-8390.25 259,-8339.39 259,-8308.08\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"259,-8435.65 254.5,-8425.65 259,-8430.65 259,-8425.65 259,-8425.65 259,-8425.65 259,-8430.65 263.5,-8425.65 259,-8435.65 259,-8435.65\"/>\n",
       "<text text-anchor=\"middle\" x=\"289.5\" y=\"-8406.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4c_3x3_reduce -->\n",
       "<g id=\"node127\" class=\"node\"><title>relu_in4c_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"310,-8646 216,-8646 216,-8588 310,-8588 310,-8646\"/>\n",
       "<text text-anchor=\"middle\" x=\"263\" y=\"-8620.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"263\" y=\"-8605.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4c_3x3_reduce&#45;&gt;bn_in4c_3x3_reduce -->\n",
       "<g id=\"edge140\" class=\"edge\"><title>relu_in4c_3x3_reduce&#45;&gt;bn_in4c_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M261.974,-8577.51C261.279,-8551.45 260.377,-8517.62 259.749,-8494.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"262.248,-8587.79 257.483,-8577.91 262.114,-8582.79 261.981,-8577.79 261.981,-8577.79 261.981,-8577.79 262.114,-8582.79 266.479,-8577.67 262.248,-8587.79 262.248,-8587.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"292.5\" y=\"-8537.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4c_3x3 -->\n",
       "<g id=\"node128\" class=\"node\"><title>conv_in4c_3x3</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"310,-8798 216,-8798 216,-8740 310,-8740 310,-8798\"/>\n",
       "<text text-anchor=\"middle\" x=\"263\" y=\"-8772.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"263\" y=\"-8757.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 160</text>\n",
       "</g>\n",
       "<!-- conv_in4c_3x3&#45;&gt;relu_in4c_3x3_reduce -->\n",
       "<g id=\"edge141\" class=\"edge\"><title>conv_in4c_3x3&#45;&gt;relu_in4c_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M263,-8729.51C263,-8703.45 263,-8669.62 263,-8646.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"263,-8739.79 258.5,-8729.79 263,-8734.79 263,-8729.79 263,-8729.79 263,-8729.79 263,-8734.79 267.5,-8729.79 263,-8739.79 263,-8739.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"293.5\" y=\"-8689.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4c_3x3 -->\n",
       "<g id=\"node129\" class=\"node\"><title>bn_in4c_3x3</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"310,-8950 216,-8950 216,-8892 310,-8892 310,-8950\"/>\n",
       "<text text-anchor=\"middle\" x=\"263\" y=\"-8917.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4c_3x3&#45;&gt;conv_in4c_3x3 -->\n",
       "<g id=\"edge142\" class=\"edge\"><title>bn_in4c_3x3&#45;&gt;conv_in4c_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M263,-8881.51C263,-8855.45 263,-8821.62 263,-8798.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"263,-8891.79 258.5,-8881.79 263,-8886.79 263,-8881.79 263,-8881.79 263,-8881.79 263,-8886.79 267.5,-8881.79 263,-8891.79 263,-8891.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"293.5\" y=\"-8841.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4c_3x3 -->\n",
       "<g id=\"node130\" class=\"node\"><title>relu_in4c_3x3</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"310,-9102 216,-9102 216,-9044 310,-9044 310,-9102\"/>\n",
       "<text text-anchor=\"middle\" x=\"263\" y=\"-9076.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"263\" y=\"-9061.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4c_3x3&#45;&gt;bn_in4c_3x3 -->\n",
       "<g id=\"edge143\" class=\"edge\"><title>relu_in4c_3x3&#45;&gt;bn_in4c_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M263,-9033.51C263,-9007.45 263,-8973.62 263,-8950.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"263,-9043.79 258.5,-9033.79 263,-9038.79 263,-9033.79 263,-9033.79 263,-9033.79 263,-9038.79 267.5,-9033.79 263,-9043.79 263,-9043.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"293.5\" y=\"-8993.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4c_double_3x3_reduce -->\n",
       "<g id=\"node131\" class=\"node\"><title>conv_in4c_double_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"405,-8012 311,-8012 311,-7954 405,-7954 405,-8012\"/>\n",
       "<text text-anchor=\"middle\" x=\"358\" y=\"-7986.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"358\" y=\"-7971.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 128</text>\n",
       "</g>\n",
       "<!-- conv_in4c_double_3x3_reduce&#45;&gt;ch_concat_in4b_chconcat -->\n",
       "<g id=\"edge144\" class=\"edge\"><title>conv_in4c_double_3x3_reduce&#45;&gt;ch_concat_in4b_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M340.692,-7944.62C334.271,-7930.75 327.101,-7915.26 321.115,-7902.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"344.994,-7953.91 336.709,-7946.72 342.893,-7949.37 340.792,-7944.83 340.792,-7944.83 340.792,-7944.83 342.893,-7949.37 344.876,-7942.94 344.994,-7953.91 344.994,-7953.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"366.5\" y=\"-7924.3\" font-family=\"Times,serif\" font-size=\"14.00\">576x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4c_double_3x3_reduce -->\n",
       "<g id=\"node132\" class=\"node\"><title>bn_in4c_double_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"431,-8122 337,-8122 337,-8064 431,-8064 431,-8122\"/>\n",
       "<text text-anchor=\"middle\" x=\"384\" y=\"-8089.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4c_double_3x3_reduce&#45;&gt;conv_in4c_double_3x3_reduce -->\n",
       "<g id=\"edge145\" class=\"edge\"><title>bn_in4c_double_3x3_reduce&#45;&gt;conv_in4c_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M374.807,-8053.81C371.518,-8040.15 367.873,-8025.01 364.82,-8012.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"377.237,-8063.91 370.521,-8055.24 376.066,-8059.05 374.896,-8054.18 374.896,-8054.18 374.896,-8054.18 376.066,-8059.05 379.271,-8053.13 377.237,-8063.91 377.237,-8063.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"403.5\" y=\"-8034.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4c_double_3x3_reduce -->\n",
       "<g id=\"node133\" class=\"node\"><title>relu_in4c_double_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"423,-8232 329,-8232 329,-8174 423,-8174 423,-8232\"/>\n",
       "<text text-anchor=\"middle\" x=\"376\" y=\"-8206.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"376\" y=\"-8191.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4c_double_3x3_reduce&#45;&gt;bn_in4c_double_3x3_reduce -->\n",
       "<g id=\"edge146\" class=\"edge\"><title>relu_in4c_double_3x3_reduce&#45;&gt;bn_in4c_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M378.829,-8163.81C379.841,-8150.15 380.962,-8135.01 381.902,-8122.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"378.081,-8173.91 374.332,-8163.6 378.45,-8168.92 378.82,-8163.93 378.82,-8163.93 378.82,-8163.93 378.45,-8168.92 383.308,-8164.27 378.081,-8173.91 378.081,-8173.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"411.5\" y=\"-8144.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4c_double_3x3_0 -->\n",
       "<g id=\"node134\" class=\"node\"><title>conv_in4c_double_3x3_0</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"422,-8384 328,-8384 328,-8326 422,-8326 422,-8384\"/>\n",
       "<text text-anchor=\"middle\" x=\"375\" y=\"-8358.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"375\" y=\"-8343.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 160</text>\n",
       "</g>\n",
       "<!-- conv_in4c_double_3x3_0&#45;&gt;relu_in4c_double_3x3_reduce -->\n",
       "<g id=\"edge147\" class=\"edge\"><title>conv_in4c_double_3x3_0&#45;&gt;relu_in4c_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M375.257,-8315.51C375.43,-8289.45 375.656,-8255.62 375.813,-8232.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"375.188,-8325.79 370.755,-8315.76 375.221,-8320.79 375.255,-8315.79 375.255,-8315.79 375.255,-8315.79 375.221,-8320.79 379.755,-8315.82 375.188,-8325.79 375.188,-8325.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"406.5\" y=\"-8275.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4c_double_3x3_0 -->\n",
       "<g id=\"node135\" class=\"node\"><title>bn_in4c_double_3x3_0</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"421,-8494 327,-8494 327,-8436 421,-8436 421,-8494\"/>\n",
       "<text text-anchor=\"middle\" x=\"374\" y=\"-8461.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4c_double_3x3_0&#45;&gt;conv_in4c_double_3x3_0 -->\n",
       "<g id=\"edge148\" class=\"edge\"><title>bn_in4c_double_3x3_0&#45;&gt;conv_in4c_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M374.354,-8425.81C374.48,-8412.15 374.62,-8397.01 374.738,-8384.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"374.26,-8435.91 369.853,-8425.86 374.306,-8430.91 374.353,-8425.91 374.353,-8425.91 374.353,-8425.91 374.306,-8430.91 378.853,-8425.95 374.26,-8435.91 374.26,-8435.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"405.5\" y=\"-8406.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4c_double_3x3_0 -->\n",
       "<g id=\"node136\" class=\"node\"><title>relu_in4c_double_3x3_0</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"422,-8646 328,-8646 328,-8588 422,-8588 422,-8646\"/>\n",
       "<text text-anchor=\"middle\" x=\"375\" y=\"-8620.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"375\" y=\"-8605.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4c_double_3x3_0&#45;&gt;bn_in4c_double_3x3_0 -->\n",
       "<g id=\"edge149\" class=\"edge\"><title>relu_in4c_double_3x3_0&#45;&gt;bn_in4c_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M370.524,-8577.75C370.316,-8575.13 370.137,-8572.53 370,-8570 368.605,-8544.26 368.882,-8537.75 370,-8512 370.25,-8506.23 370.676,-8500.07 371.159,-8494.19\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"371.449,-8587.82 366.054,-8578.27 370.992,-8582.84 370.535,-8577.86 370.535,-8577.86 370.535,-8577.86 370.992,-8582.84 375.016,-8577.45 371.449,-8587.82 371.449,-8587.82\"/>\n",
       "<text text-anchor=\"middle\" x=\"400.5\" y=\"-8537.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4c_double_3x3_1 -->\n",
       "<g id=\"node137\" class=\"node\"><title>conv_in4c_double_3x3_1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"422,-8798 328,-8798 328,-8740 422,-8740 422,-8798\"/>\n",
       "<text text-anchor=\"middle\" x=\"375\" y=\"-8772.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"375\" y=\"-8757.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 160</text>\n",
       "</g>\n",
       "<!-- conv_in4c_double_3x3_1&#45;&gt;relu_in4c_double_3x3_0 -->\n",
       "<g id=\"edge150\" class=\"edge\"><title>conv_in4c_double_3x3_1&#45;&gt;relu_in4c_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M375,-8729.51C375,-8703.45 375,-8669.62 375,-8646.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"375,-8739.79 370.5,-8729.79 375,-8734.79 375,-8729.79 375,-8729.79 375,-8729.79 375,-8734.79 379.5,-8729.79 375,-8739.79 375,-8739.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"405.5\" y=\"-8689.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4c_double_3x3_1 -->\n",
       "<g id=\"node138\" class=\"node\"><title>bn_in4c_double_3x3_1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"422,-8950 328,-8950 328,-8892 422,-8892 422,-8950\"/>\n",
       "<text text-anchor=\"middle\" x=\"375\" y=\"-8917.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4c_double_3x3_1&#45;&gt;conv_in4c_double_3x3_1 -->\n",
       "<g id=\"edge151\" class=\"edge\"><title>bn_in4c_double_3x3_1&#45;&gt;conv_in4c_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M375,-8881.51C375,-8855.45 375,-8821.62 375,-8798.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"375,-8891.79 370.5,-8881.79 375,-8886.79 375,-8881.79 375,-8881.79 375,-8881.79 375,-8886.79 379.5,-8881.79 375,-8891.79 375,-8891.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"405.5\" y=\"-8841.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4c_double_3x3_1 -->\n",
       "<g id=\"node139\" class=\"node\"><title>relu_in4c_double_3x3_1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"422,-9102 328,-9102 328,-9044 422,-9044 422,-9102\"/>\n",
       "<text text-anchor=\"middle\" x=\"375\" y=\"-9076.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"375\" y=\"-9061.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4c_double_3x3_1&#45;&gt;bn_in4c_double_3x3_1 -->\n",
       "<g id=\"edge152\" class=\"edge\"><title>relu_in4c_double_3x3_1&#45;&gt;bn_in4c_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M375,-9033.51C375,-9007.45 375,-8973.62 375,-8950.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"375,-9043.79 370.5,-9033.79 375,-9038.79 375,-9033.79 375,-9033.79 375,-9033.79 375,-9038.79 379.5,-9033.79 375,-9043.79 375,-9043.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"405.5\" y=\"-8993.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- avg_pool_in4c_pool -->\n",
       "<g id=\"node140\" class=\"node\"><title>avg_pool_in4c_pool</title>\n",
       "<polygon fill=\"#80b1d3\" stroke=\"black\" points=\"534,-8570 440,-8570 440,-8512 534,-8512 534,-8570\"/>\n",
       "<text text-anchor=\"middle\" x=\"487\" y=\"-8544.8\" font-family=\"Times,serif\" font-size=\"14.00\">Pooling</text>\n",
       "<text text-anchor=\"middle\" x=\"487\" y=\"-8529.8\" font-family=\"Times,serif\" font-size=\"14.00\">avg, 3x3/1</text>\n",
       "</g>\n",
       "<!-- avg_pool_in4c_pool&#45;&gt;ch_concat_in4b_chconcat -->\n",
       "<g id=\"edge153\" class=\"edge\"><title>avg_pool_in4c_pool&#45;&gt;ch_concat_in4b_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M474.375,-8502.31C466.948,-8476.83 459,-8442.26 459,-8411 459,-8411 459,-8411 459,-7982 459,-7930.27 399.646,-7900.95 355.363,-7886.28\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"477.286,-8511.94 470.087,-8503.67 475.84,-8507.16 474.394,-8502.37 474.394,-8502.37 474.394,-8502.37 475.84,-8507.16 478.702,-8501.07 477.286,-8511.94 477.286,-8511.94\"/>\n",
       "<text text-anchor=\"middle\" x=\"489.5\" y=\"-8199.3\" font-family=\"Times,serif\" font-size=\"14.00\">576x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4c_proj -->\n",
       "<g id=\"node141\" class=\"node\"><title>conv_in4c_proj</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"534,-8798 440,-8798 440,-8740 534,-8740 534,-8798\"/>\n",
       "<text text-anchor=\"middle\" x=\"487\" y=\"-8772.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"487\" y=\"-8757.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 128</text>\n",
       "</g>\n",
       "<!-- conv_in4c_proj&#45;&gt;avg_pool_in4c_pool -->\n",
       "<g id=\"edge154\" class=\"edge\"><title>conv_in4c_proj&#45;&gt;avg_pool_in4c_pool</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M487,-8729.83C487,-8684.64 487,-8610.45 487,-8570.17\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"487,-8739.83 482.5,-8729.83 487,-8734.83 487,-8729.83 487,-8729.83 487,-8729.83 487,-8734.83 491.5,-8729.83 487,-8739.83 487,-8739.83\"/>\n",
       "<text text-anchor=\"middle\" x=\"517.5\" y=\"-8689.3\" font-family=\"Times,serif\" font-size=\"14.00\">576x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4c_proj -->\n",
       "<g id=\"node142\" class=\"node\"><title>bn_in4c_proj</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"534,-8950 440,-8950 440,-8892 534,-8892 534,-8950\"/>\n",
       "<text text-anchor=\"middle\" x=\"487\" y=\"-8917.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4c_proj&#45;&gt;conv_in4c_proj -->\n",
       "<g id=\"edge155\" class=\"edge\"><title>bn_in4c_proj&#45;&gt;conv_in4c_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M487,-8881.51C487,-8855.45 487,-8821.62 487,-8798.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"487,-8891.79 482.5,-8881.79 487,-8886.79 487,-8881.79 487,-8881.79 487,-8881.79 487,-8886.79 491.5,-8881.79 487,-8891.79 487,-8891.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"517.5\" y=\"-8841.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4c_proj -->\n",
       "<g id=\"node143\" class=\"node\"><title>relu_in4c_proj</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"534,-9102 440,-9102 440,-9044 534,-9044 534,-9102\"/>\n",
       "<text text-anchor=\"middle\" x=\"487\" y=\"-9076.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"487\" y=\"-9061.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4c_proj&#45;&gt;bn_in4c_proj -->\n",
       "<g id=\"edge156\" class=\"edge\"><title>relu_in4c_proj&#45;&gt;bn_in4c_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M487,-9033.51C487,-9007.45 487,-8973.62 487,-8950.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"487,-9043.79 482.5,-9033.79 487,-9038.79 487,-9033.79 487,-9033.79 487,-9033.79 487,-9038.79 491.5,-9033.79 487,-9043.79 487,-9043.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"517.5\" y=\"-8993.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4c_chconcat -->\n",
       "<g id=\"node144\" class=\"node\"><title>ch_concat_in4c_chconcat</title>\n",
       "<polygon fill=\"#fdb462\" stroke=\"black\" points=\"366,-9212 272,-9212 272,-9154 366,-9154 366,-9212\"/>\n",
       "<text text-anchor=\"middle\" x=\"319\" y=\"-9179.3\" font-family=\"Times,serif\" font-size=\"14.00\">Concat</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4c_chconcat&#45;&gt;relu_in4c_1x1 -->\n",
       "<g id=\"edge157\" class=\"edge\"><title>ch_concat_in4c_chconcat&#45;&gt;relu_in4c_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M262.36,-9165.93C245.215,-9158.92 227.4,-9149.2 214,-9136 182.943,-9105.42 165.712,-9056.7 157.409,-9026.08\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"271.783,-9169.56 260.834,-9170.17 267.116,-9167.76 262.449,-9165.97 262.449,-9165.97 262.449,-9165.97 267.116,-9167.76 264.064,-9161.77 271.783,-9169.56 271.783,-9169.56\"/>\n",
       "<text text-anchor=\"middle\" x=\"244.5\" y=\"-9124.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4c_chconcat&#45;&gt;relu_in4c_3x3 -->\n",
       "<g id=\"edge158\" class=\"edge\"><title>ch_concat_in4c_chconcat&#45;&gt;relu_in4c_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M290.392,-9145.22C288.46,-9142.17 286.635,-9139.07 285,-9136 279.369,-9125.41 274.657,-9113.08 271.056,-9102.21\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"296.052,-9153.66 286.744,-9147.86 293.267,-9149.51 290.481,-9145.35 290.481,-9145.35 290.481,-9145.35 293.267,-9149.51 294.218,-9142.85 296.052,-9153.66 296.052,-9153.66\"/>\n",
       "<text text-anchor=\"middle\" x=\"315.5\" y=\"-9124.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4c_chconcat&#45;&gt;relu_in4c_double_3x3_1 -->\n",
       "<g id=\"edge159\" class=\"edge\"><title>ch_concat_in4c_chconcat&#45;&gt;relu_in4c_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M341.251,-9144.76C342.891,-9141.81 344.491,-9138.87 346,-9136 351.752,-9125.06 357.617,-9112.78 362.553,-9102.05\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"336.27,-9153.52 337.299,-9142.61 338.74,-9149.18 341.211,-9144.83 341.211,-9144.83 341.211,-9144.83 338.74,-9149.18 345.123,-9147.05 336.27,-9153.52 336.27,-9153.52\"/>\n",
       "<text text-anchor=\"middle\" x=\"384.5\" y=\"-9124.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4c_chconcat&#45;&gt;relu_in4c_proj -->\n",
       "<g id=\"edge160\" class=\"edge\"><title>ch_concat_in4c_chconcat&#45;&gt;relu_in4c_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M375.602,-9159.64C390.222,-9152.88 405.606,-9144.88 419,-9136 433.649,-9126.29 448.264,-9113.48 460.17,-9102.02\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"366.132,-9163.89 373.411,-9155.69 370.693,-9161.84 375.255,-9159.79 375.255,-9159.79 375.255,-9159.79 370.693,-9161.84 377.098,-9163.9 366.132,-9163.89 366.132,-9163.89\"/>\n",
       "<text text-anchor=\"middle\" x=\"469.5\" y=\"-9124.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4d_1x1 -->\n",
       "<g id=\"node145\" class=\"node\"><title>conv_in4d_1x1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"202,-10032 108,-10032 108,-9974 202,-9974 202,-10032\"/>\n",
       "<text text-anchor=\"middle\" x=\"155\" y=\"-10006.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"155\" y=\"-9991.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 96</text>\n",
       "</g>\n",
       "<!-- conv_in4d_1x1&#45;&gt;ch_concat_in4c_chconcat -->\n",
       "<g id=\"edge161\" class=\"edge\"><title>conv_in4d_1x1&#45;&gt;ch_concat_in4c_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M155.396,-9963.66C155.676,-9933.35 156,-9889.97 156,-9852 156,-9852 156,-9852 156,-9292 156,-9235.99 223.714,-9207.31 271.854,-9194.01\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"155.3,-9973.8 150.895,-9963.76 155.348,-9968.8 155.395,-9963.8 155.395,-9963.8 155.395,-9963.8 155.348,-9968.8 159.895,-9963.84 155.3,-9973.8 155.3,-9973.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"186.5\" y=\"-9585.3\" font-family=\"Times,serif\" font-size=\"14.00\">608x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4d_1x1 -->\n",
       "<g id=\"node146\" class=\"node\"><title>bn_in4d_1x1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"199,-10184 105,-10184 105,-10126 199,-10126 199,-10184\"/>\n",
       "<text text-anchor=\"middle\" x=\"152\" y=\"-10151.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4d_1x1&#45;&gt;conv_in4d_1x1 -->\n",
       "<g id=\"edge162\" class=\"edge\"><title>bn_in4d_1x1&#45;&gt;conv_in4d_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M152.77,-10115.5C153.291,-10089.5 153.968,-10055.6 154.438,-10032.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"152.564,-10125.8 148.265,-10115.7 152.664,-10120.8 152.764,-10115.8 152.764,-10115.8 152.764,-10115.8 152.664,-10120.8 157.263,-10115.9 152.564,-10125.8 152.564,-10125.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"182.5\" y=\"-10075.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4d_1x1 -->\n",
       "<g id=\"node147\" class=\"node\"><title>relu_in4d_1x1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"218,-10336 124,-10336 124,-10278 218,-10278 218,-10336\"/>\n",
       "<text text-anchor=\"middle\" x=\"171\" y=\"-10310.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"171\" y=\"-10295.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4d_1x1&#45;&gt;bn_in4d_1x1 -->\n",
       "<g id=\"edge163\" class=\"edge\"><title>relu_in4d_1x1&#45;&gt;bn_in4d_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M162.357,-10268.1C161.859,-10265.3 161.399,-10262.6 161,-10260 157.149,-10234.6 154.801,-10205.3 153.474,-10184.4\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"164.293,-10277.9 157.943,-10268.9 163.325,-10273 162.358,-10268.1 162.358,-10268.1 162.358,-10268.1 163.325,-10273 166.772,-10267.2 164.293,-10277.9 164.293,-10277.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"188.5\" y=\"-10227.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4d_3x3_reduce -->\n",
       "<g id=\"node148\" class=\"node\"><title>conv_in4d_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"317,-9618 223,-9618 223,-9560 317,-9560 317,-9618\"/>\n",
       "<text text-anchor=\"middle\" x=\"270\" y=\"-9592.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"270\" y=\"-9577.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 128</text>\n",
       "</g>\n",
       "<!-- conv_in4d_3x3_reduce&#45;&gt;ch_concat_in4c_chconcat -->\n",
       "<g id=\"edge164\" class=\"edge\"><title>conv_in4d_3x3_reduce&#45;&gt;ch_concat_in4c_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M269.548,-9549.75C269.283,-9524.08 269,-9489.51 269,-9459 269,-9459 269,-9459 269,-9292 269,-9262.87 284.168,-9233.06 297.795,-9212.16\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"269.656,-9559.82 265.049,-9549.86 269.602,-9554.82 269.549,-9549.82 269.549,-9549.82 269.549,-9549.82 269.602,-9554.82 274.049,-9549.77 269.656,-9559.82 269.656,-9559.82\"/>\n",
       "<text text-anchor=\"middle\" x=\"299.5\" y=\"-9399.3\" font-family=\"Times,serif\" font-size=\"14.00\">608x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4d_3x3_reduce -->\n",
       "<g id=\"node149\" class=\"node\"><title>bn_in4d_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"317,-9804 223,-9804 223,-9746 317,-9746 317,-9804\"/>\n",
       "<text text-anchor=\"middle\" x=\"270\" y=\"-9771.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4d_3x3_reduce&#45;&gt;conv_in4d_3x3_reduce -->\n",
       "<g id=\"edge165\" class=\"edge\"><title>bn_in4d_3x3_reduce&#45;&gt;conv_in4d_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M270,-9735.32C270,-9700.25 270,-9649.39 270,-9618.08\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"270,-9745.65 265.5,-9735.65 270,-9740.65 270,-9735.65 270,-9735.65 270,-9735.65 270,-9740.65 274.5,-9735.65 270,-9745.65 270,-9745.65\"/>\n",
       "<text text-anchor=\"middle\" x=\"300.5\" y=\"-9716.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4d_3x3_reduce -->\n",
       "<g id=\"node150\" class=\"node\"><title>relu_in4d_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"317,-9956 223,-9956 223,-9898 317,-9898 317,-9956\"/>\n",
       "<text text-anchor=\"middle\" x=\"270\" y=\"-9930.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"270\" y=\"-9915.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4d_3x3_reduce&#45;&gt;bn_in4d_3x3_reduce -->\n",
       "<g id=\"edge166\" class=\"edge\"><title>relu_in4d_3x3_reduce&#45;&gt;bn_in4d_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M270,-9887.51C270,-9861.45 270,-9827.62 270,-9804.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"270,-9897.79 265.5,-9887.79 270,-9892.79 270,-9887.79 270,-9887.79 270,-9887.79 270,-9892.79 274.5,-9887.79 270,-9897.79 270,-9897.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"300.5\" y=\"-9847.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4d_3x3 -->\n",
       "<g id=\"node151\" class=\"node\"><title>conv_in4d_3x3</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"319,-10108 225,-10108 225,-10050 319,-10050 319,-10108\"/>\n",
       "<text text-anchor=\"middle\" x=\"272\" y=\"-10082.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"272\" y=\"-10067.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 192</text>\n",
       "</g>\n",
       "<!-- conv_in4d_3x3&#45;&gt;relu_in4d_3x3_reduce -->\n",
       "<g id=\"edge167\" class=\"edge\"><title>conv_in4d_3x3&#45;&gt;relu_in4d_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M271.487,-10039.5C271.139,-10013.5 270.688,-9979.62 270.374,-9956.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"271.624,-10049.8 266.991,-10039.8 271.557,-10044.8 271.49,-10039.8 271.49,-10039.8 271.49,-10039.8 271.557,-10044.8 275.99,-10039.7 271.624,-10049.8 271.624,-10049.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"302.5\" y=\"-9999.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4d_3x3 -->\n",
       "<g id=\"node152\" class=\"node\"><title>bn_in4d_3x3</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"319,-10260 225,-10260 225,-10202 319,-10202 319,-10260\"/>\n",
       "<text text-anchor=\"middle\" x=\"272\" y=\"-10227.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4d_3x3&#45;&gt;conv_in4d_3x3 -->\n",
       "<g id=\"edge168\" class=\"edge\"><title>bn_in4d_3x3&#45;&gt;conv_in4d_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M272,-10191.5C272,-10165.5 272,-10131.6 272,-10108.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"272,-10201.8 267.5,-10191.8 272,-10196.8 272,-10191.8 272,-10191.8 272,-10191.8 272,-10196.8 276.5,-10191.8 272,-10201.8 272,-10201.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"302.5\" y=\"-10151.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4d_3x3 -->\n",
       "<g id=\"node153\" class=\"node\"><title>relu_in4d_3x3</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"319,-10412 225,-10412 225,-10354 319,-10354 319,-10412\"/>\n",
       "<text text-anchor=\"middle\" x=\"272\" y=\"-10386.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"272\" y=\"-10371.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4d_3x3&#45;&gt;bn_in4d_3x3 -->\n",
       "<g id=\"edge169\" class=\"edge\"><title>relu_in4d_3x3&#45;&gt;bn_in4d_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M272,-10343.5C272,-10317.5 272,-10283.6 272,-10260.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"272,-10353.8 267.5,-10343.8 272,-10348.8 272,-10343.8 272,-10343.8 272,-10343.8 272,-10348.8 276.5,-10343.8 272,-10353.8 272,-10353.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"302.5\" y=\"-10303.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4d_double_3x3_reduce -->\n",
       "<g id=\"node154\" class=\"node\"><title>conv_in4d_double_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"416,-9322 322,-9322 322,-9264 416,-9264 416,-9322\"/>\n",
       "<text text-anchor=\"middle\" x=\"369\" y=\"-9296.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"369\" y=\"-9281.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 160</text>\n",
       "</g>\n",
       "<!-- conv_in4d_double_3x3_reduce&#45;&gt;ch_concat_in4c_chconcat -->\n",
       "<g id=\"edge170\" class=\"edge\"><title>conv_in4d_double_3x3_reduce&#45;&gt;ch_concat_in4c_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M351.692,-9254.62C345.271,-9240.75 338.101,-9225.26 332.115,-9212.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"355.994,-9263.91 347.709,-9256.72 353.893,-9259.37 351.792,-9254.83 351.792,-9254.83 351.792,-9254.83 353.893,-9259.37 355.876,-9252.94 355.994,-9263.91 355.994,-9263.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"377.5\" y=\"-9234.3\" font-family=\"Times,serif\" font-size=\"14.00\">608x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4d_double_3x3_reduce -->\n",
       "<g id=\"node155\" class=\"node\"><title>bn_in4d_double_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"442,-9432 348,-9432 348,-9374 442,-9374 442,-9432\"/>\n",
       "<text text-anchor=\"middle\" x=\"395\" y=\"-9399.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4d_double_3x3_reduce&#45;&gt;conv_in4d_double_3x3_reduce -->\n",
       "<g id=\"edge171\" class=\"edge\"><title>bn_in4d_double_3x3_reduce&#45;&gt;conv_in4d_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M385.807,-9363.81C382.518,-9350.15 378.873,-9335.01 375.82,-9322.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"388.237,-9373.91 381.521,-9365.24 387.066,-9369.05 385.896,-9364.18 385.896,-9364.18 385.896,-9364.18 387.066,-9369.05 390.271,-9363.13 388.237,-9373.91 388.237,-9373.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"413.5\" y=\"-9344.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4d_double_3x3_reduce -->\n",
       "<g id=\"node156\" class=\"node\"><title>relu_in4d_double_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"434,-9542 340,-9542 340,-9484 434,-9484 434,-9542\"/>\n",
       "<text text-anchor=\"middle\" x=\"387\" y=\"-9516.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"387\" y=\"-9501.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4d_double_3x3_reduce&#45;&gt;bn_in4d_double_3x3_reduce -->\n",
       "<g id=\"edge172\" class=\"edge\"><title>relu_in4d_double_3x3_reduce&#45;&gt;bn_in4d_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M389.829,-9473.81C390.841,-9460.15 391.962,-9445.01 392.902,-9432.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"389.081,-9483.91 385.332,-9473.6 389.45,-9478.92 389.82,-9473.93 389.82,-9473.93 389.82,-9473.93 389.45,-9478.92 394.308,-9474.27 389.081,-9483.91 389.081,-9483.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"421.5\" y=\"-9454.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4d_double_3x3_0 -->\n",
       "<g id=\"node157\" class=\"node\"><title>conv_in4d_double_3x3_0</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"432,-9694 338,-9694 338,-9636 432,-9636 432,-9694\"/>\n",
       "<text text-anchor=\"middle\" x=\"385\" y=\"-9668.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"385\" y=\"-9653.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 192</text>\n",
       "</g>\n",
       "<!-- conv_in4d_double_3x3_0&#45;&gt;relu_in4d_double_3x3_reduce -->\n",
       "<g id=\"edge173\" class=\"edge\"><title>conv_in4d_double_3x3_0&#45;&gt;relu_in4d_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M385.513,-9625.51C385.861,-9599.45 386.312,-9565.62 386.626,-9542.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"385.376,-9635.79 381.01,-9625.73 385.443,-9630.79 385.51,-9625.79 385.51,-9625.79 385.51,-9625.79 385.443,-9630.79 390.009,-9625.85 385.376,-9635.79 385.376,-9635.79\"/>\n",
       "<text text-anchor=\"middle\" x=\"416.5\" y=\"-9585.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4d_double_3x3_0 -->\n",
       "<g id=\"node158\" class=\"node\"><title>bn_in4d_double_3x3_0</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"430,-9804 336,-9804 336,-9746 430,-9746 430,-9804\"/>\n",
       "<text text-anchor=\"middle\" x=\"383\" y=\"-9771.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4d_double_3x3_0&#45;&gt;conv_in4d_double_3x3_0 -->\n",
       "<g id=\"edge174\" class=\"edge\"><title>bn_in4d_double_3x3_0&#45;&gt;conv_in4d_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M383.707,-9735.81C383.96,-9722.15 384.241,-9707.01 384.475,-9694.33\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"383.52,-9745.91 379.206,-9735.82 383.613,-9740.91 383.706,-9735.91 383.706,-9735.91 383.706,-9735.91 383.613,-9740.91 388.205,-9735.99 383.52,-9745.91 383.52,-9745.91\"/>\n",
       "<text text-anchor=\"middle\" x=\"414.5\" y=\"-9716.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4d_double_3x3_0 -->\n",
       "<g id=\"node159\" class=\"node\"><title>relu_in4d_double_3x3_0</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"430,-9956 336,-9956 336,-9898 430,-9898 430,-9956\"/>\n",
       "<text text-anchor=\"middle\" x=\"383\" y=\"-9930.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"383\" y=\"-9915.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4d_double_3x3_0&#45;&gt;bn_in4d_double_3x3_0 -->\n",
       "<g id=\"edge175\" class=\"edge\"><title>relu_in4d_double_3x3_0&#45;&gt;bn_in4d_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M379.419,-9887.74C379.253,-9885.12 379.109,-9882.52 379,-9880 377.882,-9854.25 377.882,-9847.75 379,-9822 379.25,-9816.23 379.676,-9810.07 380.159,-9804.19\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"380.159,-9897.81 374.938,-9888.16 379.793,-9892.82 379.426,-9887.83 379.426,-9887.83 379.426,-9887.83 379.793,-9892.82 383.914,-9887.5 380.159,-9897.81 380.159,-9897.81\"/>\n",
       "<text text-anchor=\"middle\" x=\"409.5\" y=\"-9847.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4d_double_3x3_1 -->\n",
       "<g id=\"node160\" class=\"node\"><title>conv_in4d_double_3x3_1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"431,-10108 337,-10108 337,-10050 431,-10050 431,-10108\"/>\n",
       "<text text-anchor=\"middle\" x=\"384\" y=\"-10082.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"384\" y=\"-10067.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 192</text>\n",
       "</g>\n",
       "<!-- conv_in4d_double_3x3_1&#45;&gt;relu_in4d_double_3x3_0 -->\n",
       "<g id=\"edge176\" class=\"edge\"><title>conv_in4d_double_3x3_1&#45;&gt;relu_in4d_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M383.743,-10039.5C383.57,-10013.5 383.344,-9979.62 383.187,-9956.09\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"383.812,-10049.8 379.245,-10039.8 383.779,-10044.8 383.745,-10039.8 383.745,-10039.8 383.745,-10039.8 383.779,-10044.8 388.245,-10039.8 383.812,-10049.8 383.812,-10049.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"413.5\" y=\"-9999.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4d_double_3x3_1 -->\n",
       "<g id=\"node161\" class=\"node\"><title>bn_in4d_double_3x3_1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"431,-10260 337,-10260 337,-10202 431,-10202 431,-10260\"/>\n",
       "<text text-anchor=\"middle\" x=\"384\" y=\"-10227.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4d_double_3x3_1&#45;&gt;conv_in4d_double_3x3_1 -->\n",
       "<g id=\"edge177\" class=\"edge\"><title>bn_in4d_double_3x3_1&#45;&gt;conv_in4d_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M384,-10191.5C384,-10165.5 384,-10131.6 384,-10108.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"384,-10201.8 379.5,-10191.8 384,-10196.8 384,-10191.8 384,-10191.8 384,-10191.8 384,-10196.8 388.5,-10191.8 384,-10201.8 384,-10201.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"414.5\" y=\"-10151.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4d_double_3x3_1 -->\n",
       "<g id=\"node162\" class=\"node\"><title>relu_in4d_double_3x3_1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"431,-10412 337,-10412 337,-10354 431,-10354 431,-10412\"/>\n",
       "<text text-anchor=\"middle\" x=\"384\" y=\"-10386.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"384\" y=\"-10371.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4d_double_3x3_1&#45;&gt;bn_in4d_double_3x3_1 -->\n",
       "<g id=\"edge178\" class=\"edge\"><title>relu_in4d_double_3x3_1&#45;&gt;bn_in4d_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M384,-10343.5C384,-10317.5 384,-10283.6 384,-10260.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"384,-10353.8 379.5,-10343.8 384,-10348.8 384,-10343.8 384,-10343.8 384,-10343.8 384,-10348.8 388.5,-10343.8 384,-10353.8 384,-10353.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"414.5\" y=\"-10303.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x14x14</text>\n",
       "</g>\n",
       "<!-- avg_pool_in4d_pool -->\n",
       "<g id=\"node163\" class=\"node\"><title>avg_pool_in4d_pool</title>\n",
       "<polygon fill=\"#80b1d3\" stroke=\"black\" points=\"543,-9880 449,-9880 449,-9822 543,-9822 543,-9880\"/>\n",
       "<text text-anchor=\"middle\" x=\"496\" y=\"-9854.8\" font-family=\"Times,serif\" font-size=\"14.00\">Pooling</text>\n",
       "<text text-anchor=\"middle\" x=\"496\" y=\"-9839.8\" font-family=\"Times,serif\" font-size=\"14.00\">avg, 3x3/1</text>\n",
       "</g>\n",
       "<!-- avg_pool_in4d_pool&#45;&gt;ch_concat_in4c_chconcat -->\n",
       "<g id=\"edge179\" class=\"edge\"><title>avg_pool_in4d_pool&#45;&gt;ch_concat_in4c_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M484.277,-9812.24C477.381,-9786.74 470,-9752.16 470,-9721 470,-9721 470,-9721 470,-9292 470,-9240.27 410.646,-9210.95 366.363,-9196.28\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"486.979,-9821.89 479.949,-9813.47 485.631,-9817.08 484.282,-9812.26 484.282,-9812.26 484.282,-9812.26 485.631,-9817.08 488.616,-9811.05 486.979,-9821.89 486.979,-9821.89\"/>\n",
       "<text text-anchor=\"middle\" x=\"500.5\" y=\"-9509.3\" font-family=\"Times,serif\" font-size=\"14.00\">608x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4d_proj -->\n",
       "<g id=\"node164\" class=\"node\"><title>conv_in4d_proj</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"543,-10108 449,-10108 449,-10050 543,-10050 543,-10108\"/>\n",
       "<text text-anchor=\"middle\" x=\"496\" y=\"-10082.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"496\" y=\"-10067.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 128</text>\n",
       "</g>\n",
       "<!-- conv_in4d_proj&#45;&gt;avg_pool_in4d_pool -->\n",
       "<g id=\"edge180\" class=\"edge\"><title>conv_in4d_proj&#45;&gt;avg_pool_in4d_pool</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M496,-10039.8C496,-9994.64 496,-9920.45 496,-9880.17\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"496,-10049.8 491.5,-10039.8 496,-10044.8 496,-10039.8 496,-10039.8 496,-10039.8 496,-10044.8 500.5,-10039.8 496,-10049.8 496,-10049.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"526.5\" y=\"-9999.3\" font-family=\"Times,serif\" font-size=\"14.00\">608x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4d_proj -->\n",
       "<g id=\"node165\" class=\"node\"><title>bn_in4d_proj</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"543,-10260 449,-10260 449,-10202 543,-10202 543,-10260\"/>\n",
       "<text text-anchor=\"middle\" x=\"496\" y=\"-10227.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4d_proj&#45;&gt;conv_in4d_proj -->\n",
       "<g id=\"edge181\" class=\"edge\"><title>bn_in4d_proj&#45;&gt;conv_in4d_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M496,-10191.5C496,-10165.5 496,-10131.6 496,-10108.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"496,-10201.8 491.5,-10191.8 496,-10196.8 496,-10191.8 496,-10191.8 496,-10191.8 496,-10196.8 500.5,-10191.8 496,-10201.8 496,-10201.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"526.5\" y=\"-10151.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4d_proj -->\n",
       "<g id=\"node166\" class=\"node\"><title>relu_in4d_proj</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"543,-10412 449,-10412 449,-10354 543,-10354 543,-10412\"/>\n",
       "<text text-anchor=\"middle\" x=\"496\" y=\"-10386.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"496\" y=\"-10371.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4d_proj&#45;&gt;bn_in4d_proj -->\n",
       "<g id=\"edge182\" class=\"edge\"><title>relu_in4d_proj&#45;&gt;bn_in4d_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M496,-10343.5C496,-10317.5 496,-10283.6 496,-10260.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"496,-10353.8 491.5,-10343.8 496,-10348.8 496,-10343.8 496,-10343.8 496,-10343.8 496,-10348.8 500.5,-10343.8 496,-10353.8 496,-10353.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"526.5\" y=\"-10303.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4d_chconcat -->\n",
       "<g id=\"node167\" class=\"node\"><title>ch_concat_in4d_chconcat</title>\n",
       "<polygon fill=\"#fdb462\" stroke=\"black\" points=\"372,-10522 278,-10522 278,-10464 372,-10464 372,-10522\"/>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-10489.3\" font-family=\"Times,serif\" font-size=\"14.00\">Concat</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4d_chconcat&#45;&gt;relu_in4d_1x1 -->\n",
       "<g id=\"edge183\" class=\"edge\"><title>ch_concat_in4d_chconcat&#45;&gt;relu_in4d_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M268.307,-10475.7C251.978,-10468.7 235.28,-10459.1 223,-10446 194.089,-10415.2 180.844,-10366.8 175.081,-10336.2\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"277.843,-10479.5 266.887,-10480 273.198,-10477.6 268.553,-10475.8 268.553,-10475.8 268.553,-10475.8 273.198,-10477.6 270.219,-10471.6 277.843,-10479.5 277.843,-10479.5\"/>\n",
       "<text text-anchor=\"middle\" x=\"250.5\" y=\"-10434.3\" font-family=\"Times,serif\" font-size=\"14.00\">96x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4d_chconcat&#45;&gt;relu_in4d_3x3 -->\n",
       "<g id=\"edge184\" class=\"edge\"><title>ch_concat_in4d_chconcat&#45;&gt;relu_in4d_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M292.668,-10455.8C290.575,-10452.6 288.65,-10449.3 287,-10446 281.747,-10435.5 278.273,-10423.1 276.005,-10412.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"298.524,-10464 289.05,-10458.4 295.618,-10459.9 292.712,-10455.8 292.712,-10455.8 292.712,-10455.8 295.618,-10459.9 296.374,-10453.2 298.524,-10464 298.524,-10464\"/>\n",
       "<text text-anchor=\"middle\" x=\"317.5\" y=\"-10434.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4d_chconcat&#45;&gt;relu_in4d_double_3x3_1 -->\n",
       "<g id=\"edge185\" class=\"edge\"><title>ch_concat_in4d_chconcat&#45;&gt;relu_in4d_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M345.205,-10455C352.837,-10441 361.393,-10425.4 368.524,-10412.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"340.348,-10463.9 341.193,-10453 342.745,-10459.5 345.142,-10455.1 345.142,-10455.1 345.142,-10455.1 342.745,-10459.5 349.091,-10457.3 340.348,-10463.9 340.348,-10463.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"389.5\" y=\"-10434.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4d_chconcat&#45;&gt;relu_in4d_proj -->\n",
       "<g id=\"edge186\" class=\"edge\"><title>ch_concat_in4d_chconcat&#45;&gt;relu_in4d_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M381.495,-10469C395.782,-10462.3 410.805,-10454.5 424,-10446 439.109,-10436.3 454.405,-10423.6 466.989,-10412.2\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"372.24,-10473.2 379.468,-10465 376.788,-10471.2 381.337,-10469.1 381.337,-10469.1 381.337,-10469.1 376.788,-10471.2 383.206,-10473.2 372.24,-10473.2 372.24,-10473.2\"/>\n",
       "<text text-anchor=\"middle\" x=\"475.5\" y=\"-10434.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4e_3x3_reduce -->\n",
       "<g id=\"node168\" class=\"node\"><title>conv_in4e_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"246,-10970 152,-10970 152,-10912 246,-10912 246,-10970\"/>\n",
       "<text text-anchor=\"middle\" x=\"199\" y=\"-10944.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"199\" y=\"-10929.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 128</text>\n",
       "</g>\n",
       "<!-- conv_in4e_3x3_reduce&#45;&gt;ch_concat_in4d_chconcat -->\n",
       "<g id=\"edge187\" class=\"edge\"><title>conv_in4e_3x3_reduce&#45;&gt;ch_concat_in4d_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M199,-10901.7C199,-10871.3 199,-10828 199,-10790 199,-10790 199,-10790 199,-10602 199,-10558.9 241.971,-10529.3 277.724,-10512.2\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"199,-10911.8 194.5,-10901.8 199,-10906.8 199,-10901.8 199,-10901.8 199,-10901.8 199,-10906.8 203.5,-10901.8 199,-10911.8 199,-10911.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"229.5\" y=\"-10709.3\" font-family=\"Times,serif\" font-size=\"14.00\">608x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4e_3x3_reduce -->\n",
       "<g id=\"node169\" class=\"node\"><title>bn_in4e_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"246,-11122 152,-11122 152,-11064 246,-11064 246,-11122\"/>\n",
       "<text text-anchor=\"middle\" x=\"199\" y=\"-11089.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4e_3x3_reduce&#45;&gt;conv_in4e_3x3_reduce -->\n",
       "<g id=\"edge188\" class=\"edge\"><title>bn_in4e_3x3_reduce&#45;&gt;conv_in4e_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M199,-11053.5C199,-11027.5 199,-10993.6 199,-10970.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"199,-11063.8 194.5,-11053.8 199,-11058.8 199,-11053.8 199,-11053.8 199,-11053.8 199,-11058.8 203.5,-11053.8 199,-11063.8 199,-11063.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"229.5\" y=\"-11013.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4e_3x3_reduce -->\n",
       "<g id=\"node170\" class=\"node\"><title>relu_in4e_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"246,-11274 152,-11274 152,-11216 246,-11216 246,-11274\"/>\n",
       "<text text-anchor=\"middle\" x=\"199\" y=\"-11248.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"199\" y=\"-11233.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4e_3x3_reduce&#45;&gt;bn_in4e_3x3_reduce -->\n",
       "<g id=\"edge189\" class=\"edge\"><title>relu_in4e_3x3_reduce&#45;&gt;bn_in4e_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M199,-11205.5C199,-11179.5 199,-11145.6 199,-11122.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"199,-11215.8 194.5,-11205.8 199,-11210.8 199,-11205.8 199,-11205.8 199,-11205.8 199,-11210.8 203.5,-11205.8 199,-11215.8 199,-11215.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"229.5\" y=\"-11165.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4e_3x3 -->\n",
       "<g id=\"node171\" class=\"node\"><title>conv_in4e_3x3</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"247,-11426 153,-11426 153,-11368 247,-11368 247,-11426\"/>\n",
       "<text text-anchor=\"middle\" x=\"200\" y=\"-11400.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"200\" y=\"-11385.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/2, 192</text>\n",
       "</g>\n",
       "<!-- conv_in4e_3x3&#45;&gt;relu_in4e_3x3_reduce -->\n",
       "<g id=\"edge190\" class=\"edge\"><title>conv_in4e_3x3&#45;&gt;relu_in4e_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M199.743,-11357.5C199.57,-11331.5 199.344,-11297.6 199.187,-11274.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"199.812,-11367.8 195.245,-11357.8 199.779,-11362.8 199.745,-11357.8 199.745,-11357.8 199.745,-11357.8 199.779,-11362.8 204.245,-11357.8 199.812,-11367.8 199.812,-11367.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"230.5\" y=\"-11317.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4e_3x3 -->\n",
       "<g id=\"node172\" class=\"node\"><title>bn_in4e_3x3</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"250,-11578 156,-11578 156,-11520 250,-11520 250,-11578\"/>\n",
       "<text text-anchor=\"middle\" x=\"203\" y=\"-11545.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4e_3x3&#45;&gt;conv_in4e_3x3 -->\n",
       "<g id=\"edge191\" class=\"edge\"><title>bn_in4e_3x3&#45;&gt;conv_in4e_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M202.23,-11509.5C201.709,-11483.5 201.032,-11449.6 200.562,-11426.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"202.436,-11519.8 197.737,-11509.9 202.336,-11514.8 202.236,-11509.8 202.236,-11509.8 202.236,-11509.8 202.336,-11514.8 206.735,-11509.7 202.436,-11519.8 202.436,-11519.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"227\" y=\"-11469.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x7x7</text>\n",
       "</g>\n",
       "<!-- relu_in4e_3x3 -->\n",
       "<g id=\"node173\" class=\"node\"><title>relu_in4e_3x3</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"262,-11730 168,-11730 168,-11672 262,-11672 262,-11730\"/>\n",
       "<text text-anchor=\"middle\" x=\"215\" y=\"-11704.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"215\" y=\"-11689.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4e_3x3&#45;&gt;bn_in4e_3x3 -->\n",
       "<g id=\"edge192\" class=\"edge\"><title>relu_in4e_3x3&#45;&gt;bn_in4e_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M211.921,-11661.5C209.836,-11635.5 207.13,-11601.6 205.247,-11578.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"212.743,-11671.8 207.46,-11662.2 212.344,-11666.8 211.945,-11661.8 211.945,-11661.8 211.945,-11661.8 212.344,-11666.8 216.431,-11661.5 212.743,-11671.8 212.743,-11671.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"236\" y=\"-11621.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x7x7</text>\n",
       "</g>\n",
       "<!-- conv_in4e_double_3x3_reduce -->\n",
       "<g id=\"node174\" class=\"node\"><title>conv_in4e_double_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"372,-10632 278,-10632 278,-10574 372,-10574 372,-10632\"/>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-10606.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-10591.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 192</text>\n",
       "</g>\n",
       "<!-- conv_in4e_double_3x3_reduce&#45;&gt;ch_concat_in4d_chconcat -->\n",
       "<g id=\"edge193\" class=\"edge\"><title>conv_in4e_double_3x3_reduce&#45;&gt;ch_concat_in4d_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M325,-10563.8C325,-10550.2 325,-10535 325,-10522.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"325,-10573.9 320.5,-10563.9 325,-10568.9 325,-10563.9 325,-10563.9 325,-10563.9 325,-10568.9 329.5,-10563.9 325,-10573.9 325,-10573.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"355.5\" y=\"-10544.3\" font-family=\"Times,serif\" font-size=\"14.00\">608x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4e_double_3x3_reduce -->\n",
       "<g id=\"node175\" class=\"node\"><title>bn_in4e_double_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"372,-10742 278,-10742 278,-10684 372,-10684 372,-10742\"/>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-10709.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4e_double_3x3_reduce&#45;&gt;conv_in4e_double_3x3_reduce -->\n",
       "<g id=\"edge194\" class=\"edge\"><title>bn_in4e_double_3x3_reduce&#45;&gt;conv_in4e_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M325,-10673.8C325,-10660.2 325,-10645 325,-10632.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"325,-10683.9 320.5,-10673.9 325,-10678.9 325,-10673.9 325,-10673.9 325,-10673.9 325,-10678.9 329.5,-10673.9 325,-10683.9 325,-10683.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"355.5\" y=\"-10654.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4e_double_3x3_reduce -->\n",
       "<g id=\"node176\" class=\"node\"><title>relu_in4e_double_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"363,-10894 269,-10894 269,-10836 363,-10836 363,-10894\"/>\n",
       "<text text-anchor=\"middle\" x=\"316\" y=\"-10868.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"316\" y=\"-10853.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4e_double_3x3_reduce&#45;&gt;bn_in4e_double_3x3_reduce -->\n",
       "<g id=\"edge195\" class=\"edge\"><title>relu_in4e_double_3x3_reduce&#45;&gt;bn_in4e_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M299.922,-10826.1C299.16,-10823.4 298.504,-10820.7 298,-10818 293.22,-10792.7 291.239,-10784.9 298,-10760 299.652,-10753.9 302.331,-10747.8 305.375,-10742.2\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"303.064,-10835.8 295.697,-10827.7 301.52,-10831 299.977,-10826.3 299.977,-10826.3 299.977,-10826.3 301.52,-10831 304.257,-10824.9 303.064,-10835.8 303.064,-10835.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"328.5\" y=\"-10785.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4e_double_3x3_0 -->\n",
       "<g id=\"node177\" class=\"node\"><title>conv_in4e_double_3x3_0</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"372,-11046 278,-11046 278,-10988 372,-10988 372,-11046\"/>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-11020.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-11005.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 256</text>\n",
       "</g>\n",
       "<!-- conv_in4e_double_3x3_0&#45;&gt;relu_in4e_double_3x3_reduce -->\n",
       "<g id=\"edge196\" class=\"edge\"><title>conv_in4e_double_3x3_0&#45;&gt;relu_in4e_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M322.69,-10977.5C321.127,-10951.5 319.097,-10917.6 317.685,-10894.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"323.307,-10987.8 318.216,-10978.1 323.008,-10982.8 322.708,-10977.8 322.708,-10977.8 322.708,-10977.8 323.008,-10982.8 327.2,-10977.5 323.307,-10987.8 323.307,-10987.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"353.5\" y=\"-10937.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4e_double_3x3_0 -->\n",
       "<g id=\"node178\" class=\"node\"><title>bn_in4e_double_3x3_0</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"372,-11198 278,-11198 278,-11140 372,-11140 372,-11198\"/>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-11165.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4e_double_3x3_0&#45;&gt;conv_in4e_double_3x3_0 -->\n",
       "<g id=\"edge197\" class=\"edge\"><title>bn_in4e_double_3x3_0&#45;&gt;conv_in4e_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M325,-11129.5C325,-11103.5 325,-11069.6 325,-11046.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"325,-11139.8 320.5,-11129.8 325,-11134.8 325,-11129.8 325,-11129.8 325,-11129.8 325,-11134.8 329.5,-11129.8 325,-11139.8 325,-11139.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"355.5\" y=\"-11089.3\" font-family=\"Times,serif\" font-size=\"14.00\">256x14x14</text>\n",
       "</g>\n",
       "<!-- relu_in4e_double_3x3_0 -->\n",
       "<g id=\"node179\" class=\"node\"><title>relu_in4e_double_3x3_0</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"372,-11350 278,-11350 278,-11292 372,-11292 372,-11350\"/>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-11324.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-11309.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4e_double_3x3_0&#45;&gt;bn_in4e_double_3x3_0 -->\n",
       "<g id=\"edge198\" class=\"edge\"><title>relu_in4e_double_3x3_0&#45;&gt;bn_in4e_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M325,-11281.5C325,-11255.5 325,-11221.6 325,-11198.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"325,-11291.8 320.5,-11281.8 325,-11286.8 325,-11281.8 325,-11281.8 325,-11281.8 325,-11286.8 329.5,-11281.8 325,-11291.8 325,-11291.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"355.5\" y=\"-11241.3\" font-family=\"Times,serif\" font-size=\"14.00\">256x14x14</text>\n",
       "</g>\n",
       "<!-- conv_in4e_double_3x3_1 -->\n",
       "<g id=\"node180\" class=\"node\"><title>conv_in4e_double_3x3_1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"372,-11502 278,-11502 278,-11444 372,-11444 372,-11502\"/>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-11476.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-11461.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/2, 256</text>\n",
       "</g>\n",
       "<!-- conv_in4e_double_3x3_1&#45;&gt;relu_in4e_double_3x3_0 -->\n",
       "<g id=\"edge199\" class=\"edge\"><title>conv_in4e_double_3x3_1&#45;&gt;relu_in4e_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M325,-11433.5C325,-11407.5 325,-11373.6 325,-11350.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"325,-11443.8 320.5,-11433.8 325,-11438.8 325,-11433.8 325,-11433.8 325,-11433.8 325,-11438.8 329.5,-11433.8 325,-11443.8 325,-11443.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"355.5\" y=\"-11393.3\" font-family=\"Times,serif\" font-size=\"14.00\">256x14x14</text>\n",
       "</g>\n",
       "<!-- bn_in4e_double_3x3_1 -->\n",
       "<g id=\"node181\" class=\"node\"><title>bn_in4e_double_3x3_1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"372,-11654 278,-11654 278,-11596 372,-11596 372,-11654\"/>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-11621.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in4e_double_3x3_1&#45;&gt;conv_in4e_double_3x3_1 -->\n",
       "<g id=\"edge200\" class=\"edge\"><title>bn_in4e_double_3x3_1&#45;&gt;conv_in4e_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M325,-11585.5C325,-11559.5 325,-11525.6 325,-11502.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"325,-11595.8 320.5,-11585.8 325,-11590.8 325,-11585.8 325,-11585.8 325,-11585.8 325,-11590.8 329.5,-11585.8 325,-11595.8 325,-11595.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"349\" y=\"-11545.3\" font-family=\"Times,serif\" font-size=\"14.00\">256x7x7</text>\n",
       "</g>\n",
       "<!-- relu_in4e_double_3x3_1 -->\n",
       "<g id=\"node182\" class=\"node\"><title>relu_in4e_double_3x3_1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"372,-11806 278,-11806 278,-11748 372,-11748 372,-11806\"/>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-11780.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-11765.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in4e_double_3x3_1&#45;&gt;bn_in4e_double_3x3_1 -->\n",
       "<g id=\"edge201\" class=\"edge\"><title>relu_in4e_double_3x3_1&#45;&gt;bn_in4e_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M325,-11737.5C325,-11711.5 325,-11677.6 325,-11654.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"325,-11747.8 320.5,-11737.8 325,-11742.8 325,-11737.8 325,-11737.8 325,-11737.8 325,-11742.8 329.5,-11737.8 325,-11747.8 325,-11747.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"349\" y=\"-11697.3\" font-family=\"Times,serif\" font-size=\"14.00\">256x7x7</text>\n",
       "</g>\n",
       "<!-- max_pool_in4e_pool -->\n",
       "<g id=\"node183\" class=\"node\"><title>max_pool_in4e_pool</title>\n",
       "<polygon fill=\"#80b1d3\" stroke=\"black\" points=\"462,-10818 368,-10818 368,-10760 462,-10760 462,-10818\"/>\n",
       "<text text-anchor=\"middle\" x=\"415\" y=\"-10792.8\" font-family=\"Times,serif\" font-size=\"14.00\">Pooling</text>\n",
       "<text text-anchor=\"middle\" x=\"415\" y=\"-10777.8\" font-family=\"Times,serif\" font-size=\"14.00\">max, 3x3/2</text>\n",
       "</g>\n",
       "<!-- max_pool_in4e_pool&#45;&gt;ch_concat_in4d_chconcat -->\n",
       "<g id=\"edge202\" class=\"edge\"><title>max_pool_in4e_pool&#45;&gt;ch_concat_in4d_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M420.448,-10749.7C425.789,-10698.2 428.325,-10605.8 390,-10540 385.475,-10532.2 379.058,-10525.4 372,-10519.6\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"419.317,-10759.7 415.967,-10749.2 419.877,-10754.7 420.438,-10749.7 420.438,-10749.7 420.438,-10749.7 419.877,-10754.7 424.91,-10750.2 419.317,-10759.7 419.317,-10759.7\"/>\n",
       "<text text-anchor=\"middle\" x=\"452.5\" y=\"-10654.3\" font-family=\"Times,serif\" font-size=\"14.00\">608x14x14</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4e_chconcat -->\n",
       "<g id=\"node184\" class=\"node\"><title>ch_concat_in4e_chconcat</title>\n",
       "<polygon fill=\"#fdb462\" stroke=\"black\" points=\"372,-11916 278,-11916 278,-11858 372,-11858 372,-11916\"/>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-11883.3\" font-family=\"Times,serif\" font-size=\"14.00\">Concat</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4e_chconcat&#45;&gt;relu_in4e_3x3 -->\n",
       "<g id=\"edge203\" class=\"edge\"><title>ch_concat_in4e_chconcat&#45;&gt;relu_in4e_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M281.651,-11850.6C278.533,-11847.2 275.599,-11843.6 273,-11840 248.386,-11805.7 231.651,-11759.3 222.709,-11730\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"288.712,-11857.8 278.499,-11853.8 285.212,-11854.2 281.712,-11850.6 281.712,-11850.6 281.712,-11850.6 285.212,-11854.2 284.926,-11847.5 288.712,-11857.8 288.712,-11857.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"297\" y=\"-11828.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x7x7</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4e_chconcat&#45;&gt;relu_in4e_double_3x3_1 -->\n",
       "<g id=\"edge204\" class=\"edge\"><title>ch_concat_in4e_chconcat&#45;&gt;relu_in4e_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M325,-11847.8C325,-11834.2 325,-11819 325,-11806.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"325,-11857.9 320.5,-11847.9 325,-11852.9 325,-11847.9 325,-11847.9 325,-11847.9 325,-11852.9 329.5,-11847.9 325,-11857.9 325,-11857.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"349\" y=\"-11828.3\" font-family=\"Times,serif\" font-size=\"14.00\">256x7x7</text>\n",
       "</g>\n",
       "<!-- ch_concat_in4e_chconcat&#45;&gt;max_pool_in4e_pool -->\n",
       "<g id=\"edge205\" class=\"edge\"><title>ch_concat_in4e_chconcat&#45;&gt;max_pool_in4e_pool</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M374.792,-11851.2C395.586,-11832.4 415,-11807 415,-11778 415,-11778 415,-11778 415,-10940 415,-10897.6 415,-10848.3 415,-10818.2\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"367.101,-11857.9 371.729,-11847.9 370.886,-11854.6 374.67,-11851.3 374.67,-11851.3 374.67,-11851.3 370.886,-11854.6 377.611,-11854.7 367.101,-11857.9 367.101,-11857.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"439\" y=\"-11393.3\" font-family=\"Times,serif\" font-size=\"14.00\">608x7x7</text>\n",
       "</g>\n",
       "<!-- conv_in5a_1x1 -->\n",
       "<g id=\"node185\" class=\"node\"><title>conv_in5a_1x1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"233,-12736 139,-12736 139,-12678 233,-12678 233,-12736\"/>\n",
       "<text text-anchor=\"middle\" x=\"186\" y=\"-12710.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"186\" y=\"-12695.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 352</text>\n",
       "</g>\n",
       "<!-- conv_in5a_1x1&#45;&gt;ch_concat_in4e_chconcat -->\n",
       "<g id=\"edge206\" class=\"edge\"><title>conv_in5a_1x1&#45;&gt;ch_concat_in4e_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M187.189,-12667.7C188.027,-12637.4 189,-12594 189,-12556 189,-12556 189,-12556 189,-11996 189,-11949.4 238.535,-11919.7 277.815,-11903.5\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"186.9,-12677.8 182.687,-12667.7 187.042,-12672.8 187.185,-12667.8 187.185,-12667.8 187.185,-12667.8 187.042,-12672.8 191.683,-12667.9 186.9,-12677.8 186.9,-12677.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"216.5\" y=\"-12289.3\" font-family=\"Times,serif\" font-size=\"14.00\">1056x7x7</text>\n",
       "</g>\n",
       "<!-- bn_in5a_1x1 -->\n",
       "<g id=\"node186\" class=\"node\"><title>bn_in5a_1x1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"232,-12888 138,-12888 138,-12830 232,-12830 232,-12888\"/>\n",
       "<text text-anchor=\"middle\" x=\"185\" y=\"-12855.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in5a_1x1&#45;&gt;conv_in5a_1x1 -->\n",
       "<g id=\"edge207\" class=\"edge\"><title>bn_in5a_1x1&#45;&gt;conv_in5a_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M185.257,-12819.5C185.43,-12793.5 185.656,-12759.6 185.813,-12736.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"185.188,-12829.8 180.755,-12819.8 185.221,-12824.8 185.255,-12819.8 185.255,-12819.8 185.255,-12819.8 185.221,-12824.8 189.755,-12819.8 185.188,-12829.8 185.188,-12829.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"210\" y=\"-12779.3\" font-family=\"Times,serif\" font-size=\"14.00\">352x7x7</text>\n",
       "</g>\n",
       "<!-- relu_in5a_1x1 -->\n",
       "<g id=\"node187\" class=\"node\"><title>relu_in5a_1x1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"242,-13040 148,-13040 148,-12982 242,-12982 242,-13040\"/>\n",
       "<text text-anchor=\"middle\" x=\"195\" y=\"-13014.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"195\" y=\"-12999.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in5a_1x1&#45;&gt;bn_in5a_1x1 -->\n",
       "<g id=\"edge208\" class=\"edge\"><title>relu_in5a_1x1&#45;&gt;bn_in5a_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M192.434,-12971.5C190.697,-12945.5 188.441,-12911.6 186.872,-12888.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"193.119,-12981.8 187.964,-12972.1 192.786,-12976.8 192.454,-12971.8 192.454,-12971.8 192.454,-12971.8 192.786,-12976.8 196.944,-12971.5 193.119,-12981.8 193.119,-12981.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"216\" y=\"-12931.3\" font-family=\"Times,serif\" font-size=\"14.00\">352x7x7</text>\n",
       "</g>\n",
       "<!-- conv_in5a_3x3_reduce -->\n",
       "<g id=\"node188\" class=\"node\"><title>conv_in5a_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"343,-12322 249,-12322 249,-12264 343,-12264 343,-12322\"/>\n",
       "<text text-anchor=\"middle\" x=\"296\" y=\"-12296.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"296\" y=\"-12281.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 192</text>\n",
       "</g>\n",
       "<!-- conv_in5a_3x3_reduce&#45;&gt;ch_concat_in4e_chconcat -->\n",
       "<g id=\"edge209\" class=\"edge\"><title>conv_in5a_3x3_reduce&#45;&gt;ch_concat_in4e_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M295.548,-12253.7C295.283,-12228.1 295,-12193.5 295,-12163 295,-12163 295,-12163 295,-11996 295,-11968.2 304.361,-11937.7 312.625,-11916.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"295.656,-12263.8 291.049,-12253.9 295.602,-12258.8 295.549,-12253.8 295.549,-12253.8 295.549,-12253.8 295.602,-12258.8 300.049,-12253.8 295.656,-12263.8 295.656,-12263.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"322.5\" y=\"-12103.3\" font-family=\"Times,serif\" font-size=\"14.00\">1056x7x7</text>\n",
       "</g>\n",
       "<!-- bn_in5a_3x3_reduce -->\n",
       "<g id=\"node189\" class=\"node\"><title>bn_in5a_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"343,-12508 249,-12508 249,-12450 343,-12450 343,-12508\"/>\n",
       "<text text-anchor=\"middle\" x=\"296\" y=\"-12475.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in5a_3x3_reduce&#45;&gt;conv_in5a_3x3_reduce -->\n",
       "<g id=\"edge210\" class=\"edge\"><title>bn_in5a_3x3_reduce&#45;&gt;conv_in5a_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M296,-12439.3C296,-12404.2 296,-12353.4 296,-12322.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"296,-12449.7 291.5,-12439.7 296,-12444.7 296,-12439.7 296,-12439.7 296,-12439.7 296,-12444.7 300.5,-12439.7 296,-12449.7 296,-12449.7\"/>\n",
       "<text text-anchor=\"middle\" x=\"320\" y=\"-12420.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x7x7</text>\n",
       "</g>\n",
       "<!-- relu_in5a_3x3_reduce -->\n",
       "<g id=\"node190\" class=\"node\"><title>relu_in5a_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"344,-12660 250,-12660 250,-12602 344,-12602 344,-12660\"/>\n",
       "<text text-anchor=\"middle\" x=\"297\" y=\"-12634.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"297\" y=\"-12619.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in5a_3x3_reduce&#45;&gt;bn_in5a_3x3_reduce -->\n",
       "<g id=\"edge211\" class=\"edge\"><title>relu_in5a_3x3_reduce&#45;&gt;bn_in5a_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M296.743,-12591.5C296.57,-12565.5 296.344,-12531.6 296.187,-12508.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"296.812,-12601.8 292.245,-12591.8 296.779,-12596.8 296.745,-12591.8 296.745,-12591.8 296.745,-12591.8 296.779,-12596.8 301.245,-12591.8 296.812,-12601.8 296.812,-12601.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"321\" y=\"-12551.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x7x7</text>\n",
       "</g>\n",
       "<!-- conv_in5a_3x3 -->\n",
       "<g id=\"node191\" class=\"node\"><title>conv_in5a_3x3</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"345,-12812 251,-12812 251,-12754 345,-12754 345,-12812\"/>\n",
       "<text text-anchor=\"middle\" x=\"298\" y=\"-12786.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"298\" y=\"-12771.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 320</text>\n",
       "</g>\n",
       "<!-- conv_in5a_3x3&#45;&gt;relu_in5a_3x3_reduce -->\n",
       "<g id=\"edge212\" class=\"edge\"><title>conv_in5a_3x3&#45;&gt;relu_in5a_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M297.743,-12743.5C297.57,-12717.5 297.344,-12683.6 297.187,-12660.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"297.812,-12753.8 293.245,-12743.8 297.779,-12748.8 297.745,-12743.8 297.745,-12743.8 297.745,-12743.8 297.779,-12748.8 302.245,-12743.8 297.812,-12753.8 297.812,-12753.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"322\" y=\"-12703.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x7x7</text>\n",
       "</g>\n",
       "<!-- bn_in5a_3x3 -->\n",
       "<g id=\"node192\" class=\"node\"><title>bn_in5a_3x3</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"345,-12964 251,-12964 251,-12906 345,-12906 345,-12964\"/>\n",
       "<text text-anchor=\"middle\" x=\"298\" y=\"-12931.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in5a_3x3&#45;&gt;conv_in5a_3x3 -->\n",
       "<g id=\"edge213\" class=\"edge\"><title>bn_in5a_3x3&#45;&gt;conv_in5a_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M298,-12895.5C298,-12869.5 298,-12835.6 298,-12812.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"298,-12905.8 293.5,-12895.8 298,-12900.8 298,-12895.8 298,-12895.8 298,-12895.8 298,-12900.8 302.5,-12895.8 298,-12905.8 298,-12905.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"322\" y=\"-12855.3\" font-family=\"Times,serif\" font-size=\"14.00\">320x7x7</text>\n",
       "</g>\n",
       "<!-- relu_in5a_3x3 -->\n",
       "<g id=\"node193\" class=\"node\"><title>relu_in5a_3x3</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"345,-13116 251,-13116 251,-13058 345,-13058 345,-13116\"/>\n",
       "<text text-anchor=\"middle\" x=\"298\" y=\"-13090.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"298\" y=\"-13075.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in5a_3x3&#45;&gt;bn_in5a_3x3 -->\n",
       "<g id=\"edge214\" class=\"edge\"><title>relu_in5a_3x3&#45;&gt;bn_in5a_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M298,-13047.5C298,-13021.5 298,-12987.6 298,-12964.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"298,-13057.8 293.5,-13047.8 298,-13052.8 298,-13047.8 298,-13047.8 298,-13047.8 298,-13052.8 302.5,-13047.8 298,-13057.8 298,-13057.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"322\" y=\"-13007.3\" font-family=\"Times,serif\" font-size=\"14.00\">320x7x7</text>\n",
       "</g>\n",
       "<!-- conv_in5a_double_3x3_reduce -->\n",
       "<g id=\"node194\" class=\"node\"><title>conv_in5a_double_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"429,-12026 335,-12026 335,-11968 429,-11968 429,-12026\"/>\n",
       "<text text-anchor=\"middle\" x=\"382\" y=\"-12000.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"382\" y=\"-11985.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 160</text>\n",
       "</g>\n",
       "<!-- conv_in5a_double_3x3_reduce&#45;&gt;ch_concat_in4e_chconcat -->\n",
       "<g id=\"edge215\" class=\"edge\"><title>conv_in5a_double_3x3_reduce&#45;&gt;ch_concat_in4e_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M362.48,-11959C355.107,-11945 346.841,-11929.4 339.951,-11916.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"367.173,-11967.9 358.525,-11961.2 364.839,-11963.5 362.505,-11959.1 362.505,-11959.1 362.505,-11959.1 364.839,-11963.5 366.485,-11957 367.173,-11967.9 367.173,-11967.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"384.5\" y=\"-11938.3\" font-family=\"Times,serif\" font-size=\"14.00\">1056x7x7</text>\n",
       "</g>\n",
       "<!-- bn_in5a_double_3x3_reduce -->\n",
       "<g id=\"node195\" class=\"node\"><title>bn_in5a_double_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"462,-12136 368,-12136 368,-12078 462,-12078 462,-12136\"/>\n",
       "<text text-anchor=\"middle\" x=\"415\" y=\"-12103.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in5a_double_3x3_reduce&#45;&gt;conv_in5a_double_3x3_reduce -->\n",
       "<g id=\"edge216\" class=\"edge\"><title>bn_in5a_double_3x3_reduce&#45;&gt;conv_in5a_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M403.454,-12068.2C399.248,-12054.4 394.569,-12039.1 390.656,-12026.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"406.416,-12077.9 399.19,-12069.7 404.955,-12073.1 403.494,-12068.3 403.494,-12068.3 403.494,-12068.3 404.955,-12073.1 407.797,-12067 406.416,-12077.9 406.416,-12077.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"424\" y=\"-12048.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x7x7</text>\n",
       "</g>\n",
       "<!-- relu_in5a_double_3x3_reduce -->\n",
       "<g id=\"node196\" class=\"node\"><title>relu_in5a_double_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"462,-12246 368,-12246 368,-12188 462,-12188 462,-12246\"/>\n",
       "<text text-anchor=\"middle\" x=\"415\" y=\"-12220.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"415\" y=\"-12205.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in5a_double_3x3_reduce&#45;&gt;bn_in5a_double_3x3_reduce -->\n",
       "<g id=\"edge217\" class=\"edge\"><title>relu_in5a_double_3x3_reduce&#45;&gt;bn_in5a_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M415,-12177.8C415,-12164.2 415,-12149 415,-12136.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"415,-12187.9 410.5,-12177.9 415,-12182.9 415,-12177.9 415,-12177.9 415,-12177.9 415,-12182.9 419.5,-12177.9 415,-12187.9 415,-12187.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"439\" y=\"-12158.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x7x7</text>\n",
       "</g>\n",
       "<!-- conv_in5a_double_3x3_0 -->\n",
       "<g id=\"node197\" class=\"node\"><title>conv_in5a_double_3x3_0</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"462,-12398 368,-12398 368,-12340 462,-12340 462,-12398\"/>\n",
       "<text text-anchor=\"middle\" x=\"415\" y=\"-12372.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"415\" y=\"-12357.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 224</text>\n",
       "</g>\n",
       "<!-- conv_in5a_double_3x3_0&#45;&gt;relu_in5a_double_3x3_reduce -->\n",
       "<g id=\"edge218\" class=\"edge\"><title>conv_in5a_double_3x3_0&#45;&gt;relu_in5a_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M415,-12329.5C415,-12303.5 415,-12269.6 415,-12246.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"415,-12339.8 410.5,-12329.8 415,-12334.8 415,-12329.8 415,-12329.8 415,-12329.8 415,-12334.8 419.5,-12329.8 415,-12339.8 415,-12339.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"439\" y=\"-12289.3\" font-family=\"Times,serif\" font-size=\"14.00\">160x7x7</text>\n",
       "</g>\n",
       "<!-- bn_in5a_double_3x3_0 -->\n",
       "<g id=\"node198\" class=\"node\"><title>bn_in5a_double_3x3_0</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"461,-12508 367,-12508 367,-12450 461,-12450 461,-12508\"/>\n",
       "<text text-anchor=\"middle\" x=\"414\" y=\"-12475.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in5a_double_3x3_0&#45;&gt;conv_in5a_double_3x3_0 -->\n",
       "<g id=\"edge219\" class=\"edge\"><title>bn_in5a_double_3x3_0&#45;&gt;conv_in5a_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M414.354,-12439.8C414.48,-12426.2 414.62,-12411 414.738,-12398.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"414.26,-12449.9 409.853,-12439.9 414.306,-12444.9 414.353,-12439.9 414.353,-12439.9 414.353,-12439.9 414.306,-12444.9 418.853,-12439.9 414.26,-12449.9 414.26,-12449.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"438\" y=\"-12420.3\" font-family=\"Times,serif\" font-size=\"14.00\">224x7x7</text>\n",
       "</g>\n",
       "<!-- relu_in5a_double_3x3_0 -->\n",
       "<g id=\"node199\" class=\"node\"><title>relu_in5a_double_3x3_0</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"457,-12660 363,-12660 363,-12602 457,-12602 457,-12660\"/>\n",
       "<text text-anchor=\"middle\" x=\"410\" y=\"-12634.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"410\" y=\"-12619.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in5a_double_3x3_0&#45;&gt;bn_in5a_double_3x3_0 -->\n",
       "<g id=\"edge220\" class=\"edge\"><title>relu_in5a_double_3x3_0&#45;&gt;bn_in5a_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M409.207,-12591.6C409.002,-12572 409.058,-12547.7 410,-12526 410.25,-12520.2 410.676,-12514.1 411.159,-12508.2\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"409.339,-12601.7 404.708,-12591.8 409.273,-12596.7 409.208,-12591.7 409.208,-12591.7 409.208,-12591.7 409.273,-12596.7 413.707,-12591.7 409.339,-12601.7 409.339,-12601.7\"/>\n",
       "<text text-anchor=\"middle\" x=\"434\" y=\"-12551.3\" font-family=\"Times,serif\" font-size=\"14.00\">224x7x7</text>\n",
       "</g>\n",
       "<!-- conv_in5a_double_3x3_1 -->\n",
       "<g id=\"node200\" class=\"node\"><title>conv_in5a_double_3x3_1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"457,-12812 363,-12812 363,-12754 457,-12754 457,-12812\"/>\n",
       "<text text-anchor=\"middle\" x=\"410\" y=\"-12786.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"410\" y=\"-12771.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 224</text>\n",
       "</g>\n",
       "<!-- conv_in5a_double_3x3_1&#45;&gt;relu_in5a_double_3x3_0 -->\n",
       "<g id=\"edge221\" class=\"edge\"><title>conv_in5a_double_3x3_1&#45;&gt;relu_in5a_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M410,-12743.5C410,-12717.5 410,-12683.6 410,-12660.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"410,-12753.8 405.5,-12743.8 410,-12748.8 410,-12743.8 410,-12743.8 410,-12743.8 410,-12748.8 414.5,-12743.8 410,-12753.8 410,-12753.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"434\" y=\"-12703.3\" font-family=\"Times,serif\" font-size=\"14.00\">224x7x7</text>\n",
       "</g>\n",
       "<!-- bn_in5a_double_3x3_1 -->\n",
       "<g id=\"node201\" class=\"node\"><title>bn_in5a_double_3x3_1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"457,-12964 363,-12964 363,-12906 457,-12906 457,-12964\"/>\n",
       "<text text-anchor=\"middle\" x=\"410\" y=\"-12931.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in5a_double_3x3_1&#45;&gt;conv_in5a_double_3x3_1 -->\n",
       "<g id=\"edge222\" class=\"edge\"><title>bn_in5a_double_3x3_1&#45;&gt;conv_in5a_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M410,-12895.5C410,-12869.5 410,-12835.6 410,-12812.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"410,-12905.8 405.5,-12895.8 410,-12900.8 410,-12895.8 410,-12895.8 410,-12895.8 410,-12900.8 414.5,-12895.8 410,-12905.8 410,-12905.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"434\" y=\"-12855.3\" font-family=\"Times,serif\" font-size=\"14.00\">224x7x7</text>\n",
       "</g>\n",
       "<!-- relu_in5a_double_3x3_1 -->\n",
       "<g id=\"node202\" class=\"node\"><title>relu_in5a_double_3x3_1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"457,-13116 363,-13116 363,-13058 457,-13058 457,-13116\"/>\n",
       "<text text-anchor=\"middle\" x=\"410\" y=\"-13090.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"410\" y=\"-13075.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in5a_double_3x3_1&#45;&gt;bn_in5a_double_3x3_1 -->\n",
       "<g id=\"edge223\" class=\"edge\"><title>relu_in5a_double_3x3_1&#45;&gt;bn_in5a_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M410,-13047.5C410,-13021.5 410,-12987.6 410,-12964.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"410,-13057.8 405.5,-13047.8 410,-13052.8 410,-13047.8 410,-13047.8 410,-13047.8 410,-13052.8 414.5,-13047.8 410,-13057.8 410,-13057.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"434\" y=\"-13007.3\" font-family=\"Times,serif\" font-size=\"14.00\">224x7x7</text>\n",
       "</g>\n",
       "<!-- avg_pool_in5a_pool -->\n",
       "<g id=\"node203\" class=\"node\"><title>avg_pool_in5a_pool</title>\n",
       "<polygon fill=\"#80b1d3\" stroke=\"black\" points=\"561,-12584 467,-12584 467,-12526 561,-12526 561,-12584\"/>\n",
       "<text text-anchor=\"middle\" x=\"514\" y=\"-12558.8\" font-family=\"Times,serif\" font-size=\"14.00\">Pooling</text>\n",
       "<text text-anchor=\"middle\" x=\"514\" y=\"-12543.8\" font-family=\"Times,serif\" font-size=\"14.00\">avg, 3x3/1</text>\n",
       "</g>\n",
       "<!-- avg_pool_in5a_pool&#45;&gt;ch_concat_in4e_chconcat -->\n",
       "<g id=\"edge224\" class=\"edge\"><title>avg_pool_in5a_pool&#45;&gt;ch_concat_in4e_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M510.385,-12515.8C508.265,-12490.1 506,-12455.6 506,-12425 506,-12425 506,-12425 506,-11996 506,-11933.6 425.713,-11906.4 372.083,-11895.2\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"511.247,-12525.8 505.91,-12516.3 510.82,-12520.9 510.394,-12515.9 510.394,-12515.9 510.394,-12515.9 510.82,-12520.9 514.877,-12515.5 511.247,-12525.8 511.247,-12525.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"533.5\" y=\"-12213.3\" font-family=\"Times,serif\" font-size=\"14.00\">1056x7x7</text>\n",
       "</g>\n",
       "<!-- conv_in5a_proj -->\n",
       "<g id=\"node204\" class=\"node\"><title>conv_in5a_proj</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"569,-12812 475,-12812 475,-12754 569,-12754 569,-12812\"/>\n",
       "<text text-anchor=\"middle\" x=\"522\" y=\"-12786.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"522\" y=\"-12771.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 128</text>\n",
       "</g>\n",
       "<!-- conv_in5a_proj&#45;&gt;avg_pool_in5a_pool -->\n",
       "<g id=\"edge225\" class=\"edge\"><title>conv_in5a_proj&#45;&gt;avg_pool_in5a_pool</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M520.649,-12743.8C519.049,-12698.6 516.423,-12624.5 514.997,-12584.2\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"521.003,-12753.8 516.152,-12744 520.826,-12748.8 520.649,-12743.8 520.649,-12743.8 520.649,-12743.8 520.826,-12748.8 525.146,-12743.7 521.003,-12753.8 521.003,-12753.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"547.5\" y=\"-12703.3\" font-family=\"Times,serif\" font-size=\"14.00\">1056x7x7</text>\n",
       "</g>\n",
       "<!-- bn_in5a_proj -->\n",
       "<g id=\"node205\" class=\"node\"><title>bn_in5a_proj</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"569,-12964 475,-12964 475,-12906 569,-12906 569,-12964\"/>\n",
       "<text text-anchor=\"middle\" x=\"522\" y=\"-12931.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in5a_proj&#45;&gt;conv_in5a_proj -->\n",
       "<g id=\"edge226\" class=\"edge\"><title>bn_in5a_proj&#45;&gt;conv_in5a_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M522,-12895.5C522,-12869.5 522,-12835.6 522,-12812.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"522,-12905.8 517.5,-12895.8 522,-12900.8 522,-12895.8 522,-12895.8 522,-12895.8 522,-12900.8 526.5,-12895.8 522,-12905.8 522,-12905.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"546\" y=\"-12855.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x7x7</text>\n",
       "</g>\n",
       "<!-- relu_in5a_proj -->\n",
       "<g id=\"node206\" class=\"node\"><title>relu_in5a_proj</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"569,-13116 475,-13116 475,-13058 569,-13058 569,-13116\"/>\n",
       "<text text-anchor=\"middle\" x=\"522\" y=\"-13090.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"522\" y=\"-13075.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in5a_proj&#45;&gt;bn_in5a_proj -->\n",
       "<g id=\"edge227\" class=\"edge\"><title>relu_in5a_proj&#45;&gt;bn_in5a_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M522,-13047.5C522,-13021.5 522,-12987.6 522,-12964.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"522,-13057.8 517.5,-13047.8 522,-13052.8 522,-13047.8 522,-13047.8 522,-13047.8 522,-13052.8 526.5,-13047.8 522,-13057.8 522,-13057.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"546\" y=\"-13007.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x7x7</text>\n",
       "</g>\n",
       "<!-- ch_concat_in5a_chconcat -->\n",
       "<g id=\"node207\" class=\"node\"><title>ch_concat_in5a_chconcat</title>\n",
       "<polygon fill=\"#fdb462\" stroke=\"black\" points=\"400,-13226 306,-13226 306,-13168 400,-13168 400,-13226\"/>\n",
       "<text text-anchor=\"middle\" x=\"353\" y=\"-13193.3\" font-family=\"Times,serif\" font-size=\"14.00\">Concat</text>\n",
       "</g>\n",
       "<!-- ch_concat_in5a_chconcat&#45;&gt;relu_in5a_1x1 -->\n",
       "<g id=\"edge228\" class=\"edge\"><title>ch_concat_in5a_chconcat&#45;&gt;relu_in5a_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M296.827,-13168.7C287.465,-13163.1 278.158,-13156.8 270,-13150 235.1,-13121 213.871,-13071.3 203.294,-13040.2\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"305.784,-13173.8 294.872,-13172.7 301.451,-13171.3 297.118,-13168.8 297.118,-13168.8 297.118,-13168.8 301.451,-13171.3 299.364,-13164.9 305.784,-13173.8 305.784,-13173.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"294\" y=\"-13138.3\" font-family=\"Times,serif\" font-size=\"14.00\">352x7x7</text>\n",
       "</g>\n",
       "<!-- ch_concat_in5a_chconcat&#45;&gt;relu_in5a_3x3 -->\n",
       "<g id=\"edge229\" class=\"edge\"><title>ch_concat_in5a_chconcat&#45;&gt;relu_in5a_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M333.559,-13158.9C332.01,-13155.9 330.475,-13152.9 329,-13150 323.361,-13139 317.242,-13126.8 311.941,-13116.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"338.2,-13167.8 329.601,-13161 335.898,-13163.4 333.596,-13158.9 333.596,-13158.9 333.596,-13158.9 335.898,-13163.4 337.591,-13156.9 338.2,-13167.8 338.2,-13167.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"353\" y=\"-13138.3\" font-family=\"Times,serif\" font-size=\"14.00\">320x7x7</text>\n",
       "</g>\n",
       "<!-- ch_concat_in5a_chconcat&#45;&gt;relu_in5a_double_3x3_1 -->\n",
       "<g id=\"edge230\" class=\"edge\"><title>ch_concat_in5a_chconcat&#45;&gt;relu_in5a_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M372.52,-13159C379.893,-13145 388.159,-13129.4 395.049,-13116.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"367.827,-13167.9 368.515,-13157 370.161,-13163.5 372.495,-13159.1 372.495,-13159.1 372.495,-13159.1 370.161,-13163.5 376.475,-13161.2 367.827,-13167.9 367.827,-13167.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"408\" y=\"-13138.3\" font-family=\"Times,serif\" font-size=\"14.00\">224x7x7</text>\n",
       "</g>\n",
       "<!-- ch_concat_in5a_chconcat&#45;&gt;relu_in5a_proj -->\n",
       "<g id=\"edge231\" class=\"edge\"><title>ch_concat_in5a_chconcat&#45;&gt;relu_in5a_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M408.831,-13166.3C418.017,-13161 427.355,-13155.5 436,-13150 452.475,-13139.5 470.051,-13127.1 484.992,-13116.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"400.098,-13171.2 406.606,-13162.3 404.456,-13168.7 408.813,-13166.3 408.813,-13166.3 408.813,-13166.3 404.456,-13168.7 411.02,-13170.2 400.098,-13171.2 400.098,-13171.2\"/>\n",
       "<text text-anchor=\"middle\" x=\"481\" y=\"-13138.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x7x7</text>\n",
       "</g>\n",
       "<!-- conv_in5b_1x1 -->\n",
       "<g id=\"node208\" class=\"node\"><title>conv_in5b_1x1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"261,-14046 167,-14046 167,-13988 261,-13988 261,-14046\"/>\n",
       "<text text-anchor=\"middle\" x=\"214\" y=\"-14020.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"214\" y=\"-14005.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 352</text>\n",
       "</g>\n",
       "<!-- conv_in5b_1x1&#45;&gt;ch_concat_in5a_chconcat -->\n",
       "<g id=\"edge232\" class=\"edge\"><title>conv_in5b_1x1&#45;&gt;ch_concat_in5a_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M215.189,-13977.7C216.027,-13947.4 217,-13904 217,-13866 217,-13866 217,-13866 217,-13306 217,-13259.4 266.535,-13229.7 305.815,-13213.5\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"214.9,-13987.8 210.687,-13977.7 215.042,-13982.8 215.185,-13977.8 215.185,-13977.8 215.185,-13977.8 215.042,-13982.8 219.683,-13977.9 214.9,-13987.8 214.9,-13987.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"244.5\" y=\"-13599.3\" font-family=\"Times,serif\" font-size=\"14.00\">1024x7x7</text>\n",
       "</g>\n",
       "<!-- bn_in5b_1x1 -->\n",
       "<g id=\"node209\" class=\"node\"><title>bn_in5b_1x1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"260,-14198 166,-14198 166,-14140 260,-14140 260,-14198\"/>\n",
       "<text text-anchor=\"middle\" x=\"213\" y=\"-14165.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in5b_1x1&#45;&gt;conv_in5b_1x1 -->\n",
       "<g id=\"edge233\" class=\"edge\"><title>bn_in5b_1x1&#45;&gt;conv_in5b_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M213.257,-14129.5C213.43,-14103.5 213.656,-14069.6 213.813,-14046.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"213.188,-14139.8 208.755,-14129.8 213.221,-14134.8 213.255,-14129.8 213.255,-14129.8 213.255,-14129.8 213.221,-14134.8 217.755,-14129.8 213.188,-14139.8 213.188,-14139.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"238\" y=\"-14089.3\" font-family=\"Times,serif\" font-size=\"14.00\">352x7x7</text>\n",
       "</g>\n",
       "<!-- relu_in5b_1x1 -->\n",
       "<g id=\"node210\" class=\"node\"><title>relu_in5b_1x1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"269,-14350 175,-14350 175,-14292 269,-14292 269,-14350\"/>\n",
       "<text text-anchor=\"middle\" x=\"222\" y=\"-14324.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"222\" y=\"-14309.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in5b_1x1&#45;&gt;bn_in5b_1x1 -->\n",
       "<g id=\"edge234\" class=\"edge\"><title>relu_in5b_1x1&#45;&gt;bn_in5b_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M219.69,-14281.5C218.127,-14255.5 216.097,-14221.6 214.685,-14198.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"220.307,-14291.8 215.216,-14282.1 220.008,-14286.8 219.708,-14281.8 219.708,-14281.8 219.708,-14281.8 220.008,-14286.8 224.2,-14281.5 220.307,-14291.8 220.307,-14291.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"244\" y=\"-14241.3\" font-family=\"Times,serif\" font-size=\"14.00\">352x7x7</text>\n",
       "</g>\n",
       "<!-- conv_in5b_3x3_reduce -->\n",
       "<g id=\"node211\" class=\"node\"><title>conv_in5b_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"371,-13632 277,-13632 277,-13574 371,-13574 371,-13632\"/>\n",
       "<text text-anchor=\"middle\" x=\"324\" y=\"-13606.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"324\" y=\"-13591.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 192</text>\n",
       "</g>\n",
       "<!-- conv_in5b_3x3_reduce&#45;&gt;ch_concat_in5a_chconcat -->\n",
       "<g id=\"edge235\" class=\"edge\"><title>conv_in5b_3x3_reduce&#45;&gt;ch_concat_in5a_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M323.548,-13563.7C323.283,-13538.1 323,-13503.5 323,-13473 323,-13473 323,-13473 323,-13306 323,-13278.2 332.361,-13247.7 340.625,-13226.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"323.656,-13573.8 319.049,-13563.9 323.602,-13568.8 323.549,-13563.8 323.549,-13563.8 323.549,-13563.8 323.602,-13568.8 328.049,-13563.8 323.656,-13573.8 323.656,-13573.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"350.5\" y=\"-13413.3\" font-family=\"Times,serif\" font-size=\"14.00\">1024x7x7</text>\n",
       "</g>\n",
       "<!-- bn_in5b_3x3_reduce -->\n",
       "<g id=\"node212\" class=\"node\"><title>bn_in5b_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"372,-13818 278,-13818 278,-13760 372,-13760 372,-13818\"/>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-13785.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in5b_3x3_reduce&#45;&gt;conv_in5b_3x3_reduce -->\n",
       "<g id=\"edge236\" class=\"edge\"><title>bn_in5b_3x3_reduce&#45;&gt;conv_in5b_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M324.79,-13749.3C324.599,-13714.2 324.323,-13663.4 324.153,-13632.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"324.846,-13759.7 320.292,-13749.7 324.819,-13754.7 324.791,-13749.7 324.791,-13749.7 324.791,-13749.7 324.819,-13754.7 329.291,-13749.6 324.846,-13759.7 324.846,-13759.7\"/>\n",
       "<text text-anchor=\"middle\" x=\"349\" y=\"-13730.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x7x7</text>\n",
       "</g>\n",
       "<!-- relu_in5b_3x3_reduce -->\n",
       "<g id=\"node213\" class=\"node\"><title>relu_in5b_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"372,-13970 278,-13970 278,-13912 372,-13912 372,-13970\"/>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-13944.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"325\" y=\"-13929.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in5b_3x3_reduce&#45;&gt;bn_in5b_3x3_reduce -->\n",
       "<g id=\"edge237\" class=\"edge\"><title>relu_in5b_3x3_reduce&#45;&gt;bn_in5b_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M325,-13901.5C325,-13875.5 325,-13841.6 325,-13818.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"325,-13911.8 320.5,-13901.8 325,-13906.8 325,-13901.8 325,-13901.8 325,-13901.8 325,-13906.8 329.5,-13901.8 325,-13911.8 325,-13911.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"349\" y=\"-13861.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x7x7</text>\n",
       "</g>\n",
       "<!-- conv_in5b_3x3 -->\n",
       "<g id=\"node214\" class=\"node\"><title>conv_in5b_3x3</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"373,-14122 279,-14122 279,-14064 373,-14064 373,-14122\"/>\n",
       "<text text-anchor=\"middle\" x=\"326\" y=\"-14096.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"326\" y=\"-14081.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 320</text>\n",
       "</g>\n",
       "<!-- conv_in5b_3x3&#45;&gt;relu_in5b_3x3_reduce -->\n",
       "<g id=\"edge238\" class=\"edge\"><title>conv_in5b_3x3&#45;&gt;relu_in5b_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M325.743,-14053.5C325.57,-14027.5 325.344,-13993.6 325.187,-13970.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"325.812,-14063.8 321.245,-14053.8 325.779,-14058.8 325.745,-14053.8 325.745,-14053.8 325.745,-14053.8 325.779,-14058.8 330.245,-14053.8 325.812,-14063.8 325.812,-14063.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"350\" y=\"-14013.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x7x7</text>\n",
       "</g>\n",
       "<!-- bn_in5b_3x3 -->\n",
       "<g id=\"node215\" class=\"node\"><title>bn_in5b_3x3</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"373,-14274 279,-14274 279,-14216 373,-14216 373,-14274\"/>\n",
       "<text text-anchor=\"middle\" x=\"326\" y=\"-14241.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in5b_3x3&#45;&gt;conv_in5b_3x3 -->\n",
       "<g id=\"edge239\" class=\"edge\"><title>bn_in5b_3x3&#45;&gt;conv_in5b_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M326,-14205.5C326,-14179.5 326,-14145.6 326,-14122.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"326,-14215.8 321.5,-14205.8 326,-14210.8 326,-14205.8 326,-14205.8 326,-14205.8 326,-14210.8 330.5,-14205.8 326,-14215.8 326,-14215.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"350\" y=\"-14165.3\" font-family=\"Times,serif\" font-size=\"14.00\">320x7x7</text>\n",
       "</g>\n",
       "<!-- relu_in5b_3x3 -->\n",
       "<g id=\"node216\" class=\"node\"><title>relu_in5b_3x3</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"373,-14426 279,-14426 279,-14368 373,-14368 373,-14426\"/>\n",
       "<text text-anchor=\"middle\" x=\"326\" y=\"-14400.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"326\" y=\"-14385.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in5b_3x3&#45;&gt;bn_in5b_3x3 -->\n",
       "<g id=\"edge240\" class=\"edge\"><title>relu_in5b_3x3&#45;&gt;bn_in5b_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M326,-14357.5C326,-14331.5 326,-14297.6 326,-14274.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"326,-14367.8 321.5,-14357.8 326,-14362.8 326,-14357.8 326,-14357.8 326,-14357.8 326,-14362.8 330.5,-14357.8 326,-14367.8 326,-14367.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"350\" y=\"-14317.3\" font-family=\"Times,serif\" font-size=\"14.00\">320x7x7</text>\n",
       "</g>\n",
       "<!-- conv_in5b_double_3x3_reduce -->\n",
       "<g id=\"node217\" class=\"node\"><title>conv_in5b_double_3x3_reduce</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"457,-13336 363,-13336 363,-13278 457,-13278 457,-13336\"/>\n",
       "<text text-anchor=\"middle\" x=\"410\" y=\"-13310.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"410\" y=\"-13295.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 192</text>\n",
       "</g>\n",
       "<!-- conv_in5b_double_3x3_reduce&#45;&gt;ch_concat_in5a_chconcat -->\n",
       "<g id=\"edge241\" class=\"edge\"><title>conv_in5b_double_3x3_reduce&#45;&gt;ch_concat_in5a_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M390.48,-13269C383.107,-13255 374.841,-13239.4 367.951,-13226.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"395.173,-13277.9 386.525,-13271.2 392.839,-13273.5 390.505,-13269.1 390.505,-13269.1 390.505,-13269.1 392.839,-13273.5 394.485,-13267 395.173,-13277.9 395.173,-13277.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"411.5\" y=\"-13248.3\" font-family=\"Times,serif\" font-size=\"14.00\">1024x7x7</text>\n",
       "</g>\n",
       "<!-- bn_in5b_double_3x3_reduce -->\n",
       "<g id=\"node218\" class=\"node\"><title>bn_in5b_double_3x3_reduce</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"490,-13446 396,-13446 396,-13388 490,-13388 490,-13446\"/>\n",
       "<text text-anchor=\"middle\" x=\"443\" y=\"-13413.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in5b_double_3x3_reduce&#45;&gt;conv_in5b_double_3x3_reduce -->\n",
       "<g id=\"edge242\" class=\"edge\"><title>bn_in5b_double_3x3_reduce&#45;&gt;conv_in5b_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M431.454,-13378.2C427.248,-13364.4 422.569,-13349.1 418.656,-13336.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"434.416,-13387.9 427.19,-13379.7 432.955,-13383.1 431.494,-13378.3 431.494,-13378.3 431.494,-13378.3 432.955,-13383.1 435.797,-13377 434.416,-13387.9 434.416,-13387.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"452\" y=\"-13358.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x7x7</text>\n",
       "</g>\n",
       "<!-- relu_in5b_double_3x3_reduce -->\n",
       "<g id=\"node219\" class=\"node\"><title>relu_in5b_double_3x3_reduce</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"490,-13556 396,-13556 396,-13498 490,-13498 490,-13556\"/>\n",
       "<text text-anchor=\"middle\" x=\"443\" y=\"-13530.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"443\" y=\"-13515.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in5b_double_3x3_reduce&#45;&gt;bn_in5b_double_3x3_reduce -->\n",
       "<g id=\"edge243\" class=\"edge\"><title>relu_in5b_double_3x3_reduce&#45;&gt;bn_in5b_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M443,-13487.8C443,-13474.2 443,-13459 443,-13446.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"443,-13497.9 438.5,-13487.9 443,-13492.9 443,-13487.9 443,-13487.9 443,-13487.9 443,-13492.9 447.5,-13487.9 443,-13497.9 443,-13497.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"467\" y=\"-13468.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x7x7</text>\n",
       "</g>\n",
       "<!-- conv_in5b_double_3x3_0 -->\n",
       "<g id=\"node220\" class=\"node\"><title>conv_in5b_double_3x3_0</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"490,-13708 396,-13708 396,-13650 490,-13650 490,-13708\"/>\n",
       "<text text-anchor=\"middle\" x=\"443\" y=\"-13682.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"443\" y=\"-13667.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 224</text>\n",
       "</g>\n",
       "<!-- conv_in5b_double_3x3_0&#45;&gt;relu_in5b_double_3x3_reduce -->\n",
       "<g id=\"edge244\" class=\"edge\"><title>conv_in5b_double_3x3_0&#45;&gt;relu_in5b_double_3x3_reduce</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M443,-13639.5C443,-13613.5 443,-13579.6 443,-13556.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"443,-13649.8 438.5,-13639.8 443,-13644.8 443,-13639.8 443,-13639.8 443,-13639.8 443,-13644.8 447.5,-13639.8 443,-13649.8 443,-13649.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"467\" y=\"-13599.3\" font-family=\"Times,serif\" font-size=\"14.00\">192x7x7</text>\n",
       "</g>\n",
       "<!-- bn_in5b_double_3x3_0 -->\n",
       "<g id=\"node221\" class=\"node\"><title>bn_in5b_double_3x3_0</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"485,-13818 391,-13818 391,-13760 485,-13760 485,-13818\"/>\n",
       "<text text-anchor=\"middle\" x=\"438\" y=\"-13785.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in5b_double_3x3_0&#45;&gt;conv_in5b_double_3x3_0 -->\n",
       "<g id=\"edge245\" class=\"edge\"><title>bn_in5b_double_3x3_0&#45;&gt;conv_in5b_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M439.768,-13749.8C440.4,-13736.2 441.101,-13721 441.689,-13708.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"439.301,-13759.9 435.268,-13749.7 439.532,-13754.9 439.763,-13749.9 439.763,-13749.9 439.763,-13749.9 439.532,-13754.9 444.258,-13750.1 439.301,-13759.9 439.301,-13759.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"464\" y=\"-13730.3\" font-family=\"Times,serif\" font-size=\"14.00\">224x7x7</text>\n",
       "</g>\n",
       "<!-- relu_in5b_double_3x3_0 -->\n",
       "<g id=\"node222\" class=\"node\"><title>relu_in5b_double_3x3_0</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"485,-13970 391,-13970 391,-13912 485,-13912 485,-13970\"/>\n",
       "<text text-anchor=\"middle\" x=\"438\" y=\"-13944.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"438\" y=\"-13929.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in5b_double_3x3_0&#45;&gt;bn_in5b_double_3x3_0 -->\n",
       "<g id=\"edge246\" class=\"edge\"><title>relu_in5b_double_3x3_0&#45;&gt;bn_in5b_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M437.105,-13901.7C437.063,-13899.1 437.027,-13896.5 437,-13894 436.72,-13868.2 436.72,-13861.8 437,-13836 437.063,-13830.2 437.169,-13824.1 437.29,-13818.2\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"437.29,-13911.8 432.607,-13901.9 437.198,-13906.8 437.106,-13901.8 437.106,-13901.8 437.106,-13901.8 437.198,-13906.8 441.605,-13901.7 437.29,-13911.8 437.29,-13911.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"461\" y=\"-13861.3\" font-family=\"Times,serif\" font-size=\"14.00\">224x7x7</text>\n",
       "</g>\n",
       "<!-- conv_in5b_double_3x3_1 -->\n",
       "<g id=\"node223\" class=\"node\"><title>conv_in5b_double_3x3_1</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"485,-14122 391,-14122 391,-14064 485,-14064 485,-14122\"/>\n",
       "<text text-anchor=\"middle\" x=\"438\" y=\"-14096.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"438\" y=\"-14081.8\" font-family=\"Times,serif\" font-size=\"14.00\">3x3/1, 224</text>\n",
       "</g>\n",
       "<!-- conv_in5b_double_3x3_1&#45;&gt;relu_in5b_double_3x3_0 -->\n",
       "<g id=\"edge247\" class=\"edge\"><title>conv_in5b_double_3x3_1&#45;&gt;relu_in5b_double_3x3_0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M438,-14053.5C438,-14027.5 438,-13993.6 438,-13970.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"438,-14063.8 433.5,-14053.8 438,-14058.8 438,-14053.8 438,-14053.8 438,-14053.8 438,-14058.8 442.5,-14053.8 438,-14063.8 438,-14063.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"462\" y=\"-14013.3\" font-family=\"Times,serif\" font-size=\"14.00\">224x7x7</text>\n",
       "</g>\n",
       "<!-- bn_in5b_double_3x3_1 -->\n",
       "<g id=\"node224\" class=\"node\"><title>bn_in5b_double_3x3_1</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"485,-14274 391,-14274 391,-14216 485,-14216 485,-14274\"/>\n",
       "<text text-anchor=\"middle\" x=\"438\" y=\"-14241.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in5b_double_3x3_1&#45;&gt;conv_in5b_double_3x3_1 -->\n",
       "<g id=\"edge248\" class=\"edge\"><title>bn_in5b_double_3x3_1&#45;&gt;conv_in5b_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M438,-14205.5C438,-14179.5 438,-14145.6 438,-14122.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"438,-14215.8 433.5,-14205.8 438,-14210.8 438,-14205.8 438,-14205.8 438,-14205.8 438,-14210.8 442.5,-14205.8 438,-14215.8 438,-14215.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"462\" y=\"-14165.3\" font-family=\"Times,serif\" font-size=\"14.00\">224x7x7</text>\n",
       "</g>\n",
       "<!-- relu_in5b_double_3x3_1 -->\n",
       "<g id=\"node225\" class=\"node\"><title>relu_in5b_double_3x3_1</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"485,-14426 391,-14426 391,-14368 485,-14368 485,-14426\"/>\n",
       "<text text-anchor=\"middle\" x=\"438\" y=\"-14400.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"438\" y=\"-14385.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in5b_double_3x3_1&#45;&gt;bn_in5b_double_3x3_1 -->\n",
       "<g id=\"edge249\" class=\"edge\"><title>relu_in5b_double_3x3_1&#45;&gt;bn_in5b_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M438,-14357.5C438,-14331.5 438,-14297.6 438,-14274.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"438,-14367.8 433.5,-14357.8 438,-14362.8 438,-14357.8 438,-14357.8 438,-14357.8 438,-14362.8 442.5,-14357.8 438,-14367.8 438,-14367.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"462\" y=\"-14317.3\" font-family=\"Times,serif\" font-size=\"14.00\">224x7x7</text>\n",
       "</g>\n",
       "<!-- max_pool_in5b_pool -->\n",
       "<g id=\"node226\" class=\"node\"><title>max_pool_in5b_pool</title>\n",
       "<polygon fill=\"#80b1d3\" stroke=\"black\" points=\"588,-13894 494,-13894 494,-13836 588,-13836 588,-13894\"/>\n",
       "<text text-anchor=\"middle\" x=\"541\" y=\"-13868.8\" font-family=\"Times,serif\" font-size=\"14.00\">Pooling</text>\n",
       "<text text-anchor=\"middle\" x=\"541\" y=\"-13853.8\" font-family=\"Times,serif\" font-size=\"14.00\">max, 3x3/1</text>\n",
       "</g>\n",
       "<!-- max_pool_in5b_pool&#45;&gt;ch_concat_in5a_chconcat -->\n",
       "<g id=\"edge250\" class=\"edge\"><title>max_pool_in5b_pool&#45;&gt;ch_concat_in5a_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M537.385,-13825.8C535.265,-13800.1 533,-13765.6 533,-13735 533,-13735 533,-13735 533,-13306 533,-13244 453.624,-13216.7 400.293,-13205.4\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"538.247,-13835.8 532.91,-13826.3 537.82,-13830.9 537.394,-13825.9 537.394,-13825.9 537.394,-13825.9 537.82,-13830.9 541.877,-13825.5 538.247,-13835.8 538.247,-13835.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"560.5\" y=\"-13523.3\" font-family=\"Times,serif\" font-size=\"14.00\">1024x7x7</text>\n",
       "</g>\n",
       "<!-- conv_in5b_proj -->\n",
       "<g id=\"node227\" class=\"node\"><title>conv_in5b_proj</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"597,-14122 503,-14122 503,-14064 597,-14064 597,-14122\"/>\n",
       "<text text-anchor=\"middle\" x=\"550\" y=\"-14096.8\" font-family=\"Times,serif\" font-size=\"14.00\">Convolution</text>\n",
       "<text text-anchor=\"middle\" x=\"550\" y=\"-14081.8\" font-family=\"Times,serif\" font-size=\"14.00\">1x1/1, 128</text>\n",
       "</g>\n",
       "<!-- conv_in5b_proj&#45;&gt;max_pool_in5b_pool -->\n",
       "<g id=\"edge251\" class=\"edge\"><title>conv_in5b_proj&#45;&gt;max_pool_in5b_pool</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M548.48,-14053.8C546.681,-14008.6 543.726,-13934.5 542.122,-13894.2\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"548.878,-14063.8 543.984,-14054 548.679,-14058.8 548.48,-14053.8 548.48,-14053.8 548.48,-14053.8 548.679,-14058.8 552.977,-14053.7 548.878,-14063.8 548.878,-14063.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"575.5\" y=\"-14013.3\" font-family=\"Times,serif\" font-size=\"14.00\">1024x7x7</text>\n",
       "</g>\n",
       "<!-- bn_in5b_proj -->\n",
       "<g id=\"node228\" class=\"node\"><title>bn_in5b_proj</title>\n",
       "<polygon fill=\"#bebada\" stroke=\"black\" points=\"597,-14274 503,-14274 503,-14216 597,-14216 597,-14274\"/>\n",
       "<text text-anchor=\"middle\" x=\"550\" y=\"-14241.3\" font-family=\"Times,serif\" font-size=\"14.00\">BatchNorm</text>\n",
       "</g>\n",
       "<!-- bn_in5b_proj&#45;&gt;conv_in5b_proj -->\n",
       "<g id=\"edge252\" class=\"edge\"><title>bn_in5b_proj&#45;&gt;conv_in5b_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M550,-14205.5C550,-14179.5 550,-14145.6 550,-14122.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"550,-14215.8 545.5,-14205.8 550,-14210.8 550,-14205.8 550,-14205.8 550,-14205.8 550,-14210.8 554.5,-14205.8 550,-14215.8 550,-14215.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"574\" y=\"-14165.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x7x7</text>\n",
       "</g>\n",
       "<!-- relu_in5b_proj -->\n",
       "<g id=\"node229\" class=\"node\"><title>relu_in5b_proj</title>\n",
       "<polygon fill=\"#ffffb3\" stroke=\"black\" points=\"597,-14426 503,-14426 503,-14368 597,-14368 597,-14426\"/>\n",
       "<text text-anchor=\"middle\" x=\"550\" y=\"-14400.8\" font-family=\"Times,serif\" font-size=\"14.00\">Activation</text>\n",
       "<text text-anchor=\"middle\" x=\"550\" y=\"-14385.8\" font-family=\"Times,serif\" font-size=\"14.00\">relu</text>\n",
       "</g>\n",
       "<!-- relu_in5b_proj&#45;&gt;bn_in5b_proj -->\n",
       "<g id=\"edge253\" class=\"edge\"><title>relu_in5b_proj&#45;&gt;bn_in5b_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M550,-14357.5C550,-14331.5 550,-14297.6 550,-14274.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"550,-14367.8 545.5,-14357.8 550,-14362.8 550,-14357.8 550,-14357.8 550,-14357.8 550,-14362.8 554.5,-14357.8 550,-14367.8 550,-14367.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"574\" y=\"-14317.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x7x7</text>\n",
       "</g>\n",
       "<!-- ch_concat_in5b_chconcat -->\n",
       "<g id=\"node230\" class=\"node\"><title>ch_concat_in5b_chconcat</title>\n",
       "<polygon fill=\"#fdb462\" stroke=\"black\" points=\"428,-14536 334,-14536 334,-14478 428,-14478 428,-14536\"/>\n",
       "<text text-anchor=\"middle\" x=\"381\" y=\"-14503.3\" font-family=\"Times,serif\" font-size=\"14.00\">Concat</text>\n",
       "</g>\n",
       "<!-- ch_concat_in5b_chconcat&#45;&gt;relu_in5b_1x1 -->\n",
       "<g id=\"edge254\" class=\"edge\"><title>ch_concat_in5b_chconcat&#45;&gt;relu_in5b_1x1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M324.827,-14478.7C315.465,-14473.1 306.158,-14466.8 298,-14460 262.993,-14430.9 241.374,-14381.3 230.536,-14350.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"333.784,-14483.8 322.872,-14482.7 329.451,-14481.3 325.118,-14478.8 325.118,-14478.8 325.118,-14478.8 329.451,-14481.3 327.364,-14474.9 333.784,-14483.8 333.784,-14483.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"322\" y=\"-14448.3\" font-family=\"Times,serif\" font-size=\"14.00\">352x7x7</text>\n",
       "</g>\n",
       "<!-- ch_concat_in5b_chconcat&#45;&gt;relu_in5b_3x3 -->\n",
       "<g id=\"edge255\" class=\"edge\"><title>ch_concat_in5b_chconcat&#45;&gt;relu_in5b_3x3</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M361.559,-14468.9C360.01,-14465.9 358.475,-14462.9 357,-14460 351.361,-14449 345.242,-14436.8 339.941,-14426.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"366.2,-14477.8 357.601,-14471 363.898,-14473.4 361.596,-14468.9 361.596,-14468.9 361.596,-14468.9 363.898,-14473.4 365.591,-14466.9 366.2,-14477.8 366.2,-14477.8\"/>\n",
       "<text text-anchor=\"middle\" x=\"381\" y=\"-14448.3\" font-family=\"Times,serif\" font-size=\"14.00\">320x7x7</text>\n",
       "</g>\n",
       "<!-- ch_concat_in5b_chconcat&#45;&gt;relu_in5b_double_3x3_1 -->\n",
       "<g id=\"edge256\" class=\"edge\"><title>ch_concat_in5b_chconcat&#45;&gt;relu_in5b_double_3x3_1</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M400.52,-14469C407.893,-14455 416.159,-14439.4 423.049,-14426.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"395.827,-14477.9 396.515,-14467 398.161,-14473.5 400.495,-14469.1 400.495,-14469.1 400.495,-14469.1 398.161,-14473.5 404.475,-14471.2 395.827,-14477.9 395.827,-14477.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"436\" y=\"-14448.3\" font-family=\"Times,serif\" font-size=\"14.00\">224x7x7</text>\n",
       "</g>\n",
       "<!-- ch_concat_in5b_chconcat&#45;&gt;relu_in5b_proj -->\n",
       "<g id=\"edge257\" class=\"edge\"><title>ch_concat_in5b_chconcat&#45;&gt;relu_in5b_proj</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M436.831,-14476.3C446.017,-14471 455.355,-14465.5 464,-14460 480.475,-14449.5 498.051,-14437.1 512.992,-14426.1\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"428.098,-14481.2 434.606,-14472.3 432.456,-14478.7 436.813,-14476.3 436.813,-14476.3 436.813,-14476.3 432.456,-14478.7 439.02,-14480.2 428.098,-14481.2 428.098,-14481.2\"/>\n",
       "<text text-anchor=\"middle\" x=\"509\" y=\"-14448.3\" font-family=\"Times,serif\" font-size=\"14.00\">128x7x7</text>\n",
       "</g>\n",
       "<!-- global_avg -->\n",
       "<g id=\"node231\" class=\"node\"><title>global_avg</title>\n",
       "<polygon fill=\"#80b1d3\" stroke=\"black\" points=\"428,-14646 334,-14646 334,-14588 428,-14588 428,-14646\"/>\n",
       "<text text-anchor=\"middle\" x=\"381\" y=\"-14620.8\" font-family=\"Times,serif\" font-size=\"14.00\">Pooling</text>\n",
       "<text text-anchor=\"middle\" x=\"381\" y=\"-14605.8\" font-family=\"Times,serif\" font-size=\"14.00\">avg, 7x7/1</text>\n",
       "</g>\n",
       "<!-- global_avg&#45;&gt;ch_concat_in5b_chconcat -->\n",
       "<g id=\"edge258\" class=\"edge\"><title>global_avg&#45;&gt;ch_concat_in5b_chconcat</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M381,-14577.8C381,-14564.2 381,-14549 381,-14536.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"381,-14587.9 376.5,-14577.9 381,-14582.9 381,-14577.9 381,-14577.9 381,-14577.9 381,-14582.9 385.5,-14577.9 381,-14587.9 381,-14587.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"408.5\" y=\"-14558.3\" font-family=\"Times,serif\" font-size=\"14.00\">1024x7x7</text>\n",
       "</g>\n",
       "<!-- flatten0 -->\n",
       "<g id=\"node232\" class=\"node\"><title>flatten0</title>\n",
       "<polygon fill=\"#fdb462\" stroke=\"black\" points=\"428,-14756 334,-14756 334,-14698 428,-14698 428,-14756\"/>\n",
       "<text text-anchor=\"middle\" x=\"381\" y=\"-14723.3\" font-family=\"Times,serif\" font-size=\"14.00\">Flatten</text>\n",
       "</g>\n",
       "<!-- flatten0&#45;&gt;global_avg -->\n",
       "<g id=\"edge259\" class=\"edge\"><title>flatten0&#45;&gt;global_avg</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M381,-14687.8C381,-14674.2 381,-14659 381,-14646.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"381,-14697.9 376.5,-14687.9 381,-14692.9 381,-14687.9 381,-14687.9 381,-14687.9 381,-14692.9 385.5,-14687.9 381,-14697.9 381,-14697.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"408.5\" y=\"-14668.3\" font-family=\"Times,serif\" font-size=\"14.00\">1024x1x1</text>\n",
       "</g>\n",
       "<!-- fullyconnected0 -->\n",
       "<g id=\"node233\" class=\"node\"><title>fullyconnected0</title>\n",
       "<polygon fill=\"#fb8072\" stroke=\"black\" points=\"428,-14866 334,-14866 334,-14808 428,-14808 428,-14866\"/>\n",
       "<text text-anchor=\"middle\" x=\"381\" y=\"-14840.8\" font-family=\"Times,serif\" font-size=\"14.00\">FullyConnected</text>\n",
       "<text text-anchor=\"middle\" x=\"381\" y=\"-14825.8\" font-family=\"Times,serif\" font-size=\"14.00\">1000</text>\n",
       "</g>\n",
       "<!-- fullyconnected0&#45;&gt;flatten0 -->\n",
       "<g id=\"edge260\" class=\"edge\"><title>fullyconnected0&#45;&gt;flatten0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M381,-14797.8C381,-14784.2 381,-14769 381,-14756.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"381,-14807.9 376.5,-14797.9 381,-14802.9 381,-14797.9 381,-14797.9 381,-14797.9 381,-14802.9 385.5,-14797.9 381,-14807.9 381,-14807.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"408.5\" y=\"-14778.3\" font-family=\"Times,serif\" font-size=\"14.00\">1x1x1024</text>\n",
       "</g>\n",
       "<!-- softmax0 -->\n",
       "<g id=\"node234\" class=\"node\"><title>softmax0</title>\n",
       "<polygon fill=\"#b3de69\" stroke=\"black\" points=\"428,-14976 334,-14976 334,-14918 428,-14918 428,-14976\"/>\n",
       "<text text-anchor=\"middle\" x=\"381\" y=\"-14943.3\" font-family=\"Times,serif\" font-size=\"14.00\">SoftmaxOutput</text>\n",
       "</g>\n",
       "<!-- softmax0&#45;&gt;fullyconnected0 -->\n",
       "<g id=\"edge261\" class=\"edge\"><title>softmax0&#45;&gt;fullyconnected0</title>\n",
       "<path fill=\"none\" stroke=\"black\" d=\"M381,-14907.8C381,-14894.2 381,-14879 381,-14866.3\"/>\n",
       "<polygon fill=\"black\" stroke=\"black\" points=\"381,-14917.9 376.5,-14907.9 381,-14912.9 381,-14907.9 381,-14907.9 381,-14907.9 381,-14912.9 385.5,-14907.9 381,-14917.9 381,-14917.9\"/>\n",
       "<text text-anchor=\"middle\" x=\"395\" y=\"-14888.3\" font-family=\"Times,serif\" font-size=\"14.00\">1000</text>\n",
       "</g>\n",
       "</g>\n",
       "</svg>\n"
      ],
      "text/plain": [
       "<graphviz.dot.Digraph at 0x7f2bb4078630>"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# data\n",
    "data = mx.symbol.Variable(name=\"data\")\n",
    "# stage 1\n",
    "conv1 = ConvFactory(data=data, num_filter=64, kernel=(7, 7), stride=(2, 2), pad=(3, 3), name='conv1')\n",
    "pool1 = mx.symbol.Pooling(data=conv1, kernel=(3, 3), stride=(2, 2), name='pool1', pool_type='max')\n",
    "# stage 2\n",
    "conv2red = ConvFactory(data=pool1, num_filter=64, kernel=(1, 1), stride=(1, 1), name='conv2red')\n",
    "conv2 = ConvFactory(data=conv2red, num_filter=192, kernel=(3, 3), stride=(1, 1), pad=(1, 1), name='conv2')\n",
    "pool2 = mx.symbol.Pooling(data=conv2, kernel=(3, 3), stride=(2, 2), name='pool2', pool_type='max')\n",
    "# stage 3\n",
    "in3a = InceptionFactoryA(pool2, 64, 64, 64, 64, 96, \"avg\", 32, name='in3a')\n",
    "in3b = InceptionFactoryA(in3a, 64, 64, 96, 64, 96, \"avg\", 64, name='in3b')\n",
    "in3c = InceptionFactoryB(in3b, 128, 160, 64, 96, name='in3c')\n",
    "# stage 4\n",
    "in4a = InceptionFactoryA(in3c, 224, 64, 96, 96, 128, \"avg\", 128, name='in4a')\n",
    "in4b = InceptionFactoryA(in4a, 192, 96, 128, 96, 128, \"avg\", 128, name='in4b')\n",
    "in4c = InceptionFactoryA(in4b, 160, 128, 160, 128, 160, \"avg\", 128, name='in4c')\n",
    "in4d = InceptionFactoryA(in4c, 96, 128, 192, 160, 192, \"avg\", 128, name='in4d')\n",
    "in4e = InceptionFactoryB(in4d, 128, 192, 192, 256, name='in4e')\n",
    "# stage 5\n",
    "in5a = InceptionFactoryA(in4e, 352, 192, 320, 160, 224, \"avg\", 128, name='in5a')\n",
    "in5b = InceptionFactoryA(in5a, 352, 192, 320, 192, 224, \"max\", 128, name='in5b')\n",
    "# global avg pooling\n",
    "avg = mx.symbol.Pooling(data=in5b, kernel=(7, 7), stride=(1, 1), name=\"global_avg\", pool_type='avg')\n",
    "# linear classifier\n",
    "flatten = mx.symbol.Flatten(data=avg)\n",
    "fc1 = mx.symbol.FullyConnected(data=flatten, num_hidden=1000)\n",
    "softmax = mx.symbol.SoftmaxOutput(data=fc1)\n",
    "\n",
    "# if you like, you can visualize full network structure\n",
    "mx.viz.plot_network(symbol=softmax, shape={\"data\" : (128, 3, 224, 224)})"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.4.0"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}