ben_athiwaratkun/pytorch-bayesgan/Bayesian GAN in PyTorch.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Bayesian GAN"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Bayesian GAN (Saatchi and Wilson, 2017) is a Bayesian formulation of Generative Adversarial Networks (Goodfellow, 2014) where we learn the **distributions** of the generator parameters $\\theta_g$ and the discriminator parameters $\\theta_d$ instead of optimizing for point estimates. The benefits of the Bayesian approach include the flexibility to model **multimodality** in the parameter space, as well as the ability to **prevent mode collapse** in the maximum likelihood (non-Bayesian) case.\n",
    "\n",
    "\n",
    "We learn Bayesian GAN via an approximate inference algorithm called **Stochastic Gradient Hamiltonian Monte Carlo (SGHMC)** which is a gradient-based MCMC methods whose samples approximate the true posterior distributions of $\\theta_g$ and $\\theta_d$."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The Bayesian GAN training process starts from sampling noise $z$ from a fixed distribution (typically standard d-dim normal).  The noise is fed to the generator where the parameters $\\theta_g$ are sampled from the posterior distribution $p(\\theta_g | D)$. The generated image given the parameters $\\theta_g$ ($G(z|\\theta_g)$) as well as the real data are presented to the discriminator, whose parameters are sample from its posterior distribution $p(\\theta_d|D)$. We update the posteriors using the gradients $\\frac{\\partial \\log p(\\theta_g|D) }{\\partial \\theta_g }$ and $\\frac{\\partial \\log p(\\theta_d|D) }{\\partial \\theta_d }$ with Stochastic Gradient Hamiltonian Monte Carlo (SGHMC). Next section explains the intuition behind SGHMC."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "![Bayesian GAN](figs/graphics_bayesgan.png)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<img src=\"figs/graphics_bayesgan.pdf\">"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Learning Posterior Distributions \n",
    "\n",
    "There are many approaches to estimate the posterior distribution of model parameters, namely, Markov Chain Monte Carlo (MCMC), Variational Inference (VI), Approximate Bayesian Computation (ABC), etc. Bayesian GAN uses SGHMC (Chen, 2014), a stochastic version of HMC (Neal, 2012), which is an MCMC method that (1) uses gradient to perform sampling efficiently (2) stochastic gradient from minibatch to handle large amount of data. \n",
    "\n",
    "Below we show the visualization of samples generated from HMC. Once the algorithm runs for a while, we can see that the high density region has higher concentration of points. HMC can also handle multimodality (the second visualization)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<iframe width=\"1000\" height=\"400\" src=\"https://chi-feng.github.io/mcmc-demo/app.html#HamiltonianMC,banana\" frameborder=\"0\" allowfullscreen></iframe>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "execution_count": 1,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from IPython.display import HTML\n",
    "HTML('<iframe width=\"1000\" height=\"400\" src=\"https://chi-feng.github.io/mcmc-demo/app.html#HamiltonianMC,banana\" frameborder=\"0\" allowfullscreen></iframe>')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Hamiltonian Monte Carlo allows us to learn arbitrary distributions, including multimodal distributions where other Bayesian approach such as variational inference cannot model. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<iframe width=\"1000\" height=\"400\" src=\"https://chi-feng.github.io/mcmc-demo/app.html#HamiltonianMC,multimodal\" frameborder=\"0\" allowfullscreen></iframe>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "HTML('<iframe width=\"1000\" height=\"400\" src=\"https://chi-feng.github.io/mcmc-demo/app.html#HamiltonianMC,multimodal\" frameborder=\"0\" allowfullscreen></iframe>')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "# Training\n",
    "\n",
    "We show that Bayesian GAN can capture the data distribution by measuring its performance in the semi-supervised setting. We will perform the posterior update as outline in Algorithm 1 in Saatchi (2017). This algorithm can be implemented quite simply by adding noise to standard optimizers such as SGD with momentum and keep track of the parameters we sample from the posterior. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "![Posterior Sampling Algorithm](figs/bgan_alg1.png)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### SGHMC by Optimizing a Noisy Loss\n",
    "\n",
    "First, observe that the update rules are similar to momentum SGD except for the noise $\\boldsymbol{n}$. In fact, without $\\boldsymbol{n}$, this is equivalent to performing momentum SGD with the loss is $- \\sum_{i=1}{J_g} \\sum_{k=1}^{J_d} \\log \\text{posterior} $. We will describe the case where $J_g = J_d=1$ for simplicity. \n",
    "\n",
    "We use the main loss $\\mathcal{L} = - \\log p(\\theta | ..)$ and add a noise loss $\\mathcal{L}_\\text{noise} = \\frac{1}{\\eta} \\theta \\cdot \\boldsymbol{n}$ where $\\boldsymbol{n} \\sim \\mathcal{N}(0, 2 \\alpha \\eta I)$ so that optimizing the loss function $\\mathcal{L} + \\mathcal{L}_\\text{noise}$ with momentum SGD is equivalent to performing the SGHMC update step. \n",
    "\n",
    "Below (Equation 3 and 4) are the posterior probabilities where each error term corresponds its negative log probability."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "![Posterior Distributions](figs/posterior_eqs2.png)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Collecting tensorboard_logger\n",
      "  Using cached tensorboard_logger-0.0.4-py2.py3-none-any.whl\n",
      "Requirement already satisfied: six in /home/nbcommon/anaconda3_501/lib/python3.6/site-packages (from tensorboard_logger)\n",
      "Requirement already satisfied: protobuf in /home/nbcommon/anaconda3_501/lib/python3.6/site-packages (from tensorboard_logger)\n",
      "Requirement already satisfied: setuptools in /home/nbcommon/anaconda3_501/lib/python3.6/site-packages (from protobuf->tensorboard_logger)\n",
      "Installing collected packages: tensorboard-logger\n",
      "Successfully installed tensorboard-logger-0.0.4\n"
     ]
    }
   ],
   "source": [
    "!pip install tensorboard_logger"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/home/nbuser/anaconda3_501/lib/python3.6/importlib/_bootstrap.py:205: RuntimeWarning: compiletime version 3.5 of module 'tensorflow.python.framework.fast_tensor_util' does not match runtime version 3.6\n",
      "  return f(*args, **kwds)\n"
     ]
    }
   ],
   "source": [
    "from __future__ import print_function\n",
    "import os, pickle\n",
    "import numpy as np\n",
    "import random, math\n",
    "import torch\n",
    "import torch.nn as nn\n",
    "import torch.nn.parallel\n",
    "import torch.backends.cudnn as cudnn\n",
    "import torch.optim as optim\n",
    "import torch.utils.data\n",
    "import torchvision.datasets as dset\n",
    "import torchvision.transforms as transforms\n",
    "import torchvision.utils as vutils\n",
    "from torch.autograd import Variable\n",
    "from statsutil import AverageMeter, accuracy\n",
    "from tensorboard_logger import configure, log_value"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Error Making Directory modelfiles/pytorch_demo3\n"
     ]
    },
    {
     "ename": "ValueError",
     "evalue": "default logger already configured",
     "output_type": "error",
     "traceback": [
      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[0;31mValueError\u001b[0m                                Traceback (most recent call last)",
      "\u001b[0;32m<ipython-input-5-953330743521>\u001b[0m in \u001b[0;36m<module>\u001b[0;34m()\u001b[0m\n\u001b[1;32m     28\u001b[0m     \u001b[0mprint\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m\"Error Making Directory\"\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mopt\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0moutf\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     29\u001b[0m     \u001b[0;32mpass\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 30\u001b[0;31m \u001b[0;32mif\u001b[0m \u001b[0mopt\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mtensorboard\u001b[0m\u001b[0;34m:\u001b[0m \u001b[0mconfigure\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mopt\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0moutf\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m",
      "\u001b[0;32m~/anaconda3_501/lib/python3.6/site-packages/tensorboard_logger/tensorboard_logger.py\u001b[0m in \u001b[0;36mconfigure\u001b[0;34m(logdir, flush_secs)\u001b[0m\n\u001b[1;32m    140\u001b[0m     \u001b[0;32mglobal\u001b[0m \u001b[0m_default_logger\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    141\u001b[0m     \u001b[0;32mif\u001b[0m \u001b[0m_default_logger\u001b[0m \u001b[0;32mis\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0;32mNone\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 142\u001b[0;31m         \u001b[0;32mraise\u001b[0m \u001b[0mValueError\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m'default logger already configured'\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    143\u001b[0m     \u001b[0m_default_logger\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mLogger\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mlogdir\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mflush_secs\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mflush_secs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    144\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n",
      "\u001b[0;31mValueError\u001b[0m: default logger already configured"
     ]
    }
   ],
   "source": [
    "# Default Parameters\n",
    "import argparse\n",
    "parser = argparse.ArgumentParser()\n",
    "parser.add_argument('--dataset', default='cifar10')\n",
    "parser.add_argument('--imageSize', type=int, default=32)\n",
    "parser.add_argument('--batchSize', type=int, default=64, help='input batch size')\n",
    "parser.add_argument('--nz', type=int, default=100, help='size of the latent z vector')\n",
    "parser.add_argument('--niter', type=int, default=2, help='number of epochs to train for')\n",
    "parser.add_argument('--lr', type=float, default=0.0002, help='learning rate, default=0.0002')\n",
    "parser.add_argument('--cuda', type=int, default=1, help='enables cuda')\n",
    "parser.add_argument('--ngpu', type=int, default=1, help='number of GPUs to use')\n",
    "parser.add_argument('--outf', default='modelfiles/pytorch_demo3', help='folder to output images and model checkpoints')\n",
    "parser.add_argument('--numz', type=int, default=1, help='The number of set of z to marginalize over.')\n",
    "parser.add_argument('--num_mcmc', type=int, default=10, help='The number of MCMC chains to run in parallel')\n",
    "parser.add_argument('--num_semi', type=int, default=4000, help='The number of semi-supervised samples')\n",
    "parser.add_argument('--gnoise_alpha', type=float, default=0.0001, help='')\n",
    "parser.add_argument('--dnoise_alpha', type=float, default=0.0001, help='')\n",
    "parser.add_argument('--d_optim', type=str, default='adam', choices=['adam', 'sgd'], help='')\n",
    "parser.add_argument('--g_optim', type=str, default='adam', choices=['adam', 'sgd'], help='')\n",
    "parser.add_argument('--stats_interval', type=int, default=10, help='Calculate test accuracy every interval')\n",
    "parser.add_argument('--tensorboard', type=int, default=1, help='')\n",
    "parser.add_argument('--bayes', type=int, default=1, help='Do Bayesian GAN or normal GAN')\n",
    "import sys; sys.argv=['']; del sys\n",
    "opt = parser.parse_args()\n",
    "try:\n",
    "    os.makedirs(opt.outf)\n",
    "except OSError:\n",
    "    print(\"Error Making Directory\", opt.outf)\n",
    "    pass\n",
    "if opt.tensorboard: configure(opt.outf)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "ename": "KeyError",
     "evalue": "'CIFAR10_PATH'",
     "output_type": "error",
     "traceback": [
      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[0;31mKeyError\u001b[0m                                  Traceback (most recent call last)",
      "\u001b[0;32m<ipython-input-6-f32be3e849fe>\u001b[0m in \u001b[0;36m<module>\u001b[0;34m()\u001b[0m\n\u001b[1;32m      8\u001b[0m                            ])\n\u001b[1;32m      9\u001b[0m \u001b[0;31m# get training set and test set\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 10\u001b[0;31m dataset = dset.CIFAR10(root=os.environ['CIFAR10_PATH'], download=True,\n\u001b[0m\u001b[1;32m     11\u001b[0m                            transform=transform_opt)  \n\u001b[1;32m     12\u001b[0m dataloader = torch.utils.data.DataLoader(dataset, batch_size=opt.batchSize,\n",
      "\u001b[0;32m~/anaconda3_501/lib/python3.6/os.py\u001b[0m in \u001b[0;36m__getitem__\u001b[0;34m(self, key)\u001b[0m\n\u001b[1;32m    667\u001b[0m         \u001b[0;32mexcept\u001b[0m \u001b[0mKeyError\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    668\u001b[0m             \u001b[0;31m# raise KeyError with the original key value\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 669\u001b[0;31m             \u001b[0;32mraise\u001b[0m \u001b[0mKeyError\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[0;34m)\u001b[0m \u001b[0;32mfrom\u001b[0m \u001b[0;32mNone\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m    670\u001b[0m         \u001b[0;32mreturn\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mdecodevalue\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mvalue\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m    671\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n",
      "\u001b[0;31mKeyError\u001b[0m: 'CIFAR10_PATH'"
     ]
    }
   ],
   "source": [
    "# First, we construct the data loader for full training set \n",
    "# as well as the data loader of a partial training set for semi-supervised learning\n",
    "# transformation operator\n",
    "normalize = transforms.Normalize((0.5, 0.5, 0.5), (0.5, 0.5, 0.5))\n",
    "transform_opt = transforms.Compose([\n",
    "                               transforms.ToTensor(),\n",
    "                               normalize,\n",
    "                           ])\n",
    "# get training set and test set\n",
    "dataset = dset.CIFAR10(root=os.environ['CIFAR10_PATH'], download=True,\n",
    "                           transform=transform_opt)  \n",
    "dataloader = torch.utils.data.DataLoader(dataset, batch_size=opt.batchSize,\n",
    "                                         shuffle=True, num_workers=1)\n",
    "\n",
    "from partial_dataset import PartialDataset\n",
    "# partial dataset for semi-supervised training\n",
    "dataset_partial = PartialDataset(dataset, opt.num_semi)\n",
    "\n",
    "\n",
    "# test set for evaluation\n",
    "dataset_test = dset.CIFAR10(root=os.environ['CIFAR10_PATH'],\n",
    "  train=False,\n",
    "  transform=transform_opt)\n",
    "dataloader_test = torch.utils.data.DataLoader(dataset_test,\n",
    "                        batch_size=opt.batchSize, shuffle=False, pin_memory=True, num_workers=1)\n",
    "\n",
    "dataloader_semi = torch.utils.data.DataLoader(dataset_partial, batch_size=opt.batchSize,\n",
    "                                    shuffle=True, num_workers=1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Reusing the Batch Norm Layers\n",
      "Reusing the Batch Norm Layers\n",
      "Reusing the Batch Norm Layers\n",
      "Reusing the Batch Norm Layers\n",
      "Reusing the Batch Norm Layers\n",
      "Reusing the Batch Norm Layers\n",
      "Reusing the Batch Norm Layers\n",
      "Reusing the Batch Norm Layers\n",
      "Reusing the Batch Norm Layers\n",
      "Reusing the Batch Norm Layers\n"
     ]
    }
   ],
   "source": [
    "# Now we initialize the distributions of G and D\n",
    "##### Generator ######\n",
    "# opt.num_mcmc is the number of MCMC chains that we run in parallel\n",
    "# opt.numz is the number of noise batches that we use. We also use different parameter samples for different batches\n",
    "# we construct opt.numz * opt.num_mcmc initial generator parameters\n",
    "# We will keep sampling parameters from the posterior starting from this set\n",
    "# Keeping track of many MCMC chains can be done quite elegantly in Pytorch\n",
    "from models.discriminators import _netD\n",
    "from models.generators import _netG\n",
    "from statsutil import weights_init\n",
    "netGs = []\n",
    "for _idxz in range(opt.numz):\n",
    "    for _idxm in range(opt.num_mcmc):\n",
    "        netG = _netG(opt.ngpu, nz=opt.nz)\n",
    "        netG.apply(weights_init)\n",
    "        netGs.append(netG)\n",
    "##### Discriminator ######\n",
    "# We will use 1 chain of MCMCs for the discriminator\n",
    "# The number of classes for semi-supervised case is 11; that is,\n",
    "# index 0 for fake data and 1-10 for the 10 classes of CIFAR.\n",
    "num_classes = 11\n",
    "netD = _netD(opt.ngpu, num_classes=num_classes)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# In order to calculate errG or errD_real, we need to sum the probabilities over all the classes (1 to K)\n",
    "# ComplementCrossEntropyLoss is a loss function that performs this task\n",
    "# We can specify a default except_index that corresponds to a fake label. In this case, we use index=0\n",
    "from ComplementCrossEntropyLoss import ComplementCrossEntropyLoss\n",
    "criterion = nn.CrossEntropyLoss()\n",
    "# use the default index = 0 - equivalent to summing all other probabilities\n",
    "criterion_comp = ComplementCrossEntropyLoss(except_index=0)\n",
    "\n",
    "\n",
    "from models.distributions import Normal\n",
    "from models.bayes import NoiseLoss, PriorLoss\n",
    "# Finally, initialize the ``optimizers''\n",
    "# Since we keep track of a set of parameters, we also need a set of\n",
    "# ``optimizers''\n",
    "if opt.d_optim == 'adam':\n",
    "    optimizerD = optim.Adam(netD.parameters(), lr=opt.lr, betas=(0.5, 0.999))\n",
    "elif opt.d_optim == 'sgd':\n",
    "    optimizerD = torch.optim.SGD(netD.parameters(), lr=opt.lr,\n",
    "                                momentum=0.9,\n",
    "                                nesterov=True,\n",
    "                                weight_decay=1e-4)\n",
    "optimizerGs = []\n",
    "for netG in netGs:\n",
    "    optimizerG = optim.Adam(netG.parameters(), lr=opt.lr, betas=(0.5, 0.999))\n",
    "    optimizerGs.append(optimizerG)\n",
    "\n",
    "# since the log posterior is the average per sample, we also scale down the prior and the noise\n",
    "gprior_criterion = PriorLoss(prior_std=1., observed=1000.)\n",
    "gnoise_criterion = NoiseLoss(params=netGs[0].parameters(), scale=math.sqrt(2*opt.gnoise_alpha/opt.lr), observed=1000.)\n",
    "dprior_criterion = PriorLoss(prior_std=1., observed=50000.)\n",
    "dnoise_criterion = NoiseLoss(params=netD.parameters(), scale=math.sqrt(2*opt.dnoise_alpha*opt.lr), observed=50000.)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# Fixed noise for data generation\n",
    "fixed_noise = torch.FloatTensor(opt.batchSize, opt.nz, 1, 1).normal_(0, 1).cuda()\n",
    "fixed_noise = Variable(fixed_noise)\n",
    "\n",
    "# initialize input variables and use CUDA (optional)\n",
    "input = torch.FloatTensor(opt.batchSize, 3, opt.imageSize, opt.imageSize)\n",
    "noise = torch.FloatTensor(opt.batchSize, opt.nz, 1, 1)\n",
    "label = torch.FloatTensor(opt.batchSize)\n",
    "real_label = 1\n",
    "fake_label = 0\n",
    "\n",
    "if opt.cuda:\n",
    "    netD.cuda()\n",
    "    for netG in netGs:\n",
    "        netG.cuda()\n",
    "    criterion.cuda()\n",
    "    criterion_comp.cuda()\n",
    "    input, label = input.cuda(), label.cuda()\n",
    "    noise = noise.cuda()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# fully supervised\n",
    "netD_fullsup = _netD(opt.ngpu, num_classes=num_classes)\n",
    "netD_fullsup.apply(weights_init)\n",
    "criterion_fullsup = nn.CrossEntropyLoss()\n",
    "if opt.d_optim == 'adam':\n",
    "    optimizerD_fullsup = optim.Adam(netD_fullsup.parameters(), lr=opt.lr, betas=(0.5, 0.999))\n",
    "else:\n",
    "    optimizerD_fullsup = optim.SGD(netD_fullsup.parameters(), lr=opt.lr,\n",
    "                                momentum=0.9,\n",
    "                                nesterov=True,\n",
    "                                weight_decay=1e-4)\n",
    "if opt.cuda:\n",
    "    netD_fullsup.cuda()\n",
    "    criterion_fullsup.cuda()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# We define a class to calculate the accuracy on test set\n",
    "# to test the performance of semi-supervised training\n",
    "def get_test_accuracy(model_d, iteration, label='semi'):\n",
    "    # don't forget to do model_d.eval() before doing evaluation\n",
    "    top1 = AverageMeter()\n",
    "    for i, (input, target) in enumerate(dataloader_test):\n",
    "        target = target.cuda()\n",
    "        input = input.cuda()\n",
    "        input_var = torch.autograd.Variable(input.cuda(), volatile=True)\n",
    "        target_var = torch.autograd.Variable(target, volatile=True)\n",
    "        output = model_d(input_var)\n",
    "\n",
    "        probs = output.data[:, 1:] # discard the zeroth index\n",
    "        prec1 = accuracy(probs, target, topk=(1,))[0]\n",
    "        top1.update(prec1[0], input.size(0))\n",
    "        if i % 50 == 0:\n",
    "              print(\"{} Test: [{}/{}]\\t Prec@1 {top1.val:.3f} ({top1.avg:.3f})\"\\\n",
    "                .format(label, i, len(dataloader_test), top1=top1))\n",
    "    print('{label} Test Prec@1 {top1.avg:.2f}'.format(label=label, top1=top1))\n",
    "    log_value('test_acc_{}'.format(label), top1.avg, iteration)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[0/2][0/782] Loss_D: 5.13 Loss_G: 22.97 D(x): 0.92 D(G(z)): 0.92 / 0.74 | Acc 7.8 / 7.8\n",
      "[0/2][1/782] Loss_D: 4.21 Loss_G: 23.28 D(x): 0.78 D(G(z)): 0.76 / 0.54 | Acc 0.0 / 3.9\n",
      "[0/2][2/782] Loss_D: 3.91 Loss_G: 23.61 D(x): 0.66 D(G(z)): 0.57 / 0.49 | Acc 1.6 / 3.1\n",
      "[0/2][3/782] Loss_D: 3.86 Loss_G: 23.22 D(x): 0.67 D(G(z)): 0.53 / 0.53 | Acc 3.1 / 3.1\n",
      "[0/2][4/782] Loss_D: 3.62 Loss_G: 23.17 D(x): 0.75 D(G(z)): 0.58 / 0.55 | Acc 4.7 / 3.4\n",
      "[0/2][5/782] Loss_D: 3.62 Loss_G: 23.09 D(x): 0.78 D(G(z)): 0.61 / 0.51 | Acc 6.2 / 3.9\n",
      "[0/2][6/782] Loss_D: 3.47 Loss_G: 23.12 D(x): 0.74 D(G(z)): 0.58 / 0.48 | Acc 17.2 / 5.8\n",
      "[0/2][7/782] Loss_D: 3.36 Loss_G: 23.28 D(x): 0.77 D(G(z)): 0.56 / 0.43 | Acc 14.1 / 6.8\n",
      "[0/2][8/782] Loss_D: 3.43 Loss_G: 23.49 D(x): 0.74 D(G(z)): 0.52 / 0.38 | Acc 14.1 / 7.6\n",
      "semi Test: [0/157]\t Prec@1 34.375 (34.375)\n",
      "semi Test: [50/157]\t Prec@1 34.375 (31.801)\n",
      "semi Test: [100/157]\t Prec@1 25.000 (31.946)\n",
      "semi Test: [150/157]\t Prec@1 31.250 (31.767)\n",
      "semi Test Prec@1 31.68\n",
      "sup Test: [0/157]\t Prec@1 23.438 (23.438)\n",
      "sup Test: [50/157]\t Prec@1 29.688 (29.779)\n",
      "sup Test: [100/157]\t Prec@1 26.562 (30.538)\n",
      "sup Test: [150/157]\t Prec@1 25.000 (30.288)\n",
      "sup Test Prec@1 30.23\n",
      "[0/2][9/782] Loss_D: 3.35 Loss_G: 23.30 D(x): 0.71 D(G(z)): 0.47 / 0.40 | Acc 9.4 / 7.8\n",
      "[0/2][10/782] Loss_D: 3.12 Loss_G: 23.08 D(x): 0.79 D(G(z)): 0.50 / 0.38 | Acc 15.6 / 8.5\n",
      "[0/2][11/782] Loss_D: 2.99 Loss_G: 23.18 D(x): 0.77 D(G(z)): 0.49 / 0.37 | Acc 31.2 / 10.4\n",
      "[0/2][12/782] Loss_D: 2.85 Loss_G: 23.45 D(x): 0.79 D(G(z)): 0.48 / 0.33 | Acc 26.6 / 11.7\n",
      "[0/2][13/782] Loss_D: 3.13 Loss_G: 23.30 D(x): 0.76 D(G(z)): 0.46 / 0.33 | Acc 15.6 / 11.9\n",
      "[0/2][14/782] Loss_D: 3.32 Loss_G: 23.48 D(x): 0.76 D(G(z)): 0.47 / 0.29 | Acc 14.1 / 12.1\n",
      "[0/2][15/782] Loss_D: 3.14 Loss_G: 23.24 D(x): 0.78 D(G(z)): 0.42 / 0.27 | Acc 14.1 / 12.2\n",
      "[0/2][16/782] Loss_D: 3.16 Loss_G: 23.23 D(x): 0.81 D(G(z)): 0.41 / 0.27 | Acc 14.1 / 12.3\n",
      "[0/2][17/782] Loss_D: 2.70 Loss_G: 23.46 D(x): 0.83 D(G(z)): 0.41 / 0.25 | Acc 31.2 / 13.4\n",
      "[0/2][18/782] Loss_D: 2.90 Loss_G: 23.47 D(x): 0.79 D(G(z)): 0.40 / 0.25 | Acc 17.2 / 13.6\n",
      "semi Test: [0/157]\t Prec@1 35.938 (35.938)\n",
      "semi Test: [50/157]\t Prec@1 34.375 (32.200)\n",
      "semi Test: [100/157]\t Prec@1 29.688 (32.240)\n",
      "semi Test: [150/157]\t Prec@1 31.250 (32.202)\n",
      "semi Test Prec@1 32.07\n",
      "sup Test: [0/157]\t Prec@1 34.375 (34.375)\n",
      "sup Test: [50/157]\t Prec@1 34.375 (32.874)\n",
      "sup Test: [100/157]\t Prec@1 29.688 (33.277)\n",
      "sup Test: [150/157]\t Prec@1 34.375 (33.361)\n",
      "sup Test Prec@1 33.18\n",
      "[0/2][19/782] Loss_D: 2.82 Loss_G: 23.35 D(x): 0.82 D(G(z)): 0.40 / 0.23 | Acc 21.9 / 14.0\n",
      "[0/2][20/782] Loss_D: 2.71 Loss_G: 23.73 D(x): 0.84 D(G(z)): 0.38 / 0.21 | Acc 28.1 / 14.7\n",
      "[0/2][21/782] Loss_D: 2.51 Loss_G: 23.60 D(x): 0.84 D(G(z)): 0.37 / 0.18 | Acc 32.8 / 15.5\n",
      "[0/2][22/782] Loss_D: 2.50 Loss_G: 23.64 D(x): 0.80 D(G(z)): 0.34 / 0.17 | Acc 40.6 / 16.6\n",
      "[0/2][23/782] Loss_D: 2.78 Loss_G: 23.66 D(x): 0.81 D(G(z)): 0.34 / 0.18 | Acc 28.1 / 17.1\n",
      "[0/2][24/782] Loss_D: 2.73 Loss_G: 23.67 D(x): 0.80 D(G(z)): 0.39 / 0.16 | Acc 23.4 / 17.3\n",
      "[0/2][25/782] Loss_D: 2.85 Loss_G: 23.72 D(x): 0.77 D(G(z)): 0.32 / 0.21 | Acc 20.3 / 17.4\n",
      "[0/2][26/782] Loss_D: 2.70 Loss_G: 23.44 D(x): 0.81 D(G(z)): 0.40 / 0.20 | Acc 23.4 / 17.7\n",
      "[0/2][27/782] Loss_D: 2.64 Loss_G: 23.52 D(x): 0.84 D(G(z)): 0.35 / 0.15 | Acc 31.2 / 18.1\n",
      "[0/2][28/782] Loss_D: 2.62 Loss_G: 24.19 D(x): 0.84 D(G(z)): 0.29 / 0.11 | Acc 23.4 / 18.3\n",
      "semi Test: [0/157]\t Prec@1 29.688 (29.688)\n",
      "semi Test: [50/157]\t Prec@1 26.562 (32.782)\n",
      "semi Test: [100/157]\t Prec@1 28.125 (32.503)\n",
      "semi Test: [150/157]\t Prec@1 32.812 (32.595)\n",
      "semi Test Prec@1 32.52\n",
      "sup Test: [0/157]\t Prec@1 32.812 (32.812)\n",
      "sup Test: [50/157]\t Prec@1 37.500 (34.589)\n",
      "sup Test: [100/157]\t Prec@1 26.562 (34.545)\n",
      "sup Test: [150/157]\t Prec@1 39.062 (34.416)\n",
      "sup Test Prec@1 34.42\n",
      "[0/2][29/782] Loss_D: 2.50 Loss_G: 23.44 D(x): 0.77 D(G(z)): 0.23 / 0.18 | Acc 26.6 / 18.6\n",
      "[0/2][30/782] Loss_D: 2.58 Loss_G: 23.89 D(x): 0.89 D(G(z)): 0.39 / 0.13 | Acc 29.7 / 19.0\n",
      "[0/2][31/782] Loss_D: 2.53 Loss_G: 23.88 D(x): 0.82 D(G(z)): 0.27 / 0.13 | Acc 34.4 / 19.4\n",
      "[0/2][32/782] Loss_D: 2.42 Loss_G: 23.86 D(x): 0.88 D(G(z)): 0.29 / 0.12 | Acc 32.8 / 19.8\n",
      "[0/2][33/782] Loss_D: 2.41 Loss_G: 23.52 D(x): 0.84 D(G(z)): 0.29 / 0.12 | Acc 32.8 / 20.2\n",
      "[0/2][34/782] Loss_D: 2.40 Loss_G: 23.61 D(x): 0.85 D(G(z)): 0.28 / 0.12 | Acc 31.2 / 20.5\n",
      "[0/2][35/782] Loss_D: 2.63 Loss_G: 23.76 D(x): 0.86 D(G(z)): 0.29 / 0.10 | Acc 28.1 / 20.7\n",
      "[0/2][36/782] Loss_D: 2.25 Loss_G: 23.88 D(x): 0.89 D(G(z)): 0.27 / 0.09 | Acc 34.4 / 21.1\n",
      "[0/2][37/782] Loss_D: 2.43 Loss_G: 23.87 D(x): 0.81 D(G(z)): 0.23 / 0.10 | Acc 40.6 / 21.6\n",
      "[0/2][38/782] Loss_D: 2.19 Loss_G: 23.69 D(x): 0.89 D(G(z)): 0.25 / 0.10 | Acc 34.4 / 22.0\n",
      "semi Test: [0/157]\t Prec@1 28.125 (28.125)\n",
      "semi Test: [50/157]\t Prec@1 31.250 (36.336)\n",
      "semi Test: [100/157]\t Prec@1 26.562 (36.525)\n",
      "semi Test: [150/157]\t Prec@1 40.625 (36.362)\n",
      "semi Test Prec@1 36.18\n",
      "sup Test: [0/157]\t Prec@1 28.125 (28.125)\n",
      "sup Test: [50/157]\t Prec@1 43.750 (35.325)\n",
      "sup Test: [100/157]\t Prec@1 35.938 (35.953)\n",
      "sup Test: [150/157]\t Prec@1 37.500 (35.751)\n",
      "sup Test Prec@1 35.67\n",
      "[0/2][39/782] Loss_D: 2.10 Loss_G: 24.08 D(x): 0.91 D(G(z)): 0.25 / 0.07 | Acc 43.8 / 22.5\n",
      "[0/2][40/782] Loss_D: 2.19 Loss_G: 23.19 D(x): 0.81 D(G(z)): 0.18 / 0.13 | Acc 37.5 / 22.9\n",
      "[0/2][41/782] Loss_D: 2.15 Loss_G: 24.32 D(x): 0.92 D(G(z)): 0.31 / 0.08 | Acc 46.9 / 23.4\n",
      "[0/2][42/782] Loss_D: 2.30 Loss_G: 23.54 D(x): 0.82 D(G(z)): 0.18 / 0.10 | Acc 43.8 / 23.9\n",
      "[0/2][43/782] Loss_D: 2.02 Loss_G: 23.73 D(x): 0.86 D(G(z)): 0.26 / 0.08 | Acc 53.1 / 24.6\n",
      "[0/2][44/782] Loss_D: 2.13 Loss_G: 24.02 D(x): 0.90 D(G(z)): 0.21 / 0.05 | Acc 45.3 / 25.0\n",
      "[0/2][45/782] Loss_D: 2.05 Loss_G: 23.77 D(x): 0.91 D(G(z)): 0.13 / 0.08 | Acc 34.4 / 25.2\n",
      "[0/2][46/782] Loss_D: 2.09 Loss_G: 23.93 D(x): 0.91 D(G(z)): 0.25 / 0.07 | Acc 34.4 / 25.4\n",
      "[0/2][47/782] Loss_D: 2.08 Loss_G: 23.50 D(x): 0.89 D(G(z)): 0.19 / 0.11 | Acc 45.3 / 25.8\n",
      "[0/2][48/782] Loss_D: 2.07 Loss_G: 23.93 D(x): 0.93 D(G(z)): 0.24 / 0.09 | Acc 42.2 / 26.2\n",
      "semi Test: [0/157]\t Prec@1 35.938 (35.938)\n",
      "semi Test: [50/157]\t Prec@1 32.812 (37.132)\n",
      "semi Test: [100/157]\t Prec@1 28.125 (37.005)\n",
      "semi Test: [150/157]\t Prec@1 39.062 (36.714)\n",
      "semi Test Prec@1 36.47\n",
      "sup Test: [0/157]\t Prec@1 35.938 (35.938)\n",
      "sup Test: [50/157]\t Prec@1 39.062 (37.990)\n",
      "sup Test: [100/157]\t Prec@1 40.625 (38.676)\n",
      "sup Test: [150/157]\t Prec@1 42.188 (38.162)\n",
      "sup Test Prec@1 37.99\n",
      "[0/2][49/782] Loss_D: 2.37 Loss_G: 23.44 D(x): 0.80 D(G(z)): 0.19 / 0.22 | Acc 34.4 / 26.3\n",
      "[0/2][50/782] Loss_D: 2.43 Loss_G: 23.42 D(x): 0.87 D(G(z)): 0.33 / 0.12 | Acc 37.5 / 26.6\n",
      "[0/2][51/782] Loss_D: 2.19 Loss_G: 24.20 D(x): 0.91 D(G(z)): 0.27 / 0.03 | Acc 34.4 / 26.7\n",
      "[0/2][52/782] Loss_D: 2.02 Loss_G: 23.16 D(x): 0.82 D(G(z)): 0.07 / 0.10 | Acc 42.2 / 27.0\n",
      "[0/2][53/782] Loss_D: 1.94 Loss_G: 23.66 D(x): 0.95 D(G(z)): 0.26 / 0.08 | Acc 46.9 / 27.4\n",
      "[0/2][54/782] Loss_D: 1.99 Loss_G: 23.55 D(x): 0.90 D(G(z)): 0.20 / 0.06 | Acc 45.3 / 27.7\n",
      "[0/2][55/782] Loss_D: 2.07 Loss_G: 23.41 D(x): 0.87 D(G(z)): 0.17 / 0.09 | Acc 37.5 / 27.9\n",
      "[0/2][56/782] Loss_D: 2.02 Loss_G: 22.93 D(x): 0.87 D(G(z)): 0.23 / 0.09 | Acc 42.2 / 28.1\n",
      "[0/2][57/782] Loss_D: 2.04 Loss_G: 23.53 D(x): 0.90 D(G(z)): 0.27 / 0.05 | Acc 43.8 / 28.4\n",
      "[0/2][58/782] Loss_D: 2.01 Loss_G: 22.68 D(x): 0.84 D(G(z)): 0.12 / 0.15 | Acc 39.1 / 28.6\n",
      "semi Test: [0/157]\t Prec@1 35.938 (35.938)\n",
      "semi Test: [50/157]\t Prec@1 42.188 (38.848)\n",
      "semi Test: [100/157]\t Prec@1 32.812 (38.181)\n",
      "semi Test: [150/157]\t Prec@1 43.750 (37.841)\n",
      "semi Test Prec@1 37.60\n",
      "sup Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "sup Test: [50/157]\t Prec@1 46.875 (41.759)\n",
      "sup Test: [100/157]\t Prec@1 32.812 (41.166)\n",
      "sup Test: [150/157]\t Prec@1 40.625 (40.056)\n",
      "sup Test Prec@1 39.87\n",
      "[0/2][59/782] Loss_D: 2.06 Loss_G: 23.68 D(x): 0.94 D(G(z)): 0.38 / 0.05 | Acc 57.8 / 29.1\n",
      "[0/2][60/782] Loss_D: 2.39 Loss_G: 21.90 D(x): 0.72 D(G(z)): 0.14 / 0.27 | Acc 26.6 / 29.0\n",
      "[0/2][61/782] Loss_D: 2.33 Loss_G: 23.12 D(x): 0.93 D(G(z)): 0.48 / 0.08 | Acc 48.4 / 29.3\n",
      "[0/2][62/782] Loss_D: 2.36 Loss_G: 22.51 D(x): 0.82 D(G(z)): 0.18 / 0.13 | Acc 31.2 / 29.4\n",
      "[0/2][63/782] Loss_D: 2.17 Loss_G: 22.25 D(x): 0.81 D(G(z)): 0.30 / 0.18 | Acc 46.9 / 29.6\n",
      "[0/2][64/782] Loss_D: 2.28 Loss_G: 22.32 D(x): 0.85 D(G(z)): 0.34 / 0.13 | Acc 46.9 / 29.9\n",
      "[0/2][65/782] Loss_D: 2.36 Loss_G: 22.81 D(x): 0.88 D(G(z)): 0.31 / 0.09 | Acc 39.1 / 30.0\n",
      "[0/2][66/782] Loss_D: 2.18 Loss_G: 22.51 D(x): 0.84 D(G(z)): 0.22 / 0.19 | Acc 35.9 / 30.1\n",
      "[0/2][67/782] Loss_D: 2.57 Loss_G: 23.22 D(x): 0.89 D(G(z)): 0.45 / 0.13 | Acc 39.1 / 30.3\n",
      "[0/2][68/782] Loss_D: 2.64 Loss_G: 21.93 D(x): 0.73 D(G(z)): 0.23 / 0.31 | Acc 31.2 / 30.3\n",
      "semi Test: [0/157]\t Prec@1 32.812 (32.812)\n",
      "semi Test: [50/157]\t Prec@1 43.750 (40.104)\n",
      "semi Test: [100/157]\t Prec@1 35.938 (39.991)\n",
      "semi Test: [150/157]\t Prec@1 37.500 (39.342)\n",
      "semi Test Prec@1 39.16\n",
      "sup Test: [0/157]\t Prec@1 28.125 (28.125)\n",
      "sup Test: [50/157]\t Prec@1 40.625 (39.308)\n",
      "sup Test: [100/157]\t Prec@1 29.688 (39.155)\n",
      "sup Test: [150/157]\t Prec@1 46.875 (38.907)\n",
      "sup Test Prec@1 38.78\n",
      "[0/2][69/782] Loss_D: 2.75 Loss_G: 22.70 D(x): 0.91 D(G(z)): 0.48 / 0.09 | Acc 32.8 / 30.3\n",
      "[0/2][70/782] Loss_D: 2.27 Loss_G: 21.94 D(x): 0.82 D(G(z)): 0.18 / 0.20 | Acc 28.1 / 30.3\n",
      "[0/2][71/782] Loss_D: 2.21 Loss_G: 23.07 D(x): 0.94 D(G(z)): 0.37 / 0.07 | Acc 45.3 / 30.5\n",
      "[0/2][72/782] Loss_D: 2.23 Loss_G: 21.79 D(x): 0.84 D(G(z)): 0.18 / 0.19 | Acc 34.4 / 30.5\n",
      "[0/2][73/782] Loss_D: 2.25 Loss_G: 23.30 D(x): 0.89 D(G(z)): 0.44 / 0.04 | Acc 54.7 / 30.9\n",
      "[0/2][74/782] Loss_D: 2.25 Loss_G: 21.04 D(x): 0.76 D(G(z)): 0.15 / 0.36 | Acc 28.1 / 30.8\n",
      "[0/2][75/782] Loss_D: 2.91 Loss_G: 24.18 D(x): 0.94 D(G(z)): 0.70 / 0.02 | Acc 42.2 / 31.0\n",
      "[0/2][76/782] Loss_D: 3.00 Loss_G: 21.05 D(x): 0.54 D(G(z)): 0.05 / 0.36 | Acc 12.5 / 30.7\n",
      "[0/2][77/782] Loss_D: 2.80 Loss_G: 22.08 D(x): 0.97 D(G(z)): 0.64 / 0.11 | Acc 40.6 / 30.9\n",
      "[0/2][78/782] Loss_D: 2.04 Loss_G: 22.59 D(x): 0.88 D(G(z)): 0.26 / 0.06 | Acc 51.6 / 31.1\n",
      "semi Test: [0/157]\t Prec@1 31.250 (31.250)\n",
      "semi Test: [50/157]\t Prec@1 40.625 (38.971)\n",
      "semi Test: [100/157]\t Prec@1 31.250 (38.552)\n",
      "semi Test: [150/157]\t Prec@1 40.625 (38.380)\n",
      "semi Test Prec@1 38.17\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 39.062 (43.781)\n",
      "sup Test: [100/157]\t Prec@1 34.375 (42.358)\n",
      "sup Test: [150/157]\t Prec@1 45.312 (41.898)\n",
      "sup Test Prec@1 41.78\n",
      "[0/2][79/782] Loss_D: 2.27 Loss_G: 21.87 D(x): 0.84 D(G(z)): 0.15 / 0.15 | Acc 35.9 / 31.2\n",
      "[0/2][80/782] Loss_D: 2.23 Loss_G: 21.83 D(x): 0.88 D(G(z)): 0.35 / 0.13 | Acc 50.0 / 31.4\n",
      "[0/2][81/782] Loss_D: 2.09 Loss_G: 22.62 D(x): 0.92 D(G(z)): 0.32 / 0.06 | Acc 50.0 / 31.7\n",
      "[0/2][82/782] Loss_D: 2.16 Loss_G: 21.26 D(x): 0.75 D(G(z)): 0.15 / 0.25 | Acc 35.9 / 31.7\n",
      "[0/2][83/782] Loss_D: 2.33 Loss_G: 23.48 D(x): 0.95 D(G(z)): 0.54 / 0.03 | Acc 51.6 / 31.9\n",
      "[0/2][84/782] Loss_D: 2.34 Loss_G: 21.13 D(x): 0.65 D(G(z)): 0.07 / 0.26 | Acc 35.9 / 32.0\n",
      "[0/2][85/782] Loss_D: 2.53 Loss_G: 22.35 D(x): 0.96 D(G(z)): 0.53 / 0.08 | Acc 46.9 / 32.2\n",
      "[0/2][86/782] Loss_D: 1.86 Loss_G: 22.72 D(x): 0.91 D(G(z)): 0.18 / 0.05 | Acc 45.3 / 32.3\n",
      "[0/2][87/782] Loss_D: 1.84 Loss_G: 21.95 D(x): 0.87 D(G(z)): 0.14 / 0.12 | Acc 46.9 / 32.5\n",
      "[0/2][88/782] Loss_D: 2.04 Loss_G: 22.21 D(x): 0.93 D(G(z)): 0.33 / 0.07 | Acc 45.3 / 32.6\n",
      "semi Test: [0/157]\t Prec@1 31.250 (31.250)\n",
      "semi Test: [50/157]\t Prec@1 45.312 (40.625)\n",
      "semi Test: [100/157]\t Prec@1 31.250 (40.826)\n",
      "semi Test: [150/157]\t Prec@1 39.062 (40.728)\n",
      "semi Test Prec@1 40.55\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 42.188 (42.433)\n",
      "sup Test: [100/157]\t Prec@1 40.625 (42.064)\n",
      "sup Test: [150/157]\t Prec@1 46.875 (41.743)\n",
      "sup Test Prec@1 41.65\n",
      "[0/2][89/782] Loss_D: 2.32 Loss_G: 21.35 D(x): 0.82 D(G(z)): 0.20 / 0.16 | Acc 40.6 / 32.7\n",
      "[0/2][90/782] Loss_D: 2.50 Loss_G: 22.94 D(x): 0.93 D(G(z)): 0.44 / 0.05 | Acc 39.1 / 32.8\n",
      "[0/2][91/782] Loss_D: 2.23 Loss_G: 21.30 D(x): 0.76 D(G(z)): 0.13 / 0.22 | Acc 35.9 / 32.8\n",
      "[0/2][92/782] Loss_D: 2.28 Loss_G: 22.28 D(x): 0.92 D(G(z)): 0.46 / 0.10 | Acc 46.9 / 33.0\n",
      "[0/2][93/782] Loss_D: 2.11 Loss_G: 22.24 D(x): 0.84 D(G(z)): 0.21 / 0.11 | Acc 46.9 / 33.1\n",
      "[0/2][94/782] Loss_D: 2.06 Loss_G: 21.34 D(x): 0.85 D(G(z)): 0.22 / 0.23 | Acc 45.3 / 33.2\n",
      "[0/2][95/782] Loss_D: 2.49 Loss_G: 22.41 D(x): 0.92 D(G(z)): 0.39 / 0.06 | Acc 37.5 / 33.3\n",
      "[0/2][96/782] Loss_D: 2.16 Loss_G: 21.56 D(x): 0.81 D(G(z)): 0.13 / 0.15 | Acc 42.2 / 33.4\n",
      "[0/2][97/782] Loss_D: 2.09 Loss_G: 22.44 D(x): 0.94 D(G(z)): 0.36 / 0.09 | Acc 54.7 / 33.6\n",
      "[0/2][98/782] Loss_D: 2.29 Loss_G: 21.44 D(x): 0.87 D(G(z)): 0.20 / 0.13 | Acc 35.9 / 33.6\n",
      "semi Test: [0/157]\t Prec@1 37.500 (37.500)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (41.299)\n",
      "semi Test: [100/157]\t Prec@1 39.062 (41.615)\n",
      "semi Test: [150/157]\t Prec@1 37.500 (41.287)\n",
      "semi Test Prec@1 41.25\n",
      "sup Test: [0/157]\t Prec@1 35.938 (35.938)\n",
      "sup Test: [50/157]\t Prec@1 39.062 (40.931)\n",
      "sup Test: [100/157]\t Prec@1 50.000 (41.337)\n",
      "sup Test: [150/157]\t Prec@1 43.750 (41.142)\n",
      "sup Test Prec@1 41.03\n",
      "[0/2][99/782] Loss_D: 2.19 Loss_G: 21.78 D(x): 0.89 D(G(z)): 0.31 / 0.09 | Acc 51.6 / 33.8\n",
      "[0/2][100/782] Loss_D: 2.04 Loss_G: 21.33 D(x): 0.87 D(G(z)): 0.23 / 0.14 | Acc 45.3 / 33.9\n",
      "[0/2][101/782] Loss_D: 2.10 Loss_G: 21.79 D(x): 0.88 D(G(z)): 0.31 / 0.11 | Acc 46.9 / 34.0\n",
      "[0/2][102/782] Loss_D: 2.35 Loss_G: 20.93 D(x): 0.81 D(G(z)): 0.29 / 0.29 | Acc 34.4 / 34.0\n",
      "[0/2][103/782] Loss_D: 2.46 Loss_G: 22.25 D(x): 0.87 D(G(z)): 0.47 / 0.06 | Acc 50.0 / 34.2\n",
      "[0/2][104/782] Loss_D: 2.26 Loss_G: 20.28 D(x): 0.68 D(G(z)): 0.15 / 0.33 | Acc 31.2 / 34.2\n",
      "[0/2][105/782] Loss_D: 2.64 Loss_G: 22.34 D(x): 0.95 D(G(z)): 0.61 / 0.06 | Acc 50.0 / 34.3\n",
      "[0/2][106/782] Loss_D: 2.44 Loss_G: 20.66 D(x): 0.66 D(G(z)): 0.12 / 0.33 | Acc 39.1 / 34.4\n",
      "[0/2][107/782] Loss_D: 2.40 Loss_G: 21.31 D(x): 0.93 D(G(z)): 0.51 / 0.11 | Acc 54.7 / 34.5\n",
      "[0/2][108/782] Loss_D: 2.05 Loss_G: 21.62 D(x): 0.88 D(G(z)): 0.28 / 0.09 | Acc 40.6 / 34.6\n",
      "semi Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "semi Test: [50/157]\t Prec@1 42.188 (42.341)\n",
      "semi Test: [100/157]\t Prec@1 37.500 (42.358)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (42.353)\n",
      "semi Test Prec@1 42.13\n",
      "sup Test: [0/157]\t Prec@1 29.688 (29.688)\n",
      "sup Test: [50/157]\t Prec@1 42.188 (41.605)\n",
      "sup Test: [100/157]\t Prec@1 37.500 (41.708)\n",
      "sup Test: [150/157]\t Prec@1 42.188 (41.101)\n",
      "sup Test Prec@1 41.07\n",
      "[0/2][109/782] Loss_D: 2.18 Loss_G: 20.65 D(x): 0.76 D(G(z)): 0.22 / 0.23 | Acc 43.8 / 34.7\n",
      "[0/2][110/782] Loss_D: 2.29 Loss_G: 21.81 D(x): 0.89 D(G(z)): 0.51 / 0.08 | Acc 50.0 / 34.8\n",
      "[0/2][111/782] Loss_D: 2.13 Loss_G: 20.96 D(x): 0.80 D(G(z)): 0.21 / 0.14 | Acc 43.8 / 34.9\n",
      "[0/2][112/782] Loss_D: 1.99 Loss_G: 20.74 D(x): 0.84 D(G(z)): 0.32 / 0.17 | Acc 53.1 / 35.1\n",
      "[0/2][113/782] Loss_D: 2.23 Loss_G: 21.59 D(x): 0.89 D(G(z)): 0.45 / 0.07 | Acc 56.2 / 35.3\n",
      "[0/2][114/782] Loss_D: 2.30 Loss_G: 20.27 D(x): 0.76 D(G(z)): 0.20 / 0.23 | Acc 28.1 / 35.2\n",
      "[0/2][115/782] Loss_D: 2.31 Loss_G: 22.04 D(x): 0.91 D(G(z)): 0.52 / 0.06 | Acc 51.6 / 35.3\n",
      "[0/2][116/782] Loss_D: 2.65 Loss_G: 18.96 D(x): 0.57 D(G(z)): 0.14 / 0.66 | Acc 35.9 / 35.3\n",
      "[0/2][117/782] Loss_D: 3.16 Loss_G: 21.48 D(x): 0.97 D(G(z)): 0.81 / 0.07 | Acc 64.1 / 35.6\n",
      "[0/2][118/782] Loss_D: 2.23 Loss_G: 21.06 D(x): 0.77 D(G(z)): 0.14 / 0.12 | Acc 40.6 / 35.6\n",
      "semi Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (43.566)\n",
      "semi Test: [100/157]\t Prec@1 40.625 (43.595)\n",
      "semi Test: [150/157]\t Prec@1 39.062 (43.460)\n",
      "semi Test Prec@1 43.25\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 45.312 (44.148)\n",
      "sup Test: [100/157]\t Prec@1 34.375 (44.230)\n",
      "sup Test: [150/157]\t Prec@1 45.312 (43.895)\n",
      "sup Test Prec@1 43.86\n",
      "[0/2][119/782] Loss_D: 1.97 Loss_G: 20.01 D(x): 0.77 D(G(z)): 0.23 / 0.25 | Acc 50.0 / 35.7\n",
      "[0/2][120/782] Loss_D: 2.37 Loss_G: 20.73 D(x): 0.92 D(G(z)): 0.46 / 0.14 | Acc 48.4 / 35.8\n",
      "[0/2][121/782] Loss_D: 2.12 Loss_G: 20.26 D(x): 0.79 D(G(z)): 0.28 / 0.22 | Acc 45.3 / 35.9\n",
      "[0/2][122/782] Loss_D: 2.36 Loss_G: 20.85 D(x): 0.91 D(G(z)): 0.44 / 0.10 | Acc 51.6 / 36.1\n",
      "[0/2][123/782] Loss_D: 2.44 Loss_G: 19.45 D(x): 0.75 D(G(z)): 0.23 / 0.33 | Acc 29.7 / 36.0\n",
      "[0/2][124/782] Loss_D: 2.35 Loss_G: 20.89 D(x): 0.90 D(G(z)): 0.57 / 0.09 | Acc 57.8 / 36.2\n",
      "[0/2][125/782] Loss_D: 2.26 Loss_G: 20.15 D(x): 0.78 D(G(z)): 0.19 / 0.21 | Acc 37.5 / 36.2\n",
      "[0/2][126/782] Loss_D: 2.38 Loss_G: 20.64 D(x): 0.86 D(G(z)): 0.36 / 0.15 | Acc 40.6 / 36.2\n",
      "[0/2][127/782] Loss_D: 2.01 Loss_G: 20.23 D(x): 0.81 D(G(z)): 0.28 / 0.16 | Acc 57.8 / 36.4\n",
      "[0/2][128/782] Loss_D: 2.14 Loss_G: 20.32 D(x): 0.86 D(G(z)): 0.33 / 0.13 | Acc 48.4 / 36.5\n",
      "semi Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (43.290)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (43.781)\n",
      "semi Test: [150/157]\t Prec@1 40.625 (43.709)\n",
      "semi Test Prec@1 43.51\n",
      "sup Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "sup Test: [50/157]\t Prec@1 40.625 (44.179)\n",
      "sup Test: [100/157]\t Prec@1 42.188 (43.595)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (43.171)\n",
      "sup Test Prec@1 43.12\n",
      "[0/2][129/782] Loss_D: 2.06 Loss_G: 20.19 D(x): 0.85 D(G(z)): 0.28 / 0.17 | Acc 43.8 / 36.5\n",
      "[0/2][130/782] Loss_D: 2.16 Loss_G: 20.01 D(x): 0.83 D(G(z)): 0.34 / 0.20 | Acc 48.4 / 36.6\n",
      "[0/2][131/782] Loss_D: 1.99 Loss_G: 20.86 D(x): 0.86 D(G(z)): 0.37 / 0.12 | Acc 59.4 / 36.8\n",
      "[0/2][132/782] Loss_D: 2.23 Loss_G: 19.74 D(x): 0.79 D(G(z)): 0.25 / 0.22 | Acc 26.6 / 36.7\n",
      "[0/2][133/782] Loss_D: 2.23 Loss_G: 21.01 D(x): 0.89 D(G(z)): 0.41 / 0.08 | Acc 46.9 / 36.8\n",
      "[0/2][134/782] Loss_D: 2.08 Loss_G: 19.64 D(x): 0.74 D(G(z)): 0.17 / 0.27 | Acc 48.4 / 36.9\n",
      "[0/2][135/782] Loss_D: 2.37 Loss_G: 21.26 D(x): 0.93 D(G(z)): 0.49 / 0.06 | Acc 50.0 / 37.0\n",
      "[0/2][136/782] Loss_D: 2.01 Loss_G: 19.40 D(x): 0.78 D(G(z)): 0.13 / 0.25 | Acc 45.3 / 37.0\n",
      "[0/2][137/782] Loss_D: 2.04 Loss_G: 20.50 D(x): 0.91 D(G(z)): 0.45 / 0.10 | Acc 70.3 / 37.3\n",
      "[0/2][138/782] Loss_D: 1.77 Loss_G: 19.91 D(x): 0.84 D(G(z)): 0.18 / 0.15 | Acc 50.0 / 37.4\n",
      "semi Test: [0/157]\t Prec@1 50.000 (50.000)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (43.811)\n",
      "semi Test: [100/157]\t Prec@1 39.062 (43.657)\n",
      "semi Test: [150/157]\t Prec@1 40.625 (43.377)\n",
      "semi Test Prec@1 43.10\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 39.062 (43.536)\n",
      "sup Test: [100/157]\t Prec@1 35.938 (44.199)\n",
      "sup Test: [150/157]\t Prec@1 40.625 (43.543)\n",
      "sup Test Prec@1 43.48\n",
      "[0/2][139/782] Loss_D: 1.99 Loss_G: 20.61 D(x): 0.92 D(G(z)): 0.32 / 0.10 | Acc 50.0 / 37.5\n",
      "[0/2][140/782] Loss_D: 1.73 Loss_G: 19.58 D(x): 0.83 D(G(z)): 0.20 / 0.17 | Acc 57.8 / 37.6\n",
      "[0/2][141/782] Loss_D: 1.99 Loss_G: 19.94 D(x): 0.84 D(G(z)): 0.34 / 0.14 | Acc 54.7 / 37.7\n",
      "[0/2][142/782] Loss_D: 1.98 Loss_G: 20.48 D(x): 0.86 D(G(z)): 0.31 / 0.10 | Acc 54.7 / 37.8\n",
      "[0/2][143/782] Loss_D: 2.12 Loss_G: 18.97 D(x): 0.75 D(G(z)): 0.22 / 0.46 | Acc 37.5 / 37.8\n",
      "[0/2][144/782] Loss_D: 2.79 Loss_G: 21.83 D(x): 0.95 D(G(z)): 0.68 / 0.03 | Acc 57.8 / 38.0\n",
      "[0/2][145/782] Loss_D: 2.44 Loss_G: 18.89 D(x): 0.58 D(G(z)): 0.05 / 0.34 | Acc 21.9 / 37.9\n",
      "[0/2][146/782] Loss_D: 2.29 Loss_G: 20.01 D(x): 0.96 D(G(z)): 0.54 / 0.14 | Acc 62.5 / 38.0\n",
      "[0/2][147/782] Loss_D: 1.93 Loss_G: 20.21 D(x): 0.90 D(G(z)): 0.29 / 0.10 | Acc 50.0 / 38.1\n",
      "[0/2][148/782] Loss_D: 2.20 Loss_G: 19.06 D(x): 0.74 D(G(z)): 0.21 / 0.29 | Acc 42.2 / 38.2\n",
      "semi Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "semi Test: [50/157]\t Prec@1 37.500 (44.975)\n",
      "semi Test: [100/157]\t Prec@1 31.250 (44.431)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (44.195)\n",
      "semi Test Prec@1 44.02\n",
      "sup Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "sup Test: [50/157]\t Prec@1 43.750 (45.588)\n",
      "sup Test: [100/157]\t Prec@1 39.062 (45.111)\n",
      "sup Test: [150/157]\t Prec@1 43.750 (44.630)\n",
      "sup Test Prec@1 44.51\n",
      "[0/2][149/782] Loss_D: 2.12 Loss_G: 20.31 D(x): 0.94 D(G(z)): 0.51 / 0.08 | Acc 56.2 / 38.3\n",
      "[0/2][150/782] Loss_D: 1.95 Loss_G: 19.69 D(x): 0.72 D(G(z)): 0.16 / 0.18 | Acc 59.4 / 38.4\n",
      "[0/2][151/782] Loss_D: 2.10 Loss_G: 19.33 D(x): 0.88 D(G(z)): 0.35 / 0.19 | Acc 46.9 / 38.5\n",
      "[0/2][152/782] Loss_D: 1.97 Loss_G: 20.19 D(x): 0.90 D(G(z)): 0.39 / 0.08 | Acc 54.7 / 38.6\n",
      "[0/2][153/782] Loss_D: 2.25 Loss_G: 18.78 D(x): 0.69 D(G(z)): 0.17 / 0.41 | Acc 39.1 / 38.6\n",
      "[0/2][154/782] Loss_D: 2.54 Loss_G: 20.83 D(x): 0.94 D(G(z)): 0.62 / 0.05 | Acc 50.0 / 38.6\n",
      "[0/2][155/782] Loss_D: 2.22 Loss_G: 18.91 D(x): 0.65 D(G(z)): 0.10 / 0.30 | Acc 40.6 / 38.7\n",
      "[0/2][156/782] Loss_D: 2.15 Loss_G: 20.05 D(x): 0.95 D(G(z)): 0.49 / 0.10 | Acc 54.7 / 38.8\n",
      "[0/2][157/782] Loss_D: 1.87 Loss_G: 19.25 D(x): 0.77 D(G(z)): 0.20 / 0.17 | Acc 56.2 / 38.9\n",
      "[0/2][158/782] Loss_D: 1.85 Loss_G: 19.71 D(x): 0.89 D(G(z)): 0.32 / 0.13 | Acc 60.9 / 39.0\n",
      "semi Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "semi Test: [50/157]\t Prec@1 45.312 (43.903)\n",
      "semi Test: [100/157]\t Prec@1 35.938 (44.075)\n",
      "semi Test: [150/157]\t Prec@1 43.750 (44.402)\n",
      "semi Test Prec@1 44.18\n",
      "sup Test: [0/157]\t Prec@1 37.500 (37.500)\n",
      "sup Test: [50/157]\t Prec@1 40.625 (44.210)\n",
      "sup Test: [100/157]\t Prec@1 35.938 (44.493)\n",
      "sup Test: [150/157]\t Prec@1 45.312 (44.123)\n",
      "sup Test Prec@1 44.14\n",
      "[0/2][159/782] Loss_D: 1.89 Loss_G: 19.25 D(x): 0.82 D(G(z)): 0.26 / 0.19 | Acc 57.8 / 39.1\n",
      "[0/2][160/782] Loss_D: 2.11 Loss_G: 19.73 D(x): 0.87 D(G(z)): 0.34 / 0.12 | Acc 48.4 / 39.2\n",
      "[0/2][161/782] Loss_D: 1.90 Loss_G: 19.23 D(x): 0.82 D(G(z)): 0.24 / 0.21 | Acc 57.8 / 39.3\n",
      "[0/2][162/782] Loss_D: 1.97 Loss_G: 19.50 D(x): 0.81 D(G(z)): 0.35 / 0.16 | Acc 65.6 / 39.5\n",
      "[0/2][163/782] Loss_D: 1.80 Loss_G: 19.94 D(x): 0.85 D(G(z)): 0.31 / 0.09 | Acc 65.6 / 39.6\n",
      "[0/2][164/782] Loss_D: 1.76 Loss_G: 18.96 D(x): 0.81 D(G(z)): 0.17 / 0.19 | Acc 50.0 / 39.7\n",
      "[0/2][165/782] Loss_D: 1.75 Loss_G: 19.76 D(x): 0.93 D(G(z)): 0.36 / 0.10 | Acc 62.5 / 39.8\n",
      "[0/2][166/782] Loss_D: 1.79 Loss_G: 18.88 D(x): 0.79 D(G(z)): 0.19 / 0.20 | Acc 60.9 / 40.0\n",
      "[0/2][167/782] Loss_D: 2.00 Loss_G: 19.92 D(x): 0.90 D(G(z)): 0.39 / 0.07 | Acc 54.7 / 40.0\n",
      "[0/2][168/782] Loss_D: 2.06 Loss_G: 18.65 D(x): 0.80 D(G(z)): 0.16 / 0.23 | Acc 37.5 / 40.0\n",
      "semi Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "semi Test: [50/157]\t Prec@1 39.062 (45.772)\n",
      "semi Test: [100/157]\t Prec@1 35.938 (45.498)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (45.788)\n",
      "semi Test Prec@1 45.53\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 42.188 (45.987)\n",
      "sup Test: [100/157]\t Prec@1 37.500 (45.931)\n",
      "sup Test: [150/157]\t Prec@1 45.312 (45.519)\n",
      "sup Test Prec@1 45.46\n",
      "[0/2][169/782] Loss_D: 2.07 Loss_G: 20.25 D(x): 0.91 D(G(z)): 0.44 / 0.07 | Acc 59.4 / 40.1\n",
      "[0/2][170/782] Loss_D: 2.16 Loss_G: 18.39 D(x): 0.75 D(G(z)): 0.13 / 0.37 | Acc 35.9 / 40.1\n",
      "[0/2][171/782] Loss_D: 2.31 Loss_G: 20.36 D(x): 0.95 D(G(z)): 0.53 / 0.04 | Acc 51.6 / 40.2\n",
      "[0/2][172/782] Loss_D: 2.07 Loss_G: 18.67 D(x): 0.70 D(G(z)): 0.09 / 0.26 | Acc 46.9 / 40.2\n",
      "[0/2][173/782] Loss_D: 1.99 Loss_G: 19.94 D(x): 0.95 D(G(z)): 0.42 / 0.10 | Acc 68.8 / 40.4\n",
      "[0/2][174/782] Loss_D: 1.64 Loss_G: 19.65 D(x): 0.89 D(G(z)): 0.18 / 0.09 | Acc 56.2 / 40.5\n",
      "[0/2][175/782] Loss_D: 1.81 Loss_G: 18.40 D(x): 0.81 D(G(z)): 0.17 / 0.29 | Acc 54.7 / 40.6\n",
      "[0/2][176/782] Loss_D: 1.96 Loss_G: 20.00 D(x): 0.94 D(G(z)): 0.50 / 0.06 | Acc 65.6 / 40.7\n",
      "[0/2][177/782] Loss_D: 1.91 Loss_G: 18.65 D(x): 0.78 D(G(z)): 0.13 / 0.20 | Acc 42.2 / 40.7\n",
      "[0/2][178/782] Loss_D: 1.99 Loss_G: 19.49 D(x): 0.91 D(G(z)): 0.38 / 0.14 | Acc 64.1 / 40.8\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 42.188 (45.741)\n",
      "semi Test: [100/157]\t Prec@1 34.375 (45.204)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (44.630)\n",
      "semi Test Prec@1 44.52\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 40.625 (45.312)\n",
      "sup Test: [100/157]\t Prec@1 34.375 (44.817)\n",
      "sup Test: [150/157]\t Prec@1 43.750 (44.443)\n",
      "sup Test Prec@1 44.38\n",
      "[0/2][179/782] Loss_D: 2.01 Loss_G: 18.46 D(x): 0.81 D(G(z)): 0.25 / 0.21 | Acc 45.3 / 40.9\n",
      "[0/2][180/782] Loss_D: 1.89 Loss_G: 19.60 D(x): 0.90 D(G(z)): 0.41 / 0.09 | Acc 65.6 / 41.0\n",
      "[0/2][181/782] Loss_D: 1.81 Loss_G: 19.11 D(x): 0.81 D(G(z)): 0.18 / 0.17 | Acc 50.0 / 41.0\n",
      "[0/2][182/782] Loss_D: 1.62 Loss_G: 19.29 D(x): 0.92 D(G(z)): 0.34 / 0.09 | Acc 73.4 / 41.2\n",
      "[0/2][183/782] Loss_D: 1.76 Loss_G: 18.78 D(x): 0.81 D(G(z)): 0.21 / 0.19 | Acc 60.9 / 41.3\n",
      "[0/2][184/782] Loss_D: 1.95 Loss_G: 19.09 D(x): 0.88 D(G(z)): 0.36 / 0.16 | Acc 57.8 / 41.4\n",
      "[0/2][185/782] Loss_D: 2.09 Loss_G: 18.97 D(x): 0.81 D(G(z)): 0.30 / 0.16 | Acc 50.0 / 41.5\n",
      "[0/2][186/782] Loss_D: 1.98 Loss_G: 19.12 D(x): 0.82 D(G(z)): 0.31 / 0.14 | Acc 57.8 / 41.6\n",
      "[0/2][187/782] Loss_D: 2.04 Loss_G: 17.97 D(x): 0.78 D(G(z)): 0.28 / 0.28 | Acc 53.1 / 41.6\n",
      "[0/2][188/782] Loss_D: 2.11 Loss_G: 19.27 D(x): 0.90 D(G(z)): 0.43 / 0.08 | Acc 56.2 / 41.7\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 43.750 (46.140)\n",
      "semi Test: [100/157]\t Prec@1 39.062 (45.854)\n",
      "semi Test: [150/157]\t Prec@1 42.188 (45.592)\n",
      "semi Test Prec@1 45.34\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 48.438 (46.385)\n",
      "sup Test: [100/157]\t Prec@1 42.188 (45.684)\n",
      "sup Test: [150/157]\t Prec@1 45.312 (45.509)\n",
      "sup Test Prec@1 45.50\n",
      "[0/2][189/782] Loss_D: 1.74 Loss_G: 18.44 D(x): 0.80 D(G(z)): 0.16 / 0.19 | Acc 56.2 / 41.8\n",
      "[0/2][190/782] Loss_D: 1.67 Loss_G: 18.96 D(x): 0.89 D(G(z)): 0.35 / 0.12 | Acc 73.4 / 41.9\n",
      "[0/2][191/782] Loss_D: 1.90 Loss_G: 18.71 D(x): 0.86 D(G(z)): 0.23 / 0.12 | Acc 48.4 / 42.0\n",
      "[0/2][192/782] Loss_D: 1.82 Loss_G: 18.25 D(x): 0.87 D(G(z)): 0.24 / 0.20 | Acc 50.0 / 42.0\n",
      "[0/2][193/782] Loss_D: 1.74 Loss_G: 19.48 D(x): 0.94 D(G(z)): 0.42 / 0.05 | Acc 62.5 / 42.1\n",
      "[0/2][194/782] Loss_D: 1.98 Loss_G: 18.06 D(x): 0.78 D(G(z)): 0.11 / 0.24 | Acc 45.3 / 42.1\n",
      "[0/2][195/782] Loss_D: 1.93 Loss_G: 19.44 D(x): 0.93 D(G(z)): 0.47 / 0.06 | Acc 67.2 / 42.3\n",
      "[0/2][196/782] Loss_D: 2.12 Loss_G: 18.64 D(x): 0.75 D(G(z)): 0.16 / 0.16 | Acc 42.2 / 42.3\n",
      "[0/2][197/782] Loss_D: 1.89 Loss_G: 18.68 D(x): 0.90 D(G(z)): 0.33 / 0.14 | Acc 54.7 / 42.3\n",
      "[0/2][198/782] Loss_D: 1.74 Loss_G: 18.61 D(x): 0.90 D(G(z)): 0.27 / 0.11 | Acc 56.2 / 42.4\n",
      "semi Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "semi Test: [50/157]\t Prec@1 42.188 (46.538)\n",
      "semi Test: [100/157]\t Prec@1 40.625 (46.426)\n",
      "semi Test: [150/157]\t Prec@1 40.625 (46.316)\n",
      "semi Test Prec@1 46.17\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 42.188 (44.730)\n",
      "sup Test: [100/157]\t Prec@1 35.938 (44.570)\n",
      "sup Test: [150/157]\t Prec@1 40.625 (44.443)\n",
      "sup Test Prec@1 44.36\n",
      "[0/2][199/782] Loss_D: 1.61 Loss_G: 18.94 D(x): 0.90 D(G(z)): 0.24 / 0.10 | Acc 60.9 / 42.5\n",
      "[0/2][200/782] Loss_D: 1.65 Loss_G: 18.44 D(x): 0.86 D(G(z)): 0.19 / 0.16 | Acc 59.4 / 42.6\n",
      "[0/2][201/782] Loss_D: 1.65 Loss_G: 18.45 D(x): 0.90 D(G(z)): 0.29 / 0.11 | Acc 65.6 / 42.7\n",
      "[0/2][202/782] Loss_D: 1.71 Loss_G: 19.16 D(x): 0.91 D(G(z)): 0.22 / 0.08 | Acc 57.8 / 42.8\n",
      "[0/2][203/782] Loss_D: 1.63 Loss_G: 18.14 D(x): 0.88 D(G(z)): 0.16 / 0.17 | Acc 53.1 / 42.8\n",
      "[0/2][204/782] Loss_D: 1.67 Loss_G: 19.04 D(x): 0.93 D(G(z)): 0.33 / 0.09 | Acc 60.9 / 42.9\n",
      "[0/2][205/782] Loss_D: 1.87 Loss_G: 18.74 D(x): 0.87 D(G(z)): 0.20 / 0.17 | Acc 46.9 / 42.9\n",
      "[0/2][206/782] Loss_D: 2.15 Loss_G: 18.73 D(x): 0.83 D(G(z)): 0.34 / 0.17 | Acc 53.1 / 43.0\n",
      "[0/2][207/782] Loss_D: 2.00 Loss_G: 19.22 D(x): 0.82 D(G(z)): 0.33 / 0.14 | Acc 60.9 / 43.1\n",
      "[0/2][208/782] Loss_D: 2.14 Loss_G: 18.52 D(x): 0.80 D(G(z)): 0.29 / 0.16 | Acc 46.9 / 43.1\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (46.507)\n",
      "semi Test: [100/157]\t Prec@1 48.438 (46.287)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (46.275)\n",
      "semi Test Prec@1 46.01\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 42.188 (46.385)\n",
      "sup Test: [100/157]\t Prec@1 35.938 (45.869)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (45.582)\n",
      "sup Test Prec@1 45.44\n",
      "[0/2][209/782] Loss_D: 1.79 Loss_G: 18.73 D(x): 0.84 D(G(z)): 0.32 / 0.14 | Acc 71.9 / 43.2\n",
      "[0/2][210/782] Loss_D: 1.91 Loss_G: 18.81 D(x): 0.87 D(G(z)): 0.28 / 0.14 | Acc 43.8 / 43.2\n",
      "[0/2][211/782] Loss_D: 1.77 Loss_G: 19.14 D(x): 0.87 D(G(z)): 0.27 / 0.09 | Acc 59.4 / 43.3\n",
      "[0/2][212/782] Loss_D: 1.75 Loss_G: 18.30 D(x): 0.87 D(G(z)): 0.18 / 0.17 | Acc 51.6 / 43.3\n",
      "[0/2][213/782] Loss_D: 1.69 Loss_G: 18.95 D(x): 0.93 D(G(z)): 0.32 / 0.06 | Acc 64.1 / 43.4\n",
      "[0/2][214/782] Loss_D: 1.63 Loss_G: 17.52 D(x): 0.82 D(G(z)): 0.14 / 0.21 | Acc 60.9 / 43.5\n",
      "[0/2][215/782] Loss_D: 1.88 Loss_G: 19.76 D(x): 0.96 D(G(z)): 0.45 / 0.03 | Acc 60.9 / 43.6\n",
      "[0/2][216/782] Loss_D: 1.91 Loss_G: 17.37 D(x): 0.81 D(G(z)): 0.06 / 0.29 | Acc 32.8 / 43.5\n",
      "[0/2][217/782] Loss_D: 1.97 Loss_G: 19.10 D(x): 0.96 D(G(z)): 0.49 / 0.05 | Acc 64.1 / 43.6\n",
      "[0/2][218/782] Loss_D: 1.60 Loss_G: 18.52 D(x): 0.83 D(G(z)): 0.12 / 0.11 | Acc 62.5 / 43.7\n",
      "semi Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "semi Test: [50/157]\t Prec@1 54.688 (46.844)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (46.256)\n",
      "semi Test: [150/157]\t Prec@1 40.625 (45.726)\n",
      "semi Test Prec@1 45.50\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 46.875 (45.619)\n",
      "sup Test: [100/157]\t Prec@1 35.938 (45.343)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (44.661)\n",
      "sup Test Prec@1 44.58\n",
      "[0/2][219/782] Loss_D: 1.82 Loss_G: 17.34 D(x): 0.83 D(G(z)): 0.23 / 0.25 | Acc 54.7 / 43.8\n",
      "[0/2][220/782] Loss_D: 2.03 Loss_G: 19.45 D(x): 0.96 D(G(z)): 0.46 / 0.03 | Acc 60.9 / 43.8\n",
      "[0/2][221/782] Loss_D: 1.95 Loss_G: 17.23 D(x): 0.69 D(G(z)): 0.06 / 0.32 | Acc 42.2 / 43.8\n",
      "[0/2][222/782] Loss_D: 2.01 Loss_G: 19.31 D(x): 0.97 D(G(z)): 0.52 / 0.05 | Acc 71.9 / 44.0\n",
      "[0/2][223/782] Loss_D: 1.84 Loss_G: 17.89 D(x): 0.74 D(G(z)): 0.09 / 0.21 | Acc 51.6 / 44.0\n",
      "[0/2][224/782] Loss_D: 1.65 Loss_G: 18.57 D(x): 0.96 D(G(z)): 0.38 / 0.09 | Acc 67.2 / 44.1\n",
      "[0/2][225/782] Loss_D: 1.40 Loss_G: 18.71 D(x): 0.92 D(G(z)): 0.19 / 0.07 | Acc 67.2 / 44.2\n",
      "[0/2][226/782] Loss_D: 1.63 Loss_G: 18.03 D(x): 0.87 D(G(z)): 0.14 / 0.14 | Acc 56.2 / 44.3\n",
      "[0/2][227/782] Loss_D: 1.36 Loss_G: 18.00 D(x): 0.94 D(G(z)): 0.24 / 0.14 | Acc 70.3 / 44.4\n",
      "[0/2][228/782] Loss_D: 1.54 Loss_G: 18.41 D(x): 0.91 D(G(z)): 0.26 / 0.08 | Acc 68.8 / 44.5\n",
      "semi Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "semi Test: [50/157]\t Prec@1 40.625 (46.324)\n",
      "semi Test: [100/157]\t Prec@1 37.500 (45.993)\n",
      "semi Test: [150/157]\t Prec@1 40.625 (46.182)\n",
      "semi Test Prec@1 46.00\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 40.625 (47.488)\n",
      "sup Test: [100/157]\t Prec@1 42.188 (46.890)\n",
      "sup Test: [150/157]\t Prec@1 46.875 (46.358)\n",
      "sup Test Prec@1 46.18\n",
      "[0/2][229/782] Loss_D: 1.54 Loss_G: 18.25 D(x): 0.88 D(G(z)): 0.15 / 0.12 | Acc 64.1 / 44.6\n",
      "[0/2][230/782] Loss_D: 1.72 Loss_G: 17.72 D(x): 0.87 D(G(z)): 0.20 / 0.14 | Acc 57.8 / 44.6\n",
      "[0/2][231/782] Loss_D: 1.45 Loss_G: 18.99 D(x): 0.96 D(G(z)): 0.27 / 0.05 | Acc 64.1 / 44.7\n",
      "[0/2][232/782] Loss_D: 1.75 Loss_G: 18.21 D(x): 0.86 D(G(z)): 0.11 / 0.10 | Acc 56.2 / 44.7\n",
      "[0/2][233/782] Loss_D: 1.34 Loss_G: 18.24 D(x): 0.91 D(G(z)): 0.23 / 0.09 | Acc 78.1 / 44.9\n",
      "[0/2][234/782] Loss_D: 1.47 Loss_G: 18.65 D(x): 0.94 D(G(z)): 0.22 / 0.06 | Acc 59.4 / 45.0\n",
      "[0/2][235/782] Loss_D: 1.42 Loss_G: 17.53 D(x): 0.76 D(G(z)): 0.13 / 0.17 | Acc 71.9 / 45.1\n",
      "[0/2][236/782] Loss_D: 1.96 Loss_G: 18.98 D(x): 0.95 D(G(z)): 0.39 / 0.04 | Acc 56.2 / 45.1\n",
      "[0/2][237/782] Loss_D: 1.71 Loss_G: 18.36 D(x): 0.87 D(G(z)): 0.07 / 0.06 | Acc 54.7 / 45.2\n",
      "[0/2][238/782] Loss_D: 1.54 Loss_G: 17.32 D(x): 0.88 D(G(z)): 0.14 / 0.18 | Acc 59.4 / 45.2\n",
      "semi Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (45.558)\n",
      "semi Test: [100/157]\t Prec@1 35.938 (45.684)\n",
      "semi Test: [150/157]\t Prec@1 40.625 (45.561)\n",
      "semi Test Prec@1 45.28\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 39.062 (44.148)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (44.524)\n",
      "sup Test: [150/157]\t Prec@1 46.875 (43.957)\n",
      "sup Test Prec@1 43.88\n",
      "[0/2][239/782] Loss_D: 1.64 Loss_G: 18.66 D(x): 0.95 D(G(z)): 0.37 / 0.05 | Acc 64.1 / 45.3\n",
      "[0/2][240/782] Loss_D: 1.37 Loss_G: 18.45 D(x): 0.90 D(G(z)): 0.10 / 0.05 | Acc 60.9 / 45.4\n",
      "[0/2][241/782] Loss_D: 1.33 Loss_G: 18.16 D(x): 0.94 D(G(z)): 0.12 / 0.09 | Acc 62.5 / 45.4\n",
      "[0/2][242/782] Loss_D: 1.53 Loss_G: 18.20 D(x): 0.93 D(G(z)): 0.23 / 0.06 | Acc 60.9 / 45.5\n",
      "[0/2][243/782] Loss_D: 1.44 Loss_G: 17.90 D(x): 0.87 D(G(z)): 0.16 / 0.10 | Acc 75.0 / 45.6\n",
      "[0/2][244/782] Loss_D: 1.56 Loss_G: 18.93 D(x): 0.95 D(G(z)): 0.26 / 0.04 | Acc 65.6 / 45.7\n",
      "[0/2][245/782] Loss_D: 1.57 Loss_G: 17.23 D(x): 0.80 D(G(z)): 0.11 / 0.17 | Acc 57.8 / 45.7\n",
      "[0/2][246/782] Loss_D: 2.13 Loss_G: 19.87 D(x): 0.92 D(G(z)): 0.56 / 0.02 | Acc 67.2 / 45.8\n",
      "[0/2][247/782] Loss_D: 2.65 Loss_G: 17.28 D(x): 0.62 D(G(z)): 0.07 / 0.27 | Acc 37.5 / 45.8\n",
      "[0/2][248/782] Loss_D: 2.36 Loss_G: 18.30 D(x): 0.94 D(G(z)): 0.57 / 0.06 | Acc 68.8 / 45.9\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 54.688 (46.967)\n",
      "semi Test: [100/157]\t Prec@1 40.625 (46.627)\n",
      "semi Test: [150/157]\t Prec@1 37.500 (46.275)\n",
      "semi Test Prec@1 46.12\n",
      "sup Test: [0/157]\t Prec@1 35.938 (35.938)\n",
      "sup Test: [50/157]\t Prec@1 39.062 (45.282)\n",
      "sup Test: [100/157]\t Prec@1 40.625 (45.514)\n",
      "sup Test: [150/157]\t Prec@1 43.750 (45.023)\n",
      "sup Test Prec@1 44.96\n",
      "[0/2][249/782] Loss_D: 1.60 Loss_G: 18.66 D(x): 0.90 D(G(z)): 0.17 / 0.06 | Acc 57.8 / 45.9\n",
      "[0/2][250/782] Loss_D: 1.47 Loss_G: 18.54 D(x): 0.89 D(G(z)): 0.20 / 0.06 | Acc 67.2 / 46.0\n",
      "[0/2][251/782] Loss_D: 1.66 Loss_G: 17.51 D(x): 0.86 D(G(z)): 0.20 / 0.12 | Acc 59.4 / 46.1\n",
      "[0/2][252/782] Loss_D: 1.66 Loss_G: 18.42 D(x): 0.92 D(G(z)): 0.32 / 0.04 | Acc 65.6 / 46.2\n",
      "[0/2][253/782] Loss_D: 1.29 Loss_G: 17.68 D(x): 0.88 D(G(z)): 0.13 / 0.09 | Acc 71.9 / 46.3\n",
      "[0/2][254/782] Loss_D: 1.58 Loss_G: 18.24 D(x): 0.89 D(G(z)): 0.31 / 0.07 | Acc 64.1 / 46.3\n",
      "[0/2][255/782] Loss_D: 1.67 Loss_G: 18.32 D(x): 0.92 D(G(z)): 0.26 / 0.07 | Acc 57.8 / 46.4\n",
      "[0/2][256/782] Loss_D: 1.77 Loss_G: 18.29 D(x): 0.85 D(G(z)): 0.31 / 0.05 | Acc 64.1 / 46.4\n",
      "[0/2][257/782] Loss_D: 2.06 Loss_G: 16.77 D(x): 0.79 D(G(z)): 0.21 / 0.19 | Acc 53.1 / 46.5\n",
      "[0/2][258/782] Loss_D: 1.88 Loss_G: 19.35 D(x): 0.92 D(G(z)): 0.49 / 0.02 | Acc 76.6 / 46.6\n",
      "semi Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "semi Test: [50/157]\t Prec@1 45.312 (44.975)\n",
      "semi Test: [100/157]\t Prec@1 40.625 (44.338)\n",
      "semi Test: [150/157]\t Prec@1 43.750 (44.412)\n",
      "semi Test Prec@1 44.25\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 43.750 (46.783)\n",
      "sup Test: [100/157]\t Prec@1 35.938 (46.210)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (46.223)\n",
      "sup Test Prec@1 46.06\n",
      "[0/2][259/782] Loss_D: 2.35 Loss_G: 15.73 D(x): 0.64 D(G(z)): 0.04 / 0.54 | Acc 25.0 / 46.5\n",
      "[0/2][260/782] Loss_D: 2.66 Loss_G: 18.75 D(x): 0.99 D(G(z)): 0.74 / 0.03 | Acc 79.7 / 46.6\n",
      "[0/2][261/782] Loss_D: 1.56 Loss_G: 18.18 D(x): 0.84 D(G(z)): 0.06 / 0.06 | Acc 53.1 / 46.6\n",
      "[0/2][262/782] Loss_D: 1.57 Loss_G: 16.82 D(x): 0.87 D(G(z)): 0.13 / 0.20 | Acc 57.8 / 46.7\n",
      "[0/2][263/782] Loss_D: 1.80 Loss_G: 18.00 D(x): 0.97 D(G(z)): 0.42 / 0.06 | Acc 68.8 / 46.8\n",
      "[0/2][264/782] Loss_D: 1.60 Loss_G: 17.67 D(x): 0.90 D(G(z)): 0.13 / 0.08 | Acc 54.7 / 46.8\n",
      "[0/2][265/782] Loss_D: 1.53 Loss_G: 17.75 D(x): 0.90 D(G(z)): 0.21 / 0.11 | Acc 62.5 / 46.9\n",
      "[0/2][266/782] Loss_D: 1.61 Loss_G: 17.78 D(x): 0.90 D(G(z)): 0.28 / 0.07 | Acc 68.8 / 46.9\n",
      "[0/2][267/782] Loss_D: 1.89 Loss_G: 17.09 D(x): 0.83 D(G(z)): 0.22 / 0.14 | Acc 53.1 / 47.0\n",
      "[0/2][268/782] Loss_D: 1.66 Loss_G: 18.19 D(x): 0.91 D(G(z)): 0.37 / 0.05 | Acc 68.8 / 47.0\n",
      "semi Test: [0/157]\t Prec@1 35.938 (35.938)\n",
      "semi Test: [50/157]\t Prec@1 45.312 (47.702)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (47.772)\n",
      "semi Test: [150/157]\t Prec@1 40.625 (47.382)\n",
      "semi Test Prec@1 47.10\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 43.750 (45.588)\n",
      "sup Test: [100/157]\t Prec@1 34.375 (45.421)\n",
      "sup Test: [150/157]\t Prec@1 46.875 (45.012)\n",
      "sup Test Prec@1 44.91\n",
      "[0/2][269/782] Loss_D: 1.86 Loss_G: 16.77 D(x): 0.82 D(G(z)): 0.14 / 0.15 | Acc 40.6 / 47.0\n",
      "[0/2][270/782] Loss_D: 1.52 Loss_G: 18.20 D(x): 0.94 D(G(z)): 0.40 / 0.04 | Acc 68.8 / 47.1\n",
      "[0/2][271/782] Loss_D: 1.48 Loss_G: 17.46 D(x): 0.86 D(G(z)): 0.11 / 0.07 | Acc 60.9 / 47.2\n",
      "[0/2][272/782] Loss_D: 1.37 Loss_G: 17.18 D(x): 0.91 D(G(z)): 0.20 / 0.11 | Acc 65.6 / 47.2\n",
      "[0/2][273/782] Loss_D: 1.65 Loss_G: 17.42 D(x): 0.90 D(G(z)): 0.31 / 0.07 | Acc 67.2 / 47.3\n",
      "[0/2][274/782] Loss_D: 1.42 Loss_G: 17.59 D(x): 0.88 D(G(z)): 0.19 / 0.07 | Acc 65.6 / 47.4\n",
      "[0/2][275/782] Loss_D: 1.64 Loss_G: 17.02 D(x): 0.88 D(G(z)): 0.20 / 0.13 | Acc 68.8 / 47.4\n",
      "[0/2][276/782] Loss_D: 1.73 Loss_G: 18.47 D(x): 0.93 D(G(z)): 0.39 / 0.03 | Acc 62.5 / 47.5\n",
      "[0/2][277/782] Loss_D: 1.86 Loss_G: 17.08 D(x): 0.81 D(G(z)): 0.10 / 0.12 | Acc 46.9 / 47.5\n",
      "[0/2][278/782] Loss_D: 2.31 Loss_G: 19.26 D(x): 0.94 D(G(z)): 0.58 / 0.01 | Acc 60.9 / 47.5\n",
      "semi Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (46.875)\n",
      "semi Test: [100/157]\t Prec@1 46.875 (46.194)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (46.306)\n",
      "semi Test Prec@1 46.06\n",
      "sup Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "sup Test: [50/157]\t Prec@1 45.312 (45.190)\n",
      "sup Test: [100/157]\t Prec@1 35.938 (45.514)\n",
      "sup Test: [150/157]\t Prec@1 42.188 (44.950)\n",
      "sup Test Prec@1 44.88\n",
      "[0/2][279/782] Loss_D: 2.17 Loss_G: 15.68 D(x): 0.56 D(G(z)): 0.06 / 0.40 | Acc 46.9 / 47.5\n",
      "[0/2][280/782] Loss_D: 3.06 Loss_G: 19.24 D(x): 0.96 D(G(z)): 0.82 / 0.02 | Acc 76.6 / 47.6\n",
      "[0/2][281/782] Loss_D: 3.93 Loss_G: 15.22 D(x): 0.34 D(G(z)): 0.04 / 0.55 | Acc 9.4 / 47.5\n",
      "[0/2][282/782] Loss_D: 2.69 Loss_G: 16.36 D(x): 0.99 D(G(z)): 0.70 / 0.19 | Acc 62.5 / 47.6\n",
      "[0/2][283/782] Loss_D: 1.62 Loss_G: 17.78 D(x): 0.97 D(G(z)): 0.35 / 0.06 | Acc 67.2 / 47.6\n",
      "[0/2][284/782] Loss_D: 1.75 Loss_G: 17.01 D(x): 0.88 D(G(z)): 0.16 / 0.11 | Acc 50.0 / 47.6\n",
      "[0/2][285/782] Loss_D: 2.06 Loss_G: 17.14 D(x): 0.86 D(G(z)): 0.48 / 0.12 | Acc 68.8 / 47.7\n",
      "[0/2][286/782] Loss_D: 2.44 Loss_G: 17.46 D(x): 0.84 D(G(z)): 0.51 / 0.07 | Acc 48.4 / 47.7\n",
      "[0/2][287/782] Loss_D: 2.60 Loss_G: 16.00 D(x): 0.59 D(G(z)): 0.26 / 0.32 | Acc 43.8 / 47.7\n",
      "[0/2][288/782] Loss_D: 2.28 Loss_G: 17.03 D(x): 0.89 D(G(z)): 0.53 / 0.12 | Acc 60.9 / 47.7\n",
      "semi Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (45.129)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (45.204)\n",
      "semi Test: [150/157]\t Prec@1 42.188 (45.375)\n",
      "semi Test Prec@1 45.18\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 45.312 (46.293)\n",
      "sup Test: [100/157]\t Prec@1 40.625 (45.869)\n",
      "sup Test: [150/157]\t Prec@1 50.000 (46.068)\n",
      "sup Test Prec@1 45.93\n",
      "[0/2][289/782] Loss_D: 1.77 Loss_G: 17.06 D(x): 0.89 D(G(z)): 0.27 / 0.09 | Acc 51.6 / 47.8\n",
      "[0/2][290/782] Loss_D: 1.79 Loss_G: 16.60 D(x): 0.83 D(G(z)): 0.22 / 0.16 | Acc 51.6 / 47.8\n",
      "[0/2][291/782] Loss_D: 1.75 Loss_G: 16.67 D(x): 0.91 D(G(z)): 0.39 / 0.10 | Acc 64.1 / 47.8\n",
      "[0/2][292/782] Loss_D: 1.65 Loss_G: 17.08 D(x): 0.87 D(G(z)): 0.28 / 0.08 | Acc 64.1 / 47.9\n",
      "[0/2][293/782] Loss_D: 1.93 Loss_G: 16.60 D(x): 0.81 D(G(z)): 0.25 / 0.17 | Acc 53.1 / 47.9\n",
      "[0/2][294/782] Loss_D: 2.03 Loss_G: 17.13 D(x): 0.83 D(G(z)): 0.49 / 0.09 | Acc 62.5 / 48.0\n",
      "[0/2][295/782] Loss_D: 1.92 Loss_G: 16.58 D(x): 0.79 D(G(z)): 0.27 / 0.13 | Acc 50.0 / 48.0\n",
      "[0/2][296/782] Loss_D: 1.92 Loss_G: 16.65 D(x): 0.88 D(G(z)): 0.37 / 0.11 | Acc 59.4 / 48.0\n",
      "[0/2][297/782] Loss_D: 1.73 Loss_G: 16.71 D(x): 0.84 D(G(z)): 0.32 / 0.11 | Acc 64.1 / 48.0\n",
      "[0/2][298/782] Loss_D: 1.97 Loss_G: 15.70 D(x): 0.74 D(G(z)): 0.30 / 0.24 | Acc 54.7 / 48.1\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (47.273)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (46.829)\n",
      "semi Test: [150/157]\t Prec@1 43.750 (46.978)\n",
      "semi Test Prec@1 46.86\n",
      "sup Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "sup Test: [50/157]\t Prec@1 42.188 (47.426)\n",
      "sup Test: [100/157]\t Prec@1 48.438 (46.983)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (46.596)\n",
      "sup Test Prec@1 46.55\n",
      "[0/2][299/782] Loss_D: 2.04 Loss_G: 17.96 D(x): 0.92 D(G(z)): 0.52 / 0.04 | Acc 67.2 / 48.1\n",
      "[0/2][300/782] Loss_D: 2.13 Loss_G: 15.16 D(x): 0.63 D(G(z)): 0.11 / 0.47 | Acc 34.4 / 48.1\n",
      "[0/2][301/782] Loss_D: 2.32 Loss_G: 17.44 D(x): 0.97 D(G(z)): 0.69 / 0.05 | Acc 73.4 / 48.2\n",
      "[0/2][302/782] Loss_D: 1.74 Loss_G: 16.89 D(x): 0.80 D(G(z)): 0.13 / 0.08 | Acc 60.9 / 48.2\n",
      "[0/2][303/782] Loss_D: 1.69 Loss_G: 15.86 D(x): 0.82 D(G(z)): 0.20 / 0.24 | Acc 56.2 / 48.2\n",
      "[0/2][304/782] Loss_D: 1.90 Loss_G: 16.62 D(x): 0.90 D(G(z)): 0.46 / 0.10 | Acc 68.8 / 48.3\n",
      "[0/2][305/782] Loss_D: 1.60 Loss_G: 16.15 D(x): 0.85 D(G(z)): 0.23 / 0.14 | Acc 59.4 / 48.3\n",
      "[0/2][306/782] Loss_D: 1.74 Loss_G: 16.30 D(x): 0.83 D(G(z)): 0.30 / 0.15 | Acc 60.9 / 48.4\n",
      "[0/2][307/782] Loss_D: 1.75 Loss_G: 16.08 D(x): 0.84 D(G(z)): 0.33 / 0.17 | Acc 57.8 / 48.4\n",
      "[0/2][308/782] Loss_D: 1.68 Loss_G: 16.43 D(x): 0.85 D(G(z)): 0.34 / 0.12 | Acc 67.2 / 48.5\n",
      "semi Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (45.711)\n",
      "semi Test: [100/157]\t Prec@1 40.625 (45.854)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (46.058)\n",
      "semi Test Prec@1 45.94\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 48.438 (47.304)\n",
      "sup Test: [100/157]\t Prec@1 35.938 (47.277)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (46.947)\n",
      "sup Test Prec@1 46.87\n",
      "[0/2][309/782] Loss_D: 1.79 Loss_G: 15.67 D(x): 0.75 D(G(z)): 0.27 / 0.20 | Acc 68.8 / 48.5\n",
      "[0/2][310/782] Loss_D: 1.85 Loss_G: 17.01 D(x): 0.91 D(G(z)): 0.42 / 0.07 | Acc 67.2 / 48.6\n",
      "[0/2][311/782] Loss_D: 1.87 Loss_G: 15.11 D(x): 0.74 D(G(z)): 0.16 / 0.34 | Acc 53.1 / 48.6\n",
      "[0/2][312/782] Loss_D: 2.13 Loss_G: 17.31 D(x): 0.93 D(G(z)): 0.55 / 0.06 | Acc 67.2 / 48.7\n",
      "[0/2][313/782] Loss_D: 1.98 Loss_G: 15.74 D(x): 0.68 D(G(z)): 0.13 / 0.24 | Acc 54.7 / 48.7\n",
      "[0/2][314/782] Loss_D: 1.82 Loss_G: 16.42 D(x): 0.93 D(G(z)): 0.44 / 0.09 | Acc 67.2 / 48.8\n",
      "[0/2][315/782] Loss_D: 1.50 Loss_G: 16.26 D(x): 0.82 D(G(z)): 0.22 / 0.10 | Acc 67.2 / 48.8\n",
      "[0/2][316/782] Loss_D: 1.58 Loss_G: 16.06 D(x): 0.85 D(G(z)): 0.24 / 0.15 | Acc 64.1 / 48.9\n",
      "[0/2][317/782] Loss_D: 1.68 Loss_G: 16.65 D(x): 0.91 D(G(z)): 0.33 / 0.10 | Acc 64.1 / 48.9\n",
      "[0/2][318/782] Loss_D: 1.84 Loss_G: 15.98 D(x): 0.82 D(G(z)): 0.26 / 0.14 | Acc 59.4 / 48.9\n",
      "semi Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "semi Test: [50/157]\t Prec@1 43.750 (47.028)\n",
      "semi Test: [100/157]\t Prec@1 46.875 (47.061)\n",
      "semi Test: [150/157]\t Prec@1 42.188 (46.575)\n",
      "semi Test Prec@1 46.38\n",
      "sup Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "sup Test: [50/157]\t Prec@1 45.312 (46.507)\n",
      "sup Test: [100/157]\t Prec@1 42.188 (46.411)\n",
      "sup Test: [150/157]\t Prec@1 42.188 (46.037)\n",
      "sup Test Prec@1 45.96\n",
      "[0/2][319/782] Loss_D: 1.65 Loss_G: 16.55 D(x): 0.89 D(G(z)): 0.33 / 0.08 | Acc 70.3 / 49.0\n",
      "[0/2][320/782] Loss_D: 1.51 Loss_G: 16.24 D(x): 0.84 D(G(z)): 0.20 / 0.10 | Acc 64.1 / 49.1\n",
      "[0/2][321/782] Loss_D: 1.62 Loss_G: 15.72 D(x): 0.82 D(G(z)): 0.26 / 0.21 | Acc 65.6 / 49.1\n",
      "[0/2][322/782] Loss_D: 1.82 Loss_G: 16.75 D(x): 0.91 D(G(z)): 0.41 / 0.07 | Acc 73.4 / 49.2\n",
      "[0/2][323/782] Loss_D: 1.80 Loss_G: 15.63 D(x): 0.75 D(G(z)): 0.19 / 0.23 | Acc 56.2 / 49.2\n",
      "[0/2][324/782] Loss_D: 1.81 Loss_G: 16.79 D(x): 0.89 D(G(z)): 0.45 / 0.08 | Acc 75.0 / 49.3\n",
      "[0/2][325/782] Loss_D: 1.70 Loss_G: 16.25 D(x): 0.85 D(G(z)): 0.22 / 0.12 | Acc 60.9 / 49.3\n",
      "[0/2][326/782] Loss_D: 1.93 Loss_G: 15.60 D(x): 0.78 D(G(z)): 0.32 / 0.23 | Acc 59.4 / 49.4\n",
      "[0/2][327/782] Loss_D: 2.01 Loss_G: 16.79 D(x): 0.89 D(G(z)): 0.50 / 0.05 | Acc 62.5 / 49.4\n",
      "[0/2][328/782] Loss_D: 1.92 Loss_G: 14.66 D(x): 0.67 D(G(z)): 0.16 / 0.45 | Acc 53.1 / 49.4\n",
      "semi Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (47.518)\n",
      "semi Test: [100/157]\t Prec@1 43.750 (47.355)\n",
      "semi Test: [150/157]\t Prec@1 48.438 (47.506)\n",
      "semi Test Prec@1 47.36\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 50.000 (48.223)\n",
      "sup Test: [100/157]\t Prec@1 34.375 (47.834)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (47.423)\n",
      "sup Test Prec@1 47.31\n",
      "[0/2][329/782] Loss_D: 2.25 Loss_G: 17.17 D(x): 0.94 D(G(z)): 0.69 / 0.04 | Acc 73.4 / 49.5\n",
      "[0/2][330/782] Loss_D: 2.28 Loss_G: 15.03 D(x): 0.59 D(G(z)): 0.11 / 0.34 | Acc 34.4 / 49.4\n",
      "[0/2][331/782] Loss_D: 2.20 Loss_G: 16.35 D(x): 0.93 D(G(z)): 0.55 / 0.09 | Acc 62.5 / 49.5\n",
      "[0/2][332/782] Loss_D: 1.89 Loss_G: 16.01 D(x): 0.82 D(G(z)): 0.23 / 0.12 | Acc 54.7 / 49.5\n",
      "[0/2][333/782] Loss_D: 1.48 Loss_G: 16.02 D(x): 0.91 D(G(z)): 0.30 / 0.12 | Acc 70.3 / 49.5\n",
      "[0/2][334/782] Loss_D: 1.60 Loss_G: 15.91 D(x): 0.86 D(G(z)): 0.28 / 0.14 | Acc 68.8 / 49.6\n",
      "[0/2][335/782] Loss_D: 2.02 Loss_G: 16.10 D(x): 0.86 D(G(z)): 0.41 / 0.13 | Acc 60.9 / 49.6\n",
      "[0/2][336/782] Loss_D: 1.83 Loss_G: 15.83 D(x): 0.78 D(G(z)): 0.35 / 0.20 | Acc 65.6 / 49.7\n",
      "[0/2][337/782] Loss_D: 2.09 Loss_G: 15.89 D(x): 0.80 D(G(z)): 0.38 / 0.22 | Acc 56.2 / 49.7\n",
      "[0/2][338/782] Loss_D: 2.11 Loss_G: 15.69 D(x): 0.81 D(G(z)): 0.40 / 0.14 | Acc 57.8 / 49.7\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 50.000 (48.407)\n",
      "semi Test: [100/157]\t Prec@1 39.062 (48.391)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (48.044)\n",
      "semi Test Prec@1 47.88\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 46.875 (47.243)\n",
      "sup Test: [100/157]\t Prec@1 39.062 (47.587)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (47.134)\n",
      "sup Test Prec@1 47.03\n",
      "[0/2][339/782] Loss_D: 1.78 Loss_G: 15.59 D(x): 0.84 D(G(z)): 0.28 / 0.20 | Acc 57.8 / 49.8\n",
      "[0/2][340/782] Loss_D: 2.08 Loss_G: 15.92 D(x): 0.88 D(G(z)): 0.42 / 0.12 | Acc 56.2 / 49.8\n",
      "[0/2][341/782] Loss_D: 1.77 Loss_G: 15.74 D(x): 0.79 D(G(z)): 0.30 / 0.17 | Acc 65.6 / 49.8\n",
      "[0/2][342/782] Loss_D: 1.90 Loss_G: 15.63 D(x): 0.81 D(G(z)): 0.40 / 0.12 | Acc 67.2 / 49.9\n",
      "[0/2][343/782] Loss_D: 2.30 Loss_G: 14.65 D(x): 0.71 D(G(z)): 0.38 / 0.40 | Acc 51.6 / 49.9\n",
      "[0/2][344/782] Loss_D: 2.45 Loss_G: 17.19 D(x): 0.88 D(G(z)): 0.62 / 0.03 | Acc 68.8 / 49.9\n",
      "[0/2][345/782] Loss_D: 2.49 Loss_G: 14.01 D(x): 0.54 D(G(z)): 0.12 / 0.66 | Acc 25.0 / 49.9\n",
      "[0/2][346/782] Loss_D: 2.71 Loss_G: 16.89 D(x): 0.97 D(G(z)): 0.78 / 0.06 | Acc 76.6 / 49.9\n",
      "[0/2][347/782] Loss_D: 2.11 Loss_G: 15.29 D(x): 0.66 D(G(z)): 0.18 / 0.24 | Acc 54.7 / 49.9\n",
      "[0/2][348/782] Loss_D: 1.99 Loss_G: 15.04 D(x): 0.87 D(G(z)): 0.43 / 0.21 | Acc 51.6 / 50.0\n",
      "semi Test: [0/157]\t Prec@1 37.500 (37.500)\n",
      "semi Test: [50/157]\t Prec@1 46.875 (47.457)\n",
      "semi Test: [100/157]\t Prec@1 37.500 (47.277)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (47.103)\n",
      "semi Test Prec@1 46.92\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 46.875 (46.936)\n",
      "sup Test: [100/157]\t Prec@1 42.188 (47.540)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (46.782)\n",
      "sup Test Prec@1 46.61\n",
      "[0/2][349/782] Loss_D: 1.93 Loss_G: 16.16 D(x): 0.89 D(G(z)): 0.47 / 0.08 | Acc 71.9 / 50.0\n",
      "[0/2][350/782] Loss_D: 2.34 Loss_G: 14.21 D(x): 0.58 D(G(z)): 0.23 / 0.54 | Acc 40.6 / 50.0\n",
      "[0/2][351/782] Loss_D: 2.28 Loss_G: 16.18 D(x): 0.96 D(G(z)): 0.71 / 0.08 | Acc 73.4 / 50.1\n",
      "[0/2][352/782] Loss_D: 2.10 Loss_G: 14.75 D(x): 0.70 D(G(z)): 0.19 / 0.29 | Acc 39.1 / 50.0\n",
      "[0/2][353/782] Loss_D: 2.32 Loss_G: 14.90 D(x): 0.78 D(G(z)): 0.49 / 0.31 | Acc 67.2 / 50.1\n",
      "[0/2][354/782] Loss_D: 2.17 Loss_G: 15.57 D(x): 0.86 D(G(z)): 0.49 / 0.12 | Acc 59.4 / 50.1\n",
      "[0/2][355/782] Loss_D: 1.90 Loss_G: 14.70 D(x): 0.72 D(G(z)): 0.26 / 0.32 | Acc 57.8 / 50.1\n",
      "[0/2][356/782] Loss_D: 1.91 Loss_G: 15.47 D(x): 0.91 D(G(z)): 0.51 / 0.14 | Acc 70.3 / 50.2\n",
      "[0/2][357/782] Loss_D: 2.04 Loss_G: 14.73 D(x): 0.73 D(G(z)): 0.29 / 0.25 | Acc 56.2 / 50.2\n",
      "[0/2][358/782] Loss_D: 2.02 Loss_G: 15.36 D(x): 0.86 D(G(z)): 0.44 / 0.13 | Acc 60.9 / 50.2\n",
      "semi Test: [0/157]\t Prec@1 50.000 (50.000)\n",
      "semi Test: [50/157]\t Prec@1 46.875 (49.326)\n",
      "semi Test: [100/157]\t Prec@1 45.312 (49.041)\n",
      "semi Test: [150/157]\t Prec@1 48.438 (49.193)\n",
      "semi Test Prec@1 49.09\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 48.438 (47.518)\n",
      "sup Test: [100/157]\t Prec@1 39.062 (47.386)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (46.968)\n",
      "sup Test Prec@1 46.79\n",
      "[0/2][359/782] Loss_D: 1.98 Loss_G: 14.47 D(x): 0.73 D(G(z)): 0.29 / 0.26 | Acc 59.4 / 50.2\n",
      "[0/2][360/782] Loss_D: 1.80 Loss_G: 15.37 D(x): 0.88 D(G(z)): 0.46 / 0.14 | Acc 68.8 / 50.3\n",
      "[0/2][361/782] Loss_D: 1.93 Loss_G: 14.53 D(x): 0.75 D(G(z)): 0.32 / 0.31 | Acc 57.8 / 50.3\n",
      "[0/2][362/782] Loss_D: 2.00 Loss_G: 15.42 D(x): 0.86 D(G(z)): 0.50 / 0.10 | Acc 67.2 / 50.4\n",
      "[0/2][363/782] Loss_D: 1.92 Loss_G: 14.42 D(x): 0.73 D(G(z)): 0.23 / 0.32 | Acc 64.1 / 50.4\n",
      "[0/2][364/782] Loss_D: 1.81 Loss_G: 15.73 D(x): 0.88 D(G(z)): 0.51 / 0.09 | Acc 78.1 / 50.5\n",
      "[0/2][365/782] Loss_D: 1.74 Loss_G: 14.82 D(x): 0.76 D(G(z)): 0.20 / 0.25 | Acc 53.1 / 50.5\n",
      "[0/2][366/782] Loss_D: 1.92 Loss_G: 15.24 D(x): 0.83 D(G(z)): 0.46 / 0.17 | Acc 70.3 / 50.5\n",
      "[0/2][367/782] Loss_D: 1.76 Loss_G: 15.44 D(x): 0.83 D(G(z)): 0.37 / 0.13 | Acc 64.1 / 50.6\n",
      "[0/2][368/782] Loss_D: 1.82 Loss_G: 14.48 D(x): 0.78 D(G(z)): 0.27 / 0.29 | Acc 60.9 / 50.6\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 56.250 (48.928)\n",
      "semi Test: [100/157]\t Prec@1 46.875 (48.994)\n",
      "semi Test: [150/157]\t Prec@1 43.750 (48.882)\n",
      "semi Test Prec@1 48.72\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 45.312 (47.672)\n",
      "sup Test: [100/157]\t Prec@1 39.062 (47.587)\n",
      "sup Test: [150/157]\t Prec@1 45.312 (47.103)\n",
      "sup Test Prec@1 46.90\n",
      "[0/2][369/782] Loss_D: 1.93 Loss_G: 15.73 D(x): 0.89 D(G(z)): 0.52 / 0.09 | Acc 76.6 / 50.7\n",
      "[0/2][370/782] Loss_D: 2.00 Loss_G: 13.77 D(x): 0.61 D(G(z)): 0.21 / 0.48 | Acc 57.8 / 50.7\n",
      "[0/2][371/782] Loss_D: 2.32 Loss_G: 16.77 D(x): 0.93 D(G(z)): 0.70 / 0.03 | Acc 75.0 / 50.8\n",
      "[0/2][372/782] Loss_D: 2.43 Loss_G: 13.58 D(x): 0.50 D(G(z)): 0.09 / 0.65 | Acc 39.1 / 50.7\n",
      "[0/2][373/782] Loss_D: 2.78 Loss_G: 15.58 D(x): 0.97 D(G(z)): 0.80 / 0.11 | Acc 73.4 / 50.8\n",
      "[0/2][374/782] Loss_D: 2.05 Loss_G: 14.64 D(x): 0.72 D(G(z)): 0.24 / 0.19 | Acc 45.3 / 50.8\n",
      "[0/2][375/782] Loss_D: 1.79 Loss_G: 14.40 D(x): 0.79 D(G(z)): 0.36 / 0.25 | Acc 67.2 / 50.8\n",
      "[0/2][376/782] Loss_D: 2.29 Loss_G: 14.86 D(x): 0.79 D(G(z)): 0.47 / 0.19 | Acc 59.4 / 50.8\n",
      "[0/2][377/782] Loss_D: 1.94 Loss_G: 14.57 D(x): 0.71 D(G(z)): 0.39 / 0.25 | Acc 60.9 / 50.9\n",
      "[0/2][378/782] Loss_D: 2.16 Loss_G: 14.08 D(x): 0.74 D(G(z)): 0.43 / 0.28 | Acc 53.1 / 50.9\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 57.812 (48.438)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (48.329)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (48.406)\n",
      "semi Test Prec@1 48.26\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 42.188 (46.446)\n",
      "sup Test: [100/157]\t Prec@1 43.750 (46.612)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (46.471)\n",
      "sup Test Prec@1 46.25\n",
      "[0/2][379/782] Loss_D: 1.95 Loss_G: 14.69 D(x): 0.81 D(G(z)): 0.43 / 0.20 | Acc 65.6 / 50.9\n",
      "[0/2][380/782] Loss_D: 1.79 Loss_G: 14.95 D(x): 0.80 D(G(z)): 0.35 / 0.17 | Acc 65.6 / 51.0\n",
      "[0/2][381/782] Loss_D: 1.84 Loss_G: 14.87 D(x): 0.82 D(G(z)): 0.34 / 0.16 | Acc 65.6 / 51.0\n",
      "[0/2][382/782] Loss_D: 1.86 Loss_G: 14.88 D(x): 0.80 D(G(z)): 0.35 / 0.17 | Acc 60.9 / 51.0\n",
      "[0/2][383/782] Loss_D: 1.84 Loss_G: 14.85 D(x): 0.82 D(G(z)): 0.37 / 0.21 | Acc 59.4 / 51.0\n",
      "[0/2][384/782] Loss_D: 2.29 Loss_G: 14.10 D(x): 0.71 D(G(z)): 0.40 / 0.35 | Acc 51.6 / 51.0\n",
      "[0/2][385/782] Loss_D: 2.18 Loss_G: 15.90 D(x): 0.87 D(G(z)): 0.54 / 0.07 | Acc 67.2 / 51.1\n",
      "[0/2][386/782] Loss_D: 2.06 Loss_G: 13.55 D(x): 0.56 D(G(z)): 0.16 / 0.58 | Acc 54.7 / 51.1\n",
      "[0/2][387/782] Loss_D: 2.58 Loss_G: 15.44 D(x): 0.93 D(G(z)): 0.75 / 0.08 | Acc 68.8 / 51.1\n",
      "[0/2][388/782] Loss_D: 2.00 Loss_G: 14.45 D(x): 0.70 D(G(z)): 0.17 / 0.24 | Acc 51.6 / 51.1\n",
      "semi Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "semi Test: [50/157]\t Prec@1 53.125 (48.407)\n",
      "semi Test: [100/157]\t Prec@1 45.312 (48.422)\n",
      "semi Test: [150/157]\t Prec@1 40.625 (48.086)\n",
      "semi Test Prec@1 47.91\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 43.750 (46.507)\n",
      "sup Test: [100/157]\t Prec@1 42.188 (47.092)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (46.678)\n",
      "sup Test Prec@1 46.57\n",
      "[0/2][389/782] Loss_D: 1.79 Loss_G: 14.73 D(x): 0.85 D(G(z)): 0.42 / 0.19 | Acc 65.6 / 51.2\n",
      "[0/2][390/782] Loss_D: 1.84 Loss_G: 14.65 D(x): 0.81 D(G(z)): 0.36 / 0.20 | Acc 60.9 / 51.2\n",
      "[0/2][391/782] Loss_D: 2.07 Loss_G: 14.20 D(x): 0.81 D(G(z)): 0.38 / 0.26 | Acc 50.0 / 51.2\n",
      "[0/2][392/782] Loss_D: 1.92 Loss_G: 14.95 D(x): 0.81 D(G(z)): 0.46 / 0.15 | Acc 75.0 / 51.3\n",
      "[0/2][393/782] Loss_D: 1.67 Loss_G: 14.04 D(x): 0.76 D(G(z)): 0.31 / 0.26 | Acc 67.2 / 51.3\n",
      "[0/2][394/782] Loss_D: 1.72 Loss_G: 14.93 D(x): 0.84 D(G(z)): 0.45 / 0.14 | Acc 75.0 / 51.4\n",
      "[0/2][395/782] Loss_D: 1.93 Loss_G: 13.62 D(x): 0.74 D(G(z)): 0.27 / 0.40 | Acc 48.4 / 51.3\n",
      "[0/2][396/782] Loss_D: 2.11 Loss_G: 15.39 D(x): 0.89 D(G(z)): 0.57 / 0.08 | Acc 65.6 / 51.4\n",
      "[0/2][397/782] Loss_D: 1.89 Loss_G: 13.70 D(x): 0.69 D(G(z)): 0.17 / 0.36 | Acc 50.0 / 51.4\n",
      "[0/2][398/782] Loss_D: 2.13 Loss_G: 15.12 D(x): 0.87 D(G(z)): 0.58 / 0.13 | Acc 73.4 / 51.4\n",
      "semi Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (47.702)\n",
      "semi Test: [100/157]\t Prec@1 40.625 (48.082)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (48.375)\n",
      "semi Test Prec@1 48.24\n",
      "sup Test: [0/157]\t Prec@1 35.938 (35.938)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (47.396)\n",
      "sup Test: [100/157]\t Prec@1 42.188 (47.819)\n",
      "sup Test: [150/157]\t Prec@1 50.000 (47.475)\n",
      "sup Test Prec@1 47.26\n",
      "[0/2][399/782] Loss_D: 1.97 Loss_G: 13.83 D(x): 0.70 D(G(z)): 0.24 / 0.34 | Acc 59.4 / 51.5\n",
      "[0/2][400/782] Loss_D: 2.09 Loss_G: 14.65 D(x): 0.83 D(G(z)): 0.53 / 0.15 | Acc 64.1 / 51.5\n",
      "[0/2][401/782] Loss_D: 1.77 Loss_G: 14.33 D(x): 0.71 D(G(z)): 0.31 / 0.24 | Acc 64.1 / 51.5\n",
      "[0/2][402/782] Loss_D: 1.86 Loss_G: 14.76 D(x): 0.79 D(G(z)): 0.43 / 0.16 | Acc 65.6 / 51.6\n",
      "[0/2][403/782] Loss_D: 1.83 Loss_G: 14.12 D(x): 0.73 D(G(z)): 0.35 / 0.29 | Acc 68.8 / 51.6\n",
      "[0/2][404/782] Loss_D: 1.98 Loss_G: 14.93 D(x): 0.83 D(G(z)): 0.50 / 0.11 | Acc 70.3 / 51.6\n",
      "[0/2][405/782] Loss_D: 1.77 Loss_G: 13.89 D(x): 0.71 D(G(z)): 0.27 / 0.27 | Acc 64.1 / 51.7\n",
      "[0/2][406/782] Loss_D: 1.91 Loss_G: 15.14 D(x): 0.85 D(G(z)): 0.50 / 0.10 | Acc 65.6 / 51.7\n",
      "[0/2][407/782] Loss_D: 2.37 Loss_G: 12.86 D(x): 0.60 D(G(z)): 0.25 / 0.65 | Acc 39.1 / 51.7\n",
      "[0/2][408/782] Loss_D: 2.72 Loss_G: 16.40 D(x): 0.96 D(G(z)): 0.81 / 0.04 | Acc 76.6 / 51.7\n",
      "semi Test: [0/157]\t Prec@1 50.000 (50.000)\n",
      "semi Test: [50/157]\t Prec@1 45.312 (46.906)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (46.829)\n",
      "semi Test: [150/157]\t Prec@1 42.188 (46.554)\n",
      "semi Test Prec@1 46.50\n",
      "sup Test: [0/157]\t Prec@1 35.938 (35.938)\n",
      "sup Test: [50/157]\t Prec@1 40.625 (46.415)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (46.566)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (46.233)\n",
      "sup Test Prec@1 46.08\n",
      "[0/2][409/782] Loss_D: 2.63 Loss_G: 13.35 D(x): 0.50 D(G(z)): 0.10 / 0.46 | Acc 42.2 / 51.7\n",
      "[0/2][410/782] Loss_D: 2.20 Loss_G: 14.82 D(x): 0.95 D(G(z)): 0.63 / 0.13 | Acc 60.9 / 51.7\n",
      "[0/2][411/782] Loss_D: 1.70 Loss_G: 14.91 D(x): 0.81 D(G(z)): 0.28 / 0.12 | Acc 65.6 / 51.8\n",
      "[0/2][412/782] Loss_D: 1.87 Loss_G: 13.53 D(x): 0.76 D(G(z)): 0.28 / 0.37 | Acc 56.2 / 51.8\n",
      "[0/2][413/782] Loss_D: 2.03 Loss_G: 14.84 D(x): 0.87 D(G(z)): 0.59 / 0.14 | Acc 73.4 / 51.8\n",
      "[0/2][414/782] Loss_D: 1.84 Loss_G: 14.04 D(x): 0.74 D(G(z)): 0.28 / 0.23 | Acc 53.1 / 51.8\n",
      "[0/2][415/782] Loss_D: 1.94 Loss_G: 14.23 D(x): 0.83 D(G(z)): 0.42 / 0.18 | Acc 62.5 / 51.9\n",
      "[0/2][416/782] Loss_D: 1.98 Loss_G: 14.26 D(x): 0.76 D(G(z)): 0.37 / 0.21 | Acc 64.1 / 51.9\n",
      "[0/2][417/782] Loss_D: 1.82 Loss_G: 14.26 D(x): 0.81 D(G(z)): 0.40 / 0.21 | Acc 65.6 / 51.9\n",
      "[0/2][418/782] Loss_D: 1.86 Loss_G: 14.26 D(x): 0.78 D(G(z)): 0.41 / 0.18 | Acc 70.3 / 52.0\n",
      "semi Test: [0/157]\t Prec@1 54.688 (54.688)\n",
      "semi Test: [50/157]\t Prec@1 43.750 (49.112)\n",
      "semi Test: [100/157]\t Prec@1 35.938 (48.948)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (48.810)\n",
      "semi Test Prec@1 48.61\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (47.365)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (47.184)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (46.999)\n",
      "sup Test Prec@1 46.84\n",
      "[0/2][419/782] Loss_D: 1.81 Loss_G: 13.95 D(x): 0.75 D(G(z)): 0.33 / 0.23 | Acc 73.4 / 52.0\n",
      "[0/2][420/782] Loss_D: 1.86 Loss_G: 14.12 D(x): 0.75 D(G(z)): 0.45 / 0.18 | Acc 75.0 / 52.1\n",
      "[0/2][421/782] Loss_D: 1.84 Loss_G: 14.18 D(x): 0.78 D(G(z)): 0.37 / 0.20 | Acc 60.9 / 52.1\n",
      "[0/2][422/782] Loss_D: 2.07 Loss_G: 13.50 D(x): 0.70 D(G(z)): 0.42 / 0.31 | Acc 62.5 / 52.1\n",
      "[0/2][423/782] Loss_D: 2.03 Loss_G: 14.67 D(x): 0.86 D(G(z)): 0.52 / 0.10 | Acc 70.3 / 52.2\n",
      "[0/2][424/782] Loss_D: 1.88 Loss_G: 13.61 D(x): 0.70 D(G(z)): 0.27 / 0.31 | Acc 64.1 / 52.2\n",
      "[0/2][425/782] Loss_D: 1.64 Loss_G: 14.89 D(x): 0.87 D(G(z)): 0.52 / 0.09 | Acc 84.4 / 52.3\n",
      "[0/2][426/782] Loss_D: 2.03 Loss_G: 13.12 D(x): 0.64 D(G(z)): 0.23 / 0.48 | Acc 48.4 / 52.3\n",
      "[0/2][427/782] Loss_D: 2.13 Loss_G: 15.05 D(x): 0.92 D(G(z)): 0.66 / 0.06 | Acc 71.9 / 52.3\n",
      "[0/2][428/782] Loss_D: 1.93 Loss_G: 13.15 D(x): 0.60 D(G(z)): 0.17 / 0.34 | Acc 56.2 / 52.3\n",
      "semi Test: [0/157]\t Prec@1 54.688 (54.688)\n",
      "semi Test: [50/157]\t Prec@1 45.312 (47.794)\n",
      "semi Test: [100/157]\t Prec@1 35.938 (47.509)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (47.651)\n",
      "semi Test Prec@1 47.45\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (47.426)\n",
      "sup Test: [100/157]\t Prec@1 39.062 (47.710)\n",
      "sup Test: [150/157]\t Prec@1 50.000 (47.341)\n",
      "sup Test Prec@1 47.25\n",
      "[0/2][429/782] Loss_D: 2.07 Loss_G: 14.66 D(x): 0.92 D(G(z)): 0.56 / 0.11 | Acc 60.9 / 52.3\n",
      "[0/2][430/782] Loss_D: 2.05 Loss_G: 13.43 D(x): 0.65 D(G(z)): 0.25 / 0.40 | Acc 59.4 / 52.3\n",
      "[0/2][431/782] Loss_D: 2.19 Loss_G: 14.90 D(x): 0.91 D(G(z)): 0.60 / 0.09 | Acc 70.3 / 52.4\n",
      "[0/2][432/782] Loss_D: 1.87 Loss_G: 13.63 D(x): 0.73 D(G(z)): 0.21 / 0.26 | Acc 53.1 / 52.4\n",
      "[0/2][433/782] Loss_D: 1.79 Loss_G: 13.89 D(x): 0.82 D(G(z)): 0.41 / 0.21 | Acc 65.6 / 52.4\n",
      "[0/2][434/782] Loss_D: 1.68 Loss_G: 14.31 D(x): 0.84 D(G(z)): 0.39 / 0.14 | Acc 64.1 / 52.4\n",
      "[0/2][435/782] Loss_D: 1.80 Loss_G: 13.81 D(x): 0.79 D(G(z)): 0.29 / 0.20 | Acc 64.1 / 52.5\n",
      "[0/2][436/782] Loss_D: 1.86 Loss_G: 14.01 D(x): 0.77 D(G(z)): 0.39 / 0.19 | Acc 71.9 / 52.5\n",
      "[0/2][437/782] Loss_D: 1.66 Loss_G: 14.26 D(x): 0.77 D(G(z)): 0.36 / 0.17 | Acc 81.2 / 52.6\n",
      "[0/2][438/782] Loss_D: 2.06 Loss_G: 13.30 D(x): 0.78 D(G(z)): 0.36 / 0.31 | Acc 53.1 / 52.6\n",
      "semi Test: [0/157]\t Prec@1 50.000 (50.000)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (47.365)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (47.246)\n",
      "semi Test: [150/157]\t Prec@1 40.625 (47.868)\n",
      "semi Test Prec@1 47.76\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 48.438 (47.917)\n",
      "sup Test: [100/157]\t Prec@1 42.188 (47.912)\n",
      "sup Test: [150/157]\t Prec@1 50.000 (47.351)\n",
      "sup Test Prec@1 47.26\n",
      "[0/2][439/782] Loss_D: 2.01 Loss_G: 14.05 D(x): 0.76 D(G(z)): 0.49 / 0.20 | Acc 73.4 / 52.6\n",
      "[0/2][440/782] Loss_D: 1.61 Loss_G: 14.39 D(x): 0.83 D(G(z)): 0.36 / 0.12 | Acc 68.8 / 52.7\n",
      "[0/2][441/782] Loss_D: 1.83 Loss_G: 12.77 D(x): 0.71 D(G(z)): 0.25 / 0.46 | Acc 59.4 / 52.7\n",
      "[0/2][442/782] Loss_D: 2.03 Loss_G: 15.03 D(x): 0.92 D(G(z)): 0.64 / 0.06 | Acc 76.6 / 52.7\n",
      "[0/2][443/782] Loss_D: 2.60 Loss_G: 12.48 D(x): 0.60 D(G(z)): 0.14 / 0.71 | Acc 29.7 / 52.7\n",
      "[0/2][444/782] Loss_D: 2.82 Loss_G: 14.50 D(x): 0.95 D(G(z)): 0.81 / 0.11 | Acc 78.1 / 52.7\n",
      "[0/2][445/782] Loss_D: 1.86 Loss_G: 13.59 D(x): 0.73 D(G(z)): 0.21 / 0.23 | Acc 57.8 / 52.8\n",
      "[0/2][446/782] Loss_D: 1.70 Loss_G: 13.36 D(x): 0.83 D(G(z)): 0.39 / 0.26 | Acc 73.4 / 52.8\n",
      "[0/2][447/782] Loss_D: 1.82 Loss_G: 14.07 D(x): 0.84 D(G(z)): 0.43 / 0.17 | Acc 65.6 / 52.8\n",
      "[0/2][448/782] Loss_D: 1.77 Loss_G: 13.34 D(x): 0.73 D(G(z)): 0.30 / 0.30 | Acc 70.3 / 52.9\n",
      "semi Test: [0/157]\t Prec@1 53.125 (53.125)\n",
      "semi Test: [50/157]\t Prec@1 45.312 (48.131)\n",
      "semi Test: [100/157]\t Prec@1 43.750 (48.205)\n",
      "semi Test: [150/157]\t Prec@1 50.000 (48.541)\n",
      "semi Test Prec@1 48.42\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 50.000 (47.518)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.004)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (47.599)\n",
      "sup Test Prec@1 47.60\n",
      "[0/2][449/782] Loss_D: 1.65 Loss_G: 14.52 D(x): 0.90 D(G(z)): 0.48 / 0.11 | Acc 79.7 / 52.9\n",
      "[0/2][450/782] Loss_D: 1.85 Loss_G: 13.07 D(x): 0.69 D(G(z)): 0.23 / 0.37 | Acc 60.9 / 52.9\n",
      "[0/2][451/782] Loss_D: 1.87 Loss_G: 14.07 D(x): 0.89 D(G(z)): 0.54 / 0.15 | Acc 76.6 / 53.0\n",
      "[0/2][452/782] Loss_D: 1.72 Loss_G: 13.16 D(x): 0.74 D(G(z)): 0.27 / 0.31 | Acc 57.8 / 53.0\n",
      "[0/2][453/782] Loss_D: 1.68 Loss_G: 13.87 D(x): 0.86 D(G(z)): 0.47 / 0.17 | Acc 76.6 / 53.1\n",
      "[0/2][454/782] Loss_D: 1.85 Loss_G: 13.49 D(x): 0.77 D(G(z)): 0.32 / 0.25 | Acc 64.1 / 53.1\n",
      "[0/2][455/782] Loss_D: 1.62 Loss_G: 13.81 D(x): 0.83 D(G(z)): 0.47 / 0.16 | Acc 79.7 / 53.1\n",
      "[0/2][456/782] Loss_D: 1.84 Loss_G: 12.84 D(x): 0.66 D(G(z)): 0.31 / 0.38 | Acc 64.1 / 53.2\n",
      "[0/2][457/782] Loss_D: 1.72 Loss_G: 14.34 D(x): 0.87 D(G(z)): 0.54 / 0.11 | Acc 85.9 / 53.2\n",
      "[0/2][458/782] Loss_D: 1.99 Loss_G: 12.66 D(x): 0.66 D(G(z)): 0.20 / 0.40 | Acc 48.4 / 53.2\n",
      "semi Test: [0/157]\t Prec@1 50.000 (50.000)\n",
      "semi Test: [50/157]\t Prec@1 45.312 (49.020)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (48.963)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (48.976)\n",
      "semi Test Prec@1 48.95\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (47.518)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (47.695)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (47.216)\n",
      "sup Test Prec@1 47.16\n",
      "[0/2][459/782] Loss_D: 1.86 Loss_G: 14.26 D(x): 0.91 D(G(z)): 0.57 / 0.11 | Acc 82.8 / 53.3\n",
      "[0/2][460/782] Loss_D: 1.69 Loss_G: 13.29 D(x): 0.74 D(G(z)): 0.24 / 0.23 | Acc 67.2 / 53.3\n",
      "[0/2][461/782] Loss_D: 1.75 Loss_G: 13.76 D(x): 0.85 D(G(z)): 0.43 / 0.19 | Acc 73.4 / 53.4\n",
      "[0/2][462/782] Loss_D: 1.64 Loss_G: 13.91 D(x): 0.83 D(G(z)): 0.37 / 0.16 | Acc 70.3 / 53.4\n",
      "[0/2][463/782] Loss_D: 1.73 Loss_G: 12.95 D(x): 0.76 D(G(z)): 0.34 / 0.27 | Acc 71.9 / 53.4\n",
      "[0/2][464/782] Loss_D: 1.72 Loss_G: 13.99 D(x): 0.84 D(G(z)): 0.46 / 0.16 | Acc 75.0 / 53.5\n",
      "[0/2][465/782] Loss_D: 2.11 Loss_G: 12.63 D(x): 0.71 D(G(z)): 0.31 / 0.46 | Acc 51.6 / 53.5\n",
      "[0/2][466/782] Loss_D: 2.04 Loss_G: 14.69 D(x): 0.90 D(G(z)): 0.65 / 0.06 | Acc 78.1 / 53.5\n",
      "[0/2][467/782] Loss_D: 2.09 Loss_G: 12.69 D(x): 0.58 D(G(z)): 0.13 / 0.46 | Acc 50.0 / 53.5\n",
      "[0/2][468/782] Loss_D: 1.91 Loss_G: 14.57 D(x): 0.95 D(G(z)): 0.64 / 0.08 | Acc 81.2 / 53.6\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 45.312 (47.580)\n",
      "semi Test: [100/157]\t Prec@1 45.312 (48.422)\n",
      "semi Test: [150/157]\t Prec@1 48.438 (48.179)\n",
      "semi Test Prec@1 47.94\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 48.438 (47.028)\n",
      "sup Test: [100/157]\t Prec@1 48.438 (47.602)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (47.289)\n",
      "sup Test Prec@1 47.11\n",
      "[0/2][469/782] Loss_D: 1.69 Loss_G: 13.23 D(x): 0.71 D(G(z)): 0.17 / 0.25 | Acc 62.5 / 53.6\n",
      "[0/2][470/782] Loss_D: 1.69 Loss_G: 13.83 D(x): 0.86 D(G(z)): 0.44 / 0.16 | Acc 76.6 / 53.7\n",
      "[0/2][471/782] Loss_D: 1.59 Loss_G: 13.66 D(x): 0.79 D(G(z)): 0.31 / 0.16 | Acc 78.1 / 53.7\n",
      "[0/2][472/782] Loss_D: 1.54 Loss_G: 13.36 D(x): 0.79 D(G(z)): 0.34 / 0.22 | Acc 73.4 / 53.8\n",
      "[0/2][473/782] Loss_D: 1.74 Loss_G: 13.66 D(x): 0.79 D(G(z)): 0.44 / 0.15 | Acc 75.0 / 53.8\n",
      "[0/2][474/782] Loss_D: 1.87 Loss_G: 12.71 D(x): 0.71 D(G(z)): 0.31 / 0.40 | Acc 57.8 / 53.8\n",
      "[0/2][475/782] Loss_D: 2.01 Loss_G: 14.26 D(x): 0.88 D(G(z)): 0.59 / 0.09 | Acc 71.9 / 53.8\n",
      "[0/2][476/782] Loss_D: 1.79 Loss_G: 12.76 D(x): 0.62 D(G(z)): 0.19 / 0.35 | Acc 67.2 / 53.9\n",
      "[0/2][477/782] Loss_D: 2.00 Loss_G: 13.43 D(x): 0.88 D(G(z)): 0.50 / 0.21 | Acc 65.6 / 53.9\n",
      "[0/2][478/782] Loss_D: 1.97 Loss_G: 13.39 D(x): 0.76 D(G(z)): 0.36 / 0.21 | Acc 54.7 / 53.9\n",
      "semi Test: [0/157]\t Prec@1 51.562 (51.562)\n",
      "semi Test: [50/157]\t Prec@1 53.125 (48.866)\n",
      "semi Test: [100/157]\t Prec@1 45.312 (48.933)\n",
      "semi Test: [150/157]\t Prec@1 48.438 (48.965)\n",
      "semi Test Prec@1 48.79\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (47.733)\n",
      "sup Test: [100/157]\t Prec@1 39.062 (47.819)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (47.289)\n",
      "sup Test Prec@1 47.19\n",
      "[0/2][479/782] Loss_D: 1.59 Loss_G: 13.28 D(x): 0.78 D(G(z)): 0.38 / 0.20 | Acc 79.7 / 54.0\n",
      "[0/2][480/782] Loss_D: 1.79 Loss_G: 13.20 D(x): 0.78 D(G(z)): 0.35 / 0.25 | Acc 64.1 / 54.0\n",
      "[0/2][481/782] Loss_D: 1.80 Loss_G: 14.07 D(x): 0.85 D(G(z)): 0.45 / 0.13 | Acc 68.8 / 54.0\n",
      "[0/2][482/782] Loss_D: 2.04 Loss_G: 12.71 D(x): 0.70 D(G(z)): 0.27 / 0.39 | Acc 51.6 / 54.0\n",
      "[0/2][483/782] Loss_D: 1.82 Loss_G: 14.06 D(x): 0.88 D(G(z)): 0.56 / 0.12 | Acc 78.1 / 54.0\n",
      "[0/2][484/782] Loss_D: 1.83 Loss_G: 12.75 D(x): 0.68 D(G(z)): 0.26 / 0.33 | Acc 54.7 / 54.0\n",
      "[0/2][485/782] Loss_D: 1.86 Loss_G: 13.87 D(x): 0.85 D(G(z)): 0.53 / 0.14 | Acc 81.2 / 54.1\n",
      "[0/2][486/782] Loss_D: 1.72 Loss_G: 13.16 D(x): 0.74 D(G(z)): 0.28 / 0.25 | Acc 60.9 / 54.1\n",
      "[0/2][487/782] Loss_D: 1.63 Loss_G: 14.02 D(x): 0.85 D(G(z)): 0.44 / 0.14 | Acc 78.1 / 54.2\n",
      "[0/2][488/782] Loss_D: 1.53 Loss_G: 13.08 D(x): 0.78 D(G(z)): 0.28 / 0.23 | Acc 71.9 / 54.2\n",
      "semi Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "semi Test: [50/157]\t Prec@1 43.750 (46.538)\n",
      "semi Test: [100/157]\t Prec@1 40.625 (46.999)\n",
      "semi Test: [150/157]\t Prec@1 42.188 (47.134)\n",
      "semi Test Prec@1 46.93\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (47.151)\n",
      "sup Test: [100/157]\t Prec@1 39.062 (47.092)\n",
      "sup Test: [150/157]\t Prec@1 45.312 (46.834)\n",
      "sup Test Prec@1 46.75\n",
      "[0/2][489/782] Loss_D: 1.99 Loss_G: 13.57 D(x): 0.79 D(G(z)): 0.43 / 0.19 | Acc 64.1 / 54.2\n",
      "[0/2][490/782] Loss_D: 2.07 Loss_G: 13.33 D(x): 0.76 D(G(z)): 0.36 / 0.24 | Acc 59.4 / 54.2\n",
      "[0/2][491/782] Loss_D: 1.71 Loss_G: 14.15 D(x): 0.84 D(G(z)): 0.43 / 0.11 | Acc 70.3 / 54.3\n",
      "[0/2][492/782] Loss_D: 1.65 Loss_G: 12.79 D(x): 0.72 D(G(z)): 0.23 / 0.37 | Acc 57.8 / 54.3\n",
      "[0/2][493/782] Loss_D: 1.93 Loss_G: 14.56 D(x): 0.91 D(G(z)): 0.56 / 0.06 | Acc 70.3 / 54.3\n",
      "[0/2][494/782] Loss_D: 2.21 Loss_G: 11.95 D(x): 0.66 D(G(z)): 0.15 / 0.71 | Acc 35.9 / 54.3\n",
      "[0/2][495/782] Loss_D: 2.95 Loss_G: 14.65 D(x): 0.97 D(G(z)): 0.81 / 0.06 | Acc 70.3 / 54.3\n",
      "[0/2][496/782] Loss_D: 1.80 Loss_G: 13.22 D(x): 0.65 D(G(z)): 0.15 / 0.26 | Acc 54.7 / 54.3\n",
      "[0/2][497/782] Loss_D: 1.82 Loss_G: 12.90 D(x): 0.87 D(G(z)): 0.44 / 0.25 | Acc 71.9 / 54.3\n",
      "[0/2][498/782] Loss_D: 1.67 Loss_G: 13.60 D(x): 0.87 D(G(z)): 0.43 / 0.13 | Acc 82.8 / 54.4\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (47.089)\n",
      "semi Test: [100/157]\t Prec@1 43.750 (47.293)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (47.672)\n",
      "semi Test Prec@1 47.48\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 48.438 (47.212)\n",
      "sup Test: [100/157]\t Prec@1 42.188 (47.447)\n",
      "sup Test: [150/157]\t Prec@1 42.188 (47.061)\n",
      "sup Test Prec@1 46.84\n",
      "[0/2][499/782] Loss_D: 1.84 Loss_G: 12.40 D(x): 0.67 D(G(z)): 0.28 / 0.41 | Acc 60.9 / 54.4\n",
      "[0/2][500/782] Loss_D: 2.11 Loss_G: 13.99 D(x): 0.91 D(G(z)): 0.60 / 0.10 | Acc 65.6 / 54.4\n",
      "[0/2][501/782] Loss_D: 2.24 Loss_G: 12.54 D(x): 0.61 D(G(z)): 0.20 / 0.39 | Acc 46.9 / 54.4\n",
      "[0/2][502/782] Loss_D: 1.91 Loss_G: 13.47 D(x): 0.89 D(G(z)): 0.54 / 0.13 | Acc 76.6 / 54.5\n",
      "[0/2][503/782] Loss_D: 1.59 Loss_G: 13.17 D(x): 0.80 D(G(z)): 0.23 / 0.19 | Acc 59.4 / 54.5\n",
      "[0/2][504/782] Loss_D: 1.68 Loss_G: 13.12 D(x): 0.83 D(G(z)): 0.33 / 0.18 | Acc 73.4 / 54.5\n",
      "[0/2][505/782] Loss_D: 1.56 Loss_G: 13.42 D(x): 0.82 D(G(z)): 0.31 / 0.18 | Acc 67.2 / 54.5\n",
      "[0/2][506/782] Loss_D: 1.39 Loss_G: 13.14 D(x): 0.84 D(G(z)): 0.32 / 0.20 | Acc 67.2 / 54.6\n",
      "[0/2][507/782] Loss_D: 1.65 Loss_G: 13.16 D(x): 0.87 D(G(z)): 0.38 / 0.16 | Acc 64.1 / 54.6\n",
      "[0/2][508/782] Loss_D: 1.72 Loss_G: 12.62 D(x): 0.72 D(G(z)): 0.31 / 0.29 | Acc 70.3 / 54.6\n",
      "semi Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "semi Test: [50/157]\t Prec@1 50.000 (48.407)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (48.639)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (48.913)\n",
      "semi Test Prec@1 48.71\n",
      "sup Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "sup Test: [50/157]\t Prec@1 45.312 (47.580)\n",
      "sup Test: [100/157]\t Prec@1 43.750 (47.587)\n",
      "sup Test: [150/157]\t Prec@1 46.875 (46.958)\n",
      "sup Test Prec@1 46.85\n",
      "[0/2][509/782] Loss_D: 1.62 Loss_G: 13.62 D(x): 0.85 D(G(z)): 0.47 / 0.12 | Acc 79.7 / 54.7\n",
      "[0/2][510/782] Loss_D: 1.85 Loss_G: 12.36 D(x): 0.71 D(G(z)): 0.24 / 0.41 | Acc 62.5 / 54.7\n",
      "[0/2][511/782] Loss_D: 1.55 Loss_G: 13.92 D(x): 0.92 D(G(z)): 0.54 / 0.09 | Acc 84.4 / 54.7\n",
      "[0/2][512/782] Loss_D: 1.84 Loss_G: 12.38 D(x): 0.72 D(G(z)): 0.19 / 0.41 | Acc 51.6 / 54.7\n",
      "[0/2][513/782] Loss_D: 1.90 Loss_G: 13.75 D(x): 0.90 D(G(z)): 0.60 / 0.12 | Acc 79.7 / 54.8\n",
      "[0/2][514/782] Loss_D: 1.51 Loss_G: 12.88 D(x): 0.74 D(G(z)): 0.22 / 0.23 | Acc 79.7 / 54.8\n",
      "[0/2][515/782] Loss_D: 1.70 Loss_G: 12.64 D(x): 0.81 D(G(z)): 0.41 / 0.25 | Acc 71.9 / 54.9\n",
      "[0/2][516/782] Loss_D: 1.42 Loss_G: 13.31 D(x): 0.81 D(G(z)): 0.40 / 0.16 | Acc 87.5 / 54.9\n",
      "[0/2][517/782] Loss_D: 1.58 Loss_G: 12.22 D(x): 0.70 D(G(z)): 0.29 / 0.36 | Acc 76.6 / 55.0\n",
      "[0/2][518/782] Loss_D: 1.76 Loss_G: 13.63 D(x): 0.87 D(G(z)): 0.50 / 0.11 | Acc 73.4 / 55.0\n",
      "semi Test: [0/157]\t Prec@1 37.500 (37.500)\n",
      "semi Test: [50/157]\t Prec@1 46.875 (46.569)\n",
      "semi Test: [100/157]\t Prec@1 45.312 (46.782)\n",
      "semi Test: [150/157]\t Prec@1 42.188 (46.606)\n",
      "semi Test Prec@1 46.44\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 50.000 (47.825)\n",
      "sup Test: [100/157]\t Prec@1 48.438 (48.082)\n",
      "sup Test: [150/157]\t Prec@1 50.000 (47.672)\n",
      "sup Test Prec@1 47.60\n",
      "[0/2][519/782] Loss_D: 1.85 Loss_G: 12.09 D(x): 0.63 D(G(z)): 0.23 / 0.45 | Acc 59.4 / 55.0\n",
      "[0/2][520/782] Loss_D: 2.07 Loss_G: 13.94 D(x): 0.94 D(G(z)): 0.60 / 0.08 | Acc 75.0 / 55.0\n",
      "[0/2][521/782] Loss_D: 1.72 Loss_G: 12.28 D(x): 0.58 D(G(z)): 0.18 / 0.43 | Acc 70.3 / 55.1\n",
      "[0/2][522/782] Loss_D: 1.82 Loss_G: 13.75 D(x): 0.92 D(G(z)): 0.62 / 0.11 | Acc 84.4 / 55.1\n",
      "[0/2][523/782] Loss_D: 1.77 Loss_G: 12.09 D(x): 0.66 D(G(z)): 0.24 / 0.41 | Acc 67.2 / 55.1\n",
      "[0/2][524/782] Loss_D: 2.06 Loss_G: 13.48 D(x): 0.87 D(G(z)): 0.61 / 0.13 | Acc 70.3 / 55.2\n",
      "[0/2][525/782] Loss_D: 1.86 Loss_G: 12.59 D(x): 0.67 D(G(z)): 0.24 / 0.34 | Acc 60.9 / 55.2\n",
      "[0/2][526/782] Loss_D: 1.83 Loss_G: 13.17 D(x): 0.86 D(G(z)): 0.52 / 0.16 | Acc 75.0 / 55.2\n",
      "[0/2][527/782] Loss_D: 2.00 Loss_G: 12.60 D(x): 0.73 D(G(z)): 0.28 / 0.29 | Acc 56.2 / 55.2\n",
      "[0/2][528/782] Loss_D: 1.61 Loss_G: 13.63 D(x): 0.89 D(G(z)): 0.48 / 0.12 | Acc 78.1 / 55.3\n",
      "semi Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "semi Test: [50/157]\t Prec@1 42.188 (49.203)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (49.737)\n",
      "semi Test: [150/157]\t Prec@1 48.438 (49.545)\n",
      "semi Test Prec@1 49.40\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (48.039)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (48.453)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (47.930)\n",
      "sup Test Prec@1 47.83\n",
      "[0/2][529/782] Loss_D: 1.59 Loss_G: 12.55 D(x): 0.71 D(G(z)): 0.24 / 0.30 | Acc 68.8 / 55.3\n",
      "[0/2][530/782] Loss_D: 1.51 Loss_G: 13.22 D(x): 0.86 D(G(z)): 0.47 / 0.14 | Acc 87.5 / 55.4\n",
      "[0/2][531/782] Loss_D: 1.89 Loss_G: 12.29 D(x): 0.77 D(G(z)): 0.29 / 0.32 | Acc 51.6 / 55.4\n",
      "[0/2][532/782] Loss_D: 1.78 Loss_G: 13.39 D(x): 0.86 D(G(z)): 0.50 / 0.11 | Acc 81.2 / 55.4\n",
      "[0/2][533/782] Loss_D: 1.71 Loss_G: 11.95 D(x): 0.66 D(G(z)): 0.24 / 0.41 | Acc 67.2 / 55.4\n",
      "[0/2][534/782] Loss_D: 1.71 Loss_G: 14.12 D(x): 0.91 D(G(z)): 0.62 / 0.06 | Acc 92.2 / 55.5\n",
      "[0/2][535/782] Loss_D: 2.26 Loss_G: 11.45 D(x): 0.57 D(G(z)): 0.14 / 0.58 | Acc 39.1 / 55.5\n",
      "[0/2][536/782] Loss_D: 2.34 Loss_G: 13.67 D(x): 0.94 D(G(z)): 0.72 / 0.09 | Acc 79.7 / 55.5\n",
      "[0/2][537/782] Loss_D: 1.62 Loss_G: 12.65 D(x): 0.70 D(G(z)): 0.21 / 0.24 | Acc 71.9 / 55.5\n",
      "[0/2][538/782] Loss_D: 1.62 Loss_G: 12.95 D(x): 0.86 D(G(z)): 0.43 / 0.16 | Acc 75.0 / 55.6\n",
      "semi Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (48.499)\n",
      "semi Test: [100/157]\t Prec@1 40.625 (48.979)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (49.172)\n",
      "semi Test Prec@1 48.99\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 50.000 (48.162)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.453)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (48.055)\n",
      "sup Test Prec@1 47.90\n",
      "[0/2][539/782] Loss_D: 1.58 Loss_G: 12.90 D(x): 0.75 D(G(z)): 0.36 / 0.20 | Acc 78.1 / 55.6\n",
      "[0/2][540/782] Loss_D: 1.69 Loss_G: 13.04 D(x): 0.83 D(G(z)): 0.39 / 0.17 | Acc 76.6 / 55.7\n",
      "[0/2][541/782] Loss_D: 1.74 Loss_G: 12.67 D(x): 0.77 D(G(z)): 0.36 / 0.23 | Acc 68.8 / 55.7\n",
      "[0/2][542/782] Loss_D: 1.71 Loss_G: 12.69 D(x): 0.79 D(G(z)): 0.42 / 0.19 | Acc 76.6 / 55.7\n",
      "[0/2][543/782] Loss_D: 1.52 Loss_G: 12.80 D(x): 0.79 D(G(z)): 0.35 / 0.16 | Acc 79.7 / 55.8\n",
      "[0/2][544/782] Loss_D: 1.49 Loss_G: 12.38 D(x): 0.78 D(G(z)): 0.29 / 0.25 | Acc 75.0 / 55.8\n",
      "[0/2][545/782] Loss_D: 1.56 Loss_G: 13.58 D(x): 0.87 D(G(z)): 0.44 / 0.09 | Acc 79.7 / 55.8\n",
      "[0/2][546/782] Loss_D: 1.59 Loss_G: 12.26 D(x): 0.70 D(G(z)): 0.22 / 0.38 | Acc 68.8 / 55.9\n",
      "[0/2][547/782] Loss_D: 1.88 Loss_G: 13.63 D(x): 0.87 D(G(z)): 0.57 / 0.10 | Acc 78.1 / 55.9\n",
      "[0/2][548/782] Loss_D: 1.78 Loss_G: 12.22 D(x): 0.70 D(G(z)): 0.27 / 0.30 | Acc 56.2 / 55.9\n",
      "semi Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "semi Test: [50/157]\t Prec@1 53.125 (48.223)\n",
      "semi Test: [100/157]\t Prec@1 40.625 (48.236)\n",
      "semi Test: [150/157]\t Prec@1 37.500 (48.200)\n",
      "semi Test Prec@1 48.12\n",
      "sup Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "sup Test: [50/157]\t Prec@1 50.000 (48.407)\n",
      "sup Test: [100/157]\t Prec@1 43.750 (48.530)\n",
      "sup Test: [150/157]\t Prec@1 46.875 (48.168)\n",
      "sup Test Prec@1 48.09\n",
      "[0/2][549/782] Loss_D: 1.94 Loss_G: 13.06 D(x): 0.79 D(G(z)): 0.49 / 0.15 | Acc 73.4 / 55.9\n",
      "[0/2][550/782] Loss_D: 1.66 Loss_G: 12.54 D(x): 0.76 D(G(z)): 0.29 / 0.23 | Acc 73.4 / 56.0\n",
      "[0/2][551/782] Loss_D: 1.50 Loss_G: 13.03 D(x): 0.81 D(G(z)): 0.44 / 0.13 | Acc 87.5 / 56.0\n",
      "[0/2][552/782] Loss_D: 1.75 Loss_G: 12.01 D(x): 0.74 D(G(z)): 0.25 / 0.38 | Acc 53.1 / 56.0\n",
      "[0/2][553/782] Loss_D: 1.61 Loss_G: 14.17 D(x): 0.93 D(G(z)): 0.59 / 0.05 | Acc 84.4 / 56.1\n",
      "[0/2][554/782] Loss_D: 1.63 Loss_G: 11.61 D(x): 0.67 D(G(z)): 0.11 / 0.37 | Acc 62.5 / 56.1\n",
      "[0/2][555/782] Loss_D: 1.42 Loss_G: 13.47 D(x): 0.93 D(G(z)): 0.53 / 0.09 | Acc 92.2 / 56.1\n",
      "[0/2][556/782] Loss_D: 1.76 Loss_G: 12.04 D(x): 0.72 D(G(z)): 0.22 / 0.36 | Acc 57.8 / 56.1\n",
      "[0/2][557/782] Loss_D: 1.82 Loss_G: 13.32 D(x): 0.92 D(G(z)): 0.49 / 0.10 | Acc 78.1 / 56.2\n",
      "[0/2][558/782] Loss_D: 1.57 Loss_G: 12.26 D(x): 0.72 D(G(z)): 0.26 / 0.26 | Acc 65.6 / 56.2\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 45.312 (48.499)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (48.623)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (48.562)\n",
      "semi Test Prec@1 48.39\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 46.875 (47.273)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (47.695)\n",
      "sup Test: [150/157]\t Prec@1 45.312 (47.423)\n",
      "sup Test Prec@1 47.35\n",
      "[0/2][559/782] Loss_D: 1.67 Loss_G: 12.90 D(x): 0.87 D(G(z)): 0.42 / 0.15 | Acc 68.8 / 56.2\n",
      "[0/2][560/782] Loss_D: 1.62 Loss_G: 12.61 D(x): 0.77 D(G(z)): 0.31 / 0.20 | Acc 73.4 / 56.3\n",
      "[0/2][561/782] Loss_D: 1.63 Loss_G: 12.05 D(x): 0.80 D(G(z)): 0.32 / 0.28 | Acc 75.0 / 56.3\n",
      "[0/2][562/782] Loss_D: 1.49 Loss_G: 12.97 D(x): 0.85 D(G(z)): 0.43 / 0.11 | Acc 85.9 / 56.3\n",
      "[0/2][563/782] Loss_D: 1.49 Loss_G: 11.54 D(x): 0.67 D(G(z)): 0.20 / 0.47 | Acc 78.1 / 56.4\n",
      "[0/2][564/782] Loss_D: 2.03 Loss_G: 14.08 D(x): 0.94 D(G(z)): 0.63 / 0.05 | Acc 78.1 / 56.4\n",
      "[0/2][565/782] Loss_D: 2.01 Loss_G: 11.32 D(x): 0.47 D(G(z)): 0.10 / 0.61 | Acc 64.1 / 56.4\n",
      "[0/2][566/782] Loss_D: 2.51 Loss_G: 13.63 D(x): 0.98 D(G(z)): 0.75 / 0.08 | Acc 71.9 / 56.5\n",
      "[0/2][567/782] Loss_D: 1.70 Loss_G: 12.23 D(x): 0.60 D(G(z)): 0.17 / 0.28 | Acc 64.1 / 56.5\n",
      "[0/2][568/782] Loss_D: 1.56 Loss_G: 12.66 D(x): 0.88 D(G(z)): 0.44 / 0.15 | Acc 75.0 / 56.5\n",
      "semi Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "semi Test: [50/157]\t Prec@1 53.125 (49.479)\n",
      "semi Test: [100/157]\t Prec@1 48.438 (49.830)\n",
      "semi Test: [150/157]\t Prec@1 51.562 (49.741)\n",
      "semi Test Prec@1 49.58\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 50.000 (47.518)\n",
      "sup Test: [100/157]\t Prec@1 43.750 (47.649)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (47.310)\n",
      "sup Test Prec@1 47.17\n",
      "[0/2][569/782] Loss_D: 1.80 Loss_G: 12.23 D(x): 0.76 D(G(z)): 0.32 / 0.23 | Acc 59.4 / 56.5\n",
      "[0/2][570/782] Loss_D: 1.74 Loss_G: 12.13 D(x): 0.78 D(G(z)): 0.41 / 0.26 | Acc 75.0 / 56.5\n",
      "[0/2][571/782] Loss_D: 1.70 Loss_G: 12.57 D(x): 0.79 D(G(z)): 0.43 / 0.17 | Acc 71.9 / 56.6\n",
      "[0/2][572/782] Loss_D: 1.50 Loss_G: 12.15 D(x): 0.75 D(G(z)): 0.31 / 0.27 | Acc 76.6 / 56.6\n",
      "[0/2][573/782] Loss_D: 1.49 Loss_G: 12.57 D(x): 0.81 D(G(z)): 0.44 / 0.16 | Acc 89.1 / 56.7\n",
      "[0/2][574/782] Loss_D: 1.70 Loss_G: 12.09 D(x): 0.73 D(G(z)): 0.30 / 0.29 | Acc 68.8 / 56.7\n",
      "[0/2][575/782] Loss_D: 1.89 Loss_G: 12.90 D(x): 0.84 D(G(z)): 0.49 / 0.15 | Acc 73.4 / 56.7\n",
      "[0/2][576/782] Loss_D: 1.66 Loss_G: 11.92 D(x): 0.71 D(G(z)): 0.28 / 0.30 | Acc 68.8 / 56.7\n",
      "[0/2][577/782] Loss_D: 1.57 Loss_G: 13.33 D(x): 0.87 D(G(z)): 0.48 / 0.09 | Acc 81.2 / 56.8\n",
      "[0/2][578/782] Loss_D: 1.67 Loss_G: 11.27 D(x): 0.60 D(G(z)): 0.19 / 0.49 | Acc 70.3 / 56.8\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 50.000 (48.866)\n",
      "semi Test: [100/157]\t Prec@1 45.312 (48.855)\n",
      "semi Test: [150/157]\t Prec@1 40.625 (49.193)\n",
      "semi Test Prec@1 48.95\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 46.875 (47.886)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.004)\n",
      "sup Test: [150/157]\t Prec@1 46.875 (47.496)\n",
      "sup Test Prec@1 47.41\n",
      "[0/2][579/782] Loss_D: 1.94 Loss_G: 13.63 D(x): 0.88 D(G(z)): 0.64 / 0.07 | Acc 79.7 / 56.8\n",
      "[0/2][580/782] Loss_D: 1.99 Loss_G: 11.31 D(x): 0.65 D(G(z)): 0.15 / 0.52 | Acc 35.9 / 56.8\n",
      "[0/2][581/782] Loss_D: 1.96 Loss_G: 13.41 D(x): 0.92 D(G(z)): 0.67 / 0.08 | Acc 85.9 / 56.9\n",
      "[0/2][582/782] Loss_D: 1.64 Loss_G: 12.07 D(x): 0.65 D(G(z)): 0.19 / 0.24 | Acc 67.2 / 56.9\n",
      "[0/2][583/782] Loss_D: 1.65 Loss_G: 12.31 D(x): 0.81 D(G(z)): 0.42 / 0.23 | Acc 76.6 / 56.9\n",
      "[0/2][584/782] Loss_D: 1.69 Loss_G: 12.63 D(x): 0.77 D(G(z)): 0.40 / 0.18 | Acc 76.6 / 56.9\n",
      "[0/2][585/782] Loss_D: 1.71 Loss_G: 11.97 D(x): 0.74 D(G(z)): 0.36 / 0.26 | Acc 73.4 / 57.0\n",
      "[0/2][586/782] Loss_D: 1.46 Loss_G: 12.63 D(x): 0.82 D(G(z)): 0.42 / 0.16 | Acc 87.5 / 57.0\n",
      "[0/2][587/782] Loss_D: 1.58 Loss_G: 11.99 D(x): 0.70 D(G(z)): 0.32 / 0.29 | Acc 75.0 / 57.0\n",
      "[0/2][588/782] Loss_D: 1.69 Loss_G: 13.15 D(x): 0.82 D(G(z)): 0.49 / 0.09 | Acc 78.1 / 57.1\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (49.295)\n",
      "semi Test: [100/157]\t Prec@1 46.875 (49.613)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (49.803)\n",
      "semi Test Prec@1 49.64\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.009)\n",
      "sup Test: [100/157]\t Prec@1 40.625 (48.360)\n",
      "sup Test: [150/157]\t Prec@1 45.312 (47.837)\n",
      "sup Test Prec@1 47.71\n",
      "[0/2][589/782] Loss_D: 1.79 Loss_G: 11.28 D(x): 0.60 D(G(z)): 0.21 / 0.51 | Acc 67.2 / 57.1\n",
      "[0/2][590/782] Loss_D: 1.86 Loss_G: 13.61 D(x): 0.93 D(G(z)): 0.66 / 0.06 | Acc 90.6 / 57.2\n",
      "[0/2][591/782] Loss_D: 2.03 Loss_G: 10.96 D(x): 0.52 D(G(z)): 0.13 / 0.61 | Acc 57.8 / 57.2\n",
      "[0/2][592/782] Loss_D: 2.33 Loss_G: 13.10 D(x): 0.94 D(G(z)): 0.75 / 0.11 | Acc 85.9 / 57.2\n",
      "[0/2][593/782] Loss_D: 1.70 Loss_G: 11.93 D(x): 0.62 D(G(z)): 0.21 / 0.27 | Acc 67.2 / 57.2\n",
      "[0/2][594/782] Loss_D: 1.60 Loss_G: 11.86 D(x): 0.80 D(G(z)): 0.41 / 0.32 | Acc 75.0 / 57.3\n",
      "[0/2][595/782] Loss_D: 1.55 Loss_G: 12.68 D(x): 0.81 D(G(z)): 0.47 / 0.13 | Acc 84.4 / 57.3\n",
      "[0/2][596/782] Loss_D: 1.61 Loss_G: 11.55 D(x): 0.70 D(G(z)): 0.25 / 0.33 | Acc 73.4 / 57.3\n",
      "[0/2][597/782] Loss_D: 1.47 Loss_G: 12.09 D(x): 0.85 D(G(z)): 0.47 / 0.20 | Acc 93.8 / 57.4\n",
      "[0/2][598/782] Loss_D: 1.75 Loss_G: 12.13 D(x): 0.78 D(G(z)): 0.35 / 0.22 | Acc 71.9 / 57.4\n",
      "semi Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (50.306)\n",
      "semi Test: [100/157]\t Prec@1 45.312 (50.511)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (50.517)\n",
      "semi Test Prec@1 50.40\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (47.426)\n",
      "sup Test: [100/157]\t Prec@1 40.625 (47.850)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (47.165)\n",
      "sup Test Prec@1 47.02\n",
      "[0/2][599/782] Loss_D: 1.60 Loss_G: 11.58 D(x): 0.73 D(G(z)): 0.35 / 0.33 | Acc 79.7 / 57.5\n",
      "[0/2][600/782] Loss_D: 1.61 Loss_G: 12.56 D(x): 0.84 D(G(z)): 0.47 / 0.13 | Acc 84.4 / 57.5\n",
      "[0/2][601/782] Loss_D: 1.74 Loss_G: 10.98 D(x): 0.61 D(G(z)): 0.26 / 0.48 | Acc 73.4 / 57.5\n",
      "[0/2][602/782] Loss_D: 1.94 Loss_G: 13.11 D(x): 0.94 D(G(z)): 0.60 / 0.09 | Acc 78.1 / 57.6\n",
      "[0/2][603/782] Loss_D: 1.99 Loss_G: 11.33 D(x): 0.58 D(G(z)): 0.18 / 0.44 | Acc 57.8 / 57.6\n",
      "[0/2][604/782] Loss_D: 1.90 Loss_G: 12.35 D(x): 0.85 D(G(z)): 0.59 / 0.15 | Acc 79.7 / 57.6\n",
      "[0/2][605/782] Loss_D: 1.52 Loss_G: 11.57 D(x): 0.72 D(G(z)): 0.28 / 0.30 | Acc 70.3 / 57.6\n",
      "[0/2][606/782] Loss_D: 1.70 Loss_G: 12.10 D(x): 0.81 D(G(z)): 0.48 / 0.21 | Acc 76.6 / 57.6\n",
      "[0/2][607/782] Loss_D: 1.53 Loss_G: 11.63 D(x): 0.77 D(G(z)): 0.36 / 0.27 | Acc 75.0 / 57.7\n",
      "[0/2][608/782] Loss_D: 1.42 Loss_G: 12.23 D(x): 0.81 D(G(z)): 0.43 / 0.19 | Acc 87.5 / 57.7\n",
      "semi Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "semi Test: [50/157]\t Prec@1 46.875 (49.020)\n",
      "semi Test: [100/157]\t Prec@1 43.750 (49.041)\n",
      "semi Test: [150/157]\t Prec@1 51.562 (49.369)\n",
      "semi Test Prec@1 49.22\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 48.438 (47.978)\n",
      "sup Test: [100/157]\t Prec@1 40.625 (48.407)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (47.868)\n",
      "sup Test Prec@1 47.74\n",
      "[0/2][609/782] Loss_D: 1.46 Loss_G: 11.77 D(x): 0.79 D(G(z)): 0.30 / 0.25 | Acc 68.8 / 57.7\n",
      "[0/2][610/782] Loss_D: 1.64 Loss_G: 12.17 D(x): 0.83 D(G(z)): 0.42 / 0.18 | Acc 78.1 / 57.8\n",
      "[0/2][611/782] Loss_D: 1.52 Loss_G: 11.72 D(x): 0.70 D(G(z)): 0.33 / 0.28 | Acc 78.1 / 57.8\n",
      "[0/2][612/782] Loss_D: 1.51 Loss_G: 12.25 D(x): 0.79 D(G(z)): 0.42 / 0.18 | Acc 82.8 / 57.8\n",
      "[0/2][613/782] Loss_D: 1.44 Loss_G: 12.17 D(x): 0.79 D(G(z)): 0.33 / 0.20 | Acc 79.7 / 57.9\n",
      "[0/2][614/782] Loss_D: 1.76 Loss_G: 11.41 D(x): 0.74 D(G(z)): 0.37 / 0.34 | Acc 68.8 / 57.9\n",
      "[0/2][615/782] Loss_D: 1.60 Loss_G: 12.90 D(x): 0.84 D(G(z)): 0.51 / 0.11 | Acc 84.4 / 57.9\n",
      "[0/2][616/782] Loss_D: 1.48 Loss_G: 12.07 D(x): 0.78 D(G(z)): 0.28 / 0.19 | Acc 70.3 / 58.0\n",
      "[0/2][617/782] Loss_D: 1.79 Loss_G: 11.46 D(x): 0.69 D(G(z)): 0.40 / 0.39 | Acc 76.6 / 58.0\n",
      "[0/2][618/782] Loss_D: 1.96 Loss_G: 12.94 D(x): 0.84 D(G(z)): 0.60 / 0.08 | Acc 79.7 / 58.0\n",
      "semi Test: [0/157]\t Prec@1 54.688 (54.688)\n",
      "semi Test: [50/157]\t Prec@1 39.062 (48.928)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (49.459)\n",
      "semi Test: [150/157]\t Prec@1 48.438 (49.762)\n",
      "semi Test Prec@1 49.67\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 50.000 (48.039)\n",
      "sup Test: [100/157]\t Prec@1 43.750 (48.391)\n",
      "sup Test: [150/157]\t Prec@1 50.000 (48.034)\n",
      "sup Test Prec@1 47.94\n",
      "[0/2][619/782] Loss_D: 2.17 Loss_G: 10.55 D(x): 0.55 D(G(z)): 0.20 / 0.71 | Acc 48.4 / 58.0\n",
      "[0/2][620/782] Loss_D: 2.54 Loss_G: 13.06 D(x): 0.96 D(G(z)): 0.80 / 0.08 | Acc 84.4 / 58.1\n",
      "[0/2][621/782] Loss_D: 1.74 Loss_G: 11.38 D(x): 0.59 D(G(z)): 0.18 / 0.37 | Acc 65.6 / 58.1\n",
      "[0/2][622/782] Loss_D: 1.81 Loss_G: 12.19 D(x): 0.87 D(G(z)): 0.58 / 0.18 | Acc 85.9 / 58.1\n",
      "[0/2][623/782] Loss_D: 1.52 Loss_G: 11.97 D(x): 0.71 D(G(z)): 0.35 / 0.25 | Acc 79.7 / 58.1\n",
      "[0/2][624/782] Loss_D: 1.84 Loss_G: 11.82 D(x): 0.75 D(G(z)): 0.44 / 0.27 | Acc 79.7 / 58.2\n",
      "[0/2][625/782] Loss_D: 1.59 Loss_G: 12.29 D(x): 0.77 D(G(z)): 0.46 / 0.17 | Acc 84.4 / 58.2\n",
      "[0/2][626/782] Loss_D: 1.73 Loss_G: 11.25 D(x): 0.64 D(G(z)): 0.34 / 0.39 | Acc 68.8 / 58.2\n",
      "[0/2][627/782] Loss_D: 2.04 Loss_G: 12.23 D(x): 0.80 D(G(z)): 0.56 / 0.18 | Acc 75.0 / 58.3\n",
      "[0/2][628/782] Loss_D: 1.64 Loss_G: 11.96 D(x): 0.73 D(G(z)): 0.34 / 0.19 | Acc 76.6 / 58.3\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 40.625 (48.805)\n",
      "semi Test: [100/157]\t Prec@1 43.750 (49.288)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (49.307)\n",
      "semi Test Prec@1 49.19\n",
      "sup Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "sup Test: [50/157]\t Prec@1 50.000 (48.039)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.391)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (47.972)\n",
      "sup Test Prec@1 47.85\n",
      "[0/2][629/782] Loss_D: 1.72 Loss_G: 11.02 D(x): 0.67 D(G(z)): 0.37 / 0.40 | Acc 76.6 / 58.3\n",
      "[0/2][630/782] Loss_D: 1.80 Loss_G: 12.63 D(x): 0.82 D(G(z)): 0.59 / 0.10 | Acc 84.4 / 58.4\n",
      "[0/2][631/782] Loss_D: 2.23 Loss_G: 10.53 D(x): 0.43 D(G(z)): 0.20 / 0.72 | Acc 71.9 / 58.4\n",
      "[0/2][632/782] Loss_D: 2.68 Loss_G: 12.92 D(x): 0.94 D(G(z)): 0.82 / 0.08 | Acc 84.4 / 58.4\n",
      "[0/2][633/782] Loss_D: 1.97 Loss_G: 11.06 D(x): 0.54 D(G(z)): 0.18 / 0.44 | Acc 59.4 / 58.4\n",
      "[0/2][634/782] Loss_D: 1.94 Loss_G: 11.94 D(x): 0.93 D(G(z)): 0.61 / 0.17 | Acc 81.2 / 58.5\n",
      "[0/2][635/782] Loss_D: 1.47 Loss_G: 11.76 D(x): 0.75 D(G(z)): 0.30 / 0.26 | Acc 76.6 / 58.5\n",
      "[0/2][636/782] Loss_D: 1.65 Loss_G: 11.46 D(x): 0.74 D(G(z)): 0.45 / 0.27 | Acc 84.4 / 58.5\n",
      "[0/2][637/782] Loss_D: 1.98 Loss_G: 11.55 D(x): 0.68 D(G(z)): 0.40 / 0.32 | Acc 68.8 / 58.6\n",
      "[0/2][638/782] Loss_D: 1.64 Loss_G: 11.79 D(x): 0.84 D(G(z)): 0.45 / 0.19 | Acc 79.7 / 58.6\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 43.750 (48.775)\n",
      "semi Test: [100/157]\t Prec@1 46.875 (48.933)\n",
      "semi Test: [150/157]\t Prec@1 43.750 (49.255)\n",
      "semi Test Prec@1 49.16\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (47.733)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (48.267)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (47.982)\n",
      "sup Test Prec@1 47.86\n",
      "[0/2][639/782] Loss_D: 1.63 Loss_G: 11.32 D(x): 0.67 D(G(z)): 0.31 / 0.35 | Acc 76.6 / 58.6\n",
      "[0/2][640/782] Loss_D: 1.61 Loss_G: 12.50 D(x): 0.87 D(G(z)): 0.51 / 0.12 | Acc 87.5 / 58.7\n",
      "[0/2][641/782] Loss_D: 1.89 Loss_G: 11.34 D(x): 0.70 D(G(z)): 0.24 / 0.33 | Acc 54.7 / 58.7\n",
      "[0/2][642/782] Loss_D: 1.74 Loss_G: 11.61 D(x): 0.80 D(G(z)): 0.51 / 0.27 | Acc 84.4 / 58.7\n",
      "[0/2][643/782] Loss_D: 1.43 Loss_G: 12.12 D(x): 0.82 D(G(z)): 0.42 / 0.14 | Acc 84.4 / 58.7\n",
      "[0/2][644/782] Loss_D: 1.57 Loss_G: 11.17 D(x): 0.67 D(G(z)): 0.28 / 0.34 | Acc 73.4 / 58.8\n",
      "[0/2][645/782] Loss_D: 1.64 Loss_G: 11.47 D(x): 0.78 D(G(z)): 0.50 / 0.27 | Acc 89.1 / 58.8\n",
      "[0/2][646/782] Loss_D: 1.67 Loss_G: 11.87 D(x): 0.73 D(G(z)): 0.42 / 0.24 | Acc 79.7 / 58.8\n",
      "[0/2][647/782] Loss_D: 1.59 Loss_G: 11.61 D(x): 0.76 D(G(z)): 0.38 / 0.22 | Acc 76.6 / 58.9\n",
      "[0/2][648/782] Loss_D: 1.64 Loss_G: 11.92 D(x): 0.78 D(G(z)): 0.41 / 0.17 | Acc 76.6 / 58.9\n",
      "semi Test: [0/157]\t Prec@1 35.938 (35.938)\n",
      "semi Test: [50/157]\t Prec@1 43.750 (48.866)\n",
      "semi Test: [100/157]\t Prec@1 43.750 (49.196)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (49.389)\n",
      "semi Test Prec@1 49.25\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.192)\n",
      "sup Test: [100/157]\t Prec@1 43.750 (48.252)\n",
      "sup Test: [150/157]\t Prec@1 54.688 (47.837)\n",
      "sup Test Prec@1 47.69\n",
      "[0/2][649/782] Loss_D: 1.54 Loss_G: 10.91 D(x): 0.71 D(G(z)): 0.33 / 0.39 | Acc 79.7 / 58.9\n",
      "[0/2][650/782] Loss_D: 1.94 Loss_G: 11.61 D(x): 0.78 D(G(z)): 0.57 / 0.20 | Acc 84.4 / 59.0\n",
      "[0/2][651/782] Loss_D: 1.73 Loss_G: 10.98 D(x): 0.65 D(G(z)): 0.35 / 0.37 | Acc 75.0 / 59.0\n",
      "[0/2][652/782] Loss_D: 1.93 Loss_G: 12.10 D(x): 0.83 D(G(z)): 0.57 / 0.15 | Acc 84.4 / 59.0\n",
      "[0/2][653/782] Loss_D: 1.51 Loss_G: 11.17 D(x): 0.66 D(G(z)): 0.28 / 0.35 | Acc 75.0 / 59.0\n",
      "[0/2][654/782] Loss_D: 1.65 Loss_G: 11.47 D(x): 0.75 D(G(z)): 0.50 / 0.25 | Acc 82.8 / 59.1\n",
      "[0/2][655/782] Loss_D: 1.29 Loss_G: 12.11 D(x): 0.79 D(G(z)): 0.40 / 0.14 | Acc 90.6 / 59.1\n",
      "[0/2][656/782] Loss_D: 1.74 Loss_G: 10.86 D(x): 0.69 D(G(z)): 0.28 / 0.47 | Acc 62.5 / 59.1\n",
      "[0/2][657/782] Loss_D: 1.89 Loss_G: 12.34 D(x): 0.87 D(G(z)): 0.62 / 0.12 | Acc 85.9 / 59.2\n",
      "[0/2][658/782] Loss_D: 2.10 Loss_G: 10.36 D(x): 0.50 D(G(z)): 0.26 / 0.63 | Acc 62.5 / 59.2\n",
      "semi Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "semi Test: [50/157]\t Prec@1 50.000 (48.591)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (48.654)\n",
      "semi Test: [150/157]\t Prec@1 43.750 (48.665)\n",
      "semi Test Prec@1 48.44\n",
      "sup Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (48.744)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (48.855)\n",
      "sup Test: [150/157]\t Prec@1 56.250 (48.189)\n",
      "sup Test Prec@1 48.04\n",
      "[0/2][659/782] Loss_D: 2.25 Loss_G: 12.33 D(x): 0.93 D(G(z)): 0.73 / 0.12 | Acc 81.2 / 59.2\n",
      "[0/2][660/782] Loss_D: 2.16 Loss_G: 10.63 D(x): 0.52 D(G(z)): 0.24 / 0.56 | Acc 62.5 / 59.2\n",
      "[0/2][661/782] Loss_D: 2.09 Loss_G: 12.06 D(x): 0.90 D(G(z)): 0.69 / 0.15 | Acc 81.2 / 59.3\n",
      "[0/2][662/782] Loss_D: 1.93 Loss_G: 11.06 D(x): 0.60 D(G(z)): 0.25 / 0.37 | Acc 62.5 / 59.3\n",
      "[0/2][663/782] Loss_D: 1.46 Loss_G: 11.54 D(x): 0.86 D(G(z)): 0.50 / 0.22 | Acc 89.1 / 59.3\n",
      "[0/2][664/782] Loss_D: 1.46 Loss_G: 11.67 D(x): 0.76 D(G(z)): 0.35 / 0.21 | Acc 79.7 / 59.3\n",
      "[0/2][665/782] Loss_D: 1.81 Loss_G: 10.77 D(x): 0.71 D(G(z)): 0.35 / 0.38 | Acc 68.8 / 59.3\n",
      "[0/2][666/782] Loss_D: 1.70 Loss_G: 11.81 D(x): 0.88 D(G(z)): 0.54 / 0.16 | Acc 79.7 / 59.4\n",
      "[0/2][667/782] Loss_D: 1.58 Loss_G: 10.97 D(x): 0.68 D(G(z)): 0.29 / 0.37 | Acc 70.3 / 59.4\n",
      "[0/2][668/782] Loss_D: 1.74 Loss_G: 11.76 D(x): 0.85 D(G(z)): 0.54 / 0.18 | Acc 81.2 / 59.4\n",
      "semi Test: [0/157]\t Prec@1 37.500 (37.500)\n",
      "semi Test: [50/157]\t Prec@1 56.250 (48.652)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (49.010)\n",
      "semi Test: [150/157]\t Prec@1 43.750 (49.058)\n",
      "semi Test Prec@1 48.84\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (48.039)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.314)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.013)\n",
      "sup Test Prec@1 47.96\n",
      "[0/2][669/782] Loss_D: 1.59 Loss_G: 10.72 D(x): 0.62 D(G(z)): 0.29 / 0.40 | Acc 82.8 / 59.5\n",
      "[0/2][670/782] Loss_D: 1.77 Loss_G: 11.85 D(x): 0.86 D(G(z)): 0.56 / 0.18 | Acc 81.2 / 59.5\n",
      "[0/2][671/782] Loss_D: 1.63 Loss_G: 11.26 D(x): 0.70 D(G(z)): 0.32 / 0.31 | Acc 75.0 / 59.5\n",
      "[0/2][672/782] Loss_D: 1.83 Loss_G: 10.95 D(x): 0.80 D(G(z)): 0.46 / 0.29 | Acc 67.2 / 59.5\n",
      "[0/2][673/782] Loss_D: 1.48 Loss_G: 11.73 D(x): 0.81 D(G(z)): 0.44 / 0.21 | Acc 84.4 / 59.6\n",
      "[0/2][674/782] Loss_D: 1.80 Loss_G: 10.80 D(x): 0.68 D(G(z)): 0.36 / 0.40 | Acc 70.3 / 59.6\n",
      "[0/2][675/782] Loss_D: 1.74 Loss_G: 11.65 D(x): 0.82 D(G(z)): 0.55 / 0.18 | Acc 85.9 / 59.6\n",
      "[0/2][676/782] Loss_D: 1.93 Loss_G: 10.67 D(x): 0.63 D(G(z)): 0.30 / 0.45 | Acc 65.6 / 59.6\n",
      "[0/2][677/782] Loss_D: 1.89 Loss_G: 11.80 D(x): 0.88 D(G(z)): 0.61 / 0.15 | Acc 82.8 / 59.7\n",
      "[0/2][678/782] Loss_D: 1.60 Loss_G: 11.23 D(x): 0.64 D(G(z)): 0.27 / 0.29 | Acc 75.0 / 59.7\n",
      "semi Test: [0/157]\t Prec@1 37.500 (37.500)\n",
      "semi Test: [50/157]\t Prec@1 60.938 (48.866)\n",
      "semi Test: [100/157]\t Prec@1 40.625 (49.087)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (49.224)\n",
      "semi Test Prec@1 48.92\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.591)\n",
      "sup Test: [100/157]\t Prec@1 43.750 (49.010)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.675)\n",
      "sup Test Prec@1 48.57\n",
      "[0/2][679/782] Loss_D: 1.59 Loss_G: 11.54 D(x): 0.82 D(G(z)): 0.47 / 0.21 | Acc 81.2 / 59.7\n",
      "[0/2][680/782] Loss_D: 1.55 Loss_G: 10.94 D(x): 0.74 D(G(z)): 0.37 / 0.28 | Acc 75.0 / 59.7\n",
      "[0/2][681/782] Loss_D: 1.64 Loss_G: 11.61 D(x): 0.78 D(G(z)): 0.43 / 0.19 | Acc 84.4 / 59.8\n",
      "[0/2][682/782] Loss_D: 1.61 Loss_G: 11.19 D(x): 0.74 D(G(z)): 0.33 / 0.28 | Acc 68.8 / 59.8\n",
      "[0/2][683/782] Loss_D: 1.52 Loss_G: 11.45 D(x): 0.79 D(G(z)): 0.43 / 0.23 | Acc 84.4 / 59.8\n",
      "[0/2][684/782] Loss_D: 1.69 Loss_G: 10.88 D(x): 0.72 D(G(z)): 0.38 / 0.36 | Acc 64.1 / 59.8\n",
      "[0/2][685/782] Loss_D: 1.53 Loss_G: 12.30 D(x): 0.87 D(G(z)): 0.52 / 0.11 | Acc 89.1 / 59.9\n",
      "[0/2][686/782] Loss_D: 2.08 Loss_G: 10.13 D(x): 0.51 D(G(z)): 0.22 / 0.76 | Acc 59.4 / 59.9\n",
      "[0/2][687/782] Loss_D: 2.63 Loss_G: 12.62 D(x): 0.95 D(G(z)): 0.82 / 0.09 | Acc 87.5 / 59.9\n",
      "[0/2][688/782] Loss_D: 2.20 Loss_G: 10.53 D(x): 0.50 D(G(z)): 0.18 / 0.48 | Acc 59.4 / 59.9\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 57.812 (48.192)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (48.670)\n",
      "semi Test: [150/157]\t Prec@1 50.000 (48.634)\n",
      "semi Test Prec@1 48.49\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.254)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.670)\n",
      "sup Test: [150/157]\t Prec@1 56.250 (48.189)\n",
      "sup Test Prec@1 48.06\n",
      "[0/2][689/782] Loss_D: 1.89 Loss_G: 11.82 D(x): 0.86 D(G(z)): 0.64 / 0.18 | Acc 84.4 / 60.0\n",
      "[0/2][690/782] Loss_D: 1.73 Loss_G: 11.17 D(x): 0.69 D(G(z)): 0.32 / 0.31 | Acc 71.9 / 60.0\n",
      "[0/2][691/782] Loss_D: 1.72 Loss_G: 11.25 D(x): 0.79 D(G(z)): 0.46 / 0.28 | Acc 78.1 / 60.0\n",
      "[0/2][692/782] Loss_D: 1.53 Loss_G: 11.51 D(x): 0.82 D(G(z)): 0.42 / 0.17 | Acc 78.1 / 60.0\n",
      "[0/2][693/782] Loss_D: 1.66 Loss_G: 10.49 D(x): 0.64 D(G(z)): 0.29 / 0.50 | Acc 75.0 / 60.0\n",
      "[0/2][694/782] Loss_D: 1.90 Loss_G: 11.85 D(x): 0.88 D(G(z)): 0.64 / 0.15 | Acc 82.8 / 60.1\n",
      "[0/2][695/782] Loss_D: 1.72 Loss_G: 10.38 D(x): 0.57 D(G(z)): 0.25 / 0.45 | Acc 67.2 / 60.1\n",
      "[0/2][696/782] Loss_D: 1.85 Loss_G: 11.20 D(x): 0.80 D(G(z)): 0.59 / 0.23 | Acc 81.2 / 60.1\n",
      "[0/2][697/782] Loss_D: 1.53 Loss_G: 11.39 D(x): 0.77 D(G(z)): 0.36 / 0.23 | Acc 76.6 / 60.1\n",
      "[0/2][698/782] Loss_D: 1.48 Loss_G: 10.90 D(x): 0.75 D(G(z)): 0.36 / 0.32 | Acc 78.1 / 60.2\n",
      "semi Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "semi Test: [50/157]\t Prec@1 57.812 (50.061)\n",
      "semi Test: [100/157]\t Prec@1 43.750 (50.325)\n",
      "semi Test: [150/157]\t Prec@1 40.625 (50.548)\n",
      "semi Test Prec@1 50.41\n",
      "sup Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (48.346)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.855)\n",
      "sup Test: [150/157]\t Prec@1 54.688 (48.365)\n",
      "sup Test Prec@1 48.27\n",
      "[0/2][699/782] Loss_D: 1.68 Loss_G: 11.06 D(x): 0.72 D(G(z)): 0.44 / 0.27 | Acc 84.4 / 60.2\n",
      "[0/2][700/782] Loss_D: 1.49 Loss_G: 11.36 D(x): 0.75 D(G(z)): 0.43 / 0.20 | Acc 87.5 / 60.2\n",
      "[0/2][701/782] Loss_D: 1.54 Loss_G: 10.98 D(x): 0.74 D(G(z)): 0.32 / 0.31 | Acc 76.6 / 60.3\n",
      "[0/2][702/782] Loss_D: 1.37 Loss_G: 11.48 D(x): 0.82 D(G(z)): 0.45 / 0.20 | Acc 89.1 / 60.3\n",
      "[0/2][703/782] Loss_D: 1.61 Loss_G: 10.69 D(x): 0.71 D(G(z)): 0.33 / 0.37 | Acc 71.9 / 60.3\n",
      "[0/2][704/782] Loss_D: 1.72 Loss_G: 11.41 D(x): 0.80 D(G(z)): 0.52 / 0.20 | Acc 78.1 / 60.3\n",
      "[0/2][705/782] Loss_D: 1.66 Loss_G: 10.64 D(x): 0.67 D(G(z)): 0.32 / 0.38 | Acc 75.0 / 60.4\n",
      "[0/2][706/782] Loss_D: 1.70 Loss_G: 11.97 D(x): 0.84 D(G(z)): 0.54 / 0.14 | Acc 84.4 / 60.4\n",
      "[0/2][707/782] Loss_D: 1.62 Loss_G: 10.34 D(x): 0.62 D(G(z)): 0.25 / 0.47 | Acc 79.7 / 60.4\n",
      "[0/2][708/782] Loss_D: 1.78 Loss_G: 12.06 D(x): 0.90 D(G(z)): 0.62 / 0.11 | Acc 85.9 / 60.5\n",
      "semi Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (48.805)\n",
      "semi Test: [100/157]\t Prec@1 40.625 (49.381)\n",
      "semi Test: [150/157]\t Prec@1 43.750 (49.503)\n",
      "semi Test Prec@1 49.34\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 50.000 (48.407)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.087)\n",
      "sup Test: [150/157]\t Prec@1 54.688 (48.707)\n",
      "sup Test Prec@1 48.56\n",
      "[0/2][709/782] Loss_D: 1.56 Loss_G: 10.56 D(x): 0.58 D(G(z)): 0.22 / 0.40 | Acc 78.1 / 60.5\n",
      "[0/2][710/782] Loss_D: 1.77 Loss_G: 11.32 D(x): 0.83 D(G(z)): 0.55 / 0.20 | Acc 84.4 / 60.5\n",
      "[0/2][711/782] Loss_D: 1.43 Loss_G: 11.67 D(x): 0.77 D(G(z)): 0.36 / 0.16 | Acc 82.8 / 60.6\n",
      "[0/2][712/782] Loss_D: 1.47 Loss_G: 10.70 D(x): 0.71 D(G(z)): 0.29 / 0.36 | Acc 75.0 / 60.6\n",
      "[0/2][713/782] Loss_D: 1.67 Loss_G: 11.95 D(x): 0.86 D(G(z)): 0.56 / 0.13 | Acc 85.9 / 60.6\n",
      "[0/2][714/782] Loss_D: 1.70 Loss_G: 10.37 D(x): 0.63 D(G(z)): 0.26 / 0.43 | Acc 71.9 / 60.6\n",
      "[0/2][715/782] Loss_D: 1.68 Loss_G: 11.84 D(x): 0.87 D(G(z)): 0.58 / 0.13 | Acc 85.9 / 60.7\n",
      "[0/2][716/782] Loss_D: 1.69 Loss_G: 10.62 D(x): 0.63 D(G(z)): 0.27 / 0.40 | Acc 70.3 / 60.7\n",
      "[0/2][717/782] Loss_D: 1.76 Loss_G: 11.88 D(x): 0.87 D(G(z)): 0.60 / 0.10 | Acc 89.1 / 60.7\n",
      "[0/2][718/782] Loss_D: 1.92 Loss_G: 9.92 D(x): 0.53 D(G(z)): 0.22 / 0.61 | Acc 65.6 / 60.7\n",
      "semi Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (48.958)\n",
      "semi Test: [100/157]\t Prec@1 54.688 (49.335)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (49.803)\n",
      "semi Test Prec@1 49.63\n",
      "sup Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.744)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.963)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.562)\n",
      "sup Test Prec@1 48.42\n",
      "[0/2][719/782] Loss_D: 2.24 Loss_G: 11.70 D(x): 0.92 D(G(z)): 0.72 / 0.14 | Acc 84.4 / 60.8\n",
      "[0/2][720/782] Loss_D: 1.81 Loss_G: 10.26 D(x): 0.58 D(G(z)): 0.27 / 0.44 | Acc 68.8 / 60.8\n",
      "[0/2][721/782] Loss_D: 1.59 Loss_G: 11.56 D(x): 0.87 D(G(z)): 0.58 / 0.13 | Acc 90.6 / 60.8\n",
      "[0/2][722/782] Loss_D: 1.44 Loss_G: 10.93 D(x): 0.70 D(G(z)): 0.22 / 0.29 | Acc 73.4 / 60.8\n",
      "[0/2][723/782] Loss_D: 1.50 Loss_G: 11.13 D(x): 0.84 D(G(z)): 0.47 / 0.22 | Acc 89.1 / 60.9\n",
      "[0/2][724/782] Loss_D: 1.74 Loss_G: 10.97 D(x): 0.70 D(G(z)): 0.40 / 0.28 | Acc 76.6 / 60.9\n",
      "[0/2][725/782] Loss_D: 1.64 Loss_G: 11.05 D(x): 0.75 D(G(z)): 0.46 / 0.24 | Acc 84.4 / 60.9\n",
      "[0/2][726/782] Loss_D: 1.71 Loss_G: 10.94 D(x): 0.71 D(G(z)): 0.43 / 0.28 | Acc 76.6 / 60.9\n",
      "[0/2][727/782] Loss_D: 1.76 Loss_G: 11.08 D(x): 0.75 D(G(z)): 0.44 / 0.23 | Acc 78.1 / 61.0\n",
      "[0/2][728/782] Loss_D: 1.80 Loss_G: 10.46 D(x): 0.66 D(G(z)): 0.39 / 0.37 | Acc 78.1 / 61.0\n",
      "semi Test: [0/157]\t Prec@1 37.500 (37.500)\n",
      "semi Test: [50/157]\t Prec@1 56.250 (48.897)\n",
      "semi Test: [100/157]\t Prec@1 50.000 (49.691)\n",
      "semi Test: [150/157]\t Prec@1 48.438 (49.876)\n",
      "semi Test Prec@1 49.70\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (49.081)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.149)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.644)\n",
      "sup Test Prec@1 48.53\n",
      "[0/2][729/782] Loss_D: 1.63 Loss_G: 11.26 D(x): 0.81 D(G(z)): 0.52 / 0.17 | Acc 89.1 / 61.0\n",
      "[0/2][730/782] Loss_D: 1.58 Loss_G: 10.62 D(x): 0.71 D(G(z)): 0.32 / 0.32 | Acc 76.6 / 61.0\n",
      "[0/2][731/782] Loss_D: 1.66 Loss_G: 10.93 D(x): 0.77 D(G(z)): 0.50 / 0.26 | Acc 85.9 / 61.1\n",
      "[0/2][732/782] Loss_D: 1.39 Loss_G: 10.92 D(x): 0.71 D(G(z)): 0.39 / 0.25 | Acc 93.8 / 61.1\n",
      "[0/2][733/782] Loss_D: 1.61 Loss_G: 10.98 D(x): 0.75 D(G(z)): 0.44 / 0.25 | Acc 79.7 / 61.1\n",
      "[0/2][734/782] Loss_D: 1.40 Loss_G: 11.11 D(x): 0.74 D(G(z)): 0.41 / 0.22 | Acc 89.1 / 61.2\n",
      "[0/2][735/782] Loss_D: 1.71 Loss_G: 10.59 D(x): 0.72 D(G(z)): 0.39 / 0.34 | Acc 71.9 / 61.2\n",
      "[0/2][736/782] Loss_D: 1.73 Loss_G: 11.19 D(x): 0.71 D(G(z)): 0.51 / 0.21 | Acc 89.1 / 61.2\n",
      "[0/2][737/782] Loss_D: 1.73 Loss_G: 10.52 D(x): 0.67 D(G(z)): 0.35 / 0.40 | Acc 79.7 / 61.3\n",
      "[0/2][738/782] Loss_D: 1.73 Loss_G: 11.52 D(x): 0.82 D(G(z)): 0.55 / 0.14 | Acc 87.5 / 61.3\n",
      "semi Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "semi Test: [50/157]\t Prec@1 53.125 (49.632)\n",
      "semi Test: [100/157]\t Prec@1 51.562 (50.046)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (50.393)\n",
      "semi Test Prec@1 50.14\n",
      "sup Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (49.081)\n",
      "sup Test: [100/157]\t Prec@1 43.750 (49.056)\n",
      "sup Test: [150/157]\t Prec@1 54.688 (48.634)\n",
      "sup Test Prec@1 48.54\n",
      "[0/2][739/782] Loss_D: 1.55 Loss_G: 10.16 D(x): 0.66 D(G(z)): 0.23 / 0.44 | Acc 73.4 / 61.3\n",
      "[0/2][740/782] Loss_D: 1.70 Loss_G: 11.90 D(x): 0.88 D(G(z)): 0.58 / 0.11 | Acc 85.9 / 61.3\n",
      "[0/2][741/782] Loss_D: 1.55 Loss_G: 10.65 D(x): 0.65 D(G(z)): 0.22 / 0.33 | Acc 76.6 / 61.4\n",
      "[0/2][742/782] Loss_D: 1.62 Loss_G: 11.78 D(x): 0.88 D(G(z)): 0.53 / 0.12 | Acc 82.8 / 61.4\n",
      "[0/2][743/782] Loss_D: 1.52 Loss_G: 10.04 D(x): 0.62 D(G(z)): 0.24 / 0.48 | Acc 78.1 / 61.4\n",
      "[0/2][744/782] Loss_D: 2.06 Loss_G: 11.58 D(x): 0.85 D(G(z)): 0.67 / 0.12 | Acc 89.1 / 61.5\n",
      "[0/2][745/782] Loss_D: 1.81 Loss_G: 10.14 D(x): 0.57 D(G(z)): 0.24 / 0.56 | Acc 67.2 / 61.5\n",
      "[0/2][746/782] Loss_D: 1.84 Loss_G: 11.80 D(x): 0.93 D(G(z)): 0.67 / 0.11 | Acc 90.6 / 61.5\n",
      "[0/2][747/782] Loss_D: 1.77 Loss_G: 10.17 D(x): 0.61 D(G(z)): 0.23 / 0.45 | Acc 64.1 / 61.5\n",
      "[0/2][748/782] Loss_D: 1.72 Loss_G: 11.06 D(x): 0.85 D(G(z)): 0.59 / 0.19 | Acc 90.6 / 61.5\n",
      "semi Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (49.050)\n",
      "semi Test: [100/157]\t Prec@1 43.750 (49.443)\n",
      "semi Test: [150/157]\t Prec@1 50.000 (49.669)\n",
      "semi Test Prec@1 49.51\n",
      "sup Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (48.775)\n",
      "sup Test: [100/157]\t Prec@1 43.750 (49.165)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.634)\n",
      "sup Test Prec@1 48.53\n",
      "[0/2][749/782] Loss_D: 1.70 Loss_G: 10.70 D(x): 0.70 D(G(z)): 0.34 / 0.29 | Acc 75.0 / 61.6\n",
      "[0/2][750/782] Loss_D: 1.68 Loss_G: 10.84 D(x): 0.75 D(G(z)): 0.46 / 0.26 | Acc 81.2 / 61.6\n",
      "[0/2][751/782] Loss_D: 1.49 Loss_G: 11.04 D(x): 0.74 D(G(z)): 0.42 / 0.23 | Acc 85.9 / 61.6\n",
      "[0/2][752/782] Loss_D: 1.36 Loss_G: 11.00 D(x): 0.79 D(G(z)): 0.38 / 0.23 | Acc 84.4 / 61.7\n",
      "[0/2][753/782] Loss_D: 1.67 Loss_G: 10.13 D(x): 0.70 D(G(z)): 0.36 / 0.45 | Acc 76.6 / 61.7\n",
      "[0/2][754/782] Loss_D: 1.63 Loss_G: 11.57 D(x): 0.87 D(G(z)): 0.57 / 0.12 | Acc 92.2 / 61.7\n",
      "[0/2][755/782] Loss_D: 1.94 Loss_G: 9.75 D(x): 0.52 D(G(z)): 0.25 / 0.63 | Acc 65.6 / 61.7\n",
      "[0/2][756/782] Loss_D: 2.21 Loss_G: 11.65 D(x): 0.92 D(G(z)): 0.73 / 0.13 | Acc 84.4 / 61.7\n",
      "[0/2][757/782] Loss_D: 1.60 Loss_G: 10.49 D(x): 0.62 D(G(z)): 0.23 / 0.35 | Acc 73.4 / 61.8\n",
      "[0/2][758/782] Loss_D: 1.62 Loss_G: 10.76 D(x): 0.80 D(G(z)): 0.50 / 0.25 | Acc 87.5 / 61.8\n",
      "semi Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "semi Test: [50/157]\t Prec@1 45.312 (50.827)\n",
      "semi Test: [100/157]\t Prec@1 50.000 (50.758)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (50.900)\n",
      "semi Test Prec@1 50.64\n",
      "sup Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "sup Test: [50/157]\t Prec@1 48.438 (48.376)\n",
      "sup Test: [100/157]\t Prec@1 43.750 (48.468)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.189)\n",
      "sup Test Prec@1 48.08\n",
      "[0/2][759/782] Loss_D: 1.55 Loss_G: 10.87 D(x): 0.74 D(G(z)): 0.42 / 0.24 | Acc 85.9 / 61.8\n",
      "[0/2][760/782] Loss_D: 1.61 Loss_G: 10.60 D(x): 0.66 D(G(z)): 0.38 / 0.29 | Acc 82.8 / 61.9\n",
      "[0/2][761/782] Loss_D: 1.55 Loss_G: 10.71 D(x): 0.72 D(G(z)): 0.44 / 0.28 | Acc 93.8 / 61.9\n",
      "[0/2][762/782] Loss_D: 1.45 Loss_G: 10.78 D(x): 0.76 D(G(z)): 0.42 / 0.23 | Acc 90.6 / 61.9\n",
      "[0/2][763/782] Loss_D: 1.48 Loss_G: 10.66 D(x): 0.79 D(G(z)): 0.40 / 0.25 | Acc 79.7 / 62.0\n",
      "[0/2][764/782] Loss_D: 1.45 Loss_G: 10.91 D(x): 0.77 D(G(z)): 0.39 / 0.22 | Acc 79.7 / 62.0\n",
      "[0/2][765/782] Loss_D: 1.60 Loss_G: 10.43 D(x): 0.73 D(G(z)): 0.39 / 0.33 | Acc 75.0 / 62.0\n",
      "[0/2][766/782] Loss_D: 1.61 Loss_G: 10.91 D(x): 0.77 D(G(z)): 0.47 / 0.23 | Acc 92.2 / 62.0\n",
      "[0/2][767/782] Loss_D: 1.70 Loss_G: 10.08 D(x): 0.66 D(G(z)): 0.35 / 0.47 | Acc 71.9 / 62.1\n",
      "[0/2][768/782] Loss_D: 1.66 Loss_G: 11.67 D(x): 0.87 D(G(z)): 0.61 / 0.11 | Acc 92.2 / 62.1\n",
      "semi Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "semi Test: [50/157]\t Prec@1 50.000 (51.409)\n",
      "semi Test: [100/157]\t Prec@1 54.688 (51.330)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (51.107)\n",
      "semi Test Prec@1 50.83\n",
      "sup Test: [0/157]\t Prec@1 50.000 (50.000)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (49.050)\n",
      "sup Test: [100/157]\t Prec@1 43.750 (49.459)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.965)\n",
      "sup Test Prec@1 48.87\n",
      "[0/2][769/782] Loss_D: 1.45 Loss_G: 10.25 D(x): 0.58 D(G(z)): 0.21 / 0.43 | Acc 85.9 / 62.1\n",
      "[0/2][770/782] Loss_D: 1.58 Loss_G: 11.05 D(x): 0.85 D(G(z)): 0.55 / 0.19 | Acc 90.6 / 62.2\n",
      "[0/2][771/782] Loss_D: 1.40 Loss_G: 10.66 D(x): 0.69 D(G(z)): 0.32 / 0.29 | Acc 85.9 / 62.2\n",
      "[0/2][772/782] Loss_D: 1.41 Loss_G: 10.88 D(x): 0.80 D(G(z)): 0.43 / 0.20 | Acc 89.1 / 62.2\n",
      "[0/2][773/782] Loss_D: 1.37 Loss_G: 10.68 D(x): 0.76 D(G(z)): 0.34 / 0.24 | Acc 85.9 / 62.3\n",
      "[0/2][774/782] Loss_D: 1.56 Loss_G: 10.22 D(x): 0.73 D(G(z)): 0.40 / 0.38 | Acc 85.9 / 62.3\n",
      "[0/2][775/782] Loss_D: 1.60 Loss_G: 11.11 D(x): 0.80 D(G(z)): 0.53 / 0.17 | Acc 90.6 / 62.3\n",
      "[0/2][776/782] Loss_D: 1.65 Loss_G: 9.81 D(x): 0.68 D(G(z)): 0.27 / 0.47 | Acc 68.8 / 62.3\n",
      "[0/2][777/782] Loss_D: 1.77 Loss_G: 11.30 D(x): 0.87 D(G(z)): 0.61 / 0.12 | Acc 84.4 / 62.4\n",
      "[0/2][778/782] Loss_D: 1.90 Loss_G: 9.74 D(x): 0.52 D(G(z)): 0.22 / 0.61 | Acc 64.1 / 62.4\n",
      "semi Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (50.306)\n",
      "semi Test: [100/157]\t Prec@1 45.312 (48.902)\n",
      "semi Test: [150/157]\t Prec@1 48.438 (49.183)\n",
      "semi Test Prec@1 48.96\n",
      "sup Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "sup Test: [50/157]\t Prec@1 50.000 (48.836)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.165)\n",
      "sup Test: [150/157]\t Prec@1 54.688 (48.665)\n",
      "sup Test Prec@1 48.52\n",
      "[0/2][779/782] Loss_D: 1.78 Loss_G: 11.44 D(x): 0.92 D(G(z)): 0.70 / 0.12 | Acc 93.8 / 62.4\n",
      "[0/2][780/782] Loss_D: 1.66 Loss_G: 10.24 D(x): 0.62 D(G(z)): 0.22 / 0.39 | Acc 62.5 / 62.4\n",
      "[0/2][781/782] Loss_D: 1.62 Loss_G: 10.88 D(x): 0.81 D(G(z)): 0.53 / 0.21 | Acc 85.9 / 62.4\n",
      "[1/2][0/782] Loss_D: 1.49 Loss_G: 10.78 D(x): 0.78 D(G(z)): 0.37 / 0.24 | Acc 81.2 / 81.2\n",
      "[1/2][1/782] Loss_D: 1.59 Loss_G: 10.53 D(x): 0.71 D(G(z)): 0.37 / 0.30 | Acc 84.4 / 82.8\n",
      "[1/2][2/782] Loss_D: 1.55 Loss_G: 10.44 D(x): 0.68 D(G(z)): 0.45 / 0.30 | Acc 93.8 / 86.5\n",
      "[1/2][3/782] Loss_D: 1.44 Loss_G: 10.80 D(x): 0.76 D(G(z)): 0.44 / 0.23 | Acc 89.1 / 87.1\n",
      "[1/2][4/782] Loss_D: 1.38 Loss_G: 10.35 D(x): 0.67 D(G(z)): 0.34 / 0.34 | Acc 90.6 / 87.8\n",
      "[1/2][5/782] Loss_D: 1.50 Loss_G: 11.21 D(x): 0.82 D(G(z)): 0.50 / 0.15 | Acc 87.5 / 87.8\n",
      "[1/2][6/782] Loss_D: 1.46 Loss_G: 10.04 D(x): 0.69 D(G(z)): 0.28 / 0.38 | Acc 76.6 / 86.2\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 50.000 (50.858)\n",
      "semi Test: [100/157]\t Prec@1 46.875 (51.037)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (50.797)\n",
      "semi Test Prec@1 50.63\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 48.438 (48.039)\n",
      "sup Test: [100/157]\t Prec@1 43.750 (48.608)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.148)\n",
      "sup Test Prec@1 47.98\n",
      "[1/2][7/782] Loss_D: 1.65 Loss_G: 10.92 D(x): 0.75 D(G(z)): 0.54 / 0.21 | Acc 93.8 / 87.1\n",
      "[1/2][8/782] Loss_D: 1.48 Loss_G: 10.34 D(x): 0.72 D(G(z)): 0.33 / 0.32 | Acc 79.7 / 86.3\n",
      "[1/2][9/782] Loss_D: 1.60 Loss_G: 10.78 D(x): 0.80 D(G(z)): 0.49 / 0.22 | Acc 85.9 / 86.2\n",
      "[1/2][10/782] Loss_D: 1.38 Loss_G: 10.79 D(x): 0.74 D(G(z)): 0.37 / 0.24 | Acc 84.4 / 86.1\n",
      "[1/2][11/782] Loss_D: 1.31 Loss_G: 10.80 D(x): 0.76 D(G(z)): 0.38 / 0.24 | Acc 87.5 / 86.2\n",
      "[1/2][12/782] Loss_D: 1.76 Loss_G: 10.15 D(x): 0.78 D(G(z)): 0.37 / 0.35 | Acc 67.2 / 84.7\n",
      "[1/2][13/782] Loss_D: 1.74 Loss_G: 11.02 D(x): 0.77 D(G(z)): 0.52 / 0.17 | Acc 82.8 / 84.6\n",
      "[1/2][14/782] Loss_D: 1.45 Loss_G: 10.35 D(x): 0.65 D(G(z)): 0.32 / 0.31 | Acc 87.5 / 84.8\n",
      "[1/2][15/782] Loss_D: 1.62 Loss_G: 10.95 D(x): 0.84 D(G(z)): 0.48 / 0.17 | Acc 82.8 / 84.7\n",
      "[1/2][16/782] Loss_D: 1.58 Loss_G: 10.21 D(x): 0.69 D(G(z)): 0.30 / 0.43 | Acc 75.0 / 84.1\n",
      "semi Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (51.164)\n",
      "semi Test: [100/157]\t Prec@1 46.875 (50.804)\n",
      "semi Test: [150/157]\t Prec@1 50.000 (51.097)\n",
      "semi Test Prec@1 50.89\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 50.000 (49.173)\n",
      "sup Test: [100/157]\t Prec@1 43.750 (49.412)\n",
      "sup Test: [150/157]\t Prec@1 54.688 (49.027)\n",
      "sup Test Prec@1 48.94\n",
      "[1/2][17/782] Loss_D: 1.66 Loss_G: 11.91 D(x): 0.87 D(G(z)): 0.61 / 0.08 | Acc 93.8 / 84.6\n",
      "[1/2][18/782] Loss_D: 1.96 Loss_G: 9.29 D(x): 0.49 D(G(z)): 0.16 / 0.69 | Acc 62.5 / 83.5\n",
      "[1/2][19/782] Loss_D: 2.42 Loss_G: 11.53 D(x): 0.95 D(G(z)): 0.79 / 0.09 | Acc 79.7 / 83.3\n",
      "[1/2][20/782] Loss_D: 1.53 Loss_G: 10.49 D(x): 0.62 D(G(z)): 0.21 / 0.31 | Acc 71.9 / 82.7\n",
      "[1/2][21/782] Loss_D: 1.48 Loss_G: 10.55 D(x): 0.78 D(G(z)): 0.47 / 0.26 | Acc 93.8 / 83.2\n",
      "[1/2][22/782] Loss_D: 1.50 Loss_G: 10.77 D(x): 0.75 D(G(z)): 0.44 / 0.22 | Acc 90.6 / 83.6\n",
      "[1/2][23/782] Loss_D: 1.58 Loss_G: 10.43 D(x): 0.72 D(G(z)): 0.37 / 0.28 | Acc 78.1 / 83.3\n",
      "[1/2][24/782] Loss_D: 1.56 Loss_G: 10.28 D(x): 0.78 D(G(z)): 0.46 / 0.26 | Acc 79.7 / 83.2\n",
      "[1/2][25/782] Loss_D: 1.54 Loss_G: 10.53 D(x): 0.72 D(G(z)): 0.42 / 0.26 | Acc 85.9 / 83.3\n",
      "[1/2][26/782] Loss_D: 1.52 Loss_G: 10.45 D(x): 0.73 D(G(z)): 0.42 / 0.31 | Acc 85.9 / 83.4\n",
      "semi Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "semi Test: [50/157]\t Prec@1 59.375 (52.298)\n",
      "semi Test: [100/157]\t Prec@1 43.750 (51.887)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (51.583)\n",
      "semi Test Prec@1 51.40\n",
      "sup Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "sup Test: [50/157]\t Prec@1 50.000 (48.744)\n",
      "sup Test: [100/157]\t Prec@1 43.750 (49.196)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.872)\n",
      "sup Test Prec@1 48.75\n",
      "[1/2][27/782] Loss_D: 1.68 Loss_G: 10.14 D(x): 0.68 D(G(z)): 0.46 / 0.32 | Acc 87.5 / 83.5\n",
      "[1/2][28/782] Loss_D: 1.57 Loss_G: 10.93 D(x): 0.79 D(G(z)): 0.45 / 0.19 | Acc 79.7 / 83.4\n",
      "[1/2][29/782] Loss_D: 1.42 Loss_G: 10.34 D(x): 0.74 D(G(z)): 0.31 / 0.29 | Acc 78.1 / 83.2\n",
      "[1/2][30/782] Loss_D: 1.63 Loss_G: 10.50 D(x): 0.76 D(G(z)): 0.47 / 0.24 | Acc 82.8 / 83.2\n",
      "[1/2][31/782] Loss_D: 1.41 Loss_G: 10.71 D(x): 0.79 D(G(z)): 0.40 / 0.23 | Acc 87.5 / 83.3\n",
      "[1/2][32/782] Loss_D: 1.46 Loss_G: 10.68 D(x): 0.77 D(G(z)): 0.39 / 0.20 | Acc 79.7 / 83.2\n",
      "[1/2][33/782] Loss_D: 1.97 Loss_G: 9.54 D(x): 0.67 D(G(z)): 0.34 / 0.58 | Acc 60.9 / 82.6\n",
      "[1/2][34/782] Loss_D: 2.08 Loss_G: 11.65 D(x): 0.90 D(G(z)): 0.72 / 0.09 | Acc 89.1 / 82.8\n",
      "[1/2][35/782] Loss_D: 1.83 Loss_G: 9.62 D(x): 0.56 D(G(z)): 0.18 / 0.49 | Acc 62.5 / 82.2\n",
      "[1/2][36/782] Loss_D: 1.73 Loss_G: 10.85 D(x): 0.88 D(G(z)): 0.61 / 0.18 | Acc 87.5 / 82.3\n",
      "semi Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "semi Test: [50/157]\t Prec@1 54.688 (50.460)\n",
      "semi Test: [100/157]\t Prec@1 51.562 (50.371)\n",
      "semi Test: [150/157]\t Prec@1 42.188 (50.393)\n",
      "semi Test Prec@1 50.14\n",
      "sup Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (48.560)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.731)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.541)\n",
      "sup Test Prec@1 48.43\n",
      "[1/2][37/782] Loss_D: 1.40 Loss_G: 10.34 D(x): 0.67 D(G(z)): 0.30 / 0.28 | Acc 82.8 / 82.4\n",
      "[1/2][38/782] Loss_D: 1.46 Loss_G: 10.27 D(x): 0.78 D(G(z)): 0.41 / 0.29 | Acc 79.7 / 82.3\n",
      "[1/2][39/782] Loss_D: 1.68 Loss_G: 10.31 D(x): 0.74 D(G(z)): 0.46 / 0.28 | Acc 82.8 / 82.3\n",
      "[1/2][40/782] Loss_D: 1.49 Loss_G: 10.26 D(x): 0.72 D(G(z)): 0.39 / 0.27 | Acc 87.5 / 82.4\n",
      "[1/2][41/782] Loss_D: 1.55 Loss_G: 10.32 D(x): 0.73 D(G(z)): 0.44 / 0.27 | Acc 90.6 / 82.6\n",
      "[1/2][42/782] Loss_D: 1.45 Loss_G: 10.42 D(x): 0.74 D(G(z)): 0.40 / 0.30 | Acc 87.5 / 82.7\n",
      "[1/2][43/782] Loss_D: 1.36 Loss_G: 10.72 D(x): 0.81 D(G(z)): 0.42 / 0.18 | Acc 84.4 / 82.8\n",
      "[1/2][44/782] Loss_D: 1.39 Loss_G: 10.01 D(x): 0.71 D(G(z)): 0.30 / 0.33 | Acc 81.2 / 82.7\n",
      "[1/2][45/782] Loss_D: 1.47 Loss_G: 10.53 D(x): 0.82 D(G(z)): 0.47 / 0.21 | Acc 84.4 / 82.8\n",
      "[1/2][46/782] Loss_D: 1.27 Loss_G: 10.60 D(x): 0.76 D(G(z)): 0.34 / 0.20 | Acc 85.9 / 82.8\n",
      "semi Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "semi Test: [50/157]\t Prec@1 56.250 (50.582)\n",
      "semi Test: [100/157]\t Prec@1 50.000 (50.418)\n",
      "semi Test: [150/157]\t Prec@1 50.000 (50.528)\n",
      "semi Test Prec@1 50.28\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 50.000 (48.805)\n",
      "sup Test: [100/157]\t Prec@1 42.188 (49.134)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.655)\n",
      "sup Test Prec@1 48.57\n",
      "[1/2][47/782] Loss_D: 1.36 Loss_G: 9.97 D(x): 0.69 D(G(z)): 0.34 / 0.36 | Acc 85.9 / 82.9\n",
      "[1/2][48/782] Loss_D: 1.69 Loss_G: 11.18 D(x): 0.82 D(G(z)): 0.55 / 0.14 | Acc 85.9 / 83.0\n",
      "[1/2][49/782] Loss_D: 1.99 Loss_G: 9.14 D(x): 0.57 D(G(z)): 0.29 / 0.66 | Acc 65.6 / 82.6\n",
      "[1/2][50/782] Loss_D: 2.21 Loss_G: 11.38 D(x): 0.93 D(G(z)): 0.76 / 0.09 | Acc 90.6 / 82.8\n",
      "[1/2][51/782] Loss_D: 1.65 Loss_G: 9.83 D(x): 0.55 D(G(z)): 0.18 / 0.38 | Acc 79.7 / 82.7\n",
      "[1/2][52/782] Loss_D: 1.45 Loss_G: 11.18 D(x): 0.88 D(G(z)): 0.56 / 0.13 | Acc 95.3 / 83.0\n",
      "[1/2][53/782] Loss_D: 1.49 Loss_G: 9.58 D(x): 0.65 D(G(z)): 0.24 / 0.41 | Acc 79.7 / 82.9\n",
      "[1/2][54/782] Loss_D: 1.51 Loss_G: 10.96 D(x): 0.88 D(G(z)): 0.54 / 0.16 | Acc 90.6 / 83.0\n",
      "[1/2][55/782] Loss_D: 1.27 Loss_G: 11.08 D(x): 0.77 D(G(z)): 0.31 / 0.15 | Acc 81.2 / 83.0\n",
      "[1/2][56/782] Loss_D: 1.68 Loss_G: 9.45 D(x): 0.58 D(G(z)): 0.27 / 0.51 | Acc 76.6 / 82.9\n",
      "semi Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (50.429)\n",
      "semi Test: [100/157]\t Prec@1 40.625 (50.371)\n",
      "semi Test: [150/157]\t Prec@1 40.625 (50.435)\n",
      "semi Test Prec@1 50.14\n",
      "sup Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "sup Test: [50/157]\t Prec@1 48.438 (48.928)\n",
      "sup Test: [100/157]\t Prec@1 42.188 (49.134)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.769)\n",
      "sup Test Prec@1 48.63\n",
      "[1/2][57/782] Loss_D: 1.68 Loss_G: 11.32 D(x): 0.90 D(G(z)): 0.64 / 0.11 | Acc 93.8 / 83.1\n",
      "[1/2][58/782] Loss_D: 1.71 Loss_G: 9.60 D(x): 0.54 D(G(z)): 0.24 / 0.45 | Acc 71.9 / 82.9\n",
      "[1/2][59/782] Loss_D: 1.79 Loss_G: 10.59 D(x): 0.86 D(G(z)): 0.58 / 0.19 | Acc 87.5 / 83.0\n",
      "[1/2][60/782] Loss_D: 1.57 Loss_G: 10.09 D(x): 0.61 D(G(z)): 0.34 / 0.32 | Acc 89.1 / 83.1\n",
      "[1/2][61/782] Loss_D: 1.58 Loss_G: 10.09 D(x): 0.74 D(G(z)): 0.47 / 0.30 | Acc 85.9 / 83.1\n",
      "[1/2][62/782] Loss_D: 1.56 Loss_G: 10.67 D(x): 0.78 D(G(z)): 0.48 / 0.17 | Acc 82.8 / 83.1\n",
      "[1/2][63/782] Loss_D: 1.62 Loss_G: 9.42 D(x): 0.63 D(G(z)): 0.27 / 0.50 | Acc 65.6 / 82.8\n",
      "[1/2][64/782] Loss_D: 1.61 Loss_G: 10.67 D(x): 0.87 D(G(z)): 0.61 / 0.17 | Acc 95.3 / 83.0\n",
      "[1/2][65/782] Loss_D: 1.60 Loss_G: 9.86 D(x): 0.67 D(G(z)): 0.30 / 0.33 | Acc 71.9 / 82.9\n",
      "[1/2][66/782] Loss_D: 1.66 Loss_G: 9.90 D(x): 0.72 D(G(z)): 0.47 / 0.33 | Acc 87.5 / 82.9\n",
      "semi Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (49.571)\n",
      "semi Test: [100/157]\t Prec@1 40.625 (49.613)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (49.897)\n",
      "semi Test Prec@1 49.77\n",
      "sup Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (49.050)\n",
      "sup Test: [100/157]\t Prec@1 43.750 (49.242)\n",
      "sup Test: [150/157]\t Prec@1 50.000 (48.841)\n",
      "sup Test Prec@1 48.74\n",
      "[1/2][67/782] Loss_D: 1.63 Loss_G: 10.40 D(x): 0.76 D(G(z)): 0.47 / 0.24 | Acc 84.4 / 83.0\n",
      "[1/2][68/782] Loss_D: 1.59 Loss_G: 10.23 D(x): 0.71 D(G(z)): 0.40 / 0.29 | Acc 82.8 / 82.9\n",
      "[1/2][69/782] Loss_D: 1.51 Loss_G: 10.33 D(x): 0.77 D(G(z)): 0.46 / 0.22 | Acc 82.8 / 82.9\n",
      "[1/2][70/782] Loss_D: 1.94 Loss_G: 9.30 D(x): 0.53 D(G(z)): 0.34 / 0.62 | Acc 79.7 / 82.9\n",
      "[1/2][71/782] Loss_D: 1.96 Loss_G: 11.19 D(x): 0.89 D(G(z)): 0.71 / 0.11 | Acc 89.1 / 83.0\n",
      "[1/2][72/782] Loss_D: 1.53 Loss_G: 10.05 D(x): 0.60 D(G(z)): 0.20 / 0.34 | Acc 76.6 / 82.9\n",
      "[1/2][73/782] Loss_D: 1.51 Loss_G: 10.03 D(x): 0.80 D(G(z)): 0.48 / 0.29 | Acc 92.2 / 83.0\n",
      "[1/2][74/782] Loss_D: 1.39 Loss_G: 10.93 D(x): 0.82 D(G(z)): 0.45 / 0.12 | Acc 87.5 / 83.1\n",
      "[1/2][75/782] Loss_D: 1.74 Loss_G: 9.35 D(x): 0.60 D(G(z)): 0.25 / 0.51 | Acc 65.6 / 82.9\n",
      "[1/2][76/782] Loss_D: 1.83 Loss_G: 10.58 D(x): 0.87 D(G(z)): 0.64 / 0.18 | Acc 89.1 / 82.9\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (51.562)\n",
      "semi Test: [100/157]\t Prec@1 45.312 (51.686)\n",
      "semi Test: [150/157]\t Prec@1 54.688 (51.873)\n",
      "semi Test Prec@1 51.73\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.591)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.226)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.686)\n",
      "sup Test Prec@1 48.54\n",
      "[1/2][77/782] Loss_D: 1.62 Loss_G: 9.97 D(x): 0.66 D(G(z)): 0.31 / 0.31 | Acc 79.7 / 82.9\n",
      "[1/2][78/782] Loss_D: 1.40 Loss_G: 10.06 D(x): 0.77 D(G(z)): 0.42 / 0.29 | Acc 90.6 / 83.0\n",
      "[1/2][79/782] Loss_D: 1.50 Loss_G: 10.10 D(x): 0.73 D(G(z)): 0.45 / 0.26 | Acc 90.6 / 83.1\n",
      "[1/2][80/782] Loss_D: 1.54 Loss_G: 10.14 D(x): 0.77 D(G(z)): 0.38 / 0.27 | Acc 75.0 / 83.0\n",
      "[1/2][81/782] Loss_D: 1.55 Loss_G: 10.09 D(x): 0.74 D(G(z)): 0.42 / 0.28 | Acc 85.9 / 83.0\n",
      "[1/2][82/782] Loss_D: 1.47 Loss_G: 10.28 D(x): 0.78 D(G(z)): 0.41 / 0.26 | Acc 84.4 / 83.0\n",
      "[1/2][83/782] Loss_D: 1.22 Loss_G: 10.30 D(x): 0.80 D(G(z)): 0.37 / 0.19 | Acc 92.2 / 83.1\n",
      "[1/2][84/782] Loss_D: 1.43 Loss_G: 9.73 D(x): 0.71 D(G(z)): 0.33 / 0.37 | Acc 79.7 / 83.1\n",
      "[1/2][85/782] Loss_D: 1.48 Loss_G: 10.68 D(x): 0.83 D(G(z)): 0.49 / 0.18 | Acc 92.2 / 83.2\n",
      "[1/2][86/782] Loss_D: 1.44 Loss_G: 9.82 D(x): 0.70 D(G(z)): 0.33 / 0.35 | Acc 82.8 / 83.2\n",
      "semi Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (50.888)\n",
      "semi Test: [100/157]\t Prec@1 48.438 (51.501)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (51.645)\n",
      "semi Test Prec@1 51.52\n",
      "sup Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (48.713)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.087)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.748)\n",
      "sup Test Prec@1 48.63\n",
      "[1/2][87/782] Loss_D: 1.38 Loss_G: 10.46 D(x): 0.83 D(G(z)): 0.49 / 0.18 | Acc 93.8 / 83.3\n",
      "[1/2][88/782] Loss_D: 1.51 Loss_G: 9.71 D(x): 0.70 D(G(z)): 0.32 / 0.40 | Acc 75.0 / 83.2\n",
      "[1/2][89/782] Loss_D: 1.42 Loss_G: 10.96 D(x): 0.87 D(G(z)): 0.55 / 0.14 | Acc 92.2 / 83.3\n",
      "[1/2][90/782] Loss_D: 1.47 Loss_G: 9.26 D(x): 0.60 D(G(z)): 0.22 / 0.49 | Acc 84.4 / 83.3\n",
      "[1/2][91/782] Loss_D: 1.59 Loss_G: 10.99 D(x): 0.91 D(G(z)): 0.62 / 0.12 | Acc 96.9 / 83.5\n",
      "[1/2][92/782] Loss_D: 1.59 Loss_G: 9.35 D(x): 0.52 D(G(z)): 0.20 / 0.51 | Acc 82.8 / 83.5\n",
      "[1/2][93/782] Loss_D: 1.77 Loss_G: 10.72 D(x): 0.88 D(G(z)): 0.65 / 0.16 | Acc 90.6 / 83.6\n",
      "[1/2][94/782] Loss_D: 1.47 Loss_G: 9.75 D(x): 0.61 D(G(z)): 0.26 / 0.37 | Acc 79.7 / 83.5\n",
      "[1/2][95/782] Loss_D: 1.52 Loss_G: 10.36 D(x): 0.83 D(G(z)): 0.50 / 0.23 | Acc 89.1 / 83.6\n",
      "[1/2][96/782] Loss_D: 1.50 Loss_G: 10.05 D(x): 0.75 D(G(z)): 0.37 / 0.27 | Acc 78.1 / 83.5\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 50.000 (50.245)\n",
      "semi Test: [100/157]\t Prec@1 45.312 (50.077)\n",
      "semi Test: [150/157]\t Prec@1 54.688 (50.383)\n",
      "semi Test Prec@1 50.25\n",
      "sup Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.836)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.056)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.593)\n",
      "sup Test Prec@1 48.50\n",
      "[1/2][97/782] Loss_D: 1.68 Loss_G: 9.47 D(x): 0.66 D(G(z)): 0.39 / 0.42 | Acc 82.8 / 83.5\n",
      "[1/2][98/782] Loss_D: 1.67 Loss_G: 10.26 D(x): 0.78 D(G(z)): 0.54 / 0.21 | Acc 85.9 / 83.5\n",
      "[1/2][99/782] Loss_D: 1.54 Loss_G: 9.63 D(x): 0.67 D(G(z)): 0.34 / 0.39 | Acc 75.0 / 83.5\n",
      "[1/2][100/782] Loss_D: 1.63 Loss_G: 10.09 D(x): 0.81 D(G(z)): 0.48 / 0.23 | Acc 85.9 / 83.5\n",
      "[1/2][101/782] Loss_D: 1.48 Loss_G: 9.58 D(x): 0.64 D(G(z)): 0.36 / 0.34 | Acc 92.2 / 83.6\n",
      "[1/2][102/782] Loss_D: 1.38 Loss_G: 10.32 D(x): 0.81 D(G(z)): 0.45 / 0.21 | Acc 92.2 / 83.6\n",
      "[1/2][103/782] Loss_D: 1.34 Loss_G: 9.84 D(x): 0.75 D(G(z)): 0.33 / 0.30 | Acc 82.8 / 83.6\n",
      "[1/2][104/782] Loss_D: 1.52 Loss_G: 9.86 D(x): 0.74 D(G(z)): 0.40 / 0.35 | Acc 82.8 / 83.6\n",
      "[1/2][105/782] Loss_D: 1.58 Loss_G: 10.09 D(x): 0.78 D(G(z)): 0.48 / 0.26 | Acc 89.1 / 83.7\n",
      "[1/2][106/782] Loss_D: 1.49 Loss_G: 9.81 D(x): 0.71 D(G(z)): 0.41 / 0.33 | Acc 89.1 / 83.7\n",
      "semi Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (50.490)\n",
      "semi Test: [100/157]\t Prec@1 48.438 (50.727)\n",
      "semi Test: [150/157]\t Prec@1 54.688 (50.786)\n",
      "semi Test Prec@1 50.64\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.805)\n",
      "sup Test: [100/157]\t Prec@1 43.750 (49.335)\n",
      "sup Test: [150/157]\t Prec@1 56.250 (48.758)\n",
      "sup Test Prec@1 48.65\n",
      "[1/2][107/782] Loss_D: 1.50 Loss_G: 9.89 D(x): 0.73 D(G(z)): 0.42 / 0.31 | Acc 90.6 / 83.8\n",
      "[1/2][108/782] Loss_D: 1.60 Loss_G: 9.88 D(x): 0.72 D(G(z)): 0.44 / 0.31 | Acc 89.1 / 83.8\n",
      "[1/2][109/782] Loss_D: 1.64 Loss_G: 10.02 D(x): 0.74 D(G(z)): 0.44 / 0.32 | Acc 79.7 / 83.8\n",
      "[1/2][110/782] Loss_D: 1.41 Loss_G: 10.39 D(x): 0.81 D(G(z)): 0.42 / 0.20 | Acc 85.9 / 83.8\n",
      "[1/2][111/782] Loss_D: 1.48 Loss_G: 9.33 D(x): 0.69 D(G(z)): 0.32 / 0.37 | Acc 85.9 / 83.8\n",
      "[1/2][112/782] Loss_D: 1.43 Loss_G: 10.67 D(x): 0.83 D(G(z)): 0.51 / 0.16 | Acc 93.8 / 83.9\n",
      "[1/2][113/782] Loss_D: 1.69 Loss_G: 9.03 D(x): 0.58 D(G(z)): 0.28 / 0.64 | Acc 82.8 / 83.9\n",
      "[1/2][114/782] Loss_D: 2.02 Loss_G: 11.38 D(x): 0.90 D(G(z)): 0.74 / 0.07 | Acc 89.1 / 84.0\n",
      "[1/2][115/782] Loss_D: 2.43 Loss_G: 8.77 D(x): 0.38 D(G(z)): 0.13 / 0.78 | Acc 60.9 / 83.8\n",
      "[1/2][116/782] Loss_D: 2.58 Loss_G: 10.26 D(x): 0.95 D(G(z)): 0.83 / 0.22 | Acc 93.8 / 83.9\n",
      "semi Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "semi Test: [50/157]\t Prec@1 43.750 (50.858)\n",
      "semi Test: [100/157]\t Prec@1 48.438 (51.021)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (50.890)\n",
      "semi Test Prec@1 50.74\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.744)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.149)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.748)\n",
      "sup Test Prec@1 48.66\n",
      "[1/2][117/782] Loss_D: 1.38 Loss_G: 10.84 D(x): 0.78 D(G(z)): 0.34 / 0.13 | Acc 82.8 / 83.8\n",
      "[1/2][118/782] Loss_D: 2.01 Loss_G: 9.00 D(x): 0.48 D(G(z)): 0.23 / 0.66 | Acc 70.3 / 83.7\n",
      "[1/2][119/782] Loss_D: 2.25 Loss_G: 10.07 D(x): 0.92 D(G(z)): 0.75 / 0.25 | Acc 87.5 / 83.8\n",
      "[1/2][120/782] Loss_D: 1.89 Loss_G: 9.73 D(x): 0.63 D(G(z)): 0.37 / 0.33 | Acc 70.3 / 83.7\n",
      "[1/2][121/782] Loss_D: 1.53 Loss_G: 9.54 D(x): 0.73 D(G(z)): 0.43 / 0.35 | Acc 87.5 / 83.7\n",
      "[1/2][122/782] Loss_D: 1.55 Loss_G: 9.68 D(x): 0.74 D(G(z)): 0.47 / 0.30 | Acc 87.5 / 83.7\n",
      "[1/2][123/782] Loss_D: 1.49 Loss_G: 9.78 D(x): 0.70 D(G(z)): 0.43 / 0.31 | Acc 85.9 / 83.7\n",
      "[1/2][124/782] Loss_D: 1.51 Loss_G: 9.65 D(x): 0.76 D(G(z)): 0.43 / 0.31 | Acc 82.8 / 83.7\n",
      "[1/2][125/782] Loss_D: 1.78 Loss_G: 9.20 D(x): 0.64 D(G(z)): 0.42 / 0.49 | Acc 79.7 / 83.7\n",
      "[1/2][126/782] Loss_D: 1.59 Loss_G: 10.45 D(x): 0.85 D(G(z)): 0.58 / 0.17 | Acc 89.1 / 83.7\n",
      "semi Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (48.744)\n",
      "semi Test: [100/157]\t Prec@1 46.875 (48.762)\n",
      "semi Test: [150/157]\t Prec@1 43.750 (49.058)\n",
      "semi Test Prec@1 48.93\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 56.250 (48.254)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.948)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.551)\n",
      "sup Test Prec@1 48.42\n",
      "[1/2][127/782] Loss_D: 1.78 Loss_G: 8.86 D(x): 0.53 D(G(z)): 0.24 / 0.54 | Acc 75.0 / 83.7\n",
      "[1/2][128/782] Loss_D: 1.79 Loss_G: 10.11 D(x): 0.87 D(G(z)): 0.65 / 0.20 | Acc 92.2 / 83.7\n",
      "[1/2][129/782] Loss_D: 1.54 Loss_G: 9.54 D(x): 0.64 D(G(z)): 0.30 / 0.40 | Acc 70.3 / 83.6\n",
      "[1/2][130/782] Loss_D: 1.44 Loss_G: 9.87 D(x): 0.80 D(G(z)): 0.49 / 0.30 | Acc 90.6 / 83.7\n",
      "[1/2][131/782] Loss_D: 1.59 Loss_G: 9.75 D(x): 0.68 D(G(z)): 0.40 / 0.35 | Acc 87.5 / 83.7\n",
      "[1/2][132/782] Loss_D: 1.69 Loss_G: 9.55 D(x): 0.75 D(G(z)): 0.48 / 0.34 | Acc 85.9 / 83.7\n",
      "[1/2][133/782] Loss_D: 1.54 Loss_G: 9.58 D(x): 0.65 D(G(z)): 0.42 / 0.34 | Acc 92.2 / 83.8\n",
      "[1/2][134/782] Loss_D: 1.67 Loss_G: 9.64 D(x): 0.73 D(G(z)): 0.48 / 0.31 | Acc 84.4 / 83.8\n",
      "[1/2][135/782] Loss_D: 1.49 Loss_G: 9.61 D(x): 0.66 D(G(z)): 0.42 / 0.33 | Acc 95.3 / 83.9\n",
      "[1/2][136/782] Loss_D: 1.60 Loss_G: 9.55 D(x): 0.74 D(G(z)): 0.43 / 0.37 | Acc 79.7 / 83.9\n",
      "semi Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (49.510)\n",
      "semi Test: [100/157]\t Prec@1 50.000 (49.752)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (50.052)\n",
      "semi Test Prec@1 49.80\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 56.250 (48.407)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.840)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (48.406)\n",
      "sup Test Prec@1 48.30\n",
      "[1/2][137/782] Loss_D: 1.50 Loss_G: 10.11 D(x): 0.79 D(G(z)): 0.49 / 0.22 | Acc 89.1 / 83.9\n",
      "[1/2][138/782] Loss_D: 1.42 Loss_G: 9.48 D(x): 0.71 D(G(z)): 0.32 / 0.39 | Acc 78.1 / 83.8\n",
      "[1/2][139/782] Loss_D: 1.65 Loss_G: 10.01 D(x): 0.80 D(G(z)): 0.50 / 0.25 | Acc 85.9 / 83.9\n",
      "[1/2][140/782] Loss_D: 1.53 Loss_G: 9.36 D(x): 0.67 D(G(z)): 0.35 / 0.43 | Acc 82.8 / 83.9\n",
      "[1/2][141/782] Loss_D: 1.62 Loss_G: 10.03 D(x): 0.80 D(G(z)): 0.55 / 0.22 | Acc 90.6 / 83.9\n",
      "[1/2][142/782] Loss_D: 1.52 Loss_G: 9.41 D(x): 0.73 D(G(z)): 0.32 / 0.40 | Acc 65.6 / 83.8\n",
      "[1/2][143/782] Loss_D: 1.47 Loss_G: 9.84 D(x): 0.76 D(G(z)): 0.49 / 0.27 | Acc 89.1 / 83.8\n",
      "[1/2][144/782] Loss_D: 1.49 Loss_G: 9.54 D(x): 0.68 D(G(z)): 0.37 / 0.34 | Acc 85.9 / 83.8\n",
      "[1/2][145/782] Loss_D: 1.60 Loss_G: 9.65 D(x): 0.72 D(G(z)): 0.44 / 0.35 | Acc 81.2 / 83.8\n",
      "[1/2][146/782] Loss_D: 1.47 Loss_G: 9.79 D(x): 0.74 D(G(z)): 0.46 / 0.29 | Acc 89.1 / 83.8\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (50.061)\n",
      "semi Test: [100/157]\t Prec@1 48.438 (50.248)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (50.486)\n",
      "semi Test Prec@1 50.37\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.070)\n",
      "sup Test: [100/157]\t Prec@1 42.188 (48.298)\n",
      "sup Test: [150/157]\t Prec@1 48.438 (47.848)\n",
      "sup Test Prec@1 47.74\n",
      "[1/2][147/782] Loss_D: 1.71 Loss_G: 9.52 D(x): 0.68 D(G(z)): 0.42 / 0.38 | Acc 76.6 / 83.8\n",
      "[1/2][148/782] Loss_D: 1.67 Loss_G: 9.52 D(x): 0.70 D(G(z)): 0.48 / 0.33 | Acc 87.5 / 83.8\n",
      "[1/2][149/782] Loss_D: 1.69 Loss_G: 9.79 D(x): 0.72 D(G(z)): 0.43 / 0.30 | Acc 81.2 / 83.8\n",
      "[1/2][150/782] Loss_D: 1.58 Loss_G: 9.47 D(x): 0.67 D(G(z)): 0.40 / 0.38 | Acc 84.4 / 83.8\n",
      "[1/2][151/782] Loss_D: 1.71 Loss_G: 9.65 D(x): 0.70 D(G(z)): 0.50 / 0.30 | Acc 87.5 / 83.8\n",
      "[1/2][152/782] Loss_D: 1.23 Loss_G: 10.06 D(x): 0.75 D(G(z)): 0.39 / 0.23 | Acc 98.4 / 83.9\n",
      "[1/2][153/782] Loss_D: 1.46 Loss_G: 9.27 D(x): 0.64 D(G(z)): 0.34 / 0.47 | Acc 89.1 / 84.0\n",
      "[1/2][154/782] Loss_D: 1.63 Loss_G: 10.74 D(x): 0.86 D(G(z)): 0.58 / 0.13 | Acc 90.6 / 84.0\n",
      "[1/2][155/782] Loss_D: 1.98 Loss_G: 8.41 D(x): 0.51 D(G(z)): 0.21 / 0.79 | Acc 54.7 / 83.8\n",
      "[1/2][156/782] Loss_D: 2.45 Loss_G: 10.23 D(x): 0.94 D(G(z)): 0.83 / 0.17 | Acc 95.3 / 83.9\n",
      "semi Test: [0/157]\t Prec@1 53.125 (53.125)\n",
      "semi Test: [50/157]\t Prec@1 56.250 (50.858)\n",
      "semi Test: [100/157]\t Prec@1 43.750 (50.897)\n",
      "semi Test: [150/157]\t Prec@1 53.125 (51.149)\n",
      "semi Test Prec@1 51.01\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (49.112)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.149)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.603)\n",
      "sup Test Prec@1 48.50\n",
      "[1/2][157/782] Loss_D: 1.65 Loss_G: 9.26 D(x): 0.54 D(G(z)): 0.28 / 0.36 | Acc 81.2 / 83.9\n",
      "[1/2][158/782] Loss_D: 1.41 Loss_G: 9.57 D(x): 0.77 D(G(z)): 0.47 / 0.31 | Acc 93.8 / 83.9\n",
      "[1/2][159/782] Loss_D: 1.49 Loss_G: 9.42 D(x): 0.72 D(G(z)): 0.41 / 0.35 | Acc 87.5 / 84.0\n",
      "[1/2][160/782] Loss_D: 1.44 Loss_G: 9.65 D(x): 0.69 D(G(z)): 0.43 / 0.32 | Acc 93.8 / 84.0\n",
      "[1/2][161/782] Loss_D: 1.51 Loss_G: 9.74 D(x): 0.72 D(G(z)): 0.44 / 0.28 | Acc 87.5 / 84.0\n",
      "[1/2][162/782] Loss_D: 1.39 Loss_G: 9.56 D(x): 0.74 D(G(z)): 0.35 / 0.34 | Acc 82.8 / 84.0\n",
      "[1/2][163/782] Loss_D: 1.39 Loss_G: 9.86 D(x): 0.79 D(G(z)): 0.45 / 0.23 | Acc 90.6 / 84.1\n",
      "[1/2][164/782] Loss_D: 1.34 Loss_G: 9.65 D(x): 0.74 D(G(z)): 0.35 / 0.29 | Acc 87.5 / 84.1\n",
      "[1/2][165/782] Loss_D: 1.42 Loss_G: 9.34 D(x): 0.74 D(G(z)): 0.39 / 0.36 | Acc 85.9 / 84.1\n",
      "[1/2][166/782] Loss_D: 1.60 Loss_G: 9.84 D(x): 0.73 D(G(z)): 0.49 / 0.25 | Acc 92.2 / 84.2\n",
      "semi Test: [0/157]\t Prec@1 51.562 (51.562)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (51.195)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (51.671)\n",
      "semi Test: [150/157]\t Prec@1 54.688 (51.904)\n",
      "semi Test Prec@1 51.72\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.713)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.242)\n",
      "sup Test: [150/157]\t Prec@1 50.000 (48.624)\n",
      "sup Test Prec@1 48.54\n",
      "[1/2][167/782] Loss_D: 1.55 Loss_G: 9.04 D(x): 0.69 D(G(z)): 0.35 / 0.46 | Acc 76.6 / 84.1\n",
      "[1/2][168/782] Loss_D: 1.67 Loss_G: 10.26 D(x): 0.81 D(G(z)): 0.59 / 0.18 | Acc 87.5 / 84.1\n",
      "[1/2][169/782] Loss_D: 1.71 Loss_G: 8.81 D(x): 0.53 D(G(z)): 0.31 / 0.55 | Acc 79.7 / 84.1\n",
      "[1/2][170/782] Loss_D: 1.58 Loss_G: 10.34 D(x): 0.87 D(G(z)): 0.63 / 0.13 | Acc 95.3 / 84.2\n",
      "[1/2][171/782] Loss_D: 1.78 Loss_G: 8.67 D(x): 0.53 D(G(z)): 0.21 / 0.64 | Acc 71.9 / 84.1\n",
      "[1/2][172/782] Loss_D: 2.06 Loss_G: 10.72 D(x): 0.94 D(G(z)): 0.74 / 0.11 | Acc 93.8 / 84.1\n",
      "[1/2][173/782] Loss_D: 2.01 Loss_G: 8.43 D(x): 0.52 D(G(z)): 0.22 / 0.72 | Acc 51.6 / 84.0\n",
      "[1/2][174/782] Loss_D: 2.33 Loss_G: 9.96 D(x): 0.89 D(G(z)): 0.79 / 0.21 | Acc 92.2 / 84.0\n",
      "[1/2][175/782] Loss_D: 1.63 Loss_G: 9.42 D(x): 0.63 D(G(z)): 0.32 / 0.33 | Acc 76.6 / 84.0\n",
      "[1/2][176/782] Loss_D: 1.58 Loss_G: 9.41 D(x): 0.72 D(G(z)): 0.46 / 0.37 | Acc 89.1 / 84.0\n",
      "semi Test: [0/157]\t Prec@1 50.000 (50.000)\n",
      "semi Test: [50/157]\t Prec@1 46.875 (50.950)\n",
      "semi Test: [100/157]\t Prec@1 37.500 (50.681)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (51.200)\n",
      "semi Test Prec@1 51.05\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.376)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.793)\n",
      "sup Test: [150/157]\t Prec@1 46.875 (48.251)\n",
      "sup Test Prec@1 48.19\n",
      "[1/2][177/782] Loss_D: 1.62 Loss_G: 9.63 D(x): 0.75 D(G(z)): 0.51 / 0.28 | Acc 90.6 / 84.0\n",
      "[1/2][178/782] Loss_D: 1.65 Loss_G: 9.01 D(x): 0.68 D(G(z)): 0.39 / 0.44 | Acc 76.6 / 84.0\n",
      "[1/2][179/782] Loss_D: 1.66 Loss_G: 9.68 D(x): 0.78 D(G(z)): 0.56 / 0.25 | Acc 95.3 / 84.1\n",
      "[1/2][180/782] Loss_D: 1.46 Loss_G: 9.34 D(x): 0.63 D(G(z)): 0.34 / 0.36 | Acc 89.1 / 84.1\n",
      "[1/2][181/782] Loss_D: 1.73 Loss_G: 9.48 D(x): 0.71 D(G(z)): 0.51 / 0.31 | Acc 90.6 / 84.1\n",
      "[1/2][182/782] Loss_D: 1.34 Loss_G: 9.85 D(x): 0.77 D(G(z)): 0.42 / 0.22 | Acc 89.1 / 84.1\n",
      "[1/2][183/782] Loss_D: 1.50 Loss_G: 9.22 D(x): 0.67 D(G(z)): 0.34 / 0.41 | Acc 81.2 / 84.1\n",
      "[1/2][184/782] Loss_D: 1.76 Loss_G: 9.29 D(x): 0.74 D(G(z)): 0.50 / 0.35 | Acc 82.8 / 84.1\n",
      "[1/2][185/782] Loss_D: 1.44 Loss_G: 9.54 D(x): 0.69 D(G(z)): 0.45 / 0.26 | Acc 95.3 / 84.2\n",
      "[1/2][186/782] Loss_D: 1.44 Loss_G: 9.32 D(x): 0.69 D(G(z)): 0.38 / 0.32 | Acc 84.4 / 84.2\n",
      "semi Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "semi Test: [50/157]\t Prec@1 43.750 (50.705)\n",
      "semi Test: [100/157]\t Prec@1 46.875 (50.572)\n",
      "semi Test: [150/157]\t Prec@1 59.375 (51.231)\n",
      "semi Test Prec@1 51.01\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.866)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.087)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.458)\n",
      "sup Test Prec@1 48.37\n",
      "[1/2][187/782] Loss_D: 1.37 Loss_G: 9.73 D(x): 0.77 D(G(z)): 0.43 / 0.22 | Acc 87.5 / 84.2\n",
      "[1/2][188/782] Loss_D: 1.51 Loss_G: 9.13 D(x): 0.69 D(G(z)): 0.37 / 0.39 | Acc 87.5 / 84.2\n",
      "[1/2][189/782] Loss_D: 1.56 Loss_G: 9.45 D(x): 0.73 D(G(z)): 0.51 / 0.29 | Acc 92.2 / 84.3\n",
      "[1/2][190/782] Loss_D: 1.65 Loss_G: 9.37 D(x): 0.67 D(G(z)): 0.45 / 0.33 | Acc 84.4 / 84.3\n",
      "[1/2][191/782] Loss_D: 1.56 Loss_G: 9.64 D(x): 0.68 D(G(z)): 0.48 / 0.27 | Acc 95.3 / 84.3\n",
      "[1/2][192/782] Loss_D: 1.61 Loss_G: 8.82 D(x): 0.61 D(G(z)): 0.39 / 0.49 | Acc 84.4 / 84.3\n",
      "[1/2][193/782] Loss_D: 1.60 Loss_G: 10.53 D(x): 0.83 D(G(z)): 0.62 / 0.12 | Acc 95.3 / 84.4\n",
      "[1/2][194/782] Loss_D: 1.56 Loss_G: 8.54 D(x): 0.53 D(G(z)): 0.21 / 0.56 | Acc 79.7 / 84.4\n",
      "[1/2][195/782] Loss_D: 1.87 Loss_G: 10.17 D(x): 0.89 D(G(z)): 0.68 / 0.16 | Acc 89.1 / 84.4\n",
      "[1/2][196/782] Loss_D: 1.79 Loss_G: 8.74 D(x): 0.57 D(G(z)): 0.29 / 0.51 | Acc 67.2 / 84.3\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 46.875 (51.685)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (51.887)\n",
      "semi Test: [150/157]\t Prec@1 54.688 (52.028)\n",
      "semi Test Prec@1 51.88\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.652)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (48.902)\n",
      "sup Test: [150/157]\t Prec@1 50.000 (48.458)\n",
      "sup Test Prec@1 48.43\n",
      "[1/2][197/782] Loss_D: 1.59 Loss_G: 10.11 D(x): 0.86 D(G(z)): 0.61 / 0.17 | Acc 96.9 / 84.4\n",
      "[1/2][198/782] Loss_D: 1.47 Loss_G: 9.51 D(x): 0.64 D(G(z)): 0.31 / 0.30 | Acc 89.1 / 84.4\n",
      "[1/2][199/782] Loss_D: 1.53 Loss_G: 9.29 D(x): 0.71 D(G(z)): 0.45 / 0.34 | Acc 89.1 / 84.4\n",
      "[1/2][200/782] Loss_D: 1.52 Loss_G: 9.61 D(x): 0.78 D(G(z)): 0.48 / 0.24 | Acc 89.1 / 84.4\n",
      "[1/2][201/782] Loss_D: 1.58 Loss_G: 8.80 D(x): 0.58 D(G(z)): 0.36 / 0.42 | Acc 90.6 / 84.5\n",
      "[1/2][202/782] Loss_D: 1.57 Loss_G: 9.93 D(x): 0.82 D(G(z)): 0.56 / 0.20 | Acc 89.1 / 84.5\n",
      "[1/2][203/782] Loss_D: 1.61 Loss_G: 8.90 D(x): 0.59 D(G(z)): 0.30 / 0.47 | Acc 79.7 / 84.5\n",
      "[1/2][204/782] Loss_D: 1.74 Loss_G: 9.67 D(x): 0.80 D(G(z)): 0.58 / 0.26 | Acc 89.1 / 84.5\n",
      "[1/2][205/782] Loss_D: 1.49 Loss_G: 9.16 D(x): 0.64 D(G(z)): 0.38 / 0.37 | Acc 93.8 / 84.5\n",
      "[1/2][206/782] Loss_D: 1.44 Loss_G: 9.74 D(x): 0.80 D(G(z)): 0.50 / 0.21 | Acc 93.8 / 84.6\n",
      "semi Test: [0/157]\t Prec@1 53.125 (53.125)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (51.746)\n",
      "semi Test: [100/157]\t Prec@1 51.562 (52.181)\n",
      "semi Test: [150/157]\t Prec@1 53.125 (52.287)\n",
      "semi Test Prec@1 52.16\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (48.591)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.056)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.603)\n",
      "sup Test Prec@1 48.53\n",
      "[1/2][207/782] Loss_D: 1.54 Loss_G: 9.17 D(x): 0.68 D(G(z)): 0.34 / 0.37 | Acc 78.1 / 84.5\n",
      "[1/2][208/782] Loss_D: 1.33 Loss_G: 9.92 D(x): 0.82 D(G(z)): 0.49 / 0.20 | Acc 95.3 / 84.6\n",
      "[1/2][209/782] Loss_D: 1.49 Loss_G: 9.11 D(x): 0.68 D(G(z)): 0.35 / 0.37 | Acc 85.9 / 84.6\n",
      "[1/2][210/782] Loss_D: 1.64 Loss_G: 9.50 D(x): 0.76 D(G(z)): 0.52 / 0.27 | Acc 85.9 / 84.6\n",
      "[1/2][211/782] Loss_D: 1.65 Loss_G: 8.91 D(x): 0.63 D(G(z)): 0.39 / 0.39 | Acc 85.9 / 84.6\n",
      "[1/2][212/782] Loss_D: 1.54 Loss_G: 9.71 D(x): 0.74 D(G(z)): 0.48 / 0.26 | Acc 89.1 / 84.6\n",
      "[1/2][213/782] Loss_D: 1.31 Loss_G: 9.50 D(x): 0.74 D(G(z)): 0.39 / 0.26 | Acc 87.5 / 84.6\n",
      "[1/2][214/782] Loss_D: 1.40 Loss_G: 9.17 D(x): 0.69 D(G(z)): 0.38 / 0.33 | Acc 87.5 / 84.7\n",
      "[1/2][215/782] Loss_D: 1.29 Loss_G: 9.73 D(x): 0.75 D(G(z)): 0.46 / 0.22 | Acc 98.4 / 84.7\n",
      "[1/2][216/782] Loss_D: 1.46 Loss_G: 9.09 D(x): 0.68 D(G(z)): 0.35 / 0.40 | Acc 84.4 / 84.7\n",
      "semi Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "semi Test: [50/157]\t Prec@1 54.688 (51.838)\n",
      "semi Test: [100/157]\t Prec@1 48.438 (51.996)\n",
      "semi Test: [150/157]\t Prec@1 48.438 (52.566)\n",
      "semi Test Prec@1 52.33\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.744)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.211)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.882)\n",
      "sup Test Prec@1 48.77\n",
      "[1/2][217/782] Loss_D: 1.56 Loss_G: 10.00 D(x): 0.78 D(G(z)): 0.56 / 0.19 | Acc 96.9 / 84.8\n",
      "[1/2][218/782] Loss_D: 1.65 Loss_G: 8.65 D(x): 0.62 D(G(z)): 0.29 / 0.55 | Acc 71.9 / 84.7\n",
      "[1/2][219/782] Loss_D: 1.89 Loss_G: 9.88 D(x): 0.81 D(G(z)): 0.66 / 0.18 | Acc 93.8 / 84.8\n",
      "[1/2][220/782] Loss_D: 1.56 Loss_G: 8.84 D(x): 0.61 D(G(z)): 0.27 / 0.46 | Acc 70.3 / 84.7\n",
      "[1/2][221/782] Loss_D: 1.61 Loss_G: 9.68 D(x): 0.80 D(G(z)): 0.57 / 0.22 | Acc 89.1 / 84.7\n",
      "[1/2][222/782] Loss_D: 1.31 Loss_G: 9.42 D(x): 0.65 D(G(z)): 0.34 / 0.29 | Acc 95.3 / 84.8\n",
      "[1/2][223/782] Loss_D: 1.38 Loss_G: 9.37 D(x): 0.76 D(G(z)): 0.42 / 0.29 | Acc 89.1 / 84.8\n",
      "[1/2][224/782] Loss_D: 1.42 Loss_G: 9.72 D(x): 0.74 D(G(z)): 0.45 / 0.23 | Acc 90.6 / 84.8\n",
      "[1/2][225/782] Loss_D: 1.47 Loss_G: 8.95 D(x): 0.66 D(G(z)): 0.34 / 0.43 | Acc 81.2 / 84.8\n",
      "[1/2][226/782] Loss_D: 1.54 Loss_G: 9.62 D(x): 0.71 D(G(z)): 0.53 / 0.23 | Acc 95.3 / 84.8\n",
      "semi Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "semi Test: [50/157]\t Prec@1 50.000 (51.532)\n",
      "semi Test: [100/157]\t Prec@1 48.438 (51.547)\n",
      "semi Test: [150/157]\t Prec@1 53.125 (51.687)\n",
      "semi Test Prec@1 51.47\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (49.081)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.211)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.872)\n",
      "sup Test Prec@1 48.78\n",
      "[1/2][227/782] Loss_D: 1.61 Loss_G: 8.99 D(x): 0.67 D(G(z)): 0.37 / 0.39 | Acc 79.7 / 84.8\n",
      "[1/2][228/782] Loss_D: 1.53 Loss_G: 9.69 D(x): 0.73 D(G(z)): 0.52 / 0.24 | Acc 95.3 / 84.9\n",
      "[1/2][229/782] Loss_D: 1.68 Loss_G: 8.86 D(x): 0.62 D(G(z)): 0.36 / 0.45 | Acc 81.2 / 84.8\n",
      "[1/2][230/782] Loss_D: 1.52 Loss_G: 10.11 D(x): 0.83 D(G(z)): 0.56 / 0.15 | Acc 89.1 / 84.9\n",
      "[1/2][231/782] Loss_D: 1.75 Loss_G: 8.42 D(x): 0.50 D(G(z)): 0.28 / 0.57 | Acc 82.8 / 84.8\n",
      "[1/2][232/782] Loss_D: 1.90 Loss_G: 10.27 D(x): 0.90 D(G(z)): 0.68 / 0.13 | Acc 89.1 / 84.9\n",
      "[1/2][233/782] Loss_D: 1.71 Loss_G: 8.86 D(x): 0.48 D(G(z)): 0.24 / 0.50 | Acc 84.4 / 84.9\n",
      "[1/2][234/782] Loss_D: 1.71 Loss_G: 9.78 D(x): 0.87 D(G(z)): 0.63 / 0.19 | Acc 95.3 / 84.9\n",
      "[1/2][235/782] Loss_D: 1.55 Loss_G: 8.86 D(x): 0.61 D(G(z)): 0.29 / 0.42 | Acc 82.8 / 84.9\n",
      "[1/2][236/782] Loss_D: 1.54 Loss_G: 9.86 D(x): 0.83 D(G(z)): 0.59 / 0.19 | Acc 96.9 / 84.9\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (51.440)\n",
      "semi Test: [100/157]\t Prec@1 39.062 (50.820)\n",
      "semi Test: [150/157]\t Prec@1 51.562 (51.107)\n",
      "semi Test Prec@1 50.88\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.652)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.824)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.582)\n",
      "sup Test Prec@1 48.50\n",
      "[1/2][237/782] Loss_D: 1.57 Loss_G: 8.72 D(x): 0.58 D(G(z)): 0.31 / 0.48 | Acc 85.9 / 85.0\n",
      "[1/2][238/782] Loss_D: 1.77 Loss_G: 9.25 D(x): 0.77 D(G(z)): 0.60 / 0.29 | Acc 90.6 / 85.0\n",
      "[1/2][239/782] Loss_D: 1.46 Loss_G: 9.52 D(x): 0.73 D(G(z)): 0.44 / 0.23 | Acc 92.2 / 85.0\n",
      "[1/2][240/782] Loss_D: 1.69 Loss_G: 8.58 D(x): 0.58 D(G(z)): 0.38 / 0.56 | Acc 87.5 / 85.0\n",
      "[1/2][241/782] Loss_D: 1.77 Loss_G: 9.74 D(x): 0.85 D(G(z)): 0.67 / 0.17 | Acc 95.3 / 85.1\n",
      "[1/2][242/782] Loss_D: 1.89 Loss_G: 8.62 D(x): 0.43 D(G(z)): 0.27 / 0.53 | Acc 85.9 / 85.1\n",
      "[1/2][243/782] Loss_D: 1.67 Loss_G: 9.51 D(x): 0.82 D(G(z)): 0.62 / 0.25 | Acc 96.9 / 85.1\n",
      "[1/2][244/782] Loss_D: 1.50 Loss_G: 9.37 D(x): 0.66 D(G(z)): 0.37 / 0.27 | Acc 90.6 / 85.1\n",
      "[1/2][245/782] Loss_D: 1.38 Loss_G: 8.92 D(x): 0.72 D(G(z)): 0.36 / 0.42 | Acc 82.8 / 85.1\n",
      "[1/2][246/782] Loss_D: 1.39 Loss_G: 9.67 D(x): 0.83 D(G(z)): 0.50 / 0.21 | Acc 92.2 / 85.2\n",
      "semi Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "semi Test: [50/157]\t Prec@1 46.875 (51.409)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (51.423)\n",
      "semi Test: [150/157]\t Prec@1 59.375 (51.604)\n",
      "semi Test Prec@1 51.46\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.683)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.948)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.665)\n",
      "sup Test Prec@1 48.62\n",
      "[1/2][247/782] Loss_D: 1.32 Loss_G: 9.11 D(x): 0.71 D(G(z)): 0.32 / 0.34 | Acc 84.4 / 85.1\n",
      "[1/2][248/782] Loss_D: 1.61 Loss_G: 8.92 D(x): 0.67 D(G(z)): 0.46 / 0.39 | Acc 90.6 / 85.2\n",
      "[1/2][249/782] Loss_D: 1.58 Loss_G: 9.31 D(x): 0.77 D(G(z)): 0.53 / 0.24 | Acc 89.1 / 85.2\n",
      "[1/2][250/782] Loss_D: 1.52 Loss_G: 8.68 D(x): 0.60 D(G(z)): 0.36 / 0.43 | Acc 89.1 / 85.2\n",
      "[1/2][251/782] Loss_D: 1.67 Loss_G: 9.07 D(x): 0.68 D(G(z)): 0.55 / 0.33 | Acc 95.3 / 85.2\n",
      "[1/2][252/782] Loss_D: 1.62 Loss_G: 8.93 D(x): 0.63 D(G(z)): 0.44 / 0.36 | Acc 89.1 / 85.3\n",
      "[1/2][253/782] Loss_D: 1.68 Loss_G: 8.93 D(x): 0.66 D(G(z)): 0.48 / 0.42 | Acc 87.5 / 85.3\n",
      "[1/2][254/782] Loss_D: 1.64 Loss_G: 9.11 D(x): 0.71 D(G(z)): 0.52 / 0.32 | Acc 93.8 / 85.3\n",
      "[1/2][255/782] Loss_D: 1.40 Loss_G: 9.27 D(x): 0.74 D(G(z)): 0.44 / 0.27 | Acc 87.5 / 85.3\n",
      "[1/2][256/782] Loss_D: 1.40 Loss_G: 8.85 D(x): 0.67 D(G(z)): 0.36 / 0.38 | Acc 87.5 / 85.3\n",
      "semi Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "semi Test: [50/157]\t Prec@1 50.000 (50.766)\n",
      "semi Test: [100/157]\t Prec@1 50.000 (50.495)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (50.849)\n",
      "semi Test Prec@1 50.56\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.744)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.180)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.872)\n",
      "sup Test Prec@1 48.81\n",
      "[1/2][257/782] Loss_D: 1.61 Loss_G: 9.32 D(x): 0.77 D(G(z)): 0.51 / 0.29 | Acc 84.4 / 85.3\n",
      "[1/2][258/782] Loss_D: 1.46 Loss_G: 8.98 D(x): 0.70 D(G(z)): 0.39 / 0.35 | Acc 89.1 / 85.3\n",
      "[1/2][259/782] Loss_D: 1.38 Loss_G: 8.90 D(x): 0.72 D(G(z)): 0.43 / 0.33 | Acc 93.8 / 85.4\n",
      "[1/2][260/782] Loss_D: 1.38 Loss_G: 9.50 D(x): 0.78 D(G(z)): 0.46 / 0.21 | Acc 92.2 / 85.4\n",
      "[1/2][261/782] Loss_D: 1.67 Loss_G: 8.49 D(x): 0.64 D(G(z)): 0.32 / 0.58 | Acc 70.3 / 85.3\n",
      "[1/2][262/782] Loss_D: 1.77 Loss_G: 9.85 D(x): 0.87 D(G(z)): 0.68 / 0.16 | Acc 98.4 / 85.4\n",
      "[1/2][263/782] Loss_D: 1.84 Loss_G: 8.35 D(x): 0.51 D(G(z)): 0.24 / 0.63 | Acc 70.3 / 85.3\n",
      "[1/2][264/782] Loss_D: 1.98 Loss_G: 9.07 D(x): 0.84 D(G(z)): 0.70 / 0.28 | Acc 92.2 / 85.3\n",
      "[1/2][265/782] Loss_D: 1.44 Loss_G: 9.11 D(x): 0.62 D(G(z)): 0.38 / 0.30 | Acc 93.8 / 85.4\n",
      "[1/2][266/782] Loss_D: 1.46 Loss_G: 8.80 D(x): 0.69 D(G(z)): 0.43 / 0.37 | Acc 89.1 / 85.4\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 56.250 (52.237)\n",
      "semi Test: [100/157]\t Prec@1 51.562 (52.676)\n",
      "semi Test: [150/157]\t Prec@1 57.812 (53.084)\n",
      "semi Test Prec@1 52.85\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.866)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.242)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.965)\n",
      "sup Test Prec@1 48.90\n",
      "[1/2][267/782] Loss_D: 1.85 Loss_G: 8.61 D(x): 0.65 D(G(z)): 0.47 / 0.45 | Acc 87.5 / 85.4\n",
      "[1/2][268/782] Loss_D: 1.56 Loss_G: 9.14 D(x): 0.74 D(G(z)): 0.54 / 0.26 | Acc 96.9 / 85.4\n",
      "[1/2][269/782] Loss_D: 1.50 Loss_G: 8.98 D(x): 0.70 D(G(z)): 0.36 / 0.34 | Acc 84.4 / 85.4\n",
      "[1/2][270/782] Loss_D: 1.50 Loss_G: 8.91 D(x): 0.71 D(G(z)): 0.47 / 0.33 | Acc 87.5 / 85.4\n",
      "[1/2][271/782] Loss_D: 1.35 Loss_G: 9.33 D(x): 0.72 D(G(z)): 0.42 / 0.25 | Acc 95.3 / 85.5\n",
      "[1/2][272/782] Loss_D: 1.70 Loss_G: 8.34 D(x): 0.57 D(G(z)): 0.35 / 0.56 | Acc 82.8 / 85.5\n",
      "[1/2][273/782] Loss_D: 1.72 Loss_G: 9.58 D(x): 0.88 D(G(z)): 0.66 / 0.19 | Acc 95.3 / 85.5\n",
      "[1/2][274/782] Loss_D: 1.50 Loss_G: 8.99 D(x): 0.56 D(G(z)): 0.27 / 0.38 | Acc 81.2 / 85.5\n",
      "[1/2][275/782] Loss_D: 1.43 Loss_G: 9.11 D(x): 0.78 D(G(z)): 0.49 / 0.33 | Acc 90.6 / 85.5\n",
      "[1/2][276/782] Loss_D: 1.57 Loss_G: 9.17 D(x): 0.75 D(G(z)): 0.44 / 0.29 | Acc 89.1 / 85.5\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 56.250 (52.819)\n",
      "semi Test: [100/157]\t Prec@1 53.125 (52.228)\n",
      "semi Test: [150/157]\t Prec@1 54.688 (52.442)\n",
      "semi Test Prec@1 52.12\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.468)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.025)\n",
      "sup Test: [150/157]\t Prec@1 50.000 (48.572)\n",
      "sup Test Prec@1 48.47\n",
      "[1/2][277/782] Loss_D: 1.47 Loss_G: 8.71 D(x): 0.70 D(G(z)): 0.41 / 0.40 | Acc 82.8 / 85.5\n",
      "[1/2][278/782] Loss_D: 1.66 Loss_G: 8.82 D(x): 0.71 D(G(z)): 0.49 / 0.37 | Acc 85.9 / 85.5\n",
      "[1/2][279/782] Loss_D: 1.53 Loss_G: 9.42 D(x): 0.70 D(G(z)): 0.52 / 0.26 | Acc 96.9 / 85.6\n",
      "[1/2][280/782] Loss_D: 1.52 Loss_G: 8.75 D(x): 0.66 D(G(z)): 0.38 / 0.37 | Acc 87.5 / 85.6\n",
      "[1/2][281/782] Loss_D: 1.74 Loss_G: 8.84 D(x): 0.65 D(G(z)): 0.52 / 0.41 | Acc 92.2 / 85.6\n",
      "[1/2][282/782] Loss_D: 1.52 Loss_G: 9.23 D(x): 0.72 D(G(z)): 0.51 / 0.24 | Acc 92.2 / 85.6\n",
      "[1/2][283/782] Loss_D: 1.60 Loss_G: 8.58 D(x): 0.61 D(G(z)): 0.33 / 0.46 | Acc 85.9 / 85.6\n",
      "[1/2][284/782] Loss_D: 1.55 Loss_G: 9.53 D(x): 0.77 D(G(z)): 0.58 / 0.23 | Acc 96.9 / 85.7\n",
      "[1/2][285/782] Loss_D: 1.41 Loss_G: 8.95 D(x): 0.68 D(G(z)): 0.35 / 0.32 | Acc 85.9 / 85.7\n",
      "[1/2][286/782] Loss_D: 1.51 Loss_G: 8.72 D(x): 0.69 D(G(z)): 0.43 / 0.37 | Acc 93.8 / 85.7\n",
      "semi Test: [0/157]\t Prec@1 51.562 (51.562)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (53.217)\n",
      "semi Test: [100/157]\t Prec@1 50.000 (52.614)\n",
      "semi Test: [150/157]\t Prec@1 60.938 (52.949)\n",
      "semi Test Prec@1 52.65\n",
      "sup Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.744)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.025)\n",
      "sup Test: [150/157]\t Prec@1 50.000 (48.727)\n",
      "sup Test Prec@1 48.62\n",
      "[1/2][287/782] Loss_D: 1.39 Loss_G: 9.80 D(x): 0.84 D(G(z)): 0.50 / 0.16 | Acc 89.1 / 85.7\n",
      "[1/2][288/782] Loss_D: 1.74 Loss_G: 8.20 D(x): 0.54 D(G(z)): 0.26 / 0.61 | Acc 68.8 / 85.6\n",
      "[1/2][289/782] Loss_D: 1.76 Loss_G: 9.56 D(x): 0.90 D(G(z)): 0.69 / 0.18 | Acc 95.3 / 85.7\n",
      "[1/2][290/782] Loss_D: 1.67 Loss_G: 8.36 D(x): 0.56 D(G(z)): 0.28 / 0.49 | Acc 71.9 / 85.6\n",
      "[1/2][291/782] Loss_D: 1.51 Loss_G: 9.59 D(x): 0.83 D(G(z)): 0.58 / 0.20 | Acc 96.9 / 85.7\n",
      "[1/2][292/782] Loss_D: 1.59 Loss_G: 8.61 D(x): 0.61 D(G(z)): 0.30 / 0.46 | Acc 78.1 / 85.6\n",
      "[1/2][293/782] Loss_D: 1.57 Loss_G: 9.11 D(x): 0.81 D(G(z)): 0.55 / 0.29 | Acc 90.6 / 85.7\n",
      "[1/2][294/782] Loss_D: 1.52 Loss_G: 8.80 D(x): 0.62 D(G(z)): 0.37 / 0.39 | Acc 87.5 / 85.7\n",
      "[1/2][295/782] Loss_D: 1.44 Loss_G: 9.04 D(x): 0.80 D(G(z)): 0.50 / 0.29 | Acc 90.6 / 85.7\n",
      "[1/2][296/782] Loss_D: 1.61 Loss_G: 8.36 D(x): 0.64 D(G(z)): 0.39 / 0.48 | Acc 84.4 / 85.7\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (53.309)\n",
      "semi Test: [100/157]\t Prec@1 54.688 (52.785)\n",
      "semi Test: [150/157]\t Prec@1 56.250 (53.063)\n",
      "semi Test Prec@1 52.84\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.744)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.180)\n",
      "sup Test: [150/157]\t Prec@1 54.688 (48.872)\n",
      "sup Test Prec@1 48.79\n",
      "[1/2][297/782] Loss_D: 1.55 Loss_G: 9.18 D(x): 0.79 D(G(z)): 0.57 / 0.26 | Acc 96.9 / 85.7\n",
      "[1/2][298/782] Loss_D: 1.55 Loss_G: 8.63 D(x): 0.66 D(G(z)): 0.37 / 0.43 | Acc 81.2 / 85.7\n",
      "[1/2][299/782] Loss_D: 1.55 Loss_G: 9.16 D(x): 0.75 D(G(z)): 0.53 / 0.24 | Acc 96.9 / 85.7\n",
      "[1/2][300/782] Loss_D: 1.98 Loss_G: 8.22 D(x): 0.51 D(G(z)): 0.35 / 0.62 | Acc 78.1 / 85.7\n",
      "[1/2][301/782] Loss_D: 1.91 Loss_G: 9.40 D(x): 0.84 D(G(z)): 0.69 / 0.21 | Acc 93.8 / 85.7\n",
      "[1/2][302/782] Loss_D: 1.51 Loss_G: 8.83 D(x): 0.60 D(G(z)): 0.29 / 0.39 | Acc 82.8 / 85.7\n",
      "[1/2][303/782] Loss_D: 1.55 Loss_G: 8.74 D(x): 0.77 D(G(z)): 0.51 / 0.36 | Acc 87.5 / 85.7\n",
      "[1/2][304/782] Loss_D: 1.37 Loss_G: 8.92 D(x): 0.72 D(G(z)): 0.42 / 0.29 | Acc 93.8 / 85.8\n",
      "[1/2][305/782] Loss_D: 1.68 Loss_G: 8.43 D(x): 0.63 D(G(z)): 0.40 / 0.46 | Acc 87.5 / 85.8\n",
      "[1/2][306/782] Loss_D: 1.67 Loss_G: 9.10 D(x): 0.78 D(G(z)): 0.58 / 0.27 | Acc 93.8 / 85.8\n",
      "semi Test: [0/157]\t Prec@1 53.125 (53.125)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (50.674)\n",
      "semi Test: [100/157]\t Prec@1 50.000 (50.959)\n",
      "semi Test: [150/157]\t Prec@1 48.438 (51.438)\n",
      "semi Test Prec@1 51.22\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 56.250 (48.683)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.149)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.789)\n",
      "sup Test Prec@1 48.68\n",
      "[1/2][307/782] Loss_D: 1.59 Loss_G: 8.45 D(x): 0.63 D(G(z)): 0.36 / 0.53 | Acc 78.1 / 85.8\n",
      "[1/2][308/782] Loss_D: 1.62 Loss_G: 9.57 D(x): 0.82 D(G(z)): 0.62 / 0.19 | Acc 96.9 / 85.8\n",
      "[1/2][309/782] Loss_D: 1.58 Loss_G: 8.50 D(x): 0.57 D(G(z)): 0.28 / 0.46 | Acc 82.8 / 85.8\n",
      "[1/2][310/782] Loss_D: 1.50 Loss_G: 8.76 D(x): 0.74 D(G(z)): 0.51 / 0.35 | Acc 95.3 / 85.8\n",
      "[1/2][311/782] Loss_D: 1.41 Loss_G: 9.21 D(x): 0.76 D(G(z)): 0.47 / 0.24 | Acc 92.2 / 85.8\n",
      "[1/2][312/782] Loss_D: 1.58 Loss_G: 8.26 D(x): 0.58 D(G(z)): 0.36 / 0.49 | Acc 92.2 / 85.9\n",
      "[1/2][313/782] Loss_D: 1.48 Loss_G: 9.21 D(x): 0.81 D(G(z)): 0.54 / 0.23 | Acc 90.6 / 85.9\n",
      "[1/2][314/782] Loss_D: 1.43 Loss_G: 8.74 D(x): 0.62 D(G(z)): 0.33 / 0.41 | Acc 92.2 / 85.9\n",
      "[1/2][315/782] Loss_D: 1.62 Loss_G: 9.02 D(x): 0.74 D(G(z)): 0.54 / 0.29 | Acc 90.6 / 85.9\n",
      "[1/2][316/782] Loss_D: 1.40 Loss_G: 8.86 D(x): 0.70 D(G(z)): 0.40 / 0.32 | Acc 87.5 / 85.9\n",
      "semi Test: [0/157]\t Prec@1 50.000 (50.000)\n",
      "semi Test: [50/157]\t Prec@1 43.750 (52.420)\n",
      "semi Test: [100/157]\t Prec@1 57.812 (52.336)\n",
      "semi Test: [150/157]\t Prec@1 48.438 (52.732)\n",
      "semi Test Prec@1 52.44\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.805)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.072)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.820)\n",
      "sup Test Prec@1 48.71\n",
      "[1/2][317/782] Loss_D: 1.51 Loss_G: 8.77 D(x): 0.69 D(G(z)): 0.44 / 0.38 | Acc 95.3 / 85.9\n",
      "[1/2][318/782] Loss_D: 1.63 Loss_G: 9.02 D(x): 0.73 D(G(z)): 0.51 / 0.27 | Acc 90.6 / 86.0\n",
      "[1/2][319/782] Loss_D: 1.59 Loss_G: 8.33 D(x): 0.62 D(G(z)): 0.38 / 0.48 | Acc 85.9 / 86.0\n",
      "[1/2][320/782] Loss_D: 1.60 Loss_G: 9.16 D(x): 0.75 D(G(z)): 0.58 / 0.23 | Acc 95.3 / 86.0\n",
      "[1/2][321/782] Loss_D: 1.80 Loss_G: 8.24 D(x): 0.58 D(G(z)): 0.34 / 0.55 | Acc 76.6 / 86.0\n",
      "[1/2][322/782] Loss_D: 1.77 Loss_G: 9.44 D(x): 0.78 D(G(z)): 0.65 / 0.19 | Acc 95.3 / 86.0\n",
      "[1/2][323/782] Loss_D: 1.55 Loss_G: 8.45 D(x): 0.57 D(G(z)): 0.29 / 0.40 | Acc 92.2 / 86.0\n",
      "[1/2][324/782] Loss_D: 1.50 Loss_G: 9.22 D(x): 0.75 D(G(z)): 0.55 / 0.23 | Acc 96.9 / 86.0\n",
      "[1/2][325/782] Loss_D: 1.46 Loss_G: 8.43 D(x): 0.59 D(G(z)): 0.35 / 0.42 | Acc 90.6 / 86.1\n",
      "[1/2][326/782] Loss_D: 1.64 Loss_G: 9.09 D(x): 0.80 D(G(z)): 0.56 / 0.29 | Acc 87.5 / 86.1\n",
      "semi Test: [0/157]\t Prec@1 53.125 (53.125)\n",
      "semi Test: [50/157]\t Prec@1 45.312 (51.777)\n",
      "semi Test: [100/157]\t Prec@1 59.375 (51.795)\n",
      "semi Test: [150/157]\t Prec@1 48.438 (52.142)\n",
      "semi Test Prec@1 51.98\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.499)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.994)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.779)\n",
      "sup Test Prec@1 48.66\n",
      "[1/2][327/782] Loss_D: 1.59 Loss_G: 8.68 D(x): 0.60 D(G(z)): 0.40 / 0.36 | Acc 89.1 / 86.1\n",
      "[1/2][328/782] Loss_D: 1.53 Loss_G: 8.75 D(x): 0.70 D(G(z)): 0.48 / 0.34 | Acc 89.1 / 86.1\n",
      "[1/2][329/782] Loss_D: 1.50 Loss_G: 8.89 D(x): 0.68 D(G(z)): 0.46 / 0.28 | Acc 92.2 / 86.1\n",
      "[1/2][330/782] Loss_D: 1.65 Loss_G: 8.28 D(x): 0.61 D(G(z)): 0.38 / 0.48 | Acc 89.1 / 86.1\n",
      "[1/2][331/782] Loss_D: 1.59 Loss_G: 9.31 D(x): 0.83 D(G(z)): 0.58 / 0.19 | Acc 87.5 / 86.1\n",
      "[1/2][332/782] Loss_D: 1.66 Loss_G: 8.29 D(x): 0.56 D(G(z)): 0.30 / 0.50 | Acc 84.4 / 86.1\n",
      "[1/2][333/782] Loss_D: 1.62 Loss_G: 9.43 D(x): 0.84 D(G(z)): 0.59 / 0.22 | Acc 93.8 / 86.1\n",
      "[1/2][334/782] Loss_D: 1.56 Loss_G: 8.55 D(x): 0.59 D(G(z)): 0.34 / 0.39 | Acc 90.6 / 86.1\n",
      "[1/2][335/782] Loss_D: 1.60 Loss_G: 8.99 D(x): 0.81 D(G(z)): 0.53 / 0.25 | Acc 87.5 / 86.1\n",
      "[1/2][336/782] Loss_D: 1.58 Loss_G: 8.23 D(x): 0.60 D(G(z)): 0.36 / 0.45 | Acc 89.1 / 86.2\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 56.250 (51.379)\n",
      "semi Test: [100/157]\t Prec@1 59.375 (51.686)\n",
      "semi Test: [150/157]\t Prec@1 54.688 (52.183)\n",
      "semi Test Prec@1 52.00\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (48.376)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.886)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.603)\n",
      "sup Test Prec@1 48.51\n",
      "[1/2][337/782] Loss_D: 1.70 Loss_G: 8.65 D(x): 0.72 D(G(z)): 0.56 / 0.33 | Acc 92.2 / 86.2\n",
      "[1/2][338/782] Loss_D: 1.56 Loss_G: 8.86 D(x): 0.68 D(G(z)): 0.47 / 0.32 | Acc 90.6 / 86.2\n",
      "[1/2][339/782] Loss_D: 1.51 Loss_G: 8.55 D(x): 0.70 D(G(z)): 0.42 / 0.39 | Acc 90.6 / 86.2\n",
      "[1/2][340/782] Loss_D: 1.44 Loss_G: 8.70 D(x): 0.74 D(G(z)): 0.47 / 0.30 | Acc 96.9 / 86.2\n",
      "[1/2][341/782] Loss_D: 1.77 Loss_G: 8.02 D(x): 0.56 D(G(z)): 0.42 / 0.49 | Acc 89.1 / 86.2\n",
      "[1/2][342/782] Loss_D: 1.62 Loss_G: 9.10 D(x): 0.76 D(G(z)): 0.59 / 0.25 | Acc 98.4 / 86.3\n",
      "[1/2][343/782] Loss_D: 1.96 Loss_G: 8.04 D(x): 0.57 D(G(z)): 0.33 / 0.57 | Acc 75.0 / 86.2\n",
      "[1/2][344/782] Loss_D: 1.72 Loss_G: 9.40 D(x): 0.85 D(G(z)): 0.67 / 0.19 | Acc 95.3 / 86.3\n",
      "[1/2][345/782] Loss_D: 1.66 Loss_G: 8.29 D(x): 0.56 D(G(z)): 0.27 / 0.49 | Acc 82.8 / 86.3\n",
      "[1/2][346/782] Loss_D: 1.49 Loss_G: 8.82 D(x): 0.84 D(G(z)): 0.58 / 0.25 | Acc 95.3 / 86.3\n",
      "semi Test: [0/157]\t Prec@1 50.000 (50.000)\n",
      "semi Test: [50/157]\t Prec@1 56.250 (51.808)\n",
      "semi Test: [100/157]\t Prec@1 56.250 (52.413)\n",
      "semi Test: [150/157]\t Prec@1 51.562 (52.887)\n",
      "semi Test Prec@1 52.70\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.468)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.840)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.500)\n",
      "sup Test Prec@1 48.41\n",
      "[1/2][347/782] Loss_D: 1.69 Loss_G: 8.48 D(x): 0.63 D(G(z)): 0.35 / 0.46 | Acc 82.8 / 86.3\n",
      "[1/2][348/782] Loss_D: 1.71 Loss_G: 8.76 D(x): 0.73 D(G(z)): 0.56 / 0.34 | Acc 87.5 / 86.3\n",
      "[1/2][349/782] Loss_D: 1.52 Loss_G: 8.59 D(x): 0.74 D(G(z)): 0.44 / 0.30 | Acc 87.5 / 86.3\n",
      "[1/2][350/782] Loss_D: 1.52 Loss_G: 8.48 D(x): 0.65 D(G(z)): 0.42 / 0.39 | Acc 89.1 / 86.3\n",
      "[1/2][351/782] Loss_D: 1.55 Loss_G: 8.66 D(x): 0.72 D(G(z)): 0.49 / 0.35 | Acc 90.6 / 86.3\n",
      "[1/2][352/782] Loss_D: 1.67 Loss_G: 8.50 D(x): 0.70 D(G(z)): 0.46 / 0.35 | Acc 84.4 / 86.3\n",
      "[1/2][353/782] Loss_D: 1.66 Loss_G: 8.49 D(x): 0.68 D(G(z)): 0.47 / 0.37 | Acc 87.5 / 86.3\n",
      "[1/2][354/782] Loss_D: 1.74 Loss_G: 8.66 D(x): 0.65 D(G(z)): 0.49 / 0.39 | Acc 87.5 / 86.3\n",
      "[1/2][355/782] Loss_D: 1.60 Loss_G: 8.72 D(x): 0.72 D(G(z)): 0.51 / 0.31 | Acc 95.3 / 86.3\n",
      "[1/2][356/782] Loss_D: 1.60 Loss_G: 8.65 D(x): 0.69 D(G(z)): 0.43 / 0.36 | Acc 84.4 / 86.3\n",
      "semi Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "semi Test: [50/157]\t Prec@1 53.125 (50.888)\n",
      "semi Test: [100/157]\t Prec@1 54.688 (50.217)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (50.797)\n",
      "semi Test Prec@1 50.67\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.591)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.902)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.541)\n",
      "sup Test Prec@1 48.41\n",
      "[1/2][357/782] Loss_D: 1.65 Loss_G: 8.57 D(x): 0.70 D(G(z)): 0.49 / 0.35 | Acc 84.4 / 86.3\n",
      "[1/2][358/782] Loss_D: 1.67 Loss_G: 8.60 D(x): 0.64 D(G(z)): 0.46 / 0.37 | Acc 89.1 / 86.3\n",
      "[1/2][359/782] Loss_D: 1.45 Loss_G: 9.05 D(x): 0.80 D(G(z)): 0.49 / 0.22 | Acc 90.6 / 86.3\n",
      "[1/2][360/782] Loss_D: 1.38 Loss_G: 8.60 D(x): 0.66 D(G(z)): 0.34 / 0.36 | Acc 89.1 / 86.3\n",
      "[1/2][361/782] Loss_D: 1.55 Loss_G: 8.38 D(x): 0.70 D(G(z)): 0.47 / 0.40 | Acc 90.6 / 86.4\n",
      "[1/2][362/782] Loss_D: 1.44 Loss_G: 9.66 D(x): 0.83 D(G(z)): 0.54 / 0.14 | Acc 93.8 / 86.4\n",
      "[1/2][363/782] Loss_D: 1.98 Loss_G: 7.69 D(x): 0.49 D(G(z)): 0.23 / 0.73 | Acc 60.9 / 86.3\n",
      "[1/2][364/782] Loss_D: 2.21 Loss_G: 9.31 D(x): 0.91 D(G(z)): 0.79 / 0.19 | Acc 96.9 / 86.3\n",
      "[1/2][365/782] Loss_D: 1.91 Loss_G: 8.36 D(x): 0.54 D(G(z)): 0.31 / 0.43 | Acc 71.9 / 86.3\n",
      "[1/2][366/782] Loss_D: 1.66 Loss_G: 8.66 D(x): 0.78 D(G(z)): 0.52 / 0.35 | Acc 85.9 / 86.3\n",
      "semi Test: [0/157]\t Prec@1 57.812 (57.812)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (52.512)\n",
      "semi Test: [100/157]\t Prec@1 53.125 (52.614)\n",
      "semi Test: [150/157]\t Prec@1 54.688 (52.794)\n",
      "semi Test Prec@1 52.62\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.591)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.056)\n",
      "sup Test: [150/157]\t Prec@1 54.688 (48.675)\n",
      "sup Test Prec@1 48.56\n",
      "[1/2][367/782] Loss_D: 1.74 Loss_G: 8.82 D(x): 0.67 D(G(z)): 0.50 / 0.29 | Acc 89.1 / 86.3\n",
      "[1/2][368/782] Loss_D: 1.41 Loss_G: 8.52 D(x): 0.71 D(G(z)): 0.42 / 0.37 | Acc 92.2 / 86.3\n",
      "[1/2][369/782] Loss_D: 1.61 Loss_G: 8.58 D(x): 0.74 D(G(z)): 0.51 / 0.30 | Acc 87.5 / 86.3\n",
      "[1/2][370/782] Loss_D: 1.45 Loss_G: 8.46 D(x): 0.67 D(G(z)): 0.41 / 0.35 | Acc 93.8 / 86.3\n",
      "[1/2][371/782] Loss_D: 1.66 Loss_G: 8.32 D(x): 0.66 D(G(z)): 0.47 / 0.42 | Acc 92.2 / 86.4\n",
      "[1/2][372/782] Loss_D: 1.52 Loss_G: 9.21 D(x): 0.85 D(G(z)): 0.54 / 0.20 | Acc 89.1 / 86.4\n",
      "[1/2][373/782] Loss_D: 1.60 Loss_G: 8.07 D(x): 0.57 D(G(z)): 0.31 / 0.46 | Acc 79.7 / 86.3\n",
      "[1/2][374/782] Loss_D: 1.75 Loss_G: 8.75 D(x): 0.71 D(G(z)): 0.56 / 0.35 | Acc 89.1 / 86.3\n",
      "[1/2][375/782] Loss_D: 1.64 Loss_G: 8.42 D(x): 0.61 D(G(z)): 0.45 / 0.39 | Acc 90.6 / 86.4\n",
      "[1/2][376/782] Loss_D: 1.43 Loss_G: 9.05 D(x): 0.77 D(G(z)): 0.51 / 0.22 | Acc 93.8 / 86.4\n",
      "semi Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "semi Test: [50/157]\t Prec@1 50.000 (51.685)\n",
      "semi Test: [100/157]\t Prec@1 53.125 (50.959)\n",
      "semi Test: [150/157]\t Prec@1 51.562 (51.293)\n",
      "semi Test Prec@1 51.18\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (48.928)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.211)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.862)\n",
      "sup Test Prec@1 48.71\n",
      "[1/2][377/782] Loss_D: 1.63 Loss_G: 8.05 D(x): 0.63 D(G(z)): 0.34 / 0.52 | Acc 78.1 / 86.4\n",
      "[1/2][378/782] Loss_D: 1.66 Loss_G: 9.11 D(x): 0.81 D(G(z)): 0.62 / 0.20 | Acc 98.4 / 86.4\n",
      "[1/2][379/782] Loss_D: 1.47 Loss_G: 8.27 D(x): 0.59 D(G(z)): 0.32 / 0.45 | Acc 89.1 / 86.4\n",
      "[1/2][380/782] Loss_D: 1.49 Loss_G: 8.88 D(x): 0.81 D(G(z)): 0.55 / 0.25 | Acc 87.5 / 86.4\n",
      "[1/2][381/782] Loss_D: 1.64 Loss_G: 8.27 D(x): 0.56 D(G(z)): 0.36 / 0.43 | Acc 87.5 / 86.4\n",
      "[1/2][382/782] Loss_D: 1.50 Loss_G: 8.85 D(x): 0.79 D(G(z)): 0.52 / 0.27 | Acc 90.6 / 86.4\n",
      "[1/2][383/782] Loss_D: 1.47 Loss_G: 8.34 D(x): 0.63 D(G(z)): 0.36 / 0.44 | Acc 87.5 / 86.4\n",
      "[1/2][384/782] Loss_D: 1.57 Loss_G: 8.86 D(x): 0.78 D(G(z)): 0.56 / 0.24 | Acc 89.1 / 86.4\n",
      "[1/2][385/782] Loss_D: 1.58 Loss_G: 8.07 D(x): 0.56 D(G(z)): 0.34 / 0.46 | Acc 87.5 / 86.4\n",
      "[1/2][386/782] Loss_D: 1.67 Loss_G: 8.58 D(x): 0.75 D(G(z)): 0.56 / 0.31 | Acc 90.6 / 86.4\n",
      "semi Test: [0/157]\t Prec@1 53.125 (53.125)\n",
      "semi Test: [50/157]\t Prec@1 50.000 (51.072)\n",
      "semi Test: [100/157]\t Prec@1 56.250 (50.820)\n",
      "semi Test: [150/157]\t Prec@1 53.125 (50.869)\n",
      "semi Test Prec@1 50.62\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.775)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.180)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.872)\n",
      "sup Test Prec@1 48.75\n",
      "[1/2][387/782] Loss_D: 1.79 Loss_G: 7.90 D(x): 0.54 D(G(z)): 0.42 / 0.55 | Acc 89.1 / 86.4\n",
      "[1/2][388/782] Loss_D: 1.79 Loss_G: 9.28 D(x): 0.81 D(G(z)): 0.67 / 0.18 | Acc 96.9 / 86.5\n",
      "[1/2][389/782] Loss_D: 1.95 Loss_G: 7.66 D(x): 0.42 D(G(z)): 0.26 / 0.67 | Acc 82.8 / 86.5\n",
      "[1/2][390/782] Loss_D: 1.95 Loss_G: 9.12 D(x): 0.90 D(G(z)): 0.75 / 0.20 | Acc 98.4 / 86.5\n",
      "[1/2][391/782] Loss_D: 1.32 Loss_G: 8.81 D(x): 0.66 D(G(z)): 0.30 / 0.26 | Acc 85.9 / 86.5\n",
      "[1/2][392/782] Loss_D: 1.37 Loss_G: 8.29 D(x): 0.73 D(G(z)): 0.39 / 0.39 | Acc 93.8 / 86.5\n",
      "[1/2][393/782] Loss_D: 1.63 Loss_G: 8.37 D(x): 0.66 D(G(z)): 0.52 / 0.39 | Acc 95.3 / 86.5\n",
      "[1/2][394/782] Loss_D: 1.44 Loss_G: 8.85 D(x): 0.73 D(G(z)): 0.51 / 0.26 | Acc 96.9 / 86.6\n",
      "[1/2][395/782] Loss_D: 1.60 Loss_G: 8.01 D(x): 0.58 D(G(z)): 0.36 / 0.49 | Acc 84.4 / 86.6\n",
      "[1/2][396/782] Loss_D: 1.74 Loss_G: 8.42 D(x): 0.70 D(G(z)): 0.58 / 0.35 | Acc 93.8 / 86.6\n",
      "semi Test: [0/157]\t Prec@1 50.000 (50.000)\n",
      "semi Test: [50/157]\t Prec@1 43.750 (53.309)\n",
      "semi Test: [100/157]\t Prec@1 57.812 (52.584)\n",
      "semi Test: [150/157]\t Prec@1 53.125 (52.701)\n",
      "semi Test Prec@1 52.52\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.468)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (48.948)\n",
      "sup Test: [150/157]\t Prec@1 54.688 (48.655)\n",
      "sup Test Prec@1 48.56\n",
      "[1/2][397/782] Loss_D: 1.41 Loss_G: 8.60 D(x): 0.69 D(G(z)): 0.43 / 0.26 | Acc 92.2 / 86.6\n",
      "[1/2][398/782] Loss_D: 1.42 Loss_G: 8.07 D(x): 0.65 D(G(z)): 0.36 / 0.43 | Acc 89.1 / 86.6\n",
      "[1/2][399/782] Loss_D: 1.50 Loss_G: 8.53 D(x): 0.73 D(G(z)): 0.54 / 0.32 | Acc 96.9 / 86.6\n",
      "[1/2][400/782] Loss_D: 1.48 Loss_G: 8.49 D(x): 0.71 D(G(z)): 0.44 / 0.35 | Acc 89.1 / 86.6\n",
      "[1/2][401/782] Loss_D: 1.70 Loss_G: 8.20 D(x): 0.61 D(G(z)): 0.47 / 0.45 | Acc 92.2 / 86.6\n",
      "[1/2][402/782] Loss_D: 1.65 Loss_G: 8.34 D(x): 0.69 D(G(z)): 0.53 / 0.34 | Acc 96.9 / 86.7\n",
      "[1/2][403/782] Loss_D: 1.61 Loss_G: 8.53 D(x): 0.67 D(G(z)): 0.44 / 0.36 | Acc 84.4 / 86.7\n",
      "[1/2][404/782] Loss_D: 1.53 Loss_G: 8.32 D(x): 0.69 D(G(z)): 0.47 / 0.39 | Acc 93.8 / 86.7\n",
      "[1/2][405/782] Loss_D: 1.58 Loss_G: 8.55 D(x): 0.69 D(G(z)): 0.49 / 0.30 | Acc 92.2 / 86.7\n",
      "[1/2][406/782] Loss_D: 1.31 Loss_G: 8.67 D(x): 0.69 D(G(z)): 0.38 / 0.29 | Acc 92.2 / 86.7\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 54.688 (53.248)\n",
      "semi Test: [100/157]\t Prec@1 45.312 (52.367)\n",
      "semi Test: [150/157]\t Prec@1 50.000 (52.494)\n",
      "semi Test Prec@1 52.28\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 56.250 (48.591)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.979)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.665)\n",
      "sup Test Prec@1 48.59\n",
      "[1/2][407/782] Loss_D: 1.36 Loss_G: 8.47 D(x): 0.69 D(G(z)): 0.41 / 0.37 | Acc 95.3 / 86.7\n",
      "[1/2][408/782] Loss_D: 1.35 Loss_G: 8.61 D(x): 0.76 D(G(z)): 0.46 / 0.29 | Acc 93.8 / 86.7\n",
      "[1/2][409/782] Loss_D: 1.56 Loss_G: 8.20 D(x): 0.65 D(G(z)): 0.40 / 0.41 | Acc 85.9 / 86.7\n",
      "[1/2][410/782] Loss_D: 1.48 Loss_G: 8.73 D(x): 0.75 D(G(z)): 0.51 / 0.29 | Acc 92.2 / 86.8\n",
      "[1/2][411/782] Loss_D: 1.43 Loss_G: 8.17 D(x): 0.63 D(G(z)): 0.40 / 0.40 | Acc 98.4 / 86.8\n",
      "[1/2][412/782] Loss_D: 1.73 Loss_G: 8.03 D(x): 0.60 D(G(z)): 0.51 / 0.47 | Acc 95.3 / 86.8\n",
      "[1/2][413/782] Loss_D: 1.45 Loss_G: 9.26 D(x): 0.77 D(G(z)): 0.56 / 0.15 | Acc 100.0 / 86.8\n",
      "[1/2][414/782] Loss_D: 1.76 Loss_G: 7.68 D(x): 0.51 D(G(z)): 0.24 / 0.67 | Acc 76.6 / 86.8\n",
      "[1/2][415/782] Loss_D: 1.78 Loss_G: 9.39 D(x): 0.91 D(G(z)): 0.72 / 0.17 | Acc 98.4 / 86.8\n",
      "[1/2][416/782] Loss_D: 1.60 Loss_G: 7.94 D(x): 0.51 D(G(z)): 0.25 / 0.53 | Acc 79.7 / 86.8\n",
      "semi Test: [0/157]\t Prec@1 50.000 (50.000)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (52.451)\n",
      "semi Test: [100/157]\t Prec@1 54.688 (52.367)\n",
      "semi Test: [150/157]\t Prec@1 53.125 (52.866)\n",
      "semi Test Prec@1 52.64\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 56.250 (48.621)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.917)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.624)\n",
      "sup Test Prec@1 48.53\n",
      "[1/2][417/782] Loss_D: 1.63 Loss_G: 8.65 D(x): 0.84 D(G(z)): 0.60 / 0.27 | Acc 92.2 / 86.8\n",
      "[1/2][418/782] Loss_D: 1.26 Loss_G: 8.67 D(x): 0.72 D(G(z)): 0.37 / 0.27 | Acc 93.8 / 86.8\n",
      "[1/2][419/782] Loss_D: 1.52 Loss_G: 7.71 D(x): 0.61 D(G(z)): 0.37 / 0.54 | Acc 89.1 / 86.9\n",
      "[1/2][420/782] Loss_D: 1.78 Loss_G: 8.54 D(x): 0.75 D(G(z)): 0.62 / 0.31 | Acc 93.8 / 86.9\n",
      "[1/2][421/782] Loss_D: 1.64 Loss_G: 8.02 D(x): 0.59 D(G(z)): 0.40 / 0.44 | Acc 85.9 / 86.9\n",
      "[1/2][422/782] Loss_D: 1.46 Loss_G: 8.32 D(x): 0.75 D(G(z)): 0.51 / 0.32 | Acc 93.8 / 86.9\n",
      "[1/2][423/782] Loss_D: 1.59 Loss_G: 8.06 D(x): 0.59 D(G(z)): 0.41 / 0.44 | Acc 95.3 / 86.9\n",
      "[1/2][424/782] Loss_D: 1.52 Loss_G: 8.45 D(x): 0.76 D(G(z)): 0.54 / 0.29 | Acc 95.3 / 86.9\n",
      "[1/2][425/782] Loss_D: 1.63 Loss_G: 7.97 D(x): 0.56 D(G(z)): 0.38 / 0.46 | Acc 95.3 / 86.9\n",
      "[1/2][426/782] Loss_D: 1.29 Loss_G: 8.80 D(x): 0.83 D(G(z)): 0.53 / 0.23 | Acc 96.9 / 87.0\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (52.328)\n",
      "semi Test: [100/157]\t Prec@1 53.125 (52.475)\n",
      "semi Test: [150/157]\t Prec@1 59.375 (53.135)\n",
      "semi Test Prec@1 52.84\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.621)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.056)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.707)\n",
      "sup Test Prec@1 48.59\n",
      "[1/2][427/782] Loss_D: 1.66 Loss_G: 7.94 D(x): 0.50 D(G(z)): 0.31 / 0.52 | Acc 90.6 / 87.0\n",
      "[1/2][428/782] Loss_D: 1.60 Loss_G: 8.43 D(x): 0.80 D(G(z)): 0.61 / 0.31 | Acc 95.3 / 87.0\n",
      "[1/2][429/782] Loss_D: 1.58 Loss_G: 8.17 D(x): 0.62 D(G(z)): 0.40 / 0.40 | Acc 87.5 / 87.0\n",
      "[1/2][430/782] Loss_D: 1.51 Loss_G: 8.40 D(x): 0.72 D(G(z)): 0.52 / 0.32 | Acc 93.8 / 87.0\n",
      "[1/2][431/782] Loss_D: 1.48 Loss_G: 8.11 D(x): 0.71 D(G(z)): 0.41 / 0.39 | Acc 79.7 / 87.0\n",
      "[1/2][432/782] Loss_D: 1.59 Loss_G: 8.20 D(x): 0.66 D(G(z)): 0.50 / 0.37 | Acc 92.2 / 87.0\n",
      "[1/2][433/782] Loss_D: 1.54 Loss_G: 8.47 D(x): 0.68 D(G(z)): 0.47 / 0.33 | Acc 95.3 / 87.0\n",
      "[1/2][434/782] Loss_D: 1.46 Loss_G: 8.12 D(x): 0.68 D(G(z)): 0.41 / 0.41 | Acc 93.8 / 87.0\n",
      "[1/2][435/782] Loss_D: 1.48 Loss_G: 8.72 D(x): 0.76 D(G(z)): 0.50 / 0.26 | Acc 92.2 / 87.1\n",
      "[1/2][436/782] Loss_D: 1.43 Loss_G: 8.26 D(x): 0.59 D(G(z)): 0.37 / 0.40 | Acc 96.9 / 87.1\n",
      "semi Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "semi Test: [50/157]\t Prec@1 46.875 (52.512)\n",
      "semi Test: [100/157]\t Prec@1 53.125 (51.918)\n",
      "semi Test: [150/157]\t Prec@1 50.000 (52.494)\n",
      "semi Test Prec@1 52.22\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.529)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (48.793)\n",
      "sup Test: [150/157]\t Prec@1 54.688 (48.572)\n",
      "sup Test Prec@1 48.47\n",
      "[1/2][437/782] Loss_D: 1.34 Loss_G: 8.54 D(x): 0.83 D(G(z)): 0.50 / 0.22 | Acc 96.9 / 87.1\n",
      "[1/2][438/782] Loss_D: 1.61 Loss_G: 7.57 D(x): 0.57 D(G(z)): 0.32 / 0.54 | Acc 85.9 / 87.1\n",
      "[1/2][439/782] Loss_D: 1.85 Loss_G: 8.71 D(x): 0.78 D(G(z)): 0.65 / 0.23 | Acc 93.8 / 87.1\n",
      "[1/2][440/782] Loss_D: 2.13 Loss_G: 7.44 D(x): 0.49 D(G(z)): 0.33 / 0.69 | Acc 65.6 / 87.1\n",
      "[1/2][441/782] Loss_D: 1.99 Loss_G: 8.50 D(x): 0.85 D(G(z)): 0.75 / 0.28 | Acc 100.0 / 87.1\n",
      "[1/2][442/782] Loss_D: 1.47 Loss_G: 8.43 D(x): 0.67 D(G(z)): 0.39 / 0.28 | Acc 82.8 / 87.1\n",
      "[1/2][443/782] Loss_D: 1.53 Loss_G: 7.82 D(x): 0.60 D(G(z)): 0.37 / 0.49 | Acc 92.2 / 87.1\n",
      "[1/2][444/782] Loss_D: 1.64 Loss_G: 8.39 D(x): 0.78 D(G(z)): 0.60 / 0.30 | Acc 96.9 / 87.1\n",
      "[1/2][445/782] Loss_D: 1.45 Loss_G: 8.44 D(x): 0.62 D(G(z)): 0.40 / 0.33 | Acc 95.3 / 87.1\n",
      "[1/2][446/782] Loss_D: 1.60 Loss_G: 7.88 D(x): 0.66 D(G(z)): 0.45 / 0.44 | Acc 87.5 / 87.1\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (50.950)\n",
      "semi Test: [100/157]\t Prec@1 45.312 (50.387)\n",
      "semi Test: [150/157]\t Prec@1 48.438 (50.683)\n",
      "semi Test Prec@1 50.45\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 56.250 (48.376)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (48.902)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.613)\n",
      "sup Test Prec@1 48.51\n",
      "[1/2][447/782] Loss_D: 1.52 Loss_G: 8.31 D(x): 0.74 D(G(z)): 0.53 / 0.30 | Acc 93.8 / 87.1\n",
      "[1/2][448/782] Loss_D: 1.67 Loss_G: 7.80 D(x): 0.62 D(G(z)): 0.40 / 0.46 | Acc 78.1 / 87.1\n",
      "[1/2][449/782] Loss_D: 1.74 Loss_G: 8.25 D(x): 0.73 D(G(z)): 0.56 / 0.32 | Acc 89.1 / 87.1\n",
      "[1/2][450/782] Loss_D: 1.37 Loss_G: 8.34 D(x): 0.68 D(G(z)): 0.40 / 0.31 | Acc 93.8 / 87.1\n",
      "[1/2][451/782] Loss_D: 1.46 Loss_G: 8.31 D(x): 0.70 D(G(z)): 0.43 / 0.33 | Acc 90.6 / 87.2\n",
      "[1/2][452/782] Loss_D: 1.34 Loss_G: 8.80 D(x): 0.75 D(G(z)): 0.45 / 0.25 | Acc 93.8 / 87.2\n",
      "[1/2][453/782] Loss_D: 1.45 Loss_G: 7.92 D(x): 0.64 D(G(z)): 0.36 / 0.44 | Acc 87.5 / 87.2\n",
      "[1/2][454/782] Loss_D: 1.61 Loss_G: 8.26 D(x): 0.80 D(G(z)): 0.58 / 0.30 | Acc 92.2 / 87.2\n",
      "[1/2][455/782] Loss_D: 1.46 Loss_G: 8.16 D(x): 0.63 D(G(z)): 0.41 / 0.34 | Acc 95.3 / 87.2\n",
      "[1/2][456/782] Loss_D: 1.69 Loss_G: 7.82 D(x): 0.67 D(G(z)): 0.47 / 0.43 | Acc 87.5 / 87.2\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (52.482)\n",
      "semi Test: [100/157]\t Prec@1 46.875 (52.027)\n",
      "semi Test: [150/157]\t Prec@1 54.688 (52.401)\n",
      "semi Test Prec@1 52.19\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.805)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.165)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.882)\n",
      "sup Test Prec@1 48.76\n",
      "[1/2][457/782] Loss_D: 1.55 Loss_G: 8.32 D(x): 0.68 D(G(z)): 0.52 / 0.31 | Acc 98.4 / 87.2\n",
      "[1/2][458/782] Loss_D: 1.59 Loss_G: 7.95 D(x): 0.64 D(G(z)): 0.41 / 0.42 | Acc 85.9 / 87.2\n",
      "[1/2][459/782] Loss_D: 1.52 Loss_G: 8.28 D(x): 0.73 D(G(z)): 0.55 / 0.30 | Acc 96.9 / 87.2\n",
      "[1/2][460/782] Loss_D: 1.46 Loss_G: 8.30 D(x): 0.70 D(G(z)): 0.43 / 0.36 | Acc 87.5 / 87.2\n",
      "[1/2][461/782] Loss_D: 1.57 Loss_G: 7.90 D(x): 0.66 D(G(z)): 0.45 / 0.43 | Acc 89.1 / 87.2\n",
      "[1/2][462/782] Loss_D: 1.45 Loss_G: 8.56 D(x): 0.76 D(G(z)): 0.54 / 0.22 | Acc 98.4 / 87.3\n",
      "[1/2][463/782] Loss_D: 1.79 Loss_G: 7.55 D(x): 0.53 D(G(z)): 0.32 / 0.59 | Acc 79.7 / 87.3\n",
      "[1/2][464/782] Loss_D: 1.82 Loss_G: 8.38 D(x): 0.83 D(G(z)): 0.67 / 0.24 | Acc 90.6 / 87.3\n",
      "[1/2][465/782] Loss_D: 1.48 Loss_G: 8.04 D(x): 0.57 D(G(z)): 0.34 / 0.41 | Acc 89.1 / 87.3\n",
      "[1/2][466/782] Loss_D: 1.42 Loss_G: 8.26 D(x): 0.75 D(G(z)): 0.52 / 0.33 | Acc 93.8 / 87.3\n",
      "semi Test: [0/157]\t Prec@1 50.000 (50.000)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (53.431)\n",
      "semi Test: [100/157]\t Prec@1 50.000 (52.413)\n",
      "semi Test: [150/157]\t Prec@1 51.562 (53.177)\n",
      "semi Test Prec@1 52.93\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 56.250 (48.744)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (48.979)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.810)\n",
      "sup Test Prec@1 48.68\n",
      "[1/2][467/782] Loss_D: 1.37 Loss_G: 8.51 D(x): 0.72 D(G(z)): 0.44 / 0.27 | Acc 92.2 / 87.3\n",
      "[1/2][468/782] Loss_D: 1.60 Loss_G: 7.64 D(x): 0.57 D(G(z)): 0.38 / 0.53 | Acc 87.5 / 87.3\n",
      "[1/2][469/782] Loss_D: 1.74 Loss_G: 8.29 D(x): 0.77 D(G(z)): 0.63 / 0.28 | Acc 93.8 / 87.3\n",
      "[1/2][470/782] Loss_D: 1.77 Loss_G: 7.66 D(x): 0.50 D(G(z)): 0.38 / 0.48 | Acc 92.2 / 87.3\n",
      "[1/2][471/782] Loss_D: 1.66 Loss_G: 8.20 D(x): 0.73 D(G(z)): 0.57 / 0.32 | Acc 95.3 / 87.3\n",
      "[1/2][472/782] Loss_D: 1.52 Loss_G: 8.13 D(x): 0.65 D(G(z)): 0.45 / 0.33 | Acc 93.8 / 87.3\n",
      "[1/2][473/782] Loss_D: 1.66 Loss_G: 7.81 D(x): 0.58 D(G(z)): 0.41 / 0.46 | Acc 90.6 / 87.4\n",
      "[1/2][474/782] Loss_D: 1.49 Loss_G: 8.55 D(x): 0.77 D(G(z)): 0.55 / 0.27 | Acc 100.0 / 87.4\n",
      "[1/2][475/782] Loss_D: 1.47 Loss_G: 7.98 D(x): 0.56 D(G(z)): 0.37 / 0.42 | Acc 95.3 / 87.4\n",
      "[1/2][476/782] Loss_D: 1.41 Loss_G: 8.66 D(x): 0.75 D(G(z)): 0.53 / 0.27 | Acc 95.3 / 87.4\n",
      "semi Test: [0/157]\t Prec@1 50.000 (50.000)\n",
      "semi Test: [50/157]\t Prec@1 45.312 (52.972)\n",
      "semi Test: [100/157]\t Prec@1 43.750 (52.150)\n",
      "semi Test: [150/157]\t Prec@1 53.125 (52.525)\n",
      "semi Test Prec@1 52.31\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 56.250 (48.775)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.196)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.872)\n",
      "sup Test Prec@1 48.77\n",
      "[1/2][477/782] Loss_D: 1.90 Loss_G: 7.37 D(x): 0.49 D(G(z)): 0.39 / 0.60 | Acc 84.4 / 87.4\n",
      "[1/2][478/782] Loss_D: 1.78 Loss_G: 8.48 D(x): 0.82 D(G(z)): 0.68 / 0.23 | Acc 98.4 / 87.4\n",
      "[1/2][479/782] Loss_D: 1.46 Loss_G: 8.12 D(x): 0.61 D(G(z)): 0.32 / 0.35 | Acc 87.5 / 87.4\n",
      "[1/2][480/782] Loss_D: 1.60 Loss_G: 7.72 D(x): 0.62 D(G(z)): 0.44 / 0.49 | Acc 95.3 / 87.4\n",
      "[1/2][481/782] Loss_D: 1.58 Loss_G: 8.58 D(x): 0.80 D(G(z)): 0.58 / 0.24 | Acc 96.9 / 87.5\n",
      "[1/2][482/782] Loss_D: 1.62 Loss_G: 7.78 D(x): 0.55 D(G(z)): 0.37 / 0.46 | Acc 92.2 / 87.5\n",
      "[1/2][483/782] Loss_D: 1.52 Loss_G: 8.29 D(x): 0.77 D(G(z)): 0.54 / 0.28 | Acc 92.2 / 87.5\n",
      "[1/2][484/782] Loss_D: 1.52 Loss_G: 7.87 D(x): 0.60 D(G(z)): 0.38 / 0.41 | Acc 93.8 / 87.5\n",
      "[1/2][485/782] Loss_D: 1.47 Loss_G: 8.19 D(x): 0.73 D(G(z)): 0.50 / 0.32 | Acc 93.8 / 87.5\n",
      "[1/2][486/782] Loss_D: 1.43 Loss_G: 7.99 D(x): 0.64 D(G(z)): 0.42 / 0.38 | Acc 95.3 / 87.5\n",
      "semi Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "semi Test: [50/157]\t Prec@1 50.000 (52.972)\n",
      "semi Test: [100/157]\t Prec@1 46.875 (53.171)\n",
      "semi Test: [150/157]\t Prec@1 53.125 (53.622)\n",
      "semi Test Prec@1 53.36\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.897)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.273)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.934)\n",
      "sup Test Prec@1 48.81\n",
      "[1/2][487/782] Loss_D: 1.50 Loss_G: 8.21 D(x): 0.74 D(G(z)): 0.48 / 0.32 | Acc 90.6 / 87.5\n",
      "[1/2][488/782] Loss_D: 1.26 Loss_G: 8.42 D(x): 0.77 D(G(z)): 0.42 / 0.27 | Acc 93.8 / 87.5\n",
      "[1/2][489/782] Loss_D: 1.62 Loss_G: 7.61 D(x): 0.55 D(G(z)): 0.37 / 0.55 | Acc 90.6 / 87.6\n",
      "[1/2][490/782] Loss_D: 1.64 Loss_G: 8.50 D(x): 0.80 D(G(z)): 0.62 / 0.28 | Acc 96.9 / 87.6\n",
      "[1/2][491/782] Loss_D: 1.33 Loss_G: 8.22 D(x): 0.69 D(G(z)): 0.37 / 0.29 | Acc 92.2 / 87.6\n",
      "[1/2][492/782] Loss_D: 1.35 Loss_G: 7.80 D(x): 0.68 D(G(z)): 0.38 / 0.40 | Acc 92.2 / 87.6\n",
      "[1/2][493/782] Loss_D: 1.49 Loss_G: 8.37 D(x): 0.75 D(G(z)): 0.51 / 0.27 | Acc 89.1 / 87.6\n",
      "[1/2][494/782] Loss_D: 1.37 Loss_G: 8.31 D(x): 0.66 D(G(z)): 0.38 / 0.29 | Acc 92.2 / 87.6\n",
      "[1/2][495/782] Loss_D: 1.45 Loss_G: 7.70 D(x): 0.60 D(G(z)): 0.38 / 0.49 | Acc 95.3 / 87.6\n",
      "[1/2][496/782] Loss_D: 1.37 Loss_G: 8.71 D(x): 0.82 D(G(z)): 0.58 / 0.19 | Acc 98.4 / 87.6\n",
      "semi Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (52.053)\n",
      "semi Test: [100/157]\t Prec@1 43.750 (51.949)\n",
      "semi Test: [150/157]\t Prec@1 53.125 (52.411)\n",
      "semi Test Prec@1 52.30\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 56.250 (48.529)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (48.963)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.748)\n",
      "sup Test Prec@1 48.66\n",
      "[1/2][497/782] Loss_D: 1.47 Loss_G: 7.58 D(x): 0.57 D(G(z)): 0.28 / 0.50 | Acc 85.9 / 87.6\n",
      "[1/2][498/782] Loss_D: 1.66 Loss_G: 8.37 D(x): 0.80 D(G(z)): 0.60 / 0.27 | Acc 96.9 / 87.7\n",
      "[1/2][499/782] Loss_D: 1.32 Loss_G: 8.36 D(x): 0.69 D(G(z)): 0.37 / 0.32 | Acc 90.6 / 87.7\n",
      "[1/2][500/782] Loss_D: 1.42 Loss_G: 7.78 D(x): 0.65 D(G(z)): 0.40 / 0.45 | Acc 89.1 / 87.7\n",
      "[1/2][501/782] Loss_D: 1.53 Loss_G: 8.06 D(x): 0.67 D(G(z)): 0.53 / 0.34 | Acc 98.4 / 87.7\n",
      "[1/2][502/782] Loss_D: 1.42 Loss_G: 8.16 D(x): 0.71 D(G(z)): 0.44 / 0.29 | Acc 93.8 / 87.7\n",
      "[1/2][503/782] Loss_D: 1.47 Loss_G: 7.52 D(x): 0.63 D(G(z)): 0.38 / 0.48 | Acc 89.1 / 87.7\n",
      "[1/2][504/782] Loss_D: 1.44 Loss_G: 8.45 D(x): 0.77 D(G(z)): 0.55 / 0.23 | Acc 98.4 / 87.7\n",
      "[1/2][505/782] Loss_D: 1.45 Loss_G: 7.48 D(x): 0.55 D(G(z)): 0.30 / 0.54 | Acc 93.8 / 87.7\n",
      "[1/2][506/782] Loss_D: 1.51 Loss_G: 8.58 D(x): 0.83 D(G(z)): 0.61 / 0.20 | Acc 96.9 / 87.7\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (53.186)\n",
      "semi Test: [100/157]\t Prec@1 46.875 (52.584)\n",
      "semi Test: [150/157]\t Prec@1 51.562 (53.094)\n",
      "semi Test Prec@1 52.93\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.683)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.056)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.758)\n",
      "sup Test Prec@1 48.64\n",
      "[1/2][507/782] Loss_D: 1.37 Loss_G: 7.88 D(x): 0.62 D(G(z)): 0.26 / 0.41 | Acc 85.9 / 87.7\n",
      "[1/2][508/782] Loss_D: 1.51 Loss_G: 7.92 D(x): 0.73 D(G(z)): 0.50 / 0.40 | Acc 92.2 / 87.8\n",
      "[1/2][509/782] Loss_D: 1.45 Loss_G: 8.24 D(x): 0.74 D(G(z)): 0.47 / 0.27 | Acc 92.2 / 87.8\n",
      "[1/2][510/782] Loss_D: 1.64 Loss_G: 7.54 D(x): 0.56 D(G(z)): 0.38 / 0.52 | Acc 85.9 / 87.8\n",
      "[1/2][511/782] Loss_D: 1.54 Loss_G: 8.31 D(x): 0.80 D(G(z)): 0.58 / 0.26 | Acc 98.4 / 87.8\n",
      "[1/2][512/782] Loss_D: 1.37 Loss_G: 7.92 D(x): 0.68 D(G(z)): 0.34 / 0.37 | Acc 87.5 / 87.8\n",
      "[1/2][513/782] Loss_D: 1.40 Loss_G: 7.84 D(x): 0.69 D(G(z)): 0.45 / 0.36 | Acc 95.3 / 87.8\n",
      "[1/2][514/782] Loss_D: 1.36 Loss_G: 7.99 D(x): 0.70 D(G(z)): 0.45 / 0.35 | Acc 95.3 / 87.8\n",
      "[1/2][515/782] Loss_D: 1.39 Loss_G: 7.84 D(x): 0.68 D(G(z)): 0.43 / 0.38 | Acc 95.3 / 87.8\n",
      "[1/2][516/782] Loss_D: 1.52 Loss_G: 7.87 D(x): 0.67 D(G(z)): 0.46 / 0.40 | Acc 90.6 / 87.8\n",
      "semi Test: [0/157]\t Prec@1 43.750 (43.750)\n",
      "semi Test: [50/157]\t Prec@1 46.875 (51.838)\n",
      "semi Test: [100/157]\t Prec@1 43.750 (52.259)\n",
      "semi Test: [150/157]\t Prec@1 53.125 (52.773)\n",
      "semi Test Prec@1 52.48\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 56.250 (48.652)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.149)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.841)\n",
      "sup Test Prec@1 48.70\n",
      "[1/2][517/782] Loss_D: 1.56 Loss_G: 8.07 D(x): 0.67 D(G(z)): 0.50 / 0.36 | Acc 95.3 / 87.8\n",
      "[1/2][518/782] Loss_D: 1.43 Loss_G: 7.96 D(x): 0.71 D(G(z)): 0.45 / 0.33 | Acc 89.1 / 87.8\n",
      "[1/2][519/782] Loss_D: 1.46 Loss_G: 7.65 D(x): 0.63 D(G(z)): 0.40 / 0.40 | Acc 95.3 / 87.9\n",
      "[1/2][520/782] Loss_D: 1.54 Loss_G: 8.00 D(x): 0.71 D(G(z)): 0.51 / 0.32 | Acc 93.8 / 87.9\n",
      "[1/2][521/782] Loss_D: 1.41 Loss_G: 7.71 D(x): 0.61 D(G(z)): 0.38 / 0.46 | Acc 96.9 / 87.9\n",
      "[1/2][522/782] Loss_D: 1.46 Loss_G: 8.20 D(x): 0.76 D(G(z)): 0.55 / 0.27 | Acc 96.9 / 87.9\n",
      "[1/2][523/782] Loss_D: 1.58 Loss_G: 7.56 D(x): 0.59 D(G(z)): 0.35 / 0.47 | Acc 87.5 / 87.9\n",
      "[1/2][524/782] Loss_D: 1.48 Loss_G: 8.17 D(x): 0.77 D(G(z)): 0.56 / 0.26 | Acc 96.9 / 87.9\n",
      "[1/2][525/782] Loss_D: 1.54 Loss_G: 7.54 D(x): 0.59 D(G(z)): 0.35 / 0.50 | Acc 85.9 / 87.9\n",
      "[1/2][526/782] Loss_D: 1.49 Loss_G: 8.51 D(x): 0.80 D(G(z)): 0.58 / 0.23 | Acc 98.4 / 87.9\n",
      "semi Test: [0/157]\t Prec@1 54.688 (54.688)\n",
      "semi Test: [50/157]\t Prec@1 43.750 (53.278)\n",
      "semi Test: [100/157]\t Prec@1 50.000 (53.496)\n",
      "semi Test: [150/157]\t Prec@1 56.250 (53.994)\n",
      "semi Test Prec@1 53.83\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.836)\n",
      "sup Test: [100/157]\t Prec@1 45.312 (49.118)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.820)\n",
      "sup Test Prec@1 48.68\n",
      "[1/2][527/782] Loss_D: 1.46 Loss_G: 7.42 D(x): 0.58 D(G(z)): 0.31 / 0.49 | Acc 87.5 / 87.9\n",
      "[1/2][528/782] Loss_D: 1.55 Loss_G: 7.98 D(x): 0.75 D(G(z)): 0.57 / 0.30 | Acc 98.4 / 88.0\n",
      "[1/2][529/782] Loss_D: 1.47 Loss_G: 7.83 D(x): 0.64 D(G(z)): 0.38 / 0.40 | Acc 93.8 / 88.0\n",
      "[1/2][530/782] Loss_D: 1.53 Loss_G: 7.88 D(x): 0.74 D(G(z)): 0.52 / 0.33 | Acc 93.8 / 88.0\n",
      "[1/2][531/782] Loss_D: 1.35 Loss_G: 8.15 D(x): 0.68 D(G(z)): 0.43 / 0.29 | Acc 96.9 / 88.0\n",
      "[1/2][532/782] Loss_D: 1.43 Loss_G: 7.71 D(x): 0.69 D(G(z)): 0.39 / 0.43 | Acc 87.5 / 88.0\n",
      "[1/2][533/782] Loss_D: 1.61 Loss_G: 7.97 D(x): 0.69 D(G(z)): 0.51 / 0.37 | Acc 93.8 / 88.0\n",
      "[1/2][534/782] Loss_D: 1.40 Loss_G: 8.35 D(x): 0.74 D(G(z)): 0.48 / 0.26 | Acc 93.8 / 88.0\n",
      "[1/2][535/782] Loss_D: 1.62 Loss_G: 7.43 D(x): 0.55 D(G(z)): 0.33 / 0.58 | Acc 87.5 / 88.0\n",
      "[1/2][536/782] Loss_D: 1.73 Loss_G: 8.85 D(x): 0.86 D(G(z)): 0.68 / 0.16 | Acc 98.4 / 88.0\n",
      "semi Test: [0/157]\t Prec@1 51.562 (51.562)\n",
      "semi Test: [50/157]\t Prec@1 43.750 (51.930)\n",
      "semi Test: [100/157]\t Prec@1 42.188 (51.825)\n",
      "semi Test: [150/157]\t Prec@1 57.812 (52.380)\n",
      "semi Test Prec@1 52.24\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 56.250 (48.346)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.072)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.696)\n",
      "sup Test Prec@1 48.54\n",
      "[1/2][537/782] Loss_D: 1.92 Loss_G: 7.27 D(x): 0.47 D(G(z)): 0.25 / 0.65 | Acc 70.3 / 88.0\n",
      "[1/2][538/782] Loss_D: 1.82 Loss_G: 8.48 D(x): 0.86 D(G(z)): 0.71 / 0.24 | Acc 98.4 / 88.0\n",
      "[1/2][539/782] Loss_D: 1.75 Loss_G: 7.64 D(x): 0.55 D(G(z)): 0.37 / 0.47 | Acc 82.8 / 88.0\n",
      "[1/2][540/782] Loss_D: 1.49 Loss_G: 8.10 D(x): 0.79 D(G(z)): 0.55 / 0.29 | Acc 93.8 / 88.0\n",
      "[1/2][541/782] Loss_D: 1.47 Loss_G: 7.58 D(x): 0.61 D(G(z)): 0.37 / 0.44 | Acc 93.8 / 88.0\n",
      "[1/2][542/782] Loss_D: 1.61 Loss_G: 7.94 D(x): 0.71 D(G(z)): 0.54 / 0.36 | Acc 90.6 / 88.0\n",
      "[1/2][543/782] Loss_D: 1.50 Loss_G: 8.11 D(x): 0.72 D(G(z)): 0.46 / 0.30 | Acc 87.5 / 88.0\n",
      "[1/2][544/782] Loss_D: 1.55 Loss_G: 7.36 D(x): 0.58 D(G(z)): 0.41 / 0.52 | Acc 95.3 / 88.1\n",
      "[1/2][545/782] Loss_D: 1.44 Loss_G: 8.08 D(x): 0.76 D(G(z)): 0.57 / 0.27 | Acc 100.0 / 88.1\n",
      "[1/2][546/782] Loss_D: 1.57 Loss_G: 7.72 D(x): 0.60 D(G(z)): 0.39 / 0.40 | Acc 92.2 / 88.1\n",
      "semi Test: [0/157]\t Prec@1 51.562 (51.562)\n",
      "semi Test: [50/157]\t Prec@1 50.000 (53.431)\n",
      "semi Test: [100/157]\t Prec@1 46.875 (53.728)\n",
      "semi Test: [150/157]\t Prec@1 53.125 (54.170)\n",
      "semi Test Prec@1 54.00\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.254)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (48.979)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.675)\n",
      "sup Test Prec@1 48.55\n",
      "[1/2][547/782] Loss_D: 1.61 Loss_G: 7.70 D(x): 0.66 D(G(z)): 0.49 / 0.44 | Acc 92.2 / 88.1\n",
      "[1/2][548/782] Loss_D: 1.56 Loss_G: 8.14 D(x): 0.75 D(G(z)): 0.53 / 0.28 | Acc 90.6 / 88.1\n",
      "[1/2][549/782] Loss_D: 1.54 Loss_G: 7.43 D(x): 0.62 D(G(z)): 0.37 / 0.52 | Acc 85.9 / 88.1\n",
      "[1/2][550/782] Loss_D: 1.53 Loss_G: 8.04 D(x): 0.76 D(G(z)): 0.58 / 0.25 | Acc 96.9 / 88.1\n",
      "[1/2][551/782] Loss_D: 1.36 Loss_G: 7.89 D(x): 0.68 D(G(z)): 0.37 / 0.33 | Acc 89.1 / 88.1\n",
      "[1/2][552/782] Loss_D: 1.38 Loss_G: 7.71 D(x): 0.69 D(G(z)): 0.43 / 0.40 | Acc 95.3 / 88.1\n",
      "[1/2][553/782] Loss_D: 1.58 Loss_G: 7.87 D(x): 0.69 D(G(z)): 0.48 / 0.36 | Acc 92.2 / 88.1\n",
      "[1/2][554/782] Loss_D: 1.53 Loss_G: 7.97 D(x): 0.65 D(G(z)): 0.47 / 0.34 | Acc 90.6 / 88.1\n",
      "[1/2][555/782] Loss_D: 1.60 Loss_G: 7.48 D(x): 0.63 D(G(z)): 0.43 / 0.43 | Acc 87.5 / 88.1\n",
      "[1/2][556/782] Loss_D: 1.41 Loss_G: 8.30 D(x): 0.79 D(G(z)): 0.54 / 0.23 | Acc 95.3 / 88.1\n",
      "semi Test: [0/157]\t Prec@1 51.562 (51.562)\n",
      "semi Test: [50/157]\t Prec@1 54.688 (52.083)\n",
      "semi Test: [100/157]\t Prec@1 43.750 (52.367)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (52.918)\n",
      "semi Test Prec@1 52.76\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 56.250 (48.438)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.025)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.634)\n",
      "sup Test Prec@1 48.49\n",
      "[1/2][557/782] Loss_D: 1.69 Loss_G: 7.18 D(x): 0.53 D(G(z)): 0.32 / 0.60 | Acc 81.2 / 88.1\n",
      "[1/2][558/782] Loss_D: 1.84 Loss_G: 8.09 D(x): 0.82 D(G(z)): 0.68 / 0.25 | Acc 93.8 / 88.1\n",
      "[1/2][559/782] Loss_D: 1.37 Loss_G: 8.08 D(x): 0.61 D(G(z)): 0.35 / 0.30 | Acc 90.6 / 88.1\n",
      "[1/2][560/782] Loss_D: 1.41 Loss_G: 7.64 D(x): 0.64 D(G(z)): 0.40 / 0.46 | Acc 93.8 / 88.2\n",
      "[1/2][561/782] Loss_D: 1.48 Loss_G: 8.44 D(x): 0.81 D(G(z)): 0.57 / 0.21 | Acc 96.9 / 88.2\n",
      "[1/2][562/782] Loss_D: 1.61 Loss_G: 7.28 D(x): 0.51 D(G(z)): 0.29 / 0.56 | Acc 89.1 / 88.2\n",
      "[1/2][563/782] Loss_D: 1.74 Loss_G: 8.13 D(x): 0.78 D(G(z)): 0.64 / 0.27 | Acc 98.4 / 88.2\n",
      "[1/2][564/782] Loss_D: 1.55 Loss_G: 7.53 D(x): 0.58 D(G(z)): 0.38 / 0.38 | Acc 92.2 / 88.2\n",
      "[1/2][565/782] Loss_D: 1.35 Loss_G: 7.71 D(x): 0.73 D(G(z)): 0.46 / 0.33 | Acc 96.9 / 88.2\n",
      "[1/2][566/782] Loss_D: 1.40 Loss_G: 7.91 D(x): 0.68 D(G(z)): 0.44 / 0.33 | Acc 96.9 / 88.2\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (51.961)\n",
      "semi Test: [100/157]\t Prec@1 57.812 (52.135)\n",
      "semi Test: [150/157]\t Prec@1 53.125 (52.659)\n",
      "semi Test Prec@1 52.42\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 56.250 (48.621)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.211)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.820)\n",
      "sup Test Prec@1 48.70\n",
      "[1/2][567/782] Loss_D: 1.45 Loss_G: 7.60 D(x): 0.65 D(G(z)): 0.42 / 0.41 | Acc 87.5 / 88.2\n",
      "[1/2][568/782] Loss_D: 1.54 Loss_G: 7.94 D(x): 0.73 D(G(z)): 0.52 / 0.33 | Acc 90.6 / 88.2\n",
      "[1/2][569/782] Loss_D: 1.45 Loss_G: 7.73 D(x): 0.70 D(G(z)): 0.43 / 0.37 | Acc 87.5 / 88.2\n",
      "[1/2][570/782] Loss_D: 1.64 Loss_G: 7.50 D(x): 0.63 D(G(z)): 0.45 / 0.48 | Acc 87.5 / 88.2\n",
      "[1/2][571/782] Loss_D: 1.56 Loss_G: 8.07 D(x): 0.72 D(G(z)): 0.56 / 0.28 | Acc 100.0 / 88.2\n",
      "[1/2][572/782] Loss_D: 1.33 Loss_G: 7.74 D(x): 0.66 D(G(z)): 0.37 / 0.36 | Acc 95.3 / 88.3\n",
      "[1/2][573/782] Loss_D: 1.65 Loss_G: 7.37 D(x): 0.58 D(G(z)): 0.46 / 0.50 | Acc 95.3 / 88.3\n",
      "[1/2][574/782] Loss_D: 1.61 Loss_G: 8.15 D(x): 0.77 D(G(z)): 0.59 / 0.25 | Acc 93.8 / 88.3\n",
      "[1/2][575/782] Loss_D: 1.67 Loss_G: 7.28 D(x): 0.58 D(G(z)): 0.33 / 0.54 | Acc 85.9 / 88.3\n",
      "[1/2][576/782] Loss_D: 1.61 Loss_G: 8.04 D(x): 0.78 D(G(z)): 0.60 / 0.28 | Acc 95.3 / 88.3\n",
      "semi Test: [0/157]\t Prec@1 45.312 (45.312)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (52.328)\n",
      "semi Test: [100/157]\t Prec@1 53.125 (52.460)\n",
      "semi Test: [150/157]\t Prec@1 40.625 (53.084)\n",
      "semi Test Prec@1 52.89\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.346)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.025)\n",
      "sup Test: [150/157]\t Prec@1 50.000 (48.758)\n",
      "sup Test Prec@1 48.61\n",
      "[1/2][577/782] Loss_D: 1.59 Loss_G: 7.62 D(x): 0.60 D(G(z)): 0.38 / 0.43 | Acc 82.8 / 88.3\n",
      "[1/2][578/782] Loss_D: 1.64 Loss_G: 7.48 D(x): 0.65 D(G(z)): 0.51 / 0.44 | Acc 96.9 / 88.3\n",
      "[1/2][579/782] Loss_D: 1.44 Loss_G: 8.32 D(x): 0.78 D(G(z)): 0.55 / 0.21 | Acc 96.9 / 88.3\n",
      "[1/2][580/782] Loss_D: 1.67 Loss_G: 7.21 D(x): 0.49 D(G(z)): 0.28 / 0.56 | Acc 87.5 / 88.3\n",
      "[1/2][581/782] Loss_D: 1.62 Loss_G: 8.09 D(x): 0.81 D(G(z)): 0.63 / 0.27 | Acc 96.9 / 88.3\n",
      "[1/2][582/782] Loss_D: 1.34 Loss_G: 7.75 D(x): 0.62 D(G(z)): 0.37 / 0.35 | Acc 96.9 / 88.3\n",
      "[1/2][583/782] Loss_D: 1.55 Loss_G: 7.74 D(x): 0.66 D(G(z)): 0.46 / 0.41 | Acc 90.6 / 88.3\n",
      "[1/2][584/782] Loss_D: 1.40 Loss_G: 8.14 D(x): 0.77 D(G(z)): 0.51 / 0.26 | Acc 96.9 / 88.4\n",
      "[1/2][585/782] Loss_D: 1.60 Loss_G: 7.44 D(x): 0.63 D(G(z)): 0.37 / 0.52 | Acc 82.8 / 88.3\n",
      "[1/2][586/782] Loss_D: 1.67 Loss_G: 7.81 D(x): 0.73 D(G(z)): 0.59 / 0.32 | Acc 96.9 / 88.4\n",
      "semi Test: [0/157]\t Prec@1 54.688 (54.688)\n",
      "semi Test: [50/157]\t Prec@1 45.312 (52.022)\n",
      "semi Test: [100/157]\t Prec@1 53.125 (52.274)\n",
      "semi Test: [150/157]\t Prec@1 53.125 (52.721)\n",
      "semi Test Prec@1 52.42\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.591)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.180)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.779)\n",
      "sup Test Prec@1 48.65\n",
      "[1/2][587/782] Loss_D: 1.47 Loss_G: 7.72 D(x): 0.64 D(G(z)): 0.40 / 0.37 | Acc 89.1 / 88.4\n",
      "[1/2][588/782] Loss_D: 1.61 Loss_G: 7.41 D(x): 0.61 D(G(z)): 0.47 / 0.47 | Acc 96.9 / 88.4\n",
      "[1/2][589/782] Loss_D: 1.55 Loss_G: 8.05 D(x): 0.75 D(G(z)): 0.54 / 0.26 | Acc 93.8 / 88.4\n",
      "[1/2][590/782] Loss_D: 1.46 Loss_G: 7.61 D(x): 0.64 D(G(z)): 0.35 / 0.39 | Acc 89.1 / 88.4\n",
      "[1/2][591/782] Loss_D: 1.37 Loss_G: 8.08 D(x): 0.78 D(G(z)): 0.49 / 0.27 | Acc 96.9 / 88.4\n",
      "[1/2][592/782] Loss_D: 1.49 Loss_G: 7.35 D(x): 0.58 D(G(z)): 0.36 / 0.49 | Acc 92.2 / 88.4\n",
      "[1/2][593/782] Loss_D: 1.43 Loss_G: 8.18 D(x): 0.79 D(G(z)): 0.57 / 0.25 | Acc 100.0 / 88.4\n",
      "[1/2][594/782] Loss_D: 1.46 Loss_G: 7.23 D(x): 0.58 D(G(z)): 0.34 / 0.46 | Acc 90.6 / 88.4\n",
      "[1/2][595/782] Loss_D: 1.55 Loss_G: 7.87 D(x): 0.72 D(G(z)): 0.55 / 0.32 | Acc 93.8 / 88.4\n",
      "[1/2][596/782] Loss_D: 1.39 Loss_G: 7.74 D(x): 0.66 D(G(z)): 0.41 / 0.36 | Acc 93.8 / 88.5\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 46.875 (53.125)\n",
      "semi Test: [100/157]\t Prec@1 48.438 (53.171)\n",
      "semi Test: [150/157]\t Prec@1 53.125 (53.529)\n",
      "semi Test Prec@1 53.29\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.683)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.072)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.655)\n",
      "sup Test Prec@1 48.53\n",
      "[1/2][597/782] Loss_D: 1.25 Loss_G: 7.73 D(x): 0.72 D(G(z)): 0.44 / 0.31 | Acc 98.4 / 88.5\n",
      "[1/2][598/782] Loss_D: 1.44 Loss_G: 7.52 D(x): 0.59 D(G(z)): 0.39 / 0.42 | Acc 96.9 / 88.5\n",
      "[1/2][599/782] Loss_D: 1.49 Loss_G: 7.66 D(x): 0.68 D(G(z)): 0.51 / 0.34 | Acc 98.4 / 88.5\n",
      "[1/2][600/782] Loss_D: 1.33 Loss_G: 7.82 D(x): 0.65 D(G(z)): 0.44 / 0.33 | Acc 100.0 / 88.5\n",
      "[1/2][601/782] Loss_D: 1.49 Loss_G: 7.44 D(x): 0.63 D(G(z)): 0.43 / 0.41 | Acc 96.9 / 88.5\n",
      "[1/2][602/782] Loss_D: 1.53 Loss_G: 7.75 D(x): 0.70 D(G(z)): 0.50 / 0.35 | Acc 92.2 / 88.5\n",
      "[1/2][603/782] Loss_D: 1.32 Loss_G: 7.61 D(x): 0.67 D(G(z)): 0.42 / 0.34 | Acc 100.0 / 88.6\n",
      "[1/2][604/782] Loss_D: 1.46 Loss_G: 7.50 D(x): 0.67 D(G(z)): 0.43 / 0.43 | Acc 89.1 / 88.6\n",
      "[1/2][605/782] Loss_D: 1.56 Loss_G: 7.89 D(x): 0.71 D(G(z)): 0.54 / 0.29 | Acc 95.3 / 88.6\n",
      "[1/2][606/782] Loss_D: 1.60 Loss_G: 7.29 D(x): 0.49 D(G(z)): 0.36 / 0.53 | Acc 95.3 / 88.6\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 46.875 (52.849)\n",
      "semi Test: [100/157]\t Prec@1 53.125 (52.645)\n",
      "semi Test: [150/157]\t Prec@1 48.438 (53.518)\n",
      "semi Test Prec@1 53.34\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.499)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (48.933)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.758)\n",
      "sup Test Prec@1 48.61\n",
      "[1/2][607/782] Loss_D: 1.59 Loss_G: 8.09 D(x): 0.78 D(G(z)): 0.60 / 0.27 | Acc 100.0 / 88.6\n",
      "[1/2][608/782] Loss_D: 1.28 Loss_G: 7.93 D(x): 0.65 D(G(z)): 0.38 / 0.30 | Acc 98.4 / 88.6\n",
      "[1/2][609/782] Loss_D: 1.37 Loss_G: 7.25 D(x): 0.67 D(G(z)): 0.39 / 0.48 | Acc 93.8 / 88.6\n",
      "[1/2][610/782] Loss_D: 1.55 Loss_G: 8.17 D(x): 0.78 D(G(z)): 0.58 / 0.23 | Acc 96.9 / 88.6\n",
      "[1/2][611/782] Loss_D: 1.69 Loss_G: 7.18 D(x): 0.49 D(G(z)): 0.31 / 0.60 | Acc 85.9 / 88.6\n",
      "[1/2][612/782] Loss_D: 1.82 Loss_G: 7.93 D(x): 0.81 D(G(z)): 0.68 / 0.27 | Acc 95.3 / 88.6\n",
      "[1/2][613/782] Loss_D: 1.58 Loss_G: 7.37 D(x): 0.56 D(G(z)): 0.37 / 0.42 | Acc 92.2 / 88.6\n",
      "[1/2][614/782] Loss_D: 1.45 Loss_G: 7.58 D(x): 0.71 D(G(z)): 0.50 / 0.36 | Acc 95.3 / 88.7\n",
      "[1/2][615/782] Loss_D: 1.50 Loss_G: 7.47 D(x): 0.64 D(G(z)): 0.44 / 0.38 | Acc 92.2 / 88.7\n",
      "[1/2][616/782] Loss_D: 1.38 Loss_G: 7.71 D(x): 0.70 D(G(z)): 0.48 / 0.34 | Acc 96.9 / 88.7\n",
      "semi Test: [0/157]\t Prec@1 51.562 (51.562)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (53.922)\n",
      "semi Test: [100/157]\t Prec@1 51.562 (53.883)\n",
      "semi Test: [150/157]\t Prec@1 46.875 (54.243)\n",
      "semi Test Prec@1 54.04\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.407)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.025)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.810)\n",
      "sup Test Prec@1 48.68\n",
      "[1/2][617/782] Loss_D: 1.34 Loss_G: 7.95 D(x): 0.70 D(G(z)): 0.44 / 0.31 | Acc 96.9 / 88.7\n",
      "[1/2][618/782] Loss_D: 1.66 Loss_G: 7.12 D(x): 0.55 D(G(z)): 0.38 / 0.56 | Acc 90.6 / 88.7\n",
      "[1/2][619/782] Loss_D: 1.60 Loss_G: 8.51 D(x): 0.86 D(G(z)): 0.66 / 0.18 | Acc 96.9 / 88.7\n",
      "[1/2][620/782] Loss_D: 1.75 Loss_G: 7.09 D(x): 0.44 D(G(z)): 0.24 / 0.57 | Acc 87.5 / 88.7\n",
      "[1/2][621/782] Loss_D: 1.76 Loss_G: 7.69 D(x): 0.82 D(G(z)): 0.65 / 0.33 | Acc 93.8 / 88.7\n",
      "[1/2][622/782] Loss_D: 1.53 Loss_G: 7.84 D(x): 0.67 D(G(z)): 0.44 / 0.31 | Acc 90.6 / 88.7\n",
      "[1/2][623/782] Loss_D: 1.44 Loss_G: 7.31 D(x): 0.63 D(G(z)): 0.39 / 0.45 | Acc 98.4 / 88.7\n",
      "[1/2][624/782] Loss_D: 1.37 Loss_G: 8.19 D(x): 0.81 D(G(z)): 0.54 / 0.23 | Acc 96.9 / 88.7\n",
      "[1/2][625/782] Loss_D: 1.81 Loss_G: 6.95 D(x): 0.44 D(G(z)): 0.31 / 0.63 | Acc 92.2 / 88.8\n",
      "[1/2][626/782] Loss_D: 1.80 Loss_G: 7.86 D(x): 0.81 D(G(z)): 0.69 / 0.29 | Acc 96.9 / 88.8\n",
      "semi Test: [0/157]\t Prec@1 51.562 (51.562)\n",
      "semi Test: [50/157]\t Prec@1 53.125 (53.064)\n",
      "semi Test: [100/157]\t Prec@1 48.438 (52.506)\n",
      "semi Test: [150/157]\t Prec@1 45.312 (53.135)\n",
      "semi Test Prec@1 52.97\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (48.346)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.087)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.851)\n",
      "sup Test Prec@1 48.71\n",
      "[1/2][627/782] Loss_D: 1.47 Loss_G: 7.81 D(x): 0.60 D(G(z)): 0.38 / 0.31 | Acc 92.2 / 88.8\n",
      "[1/2][628/782] Loss_D: 1.39 Loss_G: 7.39 D(x): 0.64 D(G(z)): 0.42 / 0.42 | Acc 95.3 / 88.8\n",
      "[1/2][629/782] Loss_D: 1.52 Loss_G: 7.60 D(x): 0.68 D(G(z)): 0.50 / 0.35 | Acc 95.3 / 88.8\n",
      "[1/2][630/782] Loss_D: 1.53 Loss_G: 7.39 D(x): 0.61 D(G(z)): 0.45 / 0.40 | Acc 95.3 / 88.8\n",
      "[1/2][631/782] Loss_D: 1.51 Loss_G: 7.80 D(x): 0.66 D(G(z)): 0.49 / 0.34 | Acc 96.9 / 88.8\n",
      "[1/2][632/782] Loss_D: 1.53 Loss_G: 7.51 D(x): 0.62 D(G(z)): 0.44 / 0.41 | Acc 92.2 / 88.8\n",
      "[1/2][633/782] Loss_D: 1.54 Loss_G: 7.53 D(x): 0.66 D(G(z)): 0.51 / 0.37 | Acc 98.4 / 88.8\n",
      "[1/2][634/782] Loss_D: 1.49 Loss_G: 7.83 D(x): 0.68 D(G(z)): 0.47 / 0.30 | Acc 93.8 / 88.8\n",
      "[1/2][635/782] Loss_D: 1.54 Loss_G: 7.24 D(x): 0.62 D(G(z)): 0.41 / 0.45 | Acc 92.2 / 88.8\n",
      "[1/2][636/782] Loss_D: 1.64 Loss_G: 7.72 D(x): 0.74 D(G(z)): 0.53 / 0.34 | Acc 90.6 / 88.8\n",
      "semi Test: [0/157]\t Prec@1 56.250 (56.250)\n",
      "semi Test: [50/157]\t Prec@1 48.438 (52.665)\n",
      "semi Test: [100/157]\t Prec@1 45.312 (52.800)\n",
      "semi Test: [150/157]\t Prec@1 50.000 (53.435)\n",
      "semi Test Prec@1 53.23\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (48.468)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (48.917)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.675)\n",
      "sup Test Prec@1 48.54\n",
      "[1/2][637/782] Loss_D: 1.40 Loss_G: 7.72 D(x): 0.68 D(G(z)): 0.44 / 0.32 | Acc 95.3 / 88.9\n",
      "[1/2][638/782] Loss_D: 1.52 Loss_G: 7.32 D(x): 0.61 D(G(z)): 0.43 / 0.45 | Acc 98.4 / 88.9\n",
      "[1/2][639/782] Loss_D: 1.41 Loss_G: 7.68 D(x): 0.74 D(G(z)): 0.51 / 0.31 | Acc 96.9 / 88.9\n",
      "[1/2][640/782] Loss_D: 1.47 Loss_G: 7.46 D(x): 0.59 D(G(z)): 0.40 / 0.38 | Acc 98.4 / 88.9\n",
      "[1/2][641/782] Loss_D: 1.48 Loss_G: 7.52 D(x): 0.70 D(G(z)): 0.49 / 0.39 | Acc 92.2 / 88.9\n",
      "[1/2][642/782] Loss_D: 1.48 Loss_G: 7.64 D(x): 0.65 D(G(z)): 0.49 / 0.36 | Acc 98.4 / 88.9\n",
      "[1/2][643/782] Loss_D: 1.41 Loss_G: 7.52 D(x): 0.69 D(G(z)): 0.45 / 0.33 | Acc 92.2 / 88.9\n",
      "[1/2][644/782] Loss_D: 1.55 Loss_G: 7.36 D(x): 0.64 D(G(z)): 0.43 / 0.42 | Acc 90.6 / 88.9\n",
      "[1/2][645/782] Loss_D: 1.52 Loss_G: 8.09 D(x): 0.73 D(G(z)): 0.54 / 0.22 | Acc 95.3 / 88.9\n",
      "[1/2][646/782] Loss_D: 1.48 Loss_G: 6.93 D(x): 0.58 D(G(z)): 0.31 / 0.51 | Acc 89.1 / 88.9\n",
      "semi Test: [0/157]\t Prec@1 53.125 (53.125)\n",
      "semi Test: [50/157]\t Prec@1 50.000 (53.217)\n",
      "semi Test: [100/157]\t Prec@1 45.312 (53.295)\n",
      "semi Test: [150/157]\t Prec@1 51.562 (53.684)\n",
      "semi Test Prec@1 53.47\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (48.591)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.041)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.769)\n",
      "sup Test Prec@1 48.67\n",
      "[1/2][647/782] Loss_D: 1.63 Loss_G: 8.03 D(x): 0.78 D(G(z)): 0.62 / 0.25 | Acc 98.4 / 89.0\n",
      "[1/2][648/782] Loss_D: 1.40 Loss_G: 7.55 D(x): 0.63 D(G(z)): 0.36 / 0.36 | Acc 87.5 / 89.0\n",
      "[1/2][649/782] Loss_D: 1.65 Loss_G: 7.30 D(x): 0.59 D(G(z)): 0.46 / 0.47 | Acc 92.2 / 89.0\n",
      "[1/2][650/782] Loss_D: 1.55 Loss_G: 8.03 D(x): 0.76 D(G(z)): 0.56 / 0.25 | Acc 96.9 / 89.0\n",
      "[1/2][651/782] Loss_D: 1.35 Loss_G: 7.48 D(x): 0.59 D(G(z)): 0.34 / 0.37 | Acc 96.9 / 89.0\n",
      "[1/2][652/782] Loss_D: 1.47 Loss_G: 7.50 D(x): 0.66 D(G(z)): 0.47 / 0.37 | Acc 96.9 / 89.0\n",
      "[1/2][653/782] Loss_D: 1.40 Loss_G: 7.74 D(x): 0.68 D(G(z)): 0.46 / 0.31 | Acc 95.3 / 89.0\n",
      "[1/2][654/782] Loss_D: 1.36 Loss_G: 7.44 D(x): 0.66 D(G(z)): 0.39 / 0.35 | Acc 93.8 / 89.0\n",
      "[1/2][655/782] Loss_D: 1.45 Loss_G: 7.61 D(x): 0.65 D(G(z)): 0.44 / 0.40 | Acc 95.3 / 89.0\n",
      "[1/2][656/782] Loss_D: 1.36 Loss_G: 8.08 D(x): 0.78 D(G(z)): 0.53 / 0.20 | Acc 96.9 / 89.0\n",
      "semi Test: [0/157]\t Prec@1 54.688 (54.688)\n",
      "semi Test: [50/157]\t Prec@1 50.000 (53.860)\n",
      "semi Test: [100/157]\t Prec@1 50.000 (53.651)\n",
      "semi Test: [150/157]\t Prec@1 59.375 (54.201)\n",
      "semi Test Prec@1 54.06\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.713)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.257)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.965)\n",
      "sup Test Prec@1 48.83\n",
      "[1/2][657/782] Loss_D: 1.62 Loss_G: 6.80 D(x): 0.50 D(G(z)): 0.30 / 0.56 | Acc 93.8 / 89.0\n",
      "[1/2][658/782] Loss_D: 1.68 Loss_G: 7.65 D(x): 0.77 D(G(z)): 0.63 / 0.31 | Acc 98.4 / 89.1\n",
      "[1/2][659/782] Loss_D: 1.44 Loss_G: 7.62 D(x): 0.65 D(G(z)): 0.42 / 0.33 | Acc 90.6 / 89.1\n",
      "[1/2][660/782] Loss_D: 1.43 Loss_G: 7.32 D(x): 0.64 D(G(z)): 0.42 / 0.42 | Acc 93.8 / 89.1\n",
      "[1/2][661/782] Loss_D: 1.53 Loss_G: 7.50 D(x): 0.70 D(G(z)): 0.53 / 0.31 | Acc 98.4 / 89.1\n",
      "[1/2][662/782] Loss_D: 1.48 Loss_G: 7.33 D(x): 0.61 D(G(z)): 0.39 / 0.38 | Acc 93.8 / 89.1\n",
      "[1/2][663/782] Loss_D: 1.45 Loss_G: 7.70 D(x): 0.73 D(G(z)): 0.50 / 0.31 | Acc 95.3 / 89.1\n",
      "[1/2][664/782] Loss_D: 1.39 Loss_G: 7.13 D(x): 0.61 D(G(z)): 0.39 / 0.43 | Acc 98.4 / 89.1\n",
      "[1/2][665/782] Loss_D: 1.57 Loss_G: 7.87 D(x): 0.74 D(G(z)): 0.57 / 0.27 | Acc 96.9 / 89.1\n",
      "[1/2][666/782] Loss_D: 1.47 Loss_G: 7.17 D(x): 0.58 D(G(z)): 0.37 / 0.42 | Acc 93.8 / 89.1\n",
      "semi Test: [0/157]\t Prec@1 53.125 (53.125)\n",
      "semi Test: [50/157]\t Prec@1 46.875 (53.462)\n",
      "semi Test: [100/157]\t Prec@1 48.438 (53.543)\n",
      "semi Test: [150/157]\t Prec@1 51.562 (53.632)\n",
      "semi Test Prec@1 53.42\n",
      "sup Test: [0/157]\t Prec@1 42.188 (42.188)\n",
      "sup Test: [50/157]\t Prec@1 51.562 (48.683)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.134)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.913)\n",
      "sup Test Prec@1 48.77\n",
      "[1/2][667/782] Loss_D: 1.49 Loss_G: 7.68 D(x): 0.70 D(G(z)): 0.53 / 0.33 | Acc 98.4 / 89.1\n",
      "[1/2][668/782] Loss_D: 1.46 Loss_G: 7.51 D(x): 0.65 D(G(z)): 0.42 / 0.35 | Acc 93.8 / 89.1\n",
      "[1/2][669/782] Loss_D: 1.36 Loss_G: 7.66 D(x): 0.70 D(G(z)): 0.45 / 0.33 | Acc 98.4 / 89.2\n",
      "[1/2][670/782] Loss_D: 1.66 Loss_G: 7.18 D(x): 0.61 D(G(z)): 0.44 / 0.41 | Acc 90.6 / 89.2\n",
      "[1/2][671/782] Loss_D: 1.42 Loss_G: 8.01 D(x): 0.77 D(G(z)): 0.52 / 0.23 | Acc 93.8 / 89.2\n",
      "[1/2][672/782] Loss_D: 1.61 Loss_G: 6.93 D(x): 0.51 D(G(z)): 0.34 / 0.56 | Acc 90.6 / 89.2\n",
      "[1/2][673/782] Loss_D: 1.76 Loss_G: 8.02 D(x): 0.78 D(G(z)): 0.65 / 0.27 | Acc 93.8 / 89.2\n",
      "[1/2][674/782] Loss_D: 1.25 Loss_G: 7.75 D(x): 0.68 D(G(z)): 0.38 / 0.30 | Acc 96.9 / 89.2\n",
      "[1/2][675/782] Loss_D: 1.58 Loss_G: 7.00 D(x): 0.60 D(G(z)): 0.39 / 0.51 | Acc 85.9 / 89.2\n",
      "[1/2][676/782] Loss_D: 1.60 Loss_G: 8.02 D(x): 0.79 D(G(z)): 0.62 / 0.22 | Acc 100.0 / 89.2\n",
      "semi Test: [0/157]\t Prec@1 53.125 (53.125)\n",
      "semi Test: [50/157]\t Prec@1 46.875 (53.002)\n",
      "semi Test: [100/157]\t Prec@1 50.000 (53.156)\n",
      "semi Test: [150/157]\t Prec@1 51.562 (53.518)\n",
      "semi Test Prec@1 53.39\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 50.000 (48.805)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.196)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.955)\n",
      "sup Test Prec@1 48.83\n",
      "[1/2][677/782] Loss_D: 1.57 Loss_G: 7.09 D(x): 0.54 D(G(z)): 0.33 / 0.50 | Acc 92.2 / 89.2\n",
      "[1/2][678/782] Loss_D: 1.52 Loss_G: 7.81 D(x): 0.80 D(G(z)): 0.58 / 0.26 | Acc 96.9 / 89.2\n",
      "[1/2][679/782] Loss_D: 1.34 Loss_G: 7.40 D(x): 0.61 D(G(z)): 0.35 / 0.36 | Acc 96.9 / 89.2\n",
      "[1/2][680/782] Loss_D: 1.68 Loss_G: 7.07 D(x): 0.60 D(G(z)): 0.47 / 0.51 | Acc 93.8 / 89.2\n",
      "[1/2][681/782] Loss_D: 1.48 Loss_G: 7.90 D(x): 0.77 D(G(z)): 0.58 / 0.23 | Acc 98.4 / 89.2\n",
      "[1/2][682/782] Loss_D: 1.42 Loss_G: 7.17 D(x): 0.58 D(G(z)): 0.33 / 0.46 | Acc 90.6 / 89.3\n",
      "[1/2][683/782] Loss_D: 1.57 Loss_G: 7.45 D(x): 0.71 D(G(z)): 0.56 / 0.35 | Acc 96.9 / 89.3\n",
      "[1/2][684/782] Loss_D: 1.44 Loss_G: 7.61 D(x): 0.69 D(G(z)): 0.46 / 0.30 | Acc 93.8 / 89.3\n",
      "[1/2][685/782] Loss_D: 1.73 Loss_G: 6.88 D(x): 0.54 D(G(z)): 0.41 / 0.56 | Acc 90.6 / 89.3\n",
      "[1/2][686/782] Loss_D: 1.69 Loss_G: 7.96 D(x): 0.82 D(G(z)): 0.65 / 0.21 | Acc 98.4 / 89.3\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (54.963)\n",
      "semi Test: [100/157]\t Prec@1 50.000 (54.533)\n",
      "semi Test: [150/157]\t Prec@1 50.000 (54.667)\n",
      "semi Test Prec@1 54.41\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 50.000 (48.499)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.041)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.738)\n",
      "sup Test Prec@1 48.62\n",
      "[1/2][687/782] Loss_D: 1.64 Loss_G: 7.02 D(x): 0.56 D(G(z)): 0.31 / 0.50 | Acc 82.8 / 89.3\n",
      "[1/2][688/782] Loss_D: 1.68 Loss_G: 7.42 D(x): 0.72 D(G(z)): 0.59 / 0.36 | Acc 96.9 / 89.3\n",
      "[1/2][689/782] Loss_D: 1.41 Loss_G: 7.71 D(x): 0.66 D(G(z)): 0.45 / 0.30 | Acc 95.3 / 89.3\n",
      "[1/2][690/782] Loss_D: 1.35 Loss_G: 7.24 D(x): 0.64 D(G(z)): 0.37 / 0.39 | Acc 92.2 / 89.3\n",
      "[1/2][691/782] Loss_D: 1.59 Loss_G: 7.30 D(x): 0.67 D(G(z)): 0.51 / 0.40 | Acc 95.3 / 89.3\n",
      "[1/2][692/782] Loss_D: 1.43 Loss_G: 7.66 D(x): 0.70 D(G(z)): 0.49 / 0.31 | Acc 96.9 / 89.3\n",
      "[1/2][693/782] Loss_D: 1.46 Loss_G: 7.11 D(x): 0.61 D(G(z)): 0.40 / 0.42 | Acc 93.8 / 89.3\n",
      "[1/2][694/782] Loss_D: 1.38 Loss_G: 7.74 D(x): 0.76 D(G(z)): 0.51 / 0.27 | Acc 98.4 / 89.3\n",
      "[1/2][695/782] Loss_D: 1.42 Loss_G: 7.06 D(x): 0.64 D(G(z)): 0.38 / 0.41 | Acc 90.6 / 89.3\n",
      "[1/2][696/782] Loss_D: 1.49 Loss_G: 7.38 D(x): 0.69 D(G(z)): 0.49 / 0.36 | Acc 92.2 / 89.3\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 54.688 (54.228)\n",
      "semi Test: [100/157]\t Prec@1 43.750 (53.837)\n",
      "semi Test: [150/157]\t Prec@1 51.562 (54.005)\n",
      "semi Test Prec@1 53.76\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.621)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.118)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.841)\n",
      "sup Test Prec@1 48.73\n",
      "[1/2][697/782] Loss_D: 1.60 Loss_G: 7.23 D(x): 0.61 D(G(z)): 0.48 / 0.40 | Acc 93.8 / 89.3\n",
      "[1/2][698/782] Loss_D: 1.39 Loss_G: 7.60 D(x): 0.71 D(G(z)): 0.46 / 0.32 | Acc 93.8 / 89.4\n",
      "[1/2][699/782] Loss_D: 1.49 Loss_G: 7.09 D(x): 0.62 D(G(z)): 0.43 / 0.41 | Acc 95.3 / 89.4\n",
      "[1/2][700/782] Loss_D: 1.59 Loss_G: 7.28 D(x): 0.67 D(G(z)): 0.48 / 0.39 | Acc 90.6 / 89.4\n",
      "[1/2][701/782] Loss_D: 1.35 Loss_G: 7.64 D(x): 0.73 D(G(z)): 0.48 / 0.26 | Acc 100.0 / 89.4\n",
      "[1/2][702/782] Loss_D: 1.41 Loss_G: 7.07 D(x): 0.58 D(G(z)): 0.34 / 0.47 | Acc 89.1 / 89.4\n",
      "[1/2][703/782] Loss_D: 1.51 Loss_G: 7.36 D(x): 0.75 D(G(z)): 0.54 / 0.34 | Acc 96.9 / 89.4\n",
      "[1/2][704/782] Loss_D: 1.41 Loss_G: 7.56 D(x): 0.65 D(G(z)): 0.42 / 0.36 | Acc 93.8 / 89.4\n",
      "[1/2][705/782] Loss_D: 1.47 Loss_G: 7.34 D(x): 0.66 D(G(z)): 0.46 / 0.36 | Acc 100.0 / 89.4\n",
      "[1/2][706/782] Loss_D: 1.54 Loss_G: 7.15 D(x): 0.61 D(G(z)): 0.46 / 0.39 | Acc 95.3 / 89.4\n",
      "semi Test: [0/157]\t Prec@1 46.875 (46.875)\n",
      "semi Test: [50/157]\t Prec@1 54.688 (53.523)\n",
      "semi Test: [100/157]\t Prec@1 40.625 (52.877)\n",
      "semi Test: [150/157]\t Prec@1 48.438 (53.291)\n",
      "semi Test Prec@1 53.15\n",
      "sup Test: [0/157]\t Prec@1 39.062 (39.062)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.683)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.149)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.903)\n",
      "sup Test Prec@1 48.79\n",
      "[1/2][707/782] Loss_D: 1.43 Loss_G: 7.60 D(x): 0.74 D(G(z)): 0.50 / 0.29 | Acc 93.8 / 89.4\n",
      "[1/2][708/782] Loss_D: 1.52 Loss_G: 6.86 D(x): 0.58 D(G(z)): 0.36 / 0.52 | Acc 89.1 / 89.4\n",
      "[1/2][709/782] Loss_D: 1.64 Loss_G: 7.70 D(x): 0.73 D(G(z)): 0.58 / 0.29 | Acc 98.4 / 89.4\n",
      "[1/2][710/782] Loss_D: 1.30 Loss_G: 7.54 D(x): 0.67 D(G(z)): 0.38 / 0.29 | Acc 93.8 / 89.4\n",
      "[1/2][711/782] Loss_D: 1.40 Loss_G: 7.03 D(x): 0.67 D(G(z)): 0.38 / 0.47 | Acc 92.2 / 89.4\n",
      "[1/2][712/782] Loss_D: 1.72 Loss_G: 7.51 D(x): 0.69 D(G(z)): 0.60 / 0.32 | Acc 96.9 / 89.5\n",
      "[1/2][713/782] Loss_D: 1.48 Loss_G: 7.29 D(x): 0.63 D(G(z)): 0.40 / 0.42 | Acc 89.1 / 89.5\n",
      "[1/2][714/782] Loss_D: 1.34 Loss_G: 7.36 D(x): 0.73 D(G(z)): 0.49 / 0.33 | Acc 98.4 / 89.5\n",
      "[1/2][715/782] Loss_D: 1.43 Loss_G: 7.48 D(x): 0.70 D(G(z)): 0.44 / 0.31 | Acc 92.2 / 89.5\n",
      "[1/2][716/782] Loss_D: 1.55 Loss_G: 6.88 D(x): 0.55 D(G(z)): 0.39 / 0.52 | Acc 100.0 / 89.5\n",
      "semi Test: [0/157]\t Prec@1 56.250 (56.250)\n",
      "semi Test: [50/157]\t Prec@1 60.938 (53.676)\n",
      "semi Test: [100/157]\t Prec@1 50.000 (53.094)\n",
      "semi Test: [150/157]\t Prec@1 50.000 (53.611)\n",
      "semi Test Prec@1 53.48\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.652)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.041)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.862)\n",
      "sup Test Prec@1 48.74\n",
      "[1/2][717/782] Loss_D: 1.59 Loss_G: 7.79 D(x): 0.80 D(G(z)): 0.60 / 0.25 | Acc 93.8 / 89.5\n",
      "[1/2][718/782] Loss_D: 1.38 Loss_G: 7.05 D(x): 0.57 D(G(z)): 0.32 / 0.44 | Acc 92.2 / 89.5\n",
      "[1/2][719/782] Loss_D: 1.46 Loss_G: 7.53 D(x): 0.74 D(G(z)): 0.54 / 0.31 | Acc 96.9 / 89.5\n",
      "[1/2][720/782] Loss_D: 1.64 Loss_G: 6.75 D(x): 0.53 D(G(z)): 0.40 / 0.56 | Acc 96.9 / 89.5\n",
      "[1/2][721/782] Loss_D: 1.56 Loss_G: 7.71 D(x): 0.79 D(G(z)): 0.61 / 0.24 | Acc 95.3 / 89.5\n",
      "[1/2][722/782] Loss_D: 1.30 Loss_G: 7.44 D(x): 0.65 D(G(z)): 0.33 / 0.32 | Acc 92.2 / 89.5\n",
      "[1/2][723/782] Loss_D: 1.46 Loss_G: 6.86 D(x): 0.61 D(G(z)): 0.39 / 0.54 | Acc 96.9 / 89.5\n",
      "[1/2][724/782] Loss_D: 1.59 Loss_G: 7.64 D(x): 0.78 D(G(z)): 0.62 / 0.24 | Acc 96.9 / 89.6\n",
      "[1/2][725/782] Loss_D: 1.48 Loss_G: 6.92 D(x): 0.55 D(G(z)): 0.31 / 0.49 | Acc 90.6 / 89.6\n",
      "[1/2][726/782] Loss_D: 1.49 Loss_G: 7.22 D(x): 0.77 D(G(z)): 0.56 / 0.32 | Acc 93.8 / 89.6\n",
      "semi Test: [0/157]\t Prec@1 56.250 (56.250)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (53.707)\n",
      "semi Test: [100/157]\t Prec@1 56.250 (53.605)\n",
      "semi Test: [150/157]\t Prec@1 50.000 (53.901)\n",
      "semi Test Prec@1 53.80\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 56.250 (48.560)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.072)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.820)\n",
      "sup Test Prec@1 48.70\n",
      "[1/2][727/782] Loss_D: 1.45 Loss_G: 7.29 D(x): 0.66 D(G(z)): 0.43 / 0.34 | Acc 90.6 / 89.6\n",
      "[1/2][728/782] Loss_D: 1.62 Loss_G: 6.68 D(x): 0.57 D(G(z)): 0.41 / 0.52 | Acc 92.2 / 89.6\n",
      "[1/2][729/782] Loss_D: 1.52 Loss_G: 7.68 D(x): 0.80 D(G(z)): 0.60 / 0.24 | Acc 100.0 / 89.6\n",
      "[1/2][730/782] Loss_D: 1.51 Loss_G: 6.77 D(x): 0.53 D(G(z)): 0.29 / 0.51 | Acc 89.1 / 89.6\n",
      "[1/2][731/782] Loss_D: 1.41 Loss_G: 7.50 D(x): 0.82 D(G(z)): 0.57 / 0.28 | Acc 96.9 / 89.6\n",
      "[1/2][732/782] Loss_D: 1.65 Loss_G: 6.77 D(x): 0.56 D(G(z)): 0.36 / 0.52 | Acc 85.9 / 89.6\n",
      "[1/2][733/782] Loss_D: 1.56 Loss_G: 7.51 D(x): 0.78 D(G(z)): 0.60 / 0.29 | Acc 95.3 / 89.6\n",
      "[1/2][734/782] Loss_D: 1.59 Loss_G: 6.88 D(x): 0.57 D(G(z)): 0.35 / 0.50 | Acc 87.5 / 89.6\n",
      "[1/2][735/782] Loss_D: 1.58 Loss_G: 7.23 D(x): 0.72 D(G(z)): 0.57 / 0.36 | Acc 98.4 / 89.6\n",
      "[1/2][736/782] Loss_D: 1.43 Loss_G: 7.57 D(x): 0.69 D(G(z)): 0.46 / 0.27 | Acc 96.9 / 89.6\n",
      "semi Test: [0/157]\t Prec@1 48.438 (48.438)\n",
      "semi Test: [50/157]\t Prec@1 54.688 (53.217)\n",
      "semi Test: [100/157]\t Prec@1 45.312 (53.063)\n",
      "semi Test: [150/157]\t Prec@1 56.250 (53.404)\n",
      "semi Test Prec@1 53.22\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.683)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.149)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.924)\n",
      "sup Test Prec@1 48.82\n",
      "[1/2][737/782] Loss_D: 1.47 Loss_G: 6.77 D(x): 0.57 D(G(z)): 0.33 / 0.51 | Acc 92.2 / 89.6\n",
      "[1/2][738/782] Loss_D: 1.48 Loss_G: 7.47 D(x): 0.77 D(G(z)): 0.58 / 0.28 | Acc 98.4 / 89.6\n",
      "[1/2][739/782] Loss_D: 1.39 Loss_G: 7.27 D(x): 0.58 D(G(z)): 0.37 / 0.37 | Acc 96.9 / 89.6\n",
      "[1/2][740/782] Loss_D: 1.48 Loss_G: 7.03 D(x): 0.63 D(G(z)): 0.42 / 0.47 | Acc 92.2 / 89.6\n",
      "[1/2][741/782] Loss_D: 1.46 Loss_G: 7.63 D(x): 0.80 D(G(z)): 0.57 / 0.25 | Acc 98.4 / 89.7\n",
      "[1/2][742/782] Loss_D: 1.47 Loss_G: 7.02 D(x): 0.55 D(G(z)): 0.33 / 0.42 | Acc 96.9 / 89.7\n",
      "[1/2][743/782] Loss_D: 1.55 Loss_G: 7.29 D(x): 0.68 D(G(z)): 0.51 / 0.37 | Acc 98.4 / 89.7\n",
      "[1/2][744/782] Loss_D: 1.46 Loss_G: 7.26 D(x): 0.66 D(G(z)): 0.47 / 0.37 | Acc 95.3 / 89.7\n",
      "[1/2][745/782] Loss_D: 1.44 Loss_G: 7.08 D(x): 0.64 D(G(z)): 0.45 / 0.39 | Acc 92.2 / 89.7\n",
      "[1/2][746/782] Loss_D: 1.48 Loss_G: 7.07 D(x): 0.66 D(G(z)): 0.47 / 0.42 | Acc 96.9 / 89.7\n",
      "semi Test: [0/157]\t Prec@1 56.250 (56.250)\n",
      "semi Test: [50/157]\t Prec@1 50.000 (54.657)\n",
      "semi Test: [100/157]\t Prec@1 53.125 (54.131)\n",
      "semi Test: [150/157]\t Prec@1 54.688 (53.870)\n",
      "semi Test Prec@1 53.67\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 53.125 (48.805)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.273)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.986)\n",
      "sup Test Prec@1 48.83\n",
      "[1/2][747/782] Loss_D: 1.42 Loss_G: 7.44 D(x): 0.74 D(G(z)): 0.52 / 0.28 | Acc 95.3 / 89.7\n",
      "[1/2][748/782] Loss_D: 1.57 Loss_G: 6.76 D(x): 0.55 D(G(z)): 0.33 / 0.53 | Acc 87.5 / 89.7\n",
      "[1/2][749/782] Loss_D: 1.49 Loss_G: 7.95 D(x): 0.85 D(G(z)): 0.59 / 0.17 | Acc 96.9 / 89.7\n",
      "[1/2][750/782] Loss_D: 1.51 Loss_G: 6.49 D(x): 0.54 D(G(z)): 0.27 / 0.60 | Acc 92.2 / 89.7\n",
      "[1/2][751/782] Loss_D: 1.72 Loss_G: 7.62 D(x): 0.83 D(G(z)): 0.66 / 0.23 | Acc 95.3 / 89.7\n",
      "[1/2][752/782] Loss_D: 1.41 Loss_G: 7.09 D(x): 0.59 D(G(z)): 0.32 / 0.40 | Acc 92.2 / 89.7\n",
      "[1/2][753/782] Loss_D: 1.50 Loss_G: 6.91 D(x): 0.68 D(G(z)): 0.48 / 0.43 | Acc 95.3 / 89.7\n",
      "[1/2][754/782] Loss_D: 1.36 Loss_G: 7.70 D(x): 0.79 D(G(z)): 0.53 / 0.24 | Acc 100.0 / 89.7\n",
      "[1/2][755/782] Loss_D: 1.49 Loss_G: 6.83 D(x): 0.54 D(G(z)): 0.31 / 0.48 | Acc 93.8 / 89.7\n",
      "[1/2][756/782] Loss_D: 1.44 Loss_G: 7.45 D(x): 0.77 D(G(z)): 0.57 / 0.28 | Acc 100.0 / 89.8\n",
      "semi Test: [0/157]\t Prec@1 57.812 (57.812)\n",
      "semi Test: [50/157]\t Prec@1 54.688 (53.830)\n",
      "semi Test: [100/157]\t Prec@1 54.688 (54.162)\n",
      "semi Test: [150/157]\t Prec@1 51.562 (54.481)\n",
      "semi Test Prec@1 54.30\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 54.688 (48.836)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.226)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (48.913)\n",
      "sup Test Prec@1 48.79\n",
      "[1/2][757/782] Loss_D: 1.32 Loss_G: 7.03 D(x): 0.62 D(G(z)): 0.36 / 0.37 | Acc 96.9 / 89.8\n",
      "[1/2][758/782] Loss_D: 1.54 Loss_G: 7.07 D(x): 0.63 D(G(z)): 0.47 / 0.44 | Acc 96.9 / 89.8\n",
      "[1/2][759/782] Loss_D: 1.62 Loss_G: 7.08 D(x): 0.68 D(G(z)): 0.52 / 0.40 | Acc 96.9 / 89.8\n",
      "[1/2][760/782] Loss_D: 1.48 Loss_G: 7.39 D(x): 0.68 D(G(z)): 0.49 / 0.29 | Acc 95.3 / 89.8\n",
      "[1/2][761/782] Loss_D: 1.49 Loss_G: 6.84 D(x): 0.61 D(G(z)): 0.38 / 0.47 | Acc 90.6 / 89.8\n",
      "[1/2][762/782] Loss_D: 1.50 Loss_G: 7.80 D(x): 0.84 D(G(z)): 0.58 / 0.22 | Acc 93.8 / 89.8\n",
      "[1/2][763/782] Loss_D: 1.68 Loss_G: 6.74 D(x): 0.46 D(G(z)): 0.32 / 0.57 | Acc 93.8 / 89.8\n",
      "[1/2][764/782] Loss_D: 1.52 Loss_G: 7.48 D(x): 0.81 D(G(z)): 0.62 / 0.26 | Acc 100.0 / 89.8\n",
      "[1/2][765/782] Loss_D: 1.68 Loss_G: 6.77 D(x): 0.51 D(G(z)): 0.37 / 0.50 | Acc 87.5 / 89.8\n",
      "[1/2][766/782] Loss_D: 1.61 Loss_G: 7.34 D(x): 0.76 D(G(z)): 0.59 / 0.30 | Acc 95.3 / 89.8\n",
      "semi Test: [0/157]\t Prec@1 53.125 (53.125)\n",
      "semi Test: [50/157]\t Prec@1 51.562 (53.094)\n",
      "semi Test: [100/157]\t Prec@1 46.875 (53.233)\n",
      "semi Test: [150/157]\t Prec@1 53.125 (53.260)\n",
      "semi Test Prec@1 53.12\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 56.250 (49.050)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.319)\n",
      "sup Test: [150/157]\t Prec@1 51.562 (49.048)\n",
      "sup Test Prec@1 48.93\n",
      "[1/2][767/782] Loss_D: 1.38 Loss_G: 7.35 D(x): 0.64 D(G(z)): 0.39 / 0.34 | Acc 87.5 / 89.8\n",
      "[1/2][768/782] Loss_D: 1.44 Loss_G: 6.69 D(x): 0.63 D(G(z)): 0.43 / 0.45 | Acc 96.9 / 89.8\n",
      "[1/2][769/782] Loss_D: 1.36 Loss_G: 7.56 D(x): 0.79 D(G(z)): 0.53 / 0.24 | Acc 98.4 / 89.8\n",
      "[1/2][770/782] Loss_D: 1.46 Loss_G: 6.89 D(x): 0.57 D(G(z)): 0.34 / 0.50 | Acc 96.9 / 89.9\n",
      "[1/2][771/782] Loss_D: 1.51 Loss_G: 7.39 D(x): 0.78 D(G(z)): 0.58 / 0.30 | Acc 96.9 / 89.9\n",
      "[1/2][772/782] Loss_D: 1.40 Loss_G: 7.08 D(x): 0.64 D(G(z)): 0.37 / 0.39 | Acc 92.2 / 89.9\n",
      "[1/2][773/782] Loss_D: 1.57 Loss_G: 6.95 D(x): 0.62 D(G(z)): 0.47 / 0.47 | Acc 93.8 / 89.9\n",
      "[1/2][774/782] Loss_D: 1.39 Loss_G: 7.88 D(x): 0.80 D(G(z)): 0.57 / 0.20 | Acc 100.0 / 89.9\n",
      "[1/2][775/782] Loss_D: 1.84 Loss_G: 6.39 D(x): 0.50 D(G(z)): 0.28 / 0.65 | Acc 73.4 / 89.9\n",
      "[1/2][776/782] Loss_D: 1.82 Loss_G: 7.46 D(x): 0.82 D(G(z)): 0.69 / 0.30 | Acc 95.3 / 89.9\n",
      "semi Test: [0/157]\t Prec@1 57.812 (57.812)\n",
      "semi Test: [50/157]\t Prec@1 43.750 (52.083)\n",
      "semi Test: [100/157]\t Prec@1 51.562 (51.176)\n",
      "semi Test: [150/157]\t Prec@1 50.000 (51.242)\n",
      "semi Test Prec@1 51.08\n",
      "sup Test: [0/157]\t Prec@1 40.625 (40.625)\n",
      "sup Test: [50/157]\t Prec@1 56.250 (48.744)\n",
      "sup Test: [100/157]\t Prec@1 46.875 (49.196)\n",
      "sup Test: [150/157]\t Prec@1 53.125 (48.934)\n",
      "sup Test Prec@1 48.82\n",
      "[1/2][777/782] Loss_D: 1.43 Loss_G: 7.33 D(x): 0.62 D(G(z)): 0.40 / 0.30 | Acc 93.8 / 89.9\n",
      "[1/2][778/782] Loss_D: 1.34 Loss_G: 6.93 D(x): 0.63 D(G(z)): 0.39 / 0.41 | Acc 98.4 / 89.9\n",
      "[1/2][779/782] Loss_D: 1.58 Loss_G: 6.95 D(x): 0.65 D(G(z)): 0.51 / 0.40 | Acc 96.9 / 89.9\n",
      "[1/2][780/782] Loss_D: 1.47 Loss_G: 7.31 D(x): 0.68 D(G(z)): 0.48 / 0.32 | Acc 93.8 / 89.9\n",
      "[1/2][781/782] Loss_D: 1.67 Loss_G: 6.75 D(x): 0.51 D(G(z)): 0.39 / 0.47 | Acc 92.2 / 89.9\n"
     ]
    }
   ],
   "source": [
    "iteration = 0\n",
    "for epoch in range(opt.niter):\n",
    "    top1 = AverageMeter()\n",
    "    top1_weakD = AverageMeter()\n",
    "    for i, data in enumerate(dataloader):\n",
    "        iteration += 1\n",
    "        #######\n",
    "        # 1. real input\n",
    "        netD.zero_grad()\n",
    "        _input, _ = data\n",
    "        batch_size = _input.size(0)\n",
    "        if opt.cuda:\n",
    "            _input = _input.cuda()\n",
    "        input.resize_as_(_input).copy_(_input)       \n",
    "        label.resize_(batch_size).fill_(real_label)  \n",
    "        inputv = Variable(input)\n",
    "        labelv = Variable(label)\n",
    "        \n",
    "        output = netD(inputv)\n",
    "        errD_real = criterion_comp(output)\n",
    "        errD_real.backward()\n",
    "        # calculate D_x, the probability that real data are classified \n",
    "        D_x = 1 - torch.nn.functional.softmax(output).data[:, 0].mean()\n",
    "        \n",
    "        #######\n",
    "        # 2. Generated input\n",
    "        fakes = []\n",
    "        for _idxz in range(opt.numz):\n",
    "            noise.resize_(batch_size, opt.nz, 1, 1).normal_(0, 1)\n",
    "            noisev = Variable(noise)\n",
    "            for _idxm in range(opt.num_mcmc):\n",
    "                idx = _idxz*opt.num_mcmc + _idxm\n",
    "                netG = netGs[idx]\n",
    "                _fake = netG(noisev)\n",
    "                fakes.append(_fake)\n",
    "        fake = torch.cat(fakes)\n",
    "        output = netD(fake.detach())\n",
    "        labelv = Variable(torch.LongTensor(fake.data.shape[0]).cuda().fill_(fake_label))\n",
    "        errD_fake = criterion(output, labelv)\n",
    "        errD_fake.backward()\n",
    "        \n",
    "        D_G_z1 = 1 - torch.nn.functional.softmax(output).data[:, 0].mean()\n",
    "        \n",
    "        #######\n",
    "        # 3. Labeled Data Part (for semi-supervised learning)\n",
    "        for ii, (input_sup, target_sup) in enumerate(dataloader_semi):\n",
    "            input_sup, target_sup = input_sup.cuda(), target_sup.cuda()\n",
    "            break\n",
    "        input_sup_v = Variable(input_sup.cuda())\n",
    "        # convert target indicies from 0 to 9 to 1 to 10\n",
    "        target_sup_v = Variable( (target_sup + 1).cuda())\n",
    "        output_sup = netD(input_sup_v)\n",
    "        err_sup = criterion(output_sup, target_sup_v)\n",
    "        err_sup.backward()\n",
    "        prec1 = accuracy(output_sup.data, target_sup + 1, topk=(1,))[0]\n",
    "        top1.update(prec1[0], input_sup.size(0))\n",
    "        if opt.bayes:\n",
    "            errD_prior = dprior_criterion(netD.parameters())\n",
    "            errD_prior.backward()\n",
    "            errD_noise = dnoise_criterion(netD.parameters())\n",
    "            errD_noise.backward()\n",
    "            errD = errD_real + errD_fake + err_sup + errD_prior + errD_noise\n",
    "        else:\n",
    "            errD = errD_real + errD_fake + err_sup\n",
    "        optimizerD.step()\n",
    "        \n",
    "        # 4. Generator\n",
    "        for netG in netGs:\n",
    "            netG.zero_grad()\n",
    "        labelv = Variable(torch.FloatTensor(fake.data.shape[0]).cuda().fill_(real_label))\n",
    "        output = netD(fake)\n",
    "        errG = criterion_comp(output)\n",
    "        if opt.bayes:\n",
    "            for netG in netGs:\n",
    "                errG += gprior_criterion(netG.parameters())\n",
    "                errG += gnoise_criterion(netG.parameters())\n",
    "        errG.backward()\n",
    "        D_G_z2 = 1 - torch.nn.functional.softmax(output).data[:, 0].mean()\n",
    "        for optimizerG in optimizerGs:\n",
    "            optimizerG.step()\n",
    "            \n",
    "        # 5. Fully supervised training (running in parallel for comparison)\n",
    "        netD_fullsup.zero_grad()\n",
    "        input_fullsup = Variable(input_sup)\n",
    "        target_fullsup = Variable((target_sup + 1))\n",
    "        output_fullsup = netD_fullsup(input_fullsup)\n",
    "        err_fullsup = criterion_fullsup(output_fullsup, target_fullsup)\n",
    "        optimizerD_fullsup.zero_grad()\n",
    "        err_fullsup.backward()\n",
    "        optimizerD_fullsup.step()\n",
    "        \n",
    "        # 6. get test accuracy after every interval\n",
    "        if iteration % opt.stats_interval == 0:\n",
    "            # get test accuracy on train and test\n",
    "            netD.eval()\n",
    "            get_test_accuracy(netD, iteration, label='semi')\n",
    "            get_test_accuracy(netD_fullsup, iteration, label='sup')\n",
    "            netD.train()\n",
    "        \n",
    "        # 7. Report for this iteration\n",
    "        cur_val, ave_val = top1.val, top1.avg\n",
    "        log_value('train_acc', top1.avg, iteration)\n",
    "        print('[%d/%d][%d/%d] Loss_D: %.2f Loss_G: %.2f D(x): %.2f D(G(z)): %.2f / %.2f | Acc %.1f / %.1f'\n",
    "              % (epoch, opt.niter, i, len(dataloader),\n",
    "                 errD.data[0], errG.data[0], D_x, D_G_z1, D_G_z2, cur_val, ave_val))\n",
    "    # after each epoch, save images\n",
    "    vutils.save_image(_input,\n",
    "                      '%s/real_samples.png' % opt.outf,\n",
    "                    normalize=True)\n",
    "    for _zid in range(opt.numz):\n",
    "        for _mid in range(opt.num_mcmc):\n",
    "            idx = _zid*opt.num_mcmc + _mid\n",
    "            netG = netGs[idx]\n",
    "            fake = netG(fixed_noise)\n",
    "            vutils.save_image(fake.data,\n",
    "              '%s/fake_samples_epoch_%03d_G_z%02d_m%02d.png' % (opt.outf, epoch, _zid, _mid),\n",
    "              normalize=True)\n",
    "    for ii, netG in enumerate(netGs):\n",
    "        torch.save(netG.state_dict(), '%s/netG%d_epoch_%d.pth' % (opt.outf, ii, epoch))\n",
    "    torch.save(netD.state_dict(), '%s/netD_epoch_%d.pth' % (opt.outf, epoch))\n",
    "    torch.save(netD_fullsup.state_dict(), '%s/netD_fullsup_epoch_%d.pth' % (opt.outf, epoch))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:Directory watcher advancing from modelfiles/pytorch_demo3/events.out.tfevents.1512681730.en-cs-nikola-compute01 to modelfiles/pytorch_demo3/events.out.tfevents.1512681765.en-cs-nikola-compute01\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:Directory watcher advancing from modelfiles/pytorch_demo3/events.out.tfevents.1512681730.en-cs-nikola-compute01 to modelfiles/pytorch_demo3/events.out.tfevents.1512681765.en-cs-nikola-compute01\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:No path found after modelfiles/pytorch_demo3/events.out.tfevents.1512681765.en-cs-nikola-compute01\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "INFO:tensorflow:No path found after modelfiles/pytorch_demo3/events.out.tfevents.1512681765.en-cs-nikola-compute01\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "<tensorflow.python.summary.event_accumulator.EventAccumulator at 0x7ff4a7a9ab50>"
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from tensorflow.python.summary import event_accumulator\n",
    "import pandas as pd\n",
    "from plotnine import *\n",
    "ea = event_accumulator.EventAccumulator(opt.outf)\n",
    "ea.Reload()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "_df1 = pd.DataFrame(ea.Scalars('test_acc_semi'))\n",
    "_df2 = pd.DataFrame(ea.Scalars('test_acc_sup'))\n",
    "df = pd.DataFrame()\n",
    "df['Iteration'] = pd.concat([_df1['step'], _df2['step']])\n",
    "df['Accuracy'] = pd.concat([_df1['value'], _df2['value']])\n",
    "df['Classification'] = ['BayesGAN']*len(_df1['step']) + ['Baseline']*len(_df2['step'])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The results show that the Bayesian discriminator trained with the Bayesian generator outperforms the discriminator trained on partial data."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAeQAAAELCAYAAAAIvPWuAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4wLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvpW3flQAAIABJREFUeJzs3XecVNXd+PHPbdNntlOkCLr0IkVQ\nRJDYUFTEQuyKeVTsiXk0tphfjMY8lifWJApqNCEm+phYYy/YKFFBEBAElLL07dNvO78/ZhlZdpct\n7MLuct6vF68XU+69586dne897XsUIYRAkiRJkqT9St3fBZAkSZIkSQZkSZIkSWoXZECWJEmSpHZA\nBmRJkiRJagdkQJYkSZKkdkAGZEmSJElqB2RAliRJkqR2QAZkSZIkSWoHZECWJEmSpHZA398FaEhp\naWmztwkEAiQSiTYozb5jGAaWZe3vYuwVeR3ah85wHUBei+YqLCzcJ8eRWl+bBuTp06fTr18/AM46\n6ywqKyt5/vnns1+Ye+65p1WP1xl+gOSPT/sgr0P7Ia+FdKBo04DctWvXWkH3/fff5+STT+aMM85o\ny8NKkiRJUofTpgG5tLSUW265haKiIi6//HIA3nnnHRYsWMBRRx3F6aef3paHlyRJkqQOo00D8qxZ\ns4hEIrz77rvMmTOHiy++mEmTJuG6LnfddRcDBgxg4MCBbVkESZIkSeoQlH2x/GI6neb222/ngQce\nyD73xhtvADBlypTsc0888QSzZ88GYMaMGVx77bVtXTRJkiRJahfarIacSqUwDANN01i2bBndu3cn\nHo8TDAYRQrB8+XJOOOGEWtvMnDmTmTNnApnm7uaOtC4sLGzR6Oz2pDMM/pDXoX3oDNcB5LVoybGk\njqnNAnJJSQmPPvoogUAAwzC47rrrePnll1m8eDGKojBkyBBGjBjRVoeXJEmSpA5lnzRZt0RL7iY7\nQ41A1gbaB3kd2o+OcC1irsu7sRQDPQaDfEad12UNWWoKmalLkiRpL70aTfFBwmR2VRynGXWcNabN\nkxVxSiy7DUsndRQyIEuSJO2lQw0NQ4EiTW3Wj+qfK+N8lbaYU9W+WwCkfaPdps6UJEnaG5YQpFxB\nWGt6iBRC8EXSxFAVRvg8dV5PuC7/iqboqatMCvqyzx8R8DLc58GrgKIoTT7ecK/B/KTJiHqauaUD\njwzIkiR1OrYQ3LWjmrgQXBQJMMJfN7jWZ4Vp849oEoBcVaWPp/ZP5EeJNAuTJosVGOHzkLtLsPer\nTQ/EO52TE+DHEX+zgrjUeckma0mSOoUP4ykeKY+y3XawBMSFwBawyXaavI9cVUUh88MYqifADvAY\neBXI19R6Xweoctw6/ciVts37sRQ76imLDMbSTrKGLElSh+cIwSvRFDbwZizFJblBLssJsMF2+VHQ\n2+T99DA0flUYQVEgrNatrxzi0bm/S06DQfTDWIrX4ykKNZVbCyPZ5x/ZuJVv4ik+Tpjc2SVCzHVZ\nkbYZ7NUJ1XMc6cAkA7IkSR2epigM8xqsMm2OqGmeHuTzMKgF+4o00ue8pxrthpraeZnj1nq+u8fD\n2kSKQj2z7z+Vx9lsO/Q0NP67INyCUkqdkQzIkiR1Cv+VF2yzfcdclzlVCbpoKmeE/QCstRwKNJWw\nqqCRCdRnR/wU6SqDPJlBWqvSFi9UJzmpMI9fFIQprAn2PlVBVcAvm6ulXciALElSh/BZIs0H8TRn\nhH0MrWcEdEtVOi6WEHyaSKMAp4X9aLsFyoUJkxVpm9UKjA94WZm2eTWWZGdXcZGucnNBmKCqMiXk\nz273eizFNsflhR0V3N/lhybsmXlBNlgOBxtaq52H1PHJgCxJUofwajRFXAhej6VaLSDvsB3uK4ti\n1wRWVYH+XoPB3kwNN1FTM/agEFIV8jWVAk3FRYAAB3CBHbaLDexaKksITgx4eCGaYnJRLuCy0bJ5\nJ5bmR0EvxR758yvVJr8RkiR1CJODXj5IpJm8y/zfvZUUAgEoZPqhdQUO0n+otS5KWSxP2+gK3JAf\npmdNjfaYgJcuukZQgQVJi34eHc8uteqP42leiibp59G5q0sOhYX5lJaW8peqBFtsl/WWzW+65GTf\n/0kizdx4mrPD/npTb0oHBhmQJUlqlxwh2GI7HFLTLnxsyMexoR+CsSkEO2yXg3S1xVOHehs6l+YG\nsYVgmEdHURQURcERgvfjaVwEYVUhrKp00X8Y7KUqCkNqatF9PHUD6Iq0hQV8t1tKzBFegx12muG7\nBd1XoymSNbV/GZAPXDIgS9IB7OuUyXeWw4lBX63EFt+kLSodlyP8HtQ2GniUdAULkmn6ewx61NOX\n+lRlnFWmzYCExRU5/jqv318WpcJxOTrgZVq47uv1sYTgD+UxqlzBdfkh8jU1G1h39VXK4s1YCk2B\nn+aH6GU076fyxzkBwrEUo3fb9ylhP1NCvjo3ECcGvXycSHNiqOlTtKTORwZkSTpApVzBM1UJLAFC\nwLRIJqiV2g5PVcZxRGbk8JF7yHK10bIxFIVuevMHJz1fnWBRysKvpLm3a06d1yudTGKPSqf+xB4x\nV2AJqNhtitGuhBA8V51kk+XwX7kBkkKw0XawBSxPW0wI1B8Au+kamgK6opDbgnnC+ZrKBTmBel+r\nrzZ/QsjHCaHWa4qXOiYZkCXpAGUoEFFVql2XPoaGKwSPV8TZYjk1faqQt4d0kGtMm8crYgD8oiBM\njqryUjRJoaZyXNDbYDPyRsvmL1UJgoqCoUCOVv/7rswLsiRtMTY3Ama6zus/yw+x2rQZvYcBXhWu\n4MuUiSlgYdLkpJCPw7wGla7LyD00DfcwNH5blIOqgCGnJkn7iAzIknSA0hSFXxaGMUUmD3Op7bDW\nsjFFZgDV+ICXvJp5s2lX4CAI7FJb3DU9pAv8J2UyP2miKzDUZ2Rrzdtshz9Xxin26JwdCfBOLM0W\n20UDbisIkd9A7TqiqUwIeAnoGgmz7utddY2uukaJ5bAmaXGE31snn3SuqjDYY7DZdhhd0/x+cW7T\n5it7W5CbWpL2hgzIktQJWUKwPpnGL8Qe+4A1RcFf83KBpjLG52GL7XB0wJtdOKHScfldaRQHwQ35\n4Wx/7wCvwZV5IQwl08RrC/AoEFRV8nYJ3B8n0pTYLttskykhHz8Kellv2Qz3GXRtYt+sLQR6A+fx\nSHmMlBCU2C4X7tZMrCoKl+UFsYTgf8uiVDqC6/ND5Gkq95dFSQnBz/NDFLagyV2SWlu7DciGYWAY\nzR9tGAjU32/TURiG0eHPAeR12N9+u2kHm3dUMzbo55Ki3CZv95Ng3drjtrSJAwgUorpOIPDDAKrh\nu3xE/YFHIyEUaveTHqsZfGOW093QeaQiwdCAlwf6dM++bgvBqqTJwV6DUM1NwK4BeE5ZNR9XxTgh\nJ8j0ghz+sqOS+bEk5xdEmBAJkqPHcG2HHj4vgUCAtSmTdWmTCeEgnppa7jbLptSpxhSC74TCobpB\ndU2tv0TR6L0PrnVH/j5J+0a7DciWZWFZVrO2CQQCJBIde6FveQ7tQ0c9hwWJNO/G08SFwHQFO9Jm\nk85jjWmz1XI4MuCpUxPtCpwd9pESgv64zf5cCoBfFYaZU5WgxLLZWmUz2adn+2b/VpVgUcokR1X5\nVVGE16JJ3o+nGeP3cEFOgKXxJDawJJ7kFL/BwliCtICPq2KM1hVuyg9S4bh00VSq4nEe2F6FLWB7\nKs3pNaOvQ0IwKeBhm+0ySgefYzHObxB3BYMU0ebXel9+n2Tg77jabUCWJKn5Xo2lqHYFRZrCOQcV\n0d+uOxhqd3HX5U8VMRyRSZRR32jfI2tGI2+xHBwh2O64qDVrAjfVhICHb02LQR6j1kApWwiEIJst\na0XawiYz9Qrgqq55vFNWxbE1CUEuiAT4NGkyLZx57FEUutY0OatCEFAUEohs3mjI1NhP3W1q1FkR\nGbik9kUGZEnqBCocl69SJkcHPMxLmJwS8nNCfg6lpaWNbmsoCl5FIb1bENvdJsvhwfJoZjoUmTST\nEVXlkCamgDzY0PlNUd3pTeflBBjuszikpj/54pwg78VT2SlJfb0eLtplINYIv4cRDUzFygxUi1Dt\nuhTJfmGpg5EBWZL2kTLbwVCURpf3a0yV4xJWlVqDtf5UEWOL7dJT17i7S92gtyceReGOwghx193j\n4CaXTBV251EVINwKI5E9isLIXWra3Q2tVgBuLq+qUKTKYCx1PDIgS9I+8J1p88eKGApwW2EkO52o\nuV6LJvkwnqavR+e6/FD2+UJNpcxx91jD3RO/quBvJIj1MnSuyQvh1hxPofG1gyVJajoZkCVpH4i5\nmUUMhID/JEx6ebTsikLNscFyMIHNdu3sVf+VG2RHzcCm3TlC1FlOsKX6yhWKJKnNyL8uSdpLK9IW\n1a5grM9ocM7vMK/OBZEAG22Ht+MplATcUhBudj/nBTkBPkmk62SZ0hpIXzmrIsaKtM20sI9JQR+z\nK2KsNG0uzQm06prCkiTtPdneJEl7YUdN3ucXqhJ8mWp4mp6iKIzyexjiNVAV0FHwtaD/NVdTOS3s\np2cTE2qsNh1sYFnaRgjB8rRNWsDneyirJEn7h6whS9Je8KkKOgqOIprUL1zs0bmtMIJHgVALFi1o\nrv/KDfB50uTkmhWGpkf8LElZnNqEhQzSruD+sigJIbghP9Tk2nzSFbwcTdJdV5nUimsXS1JnJwOy\nJO2FsKpyR1EmH3R+Ewc4NfV9uxJCsMV2KdRVPIpCme3wccJktM+oaa5W6+0nHug1GLhLX/X4QCZH\ndVNscxwqXBdHZBKHNDUgf5ZIMz9pYigw3Odp0fkeqObGU3yaMDkn4qdfC8YYSB2bDMiS1EIx1yXp\nin0y3/WVWIpPEmkKNJXbCiM8W5XgO8vh40QaVYFDDZ2rdxl1vTtHCOKuaNao6J66xlF+D9WuYFQz\n+puLPTqemjnKrTEt6kDyWixFWsC/Yyl+JgPyAUcGZElqxPuxFCtNm/NyAtnaXsJ1uWtHFBvBf+UG\nWzRiujnKbRdbQNTNzAXua2RWOdIVSDWyJjDA78tibHEcpgR9HN/EdXdVRWlRNqs+Hp37uuTUyWkt\nNe7YgJf5SZMTgk1rxZA6FxmQJakBjhBUOi6vx1JYwDuxFOfmBBBCkHQFNgJXZFZD2hsx12WL5TC7\nMsFBusr1+aE6o7XPywnQL2XSv2ba0RmRAMeHfLiuYIlpM6yRG4LtjoMlYL3l7PF9LSGE4BvTJqAo\n9Kkp355WmJIadkrYzym7pfiUDhwyIEtSPYQQ/K40mk22UeUKDvd7sGqer3Jdpob8+FWFw/ew0H1j\nVqRMnqpKgIA0sMF2SAhBaLeA5leVbCrJncKqCipMbEKT+dV5IZalLSbV1LzWWzYbLIcj/B48exk8\nv07bPFsVRwFu3mUq13rL5g/lcbrpKj+r5yZDkqTaZECW2rWE66Iryl4HDcjUeLfaboMDoHblAhWu\niw0c4tE5r2ad3UrHpcp1sWoWYjjGv3dNi5tqmqI1YKBHY4DHaJPR1309ejaphy0Ej5bHsARst529\nXmTBo2TSaCpQa6WopSmLpBCUWA4xVxDR9vyZlzsuH8fTjPYb9GritC5J6kza9Fs/ffp0+vXrB8BZ\nZ53F0KFDefjhhykvL6d3795ceeWVqPtg6ofUMa2tSTeZybUcJrCX35U/V8b5xrTp59G5Mq/hAVCQ\nSbQxMzfIt6bNsbv05+VqKmeG/ZRYDsc0MFo57QpcMrXaxhwT9OIA3XWVw+oZOPVt2uLZqgQjfQZn\nt9LqRCoQUBTiCAq1vR+QNtBr8LP8MD6FWlO/jgl42Ww7HGzoTRpM9tfKOKsth/+kTO5pZj5uSeoM\n2jQgd+3alXvuuSf7+N///jfFxcWceeaZPP744yxatIjDDz+8LYsgdWDbbAdHgElmhHBgL+/dyh2B\n1YQBUDv19xr0r6dvdk/Thiocl9+VRhEI/rsgXG/2LIBS2+EPFXEKNZUr84IN1tjnJtJUuYJPE2br\nBWRF4fbCCJWum122cG/1NOruJ6KpzGzkxmdXfTw6622HXvXsS5IOBG0akEtLS7nlllsoKiri8ssv\nZ8WKFZx77rkAjBkzhmXLlsmALDVorN9D3BXka2qrTC26Ii/IkpTFYQ30+c6pSrA4ZXJ+JMCEZi7y\nnqpJohGraeYWAh4uj+FB4caCEOHdaohLUhaljku161LqNBwYTw75KHcSzZp21BReVaFrO1sR6fSw\nn2ODXoKyr1k6QLVpQJ41axaRSIR3332XOXPmEI1GCYUyd8zBYJBoNNqWh5c6OF1ROKGJU3SaIldT\nOWYP00kWp0zSAhYkTSY0c99bbIfKmiQaY3yZ9JifpyzSCDbYDkN2C8iH+z0sSVt00TWK9tCc28vQ\nuaUw0szSdFxh2YUlHcDaNCBHIpkfkokTJ/L222/TpUsX4vE4eXl5xONxwuFwWx5ekprl3IifhUmL\nM1ow7eRgQ+NIn4e4EJwdCaAp4JIEYEA9KyTlaCo/L9jz9z/qugQUpdVWapIkqX1ThBCiLXacSqUw\nDANN0/jyyy+ZO3cuAwcOxLIspk2bxqxZsxg5ciRjxozJbvPEE08we/ZsAGbMmMG1117bFkWTOjBH\nCFRaN+FEwnH4PplmQNBfa5Rwa6i2HX67bhMeReH2Pj3wNTFT1ofl1TyzZQdFHoP7i3vJBBuSdABo\ns4C8Zs0aHn30UQKBAIZhcN111xGJRHjooYeoqKigV69eXHXVVQ2Osi4tLW32MQsLC1u0XXsSCARI\nJBL7uxh7pSXXYbPloCrQTdeIuS5PVsQJqyozcgPZGuJq0+bxihh5qsqtheG9rjkuTZl8GE9T7rjE\nhGCE1+Ci3CDQetdhUdJkTlUCRYErcoMMaGJGr79XJbL5oO/rktOic+0Mfw9w4P5N7M2xpI6pzZqs\ni4uLefjhh+s8f/PNN7fVIaUOar1l82h5DICf54dZZ9l8bznoikNJzbQZyEwBMgWUuy4JVxBuZF5r\nY56rShITAo3MPGCz5tZ0XiLNV1VJzgx6Ghwl3VSDvAaH1OR2PqSepuuGnB72EVYV+nt02WQtSQcI\nOfteanOuEPy1KkGZ43JZbrDOnFR7lzYaB8Fgr0EXLU1IVThol4D4o6CXqCvobWh1Ri03R9oVrLNs\nxvoNPkuaTA76KNRVhtbUXv+vOokFGK7D5c2YtlMfv6pw7R4WfWhIQFU5VaZQlKQDigzIUpvbarss\nrandLkr9kL5xp0NrEnUokM3QdHtR7ZHF60ybiKZybk3GrF37kmOuywfxNIO9BsVNqIX+sSJGieVQ\n7NX53665dV4/zGewLG1zpL91pxpJkiTtiQzIB4BttkNEVZuUOaotdNVV+ho6FY7L8AbmAO8pkH6Z\nTPP36iQq8OuiCN+bNk9VJchVMyk1XQFbHJePEmke6JLT6AAoU2RSY1oNDJ+YkRvsFP2WkiR1LDIg\nd3KfJtK8FE3iVxTuLIq0Sn+kK0SzFgrQlB+abddbNttsh4Eevd7A6QpRZ9k+U4AgE0QdYJVpYwko\ndQQumfcbChRqapNGI1+TH2RV2m72kom2EKSFICjnykqS1AZkQO7kypzM4gUpMvmV9zY305MVMZan\nbaaF/XtMslGfHbbDo+UxBDAjJ8iw3WrLO2yHB8pi6ArcWhjOLrJwpN9DWFXJ01TCqsqJIR9JAbmq\nwoKkyUCvwelhH/5dgnHUcdlk2fwrluKYgLdWusuQqjK6Gc3Rzo7tmFu38D9d+xATgotzAgzXFWKP\nPYhbWUHoyuvRunVv1mfRkI2WzeyKOP08enbEd1tKf7EQ57s1+E45HTW4d/3lBwrhuqAo2Zu/3R83\nZz9KzXc89f47pD+di/+M6XiGj2z1MksdgwzIndyUkI8CTaWXoZGu6Xfdm1ryKtPGAr5OWxwT9PJp\nIs1XKYsfR/x02WUAlhACQe11cTVFYecjo54ibLQcLCFwgO22S8iT+bFSFIWhuwTvkKpyQU1fcn1r\nx74ZS/JuPI1Ss6Thy9HUHvNP74mwLWKPPEBC04hefiOOplFiOQyNVuPs2AamSfo/8zAGDELvP6je\nH2Vny2bQNLQuXRs93qcJk3JX8GXK4seuwNvCbgZ7UwmlH75LOicXe+UKfCdOQSssyr6eeOFvmKu+\ngXgcHBt8fgJTz8ycsxCk/v0Kbnkp/unno/oza0AjRDaANEa4LkIInJXLUQuKmnXD4karsZYsxhg8\nDDU/H2vLZpKffoQArC8W4j/9LDwjRjfr82iJ+gKt/f1aYk/+ESWSg+ewUQhFwZz7PlrXboSuvxEU\nBXf7NkQ6TerNV9FHjUHLy8epScWa+uh9Um+/gdqtO+6mEvRBQxDJJE7JekinSfzzeRLPz8F/1rl4\nR41pqGhSJyUDcidnKApHB7zMS6R5uDxGgaZyW0G4wbt5t2aJwq4NLFH4k5wg/0mZTAn5EELwYnUS\nG3g9luInNTU6WwjuKYtS7rhclRfK9g/nayq/KAiTEqLe5fWG+wyOtjz4FZW+e7HAwDrTwRTgASKq\n0uCqTE2iqKCq+C2TCzZ/x7ZBQzku4EMN+fAeNRF7UwnmwnmYC+cROPdiPMMOy25qf78WZ+sWkv9+\nGYDw9TeiFnXF/nYlSjCE3rMXwjJJz30fJS8f5/vvGF88gA29ihngNVocjAHiT/4REa0GVQXXRUSj\nhGZeixuL4mzehLnoc7Bt8AdAVdD7DwDArSjHWvc96fmfgGnilJWBYSDKShG2jWfk4Sg+H77Jp6A0\nsFKUvX4dsVmPga6BZYGqkXP7b1D8/nprl7sH+fhfnsJZ9z3J999GDQYhkcCtrsqeS+KN17BWLMcY\nORpRXoa9djXWqm/QBw3G3b6d4HkXoXXvUWufwrayLRqBiy9Dy83DWvstIhHHO+FHKKqKW1WJSKdI\nvvwiwnVxNpWgeDyE//tWABIvPIdIxMCyEOVlpD94p2bnAmfrFuzV32KvWUV63sfgumBZ2GtXg2Gw\n3ufHTSYzn4mZxi3ZAK6LveLrzHtzclDz8nHLSsGyMBfOkwH5ANRmiUH2lkwM0rqammjiz5VxlqUt\nij06VzVhys9TFXG+MS1m5AQYWrMAgpGby3Wr1mEJOCnorbcW25YqHZeP4mmGlHxP0Yt/wxh/DJUT\nj8veZJiLvyD1/tv4Tp6KZ8gw7JKNWEsWoXbrjv3tSvTBQ9G2b0c96mjUYAi3ugq3rBShKLjbtuIZ\nPRZFz9xQuFWVVN//WxCC4IWXoh9STGzWo4h4AjdalVllAgAFY9hh4LpYK74GFILnX4K97jvSH3+Q\neZ8QYBhEfnk36m6LWwjHwVn3HcLjwfzkIzxjj8Qo7l/n3J2tWzC//A/2hu9xN26ESARRWYHvxFPQ\neh9M4rlnEekUWvceCNMkcN7FmZq7qiLicarv/Q04NkowhEinMwHVsTPBUJBZ9FhV8R03Gf3Qfuh9\nDske241WE//LUwjTxN2yCRQFNA1UFbWgECUnD2f1StQu3TAGDEK4LuanH6EX9yP4kyvBsrBWLsda\nsghr1TfZoIbHAwK03gcjYjHcynJIpzP73vm5CZE5nhCoB/dF79oNJRzB2bwJ/ymn41ZXEX92dmY7\nw6g5kczgBGP0WJRgAHPeJ+A4NfurOSlNwxg0BNc0cVYuB8NAHzwMxe/HWvQ5ij+AXtwfkU5hf7sS\nHDdTbk0DVUEJBBGxGAg3cwPk9aH17IU+9DDcDetA17GWLMZ/8ml4J0zCXPwF6YXzCEw9E+2gni36\n/svEIB2XDMjtTFsF5ITr8n48zQCPXu+Sgjs9UBZlveXQTVNrTT1aY9rMS6Q5MeRrNFlGYWEhr2zY\nxAbL4fSwb4/rGH9n2rjseZR1U623bJ6rSjDG5+H4kI/ow/fjbFzPi6f+mG8GDaevoXNtfoiqu36J\nqKpEyc1DP6QYe+VyRCKRrYFlgo/AGDGa4AUzABCpJFV33QGOje/4k/Adf1L2uE7pDtxEAuvL/+Bs\n24yzYQO4TiZAqBq+085AVFWSnvteTVCruRlSlMwPtaKCoYNlZcp0cF/0fgPxjvphJbTEv17A/HJh\n5gfftlACAXJ+cx/CdXG3bcWpqiT94Xu427ciotWovXrT+6bbqTQthOMQ/Z/f4MajNTcICp4jjyJw\n+tmZc3Mcor//H9yKspqjKfinnY1n5OHEnvwjbrQaz6ChuOkU9rKlCNsCN/Oz4TlyPGqXrpBK4mze\nhLX4CzAMjEFD0foegt6zN+kF87C+WJANmCg7vw81gVTTMrXmQACRTKHk5BC65DKs778j/e6bhKZM\nRRk4GCWUadmJ//VprOVLUfwBhJlG63MIiisg4Mf+/jtIxDPBb+f1NAxQFPT+gxDpFM6GdZnPUVN/\nuGGqqbmjKKjhCASC6L0Oxq2qxF65IhNcDQM1v5DQtTeg6AZuIo7i8aLoOonXX8oEdE3HN/kUjEOL\nMzc96TTWN8vJKSxk+2sv4Z14LJ4hw/b6u74nMiB3XLLJ+gARUFVOC/txhWCNadNNV7ODpqKuS1BR\nUBWFy3ODLE5ZdaYnPVkRJyYEpY7b6KIIkFkzeHwj79lo2fyxIpOh66q8EIfuZVD+dzTFJttleyzF\n8SEfvimnkXzln1T1ORRTQJltY361CM/4iZifzEWkkliLPgevDzwelEgOorISJRSCRAK9d58fdq7r\nKB4PwhQoeQW1jqsVFiHWf4/5xQKwbdRu3VEDIXwnnYLi9aF1646zfSvmpx+BxyBw3iXYmzaSfvsN\n0DTC192IWlAAikrylX9izv8Ea/GX2KtWYAwZhmf4SISZzgQNXQMEer+BACT+/izWimW1a5OGB713\nX/RIDpSWomhaJogKMAYPwxg+EmOXoCASiUwwtm2MMePwDBmKPmgoiqIQvuqntc5VnHkO9sYNxGc/\nBo6DOf+TmtqkAFVFyc1DK+pC4PxLfmjSNjzYa79F69ETxecHRcVa8iVKTh56r944Wzfjbt6UqUka\nBorhQeveA617D3xHTahzkxq86CcIxwHXwS0rQ+3arVYTeOyR+3G2bkUtLMStqgTbAVegH1qMb8KP\nsL79BhGNog8ZjqisIPbHBxGuwDf5FNTcXDzDRmSP5WzeRHTtahSfj8iNt2XKX0MN/DDozn/yVPRe\nfdB69KzVV694vXhGjCJYWEjEgt+0AAAgAElEQVS4Z+/mfJ2lA5CsIbczbT3/9eVokk8SaQKKwl1d\ncng9muSDRJpDamqPDXmmMs5XKYtTQr5Gl0RsynUwhWCT5fCHmoB8XX4omyKzpVamLP5anWC0z+DM\nyA9NvtWOy6KUxSEv/IXItyvQuvcgfP2NJJ6fg7n4CzzHTcZ35HjUcCTzQw/4EKS12uVxkwlELIZW\n1KXOsUUqRfSR+xHpNKFrbkDLL6j7nl36T4UQ2CtXoERy0Hv80DRpLv+axN/+DLoOiQQYBjl3PwCu\ng7V8GXqfvpmm2JKNJN98NdPvWboDAkGwLLzHnYh3zDiUcJiioqLsdXAryrHXr8MYMgzFqNtCkl7w\nGc7GDfhOPR3V3/ha0M6WzThlpST+8ZeakxMoukH4F79s0mhtNxZF8QdQNA2ndAept9/AGDkaxeNB\n79mrVuBr7t+EEAJcN3tDYH+3Bqd0R6aroZ5+b5FOg3BrHbPW6y0cRb0rmctaagoZkNuZtg7Iz1cl\nWJA08akKv+uSw2PlMVaaNiFV4X+65OxxW0eIJo3Qbuw6VKbS3LOtAldRuCjsoygU4qC9GMS1k0gl\nMRd9gX5Ica1Rvc6WzaQ+fBd3x3ac7VvRevbO1vyE49T7Ix0IBCh76f+wVnxN8Ny6g4TaknAczK+/\nIvn8HLQevQhdc0OdYFD94L24mzaCP4B/8hSMIcNR8/JrvWdf/D2IVBIUFeE6KFqmFaG1dYYkLTIg\nS00hm6w7oYTrYigKRj3B88yIn35enYM0lcUpk9NCPnqmLEb5G0+SsWswXpYyWZyyOCXsJ78ZeaWd\n0h3sKNmIk3dQZhrLlk0cNHhwk7Z1kwlS/34VrVdvvEccVef1xL9ewPpqEXgM1Lx8vEeMx3v0McT/\n8ddM8IrkEJxxBfrBfbPbNDRSWDgO6Q/fBdsm9cG7P/QlOw6xPz2Mu2M7wSuurVW7bS2KpuEdMTrT\ndKrWn+zEe8Q4kq9vxzt2HN6jJ7V6GZpqZ61SLn8hSXtPBuRO5puUyZNVCQKKwh1FETy7/ZgbisIo\nn4c5VQkWJU0CqsLde6gZCyGICUFotya7P1clSAtICsEVjYzGFkKQeuMVnC1bsNetpdAVTBk3ibTP\nx4jxdQNrQ9Iff4i5cB58sYDUu2+iFBbhbtqI3vdQgpfORM0vyAyOchzcLZtJvvkq3qOPwRg8lPS2\nLXgGDcHoN6BJx1I0Dc/osVgrV+AdP/GHc4lW42zeBJaJtWJpmwTkXcvQEO9RE/EeNbHB1yVJ6nhk\nQO5kSuxMZq4EgpQr8DSwRKFBZlCp3kgT9NOVCZabFkf5PZy9S7/sIYbOGtPOrpC0J+62raTnZea1\nomkomsbEQw7GGDK83veLVIrEi39HCUfwn3YG7rYtxJ54DCUQzIyY1VREZQWiqhKEwF61MpOEYcBg\nPCNGY2/bSurl/8MzdhwA/smn4Dv+pD0GuPoEpp9f5zklJxfvxGNxNm/Ee+SEZu2vJczlX5P4+7MY\ng4Zma+mSJHVOMiB3MscEvVhCcJCu1VnmcFdnR/yM9Bn0aKTvdr1lYwr4rqKS6tkP4Z96Fka/AVyT\nH2q0T1kIQfLFv2Nv2Yyam4eIx/FPm47i96P3H9jgdubSxVhfLwFdxzN6DPa3KxHxGMIyCd3wCxCQ\n+NszaAf1QFRVIZIJ0h++T/qzj8m5+wG83brjPax2+sHmBuOGKIqC/6RTWmVfTWF+Ph9SqcznIUlS\npyYDcifjURSmNCERh6Yoe5yPvM12WJgwOSfi51vTYcRf/4C7bQupN17F+OlN2X3s7qXqBOuqNnJB\n0ENBVQXm4i/BTOM7eSq+405stFxuVSVa1+4ogQBKIIBW1BU1Nw97/fdo3Q5CK+yCoihEbrg5u016\n/ickt21BzS/Yq5Gw7ZF/ylQS6TSew0bt76JIktTG2u0o66qqKox6pmfsSWcYjWkYBpZlNXu7Csvm\nj+s20dXQ+MnBPZq1GlN9bt+4nS2WTU+Pzm96diH65mvEP3qfnB9fgL+BlH4Jx+XnG7ZiCjguEuT8\n/DDlf3oEe9sWCq79OfpuuZyFY1P1/N8QjkPuuRdhbdlE2UP3g6pQdNud6PVMHWqIE61GDQRbrSbc\n0uvQnnSGvweQ16Ilx5I6pnZbQ7Ysq9l/hJ3hB6il5zB31Wq+CxewMWXxoy1b6Z675ylMO6W/WEjy\npRfwjBlHYNrZ2ee7V+yg1Buk68bv2Py//w//yVOJ/OoeXNcltmN7dq6pU16Gs2kjxuBhoKoM8xqs\ndwRjDIVkKoX/0isAMAFzt/OyVn1D4vMFmWxJvfpk+oZdN9MkXVaG3sC80HppeiYtYis5kL9L7U1n\nOA8ZkKWmaLcB+UAnhOC9eJqY63Ja2N/o4KthdprPqivJr6qgIOdQhBBNar41F3wG6TTmFwtrBeQz\nn/8zJ5gmoUQchCC98LPMFKInHsPesA5t4CBIZZLkC8fGc+R4AlPP4tLcYJPnXGo9e6EGw7iWSfKV\nFwHwTT4FraioTUcvS5IktUdypfV2aoPt8HY8xceJzHzfxhw0ZCi/8qtc7VNI3Hc30fvvJm5aOI30\nSPinnY12aD8CZ59b6/nAKaeTEwzhnXQc2iHFBM48BwBnS2bKj7NsKc7qlQjLBEXB9PjYbjvNOkc1\nGCJy268Jnn8JO7P56wf3ydS2AWf7NqruvI3og/ciOniTpSRJUmNkDbmdKtRUvIqCBfTaZSS0IwSv\nx1J4HIcJb/wTNRDEP/VMFFVFP7gPqdUrwTRZnlvE/5XHCWsqd+QHEWtXk/jrU2jFAwhdcll2f/ou\nWasA3OpqrK+/whgyjMgvflmnXMHLrsJauhintBR79Ur8p50JhUX8NtKVeFmUU60Ek5cvJe26iG1b\n8R5zLIqx5+xNenF/Aj++AFSt1upBO0dXO2Yat6y0WWvqSpIkdTQyILdTQVXlrqIIgt0yZKUtPoqn\nUVyHbmXl9F2+FM/I0dnsU57xE3Erytk2dDQ2ELVtdtz1S/yuC8kk9jfLGkwXCRB/djbOxvWk539C\n5Mbb67yu9+5Te9EFMusfJzaXYwNbli5h+8dv77LsILVWRqqPoij1jiI2Ro3BWrMKNb8QtWu3Pe5D\nkiSpo5MBuR2rb6R0D13DUEBVVbqkEqg5uWi7BCvVHyAw/XxOSqXg29UctP47/PEYaDraof3xDB2e\nWf1HCNwd21DzCmotNqDm5uFs3Yyak9fkcmqOzaUvPEVJUTdGrvoaNB1FzeQ3VvciB7QaCBCacUWL\nt5ckSepIZEDuYPKqK7nlT/eDqpJzw62o4fqXQhRz32fSh+9kFlgfMRp9wCC8hx+RfT311uukP52L\nWlBI5Oe3stV2eCeWYvz0C+lTvh21azOahzWdg8MheqxcSuDciyjsP5AqVUWk07iBIElX4Fc71/xg\nSZKk1iYDcgfjbNqIYmYGUrnbt2KHQrwWTZKvqUwKeLMjq7UePTM11WCQwLkX1Wmidku3g2UhqqoA\n+GtVgvWWw0rT5p6DmjfCWVEUQpddnX3sKSxEKS3FVHXu2lFNUghm5gb3mIhEkiTpQCcDcgdjDB6G\n58ijUTwetL6H8p+kyScJE12BgR6D7jUDwDzDDkPv+2sUn69WMHbjMdKffIRn7Di0PodmF1sY6tXZ\nZDkM8rTeVyIhBEkhsAWU2I4MyJIkSXsgA/I+8K/qBItTFpfkBimuCXjCdYnP/gPOphKCl12N3vtg\n1pg2cSfBMFU0mGlL0TQCU8/MPu5t6BgK+BSF3N1yV6uhus3ZyVf+ibX4C9IeL7m/fSD7/MkhP8dh\nYwRbL6lAnqZyQSTAVtthQsDbavuVJEnqjGRA3gc+TpjYwKvRJAO9OpMCXnzJBOuSabYdMoAjli7G\n6tGLxytiuMCpCz5k9JIvCF39M9L5BfxvWQxbwM8LQuTsFnR7Ghq/i3hRNA2tCf20Ws/eWMuWoBbU\nXsQ8+fpLpD/7GH3AoFYdSDXK3/oL1kuSJHVGMiDvA5NDXr5Mmmy0HNZZDtWOYFo4yJ+nz8ABLK/O\nRAU0FBAuoW1bELEY9upVbBx1BJWuixCw/JWXGFbyPaHLr6HC4+XBsig+2+ayWQ/gUyB80x2ojaTN\n8038EZ6RozNLGe7CXvc9WBbOxg1t+ElIkiRJDZEBeR84OeTnpKCPu0ujVLguvQwNTQGPYWAKQV7A\nT0BV+WVRGGF40LsU4XoMjBGjKPbojPJ5SFVW0G/xQhzHxv5+Dav7DiDqChLAtrwCem/fiohVQxPy\n2KrhSJ3nAuddTPqzj/GMHtsGn4AkSZLUGBmQ9xFFUbitMEzcFdl1iu8oDFPtCrrpmUFXYVUl4PWQ\nmDa91rYX5AQQPo14r94A6If2Z4RhsMxrEFR0iocMRRs/Aa1Ly5NnaAWFtfqmJUmSpH1LBuRWtNly\n+DJlcnTAS56m4iYTuFu3oB3cF0VV0RSFiKYQdVxKHZc+hkZAb1o6ccXrJXTFtdnHXuC/8mqanRvJ\nhCVJkiS1fzIgt6I/bNlBleHl27Jy/rtPD2KPPIBbXYXn8CMJnDGd5Dtvkv5mGfeecxmWojAl5OPY\noG9/F1uSJElqB9o8IK9YsYJbbrmFOXPm8Prrr/PZZ5+Rk5NDXl4eN910U1sffp/qtrmE5EG96L5u\nLfTpwUtjJrL00IFMX/01RzgO6Q/exhYC27JwDQ8pN5Pv+TvTZofjcrhPztOVJEk6ULV5QH7llVco\nLi7OPj7//PMZP358Wx92v7g8qFP67st0Pe4EAJYMPgwThS9GHMGRmoZn1BiUlSv4mRNnW1Euh3kN\nYq7LHytiOAKSro8pwWC9+3aF4M1YCoCTQ74G5ylLkiRJHVOjAbmkpISePVu2WPznn3/O4MGDWbhw\nYfa5F154gddee42TTz6ZY445pkX7ba98w0bQc9iI7OMfRwIsTJpMi2RGPgd+fAEAOcDOJRd0AToK\nQhHkqA33J680bT6IpwHo69EZLLNeSZIkdSqNjigaO3YsZ511Fh988EGzduy6Lm+88QYnn3xy9rlT\nTz2Vhx9+mDvuuIOXX36ZHTt2NL/EHciRAS8/LQjT06h/qUMAn6rwy6Iwv8gLMuD1Fyl98F7c6moA\n7JKN2GtXIyyTbq6DrijoikJ3veH9SZIkSR1TozXkdevW8fzzz3P77bdTVVXFNddcw8UXX0y4gVWG\ndvroo48YO3YsHs8PmZoikcz812AwyPDhw9mwYQNFRUXZ15944glmz54NwIwZM7j22mtprsLCwsbf\n1M4UAuaWzWxcsgiRThP+dgXBEaMpeeIRXFegKAq6qvDYL+/C0/2gWusjt1cd8TrsLtCEOd3tXWe4\nDiCvxf5mWRZ33XUX//jHP/D5fGiaxrHHHsvAgQN5++23efHFF1v1eCNGjGD+/Pn4/X7mzZvHFVdc\ngWEY/P73v+f+++/n0Ucf5dBDD23Rvh966CHOP/98unTpAsDjjz9OMpnkhhtuaM1TaBFFiF1Wkm/E\nvHnzOPfcc6msrOSSSy7hjjvuyJ7U7p555hnWrl2LqqqsXr2a4uJibr75ZoLBII7jcPvtt3PdddfR\no0f96+WWlpY2+2QKCwtbtF17IByH+JN/RFSUE7jsalAUog/+DzguIEBRCF4wA2PI8P1d1EZ15Ouw\nUyAQIJFI7O9i7JXOcB1AXouWHKu1XXjhhSSTSZ555hnC4TC2bfP0009jmiZz585t9YC8q6uuuopD\nDjmk1QYB9+nTh9dff52hQ4e2yv5aU5MGda1fv57HH3+c5557juOPP57LLruMDz74gMmTJ7N48eJ6\nt5kxY0b2/7fddhs33ngjTz/9NBs3bsR1XSZOnNhgMO5IhBDZJQ93fS4hBMEG+oTNJYuw13yL76RT\nUYMhILNoRGjmdbV+fMLX34ibTuNuWIewLPRB7e8LJElS57Z69WpeeuklSkpKsi2juq5zxRVX8Mwz\nz2Tft3XrVs477zyqq6tJpVKccsop3HfffUBmcO8vf/lLNE3Dtm0ee+wxJk2axJ133snf//53fD4f\niqLw4Ycfkpubi6IoRKNR/vSnP/H8888TCAT429/+xvz58xk0aFA2oG7atInrr7+e1atXA3Deeedx\n66238txzz/Hwww9jmiYADzzwAMcddxy//e1v2bx5M2effTY+n4/nnnuOF154gVgsxgMPPIDjONx8\n88289dZbAJx00knce++9aJrGjBkz8Pl8fPvtt2zcuJFx48bx7LPP1vn93xuNBuRTTz2V5cuXM3Pm\nTBYtWkRBQQEARx11FP/4xz+adJB77rkHgOuuu24vitr+JN94lfTHH+Adfwz+087IPv+nijirTZsT\ngl6mhP21thGmSeIfc8C2QNMI7JaVa1dal25oAL0ObqMzkCRJ2rPFixfTr18/8vLy9vi+3NxcXnvt\nNUKhEJZlMXnyZN566y1OOukkfvWrXzFr1izGjRuH4zjE43HKy8t58MEH2bJlC36/n2g0it9f+/fy\npptuYvny5Rx++OH1dmFeeOGFTJkyhX/+85/ADy2rkydP5rzzzkNRFFatWsVxxx1HSUkJt99+O7Nn\nz+bFF1+st4Y8a9YsvvrqKxYtWgTAySefzKxZs7jqqqsAWLZsGe+99x6qqjJy5Ejee+89TjjhhOZ/\nqA1odFDXjBkzWLNmDbfccks2GO+0bNmyVitIR2R9/RXYNtayJbWeXx9PYAnB6rJyAFJz36P6oXux\nN5WArqMWFYFhoBcP2B/FliRJanWO43DTTTdx2GGHMXr0aJYtW8ZXX30FwLHHHssNN9zA/fffzzff\nfEMkEiEnJ4fi4mIuvvhiZs+eTSwWQ9ebPhM3Fosxb968Wn2/O5vr165dy+TJkxkyZAjnnHMOW7du\nZevWrY3u87333mPGjBl4PB48Hg+XXnop7733Xvb1adOm4fP58Hg8jBo1irVr1za5vE3RaEDOzc0l\nFotlH1dWVjZ7xHVnFTjvEozhI9DPn8Fa08aq6Y6/6KW/cdSX8zjz/dcBSL31Om7JRlLvvIGiqoRv\nuIWc39yLZ2jd/mBbCP5YHuOe0moqHXefno8kSdLuRo4cyerVq6moqNjj+37/+99TUVHBwoULWbp0\nKdOmTSOVyuROePDBB5k9ezYej4fp06cze/ZsNE1jwYIFXHvttZSUlDB69GiWLl3aKmU+77zzuPrq\nq1m+fDmLFi1C1/VsWfaGz/dDZsWdze+tqdGAfNNNN2VHR0NmpPSNN97YqoXoqPTeBxO8+DIetxT+\nsLWMJ9euB6D/0RM4bf23dD8hk2PaM3YcSiiM9+iJQGahCUWvfx7xZtNmrWWzzXb5Om3tmxORJElq\nQL9+/Zg6dSozZ84kGo0Cmdrwk08+Waey1r17d3w+H5s2beKVV17JvrZq1SqGDRvGT3/6Uy688EI+\n//xzotEoO3bs4JhjjuHOO+9k6NChzWp1DYVCHHXUUTz44IPZ53Y2WVdWVtK3b18Ann76adLpdPY9\nkUiEqqqqevd5/PHH8+yzz2JZFpZl8eyzz7Zqk3RjGm0f2H3QkqqqOI7TpoXqKN6PpXgznsJQVFxF\nJR6LA+AZdTieUYdn3xc48xw485wm7bOHR2eQx6DSdTlMJv+QJKkdePbZZ7nzzjsZPXo0Ho8H13WZ\nMmUKAwb80O12/fXXM336dIYOHUrPnj057rjjsq/dcsstrF69Gl3Xyc3N5amnnqKqqoqzzjqLZDKJ\n67qMGjWKM89s3opzc+bM4ZprruHZZ59F0zTOP/98br75Zh566CGmTZtGXl4eJ510Uq3u1uuvv55L\nL72UQCDAc889V2t/V1xxBWvWrGHkyJFApi/68ssvb8lH1iKNTnuaMGECDzzwAEcccQQACxcu5IYb\nbmDevHltWrD2NO3JKSsl/f7bGKPGYBT3zz5/545qdjguuY7NiV9+xvDBg8kt7tesfQshSL78Is7m\nEoIXzCB0UA85xaMdkFNt2g95LZp/LKljarSGfN999zFt2jSGDBkCZBaL+Ne//tXmBWtPkv/8B/a3\nK7G+/oqcu+7PPv/jsJ834ykm5wYYMvX0Fu1bVFZgfj4fTJP0f+YTmnZ2axVbkiRJ6kAaDcjjxo1j\nxYoVzJ8/P/u4seHvnY0+cAj2d2vR+tbODDPIZzBoL1doUnJy0Q8pxtm6Bc/wkXu1L0mSJKnjatIY\n87y8PKZMmdLWZWm3fBN/hHfc0WwUCn8pj3G06jJg5VKMgUNQc/fu5kRRVUKXXd1KJZUkSWo9uw6G\nai5FUWqlTpYa1+go66VLlzJu3DgCgQCapmX/HWgUw+CFaJIVps2cqgTJf/0fsVmP7e9iSZIktRnT\nNFv8z7LkLJHmajQgX3XVVdx9993069ePkpISbr311mzmrQNFtePyRixJf4+GBzhs+yYwdJRwpNFt\nJUmSJKkpGm2yTqVSHHfccbiuS/fu3bn77rsZM2YMN998874oX7vwXHWC5WmboAK/W7ccDu3P+qv+\nm4O7ytGMkiRJUutotIa8s3k6Pz+fJUuWUFZW1immUjRHT13Do0BB6XaSL73An9d8zxNGgD9Ut7x/\nRZIk6UCzbt06CgoKmDRpEmPHjuU3v/nNXu9z0qRJlJaW8tVXX/Hwww+3Qin3n0ZryOeeey5lZWXc\neuutHH300TiO0yofYkdySsjH+IAX/aM3cHSdZCCIIyDpNnnlSkmSJInMTJ3XX38dIQSjRo3i+uuv\nJzc3d6/3O2LECEaMGNEKJdx/9hiQXdfl+OOPp6CggJNOOony8nJSqVR2Ca4DhaIo5GkK4uxzcY6a\nwBVFXVjuKgz0ND0RuiRJkvQD0zQRQmQzdjmOg6qqPP/88xQVFXHZZZexcuVKDMPg7rvvZvz48dx0\n0018/vnn2LbN73//e8aOHZvd3851mR977DGGDBnC5MmTWbBgAWPHjuWhhx7CNE1mzpzJ+vWZFMez\nZs2iuLh4f51+vfbYZK2qKhdeeGH2sWEYB1ww3pWiqug9exH0ehnr9xDRGm3xlyRJ6pSS/5lP6a9v\nJfmf+c3abv78+UyaNIkBAwYwYcIEDjroIN566y3mzp3LOeecw9NPP41lWSxatIiPP/6YDz/8kHHj\nxvHmm2/iOA5z587lpZde2uM4pkQiwZVXXsm8efP48MMPqa6u5qmnnmLkyJF88MEHPPzww9xxxx17\n+xG0ukareMXFxaxbt44+ffrsg+JIkiRJHUH8jVdxykqJv/Eq/rHjmrzdziZr13U5++yzmTdvHo88\n8gg7duygurqaCRMmYBgGN998M5dccgl+v59f//rXLFu2jLfffptJkyYBZBe6qE8gEKB//0ya4169\nelFRUcGyZctYsGBBNtNkMBhs+cm3kUYDcjQaZfjw4Rx99NGEQqHs8y+88EKbFkySJElqv4JTphJ/\n41WCU6a2aHtVVcnNzeWjjz5iwoQJ/OxnP+Pxxx9n2bJlOI7DGWecwTnnnMOcOXN47LHHGD9+PFOn\nTuV3v/sdkGnybsiuCyJBZs2AwYMHM3z4cGbOnNno9vtLowH5wgsvrNVsva8YhoFhND8tZSAQaIPS\n7DuGYXT4cwB5HdqLznAO8lq0T/6x45pVM95pZ5O1bdv07t2b008/nYsuuoj33nuPHj16YBgG0WiU\nqVOnoqoqlmXx2GOPMXLkSD755BMmTZqEoiiMHTuWe++9t8nHvfzyy7n66qt5/vnnEUIwdepUbrjh\nhmaXvy01utrT/tIeVnsSQlDquORqKsZud1xtRa5s0z7I69B+yGvR/GO1lj01CzdGVdV22SzcnjVa\nQ54+fXqd6j8cGE3Wb8XTvBdPUaip3Foos3JJkiRJbafRgHzqqadm/59KpXjxxRcZPHhwmxaqvdhm\nO5gCKpx22YggSZIkdSKNBuRLLrmk1uNLL72UE088sc0KtD8IIXA2bUTNzUMN/TCt68cRPz11jYFe\nOd9YkiRJalvNjjSKorBp06a2KMt+Y87/lOS/X0ExDELX/Aw1Nw/F8BBQVY4P+fZ38SRJkqQDQLP6\nkF3XZenSpZxwwgltXrB9SSTi4DqIlE30wftQQyHCt/w/FFUm/pAk6cB1ICeC2h+a1Yes6zo33XQT\nRxxxRJsWal/z/ugE1IJCrBXLsZYswo3HwXVBBmRJkiRpH2l2H3JnpGganpGHYwweRrpXL/SD+6Lo\nst9YkqQDWzKZbPG2iqLg88kuv+ZotAp49NFHU1FRkX1cXl7OxIkT27RQ+4vi9eKbeCwl3Xvx6x3V\nvFTdsec+SpIk7Q3btlv8z3Gc/V38DqfRgByLxcjLy8s+zs/P36vJ4h3B+/E0pY7LRwkTc8XXuNVV\n+7tIkiRJUifXaLus67okEols2rdYLIZlWW1esP1p0pZ1bMTDkPXfkfjkHRS/n5z/3969R0dd3f0e\nf89MJhNmQoAQLRe5PQXhSSAgAgKVixeKsKwstNzCElmmFMutWJUnUBQKFKlrKVe5SMtSQEAO9AAV\nLEoPcKgWJLRSAk/BAAUkyGMIIfdkLvv8wWEKFsyFTOaXyee1lmvNTOb329/9+8r6zv5d9n51XrjD\nEhGRCFbuCHnUqFEMGDCA9evXs379egYOHBiWua1rUpO/fc7UNYsZ8H8+vP5BDU2bKSISyf75z3/S\nuHFj+vfvT48ePZgzZ05I2vF6vfzyl7+kT58+9OvXj0GDBvHFF18E/7506VKaN29OIBAIfta6dWtm\nzJgRfN+xY8eQxPZdyh0hT58+nWbNmrFjxw4Axo8fz5gxY0IeWDjVGzQE/AGiEjthj43F0fy+cIck\nIhIRbiy/aIyha9euTJkyhYYNG1ZrGwsWLADgwIEDwPW1EbKysoJ/37ZtG4MHD2b//v088sgjwPU5\n03fv3s20adOqPZ6KqtBzPc899xybN29m8+bNEV+MAezx8XjGpOLq1gNnh0Ts9TWPtYhIdSorK8MY\nw7Vr13jsscfo378/jz76KN988w3Hjx9n1KhRwe8OHDiQCxcucPTo0eB3x48fjzGGQ4cO0aNHDx55\n5BHGjRsHwIYNG3j11Z0Q2gsAABWQSURBVFeD2yckJJCcnAxcH6Xfc889TJo0iY0bNwa/Y7fbmTBh\nAkuWLKmhI/Dvyi3IzzzzDDk5OcH3V65cYfjw4SENKlwySsr4xeVcFl0pwKKLYImIWMJfCoqZfjGb\nvxRU7tGoG8svtm/fnj59+tCsWTP++Mc/sm/fPkaMGMGaNWtISkri0qVL5ObmcuHCBRwOBy1atGDq\n1Km8//777Nu3j9jYWD7++GN27txJWloae/fuZdWqVQCUlpYGH7maOXMmPXv2ZNasWQBs2rSJlJQU\nOnfuTGZm5i33RI0ZM4Zt27ZRUFBQTUepcsotyGfOnCE+Pj74vnHjxmRmZoY0qHD5e6mPMgPnvD58\n4Q5GRMTCdlwrJNvnZ8e1wkpt16tXL/bt28eZM2e4ePEin332GSNHjqRv376sWLGCr776CoDRo0ez\nadMm1q5dG5wPIyMjg5EjR9K/f3/2799PVlYWEydOZP/+/aSkpLB27VoAXC4XJSUlAMybN48FCxZw\n5coVAH7/+9+zdOlSnnjiCbKysti9e3cwNqfTSWpqKsuXL7/r41MV5V5DvvE8mcPhAK5fLC8tLa1w\nAydOnCAtLY3169cD8NZbb1FcXEznzp1JSUmpYtihMTg2huKAIdEVVWPrH4uI1EZPNfCw41ohTzWo\n2prHdrudhg0bsn//fvr06cPUqVNZuXIlGRkZAIwcOZIhQ4ZQXFzMvn37AOjUqRObN28Orvns9Xrx\ner0sXrwYYwwdOnRg1KhRpKSkMHfuXH79618D1+sYXK9H7du3Z926dQBkZmYya9asW2akTE1NpWfP\nnsGCXpPKLchPPPEEI0aMYOrUqQAsXLiQQYMGVbiB7du307ZtWwC2bt3K448/zsMPP8ycOXM4f/48\nLVu2rGLo1a+hw05qIy2oLSJSnl6x9egVW6/S2904Ze3z+WjZsiVDhgzh2WefZc+ePTRv3hyn0wlc\nn0e7VatWeDweXC4XcL3+jBo1Cp/Ph91uZ8mSJXzyySds3boVYwwDBw7E5XKRlpbGrFmzePjhh3G7\n3TidTmbOnMnGjRtvWYuhbdu2/P3vf6eo6F+TQMXExDBmzBhee+21uzxClWcz5Vws9Xq9zJ8/n507\nd2Kz2XjyySfp378/ffr0KXfnhw8fJisri0OHDpGWlsbcuXOZN28eLpeLXbt2YbPZ7ljcs7OzK92Z\nhISEKm1nJW63+5b/OWoj5cEaIiEPoFxUpa3qcjeTQNntdjyeuxvgpKamMmnSJB544IG72k9tUe41\nZKfTyaxZs9i2bRtDhgxh3bp1PP/88+XuOBAIsGvXrlsKbklJSfCXjsfjCduMX8YYvJmn8H9zOSzt\ni4jIdxs5ciRer7fOFGMo55S1z+dj+/btrFmzhoMHD+Lz+di9ezc9e/Ysd8f79++nR48eREdHBz9z\nuVyUlZURHR1NUVHRvy3ttWrVKlavXg3A2LFjmTRpUqU7VJFfh3mf/l/y1q3BZrfT6o3FOGKttcTY\njVnRarPq/JUeLsqDdSgXdc+mTZvCHUKNu+Mp6xdffJGNGzeSnJzM2LFjGTp0KImJiZw9e7ZCO373\n3Xc5ffo0drudL7/8krZt29KmTRvat29P7969mTdvHmPGjLnjNeRQnrIuPfI5xb//AGx24qbPwu6J\nrXRboaLTc9agPFiHclH5tqpLuE9Z1zV3HCGvWrWKXr16MX369OBMJrZK3Hk8duzY4OsZM2bw8ssv\nY4xh4cKFbN++neTk5LDd0BXdtTv2Bg2v/2ehYiwiInXXHQtyVlYWGzZs4JVXXiEnJ4cxY8YEbx2v\nrPnz5wdfz549u0r7qE42mw1n2/vDHYaIiKV9+7KihNYdb+pq2LAhEyZMID09nW3btpGbm0tJSQl9\n+/YNzoYiIiIi1aNCc1knJyezaNEiLl68yOTJk9m+fXuo46oRAWNILy7jglfzcomISHhVqCDf4HQ6\nGTZsGLt27QpVPDVqb1Ep718rYnFOAUU3LcMlIiJS0ypVkCNNrM2G3QZR2HCgqTJFRCR8yp06M5I9\n5HbRNPcKDWJjcdlVkEVEJHzqdEEuTT9E3P/+XxAVhZnxK2z/fxYxERGRmlanC7IpLICAH+MHE/Dr\npLWIiIRNnS7Irj6PYI9rgP2e72GvV/un5hMRkdqrThdkm91O9APdwh2GiIhI3b7L+ma5/gBl370S\npYiISMjU6RHyDYeLS9mUV4zHZmPWPXE4KjFnt4iISHWoUyNkU1JC0QfrKfnkI25e5OqSL4DPQKEx\n+DRIFhGRMKhTI+SyI59TduRzcDpxJj+A43tNAHgiNga3zUar6Cg9jywiImFRpwpy1H98H1tMDDZP\nLPZG8cHPo202Ho+NCWNkIiJS19Wpguxo2pwGc94gYAxflHqJ9/po5axTh0BERCyqTl1DvuEvxWWs\nu1bE0pwC8v1aVEJERMKvThZkj82GHXBgw6FLxiIiYgGWPV/rdDpxOp2V3s7tLn/Grd5uNy3re4i1\n22kY5ahKeCHjdDor1Aerq+19UB6sQ7mQusKyBdnr9eL1eiu1jdvtpqioqELfvXFLV1FZJQMLscr0\nwarUB2uIhD5AZPSjJvugwl971clT1iIiIlajgiwiImIBKsgiIiIWoIIsIiJiASrIIiIiFmDZu6xD\n4ZLXz6KcAurbbUxLqE+0VnUSERGLqFMj5FNlPoqNITcQ4Ipm6BIREQupEyNkvzF8XFBKjB26xThp\n7LDTxFGnfouIiIjF1YmCfKTEy8eFJdht8Iv4+jR3Wmt2LhERkTpRkJtF2XHYwGmz0VCTV4uIiAXV\niYJ8nzOK+fc2wA5E6UYuERGxoDpzIdV+/hy2/7kc7jBERERuq06MkL0nT1C4dg3YIO4XM7DHx5e/\nkYiISA2qGyPkgAm+NEaPO4mIiPWEbIR89epVXn/9dRwOB4FAgAkTJpCZmckHH3xAQkICAPPnzw9V\n87dw/mcSsc+/gK1ePRyNE2qkTRERkcoIWUGOi4tjwYIF2O12jh07xpYtW+jSpQuDBg1i6NChoWr2\njqK+37bG2xQREamokBVkh+Nfz/oWFhbSpk0bAD7++GMOHjxI7969GTJkSKiaFxERqVVCelPX+fPn\nWbZsGdnZ2aSlpdGsWTP69+9PIBBg7ty5tG/fng4dOoQyBBERkVohpDd1tWzZkjfeeINXX32Vd955\nh9jYWBwOB06nk549e3LmzJlQNi8iIlJrhGyE7PV6cTqdAHg8HlwuF4WFhXg8HowxHD9+nAEDBtyy\nzapVq1i9ejUAY8eOZdKkSZVu98YNY7WZ2+0Odwh3TXmwhkjIAygXUjfYjDGm/K9V3j/+8Q/ee+89\n7HY7xhhSU1M5ePAgf/vb37DZbCQlJTF27Ng7bp+dnV3pNhMSEqq0nZW43W6KiorCHcZdUR6sIRLy\nAMpFVdqS2ilkBfluqSDXXsqDNURCHkC5qEpbUjtF9Exdgbw8ClYuxuZyEfvCz7G5XOEOSURE5LYi\neqYuX+ZJAldz8P/PZfxfXQh3OCIiIncU0SNkZ2JHor7fDltMDI5WrcMdjoiIyB1FdEG2xdQj9icT\nwh2GiIhIuSL6lLWIiEhtoYIsIiJiASrIIiIiFqCCLCIiYgEqyCIiIhaggiwiImIBEfnYkwkEKD2w\nF+wOXA/3w2azhTskERGR7xSRBdl38r8p2b0LbOBo2gxn2/vDHZKIiMh3isiCbL/nXmwOx/WC3FgT\nrYuIiPVFZEF2JNxD3KvzwAY2Z3S4wxERESlXRBZkAFu0CrGIiNQeEX+Xtd8YAtZc8llERCQoYkfI\nAJd9ft68UkCUDaYn1Ke+PeJ/f4iISC1l2YLsdDpxOp2V3s7tdgdfZxcU48MQMDbyo6L5Xoz1T2M7\nnc5b+lBb1fY+KA/WoVxIXWHZguz1evF6vZXaxu12U1RUFHzfwWbo53ZRz2ajqd9LUZGvusOsdt/u\nQ22kPlhDJPQBIqMfNdkHFf7ay7IF+W5d9PqxA0Pq1wt3KCIiIuWKyIJ8zutjaU4BAC/G16e50xHm\niERERL5bRN7l5L/ppuoAusNaRESsL+JGyAFjaO108LNGsdiBFs6I66KIiESgiKpWOV4fv/wmj4CB\n/0qoT7wjIk8AiIhIBIqoinWxtIwyY/BhuOj1hzscERGRCouoEXKSpx6PuWPwY0hyRVTXREQkwkVU\n1bLbbAyuHxPuMERERCotok5Zi4iI1FYqyCIiIhaggiwiImIBKsgiIiIWoIIsIiJiASrIIiIiFqCC\nLCIiYgEhew756tWrvP766zgcDgKBABMmTKBJkyYsXryYnJwcWrZsyQsvvIDdrt8EIiIiISvIcXFx\nLFiwALvdzrFjx9iyZQsdOnSgbdu2PP3006xcuZK//vWvdOvWrdra9Ofnkff6bEwgQP3JL2OPi6u2\nfYuIiIRSyIanDocjOPotLCykTZs2nDhxgu7duwPQvXt3jh8/Xq1tlp47S6AgH1NYgP/8P6t13yIi\nIqEU0qkzz58/z7Jly8jOziYtLY0vvviC2NhYADweD/n5+dXaXr0OSUR3eRACAaI6/Ge17ltERCSU\nbMYYE+pGzp49y9tvv829995LSkoK9913H0eOHCEjI4Pnnnsu+L1Vq1axevVqAMaOHcukSZNCHZqI\niIglhGyE7PV6cTqdwPXRsMvlIikpifT09GBBfuCBB27ZZvz48YwfPx6A7OxssrOzK9VmQkJCpbex\nGrfbTVFRUbjDuCvKgzVEQh5AuahKW1I7hawgnz59mvfeew+73Y4xhtTUVO677z4WLVpEWloaLVq0\n4MEHHwxV8yIiIrVKjZyyroqq/JqMhBGBRgPWoDxYh3JR+bakdtJDwCIiIhaggiwiImIBKsgiIiIW\noIIsIiJiAZa9qasqVq1aFXxsSsJHebAG5cE6lAupiIgaId+YVETCS3mwBuXBOpQLqYiIKsgiIiK1\nlWP27Nmzwx1EdTHGVOvqUVI1yoM1KA/WoVxIRUTUNWQREZHaSqesRURELCCkyy/WpN27d/OnP/2J\nqKgopkyZQpMmTcIdUsQbNmwY7dq1A+CZZ56hY8eOLF68mJycHFq2bMkLL7yA3W7nyy+/ZPXq1Rhj\nGD58eHBNbKkan8/HjBkzuHDhApMmTeIHP/gBeXl5vPXWWxQXF9O5c2dSUlIAOHz4MJs3b8ZmszFu\n3DjatWtHIBBg5cqVnD9/nvj4eH7+85/jcrnC3Kva53Z52LBhA59++ikNGjSgUaNGvPLKK4DyIBVk\nIkBeXp556aWXjM/nM6dOnTILFiwId0h1wsSJE295/+GHH5qtW7caY4xZsWKFOXz4sDHGmGnTppns\n7GxTVFRkpkyZYnw+X43HGkkCgYC5cuWKef/9982f//xnY4wxa9asMQcOHDDGGPOrX/3KnDt3zvh8\nPjNlyhRTWFhosrOzzbRp04wxxnz++edmxYoVxhhjtm7danbu3BmejtRyt8vDza9vUB6koiLilPWp\nU6fo2LEjDoeDdu3acfHixXCHVCdkZ2eTlpbGm2++SV5eHidOnAiOfrt3787x48cpKyvD7/fTuHFj\n6tWrR/Pmzbl06VKYI6/dbDYb8fHxt3x287Hv1q0bx48f59KlSzRv3hy3203jxo3x+/2UlZXdNk9S\nebfLA8DmzZtJS0tj//79AMqDVFhEnLIuKCggNjY2+N7oPrUa8c477xAXF8cnn3zC+vXryc/PD+bB\n4/GQn59Pfn4+Ho8nuM2Nz6V6lZSUBE93ejweLl++fEs+bnz+7ZwoH9XrySefJCUlhcLCQmbOnEli\nYqLyIBUWESPk2NhYCgsLg+/t9ojoluXFxcUB0LdvX86cOXNLHgoLC6lfv/6/5aaoqIj69euHJd5I\n5nK5KCsrA/51jL997G+XE+Wjet34N+HxeEhOTub8+fPKg1RYRFSu+++/n4yMDPx+P6dPn6Zp06bh\nDinilZSU4Pf7AcjIyKBp06YkJSWRnp4OwJEjR0hMTMTlcuFwOMjJyaGkpISsrCzlJwS+feyTkpJo\n1qwZFy9epKSkhKtXr+JwOIiOjiYpKYkjR44AkJ6eTmJiYjhDjyg3Cqzf7+fkyZM0adJEeZAKi5jn\nkD/66CP27t2Lw+Fg8uTJNGvWLNwhRbTMzEyWLl2K2+3G6XQyefJk4uLiWLRoEVevXqVFixb87Gc/\nw263c/LkSX73u99hjOHHP/4xDz30ULjDr/V+85vfkJmZSUxMDF27duXpp59m4cKFFBcXk5yczOjR\nowE4dOgQW7ZswWazkZqaSvv27QkEAqxYsYILFy7QqFEjpk6dqrt7q+jbeSgoKODChQsEAgH69u3L\nU089BSgPUjERU5BFRERqs4g4ZS0iIlLbqSCLiIhYgAqyiIiIBaggi4iIWIAKsoiIiAWoIEut17p1\nazIyMnj33Xc5depUte8/NzeXN95445bPfvKTn3DgwIFqb0tE6i4VZIkYVS3IgUDgO6dbvV1B/u1v\nf0ufPn0q3ZaIyJ2oIEtE2Lt3L+np6UyZMoUuXbqwZ88e4PrEDT169KBr16786Ec/4uuvvwZg9uzZ\nDBs2jB/+8IckJiaSm5vLyy+/TPfu3encuTOPPfYY586dA2DixInk5ubSpUsXevfuDUD//v358MMP\nAbh8+TJDhw4lOTmZTp06sXbt2mBcrVu35rXXXqNXr160bt2aZcuW1eRhEZHaJIwrTYlUi1atWplj\nx46Zfv36mT/84Q/Bz9etW2fGjRtn/H6/McaY5cuXm5SUFGOMMbNmzTItWrQw33zzTfD7N79evXq1\nGTFihDHGmLNnz5rGjRvf0ubNbQ0fPtzMnDnTGGNMVlaWadq0qTl27Fgwtpdeeim4H4/HY/Lz86u1\n/yISGSJitSeR29mxYwfp6el07doVuL6gfIMGDYJ/Hzx4MAkJCcH3H330EW+//TYFBQX4fL4Kt7Nn\nzx7efPNNAJo2bcrgwYPZu3cvHTt2BGDkyJHA9dFyo0aN+Oqrr+jQocNd909EIosKskQsYwwzZ87k\n+eefv+3fb14S79y5c7z44oscPnyYNm3a8Nlnn5GSklItccTExARfOxyOShV7Eak7dA1ZIkZcXBzX\nrl0Lvn/qqadYvnw5V69eBaC0tJSjR4/edtu8vDyio6Np0qQJgUCAlStX3rLfoqKiOxbSxx9/nNWr\nVwPw9ddfs2vXLh599NHq6paI1BEqyBIxfvrTnzJnzpzgTV3PPvsso0ePpl+/fiQnJ/Pggw/y6aef\n3nbbTp06MWzYMBITE3nooYdo06ZN8G/x8fGMHj2aTp06BW/qutmSJUs4evQoycnJDBgwgAULFpCU\nlBSyfopIZNJqTyIiIhagEbKIiIgFqCCLiIhYgAqyiIiIBaggi4iIWIAKsoiIiAWoIIuIiFiACrKI\niIgFqCCLiIhYwP8Dx1aMRHuyUYEAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7ff40ec5c990>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<ggplot: (8792887297849)>\n"
     ]
    }
   ],
   "source": [
    "p = ggplot(df, aes(x='Iteration', y='Accuracy', color='Classification', label='Classification')) + geom_point(size=0.5)\n",
    "print(p)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "After training for 50 epochs, below are the samples generator by four different parameters $\\theta_g$'s. Note that different parameters tend to have different artistic styles.\n",
    "\n",
    "![Generated Samples Parameter 1](figs/fake_samples_epoch_024_G000.png)\n",
    "![Generated Samples Parameter 2](figs/fake_samples_epoch_024_G001.png)\n",
    "![Generated Samples Parameter 3](figs/fake_samples_epoch_024_G002.png)\n",
    "![Generated Samples Parameter 4](figs/fake_samples_epoch_024_G003.png)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Note: This code is adapted from the implementation by Saatchai and Wilson in Tensorflow (https://github.com/andrewgordonwilson/bayesgan) and the DCGAN code from Pytorch examples (https://github.com/pytorch/examples/tree/master/dcgan)."
   ]
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python 3.6",
   "language": "python",
   "name": "python36"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}