notmnist.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "5hIbr52I7Z7U"
   },
   "source": [
    "Deep Learning\n",
    "=============\n",
    "\n",
    "Assignment 1\n",
    "------------\n",
    "\n",
    "The objective of this assignment is to learn about simple data curation practices, and familiarize you with some of the data we'll be reusing later.\n",
    "\n",
    "This notebook uses the [notMNIST](http://yaroslavvb.blogspot.com/2011/09/notmnist-dataset.html) dataset to be used with python experiments. This dataset is designed to look like the classic [MNIST](http://yann.lecun.com/exdb/mnist/) dataset, while looking a little more like real data: it's a harder task, and the data is a lot less 'clean' than MNIST."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "cellView": "both",
    "colab": {
     "autoexec": {
      "startup": false,
      "wait_interval": 0
     }
    },
    "colab_type": "code",
    "collapsed": false,
    "id": "apJbCsBHl-2A"
   },
   "outputs": [],
   "source": [
    "# These are all the modules we'll be using later. Make sure you can import them\n",
    "# before proceeding further.\n",
    "from __future__ import print_function\n",
    "import matplotlib.pyplot as plt\n",
    "import numpy as np\n",
    "import os\n",
    "import sys\n",
    "import tarfile\n",
    "from IPython.display import display, Image\n",
    "from scipy import ndimage\n",
    "from sklearn.linear_model import LogisticRegression\n",
    "from six.moves.urllib.request import urlretrieve\n",
    "from six.moves import cPickle as pickle\n",
    "\n",
    "# Config the matplotlib backend as plotting inline in IPython\n",
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "jNWGtZaXn-5j"
   },
   "source": [
    "First, we'll download the dataset to our local machine. The data consists of characters rendered in a variety of fonts on a 28x28 image. The labels are limited to 'A' through 'J' (10 classes). The training set has about 500k and the testset 19000 labelled examples. Given these sizes, it should be possible to train models quickly on any machine."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "cellView": "both",
    "colab": {
     "autoexec": {
      "startup": false,
      "wait_interval": 0
     },
     "output_extras": [
      {
       "item_id": 1
      }
     ]
    },
    "colab_type": "code",
    "collapsed": false,
    "executionInfo": {
     "elapsed": 186058,
     "status": "ok",
     "timestamp": 1444485672507,
     "user": {
      "color": "#1FA15D",
      "displayName": "Vincent Vanhoucke",
      "isAnonymous": false,
      "isMe": true,
      "permissionId": "05076109866853157986",
      "photoUrl": "//lh6.googleusercontent.com/-cCJa7dTDcgQ/AAAAAAAAAAI/AAAAAAAACgw/r2EZ_8oYer4/s50-c-k-no/photo.jpg",
      "sessionId": "2a0a5e044bb03b66",
      "userId": "102167687554210253930"
     },
     "user_tz": 420
    },
    "id": "EYRJ4ICW6-da",
    "outputId": "0d0f85df-155f-4a89-8e7e-ee32df36ec8d"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Found and verified notMNIST_large.tar.gz\n",
      "Found and verified notMNIST_small.tar.gz\n"
     ]
    }
   ],
   "source": [
    "url = 'http://commondatastorage.googleapis.com/books1000/'\n",
    "last_percent_reported = None\n",
    "\n",
    "def download_progress_hook(count, blockSize, totalSize):\n",
    "    \"\"\"A hook to report the progress of a download. This is mostly intended for users with\n",
    "    slow internet connections. Reports every 1% change in download progress.\n",
    "    \"\"\"\n",
    "    global last_percent_reported\n",
    "    percent = int(count * blockSize * 100 / totalSize)\n",
    "\n",
    "    if last_percent_reported != percent:\n",
    "        if percent % 5 == 0:\n",
    "            sys.stdout.write(\"%s%%\" % percent)\n",
    "            sys.stdout.flush()\n",
    "        else:\n",
    "            sys.stdout.write(\".\")\n",
    "            sys.stdout.flush()\n",
    "\n",
    "    last_percent_reported = percent\n",
    "\n",
    "def maybe_download(filename, expected_bytes, force=False):\n",
    "    \"\"\"Download a file if not present, and make sure it's the right size.\"\"\"\n",
    "    if force or not os.path.exists(filename):\n",
    "        print('Attempting to download:', filename) \n",
    "        filename, _ = urlretrieve(url + filename, filename, reporthook=download_progress_hook)\n",
    "        print('\\nDownload Complete!')\n",
    "\n",
    "    statinfo = os.stat(filename)\n",
    "    if statinfo.st_size == expected_bytes:\n",
    "        print('Found and verified', filename)\n",
    "    else:\n",
    "        raise Exception('Failed to verify ' + filename + '. Can you get to it with a browser?')\n",
    "\n",
    "    return filename\n",
    "\n",
    "train_filename = maybe_download('notMNIST_large.tar.gz', 247336696)\n",
    "test_filename = maybe_download('notMNIST_small.tar.gz', 8458043)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "cC3p0oEyF8QT"
   },
   "source": [
    "Extract the dataset from the compressed .tar.gz file.\n",
    "This should give you a set of directories, labelled A through J."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "cellView": "both",
    "colab": {
     "autoexec": {
      "startup": false,
      "wait_interval": 0
     },
     "output_extras": [
      {
       "item_id": 1
      }
     ]
    },
    "colab_type": "code",
    "collapsed": false,
    "executionInfo": {
     "elapsed": 186055,
     "status": "ok",
     "timestamp": 1444485672525,
     "user": {
      "color": "#1FA15D",
      "displayName": "Vincent Vanhoucke",
      "isAnonymous": false,
      "isMe": true,
      "permissionId": "05076109866853157986",
      "photoUrl": "//lh6.googleusercontent.com/-cCJa7dTDcgQ/AAAAAAAAAAI/AAAAAAAACgw/r2EZ_8oYer4/s50-c-k-no/photo.jpg",
      "sessionId": "2a0a5e044bb03b66",
      "userId": "102167687554210253930"
     },
     "user_tz": 420
    },
    "id": "H8CBE-WZ8nmj",
    "outputId": "ef6c790c-2513-4b09-962e-27c79390c762"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Extracting data for notMNIST_large. This may take a while. Please wait.\n",
      "['notMNIST_large/A', 'notMNIST_large/B', 'notMNIST_large/C', 'notMNIST_large/D', 'notMNIST_large/E', 'notMNIST_large/F', 'notMNIST_large/G', 'notMNIST_large/H', 'notMNIST_large/I', 'notMNIST_large/J']\n",
      "Extracting data for notMNIST_small. This may take a while. Please wait.\n",
      "['notMNIST_small/A', 'notMNIST_small/B', 'notMNIST_small/C', 'notMNIST_small/D', 'notMNIST_small/E', 'notMNIST_small/F', 'notMNIST_small/G', 'notMNIST_small/H', 'notMNIST_small/I', 'notMNIST_small/J']\n"
     ]
    }
   ],
   "source": [
    "num_classes = 10\n",
    "np.random.seed(133)\n",
    "\n",
    "def maybe_extract(filename, force=False):\n",
    "    root = os.path.splitext(os.path.splitext(filename)[0])[0]  # remove .tar.gz\n",
    "    if os.path.isdir(root) and not force:\n",
    "        # You may override by setting force=True.\n",
    "        print('%s already present - Skipping extraction of %s.' % (root, filename))\n",
    "    else:\n",
    "        print('Extracting data for %s. This may take a while. Please wait.' % root)\n",
    "        tar = tarfile.open(filename)\n",
    "        sys.stdout.flush()\n",
    "        tar.extractall()\n",
    "        tar.close()\n",
    "\n",
    "    data_folders = [os.path.join(root, d) for d in sorted(os.listdir(root)) if os.path.isdir(os.path.join(root, d))]\n",
    "  \n",
    "    # if len(data_folders) != num_classes:\n",
    "        # raise Exception('Expected %d folders, one per class. Found %d instead.' % (num_classes, len(data_folders)))\n",
    "\n",
    "    print(data_folders)\n",
    "    return data_folders\n",
    "  \n",
    "train_folders = maybe_extract(train_filename)\n",
    "test_folders = maybe_extract(test_filename)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "4riXK3IoHgx6"
   },
   "source": [
    "---\n",
    "Problem 1\n",
    "---------\n",
    "\n",
    "Let's take a peek at some of the data to make sure it looks sensible. Each exemplar should be an image of a character A through J rendered in a different font. Display a sample of the images that we just downloaded. Hint: you can use the package IPython.display.\n",
    "\n",
    "---"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "['A', 'B', 'C', 'D', 'E', 'F', 'G', 'H', 'I', 'J']\n",
      "notMNIST_large/A/RGVhcmVzdCBPcGVuLnR0Zg==.png\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAAAAABXZoBIAAACg0lEQVR4nFXQW0iTYRgH8P/7fp9z\niPO0VbYW6lyb6Sg1ywNZhmAaGaVQBmmksBJCQUsiiAKziNBukjJEpEjtQgvNtIN2MItM0YvlTFhR\nKjpmHsrytO99uzC39dz+eP48z58AgCClF0zMKcYqv4sSh2soAEE6nn/G4tcW1GdyUIL/hmJPI/Zf\nzGjwMg40eIC6C2He+cUQA5ssGebI/mYFcymBIJ39USM6TgVM1v9Km9yQc2KWcJeq6teXFUFToYdH\niy0iudotVsChfq0+dV2y7pK4XGwa6bDkQHBduzaye+iNra7zoTJjDYLRlwruTIWQGzGx5K9Xq9Xy\nGrMoC6nvoMztGbkm1M/U95jXgMp83F4BAIEAEB/snSuFnIAKThABSCAQl7/ylxo4ONwiV0I4Z/ho\nfObvLk4EOL7pqpf/4WrBFACoSDjGfUFVIAAEBuJEyh0gmPJikh4EoFKwN19FwuJPejNh3lNwhIOA\nstzbd1ZWKQS+71bOB40ESVkXDUJYadhV1TEuAKCQcLqw5H67FvOK6VgwXhDTuliRBU4ASpEwrs4e\nPtp02LbgGa1j2/Pyv8RlLirYvxIOpgT+3Lzp3IBXL9JvDD8vG1b+CV/0VYwSEIIDl19wqQhVOzFm\njdwdn8ila5moPQ8Z5VGpLRfs6Gg1KgbRqFWlKD2xUNsYa/wEJkJ990qUPczSXNU7hSHcZGOJr5IM\n1iNtM0EaapYqbSXq2olymR9UJhhGhKwnXeU7uoM3doaIj3p8gpbebXlqbd1WmBLaP33dGrfVcO+t\nh7y9ZZYQHmM3zPRE5HZO2hNU/u93dbVl5yWBMoASyjlACC0b1DaN6tI+vw4w+zp+Ey4w8L93R/Ck\nQg45/gAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<IPython.core.display.Image object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "notMNIST_large/B/UHJvY3lvbiBTaGFkb3cudHRm.png\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAAAAABXZoBIAAACCUlEQVR4nFWSS0iUYRSGn3POP84o\napkX7CLlFGJIEFJRrUIkCDK6GFEbK+gyFkVFhWY3pJVBpLRqU9iqyIhoEWUStMtNuNEyqnVkBVIO\n9v+nxT/j2LP6vu/9znsuHKFj3ZSTwxaODf4xj/L3I2cMyZ2FkgMD28DyD1cDtICw6OytZkRj+RjJ\nRJDDwJT0jet1qAGcQJlDFTHYdPtkOQrStSybjT088XwEJVIJbcfWl0PqpG565DGRv9qMxAap7m5U\nNGpaOpurLlFaW/lwXByM8F7JPiwopBTSQ/tRQFKc8gHmS/VdF6sQwJT6jz4dnCM/H08Ez8ZEI8zD\n5PFL1XwJkv0l+Wn5j0iJIJT23saIiQ6OzutTFCDRMuyR/7pSBhlMRMQCMxVAafjkYXZwOapk5kWq\nAULZ5akONCE5RWhp29BQ7aEYLtO9axefrphV4kjjjf+NfHRvEYAY0npnI0FefO3fRt9/GH+0pzTn\nv+DJzrnIYX9AoDS8PRxnSpHxXYXhCeiWVQcnJQLRLC305UWnck3N6s/3s+KIeljX1+41+VZqV6Qb\nmypQBVPKr/30yLvo/G8TBDPs0FcPfaINMli8IKoqqEHrOw/9+4VijM4qZA6Epqce+ezdJahBendj\nUaHilf0zHvnIesQEhKLt56t+h7GYrC92meh57LmtF6X5xYznmZnsKcUs/vsPHYaztHM15nYAAAAA\nSUVORK5CYII=\n",
      "text/plain": [
       "<IPython.core.display.Image object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "notMNIST_large/C/VW5pdmVycy1MaWdodCBCb2xkIEl0YWxpYy50dGY=.png\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAAAAABXZoBIAAABxElEQVR4nHWSsWtTURTGf+e+GwJB\nmw6aLiqkg9pFEARbQQSLErUg6KAIIv4BzoLgIOKsizgKoiBo6eKiCA6dREFF1JaUggY1DiLYpsb3\n3n2fw3sJKY1nu/d3vnO+c+41inAW3N6ZqfrWSiS/+un5vUWnHouM6Rexisgyrd3ahBUsjN9uALx7\n+f7v/sP11IienCwYh74rTjU7VQKjfFNZlugcAJ5Tsbpqz2DmvffGnOJYd3PdZEexmhP4CIASpxVS\nPfLgwvaHlbTUPt70ad4l8LUVQrUJOGaVKJ6mRD/MOeeAiItKU10fZP0cqstK9KbSm6q4NjPwXFYS\ndBa/UQjVz0r0trReWKyUozuCcT+JtBHCYyXq7MINY7WWEs0PKwpu5zbg9XCh20cGS/9RjiHHj2EI\n/CgYfxj0apCfXQIZI4NlTVKe675gor5OZ85ZGcAtYMZBsn4fHWktLfy6RJTPGbQyTv7M5hlrKtFy\nLW/0QEmqO0Tee+8do/PqqjNZDH5AIc10LXfkGx/V1WojL2RRuHIjk/yHuebvzRMn9khu8fyrKBRr\n4MI3Zf3vrPbVkcIABlHYcubY7lrZZWsrreazpz9dz/s/LojOLLKnE+8AAAAASUVORK5CYII=\n",
      "text/plain": [
       "<IPython.core.display.Image object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "notMNIST_large/D/UXVhc2kudHRm.png\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAAAAABXZoBIAAAB1klEQVR4nGWRTWtTQRSGnzMzpVpD\nWulHLikUqaArrZ9IVfAXKLr0B7josohoROw/sCsruFNcuVNqUHQjIa5EUgyCaK2pDY1t01Kx0oRk\njoube5PorGbmed/zKYXS++JSadsTHrF41eiRO+9NbbP8o7y8slrdqNYBLM0Qnpw5PLqvpdQ/64tL\nC/lPNQweEOgdTqdTQTo9PJRKAPjvzx4XMB4k1ADQl9wfjE0cP5FUn71dtF4BEeOcs1ZamuDKk19a\nu4mJTIgzYIx1ThBGZ3d1zkbMAH39kc4aJkuaiXwEU9lKNo5jHEe2dk6FaM/TbW3oayTGPUzpvTDr\nbiJZb1KhfZq8qF4ygDrmMZaNDqeX5fJBA+B5t+M86x0QMGEzXgpfUH52ENFgZNG0qs0Dax1Oy9mR\n+eh6VRuNM8R9i0hOz0XwWF1XD8QTE8cdfRgPoX9Bi8korHFc069D7RTPNU8IxQkZXZmI4zjm9A0W\nMM4w/lI/HmpvxTKtr3BYKwzc/a2PBtrFYbmoOXpESF2v6OfLSHubGCa10Is7/WBLK9N7sZ2zMhzV\nbxdufWjo2o0kxkIXHNdmQ7WSGUS6bIAQ1Ju6OTOIuH8QCKm6vh373xXC3vuzCZzp+v0LjXOjbwCV\n7UAAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<IPython.core.display.Image object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "notMNIST_large/E/TW9kZXJuRXh0ZW5kZWRFRi1Cb29rLm90Zg==.png\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAAAAABXZoBIAAABuElEQVR4nG2TvWuTURTGf/ecmzf1\nK6IYpYkUC9oWQYK6iaBz/QDFuUNdBAcHN1GcuqiLg6AI/gFS8IMuDmp3HaTgIujSoFhQ0MGQN++5\nxyExSRPPdLm/+zzPvQ9cnnrhnnzTFMnd/EMWH63mey8d9eDh9XJySpX9Rxo7PQlkCgT2rbslP4YA\nQP3GTy+Sf96OqGa88sJ9jpKqqkpgZs07vl6RZJbIcQfMzMyQ+Gn+SyTTrlMC8K4pyYpS83LRh4MJ\n1FaOY3H1MaE0DqtnakjiQV7OxuEkDil8fDsxplRO44Dykq1xIIEQQ95YRADjWbYBEHnhneSzSOBU\n0/08Pckm5dTcwsVynvU21PoQ3scJMPt3Cy8Ygk++VmdP7E4+7DWUqUw+9HyQKYNzisr3KzdLfSvp\nQ8coErL0ptu0cOvdSAlJWO6tOFsfbSix1kuZamyMQviFAMqF8u9R6PxYaZKkqF6jHcfgt3NA4N40\nbQG8+6DQ46qK3V7o0IoaECsTAhCTAwnfcveqCa1oSFE7TPAQKBKA1uavHzI1WvHkwfaexbqLc//5\nn7Bj266Z6QMVTHFa/Pc7mLt3/M5fH6fV4/FtKPUAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<IPython.core.display.Image object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "notMNIST_large/F/RmVhcmxlc3MudHRm.png\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAAAAABXZoBIAAACHElEQVR4nF2STUiUURSGn3PvnfIv\nS4IU/GuoXEhBtJCUohLaBEkQRG3chQRRUeuWIW1aVdDCKCJCiKBCiqxFSIKWBia0UKFM0wwSmWZw\n/O69p8Wni+bs3vOe9/wDGPNsvAIBAGetGJsCMQbf/TBOzU/v2PT90/uZNAQjAQTR7L3j3qW+4seB\npoWb+6qn59SocvDy26KqBp94n3hV1fCzGPNvjmAMixpC0A2LYc2nKPRm4L7OTmtQ1Rh+JCFEVY0x\nRO/1XbMZYmExbW11xImRJR8RI9YknSdcPV+biSbY1w/+xvraxsFzBi2UWTL5CdfIVK6v5Xpix/sz\nA668pay6KVvdd8GqEN2jDy8Kaz1AAeN8boyuzXW1+ZrsIfJzAJZbWtTzOESMMYCj47dewxmJShVQ\nBSgqagzRDXe2PsVFUGkDanAKRBs9RJn8YjAgGR1DaaUYQgg2ZPY0CypWcViNLGA5/by3bMtKV+ds\nQ4se/WzD+gHaHqcb80m6w0RPYQGo7B5eS31+NfiQ6Mo31YspafbebS8kAJFJKc47CkvQggKYkVfM\nJAoYGZP8KKzNkFIAB/zQr6BeB9v3P7mz6/DVs9s7jpWvP41wsudKv67qDTKUmFN56Xz+TKQOtYqA\nIutzONQKdQjbCFqqhKA0IeSQUtIAkZ3LkWVMaU0BcBNlNre1NVcqNSCYij9/RxuyG0//n1L09u7K\nS8lkaVb+Ac5fH3WgTegdAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<IPython.core.display.Image object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "notMNIST_large/G/RnJlZWRvbSA5IFdpZGUgTm9ybWFsLnR0Zg==.png\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAAAAABXZoBIAAAB2UlEQVR4nG2SO2hUQRSGvzNzF6OC\nG4uwS0QRA26haBIEi0gQrCRoKWkEIaXYBFFBEEStRJsEGwsRxVehIliJKbTTZjWkUBYx5oEk+EJM\ndvfeO7/F3n0oOd3wnTmPb8YAzAKDQwMz11y42FfPoS83Z00A4GDkRVWawNuEJElz/biMdd+V9Gg3\nZsauyVqo1/U2cg22payazoJrVDn0Q3GqQRyYy5dV1SV8VifH8G/VdRQPjlta1RSRkUXEgYq+bsMB\nQ4rTdD+eVjjyR7ZjAM9U0/NO1mhuAKWVEGvUok6IZQOMK9afrdlW/4U7iPg0j9aEO4FZuTVhVMT4\niQsd+fIAQS7aCCT/5IfmOY0ANnW0NH9loDJX3dxb3PCYb4r1kpYeT79a4RYxdnSpSYMtfKSepGkM\n77gXkpDuae9pFG4EhaDKmR5OKI11irYhg7E0CSsloGcpxCq7DkPeuQVp2iLnlm8bYe/h0DYfwrqA\npqWAFZbTOHxY377rrG811RgReI4pjjVJrjlwxEklvwoY4LmgpK7zZJ8hIv850enGC5vnnFTT1S4w\n743cU+kOzppWRuYlvRntBtj3SrruXIez4uVFSUtTDx7OSE+GsRYDD73H77//Li29Hi/R9PUXuGHi\nziOXOscAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<IPython.core.display.Image object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "notMNIST_large/H/aG9vZ2UgMDVfNTQudHRm.png\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAAAAABXZoBIAAAAdElEQVR4nN2RMQrDQAwEVyJ6gmv/\n2oV/l9ovMAJNimsUQ3KVIUTtaLUDEpDsCrUJ7STg+jJ/BB+SJHPvW+7WYNbZE6dyZJCw42k0aKwL\nNuCkk7p62tR2evajkIBku2Y2EhhC4ZENRcabbXXfqlHyc/+8Cb4AzzM1c8slauUAAAAASUVORK5C\nYII=\n",
      "text/plain": [
       "<IPython.core.display.Image object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "notMNIST_large/I/U3VidGxldHkudHRm.png\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAAAAABXZoBIAAAB0ElEQVR4nG2Sv09TURSAv3PfrZa0\nL60FUqo2UlrUhIC1AxHj0sQICcrIYtQYJxf/CB1cHHRwcXXVAYMmxmCCEWJQax0MIS7GICS1EUEp\ntvS96/D64/HjbPd857vn3nuuAIAKjo/k4rGQqm2U5t9MVw2+uPD4m2nF3GSfl9UAogcvGxdEMIBY\nygdDmaSItxaMs/xy3QfDud52h9rS0pbTOAkgdtYHq8UvDYYCTPi0D/57X/TDQ4ePRNrQVKu0ofSf\nCvpuFb157QCtA0lmoMMnBrJ/P37+3jaHfKYod/BeHhFAow72ndBNza2XN5LR6Njm7E9A05XuDjSZ\nqMDzqYnhofHU8u+6QRMf6W71K9N5rPdu59V8/43ElEETP9OAZmXxkX3n+Ni7QiE/OmkvrFXgymql\nMY2nE4mei09+XApbYp+/9fAcOpXs8cTtP59eGHe6tpjamjWVmWK6FNNn08YbyOqzhTqiXs3lwUX9\nKotwf6ax6fxwBEDEsrz7CjqbaE5jZR3A4D27MaBPdmCM8pwdPwfQXThKGcSr3Rmqsm2tlRzZnffM\n68HQB/v2QGx/DIRzD4z7+uhe0wKzWbDV6D6qdgDU2yKR+h7YrLcy+mttN/wPtjOpipO7DZEAAAAA\nSUVORK5CYII=\n",
      "text/plain": [
       "<IPython.core.display.Image object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "notMNIST_large/J/SVRDIFN5bWJvbCBCbGFjay5wZmI=.png\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAABwAAAAcCAAAAABXZoBIAAABJElEQVR4nO3SPUpDURAF4HPmvhcQ\nFbWRWNtELUSwEbMHcQM2FkF0BTY27kPESBYgiLW1WijaJ0jwhxTRSCTv3XsszEvyAu7AqWb47nCK\nucCwiBOl6ldQuj1iMCx/KfQx1QVsBMWne4RswFUeHTrDAa0cAlCuH8N8/eM4CvGgJzyM/Au7MDdc\nZihMDt659B04XEXELGLpIzu2V7MIW78spRY5ki7C1rRnlvDwYqiqVYn6i+XPkV9SgUNNie72VmYK\nc2vH7YF5NYow1JR4qffaeEsUMlNPB3DAuVL5RJJCklno6RQkohjezASRv9EIYny2SwhWR0z5IBKA\ngveia+/vBAgAN6vPgyhJ8o9HCzACACnMbpRLi/MTU+h2mvWb69tvWhAA/AAEHcLGKeXDLAAAAABJ\nRU5ErkJggg==\n",
      "text/plain": [
       "<IPython.core.display.Image object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Display a sample of the images that we just downloaded\n",
    "# These function might help you:\n",
    "    # display image:  display(Image(filename=image_path))\n",
    "    # list files or folders:  os.listdir(folder_path)\n",
    "    # choose one image randomly:  random.choice(images)\n",
    "# ------------------------------------------------------------------------------\n",
    "\n",
    "    # do anything you want \n",
    "\n",
    "# ------------------------------------------------------------------------------\n",
    "import random\n",
    "\n",
    "dir_name = 'notMNIST_large'\n",
    "folders = os.listdir(dir_name)\n",
    "print(folders)\n",
    "\n",
    "for x in folders :\n",
    "    image = random.choice(os.listdir('/'.join([dir_name, x])))\n",
    "    imagePath = '/'.join([dir_name, x, image])\n",
    "    print(imagePath)\n",
    "    display(Image(filename=imagePath))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "PBdkjESPK8tw"
   },
   "source": [
    "Now let's load the data in a more manageable format. Since, depending on your computer setup you might not be able to fit it all in memory, we'll load each class into a separate dataset, store them on disk and curate them independently. Later we'll merge them into a single dataset of manageable size.\n",
    "\n",
    "We'll convert the entire dataset into a 3D array (image index, x, y) of floating point values, normalized to have approximately zero mean and standard deviation ~0.5 to make training easier down the road. \n",
    "\n",
    "A few images might not be readable, we'll just skip them."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "cellView": "both",
    "colab": {
     "autoexec": {
      "startup": false,
      "wait_interval": 0
     },
     "output_extras": [
      {
       "item_id": 30
      }
     ]
    },
    "colab_type": "code",
    "collapsed": false,
    "executionInfo": {
     "elapsed": 399874,
     "status": "ok",
     "timestamp": 1444485886378,
     "user": {
      "color": "#1FA15D",
      "displayName": "Vincent Vanhoucke",
      "isAnonymous": false,
      "isMe": true,
      "permissionId": "05076109866853157986",
      "photoUrl": "//lh6.googleusercontent.com/-cCJa7dTDcgQ/AAAAAAAAAAI/AAAAAAAACgw/r2EZ_8oYer4/s50-c-k-no/photo.jpg",
      "sessionId": "2a0a5e044bb03b66",
      "userId": "102167687554210253930"
     },
     "user_tz": 420
    },
    "id": "h7q0XhG3MJdf",
    "outputId": "92c391bb-86ff-431d-9ada-315568a19e59"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Pickling notMNIST_large/A.pickle.\n",
      "notMNIST_large/A\n"
     ]
    }
   ],
   "source": [
    "image_size = 28  # Pixel width and height.\n",
    "pixel_depth = 255.0  # Number of levels per pixel.\n",
    "\n",
    "def load_letter(folder, min_num_images):\n",
    "    \"\"\"Load the data for a single letter label.\"\"\"\n",
    "    image_files = os.listdir(folder)\n",
    "    dataset = np.ndarray(shape=(len(image_files), image_size, image_size), dtype=np.float32)\n",
    "    print(folder)\n",
    "\n",
    "    num_images = 0\n",
    "    for image in image_files:\n",
    "        image_file = os.path.join(folder, image)\n",
    "        try:\n",
    "            image_data = (ndimage.imread(image_file).astype(float) - pixel_depth / 2) / pixel_depth\n",
    "            if image_data.shape != (image_size, image_size):\n",
    "                raise Exception('Unexpected image shape: %s' % str(image_data.shape))\n",
    "\n",
    "            dataset[num_images, :, :] = image_data\n",
    "            num_images = num_images + 1\n",
    "        except IOError as e:\n",
    "            print('Could not read:', image_file, ':', e, '- it\\'s ok, skipping.')\n",
    "\n",
    "    dataset = dataset[0:num_images, :, :]\n",
    "\n",
    "    if num_images < min_num_images:\n",
    "        raise Exception('Many fewer images than expected: %d < %d' % (num_images, min_num_images))\n",
    "\n",
    "    print('Full dataset tensor:', dataset.shape)\n",
    "    print('Mean:', np.mean(dataset))\n",
    "    print('Standard deviation:', np.std(dataset))\n",
    "    return dataset\n",
    "        \n",
    "def maybe_pickle(data_folders, min_num_images_per_class, force=False):\n",
    "    dataset_names = []\n",
    "    for folder in data_folders:\n",
    "        if len(folder) == 16:\n",
    "            set_filename = folder + '.pickle'\n",
    "            dataset_names.append(set_filename)\n",
    "            if os.path.exists(set_filename) and not force:\n",
    "                # You may override by setting force=True.\n",
    "                print('%s already present - Skipping pickling.' % set_filename)\n",
    "            else:\n",
    "                print('Pickling %s.' % set_filename)\n",
    "                dataset = load_letter(folder, min_num_images_per_class)\n",
    "                try:\n",
    "                    with open(set_filename, 'wb') as f:\n",
    "                        pickle.dump(dataset, f, pickle.HIGHEST_PROTOCOL)\n",
    "                except Exception as e:\n",
    "                    print('Unable to save data to', set_filename, ':', e)\n",
    "\n",
    "    return dataset_names\n",
    "\n",
    "train_datasets = maybe_pickle(train_folders, 45000)\n",
    "test_datasets = maybe_pickle(test_folders, 1800)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "vUdbskYE2d87"
   },
   "source": [
    "---\n",
    "Problem 2\n",
    "---------\n",
    "\n",
    "Let's verify that the data still looks good. Displaying a sample of the labels and images from the ndarray. Hint: you can use matplotlib.pyplot.\n",
    "\n",
    "---"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 58,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(1872, 28, 28)\n",
      "1872\n",
      "1718\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAWEAAAFfCAYAAACfj30KAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAAPYQAAD2EBqD+naQAAGgxJREFUeJzt3X+sXWWd7/H3t6Wnv6DWoUCBMpQfg4MoDdQL9g5VDBIu\nGAEzI1wQf2EyQwQkTa4QEmIRvUxwlHBRS8ThMhLUIKNGRn7UitKZ0qlokREKlMAtINKWlg6lpb9o\n+9w/9mnm9PTHeZ7Tvfrsffp+JSfhrPPp2s8+a+8P66y9nrUipYQkqY5htQcgSfsyS1iSKrKEJaki\nS1iSKrKEJakiS1iSKrKEJakiS1iSKrKEJami/WoPICIOBM4CXgQ21B2NJLXFKGAyMDul9Prugo2V\ncERcDvwvYCLwH8CVKaXf7iR6FvD9psYhSRV9AvjB7gKNlHBEXAh8A/hb4DFgBjA7Io5LKa3sF3+x\niTFo8CIiO1ty7ZFDDz00O3vbbbdlZ3t6erKzW7duzc4CDBu24xG7L3/5y8ycOXOH5ddcc032ep98\n8snsbFPbQ3vFiwMFmtoTngF8J6V0F0BEXAZ8BLgU+Fq/rIcgOkxTb/qRI0dmZ9/znvc0st52lPAB\nBxzAe9/73h2Wjx07tmjduSzhrjZgv7X9g7mIGAFMBR7etiy1Xhm/BKa1+/EkqZs1cXbEBGA4sLzf\n8uW0jg9LknrtzVPUAvBvJUnqo4kSXglsAQ7pt/xgdtw7lrrOeeedV3sIGkLaXsIppbeBhcAZ25ZF\n65OFM4D57X48aW87//zzaw9BQ0hTZ0fcDHwvIhbyX6eojQH+qaHHk6Su1EgJp5R+FBETgBtoHZZ4\nAjgrpbSiiceTpG7V2Iy5lNIsYFZT61f32W+//JfbEUcckZ0tmaxReh5tyTm6o0ePLlp3E2NQ9/EC\nPpJUkSUsSRVZwpJUkSUsSRVZwpJUkSUsSRVZwpJUkSUsSRVZwpJUkSUsSRVVv9uyBq+p6axNrXdn\ntwrSwEq2R1PbztsmNcd3hSRVZAlLUkWWsCRVZAlLUkWWsCRVZAlLUkWWsCRVZAlLUkWWsCRVZAlL\nUkVOW+5iTU0l3bJlSyPrXbJkSXb21FNPzc4OHz58MMNpu2effbaR9W7evLmR9aozuCcsSRVZwpJU\nkSUsSRVZwpJUkSUsSRVZwpJUkSUsSRVZwpJUkSUsSRVZwpJUkdOW94KSabUlU4Y//vGPZ2evu+66\n7Owbb7yRnR0zZkx29oUXXsjOfvKTn8zOvv3229nZ0rsRl0wNv/XWW7Ozp512WnZ29erV2dkJEyZk\nZ2fNmpWdve2227KzTb3ehyr3hCWpIktYkiqyhCWpIktYkiqyhCWpIktYkiqyhCWpIktYkiqyhCWp\nIktYkiqyhCWporZfOyIiZgIz+y1+NqX07nY/VrcovV5BrkmTJmVnTzzxxOxsybUYRowYkZ0tua5B\nT09PdrbklvDDhpXtd5RcO+Kkk05qJLtx48bs7MiRI7OzkydPzs6WaOr1PlQ1dQGfp4AzgG1bI/9d\nIkn7kKZKeHNKaUVD65akIaOpY8J/ERF/iogXIuLuiDiioceRpK7WRAkvAD4DnAVcBhwF/GtEjG3g\nsSSpq7X9cERKaXafb5+KiMeAl4ALgDvb/XiS1M0aP0UtpbQaeA44tunHkqRu03gJR8T+wDHA0qYf\nS5K6TdtLOCL+ISI+EBFHRsR/B35K6xS1H7b7sSSp2zVxitok4AfAgcAKYB7w/pTS6w08liR1tSY+\nmLuo3euUpKHKW94PQum0zNKpskPV1q1bs7MlU5FLphaXjKHpddfW1PTiktd76RhKtke3sB0kqSJL\nWJIqsoQlqSJLWJIqsoQlqSJLWJIqsoQlqSJLWJIqsoQlqSJLWJIqctryIJROnSy5e3GJe+65Jzv7\nhz/8ITu73375L4uS7Nq1a7OzTf3Ompz2evXVV2dnDzrooOxsye+i5PktXrw4O1uiqfEOVe4JS1JF\nlrAkVWQJS1JFlrAkVWQJS1JFlrAkVWQJS1JFlrAkVWQJS1JFlrAkVRS1pw1GxMnAwibWXXLX15I7\n5b7//e8vGseXvvSl7OymTZuysyVjXrlyZXb2qquuys6uX78+O1tyZ93ar8tOUjI1/MYbb8zOHnvs\nsYMZzoDGjRuXnb3llluK1v3zn/88Ozt8+PDs7JYtW4rGUWBqSunx3QXcE5akiixhSarIEpakiixh\nSarIEpakiixhSarIEpakiixhSarIEpakiixhSapoSN9tuWSabIlJkyYV5c8+++zsbMlU5JJp2SV3\nOr7uuuuysyXTlkumkW7evDk72ylKnl/Jdh45cmR29oILLsjOHnnkkdnZkjsojxgxIjt7//33Z2dL\nNfX+bzf3hCWpIktYkiqyhCWpIktYkiqyhCWpIktYkiqyhCWpIktYkiqyhCWpIktYkioa0tOWm1Iy\nLbNUJ9xluKk7zzZ4R9uOUDIVuWQ7l/zeOuH1U6Knp6f2EKor3hOOiOkRcV9E/CkitkbEuTvJ3BAR\nr0bEuoiYExHN3FtbkrrcYA5HjAWeAC4HdvjfbkRcA1wB/B1wCvAWMDsi/F+eJPVTfDgipfQQ8BBA\n7PwyRVcBX0kp/Utv5lPAcuB84EeDH6okDT1t/WAuIo4CJgIPb1uWUnoT+A0wrZ2PJUlDQbvPjphI\n6xDF8n7Ll/f+TJLUx946RS3YyfFjSdrXtbuEl9Eq3EP6LT+YHfeOJWmf19YSTiktoVXEZ2xbFhHj\ngFOB+e18LEkaCorPjoiIscCxtPZ4AY6OiCnAqpTSH4FbgOsi4nngReArwCvAz9oyYkkaQgYzY+59\nwK9pHeNNwDd6l38PuDSl9LWIGAN8BxgP/BtwdkppUxvGK0lDStSe5hgRJwMLG1p3drbk93DQQQcV\njeOUU07JzpZMUR07dmx2tmSq9U9+8pPs7KZN/r+1aSV31f7oRz+anS25i/Pq1auzs6NGjcrOPvHE\nE9lZgJdeeik729T7v9DUlNLjuwt4AR9JqsgSlqSKLGFJqsgSlqSKLGFJqsgSlqSKLGFJqsgSlqSK\nLGFJqsgSlqSKhvS05RIzZszIzk6ZMqVo3cuWLcvOjh8/Pjv7s5/lXxPpwQcfzM6WTJMtucOwBqep\n7fGhD30oO3vBBRdkZ0umOE+YMCE7C7B06dLs7MyZM7OzDb6OnbYsSZ3MEpakiixhSarIEpakiixh\nSarIEpakiixhSarIEpakiixhSarIEpakigZzy/vG5Nwdtalp1meffXZ29swzzyxa98aNG7OzJXfA\nffvtt7OzJdOWS+5Sq+YNHz48O1sy/fb000/Pzl522WXZ2ZI7cPf09GRnAZ555pns7A033JCdLfm9\ntbun3BOWpIosYUmqyBKWpIosYUmqyBKWpIosYUmqyBKWpIosYUmqyBKWpIosYUmqyBKWpIo66toR\nOfOtm7quQTdeL6Gp62ho31By7ZFOUfI+HTFiRHa25u/CPWFJqsgSlqSKLGFJqsgSlqSKLGFJqsgS\nlqSKLGFJqsgSlqSKLGFJqsgSlqSKiqctR8R04IvAVOBQ4PyU0n19fn4n8Ol+/+yhlNI5ezLQbZqa\nqnvjjTdmZ++9996idW/YsCE7O3HixOzsb3/726Jx5HI6dGfZsmVLI+t96KGHsrObN2/Ozi5dujQ7\nWzK1GOC1117Lzq5fv75o3bna/f4YzJ7wWOAJ4HJgV6N5EDgEmNj7ddGgRidJQ1zxnnBK6SHgIYDY\n9dU0NqaUVuzJwCRpX9DUMeHTI2J5RDwbEbMi4s8aehxJ6mpNXMryQeDHwBLgGODvgQciYlryYKMk\nbaftJZxS+lGfbxdFxJPAC8DpwK/b/XiS1M0aP0UtpbQEWAkc2/RjSVK3abyEI2IScCCQf96KJO0j\nBnOe8Fhae7Xbzow4OiKmAKt6v2bSOia8rDd3E/AcMLsdA5akoWQwx4TfR+vYbur9+kbv8u8BnwdO\nBD4FjAdepVW+X0opdd8NrSSpYYM5T3guuz+M8T8GPxxJ2rdE7bPGIuJkYGFu/ogjjshe95VXXpmd\nXbt2bXa29M6sJdNOb7/99uzsG2+8kZ0tuUtt7deEOk9PT092tuR9V7JegGHD8j/GOvDAA7Ozd9xx\nR3Z20aJF2Vlgakrp8d0FvICPJFVkCUtSRZawJFVkCUtSRZawJFVkCUtSRZawJFVkCUtSRZawJFVk\nCUtSRU3cWaNRhx9+eHb2i1/8YoMjyVcybfnhhx/Ozi5cmD3b22nL+4imtvM73/nO7Oz111+fnd1/\n//2zswBbt27NzpZMcX700Uezs4XTlgfknrAkVWQJS1JFlrAkVWQJS1JFlrAkVWQJS1JFlrAkVWQJ\nS1JFlrAkVWQJS1JFXTdteb/9um7IHaHk91YyNbSpbDdu55Lp6SWGDx+enS2Ztlx61/BO0NSU+hEj\nRjSy3hzuCUtSRZawJFVkCUtSRZawJFVkCUtSRZawJFVkCUtSRZawJFVkCUtSRZawJFXUdXNDn3nm\nmezsjBkzsrMl0z1HjRqVnQUYPXp0dnbJkiVF685VMkW1E+62vHnz5tpD6Bid8Lt44403srNf//rX\ns7OlU73Xrl2bnS2ZirxgwYKicbSTe8KSVJElLEkVWcKSVJElLEkVWcKSVJElLEkVWcKSVJElLEkV\nWcKSVJElLEkVRckU1Yi4FvgY8JfAemA+cE1K6bk+mZHAzcCFwEhgNvD5lNJru1jnycDC6dOn8453\nvGPAMZxwwgnZ4122bFl2tmRq8VNPPZWdBZg3b1529tOf/nR29rDDDsvObtiwITt7wAEHZGfvv//+\n7OyiRYuys1dccUV2dtiw/H2J0inZJeu+8847s7Pjxo3Lzl544YXZ2Y0bN2ZnS+7ivH79+uzsrbfe\nmp2dMmVKdhbgtNNOy86WTHGeMGFCdvbVV18dMLNq1Spmz54NMDWl9PjusqV7wtOBbwKnAh8GRgC/\niIi+DXYL8BHgr4EPAIcBPy58HEnaJxRdwCeldE7f7yPiM8BrwFRgXkSMAy4F/mdKaW5v5rPAMxFx\nSkrpsbaMWpKGiD09JjweSMCq3u+n0ir2h7cFUkqLgZeBaXv4WJI05Ay6hKN17cdbgHkppad7F08E\nNqWU3uwXX977M0lSH3tyPeFZwLuBnCPlQWuPWZLUx6BKOCK+BZwDTE8p9f2ocBnQExHj+u0NH0xr\nb3iXFi1atMNFmA877DAOP/zwwQxRkvaKF198kZdffnm7ZZs2bcr+98Ul3FvA5wEfTCm93O/HC4HN\nwBnAT3vzxwF/Dvz77tZ7wgknZJ2iJkmdZPLkyUyePHm7ZX1OURtQUQlHxCzgIuBc4K2IOKT3R6tT\nShtSSm9GxB3AzRHxn8Aa4FbgUc+MkKQdle4JX0br2O4j/ZZ/Frir979nAFuAf6Y1WeMh4PLBD1GS\nhq7S84QHPJsipbQRuLL3S5K0Gx1zt+WzzjqLo446asDcxRdfnL3OkoPjPT092dn77rsvOwtld3K9\n9tprs7Pvete7srNN/S5KpkOX3En6pptuys42OW255C7cc+bMyc4ec8wx2dmvfvWr2dmSuxeXTFte\nt25ddvbb3/52dvbSSy/NzgJ84QtfyM429ZqfP3/+gJnFixdnHxP2Aj6SVJElLEkVWcKSVJElLEkV\nWcKSVJElLEkVWcKSVJElLEkVWcKSVJElLEkVdcy05W6ydevWovzmzZsbW3dtJeMtnTI8lA3l30XJ\n1OmS7FDlnrAkVWQJS1JFlrAkVWQJS1JFlrAkVWQJS1JFlrAkVWQJS1JFlrAkVWQJS1JFHTNtee7c\nuTz55JMD5lasWJG9zpI7xI4dOzY7+7vf/S47W+qee+7Jzh555JHZ2fXr12dnx48fn539/e9/n53d\nuHFjdva73/1udrbJuy2X3JG45LVZMt37rrvuys6WvOZHjBiRnV2zZk12tsSvfvWronxTYx41alR2\n9rnnnhswU/JacE9YkiqyhCWpIktYkiqyhCWpIktYkiqyhCWpIktYkiqyhCWpIktYkiqyhCWpIktY\nkiqK2rfejoiTgYXHH3981vUbjj766Ox1b9q0KTs7cuTI7OxLL72UnQVYsGBBUV7qNBGRnS3plClT\nphSN4/jjj8/ObtiwITtbck2K5cuXD5hZs2bNtuuqTE0pPb67rHvCklSRJSxJFVnCklSRJSxJFVnC\nklSRJSxJFVnCklSRJSxJFVnCklSRJSxJFRXd8j4irgU+BvwlsB6YD1yTUnquT+YR4AN9/lkCvpNS\n+vzu1n3xxRczefLkAcdwySWXZI+3ZNpyT09Pdva+++7LzgKcd9552dmSW6w3NZW0RMmt20vGUPJ7\n6BRbtmzJzpZsu2HD6u8rlWyPkvfd5z73uaJxXHnllY2Mo+T9P3/+/AEzixcv5tJLL81aX+nWnQ58\nEzgV+DAwAvhFRIzuk0nA7cAhwETgUODqwseRpH1C0Z5wSumcvt9HxGeA14CpwLw+P1qXUlqxx6OT\npCFuT//OGU9rz3dVv+WfiIgVEfFkRNzYb09ZktSraE+4r2gd1LoFmJdSerrPj74PvAS8CpwIfA04\nDvibPRinJA1Jgy5hYBbwbuCv+i5MKf1jn28XRcQy4JcRcVRKackePJ4kDTmDKuGI+BZwDjA9pbR0\ngPhvgACOBXZZwnfffTdjxozZbtm0adOYNm3aYIYoSXvFnDlzmDNnznbL3nrrrex/X1zCvQV8HvDB\nlNLLGf/kJFrHjXdb1pdccknWKWqS1EnOPPNMzjzzzO2WlZyiVnqe8CzgIuBc4K2IOKT3R6tTShsi\n4mjgYuAB4HVgCnAzMDel9FTJY0nSvqB0T/gyWnu1j/Rb/lngLmATrfOHrwLGAn8E7gX+9x6NUpKG\nqNLzhHd7SltK6RXg9D0ZkCTtS/bk7Ih9VslU3SbXXftO2U0qmQLcjUq23VD/XXSbnPdoyfu4/qR0\nSdqHWcKSVJElLEkVWcKSVJElLEkVWcKSVJElLEkVWcKSVJElLEkVWcKSVFHHTFt+/vnnWbt27YC5\nefPmDZjZZs2aNdnZAw44IDv7xBNPZGcl7dozzzxTlF+wYEF2dtWq/ndd27WxY8dmZxcuXDhg5pVX\nXslen3vCklSRJSxJFVnCklSRJSxJFXV0CT/99NO1hyBpCHnkkUdqD2EHHV3CpZ+cStLuzJ07t/YQ\ndtDRJSxJQ50lLEkVWcKSVFEnzJgbBfD666/v8IMNGzawbNmy7ZYtXrw4e8Xr1q3Lzo4ZMyY7u3Tp\n0uxsqaF88051r6ZelytWrCjKl7z/V69evcOydevW8fzzz++wfPTo0dnrzZkNt3z58m3/OWqgbNR+\n00fExcD3qw5CkprxiZTSD3YX6IQSPhA4C3gR2FB1MJLUHqOAycDslNKOf+b3Ub2EJWlf5gdzklSR\nJSxJFVnCklSRJSxJFXVkCUfE5RGxJCLWR8SCiPhvtcfUDhExMyK29vvqyqsURcT0iLgvIv7U+zzO\n3Unmhoh4NSLWRcSciDi2xlgHY6DnFxF37mRbPlBrvLki4tqIeCwi3oyI5RHx04g4rl9mZER8OyJW\nRsSaiPjniDi41phLZD6/R/ptty0RMavWmDuuhCPiQuAbwEzgJOA/gNkRMaHqwNrnKeAQYGLv12l1\nhzNoY4EngMuBHU6xiYhrgCuAvwNOAd6itR179uYg98Bun1+vB9l+W160d4a2R6YD3wROBT4MjAB+\nERF9ZyvcAnwE+GvgA8BhwI/38jgHK+f5JeB2/mvbHQpcvZfH2Wc0KXXUF7AA+D99vg/gFeDq2mNr\nw3ObCTxeexwNPK+twLn9lr0KzOjz/ThgPXBB7fG26fndCfyk9tja8Nwm9D6/0/psp43Ax/pk3tWb\nOaX2ePf0+fUu+zVwc+2xbfvqqD3hiBgBTAUe3rYstX5rvwSm1RpXm/1F75+4L0TE3RFxRO0BtVtE\nHEVrD6PvdnwT+A1DZzsCnN77J++zETErIv6s9oAGYTytPcNtd8WcSutyBn233WLgZbpz2/V/ftt8\nIiJWRMSTEXFjvz3lvaoTrh3R1wRgOLC83/LltP5v3O0WAJ8BFtP6E+h64F8j4j0ppbcqjqvdJtJ6\n4e9sO07c+8NpxIO0/kRfAhwD/D3wQERM691x6HgREbQOPcxLKW37bGIisKn3f5p9dd2228Xzg9Zl\nEl6i9dfaicDXgOOAv9nrg6TzSnhXgl0fl+saKaXZfb59KiIeo/ViuIDWn7dD3ZDYjgAppR/1+XZR\nRDwJvACcTuvP3W4wC3g3eZ9LdOO22/b8/qrvwpTSP/b5dlFELAN+GRFHpZSW7M0BQud9MLcS2ELr\ngHlfB7PjXlXXSymtBp4DuuasgUzLaL1p94ntCND75l1Jl2zLiPgWcA5wekrp1T4/Wgb0RMS4fv+k\nq7Zdv+c30GUPf0Pr9Vpl23VUCaeU3gYWAmdsW9b7J8UZwPxa42pKROxP60/Z5q6NWUFvIS1j++04\njtYn1kNuOwJExCTgQLpgW/YW1HnAh1JKL/f78UJgM9tvu+OAPwf+fa8Ncg8M8Px25iRae/lVtl0n\nHo64GfheRCwEHgNmAGOAf6o5qHaIiH8A/oXWIYjDgS/TesH/sOa4BiMixtLac4jeRUdHxBRgVUrp\nj7SOxV0XEc/TukLeV2id5fKzCsMttrvn1/s1k9Yx4WW9uZto/VUze8e1dY7e82EvAs4F3oqIbX+t\nrE4pbUgpvRkRdwA3R8R/AmuAW4FHU0qP1Rl1voGeX0QcDVwMPAC8Dkyh1TlzU0pP1Rhz9dMzdnFa\nyedpvXHX0/q/7/tqj6lNz+uHtIpoPa1Pm38AHFV7XIN8Lh+kderPln5f/7dP5npaH36so1VOx9Ye\ndzueH63LFD5Eq4A3AP8PuA04qPa4M57Xzp7TFuBTfTIjaZ1ru5JWCd8LHFx77O14fsAk4BFgRe/r\ncjGtD1X3rzVmL2UpSRV11DFhSdrXWMKSVJElLEkVWcKSVJElLEkVWcKSVJElLEkVWcKSVJElLEkV\nWcKSVJElLEkVWcKSVNH/BxMTt2aKFOMbAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7faa2e0a6b00>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Displaying a sample of the labels and images from the ndarray\n",
    "# this functions might help you:\n",
    "    # open file: open(pickle_file, 'rb')\n",
    "    # load file: pickle.load(file)\n",
    "    # create canvas: plt.figure()\n",
    "    # draw: plt.imshow(two-dimension-image-array)\n",
    "    # show picture: plt.show()\n",
    "# -----------------------------------------------------------------------\n",
    "\n",
    "    # do anything you want \n",
    "# -----------------------------------------------------------------------"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "cYznx5jUwzoO"
   },
   "source": [
    "---\n",
    "Problem 3\n",
    "---------\n",
    "Another check: we expect the data to be balanced across classes. Verify that.\n",
    "\n",
    "---"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 65,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{'J': 52911, 'E': 52912, 'G': 52912, 'F': 52912, 'H': 52912, 'C': 52912, 'I': 52912, 'A': 52909, 'B': 52911, 'D': 52911}\n",
      "{'J': 1872, 'E': 1873, 'G': 1872, 'F': 1872, 'H': 1872, 'C': 1873, 'I': 1872, 'A': 1872, 'B': 1873, 'D': 1873}\n"
     ]
    }
   ],
   "source": [
    "# calculate the count per class\n",
    "# --------------------------------------------\n",
    "    # do anything you want \n",
    "\n",
    "# ---------------------------------------------"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "LA7M7K22ynCt"
   },
   "source": [
    "Merge and prune the training data as needed. Depending on your computer setup, you might not be able to fit it all in memory, and you can tune `train_size` as needed. The labels will be stored into a separate array of integers 0 through 9.\n",
    "\n",
    "Also create a validation dataset for hyperparameter tuning."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 66,
   "metadata": {
    "cellView": "both",
    "colab": {
     "autoexec": {
      "startup": false,
      "wait_interval": 0
     },
     "output_extras": [
      {
       "item_id": 1
      }
     ]
    },
    "colab_type": "code",
    "collapsed": false,
    "executionInfo": {
     "elapsed": 411281,
     "status": "ok",
     "timestamp": 1444485897869,
     "user": {
      "color": "#1FA15D",
      "displayName": "Vincent Vanhoucke",
      "isAnonymous": false,
      "isMe": true,
      "permissionId": "05076109866853157986",
      "photoUrl": "//lh6.googleusercontent.com/-cCJa7dTDcgQ/AAAAAAAAAAI/AAAAAAAACgw/r2EZ_8oYer4/s50-c-k-no/photo.jpg",
      "sessionId": "2a0a5e044bb03b66",
      "userId": "102167687554210253930"
     },
     "user_tz": 420
    },
    "id": "s3mWgZLpyuzq",
    "outputId": "8af66da6-902d-4719-bedc-7c9fb7ae7948"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "notMNIST_large/A.pickle\n",
      "notMNIST_large/B.pickle\n",
      "notMNIST_large/C.pickle\n",
      "notMNIST_large/D.pickle\n",
      "notMNIST_large/E.pickle\n",
      "notMNIST_large/F.pickle\n",
      "notMNIST_large/G.pickle\n",
      "notMNIST_large/H.pickle\n",
      "notMNIST_large/I.pickle\n",
      "notMNIST_large/J.pickle\n",
      "notMNIST_small/A.pickle\n",
      "notMNIST_small/B.pickle\n",
      "notMNIST_small/C.pickle\n",
      "notMNIST_small/D.pickle\n",
      "notMNIST_small/E.pickle\n",
      "notMNIST_small/F.pickle\n",
      "notMNIST_small/G.pickle\n",
      "notMNIST_small/H.pickle\n",
      "notMNIST_small/I.pickle\n",
      "notMNIST_small/J.pickle\n",
      "Training: (200000, 28, 28) (200000,)\n",
      "Validation: (10000, 28, 28) (10000,)\n",
      "Testing: (10000, 28, 28) (10000,)\n"
     ]
    }
   ],
   "source": [
    "def make_arrays(nb_rows, img_size):\n",
    "    if nb_rows:\n",
    "        dataset = np.ndarray((nb_rows, img_size, img_size), dtype=np.float32)\n",
    "        labels = np.ndarray(nb_rows, dtype=np.int32)\n",
    "    else:\n",
    "        dataset, labels = None, None\n",
    "    return dataset, labels\n",
    "\n",
    "def merge_datasets(pickle_files, train_size, valid_size=0):\n",
    "    num_classes = len(pickle_files)\n",
    "    valid_dataset, valid_labels = make_arrays(valid_size, image_size)\n",
    "    train_dataset, train_labels = make_arrays(train_size, image_size)\n",
    "\n",
    "    vsize_per_class = valid_size // num_classes\n",
    "    tsize_per_class = train_size // num_classes\n",
    "    \n",
    "    start_v, start_t = 0, 0\n",
    "    end_v, end_t = vsize_per_class, tsize_per_class\n",
    "    end_l = vsize_per_class + tsize_per_class\n",
    "\n",
    "    for label, pickle_file in enumerate(pickle_files):       \n",
    "        try:\n",
    "            print(pickle_file)\n",
    "            with open(pickle_file, 'rb') as f:\n",
    "                letter_set = pickle.load(f)\n",
    "                # let's shuffle the letters to have random validation and training set\n",
    "                np.random.shuffle(letter_set)\n",
    "        \n",
    "                if valid_dataset is not None:\n",
    "                    valid_letter = letter_set[:vsize_per_class, :, :]\n",
    "                    valid_dataset[start_v:end_v, :, :] = valid_letter\n",
    "                    valid_labels[start_v:end_v] = label\n",
    "                    start_v += vsize_per_class\n",
    "                    end_v += vsize_per_class\n",
    "\n",
    "                train_letter = letter_set[vsize_per_class:end_l, :, :]\n",
    "                train_dataset[start_t:end_t, :, :] = train_letter\n",
    "                train_labels[start_t:end_t] = label\n",
    "                start_t += tsize_per_class\n",
    "                end_t += tsize_per_class\n",
    "        except Exception as e:\n",
    "            print('Unable to process data from', pickle_file, ':', e)\n",
    "            raise\n",
    "    \n",
    "    return valid_dataset, valid_labels, train_dataset, train_labels\n",
    "            \n",
    "            \n",
    "train_size = 200000\n",
    "valid_size = 10000\n",
    "test_size = 10000\n",
    "\n",
    "valid_dataset, valid_labels, train_dataset, train_labels = merge_datasets(train_datasets, train_size, valid_size)\n",
    "_, _, test_dataset, test_labels = merge_datasets(test_datasets, test_size)\n",
    "\n",
    "print('Training:', train_dataset.shape, train_labels.shape)\n",
    "print('Validation:', valid_dataset.shape, valid_labels.shape)\n",
    "print('Testing:', test_dataset.shape, test_labels.shape)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "GPTCnjIcyuKN"
   },
   "source": [
    "Next, we'll randomize the data. It's important to have the labels well shuffled for the training and test distributions to match."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 67,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(10000,)\n",
      "[0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0\n",
      " 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0\n",
      " 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]\n",
      "[4422 4109 2150 ..., 2810 5568 4472]\n"
     ]
    }
   ],
   "source": [
    "# print the first 100 elements of train labels \n",
    "# --------------------------------------------\n",
    "    # do anything you want \n",
    "\n",
    "# ---------------------------------------------"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 68,
   "metadata": {
    "cellView": "both",
    "colab": {
     "autoexec": {
      "startup": false,
      "wait_interval": 0
     }
    },
    "colab_type": "code",
    "collapsed": true,
    "id": "6WZ2l2tN2zOL"
   },
   "outputs": [],
   "source": [
    "def randomize(dataset, labels):\n",
    "    permutation = np.random.permutation(labels.shape[0])\n",
    "    shuffled_dataset = dataset[permutation,:,:]\n",
    "    shuffled_labels = labels[permutation]\n",
    "    return shuffled_dataset, shuffled_labels\n",
    "train_dataset, train_labels = randomize(train_dataset, train_labels)\n",
    "test_dataset, test_labels = randomize(test_dataset, test_labels)\n",
    "valid_dataset, valid_labels = randomize(valid_dataset, valid_labels)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 69,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[8 8 0 0 5 3 7 3 5 8 9 7 4 3 4 4 8 9 9 7 2 8 2 5 0 5 1 2 1 1 3 6 1 5 0 5 7\n",
      " 3 9 5 0 4 6 0 2 6 0 3 7 9 9 2 5 8 7 3 7 6 9 3 0 6 5 6 4 8 0 9 4 9 5 5 7 0\n",
      " 0 4 0 7 4 8 2 9 9 2 6 4 0 2 2 3 4 6 6 3 3 3 6 5 1 1]\n",
      "[0 1 2 3 4 5 6 7 8 9]\n",
      "[0 1 2 3 4 5 6 7 8 9]\n",
      "[20000 20000 20000 20000 20000 20000 20000 20000 20000 20000]\n",
      "[1000 1000 1000 1000 1000 1000 1000 1000 1000 1000]\n"
     ]
    }
   ],
   "source": [
    "# print the first 100 elements of train labels again\n",
    "# --------------------------------------------\n",
    "    # do anything you want \n",
    "\n",
    "# ---------------------------------------------"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "puDUTe6t6USl"
   },
   "source": [
    "---\n",
    "Problem 4\n",
    "---------\n",
    "Convince yourself that the data is still good after shuffling!\n",
    "\n",
    "---"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# Convince yourself that the data is still good after shuffling!\n",
    "# These functions might help you:\n",
    "    # unique array: np.unique(array)\n",
    "    # statistics of array: np.bincount(array)\n",
    "\n",
    "# print the first 100 elements of train labels again\n",
    "# print unique train_lables & test_labels\n",
    "# print statistics for train_lables & test_labels\n",
    "# --------------------------------------------\n",
    "    # do anything you want \n",
    "\n",
    "# ---------------------------------------------"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "tIQJaJuwg5Hw"
   },
   "source": [
    "Finally, let's save the data for later reuse:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 70,
   "metadata": {
    "cellView": "both",
    "colab": {
     "autoexec": {
      "startup": false,
      "wait_interval": 0
     }
    },
    "colab_type": "code",
    "collapsed": true,
    "id": "QiR_rETzem6C"
   },
   "outputs": [],
   "source": [
    "pickle_file = 'notMNIST.pickle'\n",
    "\n",
    "try:\n",
    "    f = open(pickle_file, 'wb')\n",
    "    save = {\n",
    "        'train_dataset': train_dataset,\n",
    "        'train_labels': train_labels,\n",
    "        'valid_dataset': valid_dataset,\n",
    "        'valid_labels': valid_labels,\n",
    "        'test_dataset': test_dataset,\n",
    "        'test_labels': test_labels,\n",
    "    }\n",
    "    pickle.dump(save, f, pickle.HIGHEST_PROTOCOL)\n",
    "    f.close()\n",
    "except Exception as e:\n",
    "    print('Unable to save data to', pickle_file, ':', e)\n",
    "    raise"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 71,
   "metadata": {
    "cellView": "both",
    "colab": {
     "autoexec": {
      "startup": false,
      "wait_interval": 0
     },
     "output_extras": [
      {
       "item_id": 1
      }
     ]
    },
    "colab_type": "code",
    "collapsed": false,
    "executionInfo": {
     "elapsed": 413065,
     "status": "ok",
     "timestamp": 1444485899688,
     "user": {
      "color": "#1FA15D",
      "displayName": "Vincent Vanhoucke",
      "isAnonymous": false,
      "isMe": true,
      "permissionId": "05076109866853157986",
      "photoUrl": "//lh6.googleusercontent.com/-cCJa7dTDcgQ/AAAAAAAAAAI/AAAAAAAACgw/r2EZ_8oYer4/s50-c-k-no/photo.jpg",
      "sessionId": "2a0a5e044bb03b66",
      "userId": "102167687554210253930"
     },
     "user_tz": 420
    },
    "id": "hQbLjrW_iT39",
    "outputId": "b440efc6-5ee1-4cbc-d02d-93db44ebd956"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Compressed pickle size: 690800503\n"
     ]
    }
   ],
   "source": [
    "statinfo = os.stat(pickle_file)\n",
    "print('Compressed pickle size:', statinfo.st_size)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "gE_cRAQB33lk"
   },
   "source": [
    "---\n",
    "Problem 5\n",
    "---------\n",
    "\n",
    "By construction, this dataset might contain a lot of overlapping samples, including training data that's also contained in the validation and test set! Overlap between training and test can skew the results if you expect to use your model in an environment where there is never an overlap, but are actually ok if you expect to see training samples recur when you use it.\n",
    "Measure how much overlap there is between training, validation and test samples.\n",
    "\n",
    "Optional questions:\n",
    "- What about near duplicates between datasets? (images that are almost identical)\n",
    "- Create a sanitized validation and test set, and compare your accuracy on those in subsequent assignments.\n",
    "---"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 75,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(200000, 28, 28)\n",
      "(200000, 784)\n",
      "(187355, 784)\n",
      "12645\n"
     ]
    }
   ],
   "source": [
    "import hashlib\n",
    "def reshape(arr):\n",
    "    return arr.reshape(arr.shape[0], arr.shape[1] * arr.shape[2])\n",
    "\n",
    "def unique_rows(a):\n",
    "    a = np.ascontiguousarray(a) # Return a contiguous array in memory\n",
    "    unique_a = np.unique(a.view([('', a.dtype)]*a.shape[1]))\n",
    "    return unique_a.view(a.dtype).reshape((unique_a.shape[0], a.shape[1])) \n",
    "\n",
    "def sanitize(dataset_1, dataset_2, labels_1):\n",
    "    dataset_hash_1 = np.array([hashlib.sha256(img).hexdigest() for img in dataset_1])\n",
    "    dataset_hash_2 = np.array([hashlib.sha256(img).hexdigest() for img in dataset_2])\n",
    "    overlap = []  # list of indexes\n",
    "    for i, hash1 in enumerate(dataset_hash_1):\n",
    "        duplicates = np.where(dataset_hash_2 == hash1)\n",
    "        if len(duplicates[0]):\n",
    "            overlap.append(i)\n",
    "    return np.delete(dataset_1, overlap, 0), np.delete(labels_1, overlap, None)\n",
    "\n",
    "# Follow these step:\n",
    "# 1. Open 'notMNIST.pickle' and get train_dataset\n",
    "# 2. Change the dimension of train_dataset from 3 to 2\n",
    "# 3. Get unique rows array from train_dateset\n",
    "# 4. Get the number of duplicate rows\n",
    "# --------------------------------------------\n",
    "    # do anything you want \n",
    "\n",
    "# ---------------------------------------------"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "L8oww1s4JMQx"
   },
   "source": [
    "---\n",
    "Problem 6\n",
    "---------\n",
    "\n",
    "Let's get an idea of what an off-the-shelf classifier can give you on this data. It's always good to check that there is something to learn, and that it's a problem that is not so trivial that a canned solution solves it.\n",
    "\n",
    "Train a simple model on this data using 50, 100, 1000 and 5000 training samples. Hint: you can use the LogisticRegression model from sklearn.linear_model.\n",
    "\n",
    "Optional question: train an off-the-shelf model on all the data!\n",
    "\n",
    "---"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 76,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The test score is 0.700000 and valid score is 0.640000 with 50 training samples\n",
      "The test score is 0.740000 and valid score is 0.680000 with 100 training samples\n",
      "The test score is 0.834000 and valid score is 0.771000 with 1000 training samples\n",
      "The test score is 0.858600 and valid score is 0.789200 with 5000 training samples\n",
      "The test score is 0.864400 and valid score is 0.795700 with 10000 training samples\n"
     ]
    }
   ],
   "source": [
    "train_y = pickle_file['train_labels']\n",
    "train_x = reshape(pickle_file['train_dataset'])\n",
    "\n",
    "valid_y = pickle_file['valid_labels']\n",
    "valid_x = reshape(pickle_file['valid_dataset'])\n",
    "\n",
    "test_y = pickle_file['test_labels']\n",
    "test_x = reshape(pickle_file['test_dataset'])\n",
    "del(pickle_file)\n",
    "\n",
    "# These functions might help you\n",
    "    # create default logistic regression: LogisticRegression()\n",
    "    # training model: model.fit(train_x, train_y)\n",
    "    # predict: model.predict(test_x)\n",
    "    # get score: model.score(test_x, test_y)    "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "colab": {
   "default_view": {},
   "name": "1_notmnist.ipynb",
   "provenance": [],
   "version": "0.3.2",
   "views": {}
  },
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.4.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}