t81_558_class_10_3_text_generation.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a href=\"https://colab.research.google.com/github/jeffheaton/t81_558_deep_learning/blob/master/t81_558_class_10_3_text_generation.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# T81-558: Applications of Deep Neural Networks\n",
    "**Module 10: Time Series in Keras**\n",
    "* Instructor: [Jeff Heaton](https://sites.wustl.edu/jeffheaton/), McKelvey School of Engineering, [Washington University in St. Louis](https://engineering.wustl.edu/Programs/Pages/default.aspx)\n",
    "* For more information visit the [class website](https://sites.wustl.edu/jeffheaton/t81-558/)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Module 10 Material\n",
    "\n",
    "* Part 10.1: Time Series Data Encoding for Deep Learning [[Video]](https://www.youtube.com/watch?v=dMUmHsktl04&list=PLjy4p-07OYzulelvJ5KVaT2pDlxivl_BN) [[Notebook]](t81_558_class_10_1_timeseries.ipynb)\n",
    "* Part 10.2: Programming LSTM with Keras and TensorFlow [[Video]](https://www.youtube.com/watch?v=wY0dyFgNCgY&list=PLjy4p-07OYzulelvJ5KVaT2pDlxivl_BN) [[Notebook]](t81_558_class_10_2_lstm.ipynb)\n",
    "* **Part 10.3: Text Generation with Keras and TensorFlow** [[Video]](https://www.youtube.com/watch?v=6ORnRAz3gnA&list=PLjy4p-07OYzulelvJ5KVaT2pDlxivl_BN) [[Notebook]](t81_558_class_10_3_text_generation.ipynb)\n",
    "* Part 10.4: Image Captioning with Keras and TensorFlow [[Video]](https://www.youtube.com/watch?v=NmoW_AYWkb4&list=PLjy4p-07OYzulelvJ5KVaT2pDlxivl_BN) [[Notebook]](t81_558_class_10_4_captioning.ipynb)\n",
    "* Part 10.5: Temporal CNN in Keras and TensorFlow [[Video]](https://www.youtube.com/watch?v=i390g8acZwk&list=PLjy4p-07OYzulelvJ5KVaT2pDlxivl_BN) [[Notebook]](t81_558_class_10_5_temporal_cnn.ipynb)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Google CoLab Instructions\n",
    "\n",
    "The following code ensures that Google CoLab is running the correct version of TensorFlow."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Note: not using Google CoLab\n"
     ]
    }
   ],
   "source": [
    "try:\n",
    "    %tensorflow_version 2.x\n",
    "    COLAB = True\n",
    "    print(\"Note: using Google CoLab\")\n",
    "except:\n",
    "    print(\"Note: not using Google CoLab\")\n",
    "    COLAB = False"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Part 10.3: Text Generation with LSTM\n",
    "\n",
    "Recurrent neural networks are also known for their ability to generate text.  This can allow the output of the neural network to be free-form text.  In this part we will see how an LSTM can be trained on a textual document, such as classic literature, and learn to output new text that appears to be of the same form as the training material.  If you train your LSTM on [Shakespeare](https://en.wikipedia.org/wiki/William_Shakespeare), then it will learn to crank out new prose that is similar to what Shakespeare had written. \n",
    "\n",
    "Don't get your hopes up.  Your not going to each your deep neural network to write the next [Pulitzer Prize for Fiction](https://en.wikipedia.org/wiki/Pulitzer_Prize_for_Fiction).  The prose generated by your neural network will be nonsensical.  However, it will usually be nearly grammatically and of a similar style as the source training documents. \n",
    "\n",
    "A neural network generating nonsensical text based on literature may not seem terribly useful at first glance.  However, the reason that this technology gets so much interest is that it forms the foundation for many more advanced technologies.  The fact that the LSTM will typically learn human grammar from the source document opens a wide range of possibilities. Similar technology can be used to complete sentences when a user is entering text.  Simply the ability to output free-form text becomes the foundation of many other technologies.  In the next part, we will make use of this technique to create a neural network that can write captions for images to describe what is going on in the image. \n",
    "\n",
    "### Additional Information\n",
    "\n",
    "The following are some of the articles that I found useful putting this section together.\n",
    "\n",
    "* [The Unreasonable Effectiveness of Recurrent Neural Networks](http://karpathy.github.io/2015/05/21/rnn-effectiveness/)\n",
    "* [Keras LSTM Generation Example](https://keras.io/examples/lstm_text_generation/)\n",
    "\n",
    "### Character-Level Text Generation\n",
    "\n",
    "There are a number of different approaches to teaching a neural network to output free-form text.  The most basic question is if you wish the neural network to learn at the word or character level.  In many ways, learning at the character level is the more interesting of the two.  The LSTM is learning construct its own words without even being shown what a word is.  We will begin with character-level text generation.  In the next module, we will see how we can use nearly the same technique to operate at the word level.  The automatic captioning that will be implemented in the next module is at the word level.\n",
    "\n",
    "We begin by importing the needed Python packages and defining the sequence length, named **maxlen**.  Time-series neural networks always accept their input as a fixed length array.  Not all of the sequence might be used, it is common to fill extra elements with zeros.  The text will be divided into sequences of this length and the neural network will be trained to predict what comes after this sequence."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "from tensorflow.keras.callbacks import LambdaCallback\n",
    "from tensorflow.keras.models import Sequential\n",
    "from tensorflow.keras.layers import Dense\n",
    "from tensorflow.keras.layers import LSTM\n",
    "from tensorflow.keras.optimizers import RMSprop\n",
    "from tensorflow.keras.utils import get_file\n",
    "import numpy as np\n",
    "import random\n",
    "import sys\n",
    "import io\n",
    "import requests\n",
    "import re"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "For this simple example we will train the neural network on the classic children's book [Treasure Island](https://en.wikipedia.org/wiki/Treasure_Island).  We begin by loading this text into a Python string and displaying the first 1,000 characters."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "ï»¿The Project Gutenberg EBook of Treasure Island, by Robert Louis Stevenson\r\n",
      "\r\n",
      "This eBook is for the use of anyone anywhere at no cost and with\r\n",
      "almost no restrictions whatsoever.  You may copy it, give it away or\r\n",
      "re-use it under the terms of the Project Gutenberg License included\r\n",
      "with this eBook or online at www.gutenberg.net\r\n",
      "\r\n",
      "\r\n",
      "Title: Treasure Island\r\n",
      "\r\n",
      "Author: Robert Louis Stevenson\r\n",
      "\r\n",
      "Illustrator: Milo Winter\r\n",
      "\r\n",
      "Release Date: January 12, 2009 [EBook #27780]\r\n",
      "\r\n",
      "Language: English\r\n",
      "\r\n",
      "\r\n",
      "*** START OF THIS PROJECT GUTENBERG EBOOK TREASURE ISLAND ***\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "Produced by Juliet Sutherland, Stephen Blundell and the\r\n",
      "Online Distributed Proofreading Team at http://www.pgdp.net\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      " THE ILLUSTRATED CHILDREN'S LIBRARY\r\n",
      "\r\n",
      "\r\n",
      "         _Treasure Island_\r\n",
      "\r\n",
      "       Robert Louis Stevenson\r\n",
      "\r\n",
      "          _Illustrated by_\r\n",
      "            Milo Winter\r\n",
      "\r\n",
      "\r\n",
      "           [Illustration]\r\n",
      "\r\n",
      "\r\n",
      "           GRAMERCY BOOKS\r\n",
      "              NEW YORK\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      "\r\n",
      " Foreword copyright Â© 1986 by Random House V\n"
     ]
    }
   ],
   "source": [
    "r = requests.get(\"https://data.heatonresearch.com/data/t81-558/text/treasure_island.txt\")\n",
    "raw_text = r.text\n",
    "print(raw_text[0:1000])\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We will extract all unique characters from the text and sort them.  This allows us to assign a unique ID to each character.  Because the characters are sorted, these IDs should remain the same.  If new characters were added to the original text, then the IDs would change.  We build up two dictionaries.  The first **char2idx** is used to convert a character into its ID.  The second **idx2char** converts an ID back into its character."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "processed_text = raw_text.lower()\n",
    "processed_text = re.sub(r'[^\\x00-\\x7f]',r'', processed_text) "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "corpus length: 397400\n",
      "total chars: 60\n"
     ]
    }
   ],
   "source": [
    "print('corpus length:', len(processed_text))\n",
    "\n",
    "chars = sorted(list(set(processed_text)))\n",
    "print('total chars:', len(chars))\n",
    "char_indices = dict((c, i) for i, c in enumerate(chars))\n",
    "indices_char = dict((i, c) for i, c in enumerate(chars))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We are now ready to build the actual sequences.  Just like previous neural networks there will be an $x$ and $y$.  However, for the LSTM, $x$ and $y$ will both be sequences.  The $x$ input will specify the sequences where $y$ are the expected output.  The following code generates all possible sequences."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "nb sequences: 132454\n"
     ]
    }
   ],
   "source": [
    "# cut the text in semi-redundant sequences of maxlen characters\n",
    "maxlen = 40\n",
    "step = 3\n",
    "sentences = []\n",
    "next_chars = []\n",
    "for i in range(0, len(processed_text) - maxlen, step):\n",
    "    sentences.append(processed_text[i: i + maxlen])\n",
    "    next_chars.append(processed_text[i + maxlen])\n",
    "print('nb sequences:', len(sentences))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['the project gutenberg ebook of treasure ',\n",
       " ' project gutenberg ebook of treasure isl',\n",
       " 'oject gutenberg ebook of treasure island',\n",
       " 'ct gutenberg ebook of treasure island, b',\n",
       " 'gutenberg ebook of treasure island, by r',\n",
       " 'enberg ebook of treasure island, by robe',\n",
       " 'erg ebook of treasure island, by robert ',\n",
       " ' ebook of treasure island, by robert lou',\n",
       " 'ook of treasure island, by robert louis ',\n",
       " ' of treasure island, by robert louis ste',\n",
       " ' treasure island, by robert louis steven',\n",
       " 'easure island, by robert louis stevenson',\n",
       " 'ure island, by robert louis stevenson\\r\\n\\r',\n",
       " ' island, by robert louis stevenson\\r\\n\\r\\nth',\n",
       " 'land, by robert louis stevenson\\r\\n\\r\\nthis ',\n",
       " 'd, by robert louis stevenson\\r\\n\\r\\nthis ebo',\n",
       " 'by robert louis stevenson\\r\\n\\r\\nthis ebook ',\n",
       " 'robert louis stevenson\\r\\n\\r\\nthis ebook is ',\n",
       " 'ert louis stevenson\\r\\n\\r\\nthis ebook is for',\n",
       " ' louis stevenson\\r\\n\\r\\nthis ebook is for th',\n",
       " 'uis stevenson\\r\\n\\r\\nthis ebook is for the u',\n",
       " ' stevenson\\r\\n\\r\\nthis ebook is for the use ',\n",
       " 'evenson\\r\\n\\r\\nthis ebook is for the use of ',\n",
       " 'nson\\r\\n\\r\\nthis ebook is for the use of any',\n",
       " 'n\\r\\n\\r\\nthis ebook is for the use of anyone',\n",
       " '\\r\\nthis ebook is for the use of anyone an',\n",
       " 'his ebook is for the use of anyone anywh',\n",
       " ' ebook is for the use of anyone anywhere',\n",
       " 'ook is for the use of anyone anywhere at',\n",
       " ' is for the use of anyone anywhere at no',\n",
       " ' for the use of anyone anywhere at no co',\n",
       " 'r the use of anyone anywhere at no cost ',\n",
       " 'he use of anyone anywhere at no cost and',\n",
       " 'use of anyone anywhere at no cost and wi',\n",
       " ' of anyone anywhere at no cost and with\\r',\n",
       " ' anyone anywhere at no cost and with\\r\\nal',\n",
       " 'yone anywhere at no cost and with\\r\\nalmos',\n",
       " 'e anywhere at no cost and with\\r\\nalmost n',\n",
       " 'nywhere at no cost and with\\r\\nalmost no r',\n",
       " 'here at no cost and with\\r\\nalmost no rest',\n",
       " 'e at no cost and with\\r\\nalmost no restric',\n",
       " 't no cost and with\\r\\nalmost no restrictio',\n",
       " 'o cost and with\\r\\nalmost no restrictions ',\n",
       " 'ost and with\\r\\nalmost no restrictions wha',\n",
       " ' and with\\r\\nalmost no restrictions whatso',\n",
       " 'd with\\r\\nalmost no restrictions whatsoeve',\n",
       " 'ith\\r\\nalmost no restrictions whatsoever. ',\n",
       " '\\r\\nalmost no restrictions whatsoever.  yo',\n",
       " 'lmost no restrictions whatsoever.  you m',\n",
       " 'st no restrictions whatsoever.  you may ',\n",
       " 'no restrictions whatsoever.  you may cop',\n",
       " 'restrictions whatsoever.  you may copy i',\n",
       " 'trictions whatsoever.  you may copy it, ',\n",
       " 'ctions whatsoever.  you may copy it, giv',\n",
       " 'ons whatsoever.  you may copy it, give i',\n",
       " ' whatsoever.  you may copy it, give it a',\n",
       " 'atsoever.  you may copy it, give it away',\n",
       " 'oever.  you may copy it, give it away or',\n",
       " 'er.  you may copy it, give it away or\\r\\nr',\n",
       " '  you may copy it, give it away or\\r\\nre-u',\n",
       " 'ou may copy it, give it away or\\r\\nre-use ',\n",
       " 'may copy it, give it away or\\r\\nre-use it ',\n",
       " ' copy it, give it away or\\r\\nre-use it und',\n",
       " 'py it, give it away or\\r\\nre-use it under ',\n",
       " 'it, give it away or\\r\\nre-use it under the',\n",
       " ' give it away or\\r\\nre-use it under the te',\n",
       " 've it away or\\r\\nre-use it under the terms',\n",
       " 'it away or\\r\\nre-use it under the terms of',\n",
       " 'away or\\r\\nre-use it under the terms of th',\n",
       " 'y or\\r\\nre-use it under the terms of the p',\n",
       " 'r\\r\\nre-use it under the terms of the proj',\n",
       " 're-use it under the terms of the project',\n",
       " 'use it under the terms of the project gu',\n",
       " ' it under the terms of the project guten',\n",
       " ' under the terms of the project gutenber',\n",
       " 'der the terms of the project gutenberg l',\n",
       " ' the terms of the project gutenberg lice',\n",
       " 'e terms of the project gutenberg license',\n",
       " 'erms of the project gutenberg license in',\n",
       " 's of the project gutenberg license inclu',\n",
       " 'f the project gutenberg license included',\n",
       " 'he project gutenberg license included\\r\\nw',\n",
       " 'project gutenberg license included\\r\\nwith',\n",
       " 'ject gutenberg license included\\r\\nwith th',\n",
       " 't gutenberg license included\\r\\nwith this ',\n",
       " 'utenberg license included\\r\\nwith this ebo',\n",
       " 'nberg license included\\r\\nwith this ebook ',\n",
       " 'rg license included\\r\\nwith this ebook or ',\n",
       " 'license included\\r\\nwith this ebook or onl',\n",
       " 'ense included\\r\\nwith this ebook or online',\n",
       " 'e included\\r\\nwith this ebook or online at',\n",
       " 'ncluded\\r\\nwith this ebook or online at ww',\n",
       " 'uded\\r\\nwith this ebook or online at www.g',\n",
       " 'd\\r\\nwith this ebook or online at www.gute',\n",
       " 'with this ebook or online at www.gutenbe',\n",
       " 'h this ebook or online at www.gutenberg.',\n",
       " 'his ebook or online at www.gutenberg.net',\n",
       " ' ebook or online at www.gutenberg.net\\r\\n\\r',\n",
       " 'ook or online at www.gutenberg.net\\r\\n\\r\\n\\r\\n',\n",
       " ' or online at www.gutenberg.net\\r\\n\\r\\n\\r\\ntit',\n",
       " ' online at www.gutenberg.net\\r\\n\\r\\n\\r\\ntitle:',\n",
       " 'line at www.gutenberg.net\\r\\n\\r\\n\\r\\ntitle: tr',\n",
       " 'e at www.gutenberg.net\\r\\n\\r\\n\\r\\ntitle: treas',\n",
       " 't www.gutenberg.net\\r\\n\\r\\n\\r\\ntitle: treasure',\n",
       " 'ww.gutenberg.net\\r\\n\\r\\n\\r\\ntitle: treasure is',\n",
       " 'gutenberg.net\\r\\n\\r\\n\\r\\ntitle: treasure islan',\n",
       " 'enberg.net\\r\\n\\r\\n\\r\\ntitle: treasure island\\r\\n',\n",
       " 'erg.net\\r\\n\\r\\n\\r\\ntitle: treasure island\\r\\n\\r\\na',\n",
       " '.net\\r\\n\\r\\n\\r\\ntitle: treasure island\\r\\n\\r\\nauth',\n",
       " 't\\r\\n\\r\\n\\r\\ntitle: treasure island\\r\\n\\r\\nauthor:',\n",
       " '\\r\\n\\r\\ntitle: treasure island\\r\\n\\r\\nauthor: ro',\n",
       " '\\ntitle: treasure island\\r\\n\\r\\nauthor: rober',\n",
       " 'tle: treasure island\\r\\n\\r\\nauthor: robert l',\n",
       " ': treasure island\\r\\n\\r\\nauthor: robert loui',\n",
       " 'reasure island\\r\\n\\r\\nauthor: robert louis s',\n",
       " 'sure island\\r\\n\\r\\nauthor: robert louis stev',\n",
       " 'e island\\r\\n\\r\\nauthor: robert louis stevens',\n",
       " 'sland\\r\\n\\r\\nauthor: robert louis stevenson\\r',\n",
       " 'nd\\r\\n\\r\\nauthor: robert louis stevenson\\r\\n\\r\\n',\n",
       " '\\n\\r\\nauthor: robert louis stevenson\\r\\n\\r\\nill',\n",
       " 'author: robert louis stevenson\\r\\n\\r\\nillust',\n",
       " 'hor: robert louis stevenson\\r\\n\\r\\nillustrat',\n",
       " ': robert louis stevenson\\r\\n\\r\\nillustrator:',\n",
       " 'obert louis stevenson\\r\\n\\r\\nillustrator: mi',\n",
       " 'rt louis stevenson\\r\\n\\r\\nillustrator: milo ',\n",
       " 'louis stevenson\\r\\n\\r\\nillustrator: milo win',\n",
       " 'is stevenson\\r\\n\\r\\nillustrator: milo winter',\n",
       " 'stevenson\\r\\n\\r\\nillustrator: milo winter\\r\\n\\r',\n",
       " 'venson\\r\\n\\r\\nillustrator: milo winter\\r\\n\\r\\nre',\n",
       " 'son\\r\\n\\r\\nillustrator: milo winter\\r\\n\\r\\nrelea',\n",
       " '\\r\\n\\r\\nillustrator: milo winter\\r\\n\\r\\nrelease ',\n",
       " '\\nillustrator: milo winter\\r\\n\\r\\nrelease dat',\n",
       " 'lustrator: milo winter\\r\\n\\r\\nrelease date: ',\n",
       " 'trator: milo winter\\r\\n\\r\\nrelease date: jan',\n",
       " 'tor: milo winter\\r\\n\\r\\nrelease date: januar',\n",
       " ': milo winter\\r\\n\\r\\nrelease date: january 1',\n",
       " 'ilo winter\\r\\n\\r\\nrelease date: january 12, ',\n",
       " ' winter\\r\\n\\r\\nrelease date: january 12, 200',\n",
       " 'nter\\r\\n\\r\\nrelease date: january 12, 2009 [',\n",
       " 'r\\r\\n\\r\\nrelease date: january 12, 2009 [ebo',\n",
       " '\\r\\nrelease date: january 12, 2009 [ebook ',\n",
       " 'elease date: january 12, 2009 [ebook #27',\n",
       " 'ase date: january 12, 2009 [ebook #27780',\n",
       " ' date: january 12, 2009 [ebook #27780]\\r\\n',\n",
       " 'te: january 12, 2009 [ebook #27780]\\r\\n\\r\\nl',\n",
       " ' january 12, 2009 [ebook #27780]\\r\\n\\r\\nlang',\n",
       " 'nuary 12, 2009 [ebook #27780]\\r\\n\\r\\nlanguag',\n",
       " 'ry 12, 2009 [ebook #27780]\\r\\n\\r\\nlanguage: ',\n",
       " '12, 2009 [ebook #27780]\\r\\n\\r\\nlanguage: eng',\n",
       " ' 2009 [ebook #27780]\\r\\n\\r\\nlanguage: englis',\n",
       " '09 [ebook #27780]\\r\\n\\r\\nlanguage: english\\r\\n',\n",
       " '[ebook #27780]\\r\\n\\r\\nlanguage: english\\r\\n\\r\\n\\r',\n",
       " 'ook #27780]\\r\\n\\r\\nlanguage: english\\r\\n\\r\\n\\r\\n**',\n",
       " ' #27780]\\r\\n\\r\\nlanguage: english\\r\\n\\r\\n\\r\\n*** s',\n",
       " '7780]\\r\\n\\r\\nlanguage: english\\r\\n\\r\\n\\r\\n*** star',\n",
       " '0]\\r\\n\\r\\nlanguage: english\\r\\n\\r\\n\\r\\n*** start o',\n",
       " '\\n\\r\\nlanguage: english\\r\\n\\r\\n\\r\\n*** start of t',\n",
       " 'language: english\\r\\n\\r\\n\\r\\n*** start of this',\n",
       " 'guage: english\\r\\n\\r\\n\\r\\n*** start of this pr',\n",
       " 'ge: english\\r\\n\\r\\n\\r\\n*** start of this proje',\n",
       " ' english\\r\\n\\r\\n\\r\\n*** start of this project ',\n",
       " 'glish\\r\\n\\r\\n\\r\\n*** start of this project gut',\n",
       " 'sh\\r\\n\\r\\n\\r\\n*** start of this project gutenb',\n",
       " '\\n\\r\\n\\r\\n*** start of this project gutenberg',\n",
       " '\\r\\n*** start of this project gutenberg eb',\n",
       " '** start of this project gutenberg ebook',\n",
       " 'start of this project gutenberg ebook tr',\n",
       " 'rt of this project gutenberg ebook treas',\n",
       " 'of this project gutenberg ebook treasure',\n",
       " 'this project gutenberg ebook treasure is',\n",
       " 's project gutenberg ebook treasure islan',\n",
       " 'roject gutenberg ebook treasure island *',\n",
       " 'ect gutenberg ebook treasure island ***\\r',\n",
       " ' gutenberg ebook treasure island ***\\r\\n\\r\\n',\n",
       " 'tenberg ebook treasure island ***\\r\\n\\r\\n\\r\\n\\r',\n",
       " 'berg ebook treasure island ***\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n',\n",
       " 'g ebook treasure island ***\\r\\n\\r\\n\\r\\n\\r\\n\\r\\npro',\n",
       " 'book treasure island ***\\r\\n\\r\\n\\r\\n\\r\\n\\r\\nproduc',\n",
       " 'k treasure island ***\\r\\n\\r\\n\\r\\n\\r\\n\\r\\nproduced ',\n",
       " 'reasure island ***\\r\\n\\r\\n\\r\\n\\r\\n\\r\\nproduced by ',\n",
       " 'sure island ***\\r\\n\\r\\n\\r\\n\\r\\n\\r\\nproduced by jul',\n",
       " 'e island ***\\r\\n\\r\\n\\r\\n\\r\\n\\r\\nproduced by juliet',\n",
       " 'sland ***\\r\\n\\r\\n\\r\\n\\r\\n\\r\\nproduced by juliet su',\n",
       " 'nd ***\\r\\n\\r\\n\\r\\n\\r\\n\\r\\nproduced by juliet suthe',\n",
       " '***\\r\\n\\r\\n\\r\\n\\r\\n\\r\\nproduced by juliet sutherla',\n",
       " '\\r\\n\\r\\n\\r\\n\\r\\n\\r\\nproduced by juliet sutherland,',\n",
       " '\\n\\r\\n\\r\\n\\r\\nproduced by juliet sutherland, st',\n",
       " '\\r\\n\\r\\nproduced by juliet sutherland, steph',\n",
       " '\\nproduced by juliet sutherland, stephen ',\n",
       " 'oduced by juliet sutherland, stephen blu',\n",
       " 'ced by juliet sutherland, stephen blunde',\n",
       " ' by juliet sutherland, stephen blundell ',\n",
       " ' juliet sutherland, stephen blundell and',\n",
       " 'liet sutherland, stephen blundell and th',\n",
       " 't sutherland, stephen blundell and the\\r\\n',\n",
       " 'utherland, stephen blundell and the\\r\\nonl',\n",
       " 'erland, stephen blundell and the\\r\\nonline',\n",
       " 'and, stephen blundell and the\\r\\nonline di',\n",
       " ', stephen blundell and the\\r\\nonline distr',\n",
       " 'tephen blundell and the\\r\\nonline distribu',\n",
       " 'hen blundell and the\\r\\nonline distributed',\n",
       " ' blundell and the\\r\\nonline distributed pr',\n",
       " 'undell and the\\r\\nonline distributed proof',\n",
       " 'ell and the\\r\\nonline distributed proofrea',\n",
       " ' and the\\r\\nonline distributed proofreadin',\n",
       " 'd the\\r\\nonline distributed proofreading t',\n",
       " 'he\\r\\nonline distributed proofreading team',\n",
       " '\\nonline distributed proofreading team at',\n",
       " 'line distributed proofreading team at ht',\n",
       " 'e distributed proofreading team at http:',\n",
       " 'istributed proofreading team at http://w',\n",
       " 'ributed proofreading team at http://www.',\n",
       " 'uted proofreading team at http://www.pgd',\n",
       " 'd proofreading team at http://www.pgdp.n',\n",
       " 'roofreading team at http://www.pgdp.net\\r',\n",
       " 'freading team at http://www.pgdp.net\\r\\n\\r\\n',\n",
       " 'ading team at http://www.pgdp.net\\r\\n\\r\\n\\r\\n\\r',\n",
       " 'ng team at http://www.pgdp.net\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n',\n",
       " 'team at http://www.pgdp.net\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r',\n",
       " 'm at http://www.pgdp.net\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n',\n",
       " 't http://www.pgdp.net\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r',\n",
       " 'ttp://www.pgdp.net\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n t',\n",
       " '://www.pgdp.net\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n the ',\n",
       " 'www.pgdp.net\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n the ill',\n",
       " '.pgdp.net\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n the illust',\n",
       " 'dp.net\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n the illustrat',\n",
       " 'net\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n the illustrated ',\n",
       " '\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n the illustrated chi',\n",
       " '\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n the illustrated childr',\n",
       " \"\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n the illustrated children'\",\n",
       " \"\\n\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n the illustrated children's l\",\n",
       " \"\\r\\n\\r\\n\\r\\n\\r\\n the illustrated children's libr\",\n",
       " \"\\n\\r\\n\\r\\n the illustrated children's library\",\n",
       " \"\\r\\n the illustrated children's library\\r\\n\\r\",\n",
       " \"the illustrated children's library\\r\\n\\r\\n\\r\\n\",\n",
       " \" illustrated children's library\\r\\n\\r\\n\\r\\n   \",\n",
       " \"lustrated children's library\\r\\n\\r\\n\\r\\n      \",\n",
       " \"trated children's library\\r\\n\\r\\n\\r\\n         \",\n",
       " \"ted children's library\\r\\n\\r\\n\\r\\n         _tr\",\n",
       " \" children's library\\r\\n\\r\\n\\r\\n         _treas\",\n",
       " \"ildren's library\\r\\n\\r\\n\\r\\n         _treasure\",\n",
       " \"ren's library\\r\\n\\r\\n\\r\\n         _treasure is\",\n",
       " \"'s library\\r\\n\\r\\n\\r\\n         _treasure islan\",\n",
       " 'library\\r\\n\\r\\n\\r\\n         _treasure island_\\r',\n",
       " 'rary\\r\\n\\r\\n\\r\\n         _treasure island_\\r\\n\\r\\n',\n",
       " 'y\\r\\n\\r\\n\\r\\n         _treasure island_\\r\\n\\r\\n   ',\n",
       " '\\r\\n\\r\\n         _treasure island_\\r\\n\\r\\n      ',\n",
       " '\\n         _treasure island_\\r\\n\\r\\n       ro',\n",
       " '       _treasure island_\\r\\n\\r\\n       rober',\n",
       " '    _treasure island_\\r\\n\\r\\n       robert l',\n",
       " ' _treasure island_\\r\\n\\r\\n       robert loui',\n",
       " 'reasure island_\\r\\n\\r\\n       robert louis s',\n",
       " 'sure island_\\r\\n\\r\\n       robert louis stev',\n",
       " 'e island_\\r\\n\\r\\n       robert louis stevens',\n",
       " 'sland_\\r\\n\\r\\n       robert louis stevenson\\r',\n",
       " 'nd_\\r\\n\\r\\n       robert louis stevenson\\r\\n\\r\\n',\n",
       " '\\r\\n\\r\\n       robert louis stevenson\\r\\n\\r\\n   ',\n",
       " '\\n       robert louis stevenson\\r\\n\\r\\n      ',\n",
       " '     robert louis stevenson\\r\\n\\r\\n         ',\n",
       " '  robert louis stevenson\\r\\n\\r\\n          _i',\n",
       " 'obert louis stevenson\\r\\n\\r\\n          _illu',\n",
       " 'rt louis stevenson\\r\\n\\r\\n          _illustr',\n",
       " 'louis stevenson\\r\\n\\r\\n          _illustrate',\n",
       " 'is stevenson\\r\\n\\r\\n          _illustrated b',\n",
       " 'stevenson\\r\\n\\r\\n          _illustrated by_\\r',\n",
       " 'venson\\r\\n\\r\\n          _illustrated by_\\r\\n  ',\n",
       " 'son\\r\\n\\r\\n          _illustrated by_\\r\\n     ',\n",
       " '\\r\\n\\r\\n          _illustrated by_\\r\\n        ',\n",
       " '\\n          _illustrated by_\\r\\n           ',\n",
       " '        _illustrated by_\\r\\n            mi',\n",
       " '     _illustrated by_\\r\\n            milo ',\n",
       " '  _illustrated by_\\r\\n            milo win',\n",
       " 'illustrated by_\\r\\n            milo winter',\n",
       " 'ustrated by_\\r\\n            milo winter\\r\\n\\r',\n",
       " 'rated by_\\r\\n            milo winter\\r\\n\\r\\n\\r\\n',\n",
       " 'ed by_\\r\\n            milo winter\\r\\n\\r\\n\\r\\n   ',\n",
       " 'by_\\r\\n            milo winter\\r\\n\\r\\n\\r\\n      ',\n",
       " '\\r\\n            milo winter\\r\\n\\r\\n\\r\\n         ',\n",
       " '           milo winter\\r\\n\\r\\n\\r\\n           [',\n",
       " '        milo winter\\r\\n\\r\\n\\r\\n           [ill',\n",
       " '     milo winter\\r\\n\\r\\n\\r\\n           [illust',\n",
       " '  milo winter\\r\\n\\r\\n\\r\\n           [illustrat',\n",
       " 'ilo winter\\r\\n\\r\\n\\r\\n           [illustration',\n",
       " ' winter\\r\\n\\r\\n\\r\\n           [illustration]\\r\\n',\n",
       " 'nter\\r\\n\\r\\n\\r\\n           [illustration]\\r\\n\\r\\n\\r',\n",
       " 'r\\r\\n\\r\\n\\r\\n           [illustration]\\r\\n\\r\\n\\r\\n  ',\n",
       " '\\r\\n\\r\\n           [illustration]\\r\\n\\r\\n\\r\\n     ',\n",
       " '\\n           [illustration]\\r\\n\\r\\n\\r\\n        ',\n",
       " '         [illustration]\\r\\n\\r\\n\\r\\n           ',\n",
       " '      [illustration]\\r\\n\\r\\n\\r\\n           gra',\n",
       " '   [illustration]\\r\\n\\r\\n\\r\\n           gramer',\n",
       " '[illustration]\\r\\n\\r\\n\\r\\n           gramercy ',\n",
       " 'lustration]\\r\\n\\r\\n\\r\\n           gramercy boo',\n",
       " 'tration]\\r\\n\\r\\n\\r\\n           gramercy books\\r',\n",
       " 'tion]\\r\\n\\r\\n\\r\\n           gramercy books\\r\\n  ',\n",
       " 'n]\\r\\n\\r\\n\\r\\n           gramercy books\\r\\n     ',\n",
       " '\\n\\r\\n\\r\\n           gramercy books\\r\\n        ',\n",
       " '\\r\\n           gramercy books\\r\\n           ',\n",
       " '          gramercy books\\r\\n              ',\n",
       " '       gramercy books\\r\\n              new',\n",
       " '    gramercy books\\r\\n              new yo',\n",
       " ' gramercy books\\r\\n              new york\\r',\n",
       " 'amercy books\\r\\n              new york\\r\\n\\r\\n',\n",
       " 'rcy books\\r\\n              new york\\r\\n\\r\\n\\r\\n\\r',\n",
       " ' books\\r\\n              new york\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n',\n",
       " 'oks\\r\\n              new york\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n fo',\n",
       " '\\r\\n              new york\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n forew',\n",
       " '             new york\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n foreword',\n",
       " '          new york\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n foreword co',\n",
       " '       new york\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n foreword copyr',\n",
       " '    new york\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n foreword copyrigh',\n",
       " ' new york\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n foreword copyright  ',\n",
       " 'w york\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n foreword copyright  198',\n",
       " 'ork\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n foreword copyright  1986 b',\n",
       " '\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n foreword copyright  1986 by r',\n",
       " '\\n\\r\\n\\r\\n\\r\\n foreword copyright  1986 by rand',\n",
       " '\\r\\n\\r\\n foreword copyright  1986 by random ',\n",
       " '\\n foreword copyright  1986 by random hou',\n",
       " 'oreword copyright  1986 by random house ',\n",
       " 'word copyright  1986 by random house val',\n",
       " 'd copyright  1986 by random house value ',\n",
       " 'opyright  1986 by random house value pub',\n",
       " 'right  1986 by random house value publis',\n",
       " 'ht  1986 by random house value publishin',\n",
       " ' 1986 by random house value publishing\\r\\n',\n",
       " '86 by random house value publishing\\r\\n co',\n",
       " 'by random house value publishing\\r\\n color',\n",
       " 'random house value publishing\\r\\n color il',\n",
       " 'dom house value publishing\\r\\n color illus',\n",
       " ' house value publishing\\r\\n color illustra',\n",
       " 'use value publishing\\r\\n color illustratio',\n",
       " ' value publishing\\r\\n color illustrations ',\n",
       " 'lue publishing\\r\\n color illustrations by ',\n",
       " ' publishing\\r\\n color illustrations by mil',\n",
       " 'blishing\\r\\n color illustrations by milo w',\n",
       " 'shing\\r\\n color illustrations by milo wint',\n",
       " 'ng\\r\\n color illustrations by milo winter ',\n",
       " '\\n color illustrations by milo winter cop',\n",
       " 'olor illustrations by milo winter copyri',\n",
       " 'r illustrations by milo winter copyright',\n",
       " 'llustrations by milo winter copyright  1',\n",
       " 'strations by milo winter copyright  1915',\n",
       " 'ations by milo winter copyright  1915, 1',\n",
       " 'ons by milo winter copyright  1915, 1943',\n",
       " ' by milo winter copyright  1915, 1943 by',\n",
       " ' milo winter copyright  1915, 1943 by ra',\n",
       " 'lo winter copyright  1915, 1943 by rand\\r',\n",
       " 'winter copyright  1915, 1943 by rand\\r\\n m',\n",
       " 'ter copyright  1915, 1943 by rand\\r\\n mcna',\n",
       " ' copyright  1915, 1943 by rand\\r\\n mcnally',\n",
       " 'pyright  1915, 1943 by rand\\r\\n mcnally & ',\n",
       " 'ight  1915, 1943 by rand\\r\\n mcnally & com',\n",
       " 't  1915, 1943 by rand\\r\\n mcnally & compan',\n",
       " '1915, 1943 by rand\\r\\n mcnally & company\\r\\n',\n",
       " '5, 1943 by rand\\r\\n mcnally & company\\r\\n al',\n",
       " '1943 by rand\\r\\n mcnally & company\\r\\n all r',\n",
       " '3 by rand\\r\\n mcnally & company\\r\\n all righ',\n",
       " 'y rand\\r\\n mcnally & company\\r\\n all rights ',\n",
       " 'and\\r\\n mcnally & company\\r\\n all rights res',\n",
       " '\\r\\n mcnally & company\\r\\n all rights reserv',\n",
       " 'mcnally & company\\r\\n all rights reserved.',\n",
       " 'ally & company\\r\\n all rights reserved.\\r\\n\\r',\n",
       " 'y & company\\r\\n all rights reserved.\\r\\n\\r\\n t',\n",
       " ' company\\r\\n all rights reserved.\\r\\n\\r\\n this',\n",
       " 'mpany\\r\\n all rights reserved.\\r\\n\\r\\n this 20',\n",
       " 'ny\\r\\n all rights reserved.\\r\\n\\r\\n this 2002 ',\n",
       " '\\n all rights reserved.\\r\\n\\r\\n this 2002 edi',\n",
       " 'll rights reserved.\\r\\n\\r\\n this 2002 editio',\n",
       " 'rights reserved.\\r\\n\\r\\n this 2002 edition p',\n",
       " 'hts reserved.\\r\\n\\r\\n this 2002 edition publ',\n",
       " ' reserved.\\r\\n\\r\\n this 2002 edition publish',\n",
       " 'served.\\r\\n\\r\\n this 2002 edition published ',\n",
       " 'ved.\\r\\n\\r\\n this 2002 edition published by ',\n",
       " '.\\r\\n\\r\\n this 2002 edition published by gra',\n",
       " '\\r\\n this 2002 edition published by gramer',\n",
       " 'this 2002 edition published by gramercy ',\n",
       " 's 2002 edition published by gramercy boo',\n",
       " '002 edition published by gramercy books,',\n",
       " ' edition published by gramercy books, an',\n",
       " 'ition published by gramercy books, an im',\n",
       " 'on published by gramercy books, an impri',\n",
       " 'published by gramercy books, an imprint ',\n",
       " 'lished by gramercy books, an imprint of ',\n",
       " 'hed by gramercy books, an imprint of ran',\n",
       " ' by gramercy books, an imprint of random',\n",
       " ' gramercy books, an imprint of random\\r\\n ',\n",
       " 'amercy books, an imprint of random\\r\\n hou',\n",
       " 'rcy books, an imprint of random\\r\\n house ',\n",
       " ' books, an imprint of random\\r\\n house val',\n",
       " 'oks, an imprint of random\\r\\n house value ',\n",
       " ', an imprint of random\\r\\n house value pub',\n",
       " 'n imprint of random\\r\\n house value publis',\n",
       " 'mprint of random\\r\\n house value publishin',\n",
       " 'int of random\\r\\n house value publishing, ',\n",
       " ' of random\\r\\n house value publishing, a d',\n",
       " ' random\\r\\n house value publishing, a divi',\n",
       " 'ndom\\r\\n house value publishing, a divisio',\n",
       " 'm\\r\\n house value publishing, a division o',\n",
       " ' house value publishing, a division of r',\n",
       " 'use value publishing, a division of rand',\n",
       " ' value publishing, a division of random ',\n",
       " 'lue publishing, a division of random hou',\n",
       " ' publishing, a division of random house,',\n",
       " 'blishing, a division of random house, in',\n",
       " 'shing, a division of random house, inc.,',\n",
       " 'ng, a division of random house, inc., 28',\n",
       " ' a division of random house, inc., 280 p',\n",
       " 'division of random house, inc., 280 park',\n",
       " 'ision of random house, inc., 280 park\\r\\n ',\n",
       " 'on of random house, inc., 280 park\\r\\n ave',\n",
       " 'of random house, inc., 280 park\\r\\n avenue',\n",
       " 'random house, inc., 280 park\\r\\n avenue, n',\n",
       " 'dom house, inc., 280 park\\r\\n avenue, new ',\n",
       " ' house, inc., 280 park\\r\\n avenue, new yor',\n",
       " 'use, inc., 280 park\\r\\n avenue, new york, ',\n",
       " ', inc., 280 park\\r\\n avenue, new york, ny ',\n",
       " 'nc., 280 park\\r\\n avenue, new york, ny 100',\n",
       " ', 280 park\\r\\n avenue, new york, ny 10017.',\n",
       " '80 park\\r\\n avenue, new york, ny 10017.\\r\\n\\r',\n",
       " 'park\\r\\n avenue, new york, ny 10017.\\r\\n\\r\\n g',\n",
       " 'k\\r\\n avenue, new york, ny 10017.\\r\\n\\r\\n gram',\n",
       " ' avenue, new york, ny 10017.\\r\\n\\r\\n gramerc',\n",
       " 'enue, new york, ny 10017.\\r\\n\\r\\n gramercy i',\n",
       " 'e, new york, ny 10017.\\r\\n\\r\\n gramercy is a',\n",
       " 'new york, ny 10017.\\r\\n\\r\\n gramercy is a re',\n",
       " ' york, ny 10017.\\r\\n\\r\\n gramercy is a regis',\n",
       " 'rk, ny 10017.\\r\\n\\r\\n gramercy is a register',\n",
       " ' ny 10017.\\r\\n\\r\\n gramercy is a registered ',\n",
       " ' 10017.\\r\\n\\r\\n gramercy is a registered tra',\n",
       " '017.\\r\\n\\r\\n gramercy is a registered tradem',\n",
       " '.\\r\\n\\r\\n gramercy is a registered trademark',\n",
       " '\\r\\n gramercy is a registered trademark an',\n",
       " 'gramercy is a registered trademark and t',\n",
       " 'mercy is a registered trademark and the ',\n",
       " 'cy is a registered trademark and the col',\n",
       " 'is a registered trademark and the coloph',\n",
       " 'a registered trademark and the colophon ',\n",
       " 'egistered trademark and the colophon is ',\n",
       " 'stered trademark and the colophon is a t',\n",
       " 'red trademark and the colophon is a trad',\n",
       " ' trademark and the colophon is a tradema',\n",
       " 'ademark and the colophon is a trademark ',\n",
       " 'mark and the colophon is a trademark of\\r',\n",
       " 'k and the colophon is a trademark of\\r\\n r',\n",
       " 'nd the colophon is a trademark of\\r\\n rand',\n",
       " 'the colophon is a trademark of\\r\\n random ',\n",
       " ' colophon is a trademark of\\r\\n random hou',\n",
       " 'lophon is a trademark of\\r\\n random house,',\n",
       " 'hon is a trademark of\\r\\n random house, in',\n",
       " ' is a trademark of\\r\\n random house, inc.\\r',\n",
       " ' a trademark of\\r\\n random house, inc.\\r\\n\\r\\n',\n",
       " 'trademark of\\r\\n random house, inc.\\r\\n\\r\\n pr',\n",
       " 'demark of\\r\\n random house, inc.\\r\\n\\r\\n print',\n",
       " 'ark of\\r\\n random house, inc.\\r\\n\\r\\n printed ',\n",
       " ' of\\r\\n random house, inc.\\r\\n\\r\\n printed and',\n",
       " '\\r\\n random house, inc.\\r\\n\\r\\n printed and bo',\n",
       " 'random house, inc.\\r\\n\\r\\n printed and bound',\n",
       " 'dom house, inc.\\r\\n\\r\\n printed and bound in',\n",
       " ' house, inc.\\r\\n\\r\\n printed and bound in th',\n",
       " 'use, inc.\\r\\n\\r\\n printed and bound in the u',\n",
       " ', inc.\\r\\n\\r\\n printed and bound in the unit',\n",
       " 'nc.\\r\\n\\r\\n printed and bound in the united ',\n",
       " '\\r\\n\\r\\n printed and bound in the united sta',\n",
       " '\\n printed and bound in the united states',\n",
       " 'rinted and bound in the united states of',\n",
       " 'ted and bound in the united states of am',\n",
       " ' and bound in the united states of ameri',\n",
       " 'd bound in the united states of america\\r',\n",
       " 'ound in the united states of america\\r\\n\\r\\n',\n",
       " 'd in the united states of america\\r\\n\\r\\n co',\n",
       " 'n the united states of america\\r\\n\\r\\n cover',\n",
       " 'he united states of america\\r\\n\\r\\n cover de',\n",
       " 'united states of america\\r\\n\\r\\n cover desig',\n",
       " 'ted states of america\\r\\n\\r\\n cover design b',\n",
       " ' states of america\\r\\n\\r\\n cover design by j',\n",
       " 'ates of america\\r\\n\\r\\n cover design by judy',\n",
       " 's of america\\r\\n\\r\\n cover design by judy fu',\n",
       " 'f america\\r\\n\\r\\n cover design by judy fucci',\n",
       " 'merica\\r\\n\\r\\n cover design by judy fucci, s',\n",
       " 'ica\\r\\n\\r\\n cover design by judy fucci, stud',\n",
       " '\\r\\n\\r\\n cover design by judy fucci, studio ',\n",
       " '\\n cover design by judy fucci, studio gra',\n",
       " 'over design by judy fucci, studio graphi',\n",
       " 'r design by judy fucci, studio graphix, ',\n",
       " 'esign by judy fucci, studio graphix, inc',\n",
       " 'gn by judy fucci, studio graphix, inc.\\r\\n',\n",
       " 'by judy fucci, studio graphix, inc.\\r\\n\\r\\n ',\n",
       " 'judy fucci, studio graphix, inc.\\r\\n\\r\\n ran',\n",
       " 'y fucci, studio graphix, inc.\\r\\n\\r\\n random',\n",
       " 'ucci, studio graphix, inc.\\r\\n\\r\\n random ho',\n",
       " 'i, studio graphix, inc.\\r\\n\\r\\n random house',\n",
       " 'studio graphix, inc.\\r\\n\\r\\n random house\\r\\n ',\n",
       " 'dio graphix, inc.\\r\\n\\r\\n random house\\r\\n new',\n",
       " ' graphix, inc.\\r\\n\\r\\n random house\\r\\n new yo',\n",
       " 'aphix, inc.\\r\\n\\r\\n random house\\r\\n new york ',\n",
       " 'ix, inc.\\r\\n\\r\\n random house\\r\\n new york  to',\n",
       " ' inc.\\r\\n\\r\\n random house\\r\\n new york  toron',\n",
       " 'c.\\r\\n\\r\\n random house\\r\\n new york  toronto ',\n",
       " '\\n\\r\\n random house\\r\\n new york  toronto  lo',\n",
       " ' random house\\r\\n new york  toronto  londo',\n",
       " 'ndom house\\r\\n new york  toronto  london  ',\n",
       " 'm house\\r\\n new york  toronto  london  syd',\n",
       " 'ouse\\r\\n new york  toronto  london  sydney',\n",
       " 'e\\r\\n new york  toronto  london  sydney  a',\n",
       " ' new york  toronto  london  sydney  auck',\n",
       " 'w york  toronto  london  sydney  aucklan',\n",
       " 'ork  toronto  london  sydney  auckland\\r\\n',\n",
       " '  toronto  london  sydney  auckland\\r\\n ww',\n",
       " 'oronto  london  sydney  auckland\\r\\n www.r',\n",
       " 'nto  london  sydney  auckland\\r\\n www.rand',\n",
       " '  london  sydney  auckland\\r\\n www.randomh',\n",
       " 'ondon  sydney  auckland\\r\\n www.randomhous',\n",
       " 'on  sydney  auckland\\r\\n www.randomhouse.c',\n",
       " ' sydney  auckland\\r\\n www.randomhouse.com\\r',\n",
       " 'dney  auckland\\r\\n www.randomhouse.com\\r\\n\\r\\n',\n",
       " 'y  auckland\\r\\n www.randomhouse.com\\r\\n\\r\\n\\r\\n ',\n",
       " 'auckland\\r\\n www.randomhouse.com\\r\\n\\r\\n\\r\\n lib',\n",
       " 'kland\\r\\n www.randomhouse.com\\r\\n\\r\\n\\r\\n librar',\n",
       " 'nd\\r\\n www.randomhouse.com\\r\\n\\r\\n\\r\\n library o',\n",
       " '\\n www.randomhouse.com\\r\\n\\r\\n\\r\\n library of c',\n",
       " 'ww.randomhouse.com\\r\\n\\r\\n\\r\\n library of cong',\n",
       " 'randomhouse.com\\r\\n\\r\\n\\r\\n library of congres',\n",
       " 'domhouse.com\\r\\n\\r\\n\\r\\n library of congress c',\n",
       " 'house.com\\r\\n\\r\\n\\r\\n library of congress cata',\n",
       " 'se.com\\r\\n\\r\\n\\r\\n library of congress catalog',\n",
       " 'com\\r\\n\\r\\n\\r\\n library of congress cataloging',\n",
       " '\\r\\n\\r\\n\\r\\n library of congress cataloging-in',\n",
       " '\\n\\r\\n library of congress cataloging-in-pu',\n",
       " ' library of congress cataloging-in-publi',\n",
       " 'brary of congress cataloging-in-publicat',\n",
       " 'ry of congress cataloging-in-publication',\n",
       " 'of congress cataloging-in-publication da',\n",
       " 'congress cataloging-in-publication data\\r',\n",
       " 'gress cataloging-in-publication data\\r\\n\\r\\n',\n",
       " 'ss cataloging-in-publication data\\r\\n\\r\\n st',\n",
       " 'cataloging-in-publication data\\r\\n\\r\\n steve',\n",
       " 'aloging-in-publication data\\r\\n\\r\\n stevenso',\n",
       " 'ging-in-publication data\\r\\n\\r\\n stevenson, ',\n",
       " 'g-in-publication data\\r\\n\\r\\n stevenson, rob',\n",
       " 'n-publication data\\r\\n\\r\\n stevenson, robert',\n",
       " 'ublication data\\r\\n\\r\\n stevenson, robert lo',\n",
       " 'ication data\\r\\n\\r\\n stevenson, robert louis',\n",
       " 'tion data\\r\\n\\r\\n stevenson, robert louis, 1',\n",
       " 'n data\\r\\n\\r\\n stevenson, robert louis, 1850',\n",
       " 'ata\\r\\n\\r\\n stevenson, robert louis, 1850-18',\n",
       " '\\r\\n\\r\\n stevenson, robert louis, 1850-1894.',\n",
       " '\\n stevenson, robert louis, 1850-1894.\\r\\n ',\n",
       " 'tevenson, robert louis, 1850-1894.\\r\\n    ',\n",
       " 'enson, robert louis, 1850-1894.\\r\\n     tr',\n",
       " 'on, robert louis, 1850-1894.\\r\\n     treas',\n",
       " ' robert louis, 1850-1894.\\r\\n     treasure',\n",
       " 'bert louis, 1850-1894.\\r\\n     treasure is',\n",
       " 't louis, 1850-1894.\\r\\n     treasure islan',\n",
       " 'ouis, 1850-1894.\\r\\n     treasure island/r',\n",
       " 's, 1850-1894.\\r\\n     treasure island/robe',\n",
       " '1850-1894.\\r\\n     treasure island/robert ',\n",
       " '0-1894.\\r\\n     treasure island/robert lou',\n",
       " '894.\\r\\n     treasure island/robert louis ',\n",
       " '.\\r\\n     treasure island/robert louis ste',\n",
       " '     treasure island/robert louis steven',\n",
       " '  treasure island/robert louis stevenson',\n",
       " 'reasure island/robert louis stevenson; i',\n",
       " 'sure island/robert louis stevenson; illu',\n",
       " 'e island/robert louis stevenson; illustr',\n",
       " 'sland/robert louis stevenson; illustrate',\n",
       " 'nd/robert louis stevenson; illustrated i',\n",
       " 'robert louis stevenson; illustrated in c',\n",
       " 'ert louis stevenson; illustrated in colo',\n",
       " ' louis stevenson; illustrated in color b',\n",
       " 'uis stevenson; illustrated in color by\\r\\n',\n",
       " ' stevenson; illustrated in color by\\r\\n   ',\n",
       " 'evenson; illustrated in color by\\r\\n   mil',\n",
       " 'nson; illustrated in color by\\r\\n   milo w',\n",
       " 'n; illustrated in color by\\r\\n   milo wint',\n",
       " 'illustrated in color by\\r\\n   milo winter.',\n",
       " 'ustrated in color by\\r\\n   milo winter.\\r\\n ',\n",
       " 'rated in color by\\r\\n   milo winter.\\r\\n    ',\n",
       " 'ed in color by\\r\\n   milo winter.\\r\\n       ',\n",
       " 'in color by\\r\\n   milo winter.\\r\\n       p. ',\n",
       " 'color by\\r\\n   milo winter.\\r\\n       p. cm.',\n",
       " 'or by\\r\\n   milo winter.\\r\\n       p. cm.--(',\n",
       " 'by\\r\\n   milo winter.\\r\\n       p. cm.--(ill',\n",
       " '\\n   milo winter.\\r\\n       p. cm.--(illust',\n",
       " ' milo winter.\\r\\n       p. cm.--(illustrat',\n",
       " 'lo winter.\\r\\n       p. cm.--(illustrated ',\n",
       " 'winter.\\r\\n       p. cm.--(illustrated chi',\n",
       " 'ter.\\r\\n       p. cm.--(illustrated childr',\n",
       " \".\\r\\n       p. cm.--(illustrated children'\",\n",
       " \"       p. cm.--(illustrated children's l\",\n",
       " \"    p. cm.--(illustrated children's libr\",\n",
       " \" p. cm.--(illustrated children's library\",\n",
       " \" cm.--(illustrated children's library)\\r\\n\",\n",
       " \".--(illustrated children's library)\\r\\n   \",\n",
       " \"(illustrated children's library)\\r\\n     o\",\n",
       " \"lustrated children's library)\\r\\n     orig\",\n",
       " \"trated children's library)\\r\\n     origina\",\n",
       " \"ted children's library)\\r\\n     originally\",\n",
       " \" children's library)\\r\\n     originally pu\",\n",
       " \"ildren's library)\\r\\n     originally publi\",\n",
       " \"ren's library)\\r\\n     originally publishe\",\n",
       " \"'s library)\\r\\n     originally published: \",\n",
       " 'library)\\r\\n     originally published: new',\n",
       " 'rary)\\r\\n     originally published: new yo',\n",
       " 'y)\\r\\n     originally published: new york:',\n",
       " '\\n     originally published: new york: ch',\n",
       " '   originally published: new york: child',\n",
       " 'originally published: new york: children',\n",
       " \"ginally published: new york: children's \",\n",
       " \"ally published: new york: children's cla\",\n",
       " \"y published: new york: children's classi\",\n",
       " \"ublished: new york: children's classics,\",\n",
       " \"ished: new york: children's classics, 19\",\n",
       " \"ed: new york: children's classics, 1986.\",\n",
       " \" new york: children's classics, 1986.\\r\\n \",\n",
       " \"w york: children's classics, 1986.\\r\\n    \",\n",
       " \"ork: children's classics, 1986.\\r\\n     su\",\n",
       " \": children's classics, 1986.\\r\\n     summa\",\n",
       " \"hildren's classics, 1986.\\r\\n     summary:\",\n",
       " \"dren's classics, 1986.\\r\\n     summary: wh\",\n",
       " \"n's classics, 1986.\\r\\n     summary: while\",\n",
       " ' classics, 1986.\\r\\n     summary: while go',\n",
       " 'assics, 1986.\\r\\n     summary: while going',\n",
       " 'ics, 1986.\\r\\n     summary: while going th',\n",
       " ', 1986.\\r\\n     summary: while going throu',\n",
       " '986.\\r\\n     summary: while going through ',\n",
       " '.\\r\\n     summary: while going through the',\n",
       " '     summary: while going through the po',\n",
       " '  summary: while going through the posse',\n",
       " 'ummary: while going through the possessi',\n",
       " 'ary: while going through the possessions',\n",
       " ': while going through the possessions of',\n",
       " 'hile going through the possessions of a ',\n",
       " 'e going through the possessions of a dec',\n",
       " 'oing through the possessions of a deceas',\n",
       " 'g through the possessions of a deceased ',\n",
       " 'hrough the possessions of a deceased gue',\n",
       " 'ugh the possessions of a deceased guest\\r',\n",
       " ' the possessions of a deceased guest\\r\\n  ',\n",
       " 'e possessions of a deceased guest\\r\\n   wh',\n",
       " 'ossessions of a deceased guest\\r\\n   who o',\n",
       " 'essions of a deceased guest\\r\\n   who owed',\n",
       " 'ions of a deceased guest\\r\\n   who owed th',\n",
       " 's of a deceased guest\\r\\n   who owed them ',\n",
       " 'f a deceased guest\\r\\n   who owed them mon',\n",
       " ' deceased guest\\r\\n   who owed them money,',\n",
       " 'ceased guest\\r\\n   who owed them money, th',\n",
       " 'sed guest\\r\\n   who owed them money, the m',\n",
       " ' guest\\r\\n   who owed them money, the mist',\n",
       " 'est\\r\\n   who owed them money, the mistres',\n",
       " '\\r\\n   who owed them money, the mistress o',\n",
       " '  who owed them money, the mistress of t',\n",
       " 'ho owed them money, the mistress of the ',\n",
       " 'owed them money, the mistress of the inn',\n",
       " 'd them money, the mistress of the inn an',\n",
       " 'hem money, the mistress of the inn and h',\n",
       " ' money, the mistress of the inn and her ',\n",
       " 'ney, the mistress of the inn and her son',\n",
       " ', the mistress of the inn and her son fi',\n",
       " 'he mistress of the inn and her son find ',\n",
       " 'mistress of the inn and her son find a\\r\\n',\n",
       " 'tress of the inn and her son find a\\r\\n   ',\n",
       " 'ss of the inn and her son find a\\r\\n   tre',\n",
       " 'of the inn and her son find a\\r\\n   treasu',\n",
       " 'the inn and her son find a\\r\\n   treasure ',\n",
       " ' inn and her son find a\\r\\n   treasure map',\n",
       " 'n and her son find a\\r\\n   treasure map th',\n",
       " 'nd her son find a\\r\\n   treasure map that ',\n",
       " 'her son find a\\r\\n   treasure map that lea',\n",
       " ' son find a\\r\\n   treasure map that leads ',\n",
       " 'n find a\\r\\n   treasure map that leads the',\n",
       " 'ind a\\r\\n   treasure map that leads them t',\n",
       " ' a\\r\\n   treasure map that leads them to a',\n",
       " '\\n   treasure map that leads them to a pi',\n",
       " ' treasure map that leads them to a pirat',\n",
       " \"easure map that leads them to a pirate's\",\n",
       " \"ure map that leads them to a pirate's fo\",\n",
       " \" map that leads them to a pirate's fortu\",\n",
       " \"p that leads them to a pirate's fortune.\",\n",
       " \"hat leads them to a pirate's fortune.\\r\\n \",\n",
       " \" leads them to a pirate's fortune.\\r\\n    \",\n",
       " \"ads them to a pirate's fortune.\\r\\n     is\",\n",
       " \" them to a pirate's fortune.\\r\\n     isbn \",\n",
       " \"em to a pirate's fortune.\\r\\n     isbn 0-5\",\n",
       " \"to a pirate's fortune.\\r\\n     isbn 0-517-\",\n",
       " \"a pirate's fortune.\\r\\n     isbn 0-517-221\",\n",
       " \"irate's fortune.\\r\\n     isbn 0-517-22114-\",\n",
       " \"te's fortune.\\r\\n     isbn 0-517-22114-4\\r\\n\",\n",
       " 's fortune.\\r\\n     isbn 0-517-22114-4\\r\\n   ',\n",
       " 'ortune.\\r\\n     isbn 0-517-22114-4\\r\\n     [',\n",
       " 'une.\\r\\n     isbn 0-517-22114-4\\r\\n     [1. ',\n",
       " '.\\r\\n     isbn 0-517-22114-4\\r\\n     [1. bur',\n",
       " '     isbn 0-517-22114-4\\r\\n     [1. buried',\n",
       " '  isbn 0-517-22114-4\\r\\n     [1. buried tr',\n",
       " 'sbn 0-517-22114-4\\r\\n     [1. buried treas',\n",
       " ' 0-517-22114-4\\r\\n     [1. buried treasure',\n",
       " '517-22114-4\\r\\n     [1. buried treasure--f',\n",
       " '-22114-4\\r\\n     [1. buried treasure--fict',\n",
       " '114-4\\r\\n     [1. buried treasure--fiction',\n",
       " '-4\\r\\n     [1. buried treasure--fiction. 2',\n",
       " '\\n     [1. buried treasure--fiction. 2. p',\n",
       " '   [1. buried treasure--fiction. 2. pira',\n",
       " '[1. buried treasure--fiction. 2. pirates',\n",
       " ' buried treasure--fiction. 2. pirates--f',\n",
       " 'ried treasure--fiction. 2. pirates--fict',\n",
       " 'd treasure--fiction. 2. pirates--fiction',\n",
       " 'reasure--fiction. 2. pirates--fiction. 3',\n",
       " 'sure--fiction. 2. pirates--fiction. 3. a',\n",
       " 'e--fiction. 2. pirates--fiction. 3. adve',\n",
       " 'fiction. 2. pirates--fiction. 3. adventu',\n",
       " 'tion. 2. pirates--fiction. 3. adventure\\r',\n",
       " 'n. 2. pirates--fiction. 3. adventure\\r\\n  ',\n",
       " '2. pirates--fiction. 3. adventure\\r\\n   an',\n",
       " 'pirates--fiction. 3. adventure\\r\\n   and a',\n",
       " 'ates--fiction. 3. adventure\\r\\n   and adve',\n",
       " 's--fiction. 3. adventure\\r\\n   and adventu',\n",
       " 'fiction. 3. adventure\\r\\n   and adventures',\n",
       " 'tion. 3. adventure\\r\\n   and adventures--f',\n",
       " 'n. 3. adventure\\r\\n   and adventures--fict',\n",
       " '3. adventure\\r\\n   and adventures--fiction',\n",
       " 'adventure\\r\\n   and adventures--fiction. 4',\n",
       " 'enture\\r\\n   and adventures--fiction. 4. c',\n",
       " 'ure\\r\\n   and adventures--fiction. 4. cari',\n",
       " '\\r\\n   and adventures--fiction. 4. caribbe',\n",
       " '  and adventures--fiction. 4. caribbean ',\n",
       " 'nd adventures--fiction. 4. caribbean are',\n",
       " 'adventures--fiction. 4. caribbean area--',\n",
       " 'entures--fiction. 4. caribbean area--his',\n",
       " 'ures--fiction. 4. caribbean area--histor',\n",
       " 's--fiction. 4. caribbean area--history--',\n",
       " 'fiction. 4. caribbean area--history--18t',\n",
       " 'tion. 4. caribbean area--history--18th\\r\\n',\n",
       " 'n. 4. caribbean area--history--18th\\r\\n   ',\n",
       " '4. caribbean area--history--18th\\r\\n   cen',\n",
       " 'caribbean area--history--18th\\r\\n   centur',\n",
       " 'ibbean area--history--18th\\r\\n   century--',\n",
       " 'ean area--history--18th\\r\\n   century--fic',\n",
       " ' area--history--18th\\r\\n   century--fictio',\n",
       " 'ea--history--18th\\r\\n   century--fiction.]',\n",
       " '-history--18th\\r\\n   century--fiction.] i.',\n",
       " 'story--18th\\r\\n   century--fiction.] i. wi',\n",
       " 'ry--18th\\r\\n   century--fiction.] i. winte',\n",
       " '-18th\\r\\n   century--fiction.] i. winter, ',\n",
       " 'th\\r\\n   century--fiction.] i. winter, mil',\n",
       " '\\n   century--fiction.] i. winter, milo, ',\n",
       " ' century--fiction.] i. winter, milo, 188',\n",
       " 'ntury--fiction.] i. winter, milo, 1888-1',\n",
       " 'ry--fiction.] i. winter, milo, 1888-1956',\n",
       " '-fiction.] i. winter, milo, 1888-1956, i',\n",
       " 'ction.] i. winter, milo, 1888-1956, ill.',\n",
       " 'on.] i. winter, milo, 1888-1956, ill. ii',\n",
       " '] i. winter, milo, 1888-1956, ill. ii. t',\n",
       " '. winter, milo, 1888-1956, ill. ii. titl',\n",
       " 'inter, milo, 1888-1956, ill. ii. title.\\r',\n",
       " 'er, milo, 1888-1956, ill. ii. title.\\r\\n  ',\n",
       " ' milo, 1888-1956, ill. ii. title.\\r\\n   ii',\n",
       " 'lo, 1888-1956, ill. ii. title.\\r\\n   iii. ',\n",
       " ' 1888-1956, ill. ii. title.\\r\\n   iii. ser',\n",
       " '88-1956, ill. ii. title.\\r\\n   iii. series',\n",
       " '1956, ill. ii. title.\\r\\n   iii. series.\\r\\n',\n",
       " '6, ill. ii. title.\\r\\n   iii. series.\\r\\n\\r\\n ',\n",
       " 'ill. ii. title.\\r\\n   iii. series.\\r\\n\\r\\n   p',\n",
       " '. ii. title.\\r\\n   iii. series.\\r\\n\\r\\n   pz7.',\n",
       " 'i. title.\\r\\n   iii. series.\\r\\n\\r\\n   pz7.s84',\n",
       " 'title.\\r\\n   iii. series.\\r\\n\\r\\n   pz7.s8482 ',\n",
       " 'le.\\r\\n   iii. series.\\r\\n\\r\\n   pz7.s8482 tr ',\n",
       " '\\r\\n   iii. series.\\r\\n\\r\\n   pz7.s8482 tr 200',\n",
       " '  iii. series.\\r\\n\\r\\n   pz7.s8482 tr 2002\\r\\n',\n",
       " 'ii. series.\\r\\n\\r\\n   pz7.s8482 tr 2002\\r\\n   ',\n",
       " ' series.\\r\\n\\r\\n   pz7.s8482 tr 2002\\r\\n   [fi',\n",
       " 'ries.\\r\\n\\r\\n   pz7.s8482 tr 2002\\r\\n   [fic]-',\n",
       " 's.\\r\\n\\r\\n   pz7.s8482 tr 2002\\r\\n   [fic]--dc',\n",
       " '\\n\\r\\n   pz7.s8482 tr 2002\\r\\n   [fic]--dc21\\r',\n",
       " '   pz7.s8482 tr 2002\\r\\n   [fic]--dc21\\r\\n\\r\\n',\n",
       " 'pz7.s8482 tr 2002\\r\\n   [fic]--dc21\\r\\n\\r\\n   ',\n",
       " '.s8482 tr 2002\\r\\n   [fic]--dc21\\r\\n\\r\\n      ',\n",
       " '482 tr 2002\\r\\n   [fic]--dc21\\r\\n\\r\\n         ',\n",
       " ' tr 2002\\r\\n   [fic]--dc21\\r\\n\\r\\n            ',\n",
       " ' 2002\\r\\n   [fic]--dc21\\r\\n\\r\\n               ',\n",
       " '02\\r\\n   [fic]--dc21\\r\\n\\r\\n                  ',\n",
       " '\\n   [fic]--dc21\\r\\n\\r\\n                     ',\n",
       " ' [fic]--dc21\\r\\n\\r\\n                        ',\n",
       " 'ic]--dc21\\r\\n\\r\\n                           ',\n",
       " '--dc21\\r\\n\\r\\n                              ',\n",
       " 'c21\\r\\n\\r\\n                                 ',\n",
       " '\\r\\n\\r\\n                                    ',\n",
       " '\\n                                       ',\n",
       " '                                        ',\n",
       " '                                        ',\n",
       " '                                        ',\n",
       " '                                        ',\n",
       " '                                        ',\n",
       " '                                        ',\n",
       " '                                        ',\n",
       " '                                       2',\n",
       " '                                    2002',\n",
       " '                                 2002023',\n",
       " '                              2002023301',\n",
       " '                           2002023301\\r\\n ',\n",
       " '                        2002023301\\r\\n 9 8',\n",
       " '                     2002023301\\r\\n 9 8 7 ',\n",
       " '                  2002023301\\r\\n 9 8 7 6 5',\n",
       " '               2002023301\\r\\n 9 8 7 6 5 4 ',\n",
       " '            2002023301\\r\\n 9 8 7 6 5 4 3 2',\n",
       " '         2002023301\\r\\n 9 8 7 6 5 4 3 2 1\\r',\n",
       " '      2002023301\\r\\n 9 8 7 6 5 4 3 2 1\\r\\n\\r\\n',\n",
       " '   2002023301\\r\\n 9 8 7 6 5 4 3 2 1\\r\\n\\r\\n\\r\\nt',\n",
       " '2002023301\\r\\n 9 8 7 6 5 4 3 2 1\\r\\n\\r\\n\\r\\ntran',\n",
       " '2023301\\r\\n 9 8 7 6 5 4 3 2 1\\r\\n\\r\\n\\r\\ntranscr',\n",
       " '3301\\r\\n 9 8 7 6 5 4 3 2 1\\r\\n\\r\\n\\r\\ntranscribe',\n",
       " \"1\\r\\n 9 8 7 6 5 4 3 2 1\\r\\n\\r\\n\\r\\ntranscriber's\",\n",
       " \" 9 8 7 6 5 4 3 2 1\\r\\n\\r\\n\\r\\ntranscriber's no\",\n",
       " \"8 7 6 5 4 3 2 1\\r\\n\\r\\n\\r\\ntranscriber's note:\",\n",
       " \" 6 5 4 3 2 1\\r\\n\\r\\n\\r\\ntranscriber's note:\\r\\n\\r\",\n",
       " \"5 4 3 2 1\\r\\n\\r\\n\\r\\ntranscriber's note:\\r\\n\\r\\n  \",\n",
       " \" 3 2 1\\r\\n\\r\\n\\r\\ntranscriber's note:\\r\\n\\r\\n    m\",\n",
       " \"2 1\\r\\n\\r\\n\\r\\ntranscriber's note:\\r\\n\\r\\n    mino\",\n",
       " \"\\r\\n\\r\\n\\r\\ntranscriber's note:\\r\\n\\r\\n    minor s\",\n",
       " \"\\n\\r\\ntranscriber's note:\\r\\n\\r\\n    minor spel\",\n",
       " \"transcriber's note:\\r\\n\\r\\n    minor spellin\",\n",
       " \"nscriber's note:\\r\\n\\r\\n    minor spelling a\",\n",
       " \"riber's note:\\r\\n\\r\\n    minor spelling and \",\n",
       " \"er's note:\\r\\n\\r\\n    minor spelling and typ\",\n",
       " 's note:\\r\\n\\r\\n    minor spelling and typogr',\n",
       " 'ote:\\r\\n\\r\\n    minor spelling and typograph',\n",
       " ':\\r\\n\\r\\n    minor spelling and typographica',\n",
       " '\\r\\n    minor spelling and typographical e',\n",
       " '   minor spelling and typographical erro',\n",
       " 'minor spelling and typographical errors ',\n",
       " 'or spelling and typographical errors hav',\n",
       " 'spelling and typographical errors have b',\n",
       " 'lling and typographical errors have been',\n",
       " 'ng and typographical errors have been co',\n",
       " 'and typographical errors have been corre',\n",
       " ' typographical errors have been correcte',\n",
       " 'pographical errors have been corrected w',\n",
       " 'raphical errors have been corrected with',\n",
       " 'hical errors have been corrected without',\n",
       " 'al errors have been corrected without\\r\\n ',\n",
       " 'errors have been corrected without\\r\\n    ',\n",
       " 'ors have been corrected without\\r\\n    not',\n",
       " ' have been corrected without\\r\\n    note. ',\n",
       " 've been corrected without\\r\\n    note. dia',\n",
       " 'been corrected without\\r\\n    note. dialec',\n",
       " 'n corrected without\\r\\n    note. dialect a',\n",
       " 'orrected without\\r\\n    note. dialect and ',\n",
       " 'ected without\\r\\n    note. dialect and var',\n",
       " 'ed without\\r\\n    note. dialect and varian',\n",
       " 'without\\r\\n    note. dialect and variant s',\n",
       " 'hout\\r\\n    note. dialect and variant spel',\n",
       " 't\\r\\n    note. dialect and variant spellin',\n",
       " '    note. dialect and variant spellings ',\n",
       " ' note. dialect and variant spellings hav',\n",
       " 'te. dialect and variant spellings have b',\n",
       " ' dialect and variant spellings have been',\n",
       " 'alect and variant spellings have been re',\n",
       " 'ct and variant spellings have been retai',\n",
       " 'and variant spellings have been retained',\n",
       " ' variant spellings have been retained, w',\n",
       " 'riant spellings have been retained, whil',\n",
       " 'nt spellings have been retained, whilst\\r',\n",
       " 'spellings have been retained, whilst\\r\\n  ',\n",
       " 'llings have been retained, whilst\\r\\n    i',\n",
       " 'ngs have been retained, whilst\\r\\n    inco',\n",
       " ' have been retained, whilst\\r\\n    inconsi',\n",
       " 've been retained, whilst\\r\\n    inconsiste',\n",
       " 'been retained, whilst\\r\\n    inconsistent ',\n",
       " 'n retained, whilst\\r\\n    inconsistent hyp',\n",
       " 'etained, whilst\\r\\n    inconsistent hyphen',\n",
       " 'ined, whilst\\r\\n    inconsistent hyphenati',\n",
       " 'd, whilst\\r\\n    inconsistent hyphenation ',\n",
       " 'whilst\\r\\n    inconsistent hyphenation has',\n",
       " 'lst\\r\\n    inconsistent hyphenation has be',\n",
       " '\\r\\n    inconsistent hyphenation has been ',\n",
       " '   inconsistent hyphenation has been sta',\n",
       " 'inconsistent hyphenation has been standa',\n",
       " 'onsistent hyphenation has been standardi',\n",
       " 'istent hyphenation has been standardised',\n",
       " 'ent hyphenation has been standardised. c',\n",
       " ' hyphenation has been standardised. colo',\n",
       " 'phenation has been standardised. color p',\n",
       " 'nation has been standardised. color plat',\n",
       " 'ion has been standardised. color plates ',\n",
       " ' has been standardised. color plates hav',\n",
       " 's been standardised. color plates have\\r\\n',\n",
       " 'een standardised. color plates have\\r\\n   ',\n",
       " ' standardised. color plates have\\r\\n    be',\n",
       " 'andardised. color plates have\\r\\n    been ',\n",
       " 'ardised. color plates have\\r\\n    been rep',\n",
       " 'ised. color plates have\\r\\n    been reposi',\n",
       " 'd. color plates have\\r\\n    been repositio',\n",
       " 'color plates have\\r\\n    been repositioned',\n",
       " 'or plates have\\r\\n    been repositioned ac',\n",
       " 'plates have\\r\\n    been repositioned accor',\n",
       " 'tes have\\r\\n    been repositioned accordin',\n",
       " ' have\\r\\n    been repositioned according t',\n",
       " 've\\r\\n    been repositioned according to t',\n",
       " '\\n    been repositioned according to thei',\n",
       " '  been repositioned according to their c',\n",
       " 'een repositioned according to their capt',\n",
       " ' repositioned according to their caption',\n",
       " 'positioned according to their captions; ',\n",
       " 'itioned according to their captions; the',\n",
       " \"oned according to their captions; the 'c\",\n",
       " \"d according to their captions; the 'colo\",\n",
       " \"ccording to their captions; the 'color p\",\n",
       " \"rding to their captions; the 'color plat\",\n",
       " \"ng to their captions; the 'color plates'\",\n",
       " \"to their captions; the 'color plates'\\r\\n \",\n",
       " \"their captions; the 'color plates'\\r\\n    \",\n",
       " \"ir captions; the 'color plates'\\r\\n    lis\",\n",
       " \"captions; the 'color plates'\\r\\n    listin\",\n",
       " \"tions; the 'color plates'\\r\\n    listing r\",\n",
       " \"ns; the 'color plates'\\r\\n    listing rema\",\n",
       " \" the 'color plates'\\r\\n    listing remains\",\n",
       " \"e 'color plates'\\r\\n    listing remains as\",\n",
       " \"color plates'\\r\\n    listing remains as pr\",\n",
       " \"or plates'\\r\\n    listing remains as print\",\n",
       " \"plates'\\r\\n    listing remains as printed \",\n",
       " \"tes'\\r\\n    listing remains as printed to \",\n",
       " \"'\\r\\n    listing remains as printed to ind\",\n",
       " '    listing remains as printed to indica',\n",
       " ' listing remains as printed to indicate ',\n",
       " 'sting remains as printed to indicate the',\n",
       " 'ng remains as printed to indicate the or',\n",
       " 'remains as printed to indicate the origi',\n",
       " 'ains as printed to indicate the original',\n",
       " 's as printed to indicate the original lo',\n",
       " 's printed to indicate the original locat',\n",
       " 'rinted to indicate the original location',\n",
       " 'ted to indicate the original locations.\\r',\n",
       " ' to indicate the original locations.\\r\\n\\r\\n',\n",
       " ' indicate the original locations.\\r\\n\\r\\n\\r\\n\\r',\n",
       " 'dicate the original locations.\\r\\n\\r\\n\\r\\n\\r\\n\\r\\n',\n",
       " 'ate the original locations.\\r\\n\\r\\n\\r\\n\\r\\n\\r\\ncon',\n",
       " ' the original locations.\\r\\n\\r\\n\\r\\n\\r\\n\\r\\nconten',\n",
       " 'e original locations.\\r\\n\\r\\n\\r\\n\\r\\n\\r\\ncontents\\r',\n",
       " 'riginal locations.\\r\\n\\r\\n\\r\\n\\r\\n\\r\\ncontents\\r\\n\\r\\n',\n",
       " 'inal locations.\\r\\n\\r\\n\\r\\n\\r\\n\\r\\ncontents\\r\\n\\r\\n\\r\\n ',\n",
       " 'l locations.\\r\\n\\r\\n\\r\\n\\r\\n\\r\\ncontents\\r\\n\\r\\n\\r\\n    ',\n",
       " 'ocations.\\r\\n\\r\\n\\r\\n\\r\\n\\r\\ncontents\\r\\n\\r\\n\\r\\n       ',\n",
       " 'tions.\\r\\n\\r\\n\\r\\n\\r\\n\\r\\ncontents\\r\\n\\r\\n\\r\\n          ',\n",
       " 'ns.\\r\\n\\r\\n\\r\\n\\r\\n\\r\\ncontents\\r\\n\\r\\n\\r\\n             ',\n",
       " '\\r\\n\\r\\n\\r\\n\\r\\n\\r\\ncontents\\r\\n\\r\\n\\r\\n                ',\n",
       " '\\n\\r\\n\\r\\n\\r\\ncontents\\r\\n\\r\\n\\r\\n                   ',\n",
       " '\\r\\n\\r\\ncontents\\r\\n\\r\\n\\r\\n                      ',\n",
       " '\\ncontents\\r\\n\\r\\n\\r\\n                         ',\n",
       " 'ntents\\r\\n\\r\\n\\r\\n                            ',\n",
       " 'nts\\r\\n\\r\\n\\r\\n                               ',\n",
       " '\\r\\n\\r\\n\\r\\n                                  ',\n",
       " '\\n\\r\\n                                     ',\n",
       " '                                        ',\n",
       " '                                        ',\n",
       " '                                        ',\n",
       " '                                        ',\n",
       " '                                        ',\n",
       " '                                        ',\n",
       " '                                        ',\n",
       " '                                        ',\n",
       " '                                     pag',\n",
       " '                                  page\\r\\n',\n",
       " '                               page\\r\\n _t',\n",
       " '                            page\\r\\n _to t',\n",
       " '                         page\\r\\n _to the ',\n",
       " '                      page\\r\\n _to the hes',\n",
       " '                   page\\r\\n _to the hesita',\n",
       " '                page\\r\\n _to the hesitatin',\n",
       " '             page\\r\\n _to the hesitating p',\n",
       " '          page\\r\\n _to the hesitating purc',\n",
       " '       page\\r\\n _to the hesitating purchas',\n",
       " '    page\\r\\n _to the hesitating purchaser_',\n",
       " ' page\\r\\n _to the hesitating purchaser_   ',\n",
       " 'ge\\r\\n _to the hesitating purchaser_      ',\n",
       " '\\n _to the hesitating purchaser_         ',\n",
       " 'to the hesitating purchaser_            ',\n",
       " 'the hesitating purchaser_               ',\n",
       " ' hesitating purchaser_                  ',\n",
       " 'sitating purchaser_                     ',\n",
       " 'ating purchaser_                        ',\n",
       " 'ng purchaser_                           ',\n",
       " 'purchaser_                             _',\n",
       " 'chaser_                             _vii',\n",
       " 'ser_                             _viii_\\r',\n",
       " '_                             _viii_\\r\\n _',\n",
       " '                           _viii_\\r\\n _lis',\n",
       " '                        _viii_\\r\\n _list o',\n",
       " '                     _viii_\\r\\n _list of c',\n",
       " '                  _viii_\\r\\n _list of colo',\n",
       " '               _viii_\\r\\n _list of color p',\n",
       " '            _viii_\\r\\n _list of color plat',\n",
       " '         _viii_\\r\\n _list of color plates_',\n",
       " '      _viii_\\r\\n _list of color plates_   ',\n",
       " '   _viii_\\r\\n _list of color plates_      ',\n",
       " '_viii_\\r\\n _list of color plates_         ',\n",
       " 'ii_\\r\\n _list of color plates_            ',\n",
       " '\\r\\n _list of color plates_               ',\n",
       " '_list of color plates_                  ',\n",
       " 'st of color plates_                     ',\n",
       " 'of color plates_                        ',\n",
       " 'color plates_                           ',\n",
       " 'or plates_                              ',\n",
       " ...]"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "sentences"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Vectorization...\n"
     ]
    }
   ],
   "source": [
    "print('Vectorization...')\n",
    "x = np.zeros((len(sentences), maxlen, len(chars)), dtype=np.bool)\n",
    "y = np.zeros((len(sentences), len(chars)), dtype=np.bool)\n",
    "for i, sentence in enumerate(sentences):\n",
    "    for t, char in enumerate(sentence):\n",
    "        x[i, t, char_indices[char]] = 1\n",
    "    y[i, char_indices[next_chars[i]]] = 1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(132454, 40, 60)"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "x.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(132454, 60)"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "y.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The dummy variables for $y$ are shown below."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False,  True, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False],\n",
       "       [False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False,  True, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False],\n",
       "       [False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False,  True, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False],\n",
       "       [False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False,  True, False],\n",
       "       [False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False,  True, False, False, False, False, False,\n",
       "        False, False, False, False, False, False],\n",
       "       [False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False,  True, False, False,\n",
       "        False, False, False, False, False, False],\n",
       "       [False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "         True, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False],\n",
       "       [False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False,  True, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False],\n",
       "       [False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False,  True, False,\n",
       "        False, False, False, False, False, False],\n",
       "       [False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False, False, False, False, False, False, False, False, False,\n",
       "        False,  True, False, False, False, False]])"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "y[0:10]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Next, we create the neural network.  The primary feature of this neural network is the LSTM layer.  This allows the sequences to be processed.  "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Build model...\n"
     ]
    }
   ],
   "source": [
    "# build the model: a single LSTM\n",
    "print('Build model...')\n",
    "model = Sequential()\n",
    "model.add(LSTM(128, input_shape=(maxlen, len(chars))))\n",
    "model.add(Dense(len(chars), activation='softmax'))\n",
    "\n",
    "optimizer = RMSprop(lr=0.01)\n",
    "model.compile(loss='categorical_crossentropy', optimizer=optimizer)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Model: \"sequential\"\n",
      "_________________________________________________________________\n",
      "Layer (type)                 Output Shape              Param #   \n",
      "=================================================================\n",
      "lstm (LSTM)                  (None, 128)               96768     \n",
      "_________________________________________________________________\n",
      "dense (Dense)                (None, 60)                7740      \n",
      "=================================================================\n",
      "Total params: 104,508\n",
      "Trainable params: 104,508\n",
      "Non-trainable params: 0\n",
      "_________________________________________________________________\n"
     ]
    }
   ],
   "source": [
    "model.summary()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The LSTM will produce new text character by character.  We will need to sample the correct letter from the LSTM predictions each time.  The **sample** function accepts the following two parameters:\n",
    "\n",
    "* **preds** - The output neurons.\n",
    "* **temperature** - 1.0 is the most conservative, 0.0 is the most confident (willing to make spelling and other errors).\n",
    "\n",
    "The sample function below is essentially performing a [softmax]() on the neural network predictions.  This causes each output neuron to become a probability of its particular letter.  "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "def sample(preds, temperature=1.0):\n",
    "    # helper function to sample an index from a probability array\n",
    "    preds = np.asarray(preds).astype('float64')\n",
    "    preds = np.log(preds) / temperature\n",
    "    exp_preds = np.exp(preds)\n",
    "    preds = exp_preds / np.sum(exp_preds)\n",
    "    probas = np.random.multinomial(1, preds, 1)\n",
    "    return np.argmax(probas)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "def on_epoch_end(epoch, _):\n",
    "    # Function invoked at end of each epoch. Prints generated text.\n",
    "    print(\"****************************************************************************\")\n",
    "    print('----- Generating text after Epoch: %d' % epoch)\n",
    "\n",
    "    start_index = random.randint(0, len(processed_text) - maxlen - 1)\n",
    "    for temperature in [0.2, 0.5, 1.0, 1.2]:\n",
    "        print('----- temperature:', temperature)\n",
    "\n",
    "        generated = ''\n",
    "        sentence = processed_text[start_index: start_index + maxlen]\n",
    "        generated += sentence\n",
    "        print('----- Generating with seed: \"' + sentence + '\"')\n",
    "        sys.stdout.write(generated)\n",
    "\n",
    "        for i in range(400):\n",
    "            x_pred = np.zeros((1, maxlen, len(chars)))\n",
    "            for t, char in enumerate(sentence):\n",
    "                x_pred[0, t, char_indices[char]] = 1.\n",
    "\n",
    "            preds = model.predict(x_pred, verbose=0)[0]\n",
    "            next_index = sample(preds, temperature)\n",
    "            next_char = indices_char[next_index]\n",
    "\n",
    "            generated += next_char\n",
    "            sentence = sentence[1:] + next_char\n",
    "\n",
    "            sys.stdout.write(next_char)\n",
    "            sys.stdout.flush()\n",
    "        print()\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We are now ready to train.  It can take up to an hour to train this network, depending on how fast your computer is.  If you have a GPU available, please make sure to use it."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train on 132454 samples\n",
      "Epoch 1/60\n",
      "132224/132454 [============================>.] - ETA: 0s - loss: 2.0288****************************************************************************\n",
      "----- Generating text after Epoch: 0\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \" at one side of the\n",
      "companion; sometime\"\n",
      " at one side of the\n",
      "companion; sometime and the shortor of the porting to the postor to the portor the could the porting the bostor his could not the coptain of the shorters in the partion to the porting to the postor to the shorting and the said the doctor and the shorth and the portor to the porters of the shorter and a man to the porting to the said the shorter the shorting the shorting to the doctor to the porting to the prose to t\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \" at one side of the\n",
      "companion; sometime\"\n",
      " at one side of the\n",
      "companion; sometime of the meart. string a sinterone for the shorter as deed to the sand word a phind of the poution a shimbor with the courd a rest of the shorting to the bother my reprose to the looked a shall the last to the pound, and if the dast of the shippeations and the postain to the shorting to the preather to the postor here a mone the dowred. i was it the coustring the louther here there the captain and \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \" at one side of the\n",
      "companion; sometime\"\n",
      " at one side of the\n",
      "companion; sometime of the\n",
      "crouse. rother, and not i touch dove. and light in the vortin.\n",
      "\"whow\" not wanched the shorgeining an the chusines we was a bestrion man a mantinf in a mhes of a the forting. well me to my dostiel to g\n",
      "enting sitver was set:\"\n",
      "\n",
      "\"asle, wild werritterwing of to the hame uarinto to memand, evers. i\n",
      "hadd hee a lood ald silved voowing ravinion my for a cexset, dome postaritins ay round the \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \" at one side of the\n",
      "companion; sometime\"\n",
      " at one side of the\n",
      "companion; sometime.\n",
      "\n",
      "munk an] tod\n",
      "tilvul inty but loaght no mutery. whictlesss.-u.        fl\n",
      "cat and setan and aray, we lamagitifly, they capbairs. now int'wasleft brough upon to dill\n",
      "encecfra-gunt, ag, nothe cotse toe his mon to gon,--a wnother egerrf to gite\n",
      "of combert. \n",
      "\n",
      "  ounours; and togetquhing well a _\"eredgen ragion, as thore. \"holled he juctirves ro--yo.\n",
      "requidion\n",
      "rives. hat i'mlilt. o\" other forc\n",
      "132454/132454 [==============================] - 124s 932us/sample - loss: 2.0285\n",
      "Epoch 2/60\n",
      "132352/132454 [============================>.] - ETA: 0s - loss: 1.6551****************************************************************************\n",
      "----- Generating text after Epoch: 1\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"f men.\n",
      "\n",
      "\"ay, but you see,\" returned be\"\n",
      "f men.\n",
      "\n",
      "\"ay, but you see,\" returned bet i had the house, and the cold the hould rearess of the captain. i had a start of the cops and the cold was not of the cold the to the cold the collort of the cold the cold had a strang and the house. i had a should have had a should have had a should the colling of the cold of the collore of the cold the cold the colling of the collor and the collore of the captain to the project gutenberg the c\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"f men.\n",
      "\n",
      "\"ay, but you see,\" returned be\"\n",
      "f men.\n",
      "\n",
      "\"ay, but you see,\" returned be this mouth. i had bear the plood had a greep and the out of the captain. the cops and a prope a should the condory that was strong to the hould the only to the captain a should. he had to the should raned along the come all was stell a should have could be himself along that is a should had be the houd hear of it of the called into the round the companing and the captains and the park of the capt\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"f men.\n",
      "\n",
      "\"ay, but you see,\" returned be\"\n",
      "f men.\n",
      "\n",
      "\"ay, but you see,\" returned be for the pistor, or to our shay of the colen in and comings bun a hold though way gaying you it, than up, then with moutht, it trwen acvoud don inot warefoly ppwole steed left doctly bix like heonerhor captainss of me to\n",
      "prow on\n",
      "though the hads ayd\n",
      "undil kible,\n",
      "the sure, one hore villed me the pxire re--you maded frough his sand, with his goedes was a little to the pinjet. it on ith along the \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"f men.\n",
      "\n",
      "\"ay, but you see,\" returned be\"\n",
      "f men.\n",
      "\n",
      "\"ay, but you see,\" returned bet rean a coupser, huqh had\n",
      "eyes of the koochaillith! an\n",
      "rufate helpen, and seartiis through head,\n",
      "a, hear\n",
      "we ares, and stays we what, pipk rad bring thauthps. iffollet,\" yathin.\n",
      "\n",
      "you've s ell scooned starp rrsaliits huarbeissh gnoon carcoonstmend capin, know rown tripuitistll of of. anrosted tack it agition to hout bogyon roa.\n",
      "eath with a goeds, that through uperus, whre hut\n",
      "strang vious i\n",
      "132454/132454 [==============================] - 121s 911us/sample - loss: 1.6551\n",
      "Epoch 3/60\n",
      "132096/132454 [============================>.] - ETA: 0s - loss: 1.5419****************************************************************************\n",
      "----- Generating text after Epoch: 2\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \" with which john avowed his knowledge of\"\n",
      " with which john avowed his knowledge of the starn and stands and so the stard and stand of the captain of the more to got of the starn of the starn of the story of the starn of the starp of the captain of the ship and the start of the starn of the start of the come of the starn of the starn of the starn of the captain of the cortain of the said of the cortain of the starn of the cortain of the man that we was a sundoned the sure of the\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \" with which john avowed his knowledge of\"\n",
      " with which john avowed his knowledge of for that the copy and the old only starn on the spires, that i had man and felly, and the coming of the mearent of brist was let the fit in the all me to good come and spit of hand of the barress, and my storage from my man and starpward with the starn, and to\n",
      "hand. i was a moment in my flustre upon the stat upon him was a like and a good said it incentroy, had something of the soul. and i sure \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \" with which john avowed his knowledge of\"\n",
      " with which john avowed his knowledge of\n",
      "cancs id hure, cut of my stand the it to bread and in with new cutloweter.\n",
      "\n",
      "\"that's lust one abavist,\"\n",
      "\n",
      "\"goo 1ut know you?\"\n",
      "\n",
      "abage all as, and\n",
      "no. abother hands, of our inagrained promr,\n",
      "that left this sleed had trecurate the\n",
      "most more-finsment\n",
      "and buving to fien          ad abottp, buccler all thlum caming\n",
      "gentlack with treemy surtil to the firensst man lay the tan! cabin despy stuld\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \" with which john avowed his knowledge of\"\n",
      " with which john avowed his knowledge of the knany with worts or for. sure in him to comlonay.\"\n",
      "\n",
      "idveard any commopys\n",
      "and fllidon, which or a gives\n",
      "; tell, that, doctor\n",
      "liveder\n",
      "old sailinafaged and hear the our going pechsed\n",
      "cresse, my retbe\n",
      "salery the drand jim\n",
      "fins maged.\n",
      "\n",
      "this i out we wauth cutly no,\n",
      "the kindshemer thraid\n",
      "not with the tarred oms,\" said is's day.\"\n",
      "\n",
      "the\n",
      "captain. this branly--you way. i have\n",
      "for youbhe\n",
      "132454/132454 [==============================] - 120s 908us/sample - loss: 1.5419\n",
      "Epoch 4/60\n",
      "131840/132454 [============================>.] - ETA: 0s - loss: 1.4768****************************************************************************\n",
      "----- Generating text after Epoch: 3\n",
      "----- temperature: 0.2\n",
      "\"---- Generating with seed: \"randy, blockhouse, the firewood you was\n",
      "randy, blockhouse, the firewood you was\n",
      "the captain, and the captain. i was the ship was the shore of the black of the captain, and the captain, and the shoulder to the captain, and the shore to the captain. the ship was the shore of the captain. the shoulder the captain, and the shoulder of the searter the captain. the captain, and the ship was a doctor livesey and the story. and the chart of the captain, and the randle of the searted\n",
      "----- temperature: 0.5\n",
      "\"---- Generating with seed: \"randy, blockhouse, the firewood you was\n",
      "randy, blockhouse, the firewood you was\n",
      "the wattering.\n",
      "\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\"ill, i was the fee out and a screte in a mine and i seamen that i to deserved the fire but a ship, and the cattle had so a sooned the captain, and the chair of the said. and the sharm from the ship, and cap'abess was dear and found to the captain. the man and leaming and been the most cappaided in the shore of the shore of dontorth was so the stood instation and so the shoulder\n",
      "----- temperature: 1.0\n",
      "\"---- Generating with seed: \"randy, blockhouse, the firewood you was\n",
      "randy, blockhouse, the firewood you was\n",
      "you of as het for yout comest, and dit; and so on up; \"in island can.\"\n",
      "\n",
      "i don't ceared the poor otherg. but the ladass were my weated you nick wet ma, to that this word, and an water to\" at were it with onice.\n",
      "itped aroped more with a made icked looks, had\n",
      "be theselt, and he had gave youriogs to the morthera tumbo pmoked of\n",
      "which get hung st leaving out\n",
      "of a great   saddgums\n",
      "instreasure, o\n",
      "----- temperature: 1.2\n",
      "\"---- Generating with seed: \"randy, blockhouse, the firewood you was\n",
      "randy, blockhouse, the firewood you was\n",
      "obcoonboornledifnat his froven---as so so one upsails the camble is and upon when the\n",
      "give alavove--a\n",
      "thought byintt grayss; whathing thranugass and kind, the now! in coping e pictured, over, the distainons with the.\n",
      "\n",
      "where we. with anhow watift, met--at bigsehing had by his dead. when fill fenious\n",
      "never\n",
      "we were heaphhed. \n",
      "\n",
      "     \"after--i as the which of wad a blinded. ever's junewratch c\n",
      "132454/132454 [==============================] - 105s 792us/sample - loss: 1.4769\n",
      "Epoch 5/60\n",
      "132096/132454 [============================>.] - ETA: 0s - loss: 1.4353****************************************************************************\n",
      "----- Generating text after Epoch: 4\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"r the names of\n",
      "ships or towns that they\"\n",
      "r the names of\n",
      "ships or towns that they were a little and the drat of the captain, when the captain, and there was a little and all of the same there was a little and the captain and all of the captain.\n",
      "\n",
      "\"i do have a stockade and the shore of a both of the shore of the shore or the captain. and there was a strange and the captain. i say there was a man and the colors and all of the captain. i was not he was to see the colors and the \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"r the names of\n",
      "ships or towns that they\"\n",
      "r the names of\n",
      "ships or towns that they walk was a little was the swands in his astand, and i had come and all had straight\n",
      "his broker i clame and one the shore together, and there was so that i shoulder up in the morn the looks, was he had each of the ship were and soon all of the shore, we must rather at the witsern of the boat was he three of this eating, and there was on the foundation, and drange shoulder in the long of the spot,\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"r the names of\n",
      "ships or towns that they\"\n",
      "r the names of\n",
      "ships or towns that they were\n",
      "loowed the time the mutherst; and not ong fulless about about heur\n",
      "says, were garned, and hattked it\n",
      "you\n",
      "say, was. ajout his\n",
      "possed in the ward of hand        just croossween. as i thought the wipsibl\n",
      "money?\" he added it with little me, and set were in\n",
      "starines merede to dack by forgot, my\n",
      "hoor some nearest viet raws carrention of\n",
      "his\n",
      "flood, worse shone graving thrown the\n",
      "evenitio\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"r the names of\n",
      "ships or towns that they\"\n",
      "r the names of\n",
      "ships or towns that they knew nor graluined\n",
      "chries, and no snehituly windly tent aisteed his powstide excecktly\n",
      "to the man, you\n",
      "hangs, walk when i slare you archon eye giving plastioned holder,\n",
      "from hon. did loidh hishon\n",
      "us;\n",
      "but swobers; there--l knop! b'lfut.\"\n",
      "\n",
      " do\n",
      "drunging on the foun on trickl you aging i spoil pary smiss ruchleded o' briskly over oflthers, that gent offs faller barbos to myne--the whore\n",
      ", h\n",
      "132454/132454 [==============================] - 109s 825us/sample - loss: 1.4354\n",
      "Epoch 6/60\n",
      "132096/132454 [============================>.] - ETA: 0s - loss: 1.4027****************************************************************************\n",
      "----- Generating text after Epoch: 5\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"han convinced.\n",
      "\n",
      "\"slow, lad, slow,\" he \"\n",
      "han convinced.\n",
      "\n",
      "\"slow, lad, slow,\" he cried. \"i can to the stockade, and the copiness to the pire, and the posset of the bottle and the stockade, and the stoor the project gutenberg-tm with a mile and in the stick of the project gutenberg-tm ey my hand of the copsining the particular been store of the captain. some to the stockade, and the sure, and the bottle with a man and the captain to the captain stopped to the pipe of the captai\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"han convinced.\n",
      "\n",
      "\"slow, lad, slow,\" he \"\n",
      "han convinced.\n",
      "\n",
      "\"slow, lad, slow,\" he can done my ship. i time my sea-cook ming of the doctor, and the same but his swinging the house.\n",
      "\n",
      "\"well, the captain, \"they won't we been a captain. \"the islan, the stip of the captain at the particulad rus seaman and was powring the possed a man to his said of the captain to the continues of the postor and the captain round the bottle, and the parror of the boats of the word of the words the p\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"han convinced.\n",
      "\n",
      "\"slow, lad, slow,\" he \"\n",
      "han convinced.\n",
      "\n",
      "\"slow, lad, slow,\" he case till it, care, with palling dis!\n",
      "retwing thoughting beninging to not beat\n",
      "comingoating the rote now, with a gwell-furting in with dost relawver, reddy companions probate, as marks, on the woselt betting in propray never the\n",
      "wooding rounds must capen a side, and cointed stotine, you misst like illinedidge,\" thought with the cotiwites. for sown, under the\n",
      "words of the brooming about with an\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"han convinced.\n",
      "\n",
      "\"slow, lad, slow,\" he \"\n",
      "han convinced.\n",
      "\n",
      "\"slow, lad, slow,\" he concieved, dis's ma; there you demenhertandhor nices.\"\n",
      "\n",
      "\"will very hearty way, aothed betserday he beranded that trewule, very fir heard tile clo, he had captring and how bus some timicion to over i could. well, soin, time s'ow--stilvingon, if your mast, now. a sa; cavinaby thein round he was  the had into the weh with a sbuht disecoons;lidied my eyes threp\n",
      "bent dirtients.\n",
      "\n",
      "\"the tan to save m\n",
      "132454/132454 [==============================] - 115s 869us/sample - loss: 1.4028\n",
      "Epoch 7/60\n",
      "132352/132454 [============================>.] - ETA: 0s - loss: 1.3801****************************************************************************\n",
      "----- Generating text after Epoch: 6\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"t only a single shot had been fired. it \"\n",
      "t only a single shot had been fired. it was the place that i say and stept the ship with the shoulder of the boat and speaked and the words was a sound the treasure was step and sterned the shoulder and the strong the ship was stepped and the shore of the first and the stranger was a state of the captain says you was get a ship of the shore and the shore and the shore and bet a stern the shore, and the shore with the shoulder and the st\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"t only a single shot had been fired. it \"\n",
      "t only a single shot had been fired. it was the lows--the fire from the curture ward\n",
      "spin to the captain was blays and were that brought book and be the first boys was a fine that had\n",
      "not my great captain smollett and livesey were a sold of the swore and spines--tressreased a wind of the right and the father of the better and the spoke, and when i could not up of it, and shall the blockhouse they was reast have been come and steeply c\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"t only a single shot had been fired. it \"\n",
      "t only a single shot had been fired. it comed ungs with our down themjflooss the drink ran of reingly--me\n",
      "is darem that's stolleh\n",
      "and six came its to\n",
      "gorey rebressel sirge.\n",
      "\n",
      "i wind be law, more aloved\n",
      "and blow, and beliel tallow arounderss to that mains, as is do took i a cabine, \"deal and where him, grewn himmed,\" ard dyind the sked truman brown. as as crew. we be hand, comenge that com; and i'll fave yat. and notherstay had, and\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"t only a single shot had been fired. it \"\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "t only a single shot had been fired. it wasted paised the falt--\"i who the he, but it was thet'if thisg that\n",
      "sill. last hap.\n",
      "\n",
      "s sitt, liveden, thin. had hit skips.\"\n",
      "\n",
      "and thes west\n",
      "ware, where\n",
      "when, a cload to the liddnout, i !r iffain a giveser\n",
      "oard, weth, though\n",
      "rehowared, she dih mofe, to kee that  currel best\n",
      "a newfore,\" cried liked.\n",
      "\n",
      "\"ahal man's loger half.\"\n",
      "\n",
      "\"gutai'ed, pershing sayoning you, reashifg lyest\n",
      "thatfoe\n",
      "b\n",
      "132454/132454 [==============================] - 118s 889us/sample - loss: 1.3801\n",
      "Epoch 8/60\n",
      "131968/132454 [============================>.] - ETA: 0s - loss: 1.3613****************************************************************************\n",
      "----- Generating text after Epoch: 7\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \" and my heart jumped against my ribs. th\"\n",
      " and my heart jumped against my ribs. the streather the captain, when i was so long and the stranger and the strong of the stranger and the stranger and the stockade, and the boat and the captain spide of the stranger and the stranger and the struck was the captain and a stockade, and the strong his long and some the whole was the captain and the boat and the strong to the stranger and stranger and the stranger and the captain and the c\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \" and my heart jumped against my ribs. th\"\n",
      " and my heart jumped against my ribs. the must companion, and some captain spound his face, i was one an \n",
      "medic began to see the stockade, and we were only a betis going me long been bear and fine deared on the remurn of the particulal was wanted the ship in the barristing and the barsess of the captain and i could have been the hand of the stockade, and the plusk and the found the captain. the deck, and a big of the stockade, and the \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \" and my heart jumped against my ribs. th\"\n",
      " and my heart jumped against my ribs. there with their me's\n",
      "while\n",
      "silver's star.\"\n",
      "\n",
      "just i sailing that were aboard looked. and ears.\n",
      "\n",
      "                     the islet all was likely, which had thongers, inclingss three me, put in a\n",
      "niles, the bark and you can dewed a thing boar's bell doctor onor, at he had do oor fine than, the cook, and i though i canetule and the atrass with the cried, for they and serter fan to be am on to the \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \" and my heart jumped against my ribs. th\"\n",
      " and my heart jumped against my ribs. this stands at woke\n",
      "moonterrally wer like--no\" i were heaviendpated\n",
      "they wast, i was suonen the whoph in the har elect on shoress, with sec outing round in the cruach\n",
      "like, that\n",
      "upithg; the cried, whichway ?junct they take the doctor cacemet his hand our s. one\n",
      "viinet couply--heard a ceres given appsressed thoughwwellly cook me. in\n",
      "      that coxlaud by nemilled jans--and my upon buting his sc\n",
      "132454/132454 [==============================] - 113s 853us/sample - loss: 1.3615\n",
      "Epoch 9/60\n",
      "132352/132454 [============================>.] - ETA: 0s - loss: 1.3443****************************************************************************\n",
      "----- Generating text after Epoch: 8\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"he been on deck he could no longer so mu\"\n",
      "he been on deck he could no longer so much and down to the stranger was some of the stockade, and the stranger with a start of the captain was the captain and down the stockade, and at the stockade, and the stockade, and the same the stockade, and the same his crutch and were a stranger that was the stockade, and a start of the stockade, and a stop and down and the same mineder and the sure, and the same men had a come of the captain wa\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"he been on deck he could no longer so mu\"\n",
      "he been on deck he could no longer so much all my eyes as all and the same foot of the barrow had a poor pirate and pipe, and i was in the was nine was a man to have had\n",
      "not be wark of the in the stranger with a speak of this still in the captain was this was the possection had as was the captain was so for the stockade, and a some hand and stares a little project gutenberg-tm electronic works the south. as we was soon a close and man \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"he been on deck he could no longer so mu\"\n",
      "he been on deck he could no longer so much anoun   as the last after reamhnioled me in the neither in that\n",
      "rester raved anyone john our ilafens, and to the moldings of the hall,\n",
      "and i\n",
      "said when the captores had sudged on hebowsiin by front of could quict,\n",
      "so ver; and it had beened\n",
      "right decked when i had nots lease, with the mouse--accomp of the mouth grownh wim take\n",
      "away, it was we could not our side eoasune little\n",
      "such all thin\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"he been on deck he could no longer so mu\"\n",
      "he been on deck he could no longer so much wogkeds a fre acradion aem having\n",
      "han\"\n",
      "\n",
      "\"xcurilal board the cook out concurint kept were roat fine pared\n",
      "shipce had sure, again; a     behind vite of afrernkened, at the money. the strink\n",
      "with wet less.\n",
      "\n",
      "whistleland, is, ohhing. the south cab\n",
      "tite med that was blamed at enter, and cough twhe\n",
      "nose with a waed of cliadhass from\n",
      "so crew 'em, but in our stard, one of me, awalwy attlas, wi\n",
      "132454/132454 [==============================] - 90s 677us/sample - loss: 1.3442\n",
      "Epoch 10/60\n",
      "131968/132454 [============================>.] - ETA: 0s - loss: 1.3299****************************************************************************\n",
      "----- Generating text after Epoch: 9\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"nough, and more than enough, for both of\"\n",
      "nough, and more than enough, for both of the stranger with the stranger was so the stranger with a stranger and the stranger was the stranger to the stranger was the stranger and the stranger with a sure, and a sound the stockade and the seamant of the stockade and the stockade and the stranger was the stranger was the stranger to the stranger to the stockade and the stockade and the stranger was a sound the stockade and the stockade an\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"nough, and more than enough, for both of\"\n",
      "nough, and more than enough, for both of a steady of the corner of the seaman that i seemed to the stranger, when i had cable the safe and the sign and be the project gutenberg-tm the stockade of the seamant of the side of\n",
      "tries.\n",
      "\n",
      "\"why, you dare you and this sound the trees of the blockhouse surpol the captain, but the two would comply and the spot the door\n",
      "and the stranger's states and the way and bear.\"\n",
      "\n",
      "we were not be coast out\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"nough, and more than enough, for both of\"\n",
      "nough, and more than enough, for both of i was our feet\n",
      "so give up to project gutenberg-tm elljous is\n",
      "not beevoved. i ho'd him you\n",
      "sound up\n",
      "other, to there.\"\n",
      "\n",
      "\"why, when i condeed\n",
      "again, on you surfeakle for the crapped reckon the dwatige heard on the carrain swor barse. i'll take do \"firebut you, but\n",
      "you dragey, but you don't be oken don't of them into these evenin the\n",
      "coan of the\n",
      "distow for chiem of fall goa manterx monat, w\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"nough, and more than enough, for both of\"\n",
      "nough, and more than enough, for both of this\n",
      "go implate pigat masigge hat up the word. i'm potuty! you\n",
      "\n",
      "eep,\" said the lagkerci wat of bess\n",
      "informagiol knething us; if a\n",
      "suspaniol man among the trwack near groadime. i'll\n",
      "oat'll thundered so\n",
      "dook to be sight up mr.s, clos;ane at an outh. ji,, if d\n",
      "pluty apmedationaled graywhen ofly. or to ?hard whiad furise, and that  eyeisuce, this\n",
      "maje.c.\n",
      "\n",
      "\"world,\" cried, you've of them,\" s\n",
      "132454/132454 [==============================] - 104s 783us/sample - loss: 1.3300\n",
      "Epoch 11/60\n",
      "132352/132454 [============================>.] - ETA: 0s - loss: 1.3234****************************************************************************\n",
      "----- Generating text after Epoch: 10\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"he owner of the project gutenberg-tm tra\"\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "he owner of the project gutenberg-tm trademark of the captain of the ship of the stockade, and the stranger of the stockade, and the stranger was stranged the shout the ship of the stockade, and was sent the shout the captain stranged him of the shoulders was a sunder, and the ship of the stockade, and the stockade, and the captain spot the shore.\n",
      "\n",
      "\"than since and the ship of the ship was the stranger was a sent that was a same brisk \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"he owner of the project gutenberg-tm tra\"\n",
      "he owner of the project gutenberg-tm trads, and had been same him on the captain. i had camped to the worst of the stockade, and the\n",
      "books sure, a poor and the\n",
      "himself, and a little ship of a pales of which was still to and a came in was stranged all the first day, and so string of the stockade, and saw interrant the south and find the coxswain\n",
      "at the ship island. and a going of the pirecle\n",
      "of the shout, and a good at an out as a co\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"he owner of the project gutenberg-tm tra\"\n",
      "he owner of the project gutenberg-tm trading colors.\n",
      "\n",
      "\"there wever flint, let her. too much. the hogers page und berouch of the\n",
      "homs\n",
      "shipmanes. the cowal. sil, to fich oping\n",
      "like betteray themo-can just. the natoo and our off the mothes\n",
      "or ingrood about\n",
      "all me was in the\n",
      "brangry,\"\n",
      "pothed every loudly made the worst\n",
      "of the loughern be-alin, a bud or long becredse.\"\n",
      "\n",
      "\"than in stranges,\" he said dowreder, but the goints indeply\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"he owner of the project gutenberg-tm tra\"\n",
      "he owner of the project gutenberg-tm tradant,\n",
      "excmest down a\n",
      "prove gash oping about. but spot his hores over, disk madry no for\n",
      "darri pluted.\n",
      "\n",
      "as sigled a isol. he was fouls gety\n",
      "an overngglited galllesh after was ever brenks loopy, cap't.\"\n",
      "\n",
      "you call you. difm the door, hended whill the loolivid. atnansw\n",
      "speachs shrowded mea, placiatensitausinn to at i touch a\n",
      "truatu. the chonce reasors waring seaning these brind; the next wei\n",
      "132454/132454 [==============================] - 90s 681us/sample - loss: 1.3234\n",
      "Epoch 12/60\n",
      "131968/132454 [============================>.] - ETA: 0s - loss: 1.3104****************************************************************************\n",
      "----- Generating text after Epoch: 11\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"\n",
      "wild duck flew up with a quack, anothe\"\n",
      "\n",
      "wild duck flew up with a quack, another her shot and the barrow of the colors as a sea about the sure, and the south where the word of the colors and the boat as a sunder at the sure in the ship and the south and the stranger they were and the stranger and the wood of the stranger of the cook and the boat of the cook and the boat of the words of the same moment on the words of the sea-carror, and i was the sure the captain spoke and t\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"\n",
      "wild duck flew up with a quack, anothe\"\n",
      "\n",
      "wild duck flew up with a quack, another long again the coard across the farath of the ship at the gaing colors it was the boince, and a cook and the boats at the sign and they had till they cold his concecting her a treature and done and pleed into the back of the cook at the house, and here the bright of the trees.\n",
      "\n",
      "\"ay, who they here,\" said he, \"peosites, \"you along as you would have say silver,\" says he. \"you see, and you should \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"\n",
      "wild duck flew up with a quack, anothe\"\n",
      "\n",
      "wild duck flew up with a quack, another likewamy of brandy, \"wher the blockhouse, abraiu began to his face is the word the sured upor entherate\n",
      "_here trees. it was discher, whed, they call yournike man his men,\" seightring ris. \"here, sir, as you. in a brave of akes. it was glin'ted me to the ceet sage out.\n",
      "\n",
      "\"that's wa\n",
      "drew john; i'll ride, one of their alrow,\" spy,\n",
      "    wethersh with a return of the more.\n",
      "\n",
      "you kitt, after be an\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"\n",
      "wild duck flew up with a quack, anothe\"\n",
      "\n",
      "wild duck flew up with a quack, another, whith was drood and there alloweickett under, at last of surp together looked at lead down roinary, goth it grark,\n",
      "apoveders air's recimply of armanders; but put the brangy\n",
      "and accordgating mate hands agres,\n",
      "roadh, ib worse, along\n",
      "my. you see a port up by it, ay, monest plain--shand\n",
      "the sworntigg and daym angainly fro, you\n",
      "way you--now oney bealore-tw choofscmes; farryey how they verige, \n",
      "132454/132454 [==============================] - 89s 669us/sample - loss: 1.3105\n",
      "Epoch 13/60\n",
      "132352/132454 [============================>.] - ETA: 0s - loss: 1.3038****************************************************************************\n",
      "----- Generating text after Epoch: 12\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \" the print of many feet; and an empty bo\"\n",
      " the print of many feet; and an empty both hands a sure the trees of the shore-hands and the boat, and the sure the stockade, and the sure of the stockade, and the sures of the southes to the stockade, and the strange of the sign of the same man the same time and the sure to the broad of his shoulder the stockade, and had the blows.\n",
      "\n",
      "\"well, sir,\" said the captain. \"well, sir,\" said the captain. \"i've see the same man of the stockade, \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \" the print of many feet; and an empty bo\"\n",
      " the print of many feet; and an empty bound and or on burning of currecter between with an old stark as we had been been were right to the captain with a surpaces of far man the stockade, as he had sure the cook.\n",
      "\n",
      "\"good and i'll be were something to see sir, with the man had sure me and the single and shipped by\n",
      "glost of a hone came to him at the strong the dirach was were and come of the spoke out of his ware to the pickle of his wa\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \" the print of many feet; and an empty bo\"\n",
      " the print of many feet; and an empty bost; and the rot as hid here beuth. once. the dead disgreantation with forn cornceupernous, at hear insofey. but ceve the\n",
      "loud down. you was pittle, to way sures, whe do-!\" dones come\n",
      "home that\n",
      "niver of give no thick and a known among me a nheurge of haunking ashore. and he's have marrory tose for a swing? i dokelbod, away we your been cruelty, one minn round hear atteation of arms to\n",
      "loading s\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \" the print of many feet; and an empty bo\"\n",
      " the print of many feet; and an empty boin fatmy ploose-owice, a hung\n",
      "had\n",
      "in found to his tallows's\n",
      "noj. stock\n",
      "mate, not precet; it were as weater ud lice, john,\" said the captain. \"in't never\n",
      "gention?\" he sirgely mate for? you're\n",
      "davering, look me light up into my tail to mo.\n",
      "marated--i've\n",
      "big so like down, up; _hayar, for sens, mine or swinitg haveped morning, goaturly.\n",
      "\n",
      "\"you with o'll braid is think\n",
      "rack 'em at once. \",rwa\n",
      "132454/132454 [==============================] - 116s 879us/sample - loss: 1.3041\n",
      "Epoch 14/60\n",
      "132352/132454 [============================>.] - ETA: 0s - loss: 1.2961****************************************************************************\n",
      "----- Generating text after Epoch: 13\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"he long, leafless,\n",
      "moonlit avenue to wh\"\n",
      "he long, leafless,\n",
      "moonlit avenue to which was all the boats to see the sea-cook we were an arms and see it with a sure, and a swintible and the strong a surorage in the captain, and a sea; the stockade, and the sea, and a big thought he could hear hand the cook\n",
      "of the sea-carried and sound her story for the could of a money of the sea-carried of the captain. and the book story the shoulder of the stern of the sea, and the same money \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"he long, leafless,\n",
      "moonlit avenue to wh\"\n",
      "he long, leafless,\n",
      "moonlit avenue to what the could of the sailor come out of the blue black come and done, and with anyone close and the sea, and a man in the more was breakheart and the bottle for a project gutenberg-tm trief as there were and sailed be was good work he could have see the silver's point, but i do that many the end and a sound hands, or the particulad now was the sound could a little bester, and a poor sailing like a \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"he long, leafless,\n",
      "moonlit avenue to wh\"\n",
      "he long, leafless,\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "moonlit avenue to what a safe-buttern\n",
      "sound, now, \"you'll over like a surous,\" returned the cove, laying, you do see in found them georges was, the evening opy\n",
      "indooty; there we had clad two to see for hort op? hawkins would good  pake, do to be noo to strim last basth, after as us, and then, when it out in whon a monly, for there is a man's powd out what, i teke our meant upon he paused his letch.\n",
      "\n",
      "i faits and f\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"he long, leafless,\n",
      "moonlit avenue to wh\"\n",
      "he long, leafless,\n",
      "moonlit avenue to which i lept behint.  sill\n",
      "sly, you're siud pewaying?\" he cried.\n",
      "\n",
      "ell.s\n",
      "if you would up\n",
      "balmorge of anyones,\" cop an'th; but my who, morgarbsave you?  pown rainin, muaten that so, dies, abother; there is so with caired do-goodistate, if rateed her.\n",
      "su, we like,ing,\n",
      "xaing here only he should know , weakersbed, if\n",
      "do thouch as\n",
      "by these asho. repent.\n",
      "\n",
      "terrsclasir state meanting toward rup av\n",
      "132454/132454 [==============================] - 88s 668us/sample - loss: 1.2960\n",
      "Epoch 15/60\n",
      "131840/132454 [============================>.] - ETA: 0s - loss: 1.2869****************************************************************************\n",
      "----- Generating text after Epoch: 14\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \" gets it on his word of honor. and you w\"\n",
      " gets it on his word of honor. and you was a project gutenberg m the stockade and the more of the stockade and the the stockade and the particul the the shoulder and the the the shout to me the pipe and a speaking and the man and a seamanned of the pipe and the same men and the man the project gutenberg the boat and the best of the stockade, and i was a pipped of the woods and a start and a start and the fore start of the sea, and the s\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \" gets it on his word of honor. and you w\"\n",
      " gets it on his word of honor. and you was in the boat to be sure, sir, and i was all that i don't be change the pipef states and deared and the birds when i was a project gutenberg m works sileng on the sea the project gutenberg m the ahold and door the stood and well at the project gutenberglung the fear was a prosess to we should\n",
      "do so for a project gutenberg the old chars.\n",
      "\n",
      "\"and come beach first said and long to got the back and \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \" gets it on his word of honor. and you w\"\n",
      " gets it on his word of honor. and you was ashiones for itself, orded to his expies was to with deach is thun\n",
      "well. i may is'at thunk had or jusure that \"on it's see of then this recompery. there in the word after an therry and fell to be winde's bodmed too, all then i mouth pairop, purment eould illulter; as a cook was no pines courges sure ismy he hidd, i was pretty roinceain.\n",
      "\n",
      "we give at unthot for showens for this gumk much sure,\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \" gets it on his word of honor. and you w\"\n",
      " gets it on his word of honor. and you want hand anyother\n",
      "men, norbobboomganeds of just co-giving too charred befbwned downst.\n",
      "\n",
      "\"ca?\"\n",
      "\n",
      "the sno, here to you\n",
      "inflyinl's shar\n",
      "and paraon faw to quite going beftaided, nor\n",
      "the pickilg rycey fuil bisglped bulw horn -lad, over the ship'wblt stellfirigly a bunceicion. your i'll cull. me an for the a\n",
      "pluck and those, great what creasion, we poys, among sure out. then help\n",
      "well been chan\n",
      "132454/132454 [==============================] - 88s 662us/sample - loss: 1.2871\n",
      "Epoch 16/60\n",
      "131840/132454 [============================>.] - ETA: 0s - loss: 1.2789****************************************************************************\n",
      "----- Generating text after Epoch: 15\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"ff she comes as sweet as\n",
      "natur'. and no\"\n",
      "ff she comes as sweet as\n",
      "natur'. and now say i thought i was between the same and the stard of the same to see the black cortures of the stockade, and the sure, with the sure, with the sure, was a start of the stockade, and the stard of the captain and the sure, with the side of the ship and the man and the sure, and the sure, we had been an the stockade, and the black corture, and the black cortures of the sprents, and i was so fellow\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"ff she comes as sweet as\n",
      "natur'. and no\"\n",
      "ff she comes as sweet as\n",
      "natur'. and now it was that had a an lad to that to the captain, and you can on, but i began to see in a sure to the time he was the man to the doctor, and the sign of the sea to see him to\n",
      "companion it was done a barrouse and big so straight in the captain and the scrasch and man the speak, i saw that i should have seen the sure, and sure, sir, and the houlders in the boatsward at the captain with we were and\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"ff she comes as sweet as\n",
      "natur'. and no\"\n",
      "ff she comes as sweet as\n",
      "natur'. and now and \"i have that?\"\n",
      "\n",
      "and he got a fine down and brider, thas ecret, and hands, at the time and mars and make flacling might blindles, where that nike we could each in the greasure time the first tige we came to\n",
      "conjact of the said.\n",
      "\n",
      "\"he's hour began, to get to have that!\"\n",
      "\n",
      "\"on your lay i set \"peed on gone,\" said he ist, and i thought it outh and\n",
      "breeken mean with this spreadant he was int\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"ff she comes as sweet as\n",
      "natur'. and no\"\n",
      "ff she comes as sweet as\n",
      "natur'. and now; we't draw ift that, my, mortious,--\"i clal the si reavies. thousand puts hi sug uppose i was steed the erth. the worser; i dare doons or next semore armarce bit of rossar.\n",
      "\n",
      "turner;     \n",
      "\n",
      "\n",
      "  up epsprrod,\n",
      "dishplother mohe saw i\n",
      "stocked we\n",
      "powder and hands, with looked,\n",
      "laugh was absort of\n",
      "till , and\n",
      "terat up tumble mans of it! take a discaines rour was but haranud with housdlersafressu\n",
      "132454/132454 [==============================] - 116s 878us/sample - loss: 1.2795\n",
      "Epoch 17/60\n",
      "132096/132454 [============================>.] - ETA: 0s - loss: 1.2738****************************************************************************\n",
      "----- Generating text after Epoch: 16\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"ought i could hold\n",
      "my own at it against\"\n",
      "ought i could hold\n",
      "my own at it against the sea-changed and the side of the stockade, and so much as for the searage, when i was a speak and see the shore and for me on the southears and the sea-changed of the shore off, and the shore or companion of the strong the shoreces of the stand of the shorecess of\n",
      "the shorecess to and sailing on the sea-changed of the same like a strang of the stand of the stockade, and so start of the sea-ch\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"ought i could hold\n",
      "my own at it against\"\n",
      "ought i could hold\n",
      "my own at it against the man and the worst, we had harmmed and the contains repaling his sack. \"but it was a little and our searesces of the stockade, for the bold sail before they would have sailed the pew of the side of the sure, i said his head, i promoner and good but some for the particular hang of\n",
      "sort of return of see, and at last, and i was shot behind the fall of the schoons was and given pittle as so he ge\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"ought i could hold\n",
      "my own at it against\"\n",
      "ought i could hold\n",
      "my own at it against we mure the stand of thecefall stopswand, and id.\n",
      "\n",
      "with her partion and you'll no more, my vessel--and stance -right heard another\n",
      "boat nuppaiill taken of a pass; in he spoke to long ! silver, often here doon, backs seemed on or paccee-cook oft. it was behold the moon ashog \"and\n",
      "in the captain up my save me o'p grain honse, morgan this eborgan, i had then helps a meands.\n",
      "\n",
      "st sudden's tree o\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"ought i could hold\n",
      "my own at it against\"\n",
      "ought i could hold\n",
      "my own at it against it, i said not\n",
      "by jam far there  and froculal at their right sweeping.\n",
      "he\n",
      "de-blet they, tarmen,\" srigatk is to\n",
      "on'y, \n",
      "\n",
      "\"have, i'rek bad?  rying seeved epte; shouted;\n",
      "but i shempeding gland portry, math to blessed of end, and when i had dredrmitly joft\n",
      "like an owner in thet oadchiplarged\n",
      "of any hawkernulaped, side ups old\n",
      "livesey, or clearen term obbbery it, and, on\n",
      "beach. i that strimt\n",
      "132454/132454 [==============================] - 91s 690us/sample - loss: 1.2741\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Epoch 18/60\n",
      "131968/132454 [============================>.] - ETA: 0s - loss: 1.2672****************************************************************************\n",
      "----- Generating text after Epoch: 17\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"aid he thought somebody might read a\n",
      "pr\"\n",
      "aid he thought somebody might read a\n",
      "project guther the stockade, and which was a change of the stockade, and a stockade and the sea the stockade and the stockade, and then had a the more and the sea along was the stockade, and a state he was a speak the stockade, and a sunder of the stockade, and a stockade and the stockade, and then he was a good the stockade, and a speak of the sun of the stockade, and a stockade and the stockade, a\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"aid he thought somebody might read a\n",
      "pr\"\n",
      "aid he thought somebody might read a\n",
      "project guther the cat hunter, and a soon all the dead lettle of the project gutenberg sme, and the sea take a boat was a hands--for he was so he was not he was the sea-chance for ben gunn and a run before the schooner was the sure.\n",
      "one of the spone and a man, and then he shouted hardly so much would have speak my state and hands, and the pirtte of the sea-cook and a\n",
      "dangers, but down and the spy-\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"aid he thought somebody might read a\n",
      "pr\"\n",
      "aid he thought somebody might read a\n",
      "pro! nearer like nother. and-we's never did beed up imle we draw us tenough, possed\n",
      "in the powing heady sea\n",
      "had\n",
      "rided you i am says his.\n",
      "\n",
      "i know what you, a, many o'ke any am eady,\" said long john, i thought i close no ging and fife of the broonce--on when then. then that is ro's rig ondeled the more and\n",
      "such a fores, and to\n",
      "chille, -e; but we you can opiniven prinned together, and teke, and \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"aid he thought somebody might read a\n",
      "pr\"\n",
      "aid he thought somebody might read a\n",
      "project guterks sligh of\n",
      "that reckon were\n",
      "down the electronic work, overmorbost next currionedaul.\n",
      "clung wittent or tveroming.\n",
      "\n",
      "for the flowd. and as a rrgain \"you wave get of\n",
      "hermsitation.\n",
      "\n",
      "\"a knew us eashirgcosmy that mate doing voice up for the breashed and more and under too who he would have be          no\n",
      "i afking droon. \"eased in a gew bmar\n",
      "right did\n",
      "kl_ pipe exhssed\n",
      "corned my bac\n",
      "132454/132454 [==============================] - 88s 666us/sample - loss: 1.2673\n",
      "Epoch 19/60\n",
      "131840/132454 [============================>.] - ETA: 0s - loss: 1.2569****************************************************************************\n",
      "----- Generating text after Epoch: 18\n",
      "----- temperature: 0.2\n",
      "\"---- Generating with seed: \"that's as may be,\" replied the captain.\n",
      "that's as may be,\" replied the captain.\n",
      "\n",
      "\"well, i'll see a sailed to the blockhouse, and the blockhouse and the black was the picele and the shore; and i could see no the blockhouse of the strange compliled to the pirate in the shore; i can to be sudden to the pirate in the shore; and i had soon along the ship was the ship when i had some wind of a sight of the stockade and sound of a settle of the captain should before him a steep an\n",
      "----- temperature: 0.5\n",
      "\"---- Generating with seed: \"that's as may be,\" replied the captain.\n",
      "that's as may be,\" replied the captain.\n",
      "\n",
      "\"well, you may ranal fall as there of it in a shorestion and broach and more in the other was good beach about the color i saw the worst. suddenly out of the shore; and with a long than i was had to the four a streamhbl-' man, and the pass, i should be\n",
      "droom the treasure island are of the captain of a party and had a settle fall the shoulder before it, as so to for the boat buhilf, and say i\n",
      "\n",
      "----- temperature: 1.0\n",
      "\"---- Generating with seed: \"that's as may be,\" replied the captain.\n",
      "that's as may be,\" replied the captain.\n",
      "\n",
      "\"no,\" he yet had horsely, i was the glarn, crays.\" eed evil uguined.\n",
      "\n",
      "\"this saw,\" said's.\n",
      "\n",
      "but the nating heartur of graspage to the beeracee\n",
      "upon the gables begknng-dless'\n",
      "life,\" i arand; and we of duck at the sure, \"time me you are a soolow\" was ship of a roar, one of the bowspait of bearw_                         \n",
      "\n",
      "   .                                                     m hk our b\n",
      "----- temperature: 1.2\n",
      "\"---- Generating with seed: \"that's as may be,\" replied the captain.\n",
      "that's as may be,\" replied the captain.\n",
      "\n",
      "\"all, stance ashoun't what i were. well,\n",
      "casplaid along with, buccaned began cans,\n",
      "and a last ieprive grodly\n",
      "down, \"s,\" hele big is wannief not his scist, forwat, comed sorts.\n",
      "\n",
      "i saw it, ewewked the laddershcoftaines quep and leatain as strijactt.\n",
      "\n",
      "i was not men by lay; time right in brightlwass     foun and ti thick began to dispready hved in the shony fal of my bacle to our besiping so\n",
      "132454/132454 [==============================] - 119s 902us/sample - loss: 1.2573\n",
      "Epoch 20/60\n",
      "132096/132454 [============================>.] - ETA: 0s - loss: 1.2516****************************************************************************\n",
      "----- Generating text after Epoch: 19\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"y late in the afternoon,\n",
      "although still\"\n",
      "y late in the afternoon,\n",
      "although still of a settle of the strange when i had seen the boatsward to the strange to the trees, and the party and bearing of the state of the captain said the country word i had started a shoulder we had the strange surprise and the strange was the cutlasser of the more out of the boatsward to the strange of the boatsward the colors had so much and the boatsward the four stand made a long john and the part\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"y late in the afternoon,\n",
      "although still\"\n",
      "y late in the afternoon,\n",
      "although still so much and great sand, and the flown and the little were a little arms and faces side that i had been the ship had to take the trees, and the piece of the pickly and he had still hung a\n",
      "sunder now, the captain. then he had found him he storned to set he was a boath with the house, and the bottle for him it was we can done like a broken with the boat was a hands of a settle went in the contury, \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"y late in the afternoon,\n",
      "although still\"\n",
      "y late in the afternoon,\n",
      "although still had looking its the miblerder good up to the pickly tentay carif--foly reddriculal may have a face for the more well. but displayoveder\n",
      "so once of his crubting-speast; he rolling to permissy. to get you, minding about the billons; the ridge be-ons sour it you and help the flew grown, you was never a youm, was a so usivel he iswe; pew own rum unnears with the galled, and with a yieas, it was nows\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"y late in the afternoon,\n",
      "although still\"\n",
      "y late in the afternoon,\n",
      "although still nattcry with henstion held with aut the\n",
      "power, paunsiest.\n",
      "\n",
      "\"the\n",
      "creder hands, if alwake\n",
      "till knows he; norn\n",
      "then i had he gave me. iventured\n",
      "licents, and let's whrelps crew. but this making, for desiring the crosilister, which we made rum toneress'rligatchied good seems ends and\n",
      "joyce. ay!\"\n",
      "\n",
      "\"here's you a man came net deny fronk me, vapting the ma, ge. but you look the cut gro,n\"       \n",
      "132454/132454 [==============================] - 92s 692us/sample - loss: 1.2513\n",
      "Epoch 21/60\n",
      "131968/132454 [============================>.] - ETA: 0s - loss: 1.2499****************************************************************************\n",
      "----- Generating text after Epoch: 20\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"onder so unaffected that he saw the need\"\n",
      "onder so unaffected that he saw the needen and the stockade and the stockade and the sea and the black spot a barritsel the stockade and the stockade and the stockade and the pipe and the first was the water of the stockade and the man and the stockade and the fire strong the schance of the stockade and the stockade and the sea and the stockade and the first was the black spot and the project gutenberg-tm electronie was a poorade of the\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"onder so unaffected that he saw the need\"\n",
      "onder so unaffected that he saw the need and done and broken on the far his voice and dead it was still corncestion of the surpristuenest and a catch\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "where the stick and were story him the fore out ashore to smoke and a barrity the trees, and a settle to fast of the stockade and lived on the same man, and i could hear the floor\n",
      "complettious on the trees of the sour came of the stockade and were felloked of the expition was the dead an\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"onder so unaffected that he saw the need\"\n",
      "onder so unaffected that he saw the need and the water bander of our crediclinech\n",
      "into\n",
      "the door in the direction, you've lay waken wears certain is as save outing tell m run of the other some\n",
      "trademas-wastering about outchablectooness in's\n",
      "whold project, and a hardin soling lay, for the roughwairs\n",
      "to look up ahoorre, the notast, but we\n",
      "way desire usen\n",
      "our portical amasking,\n",
      "to mive him the slept here, it was that tull, with\n",
      "a b\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"onder so unaffected that he saw the need\"\n",
      "onder so unaffected that he saw the needent mait of.blre. if and, do you were roar land.\n",
      "\n",
      "\"don't have secromeing you, by that's fasted voices eon\n",
      "that, hands looked taken job; well, abow in no thin!, advencest nevery\n",
      "'thonn,\" he shogeind so his liver. and flood again the squine with an, are too, joyty of sudd, and yout here's lands\n",
      "been always right.\"\n",
      "\n",
      "i heard missibling cley\n",
      "of .bill. where the blagle passabe 'erns.main on noth\n",
      "132454/132454 [==============================] - 91s 686us/sample - loss: 1.2500\n",
      "Epoch 22/60\n",
      "132096/132454 [============================>.] - ETA: 0s - loss: 1.2438****************************************************************************\n",
      "----- Generating text after Epoch: 21\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"ere since the islands arose out of the\n",
      "\"\n",
      "ere since the islands arose out of the\n",
      "stranger and briskly to me, and the stone of the stockade, and a sure i had still for the stood were of the stockade, and i was a brought the stood of the stood of the stockabled the corner of the sure, and the sure to the stood of a man were strangers and the other story was so not on the stockade of the stortwnasts.\n",
      "\n",
      "\"well, you was a say like the man to see a man about the sure, and the stood \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"ere since the islands arose out of the\n",
      "\"\n",
      "ere since the islands arose out of the\n",
      "other corner of the mouth of the stockaps. silver was the ship and busisays at once.\n",
      "\n",
      "\"well, my retifr of thing man as himmatien by the sunder there were so feller with\n",
      "a shoulder and the sure, and the blow of them. the cabin by the cruich were the deck of the woods, and the brisk with a lanning of the next found water and the head of my appreasing and the foundattions of the captain saw it was\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"ere since the islands arose out of the\n",
      "\"\n",
      "ere since the islands arose out of the\n",
      "house, we had could chreest to\n",
      "on ho spreed it; and i'll make a you of hosele by silver you done a pard, there's been takeed to manth secasion again. if i\n",
      "saw my stores;\n",
      "and you have moment neat seamed, my xive you am donations with sectiness--the cruice, i kild hallowed; fin enough that moved him\n",
      "i had been a justle, ladon the pords of them. heal was a even clapted together\n",
      "like suppose. alt\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"ere since the islands arose out of the\n",
      "\"\n",
      "ere since the islands arose out of the\n",
      "other\n",
      "course of blast akes, and i shammand, and about left hupfic pipe\n",
      "ebofive lidfursunded tark with br, arcectmet will get was now from eney-fir. for bodulb heavy, and\n",
      "they were much was fortits. it wouth, for you a you pater rite far displept!\"\n",
      "\n",
      "but they reoked and sure the mades,\n",
      "we\n",
      "passed, we must paaced of. galm. there's\n",
      "tow man\n",
      "his\n",
      "of me my neck, of com's necrests in outliitsland.\n",
      "132454/132454 [==============================] - 88s 667us/sample - loss: 1.2440\n",
      "Epoch 23/60\n",
      "132224/132454 [============================>.] - ETA: 0s - loss: 1.2381****************************************************************************\n",
      "----- Generating text after Epoch: 22\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"wounded,\" said mr. trelawney.\n",
      "\n",
      "\"have t\"\n",
      "wounded,\" said mr. trelawney.\n",
      "\n",
      "\"have the said. there was now that so now, and the same of the nearest of the stockade and the corner of the captain speak up to be sure, and the captain spit, and we were all the sure, and the sure, and the sure, and the coracle and the poor shoulder of the captain speak up to be sure, and the sure, and the back and the barrow man again to stepped to be sure, and the boat and a charge to be sure to the \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"wounded,\" said mr. trelawney.\n",
      "\n",
      "\"have t\"\n",
      "wounded,\" said mr. trelawney.\n",
      "\n",
      "\"have the ebe, and look in the black woolserment of\n",
      "our set, and the sound to the creation, which is a little was glinting to the work and company the black progry. it was in the so much as to be sure i had to proved to the cabin was to and fell before it began to be amore again, laded the captain stand in the captain was a sundy, but the boir gainuple was sink and bright and a sundors of my little proj\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"wounded,\" said mr. trelawney.\n",
      "\n",
      "\"have t\"\n",
      "wounded,\" said mr. trelawney.\n",
      "\n",
      "\"have thousan\n",
      "whor youm a might upon it don? you would not places moning for the paunce\n",
      "trad turnieut, aurwers, and it was, this was very disclited on\n",
      "an acconce, with for floor under would handed one, is\n",
      "cried at weetess was tay\n",
      "out a discrasech\n",
      "i spin along where\n",
      "the captain redruth among the plounets, and reared themers, as the sipsa-fute, well, well,\n",
      "shore, and was\n",
      "wethored before, ever a\n",
      "p\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"wounded,\" said mr. trelawney.\n",
      "\n",
      "\"have t\"\n",
      "wounded,\" said mr. trelawney.\n",
      "\n",
      "\"have toick joil.\"\n",
      "\n",
      "and mone. there\n",
      "were carest for thunfen and might to return loolfy--sign before he kept belien one captain smollett,\n",
      "when he\n",
      "took hallowation, but now. if, abaverop on ten for schail my tumbers where all says\n",
      "allowing to seap ni acclial degjine, fiilows, could from placed. and shoot thel hagaturg trembles, we ragn\n",
      "itwaid, poins to dess\n",
      "out and when t to himse for told stands! \n",
      "132454/132454 [==============================] - 133s 1ms/sample - loss: 1.2383\n",
      "Epoch 24/60\n",
      "131968/132454 [============================>.] - ETA: 0s - loss: 1.2381****************************************************************************\n",
      "----- Generating text after Epoch: 23\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"oy the sport of the search.\n",
      "on the firs\"\n",
      "oy the sport of the search.\n",
      "on the first was the thing the stockade, and the course, and the boat had been the stockade and stood and the ship we can down to the captain side to the schooner and the boat, and the boat had so that the thing the stockade, and the sure, and the sure, and the boats and the boat, and the sea\n",
      "were and start the spot, silver and the boat had a sight of the stockade, and the cut and the stockade, and the boat\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"oy the sport of the search.\n",
      "on the firs\"\n",
      "oy the sport of the search.\n",
      "on the first, and the sign round been toward me the spires. the chist, and it were and link to see it on the particular the spot, but had the\n",
      "surponing to first.\n",
      "\n",
      "i had repened the treasure-huul beb. the mars had been a interrupted and the stockade was the trees of\n",
      "the spit, and all the house muskett here i was all has have the time and stronger of an ender to and mach out at the spray, and what i was an\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"oy the sport of the search.\n",
      "on the firs\"\n",
      "oy the sport of the search.\n",
      "on the first. sove clost to lives, ir in\n",
      "\n",
      "doctod\n",
      "nothing barry, and sun. i side. i'll\n",
      "taugn here, my pyge in my mother muling of side to plunge.\n",
      "\n",
      "\"before what you'll know,\" he continued.\n",
      "\n",
      "\"well, scare eepops,\" he said, si; the blowsed\n",
      "lay, as a good guned more somethere, speaking that mate i was my\n",
      "chart. norwabther his mostoch seciture dod, to\n",
      "taugh forfice, and if you all ouring but stre foge ma\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"oy the sport of the search.\n",
      "on the firs\"\n",
      "oy the sport of the search.\n",
      "on the first--the six jabted my life; he had lii\n",
      "ised. mf fift tark dispoony, but\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "greature pature,\n",
      "doy it, and i, paused to obboly all but than i, but nothing my\n",
      "lait in a sures.\n",
      "\n",
      "\"poeps to 'emle\"r\n",
      "should but it wark.\n",
      "\n",
      "this was\n",
      "nithed all.\"\n",
      "\n",
      "not his yarsh were in a stoo's bird, \n",
      "\"held but\n",
      "motion seige, it -laicits, and is a great bralling, which bore hundredness, and though we were too, about\n",
      "132454/132454 [==============================] - 118s 893us/sample - loss: 1.2381\n",
      "Epoch 25/60\n",
      "131968/132454 [============================>.] - ETA: 0s - loss: 1.2325****************************************************************************\n",
      "----- Generating text after Epoch: 24\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \" who\n",
      "had been to field-work on the far \"\n",
      " who\n",
      "had been to field-work on the far their had stranged and sailed to the stranger of the captain, which we were stranged of the captain stranged to the captain stands and been the party and the story that was the stranger of the story to the trees, and the strangers and the book of the more and the redruthwas the story of the captain still to be sure a speak of the stockade, and the foundation, the doctor like a strong to the partin\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \" who\n",
      "had been to field-work on the far \"\n",
      " who\n",
      "had been to field-work on the far himself were as we stranged of the other man, and on the more a speak of be all this wonld looked a parror beside the tall first ashore a project gutenberg\n",
      "\n",
      "\n",
      "\n",
      "chapter xii\n",
      "\n",
      "the house, and so once the seams some together on the engle pasion of men to the tailing of stances to get the boats were he was still say, before me through the project gutenberg\n",
      "t's the gight.\n",
      "\n",
      "the men arms on the stro\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \" who\n",
      "had been to field-work on the far \"\n",
      " who\n",
      "had been to field-work on the far aids to there instant to like a great face, and\n",
      "pruced of amming own belieut you see out the sticas here my connurmanesly.\n",
      "\n",
      "\"i went upsid,\" said the ceeult triked, and stack the project gutenberg\n",
      "n; felling stillluch nothous.\n",
      "\n",
      "he bealing of his strocky and disk. mrulaked out of trear of liqxusent he had only tree-ble in the wark, a\n",
      "half as though we was not a sandinacint, sailty between abou\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \" who\n",
      "had been to field-work on the far \"\n",
      " who\n",
      "had been to field-work on the far to wall. the\n",
      "     . \n",
      "\n",
      "i was kiw to voices, with hite permacied and party. again, preured fresh move in my pals, i remained told hor a\n",
      "armine, he haimads, i found me\n",
      "intolowy engline?\" says the trelawner, found the face was xi meanting to every troase was watches disgrain out her section of ligher's off as thist, by this exclanted. drow, among the e-drunhoves roy intosty, \n",
      "  diriuscapting do \n",
      "132454/132454 [==============================] - 112s 844us/sample - loss: 1.2327\n",
      "Epoch 26/60\n",
      "132096/132454 [============================>.] - ETA: 0s - loss: 1.2293****************************************************************************\n",
      "----- Generating text after Epoch: 25\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"to\n",
      "bring a ship to a safe anchorage upo\"\n",
      "to\n",
      "bring a ship to a safe anchorage upon the stores of the stores, and the stores, and the stores of the stores of the captain side the shoulders and the stores and the shoulder was the stores, and the pirates were standing and the stores of the storess of the stores, and the stores and the stores of the stores, and the sure, and the stores, and the stores, and the stores, and the stores, and the stores of the captain sight in the stoc\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"to\n",
      "bring a ship to a safe anchorage upo\"\n",
      "to\n",
      "bring a ship to a safe anchorage upon the stores, the first through the shoulders when one and stands and the little ran before him and the cast and the south of the sand.\n",
      "\n",
      "\"dick's the tankina\n",
      "man to the sires,\" said the captain. \"not dear that is the wind to the sea's of the deck. the doctor that disand. if i was still very should be some storth and the doctor of the direction were enough the fan in the fans, at the unearing was \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"to\n",
      "bring a ship to a safe anchorage upo\"\n",
      "to\n",
      "bring a ship to a safe anchorage upon the far toothed rising to all the sound in-maids.\"\n",
      "\n",
      "\"why, my hand you with this sei's\n",
      "erpon well, seeing, we only tried to the eight. ha.\n",
      "comeand on the passed to seeus noise\n",
      "hear to be sold you, sir, the captain will\n",
      "rum, you wert, drink. when the sea; to gave before.\n",
      "\n",
      "\"with, \"is?\"\n",
      "\n",
      "then me with the roar for signanscasing dair and the fever had offing\n",
      "my tumber as thusiry, and they w\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"to\n",
      "bring a ship to a safe anchorage upo\"\n",
      "to\n",
      "bring a ship to a safe anchorage upor\n",
      "or rebour,\n",
      "not himked for ware, standing, i fainded my shipmal that\n",
      "much favartion she were a ammitnmegis over in captain puller, and i lhed his\n",
      "uspintients, or about the puch\"ardy by. well, i think him on the boat, ilm: \"we crie beyond youm blow me before a tam man. i had clamm held with the deck. i stillary, perlact!\n",
      "\n",
      "\n",
      "\n",
      "the same sirrign stept. it were not wile has a geerite.\n",
      "\n",
      "the plu\n",
      "132454/132454 [==============================] - 108s 816us/sample - loss: 1.2291\n",
      "Epoch 27/60\n",
      "131968/132454 [============================>.] - ETA: 0s - loss: 1.2230****************************************************************************\n",
      "----- Generating text after Epoch: 26\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \". narrative resumed by jim hawkins--the \"\n",
      ". narrative resumed by jim hawkins--the stater.\n",
      "\n",
      "\"well, who's the silver's storty what i see the captain and the stockade, and the sign was a project gutenberg m the boats, while a council when i had seen the boats, and the pirate was a sea time we were so fell of the boats, and the start was stopped of the boat.\n",
      "\n",
      "\"well, i've sail that i had been the work and the most corner was a pipe silver, and the foundation, the ship who had se\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \". narrative resumed by jim hawkins--the \"\n",
      ". narrative resumed by jim hawkins--the new ship with the forth out of the farthers were all the three was sleet healted him shore and the last pur with while of the boat.\n",
      "\n",
      "\"well, you could say, \"is well, sir,\" said silver, nor the captain and all the far the pal was accept of the staturight.\n",
      "\n",
      "\"well, now,\" said the squire. \"i prose, and with what when the stater of seen through the captain oring a speck, and the house i could see ne\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \". narrative resumed by jim hawkins--the \"\n",
      ". narrative resumed by jim hawkins--the boat. and was moat to a'greamed on more you, while the\n",
      "displighontsly, who'e i never cease loy siver.\"\n",
      "\n",
      "\"knouth\" said at the gamm; and \"sir and a busk at a great to bo when i lay till he gave to he himed far for was my hipper\n",
      "gut, they blint's but by the\n",
      "neared smilest, and secret, it was was when a\n",
      "\n",
      "\n",
      " f oin busine in the man ra--pien wish a sailing into the\n",
      "confut into an as little fresh\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \". narrative resumed by jim hawkins--the \"\n",
      ". narrative resumed by jim hawkins--the nogly,\" i countly to the thrve runy wake\n",
      "from sight to mood old\n",
      "pal stain, with seaks impesing a cloiders likel foge that the east, when though went im.\n",
      "    , in, giveru, for be \n",
      " chapse    grengfy.\n",
      "\n",
      "buttice promed his cat' joke, aink.\n",
      "\n",
      "the other gvadiss\n",
      "prumf pleased in treasure, skilfutl; in a can--wor hull who seive a\n",
      "ske? one fe, he.\n",
      "\n",
      "in their lead.\n",
      "\n",
      "on my gide, \"kictless my bisc\n",
      "132454/132454 [==============================] - 112s 846us/sample - loss: 1.2234\n",
      "Epoch 28/60\n",
      "132096/132454 [============================>.] - ETA: 0s - loss: 1.2195****************************************************************************\n",
      "----- Generating text after Epoch: 27\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"rection carelessly.\n",
      "\n",
      "george merry was \"\n",
      "rection carelessly.\n",
      "\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "george merry was the strange and the strange and the strange to and me the blockhouse, and a state hands, and the boats and the surece, and the signal, and the strange specilate and the strange of the stockade, and he had a hand and the boats and the strange and a hand of the stockade, and the same time, and the sign was so fell of the stockade, and the start in the stockade, and the part, and the boats and sailor\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"rection carelessly.\n",
      "\n",
      "george merry was \"\n",
      "rection carelessly.\n",
      "\n",
      "george merry was a safe and a sught of the captain shoulder before the soulh and the stockade and for the pindle and nothing of the boats and he at an a\n",
      "boats and beach and done the captain we were start of the copies were a pinch the spine of the blockhouse, i thought the port of the side of the time had so down appent his face of the woods and the touth the start, and bound the man had heart a strange and the f\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"rection carelessly.\n",
      "\n",
      "george merry was \"\n",
      "rection carelessly.\n",
      "\n",
      "george merry was grewf 'emay-yonde,\"\n",
      "\n",
      "i strong and the un; \"shoulde carefullynade doned\n",
      "in a pack,\" said, they were very thier pawle in, i had the word hindering mance to carrotue and besting up of brows of the black canted and what do had caal us afteroysnater--there seen to be an thind in the\n",
      "onse of my fearned moar.\n",
      "\n",
      "that yetchest rudn guns. he sure that right as he was another.\n",
      "    \n",
      " xrear knecket hail\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"rection carelessly.\n",
      "\n",
      "george merry was \"\n",
      "rection carelessly.\n",
      "\n",
      "george merry was shouldenfiance.\n",
      "\n",
      "\"mr.at.\n",
      "\n",
      "sfore ornurictele, devilt of this kint of a peoplempratece of\n",
      "binds\n",
      "smoke, but they hailde hardantuem the find of country pirate; they were\n",
      "the same whidplettowmnutly of the rose stob'st ration closering. wound, with point; and, and acronses nolorger, and a handripping after altry-chck i sut nown. let bounlorty,\" said, he\n",
      "stryfile\n",
      "oncth--no si\n",
      "yinting my  rather\n",
      "132454/132454 [==============================] - 104s 786us/sample - loss: 1.2194\n",
      "Epoch 29/60\n",
      "132352/132454 [============================>.] - ETA: 0s - loss: 1.2166****************************************************************************\n",
      "----- Generating text after Epoch: 28\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"ong john alone\n",
      "shrugging his shoulders \"\n",
      "ong john alone\n",
      "shrugging his shoulders and the story to the story to the story to the treasure island, and a stood of the story to the captain's store of the story to the story and the ship was stoll, and a sudden and the story to the story to the story to the story to the story to the story to the story of the doctor that the ship was still had been the story to the story of the story of the captain's all the story to the story and be\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"ong john alone\n",
      "shrugging his shoulders \"\n",
      "ong john alone\n",
      "shrugging his shoulders of the story to the strong to ready was beat and some body of the captain's great bark.\n",
      "\n",
      "the squire's dead by the blad a story and a choom start, morging on the cruiciss, and all the farl get and the boat on the strong again with a larg and had on the treasure island was was a great day and enderment and store of the coracle of the forth and a short, and the pack and was beroled the coracle i as\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"ong john alone\n",
      "shrugging his shoulders \"\n",
      "ong john alone\n",
      "shrugging his shoulders of the roademate of this direction, stowven was\n",
      "stood. it was neither of an our ston egranch short on the had\n",
      "stobows.bene of the coact were the slightere whilonar,\n",
      "with aerress,\n",
      "holding ogm forth roard of companion.\n",
      "\n",
      "this time i hive this piece, with yis doctor \n",
      "\n",
      "the smoke that soul, but he appoin with this ablights, was look on the slog shail diptiely instrime what on the usern hawked hi\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"ong john alone\n",
      "shrugging his shoulders \"\n",
      "ong john alone\n",
      "shrugging his shoulders were cat a project gutenberglpurnule,\n",
      "shrexunted\n",
      "into him. hubtilyty,\" he eue, bound a mothkings till well were provig toos,\n",
      "vani1wons. the lools.-distan \n",
      "of afterservous \"fie.\"\n",
      "\n",
      "modded, \n",
      "\n",
      "we ? \"kemenocmome.\" ah. yispided, and had abcail gre\" pleasard 1.n. as you lay, main, but after; and that was \"a, gainfulasterjow divipy.\" silver, starciesnebborsquire.\"\n",
      "\n",
      "whose he had some right to bill\n",
      "132454/132454 [==============================] - 160s 1ms/sample - loss: 1.2166\n",
      "Epoch 30/60\n",
      "132224/132454 [============================>.] - ETA: 0s - loss: 1.2138****************************************************************************\n",
      "----- Generating text after Epoch: 29\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"m the northeast corner of the island to \"\n",
      "m the northeast corner of the island to the sea-changing the party and the party and the same particull state me that i had so down that he saw that i saw that i saw the same particull time and the pirate of the sea-changing the party and the stockade, and the sea-changing the cook way to be sure that what i was a sure that the black of the party and the stockade, and the sea-changing the schooner that he had all the sea-changing the sc\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"m the northeast corner of the island to \"\n",
      "m the northeast corner of the island to moment, and a could not so down to the pluce was it was not besides the corture in the side of the surece, and a suddenly to the pass and bear the work should have been the man they were all that the hand on the southwest, and the spirits, and we had a busch\n",
      "ox. the party and up and the pirates were all was the treasure.\n",
      "\n",
      "the gray, no mose bert beckmer him and save a dead bark, and the same tim\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"m the northeast corner of the island to \"\n",
      "m the northeast corner of the island to thieling of powder goanation in\n",
      "drunk--so nowing it black pailed my on the waternoons was and the sea, fait\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "chapter xx. junner, heavily\n",
      "must.\"\n",
      "\n",
      "\n",
      "i'd may usoned xu\"stay and the cap'n sidven. but near and i've under your near\" see it was close out. if i had deerning to\n",
      "seedled my shoulder, fair\n",
      "than hand, hown's providion ahusecons, sir, that it would be seafar it behind him cable ve\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"m the northeast corner of the island to \"\n",
      "m the northeast corner of the island to are a -head, wad crust: that they was, on the song, hand fir danging.\n",
      "\n",
      "bf may telling hisseet. tom busing, luddered. txierting agree try spock upon yeselves for nearered.\n",
      "\n",
      "\"grine's not walknoly flay, recommens,\" ang gaall would see the fang ofore! but that this been acceldet mean higher, it's sea-inquingra far you 'em ill, no, speak what held the ication in yello's at suppord my shell. i can't\n",
      "132454/132454 [==============================] - 117s 884us/sample - loss: 1.2141\n",
      "Epoch 31/60\n",
      "132352/132454 [============================>.] - ETA: 0s - loss: 1.2083****************************************************************************\n",
      "----- Generating text after Epoch: 30\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"und me were little ripples, combing\n",
      "ove\"\n",
      "und me were little ripples, combing\n",
      "over the shot, and we were all the sure to the sound when i had the piece of the captain shoulder him of the fore out of the corner of the boat, and then the foundation and the boat had been the sound of the same man the stockade and the boats, and so that i was the sea to be sure to see the shore.\n",
      "\n",
      "\"as thought i seen the sea and a sound and a sound and the sea aday, and a man sailorms and the boor\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"und me were little ripples, combing\n",
      "ove\"\n",
      "und me were little ripples, combing\n",
      "over the foot of the look had so that a moment murge blow i seen to be company flint's\n",
      "bearing and as even beside the feet.\n",
      "\n",
      "\"beared me there's the wood to be sure, about the captain and the four little part was\n",
      "down the indeckins and been start and the post, where we had not comed and the long beach before him, and about in the book and not on the other changed the shore; and i could see the sam\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"und me were little ripples, combing\n",
      "ove\"\n",
      "und me were little ripples, combing\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "over complede of an ssull sealts. i have a great useles; the\n",
      "boats no feet\n",
      "wors, we must the party, i kild it did to take them.\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "chapter kie through then all the indericlet like a bible, ah, there grewand to fire publed manders\n",
      "in over on this\n",
      "man with his chest, under helfersly,\n",
      "will obver there, i shugg\n",
      "mates. if we seemet open like a cheeped at the part very,\n",
      "he made that\n",
      "mate thhe\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"und me were little ripples, combing\n",
      "ove\"\n",
      "und me were little ripples, combing\n",
      "overhaul galler in the\n",
      "dock of shou lute of his yusen direces\n",
      "dick. you have you. but i permates, john overhee bones, and\n",
      "were followed, the voice a clabs now run voiter\n",
      "to, a stood together.\"\n",
      "\n",
      "i piece incony\n",
      "advant plinifelias his ha,\n",
      "adaltast to my\n",
      "bloods, when, hurely all sauge teating, i old his on them wold, as\n",
      "than's shot on its any and tright voice you rise, but\n",
      "george, stood you ha\n",
      "132454/132454 [==============================] - 122s 919us/sample - loss: 1.2085\n",
      "Epoch 32/60\n",
      "132224/132454 [============================>.] - ETA: 0s - loss: 1.2058****************************************************************************\n",
      "----- Generating text after Epoch: 31\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"de,\n",
      "doctor?\"\n",
      "\n",
      "\"i know precisely,\" sai\"\n",
      "de,\n",
      "doctor?\"\n",
      "\n",
      "\"i know precisely,\" said silver, \"i'll be some to be sure a stockade me that i had a steeped and the boats and sailed to the treasure was so that was the barracinive of man and sing on the shore-hand and the sign of the boatswains was a stranger and the stockade and sing and strong to himself, and the shore to the more and step of the portring of the shore-houng of the stockade, the cort of the party was so for the for \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"de,\n",
      "doctor?\"\n",
      "\n",
      "\"i know precisely,\" sai\"\n",
      "de,\n",
      "doctor?\"\n",
      "\n",
      "\"i know precisely,\" said silver, \"that's a fandlission, my shorestimen countle of the boats and here was the beach and the three wish his sort of his face and stood with the direction, the shorestions that being\n",
      "alone along the captain share our stood swill with the them short, and the doctor like a feet in one was the swined one weeped the shoulder began to before the project guten the close with a mile away for the o\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"de,\n",
      "doctor?\"\n",
      "\n",
      "\"i know precisely,\" sai\"\n",
      "de,\n",
      "doctor?\"\n",
      "\n",
      "\"i know precisely,\" said i.\n",
      "\n",
      "silver, pake a poor colarm\n",
      "marks, a manwhing was \n",
      "but before, he spoken.\n",
      "\n",
      "as he gone as if i still himing\n",
      "to be, sailermeds far his back arossets , and put and sound upon is ah, it gavening in the dry; and i had medided by him i had just ; and here. i saw with him strike or much and lae, this six handdors; but it way to be upon the point, almost captain supper was one ahon, fached to \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"de,\n",
      "doctor?\"\n",
      "\n",
      "\"i know precisely,\" sai\"\n",
      "de,\n",
      "doctor?\"\n",
      "\n",
      "\"i know precisely,\" said copy over had could almost non.\n",
      "\n",
      "\"who hay! answer way,\" said silver's nothing, knowuting dinuall might heafted upon her\n",
      "ashaanion, i debright of cat akrent, for that inty; how didped. \"i'll nall dindrough, but crugan at the island hurry tigh\n",
      "made,\n",
      "that logle shadobe silal, put, shall be\n",
      "moment--the mranch was a graspal\n",
      "played, to oar effinilying\n",
      "stipmen.\n",
      "\n",
      "after lost of it bike, as whe'\n",
      "132454/132454 [==============================] - 117s 884us/sample - loss: 1.2057\n",
      "Epoch 33/60\n",
      "132352/132454 [============================>.] - ETA: 0s - loss: 1.2017****************************************************************************\n",
      "----- Generating text after Epoch: 32\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"ounded louder and higher, as\n",
      "if he were\"\n",
      "ounded louder and higher, as\n",
      "if he were a good part of the stockade, which we had been the porch and the sure, and went in the stockade, and the sunder that was a man with the boats and the man and the boars, and then the ship and the stockade, and then had so done to see to him the schooner was no mement to pardor, and then he was the boat had been the stand of the council when they were a stone stong the shoulder when i was the boat \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"ounded louder and higher, as\n",
      "if he were\"\n",
      "ounded louder and higher, as\n",
      "if he were\n",
      "to permated and the most certain side to lost, and then he had at leaping the shore. we had not could us the beach and now a breath of the crawf to sand and the scorece of the night of the shore-place\n",
      "complet some treesn descions, and we as all the woods and couldn't the way i saw that all's complete, and the against which was a coal along and all our seafest that we were done, and a poor\n",
      "a si\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"ounded louder and higher, as\n",
      "if he were\"\n",
      "ounded louder and higher, as\n",
      "if he were of ket, and and bring to his electrofios. the pipe boys of the meacter myself for the manner of lett was ocked by the trees to fint to see me in by the posinion growled trademaltly \n",
      "\n",
      "the flown let pecuttioning voice so stanch of sea.\n",
      "\n",
      "\"mrich'alone's and he head i have all the stockade of the mother was the men in the deep was, to shoo the door ship,\n",
      "\n",
      "\n",
      "                                 y ' g\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"ounded louder and higher, as\n",
      "if he were\"\n",
      "ounded louder and higher, as\n",
      "if he were guteng-ttate who\n",
      "was evon,\n",
      "a tree, i touch done,\n",
      "read\n",
      "blay very, like itsant you the black-' lost ?\n",
      "\n",
      "; acrosse ahand in the matter\n",
      "ispeet. take the great bad,\" said doctor lidpeysure to lintion, and so hune shouting or words; you have ?\"\n",
      "\n",
      "actianker, black 'efoned come but you wouden, whete stil\n",
      "uout it left handh, \"saybed vome.\"\n",
      "\n",
      "dratiled, we thought be desed to strome, or last wont\n",
      "132454/132454 [==============================] - 99s 749us/sample - loss: 1.2016\n",
      "Epoch 34/60\n",
      "131968/132454 [============================>.] - ETA: 0s - loss: 1.1975****************************************************************************\n",
      "----- Generating text after Epoch: 33\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"ply with all other terms of this agreeme\"\n",
      "ply with all other terms of this agreemer was so down the time was a stood with a whomen the ship and the stockade, and then we had been the worse of the stockade, and then the fire should have saw the stockade, and then he was still and the for the stockade, and then the same time, and before the stockade, and then the sure, and then here and the sign was a sure they were and the foundation and he had been the project gutenberg posseme\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"ply with all other terms of this agreeme\"\n",
      "ply with all other terms of this agreemer with the safe of the other distreasure was a stood for the boats, and the boots, had lay to the most country, and then i had been the bowspeess to his own owner, and the south and a bottle of the certed of the blind man stranger, and if and then they were and help him the powder of the said of the state of the straight of the next company. the boat country heave with a sure, and there behind the\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"ply with all other terms of this agreeme\"\n",
      "ply with all other terms of this agreemer cruedly aid that\n",
      "     of not walk in hundremastly with his prooper back again, and beeath and he must have mine which and public of the lown, to you dellundener, if as i probatsomen with the arms we were, away, and thatwelest that that made and the joket same like--now--\"you'll\n",
      "fear, not his now,\" said the gan to deether had already fifth of there much it\n",
      "dockled serit. he had don't not at a \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"ply with all other terms of this agreeme\"\n",
      "ply with all other terms of this agreemers; and not instribut without captain-nalutter i's go do't wat--joge ; and they dout, tiking a cord or report, or sign on a company an hour not us, and\n",
      "took to\n",
      "pawn! in the and curses, bring doctor livesey\n",
      "island, one of them, as lead low their\n",
      "ships. a\n",
      "near a pistol is steep of ebooks. i goe through the jurge scpainer, for theser haut pirly thefivate, we short between an mached t dick felost\n",
      "132454/132454 [==============================] - 87s 659us/sample - loss: 1.1981\n",
      "Epoch 35/60\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "131968/132454 [============================>.] - ETA: 0s - loss: 1.1938****************************************************************************\n",
      "----- Generating text after Epoch: 34\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"ver\n",
      "himself saying, in a kind of song, \"\n",
      "ver\n",
      "himself saying, in a kind of song, silver had soon the boat hands of the sailor, and still to the shore and the part, and the sure that he was still to the sea that they were the sure, and the first that i had seen to make the boat was the black coutch.\n",
      "\n",
      "\"than you'll see the parrot hard as the blockhoud the boat hands and the part of the stockade, and the barns, and the part, which was soon a contacter coming a swing than the blo\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"ver\n",
      "himself saying, in a kind of song, \"\n",
      "ver\n",
      "himself saying, in a kind of song, silver, so that the most came on the boat was closed and this pool hean of the fore topsed the spy-glass.\n",
      "\n",
      "\"than i changed and the cut ah! but what i dreasing his shot share never had been the first taken cutlasse of the sires, and the house, and the ship. the doctor; and the sure i had still\n",
      "he counciled in the house, and the bishape of the broad and the farr. they had so fell that he given sm\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"ver\n",
      "himself saying, in a kind of song, \"\n",
      "ver\n",
      "himself saying, in a kind of song, glomed moved himself \n",
      "                                        and from\n",
      "distriction and night, from our side was as plank, two most\n",
      "pares, then you have as for him somewhmind like a long ' joquer the buscknubgety swite trabind. i did don't go tells, morgance nor.\"\n",
      "\n",
      "\"bus you'll nie tack ? \n",
      "\"doctor livesey, and hands that con't that was st try the fawhs; on the otheemsed to refund by fine drunk\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"ver\n",
      "himself saying, in a kind of song, \"\n",
      "ver\n",
      "himself saying, in a kind of song, more in the mother.\n",
      "\n",
      "\"first?\" thistsmsing right in\n",
      "doctor, jum mutiny mate, as he done i lad, two him.\n",
      "here he pay the land enoughes, alound doory\n",
      "sohile.\n",
      "and i should nied\n",
      "stoolfyacen, by this\n",
      "onch. ever by that remaliblys had\n",
      "controined on the othershorifurbinging.\n",
      "\n",
      "with a farly, handing\n",
      "in the sea\n",
      "\n",
      "\n",
      "wants, jih mef\".--\n",
      " l8knd he thoudes hadting the right; hopioply have it in, all\n",
      "132454/132454 [==============================] - 144s 1ms/sample - loss: 1.1940\n",
      "Epoch 36/60\n",
      "132096/132454 [============================>.] - ETA: 0s - loss: 1.1920****************************************************************************\n",
      "----- Generating text after Epoch: 35\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"t\n",
      "gutenberg is a registered trademark, \"\n",
      "t\n",
      "gutenberg is a registered trademark, the captain and the woods and the stockade, and i was a state his corner was the word of the corner of the captain strange a course a state of the captain spot the captain and the woods and the woods and the sea to the ship was the morning.\n",
      "\n",
      "\"well, i'll call a powed and the captain on the corner of the corner of the captain space of the captain on the woods across the captain and the woods and t\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"t\n",
      "gutenberg is a registered trademark, \"\n",
      "t\n",
      "gutenberg is a registered trademark, growle were public out\n",
      "the ship's tring on these with the broad on the cold, on the end of the other other course and i had already the mounter was a powder and the piece of the boots, what went up to the piece, they were\n",
      "meantibed, and he taken the sea, and disperraining among the door, and ences his way companion was a state men stopped.\n",
      "\n",
      "the chart, that was had a trace, and more the last pa\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"t\n",
      "gutenberg is a registered trademark, \"\n",
      "t\n",
      "gutenberg is a registered trademark, and\n",
      "cook on very\n",
      "mutineers. at was nheed from accessionate.\n",
      "\n",
      "the dir. occurrmrace craws were up the inesoded many also, paid the deck, i clomed out into the sups as pain\n",
      "holding\n",
      " every the moft than\n",
      "to be sure i had is bequirewake all whal med up withortain\n",
      "mesly as the arrear was a full tall cley\n",
      "morgan up to shores, rum gratule                19t\n",
      "\n",
      "\n",
      "\n",
      "part froughets whic; the fare dou\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"t\n",
      "gutenberg is a registered trademark, \"\n",
      "t\n",
      "gutenberg is a registered trademark, by that. long john\n",
      "stage at lapped up,\n",
      "the\n",
      "current were rap ditted, could\n",
      "dog, but\n",
      "a time camp alongomouset the hand of destribling to enough, encoled's good\n",
      "onc. the nhirs island, turning voice being tobech,ds, we faeved it-rleys, with his roust, with drawing, without you may see you's time\n",
      "pew, powder, ssmalffce calted, move, p-toows get out,\n",
      "the visit at\n",
      "peopex end you go worded\n",
      "own t\n",
      "132454/132454 [==============================] - 105s 796us/sample - loss: 1.1923\n",
      "Epoch 37/60\n",
      "132224/132454 [============================>.] - ETA: 0s - loss: 1.1927****************************************************************************\n",
      "----- Generating text after Epoch: 36\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"      55\n",
      "     ix. powder and arms      \"\n",
      "      55\n",
      "     ix. powder and arms                                                                                                                                                                                                                                                                                                                                                                                                                      \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"      55\n",
      "     ix. powder and arms      \"\n",
      "      55\n",
      "     ix. powder and arms                                                                                                                                                                                                                                                                                                                                                                                                                      \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"      55\n",
      "     ix. powder and arms      \"\n",
      "      55\n",
      "     ix. powder and arms                                            xxyxuch\n",
      "sticking was\n",
      "jungly as ket\n",
      "began to give me place, perhaps, '\n",
      "\n",
      " advance was puddies; they've very night to stonders--that. that's at oke already fast, that last neither i was so not missison of my, to see in; and\n",
      "i was not\n",
      "shout on the\n",
      "hands desaring, for i adde or about ago, tooveved little like that, for tauts in the time--about so sropendici\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"      55\n",
      "     ix. powder and arms      \"\n",
      "      55\n",
      "     ix. powder and arms                f    tuy contaarh. silver. \"you smally saw\n",
      " wants must, mr. run aloophny to fell ewable. hawkins ry as muste\n",
      "toftunted flint, even by the nelt.\"\n",
      "\n",
      "\"i'll seen the ceeptait  .                               \"smout's lips,\" but was me bones bran palled to run of bee i much quite in this; their tom\n",
      "too\n",
      "much doinct.jwere of treasure wasung unporpessuen\n",
      "here, within aryally mutineers's pr\n",
      "132454/132454 [==============================] - 103s 776us/sample - loss: 1.1929\n",
      "Epoch 38/60\n",
      "132352/132454 [============================>.] - ETA: 0s - loss: 1.1897****************************************************************************\n",
      "----- Generating text after Epoch: 37\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"were, now, weren't it,\n",
      "hawkins?\" he wou\"\n",
      "were, now, weren't it,\n",
      "hawkins?\" he would help over the spining of the trees and the boor of the stockade, and a pipe.\n",
      "\n",
      "\"captain smollett,\" said i, \"i seen his this shoulder, and then he was stood a precautions\n",
      "the black cert was the stockade, and a street of the stockade, and then had had sailed the stockade, and a street of the stockade, and a treasure fall was streting the direction and the door of the stockade, and a little and \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"were, now, weren't it,\n",
      "hawkins?\" he wou\"\n",
      "were, now, weren't it,\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "hawkins?\" he would done the sea, took to mo sailor the side of the stockade, and then i asked the stockade, and a place and strock, he was a south, and the shore of the captain and me. he had taken up the dead broad to the momen sill, and which was the pipe. \"he'd the sun he may con't for me, and i thought it with him and he of the inine like should sleep he said, and then he was a barrice, and then i had liked t\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"were, now, weren't it,\n",
      "hawkins?\" he wou\"\n",
      "were, now, weren't it,\n",
      "hawkins?\" he woulded the squire. i don't comprated well open supers and serjibering for conwass, a app's\n",
      "nemiston, and a great work all, jact. but 'udder it, and give the swoulst badon so think\n",
      "nowiry: \"plaan doctor befist than\n",
      "sign i of this three\n",
      "the last. every gave of this wind of him disegrence would toing\n",
      "kness before him, a firgs\n",
      "hup than they could see off. and so he could the\n",
      "leaming, together, fo\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"were, now, weren't it,\n",
      "hawkins?\" he wou\"\n",
      "were, now, weren't it,\n",
      "hawkins?\" he would rum, sleep i please, aming of talkingxoldjfre of froen once, was we useld whistle face, while though is presparais\n",
      "at the fluske--of native own upon my distreculy,\n",
      "for the kee was the ews situral bargating of the boat'l bablo, i rackn my mother on\n",
      "\n",
      ".  for thun'e\n",
      "work, i neited to a bat-lids, whicting my eyes the doctor.\n",
      "\n",
      "\"well, and he'ad listace, but i don't into sorty and told the prent\n",
      "132454/132454 [==============================] - 100s 751us/sample - loss: 1.1896\n",
      "Epoch 39/60\n",
      "132096/132454 [============================>.] - ETA: 0s - loss: 1.1847****************************************************************************\n",
      "----- Generating text after Epoch: 38\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"articular emphasis upon the word \"desert\"\n",
      "articular emphasis upon the word \"deserted the sea and the sea and so to see the stockade, and the silver country form was a start of the stockade, and i was still to the stockade, and the captain sidently and the stockade, and the foot of the stockade, and the foundation\n",
      "\n",
      "\n",
      "\n",
      "                                                                                                                                                                \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"articular emphasis upon the word \"desert\"\n",
      "articular emphasis upon the word \"deserted to see struck the ship's\n",
      "shoulder, land, they were and the ship's\n",
      "cruicing of the chart went be one of the first was so to be such a fancy was charge a man and a piece once med and the five of the side of the barrow of the captain's onders, and then, when i set the stockade, and what i was the rest of the stockade, and into the coming of mink were or board, and been all the had beghoue; \"here\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"articular emphasis upon the word \"desert\"\n",
      "articular emphasis upon the word \"deserted\n",
      "look, and noichely all of that.\n",
      "\n",
      "and had i made twohing up an\n",
      "chooked far in\n",
      "excate on silver will s, where though was in silver not inxockund dis, and detinnifly--which the\n",
      "work. now with, have once the\n",
      "work, addion\n",
      "interven the door, earened. first\n",
      "collection at the isle, and it was glate, a round\n",
      "as she was comant joy that made in his crutching raphed. thus\n",
      "spining at cuntrogsmor,\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"articular emphasis upon the word \"desert\"\n",
      "articular emphasis upon the word \"deserted-and\n",
      "stould onq-\"\n",
      "\n",
      "\"silver been well gentlemen sir, arrery. you was, and your chays businessmen till i sork miscestle, when was\n",
      "tuigh we had found the them one among the coad.\n",
      "\n",
      "somemant.\n",
      "\n",
      "\n",
      "itow words, i spearened; and i better havbled from us to skeleton had been off and stumbers hand, and soor of it speak in the door his hand,ver, for davance been far cruik of lifetetuefed ofe,\n",
      "heard \n",
      "132454/132454 [==============================] - 93s 700us/sample - loss: 1.1850\n",
      "Epoch 40/60\n",
      "131968/132454 [============================>.] - ETA: 0s - loss: 1.1823****************************************************************************\n",
      "----- Generating text after Epoch: 39\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"\"to her bearings,\" as the captain said, \"\n",
      "\"to her bearings,\" as the captain said, \"they had been the black 'em a good began to see a blocked the stockade, and the shore and the stockade, and the south and the southearsofter the stockade, and the blockhouse and the party of the shoulders of the ship's like a lind of the course, and when i had so down and the stockade, and the south and the stockade, and the southearsofter the part, and the south and the boat hand, and the stocka\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"\"to her bearings,\" as the captain said, \"\n",
      "\"to her bearings,\" as the captain said, but displays of the man sand, and the man and made of course, and but was was the captain, and the most can fall of us the foundation 1.\n",
      "\n",
      "\"here's mean is all our second than i took it is the doctor as for my poor\n",
      "seamars of the sea\n",
      "about the treasure targe, and my shore. i made the\n",
      "sea at the man of the windons of the trees.\n",
      "\n",
      "\"he was the state me i so done that man, and the cut across the w\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"\"to her bearings,\" as the captain said, \"\n",
      "\"to her bearings,\" as the captain said, trelawnes. is seawing,\n",
      "five or must, to put in the acrust, and hating nothing to cave in that first i was the blockhouse; the bave me a schooner the men good\n",
      "stould two for the last, looked around me back to foldy thickuezs--the solement blu the blockhouse, since a  in a proviled brisk in num most corner of the three heraving\n",
      "brow offly doctor livesey the cruidal hunters, as i fellow a nate, si\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"\"to her bearings,\" as the captain said, \"\n",
      "\"to her bearings,\" as the captain said, i had a\n",
      "place in tihtbouims, we five, came; and down we open or over\n",
      "\"he mwnog\n",
      "\n",
      "\"my ears,\" said wh. \"o'bar.-\n",
      "\"my cawe can peoliation i know ah, irelatured him\n",
      "i could publy that he is at muck to the felting, i had seen ht a rum b                     nyius !\" but\n",
      "g. mield dischater, and still as the\n",
      "gentlepled year only that grect med and.\n",
      "\n",
      "\"along! for that was i\n",
      "have lawk, so it, rate \n",
      "132454/132454 [==============================] - 90s 680us/sample - loss: 1.1817\n",
      "Epoch 41/60\n",
      "132352/132454 [============================>.] - ETA: 0s - loss: 1.1803****************************************************************************\n",
      "----- Generating text after Epoch: 40\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"r peak.\n",
      "\n",
      "alongside lay one of the gigs\"\n",
      "r peak.\n",
      "\n",
      "alongside lay one of the gigs and down the color to the stockade, and the signal hissifing the copy and done and the pirates had spite the color the pirates and way was the most companions was a start of the four bore and the stockade and sealt of the stockade and looking on the stockade, and the stockade and steel the council, and sailed to the sures, and the stockade and still had been the worst of the color of the sea to t\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"r peak.\n",
      "\n",
      "alongside lay one of the gigs\"\n",
      "r peak.\n",
      "\n",
      "alongside lay one of the gigs. i first they were like the pirates of the schooner severay the captain spoils was steelly the parted of the trum had lay to the treasure.\n",
      "                                                                                                                                                                                                                                                                   \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"r peak.\n",
      "\n",
      "alongside lay one of the gigs\"\n",
      "r peak.\n",
      "\n",
      "alongside lay one of the gigs of amademence\n",
      "exces, speaking, speaking--and deedly troub't george. now for\n",
      "i\n",
      "was on among\n",
      "came of the two four good night, and it\n",
      "was a copy inside, i should no  hune aning firedions -how to the\n",
      "colors, he was or faw my eyes provide her\n",
      "must becosicious that was\n",
      "good jabef for him, we haller the by out\n",
      "sailingss, they i sake, cooking sse\"rth up, i decifal\n",
      "tell us first of curcee, have,\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"r peak.\n",
      "\n",
      "alongside lay one of the gigs\"\n",
      "r peak.\n",
      "\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "alongside lay one of the gigs adajiney.\" madessot, turned before it, aerily, tobbess, george reture part ingbogming in the shouldered down was pointiol counse fall intenking voluelles above\n",
      "ristle my slocked about nem every renth his shore,\n",
      "and as i redert; blabling varying furthing\n",
      "the diriccery to little fall\n",
      "that settary. he rever. we don't between the just meding to passes, more traced helped through the schrieation,\n",
      "132454/132454 [==============================] - 88s 662us/sample - loss: 1.1803\n",
      "Epoch 42/60\n",
      "132352/132454 [============================>.] - ETA: 0s - loss: 1.1753****************************************************************************\n",
      "----- Generating text after Epoch: 41\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"as the other.\n",
      "\n",
      "\"the captain's wounded,\"\n",
      "as the other.\n",
      "\n",
      "\"the captain's wounded,\" said the southouse.\n",
      "\n",
      "\"well, we'll do my hand and the sea-changs to see the corner of the captain and the woods and setted he was stood on the cabin was the shorestioms was the shorestims was the southee was stood of the stockade, and the council was a country, and the trees of the stockade, and the stockade, and a steep of the stockade, and the doctor had stopped of the woods and the cabin was\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"as the other.\n",
      "\n",
      "\"the captain's wounded,\"\n",
      "as the other.\n",
      "\n",
      "\"the captain's wounded,\" said he. \"i'll be sure the captain and the neither showed his landom, and the old blessed and the last with a handle the council was not the paling with him, and when i set him an eye the nead and the most country.\n",
      "\n",
      "\"well, well, sir,\" said he, \"if i've the landly,\" said he.\n",
      "\n",
      "\"i went the ishall to see and you see, and with the berous shoulder, were and set of the shorest, which was ourselves \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"as the other.\n",
      "\n",
      "\"the captain's wounded,\"\n",
      "as the other.\n",
      "\n",
      "\"the captain's wounded,\" campled morgor, \"allfor aud's a good deal to tell you bat came to see the wistle, and were suddenlied a some\n",
      "well, muding, you wouldn't here, you lies no, down.\"\n",
      "\n",
      "i was thought, and of\n",
      "coracle., you gentlandarabled eyes, air.\n",
      "\n",
      "so suddence.\n",
      "\n",
      "\"the \"right to me upon yourses! mrent took my boy and this can and just down and ready a side ooken.\n",
      "   \"and came o' gentle shodled, and a feer back\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"as the other.\n",
      "\n",
      "\"the captain's wounded,\"\n",
      "as the other.\n",
      "\n",
      "\"the captain's wounded,\" said he, which he right\n",
      "up to rrise for us. all we come furthncher and\n",
      "stribt unible never he came, kindle ooherd 'ules and the disher. now hand.\n",
      "\n",
      "in a dropped.\n",
      "\n",
      "ad.jifrell then i till pauseds, and drevenk of make an pines. when the stica of me\n",
      " you case bay i\n",
      "?\"\n",
      "\n",
      "\"well,\" said inforjure,\n",
      "\n",
      "    body, and\n",
      "slymng the the out liibly--huble, thunder!be fellones, now legfir, too cut !\" he \n",
      "132454/132454 [==============================] - 86s 652us/sample - loss: 1.1753\n",
      "Epoch 43/60\n",
      "131968/132454 [============================>.] - ETA: 0s - loss: 1.1729****************************************************************************\n",
      "----- Generating text after Epoch: 42\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"s was not so easily answered. there had \"\n",
      "s was not so easily answered. there had had been the bottle of the story. the sun the woods and dead, and the boots. we were sure i say with the boats. the boat barrel to the stockade, and the sea-changed of the boats. the captain was not only to the stockade, and the first that was was no more that was a sea\n",
      "with the shore. and the book and the man and the boots. the stick of the stockade, and the words of the stockade, and the words \n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"s was not so easily answered. there had \"\n",
      "s was not so easily answered. there had was belan, who had as went been a bottle of his bottles was all the stand of an trelawney, and sailed by port, and all the still to inter the pirates.\n",
      "\n",
      "\"well, when there's way to that and so much there was on the house, and i was clother a corner of the stockade, and and what our lainter of the first that was the redruth with a since was a sea, and the suddenggly looking to the excave of the thr\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"s was not so easily answered. there had \"\n",
      "s was not so easily answered. there had united it\n",
      "possible before rissiuy, there was so sure to so much i have i a turned compent or up his work and fellows; of\n",
      "a precaile.\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "eying has sa; bus migenning--partaie copytself bitw vielloweds. i went under was were without wrey his folured forgonty nives, cuor upon the\n",
      "electrr. my hang accease, and by the\n",
      "three watch, which that beside goed his amortion, by the captain we've b\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"s was not so easily answered. there had \"\n",
      "s was not so easily answered. there had no more fellow at last itsed complate good no\n",
      "allows is that instant. then when\n",
      "\"anksways ; iting long that would have trowled to never i\n",
      "seen i coulded newway, from the fropigion\n",
      "\n",
      "iot onse us, in the voice and wookedned sea--the iefed, mr. felther crallok. spesse place, and\n",
      "teaty in\n",
      "mise, and i'll forgat a hasos, by\n",
      "treas myself nearer taking upnarted, and     \"i tell plessed for\n",
      "him, by\n",
      "132454/132454 [==============================] - 85s 643us/sample - loss: 1.1731\n",
      "Epoch 44/60\n",
      "132096/132454 [============================>.] - ETA: 0s - loss: 1.1714****************************************************************************\n",
      "----- Generating text after Epoch: 43\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"e; and from that moment i\n",
      "began to regr\"\n",
      "e; and from that moment i\n",
      "began to regred and the pirate to his stick was still to the ship and the sure the paling ashore and the stockade, and the black spot the shorestoother and the stockade, and a suddenly the particulargly to the shorestoother and a settle of the councition of the stockade, and when i had a still speaking.\n",
      "\n",
      "\"well, i'll take the sea, and then he was a such any and the sure the party was all the boots about the m\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"e; and from that moment i\n",
      "began to regr\"\n",
      "e; and from that moment i\n",
      "began to regred to his companions of the cabin something a still under the stockade, and a suddenly the pull color which we were a child home all our spot the color silver had slepolmaning coming with a sent on deck.\n",
      "\n",
      "\"i could not sure the project gutenberg-tm wood. the stockade, which was still but at the sign of the stockade like a little falling she spone more all the stranger, and i was the speck, i had \n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"e; and from that moment i\n",
      "began to regr\"\n",
      "e; and from that moment i\n",
      "began to regrergunce. \"\n",
      "i said hurinden side, but tumble for settle some spanior had leading in certy shores on anso against ended to the sign courage _whatp of him we had sure each but the spares of me on us taken with my pinched to randor and\n",
      "deach in old scull he came, and\n",
      "step\n",
      "torth aposped prove\n",
      "you o?' now, nothing and had at the nibeow who thinges and we stull of nothead insulatc. long before he st\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"e; and from that moment i\n",
      "began to regr\"\n",
      "e; and from that moment i\n",
      "began to regrest\n",
      "sepiting he had to\n",
      "that old gral, allud, and you're he, may online to smis to you, disting that\n",
      "do 'ur\n",
      "branged in my prace for place. \"well, haverch a-stemple had made treasle the\n",
      "breathes, would he had to me, there had come the jolly was upper old branced about the paid him poom\n",
      "risk to bowing oard, while on the\n",
      "mighty already cour conceioue by our contapturs\n",
      "upon my mother at their h\n",
      "132454/132454 [==============================] - 175s 1ms/sample - loss: 1.1716\n",
      "Epoch 45/60\n",
      "132352/132454 [============================>.] - ETA: 0s - loss: 1.1688****************************************************************************\n",
      "----- Generating text after Epoch: 44\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"mart, too,\" answered silver, shaking\n",
      "ha\"\n",
      "mart, too,\" answered silver, shaking\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "half a state me and the stockade and the stark and sailed on the stockade and the stockade and a steep and see the story. they had see the coracle of the stockade of the boat. the coracle to the stockade and the stockade and a settle of the side of the stockade and the board was a sight of the coracler, where he was a good man the\n",
      "told his companion, and we had a set my face of the same business to\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"mart, too,\" answered silver, shaking\n",
      "ha\"\n",
      "mart, too,\" answered silver, shaking\n",
      "halfweave a step before me and ready the not once mought.\n",
      "\n",
      "the stor. at the first that was a pitch and skiet of the bootse of the trees.\n",
      "\n",
      "\"cap'n!s, as he that doctor you may comotn the in and jung be come to be surpriled, but was a whom and we had been the strange of the cook of and fresher, they had stonger at the sea-strang at the\n",
      "bright and waiting the stockade of the corner was the stockade\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"mart, too,\" answered silver, shaking\n",
      "ha\"\n",
      "mart, too,\" answered silver, shaking\n",
      "hard all i amove no postor, from the right.\n",
      "\n",
      "\"nove thought taine.\"\n",
      "\n",
      "of rejc(rraive the door bagge bustition began to pause errat and given lends, the capnable, and are body and thid the little shresp chill was overgaved,\n",
      "                           si\n",
      "nitged or !\" he cried at .  _fiviii\n",
      "\n",
      "i had taking to have\n",
      "do too my little ; "
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "C:\\Users\\jheaton\\Miniconda3\\envs\\tensorflow\\lib\\site-packages\\ipykernel_launcher.py:4: RuntimeWarning: divide by zero encountered in log\n",
      "  after removing the cwd from sys.path.\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "over his face, treasure very long from own hands where he thind; \n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"mart, too,\" answered silver, shaking\n",
      "ha\"\n",
      "mart, too,\" answered silver, shaking\n",
      "has a way wading ill hear twober swidas. put,\n",
      "\"first.\"\n",
      "\n",
      "cever of\n",
      "to \n",
      " nootine i pitted that we had saw by his conloon and\n",
      ", this erought act of itsens instoned eyerations wear the\n",
      "aitvooh risially; an't were of roatide \n",
      "they don't more know, black wigh man keep your chim--buly before much.\"\n",
      "\n",
      "whether who had been a rud! i\n",
      "compled.\n",
      "\n",
      "\"well, i're adamt, as i know alo oped a'sing oye--told\n",
      "132454/132454 [==============================] - 107s 810us/sample - loss: 1.1689\n",
      "Epoch 46/60\n",
      "131968/132454 [============================>.] - ETA: 0s - loss: 1.1666****************************************************************************\n",
      "----- Generating text after Epoch: 45\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"mpanied their examination, you would hav\"\n",
      "mpanied their examination, you would have be a man about the boat, and the sure the party of the captain smollett of the captain smollett of the boats, and the pirates were and sure the project gutenberg-tm a sun the stockade, and the man and stores of the stockade, and the country, and the surery and the pirates were all the strangers and the piece, and the party of the spit, and a sea.\n",
      "\n",
      "\"why, \"as you are the party of my word and the\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"mpanied their examination, you would hav\"\n",
      "mpanied their examination, you would have had stare the\n",
      "sailor.  and were the house.\n",
      "\n",
      "\"the man seemed a landle saile, that's what it done and the blind upon the way the close was the fear pirates of the spit, and a settle of the more a mile of\n",
      "the sea-silves of\n",
      "the first was now that he saile all the more or his mouth as we began to\n",
      "sea.\n",
      "\n",
      "\"well, i'll be the more on the more was soon is a cruit of\n",
      "companions to call the said, an\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"mpanied their examination, you would hav\"\n",
      "mpanied their examination, you would have for send necet shiffine up his good the leaping hung just there was a strange\n",
      "not high, and theie sick the council,\n",
      "by nordage was\n",
      "gay when. now, i set to reland dehenction, forth armed, and no behind me, as silver seaward, silver. but let him the pinely of own\n",
      "night. upsterment that these remembered\n",
      "or his eyely do-that at     and been alm\n",
      "too the\n",
      "mighten of a going on the chance, and so\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"mpanied their examination, you would hav\"\n",
      "mpanied their examination, you would have set\n",
      "hinge ships-to see it, ohs things and over lives,n that disafeted, and the wind, stepre\n",
      "bestet; staying a little.\n",
      "\n",
      "\"any.\"\n",
      "\n",
      "\"wewe had a knew swmy, old thou-land\n",
      "either \n",
      "\n",
      "\n",
      "the most a mofey.\n",
      "leveryirles out theoce to save himself--doction\". \n",
      "never, we\n",
      "doutseed, it direce i missill might hive to ble\n",
      "open this. black\n",
      "paused, meanting, xjuitions--'etrely out sirging of the certainly\n",
      "132454/132454 [==============================] - 104s 786us/sample - loss: 1.1665\n",
      "Epoch 47/60\n",
      "131968/132454 [============================>.] - ETA: 0s - loss: 1.1629****************************************************************************\n",
      "----- Generating text after Epoch: 46\n",
      "----- temperature: 0.2\n",
      "----- Generating with seed: \"ir possession, when the kneeling\n",
      "figure\"\n",
      "ir possession, when the kneeling\n",
      "figure.\n",
      "\n",
      "\"silver,\" said i.\n",
      "\n",
      "\"ay, by the ship were and the ship if i seen the story the captain started to his stor the party and a pitted of the woods and a pipene and the first that was a sun the woods in the sea-chance and a pitted of and pipenes, and the first they were all with the fore that was a pipe and a pipe of the story.\n",
      "\n",
      "\"you was a broad for the man and a man was sure the party and a pi\n",
      "----- temperature: 0.5\n",
      "----- Generating with seed: \"ir possession, when the kneeling\n",
      "figure\"\n",
      "ir possession, when the kneeling\n",
      "figure. he was step for the worst of the captain starting and the ball regren as fass of the captain started on the woods in one of the boat and bearing started\n",
      "and party the first was the feet were a piperal had been steped in the spit, and the far of the stern so that i had swailed the chart. then we began to fated the captain the project gutenberg-tm word on the mounation of the captain stand to giv\n",
      "----- temperature: 1.0\n",
      "----- Generating with seed: \"ir possession, when the kneeling\n",
      "figure\"\n",
      "ir possession, when the kneeling\n",
      "figure, and all, once, made, papeed to bleady, but ship herew. i had speaken to which you just\n",
      "earty  the trader quept the captain steady\n",
      "there passed, and the stead stand\n",
      "oen shoughery answered to the sand.\n",
      "\n",
      "i tell a better\n",
      "lober, before remeated at last, passed the msfore to a admire in party as\n",
      "\n",
      "    junile rightly she quite thus by the woods in a heart\n",
      "going for missicing till and the slofe.\n",
      "----- temperature: 1.2\n",
      "----- Generating with seed: \"ir possession, when the kneeling\n",
      "figure\"\n",
      "ir possession, when the kneeling\n",
      "figure. revild.\n",
      "\n",
      "\"you can sure it i crossuled do's long to the chimes? who was no yourses, here out a hand                             sid.  gxva5t, from keep is"
     ]
    }
   ],
   "source": [
    "# Ignore useless W0819 warnings generated by TensorFlow 2.0.  Hopefully can remove this ignore in the future.\n",
    "# See https://github.com/tensorflow/tensorflow/issues/31308\n",
    "import logging, os\n",
    "logging.disable(logging.WARNING)\n",
    "os.environ[\"TF_CPP_MIN_LOG_LEVEL\"] = \"3\"\n",
    "\n",
    "# Fit the model\n",
    "print_callback = LambdaCallback(on_epoch_end=on_epoch_end)\n",
    "\n",
    "model.fit(x, y,\n",
    "          batch_size=128,\n",
    "          epochs=60,\n",
    "          callbacks=[print_callback])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python 3.7 (tensorflow)",
   "language": "python",
   "name": "tensorflow"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.5"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}