03_training.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Implementing the `MiniBach` model"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Part 3: Training the network"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In this step, we take the one-hot-encoded input and output vectors from Part 2 to train the neural network."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "import numpy as np\n",
    "import pandas as pd\n",
    "import tensorflow as tf\n",
    "from tensorflow import keras\n",
    "import music21\n",
    "\n",
    "pd.set_option('display.max_columns', 500)\n",
    "pd.set_option('display.max_rows', 500)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We load the one-hot-encoded vectors (computed in the last part of this tutorial)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "x = np.load('input.npy')\n",
    "y = np.load('output.npy')\n",
    "\n",
    "input_length = x.shape[1]\n",
    "output_length = y.shape[1]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The `MiniBach` architecture consists of\n",
    "- An input layer with 1664 units (originally 1344, but we extended it in Part 2, because the range of notes was not enough)\n",
    "- A hidden layer of 200 units\n",
    "- An output layer with 4928 units (originally 4480, same argument as the input layer)\n",
    "\n",
    "The output layer will be separated into three chunks of data, one for each part (alto, tenor, and bass). Within those chunks, we have the predictions corresponding to each of the 64 sixteenth-note timesteps.\n",
    "\n",
    "As this is a multi multi-class classification problem, the activation layer of the output is a `sigmoid` function and it is trained using a binary loss."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "model = keras.Sequential([\n",
    "    keras.layers.Flatten(input_shape=(input_length,)),    \n",
    "    keras.layers.Dense(200, activation='relu'),    \n",
    "    keras.layers.Dense(output_length, activation='sigmoid')\n",
    "])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The optimizer of the model is not discussed in the book.\n",
    "\n",
    "Here, we use the `adam` optimizer."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "model.compile(optimizer='adam',\n",
    "              loss='binary_crossentropy',\n",
    "              metrics=['binary_accuracy'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Epoch 1/10\n",
      "105/105 [==============================] - 1s 8ms/step - loss: 0.1274 - binary_accuracy: 0.9727\n",
      "Epoch 2/10\n",
      "105/105 [==============================] - 1s 8ms/step - loss: 0.0558 - binary_accuracy: 0.9846\n",
      "Epoch 3/10\n",
      "105/105 [==============================] - 1s 8ms/step - loss: 0.0539 - binary_accuracy: 0.9846\n",
      "Epoch 4/10\n",
      "105/105 [==============================] - 1s 8ms/step - loss: 0.0523 - binary_accuracy: 0.9847\n",
      "Epoch 5/10\n",
      "105/105 [==============================] - 1s 8ms/step - loss: 0.0512 - binary_accuracy: 0.9848\n",
      "Epoch 6/10\n",
      "105/105 [==============================] - 1s 8ms/step - loss: 0.0504 - binary_accuracy: 0.9849\n",
      "Epoch 7/10\n",
      "105/105 [==============================] - 1s 8ms/step - loss: 0.0497 - binary_accuracy: 0.9850\n",
      "Epoch 8/10\n",
      "105/105 [==============================] - 1s 8ms/step - loss: 0.0489 - binary_accuracy: 0.9851\n",
      "Epoch 9/10\n",
      "105/105 [==============================] - 1s 8ms/step - loss: 0.0482 - binary_accuracy: 0.9852\n",
      "Epoch 10/10\n",
      "105/105 [==============================] - 1s 8ms/step - loss: 0.0475 - binary_accuracy: 0.9853\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "<tensorflow.python.keras.callbacks.History at 0x7f16cc6d8af0>"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "model.fit(x, y, epochs=10)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "model.save('trained_model.h5')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We have successfully trained and saved the model!\n",
    "\n",
    "At this point, we are ready for generating some chorales! \n",
    "\n",
    "But before that, let's try predicting the accompaniment for one of the training examples."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "soprano = x[200]\n",
    "predictions = model.predict(soprano.reshape(1, -1))\n",
    "\n",
    "predictions = predictions.reshape(-1)\n",
    "\n",
    "soprano = soprano.reshape(64, -1)\n",
    "alto = predictions[:1536].reshape(64, -1)\n",
    "tenor = predictions[1536:3008].reshape(64, -1)\n",
    "bass = predictions[3008:4928].reshape(64, -1)\n",
    "\n",
    "music = {\n",
    "    'soprano': soprano,\n",
    "    'alto': alto,\n",
    "    'tenor': tenor,\n",
    "    'bass': bass\n",
    "}"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's try example 200. \n",
    "\n",
    "After obtaining the predictions from the model, we split the chunks of data into their corresponding part and `reshape` the arrays to access their 64-timesteps. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "SOPRANO_MIN = 57\n",
    "SOPRANO_MAX = 81\n",
    "\n",
    "ALTO_MIN = 52\n",
    "ALTO_MAX = 74\n",
    "\n",
    "TENOR_MIN = 48\n",
    "TENOR_MAX = 69\n",
    "\n",
    "BASS_MIN = 36\n",
    "BASS_MAX = 64\n",
    "\n",
    "ranges = {\n",
    "    'soprano': {midinumber: (midinumber - SOPRANO_MIN + 1) for midinumber in range(SOPRANO_MIN, SOPRANO_MAX + 1)},\n",
    "    'alto': {midinumber: (midinumber - ALTO_MIN + 1) for midinumber in range(ALTO_MIN, ALTO_MAX + 1)},\n",
    "    'tenor': {midinumber: (midinumber - TENOR_MIN + 1) for midinumber in range(TENOR_MIN, TENOR_MAX + 1)},\n",
    "    'bass': {midinumber: (midinumber - BASS_MIN + 1) for midinumber in range(BASS_MIN, BASS_MAX + 1)},\n",
    "}\n",
    "\n",
    "reverse_ranges = {\n",
    "    'soprano': {(midinumber - SOPRANO_MIN + 1): midinumber for midinumber in range(SOPRANO_MIN, SOPRANO_MAX + 1)},\n",
    "    'alto': {(midinumber - ALTO_MIN + 1): midinumber for midinumber in range(ALTO_MIN, ALTO_MAX + 1)},\n",
    "    'tenor': {(midinumber - TENOR_MIN + 1): midinumber for midinumber in range(TENOR_MIN, TENOR_MAX + 1)},\n",
    "    'bass': {(midinumber - BASS_MIN + 1): midinumber for midinumber in range(BASS_MIN, BASS_MAX + 1)},\n",
    "}"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "def decode_note(n, rang):\n",
    "    if n == 0:\n",
    "        ret = '--'\n",
    "    else:\n",
    "        note = music21.note.Note(type='16th')        \n",
    "        note.pitch.midi = reverse_ranges[rang][n]        \n",
    "        ret = note\n",
    "    return ret"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "generation = {\n",
    "    'soprano': [],\n",
    "    'alto': [],\n",
    "    'tenor': [],\n",
    "    'bass': []\n",
    "}\n",
    "\n",
    "for sixteenth in range(64):\n",
    "    for part, notes in music.items():\n",
    "        this_note = decode_note(np.argmax(notes[sixteenth]), part)\n",
    "        if this_note == '--':\n",
    "            last_note = generation[part][-1]\n",
    "            this_note = music21.note.Note(last_note.pitch.nameWithOctave, type='16th')\n",
    "            if last_note.tie:\n",
    "                this_note.tie = music21.tie.Tie('continue')\n",
    "            else:\n",
    "                last_note.tie = music21.tie.Tie('start')\n",
    "                generation[part][-1] = last_note\n",
    "                this_note.tie = music21.tie.Tie('continue')\n",
    "        else:\n",
    "            if sixteenth > 0:\n",
    "                last_note = generation[part][-1]\n",
    "                if last_note.tie:\n",
    "                    last_note.tie = music21.tie.Tie('stop')\n",
    "        generation[part].append(this_note)    "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [],
   "source": [
    "df = pd.DataFrame(generation)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>soprano</th>\n",
       "      <th>alto</th>\n",
       "      <th>tenor</th>\n",
       "      <th>bass</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>&lt;music21.note.Note G&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>&lt;music21.note.Note G&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>&lt;music21.note.Note G&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>&lt;music21.note.Note G&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>&lt;music21.note.Note G#&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note E-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>&lt;music21.note.Note G#&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note E-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>&lt;music21.note.Note G#&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note E-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>&lt;music21.note.Note G#&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note E-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>&lt;music21.note.Note G#&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>&lt;music21.note.Note G#&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>&lt;music21.note.Note G#&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>&lt;music21.note.Note G#&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32</th>\n",
       "      <td>&lt;music21.note.Note G&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>&lt;music21.note.Note G&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>34</th>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35</th>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>36</th>\n",
       "      <td>&lt;music21.note.Note G#&gt;</td>\n",
       "      <td>&lt;music21.note.Note E-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>37</th>\n",
       "      <td>&lt;music21.note.Note G#&gt;</td>\n",
       "      <td>&lt;music21.note.Note E-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>38</th>\n",
       "      <td>&lt;music21.note.Note G&gt;</td>\n",
       "      <td>&lt;music21.note.Note E-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>39</th>\n",
       "      <td>&lt;music21.note.Note G&gt;</td>\n",
       "      <td>&lt;music21.note.Note E-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>40</th>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note D&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>41</th>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note D&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>42</th>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note D&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>43</th>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note D&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>44</th>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note D&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>45</th>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note D&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46</th>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note D&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>47</th>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note D&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>48</th>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>49</th>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>50</th>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>51</th>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>52</th>\n",
       "      <td>&lt;music21.note.Note G&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>53</th>\n",
       "      <td>&lt;music21.note.Note G&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>54</th>\n",
       "      <td>&lt;music21.note.Note G&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55</th>\n",
       "      <td>&lt;music21.note.Note G&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>56</th>\n",
       "      <td>&lt;music21.note.Note G#&gt;</td>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>57</th>\n",
       "      <td>&lt;music21.note.Note G#&gt;</td>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>58</th>\n",
       "      <td>&lt;music21.note.Note G#&gt;</td>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>59</th>\n",
       "      <td>&lt;music21.note.Note G#&gt;</td>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note C&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>60</th>\n",
       "      <td>&lt;music21.note.Note G&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>61</th>\n",
       "      <td>&lt;music21.note.Note G&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>62</th>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>63</th>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "      <td>&lt;music21.note.Note B-&gt;</td>\n",
       "      <td>&lt;music21.note.Note F&gt;</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                   soprano                    alto                   tenor  \\\n",
       "0    <music21.note.Note C>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "1    <music21.note.Note C>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "2    <music21.note.Note C>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "3    <music21.note.Note C>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "4    <music21.note.Note C>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "5    <music21.note.Note C>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "6    <music21.note.Note C>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "7    <music21.note.Note C>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "8   <music21.note.Note B->   <music21.note.Note F>  <music21.note.Note B->   \n",
       "9   <music21.note.Note B->   <music21.note.Note F>  <music21.note.Note B->   \n",
       "10  <music21.note.Note B->   <music21.note.Note F>  <music21.note.Note B->   \n",
       "11  <music21.note.Note B->   <music21.note.Note F>  <music21.note.Note B->   \n",
       "12  <music21.note.Note B->   <music21.note.Note F>  <music21.note.Note B->   \n",
       "13  <music21.note.Note B->   <music21.note.Note F>  <music21.note.Note B->   \n",
       "14  <music21.note.Note B->   <music21.note.Note F>  <music21.note.Note B->   \n",
       "15  <music21.note.Note B->   <music21.note.Note F>  <music21.note.Note B->   \n",
       "16   <music21.note.Note F>   <music21.note.Note F>   <music21.note.Note C>   \n",
       "17   <music21.note.Note F>   <music21.note.Note F>   <music21.note.Note C>   \n",
       "18   <music21.note.Note F>   <music21.note.Note F>   <music21.note.Note C>   \n",
       "19   <music21.note.Note F>   <music21.note.Note F>   <music21.note.Note C>   \n",
       "20   <music21.note.Note G>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "21   <music21.note.Note G>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "22   <music21.note.Note G>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "23   <music21.note.Note G>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "24  <music21.note.Note G#>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "25  <music21.note.Note G#>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "26  <music21.note.Note G#>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "27  <music21.note.Note G#>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "28  <music21.note.Note G#>   <music21.note.Note F>   <music21.note.Note C>   \n",
       "29  <music21.note.Note G#>   <music21.note.Note F>   <music21.note.Note C>   \n",
       "30  <music21.note.Note G#>   <music21.note.Note F>   <music21.note.Note C>   \n",
       "31  <music21.note.Note G#>   <music21.note.Note F>   <music21.note.Note C>   \n",
       "32   <music21.note.Note G>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "33   <music21.note.Note G>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "34  <music21.note.Note B->   <music21.note.Note F>  <music21.note.Note B->   \n",
       "35  <music21.note.Note B->   <music21.note.Note F>  <music21.note.Note B->   \n",
       "36  <music21.note.Note G#>  <music21.note.Note E->  <music21.note.Note B->   \n",
       "37  <music21.note.Note G#>  <music21.note.Note E->  <music21.note.Note B->   \n",
       "38   <music21.note.Note G>  <music21.note.Note E->  <music21.note.Note B->   \n",
       "39   <music21.note.Note G>  <music21.note.Note E->  <music21.note.Note B->   \n",
       "40   <music21.note.Note F>   <music21.note.Note D>  <music21.note.Note B->   \n",
       "41   <music21.note.Note F>   <music21.note.Note D>  <music21.note.Note B->   \n",
       "42   <music21.note.Note F>   <music21.note.Note D>  <music21.note.Note B->   \n",
       "43   <music21.note.Note F>   <music21.note.Note D>  <music21.note.Note B->   \n",
       "44   <music21.note.Note F>   <music21.note.Note D>  <music21.note.Note B->   \n",
       "45   <music21.note.Note F>   <music21.note.Note D>  <music21.note.Note B->   \n",
       "46   <music21.note.Note F>   <music21.note.Note D>  <music21.note.Note B->   \n",
       "47   <music21.note.Note F>   <music21.note.Note D>  <music21.note.Note B->   \n",
       "48  <music21.note.Note B->   <music21.note.Note F>  <music21.note.Note B->   \n",
       "49  <music21.note.Note B->   <music21.note.Note F>  <music21.note.Note B->   \n",
       "50  <music21.note.Note B->   <music21.note.Note F>  <music21.note.Note B->   \n",
       "51  <music21.note.Note B->   <music21.note.Note F>  <music21.note.Note B->   \n",
       "52   <music21.note.Note G>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "53   <music21.note.Note G>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "54   <music21.note.Note G>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "55   <music21.note.Note G>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "56  <music21.note.Note G#>   <music21.note.Note C>  <music21.note.Note B->   \n",
       "57  <music21.note.Note G#>   <music21.note.Note C>  <music21.note.Note B->   \n",
       "58  <music21.note.Note G#>   <music21.note.Note C>  <music21.note.Note B->   \n",
       "59  <music21.note.Note G#>   <music21.note.Note C>  <music21.note.Note B->   \n",
       "60   <music21.note.Note G>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "61   <music21.note.Note G>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "62   <music21.note.Note F>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "63   <music21.note.Note F>   <music21.note.Note F>  <music21.note.Note B->   \n",
       "\n",
       "                      bass  \n",
       "0   <music21.note.Note B->  \n",
       "1   <music21.note.Note B->  \n",
       "2   <music21.note.Note B->  \n",
       "3   <music21.note.Note B->  \n",
       "4   <music21.note.Note B->  \n",
       "5   <music21.note.Note B->  \n",
       "6   <music21.note.Note B->  \n",
       "7   <music21.note.Note B->  \n",
       "8   <music21.note.Note B->  \n",
       "9   <music21.note.Note B->  \n",
       "10  <music21.note.Note B->  \n",
       "11  <music21.note.Note B->  \n",
       "12  <music21.note.Note B->  \n",
       "13  <music21.note.Note B->  \n",
       "14  <music21.note.Note B->  \n",
       "15  <music21.note.Note B->  \n",
       "16  <music21.note.Note B->  \n",
       "17  <music21.note.Note B->  \n",
       "18  <music21.note.Note B->  \n",
       "19  <music21.note.Note B->  \n",
       "20  <music21.note.Note B->  \n",
       "21  <music21.note.Note B->  \n",
       "22  <music21.note.Note B->  \n",
       "23  <music21.note.Note B->  \n",
       "24  <music21.note.Note E->  \n",
       "25  <music21.note.Note E->  \n",
       "26  <music21.note.Note E->  \n",
       "27  <music21.note.Note E->  \n",
       "28   <music21.note.Note F>  \n",
       "29   <music21.note.Note F>  \n",
       "30   <music21.note.Note F>  \n",
       "31   <music21.note.Note F>  \n",
       "32  <music21.note.Note B->  \n",
       "33  <music21.note.Note B->  \n",
       "34  <music21.note.Note B->  \n",
       "35  <music21.note.Note B->  \n",
       "36  <music21.note.Note B->  \n",
       "37  <music21.note.Note B->  \n",
       "38  <music21.note.Note B->  \n",
       "39  <music21.note.Note B->  \n",
       "40  <music21.note.Note B->  \n",
       "41  <music21.note.Note B->  \n",
       "42  <music21.note.Note B->  \n",
       "43  <music21.note.Note B->  \n",
       "44  <music21.note.Note B->  \n",
       "45  <music21.note.Note B->  \n",
       "46  <music21.note.Note B->  \n",
       "47  <music21.note.Note B->  \n",
       "48  <music21.note.Note B->  \n",
       "49  <music21.note.Note B->  \n",
       "50  <music21.note.Note B->  \n",
       "51  <music21.note.Note B->  \n",
       "52  <music21.note.Note B->  \n",
       "53  <music21.note.Note B->  \n",
       "54  <music21.note.Note B->  \n",
       "55  <music21.note.Note B->  \n",
       "56   <music21.note.Note C>  \n",
       "57   <music21.note.Note C>  \n",
       "58   <music21.note.Note C>  \n",
       "59   <music21.note.Note C>  \n",
       "60   <music21.note.Note F>  \n",
       "61   <music21.note.Note F>  \n",
       "62   <music21.note.Note F>  \n",
       "63   <music21.note.Note F>  "
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "s = music21.stream.Stream()\n",
    "s.append(df.soprano.to_list())\n",
    "a = music21.stream.Stream()\n",
    "a.append(df.alto.to_list())\n",
    "t = music21.stream.Stream()\n",
    "t.append(df.tenor.to_list())\n",
    "b = music21.stream.Stream()\n",
    "b.append(df.bass.to_list())\n",
    "stream = music21.stream.Stream([s,a,t,b])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'/home/napulen/dev/MiniBach/example.musicxml'"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "stream.write('musicxml', 'example.musicxml')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "After this step, we have trained and saved a `MiniBach` model. \n",
    "\n",
    "We also used the model to predict the values of one of the training examples.\n",
    "\n",
    "The next step is to try the model on an arbitrary melody. We will do that in the last part."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3.8.2 64-bit",
   "language": "python",
   "name": "python38264bit3096ab794bfa49e88dd2c11f522e534a"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}