code/appendix_h_numpy-intro/appendix_numpy-intro.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "*Accompanying code examples of the book \"Introduction to Artificial Neural Networks and Deep Learning: A Practical Guide with Applications in Python\" by [Sebastian Raschka](https://sebastianraschka.com). All code examples are released under the [MIT license](https://github.com/rasbt/deep-learning-book/blob/master/LICENSE). If you find this content useful, please consider supporting the work by buying a [copy of the book](https://leanpub.com/ann-and-deeplearning).*\n",
    "\n",
    "Other code examples and content are available on [GitHub](https://github.com/rasbt/deep-learning-book). The PDF and ebook versions of the book are available through [Leanpub](https://leanpub.com/ann-and-deeplearning)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Appendix - Introduction to NumPy"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- [Scientific Computing in NumPy](#Scientific-Computing-in-NumPy)\n",
    "- [N-dimensional Arrays](#N-dimensional-Arrays)\n",
    "- [Array Construction Routines](#Array-Construction-Routines)\n",
    "- [Array Indexing](#Array-Indexing)\n",
    "- [Array Math and Universal Functions](#Array-Math-and-Universal-Functions)\n",
    "- [Broadcasting](#Broadcasting)\n",
    "- [Advanced Indexing -- Memory Views and Copies](#Advanced-Indexing----Memory-Views-and-Copies)\n",
    "- [Comparison Operators and Masks](#Comparison-Operators-and-Masks)\n",
    "- [Random Number Generators](#Random-Number-Generators)\n",
    "- [Reshaping Arrays](#Reshaping-Arrays)\n",
    "- [Linear Algebra with NumPy Arrays](#Linear-Algebra-with-NumPy-Arrays)\n",
    "- [Set Operations](#Set-Operations)\n",
    "- [Serializing NumPy Arrays](#Serializing-NumPy-Arrays)\n",
    "- [Conclusion](#Conclusion)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "%load_ext watermark"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "format": "row"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Sebastian Raschka \n",
      "\n",
      "numpy 1.12.1\n"
     ]
    }
   ],
   "source": [
    "%watermark -a 'Sebastian Raschka' -p numpy"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Scientific Computing in NumPy"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This appendix offers a quick tour of the NumPy library for working with multi-dimensional arrays in Python. NumPy (short for Numerical Python) was created by Travis Oliphant in 2005, by merging Numarray into Numeric. Since then, the open source NumPy library has evolved into an essential library for scientific computing in Python and has become a building block of many other scientific libraries, such as SciPy, Scikit-learn, Pandas, and others.\n",
    "What makes NumPy so particularly attractive to the scientific community is that it provides a convenient Python interface for working with multi-dimensional array data structures efficiently; the NumPy array data structure is also called `ndarray`, which is short for *n*-dimensional array. \n",
    "\n",
    "In addition to being mostly implemented in C and using Python as a \"glue language,\" the main reason why NumPy is so efficient for numerical computations is that NumPy arrays use contiguous blocks of memory that can be efficiently cached by the CPU. In contrast, Python lists are arrays of pointers to objects in random locations in memory, which cannot be easily cached and come with a more expensive memory-look-up. However, the computational efficiency and low-memory footprint come at a cost: NumPy arrays have a fixed size and are homogeneous, which means that all elements must have the same type. Homogenous `ndarray` objects have the advantage that NumPy can carry out operations using efficient C loops and avoid expensive type checks and other overheads of the Python API. While adding and removing elements from the end of a Python list is very efficient, altering the size of a NumPy array is very expensive since it requires to create a new array and carry over the contents of the old array that we want to expand or shrink. \n",
    "\n",
    "Besides being more efficient for numerical computations than native Python code, NumPy can also be more elegant and readable due to vectorized operations and broadcasting, which are features that we will explore in this appendix. While this appendix should be sufficient to follow the code examples in this book if you are new to NumPy, there are many advanced NumPy topics that are beyond the scope of this book. If you are interested in a more in-depth coverage of NumPy, I selected a few resources that could be useful to you:\n",
    "\n",
    "- Rougier, N.P., 2016. [From Python to Numpy](http://www.labri.fr/perso/nrougier/from-python-to-numpy/).\n",
    "- Oliphant, T.E., 2015. A Guide to NumPy: 2nd Edition. USA: Travis Oliphant, independent publishing.\n",
    "- Varoquaux, G., Gouillart, E., Vahtras, O., Haenel, V., Rougier, N.P., Gommers, R., Pedregosa, F., Jędrzejewski-Szmek, Z., Virtanen, P., Combelles, C. and Pinte, D., 2015. [Scipy Lecture Notes](http://www.scipy-lectures.org/intro/numpy/index.html).\n",
    "- [The official NumPy documentation](https://docs.scipy.org/doc/numpy/reference/index.html)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## N-dimensional Arrays"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "NumPy is built around [`ndarrays`](https://docs.scipy.org/doc/numpy/reference/generated/numpy.ndarray.html) objects, which are high-performance multi-dimensional array data structures. Intuitively, we can think of a one-dimensional NumPy array as a data structure to represent a vector of elements -- you may think of it as a fixed-size Python list where all elements share the same type. Similarly, we can think of a two-dimensional array as a data structure to represent a matrix or a Python list of lists. While NumPy arrays can have up to 32 dimensions if it was compiled without alterations to the source code, we will focus on lower-dimensional arrays for the purpose of illustration in this introduction.\n",
    "\n",
    "Now, let us get started with NumPy by calling the `array` function to create a two-dimensional NumPy array, consisting of two rows and three columns, from a list of lists:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[1, 2, 3],\n",
       "       [4, 5, 6]])"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import numpy as np\n",
    "\n",
    "lst = [[1, 2, 3], [4, 5, 6]]\n",
    "ary1d = np.array(lst)\n",
    "ary1d"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "![](images/numpy-intro/array_1.png)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "By default, NumPy infers the type of the array upon construction. Since we passed Python integers to the array, the `ndarray` object `ary1d` should be of type `int64` on a 64-bit machine, which we can confirm by accessing the `dtype` attribute:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "dtype('int64')"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary1d.dtype"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "If we want to construct NumPy arrays of different types, we can pass an argument to the `dtype` parameter of the `array` function, for example `np.int32` to create 32-bit arrays. For a full list of supported data types, please refer to the official [NumPy documentation](https://docs.scipy.org/doc/numpy/user/basics.types.html). Once an array has been constructed, we can downcast or recast its type via the `astype` method as shown in the following example:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 1.,  2.,  3.],\n",
       "       [ 4.,  5.,  6.]], dtype=float32)"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "float32_ary = ary1d.astype(np.float32)\n",
    "float32_ary"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "dtype('float32')"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "float32_ary.dtype"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the following sections we will cover many more aspects of NumPy arrays; however, to conclude this basic introduction to the `ndarray` object, let us take a look at some of its handy attributes.\n",
    "\n",
    "For instance, the `itemsize` attribute returns the size of a single array element in bytes:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "8"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary2d = np.array([[1, 2, 3], \n",
    "                  [4, 5, 6]], dtype='int64')\n",
    "ary2d.itemsize"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The code snippet above returned `8`, which means that each element in the array (remember that `ndarray`s are homogeneous) takes up 8 bytes in memory. This result makes sense since the array `ary2d` has type `int64` (64-bit integer), which we determined earlier, and 8 bits equals 1 byte. (Note that `'int64'` is just a shorthand for `np.int64`.)\n",
    "\n",
    "To return the number of elements in an array, we can use the `size` attribute, as shown below:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "6"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary2d.size"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "And the number of dimensions of our array (Intuitively, you may think of *dimensions* as the *rank* of a tensor) can be obtained via the `ndim` attribute:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "2"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary2d.ndim"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "If we are interested in the number of elements along each array dimension (in the context of NumPy arrays, we may also refer to them as *axes*), we can access the `shape` attribute as shown below:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(2, 3)"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary2d.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The `shape` is always a tuple; in the code example above, the two-dimensional `ary` object has two *rows* and *three* columns, `(2, 3)`, if we think of it as a matrix representation.\n",
    "\n",
    "Similarly, the `shape` of the one-dimensional array only contains a single value:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(3,)"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.array([1, 2, 3]).shape"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Instead of passing lists or tuples to the `array` function, we can also provide a single float or integer, which will construct a zero-dimensional array (for instance, a representation of a scalar):"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(5)"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scalar = np.array(5)\n",
    "scalar"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scalar.ndim"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "()"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scalar.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Array Construction Routines"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the previous section, we used the `array` function to construct NumPy arrays from Python objects that are sequences or nested sequences -- lists, tuples, nested lists, iterables, and so forth. While `array` is often our go-to function for creating `ndarray` objects, NumPy implements a variety of functions for constructing arrays that may come in handy in different contexts. In this section, we will take a quick peek at those that we use most commonly -- you can find a  more comprehensive list in the [official documentation](https://docs.scipy.org/doc/numpy/reference/routines.array-creation.html)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The `array` function works with most iterables in Python, including lists, tuples, and `range` objects; however, `array` does not support generator expression. If we want parse generators directly, however, we can use the `fromiter` function as demonstrated below: "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 3, 5, 7, 9])"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "def generator():\n",
    "    for i in range(10):\n",
    "        if i % 2:\n",
    "            yield i\n",
    "\n",
    "gen = generator()\n",
    "np.fromiter(gen, dtype=int)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 3, 5, 7, 9])"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# using 'comprehensions' the following\n",
    "# generator expression is equivalent to\n",
    "# the `generator` above\n",
    "\n",
    "generator_expression = (i for i in range(10) if i % 2)\n",
    "np.fromiter(generator_expression, dtype=int)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Next, we will take at two functions that let us create `ndarray`s of consisting of either ones and zeros by only specifying the elements along each axes (here: three rows and three columns):"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 1.,  1.,  1.],\n",
       "       [ 1.,  1.,  1.],\n",
       "       [ 1.,  1.,  1.]])"
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.ones((3, 3))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 0.,  0.,  0.],\n",
       "       [ 0.,  0.,  0.],\n",
       "       [ 0.,  0.,  0.]])"
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.zeros((3, 3))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Creating arrays of ones or zeros can also be useful as placeholder arrays, in cases where we do not want to use the initial values for computations but want to fill it with other values right away. If we do not need the initial values (for instance, `'0.'` or `'1.'`), there is also `numpy.empty`, which follows the same syntax as `numpy.ones` and `np.zeros`. However, instead of filling the array with a particular value, the `empty` function creates the array with non-sensical values from memory. We can think of `zeros` as a function that creates the array via `empty` and then sets all its values to `0.` -- in practice, a difference in speed is not noticeable, though.  "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "NumPy also comes with functions to create identity matrices and diagonal matrices as `ndarrays` that can be useful in the context of linear algebra -- a topic that we will explore later in this appendix. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 1.,  0.,  0.],\n",
       "       [ 0.,  1.,  0.],\n",
       "       [ 0.,  0.,  1.]])"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.eye(3)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[3, 0, 0],\n",
       "       [0, 3, 0],\n",
       "       [0, 0, 3]])"
      ]
     },
     "execution_count": 20,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.diag((3, 3, 3))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Lastly, I want to mention two very useful functions for creating sequences of numbers within a specified range, namely, `arange` and `linspace`. NumPy's `arange` function follows the same syntax as Python's `range` objects: If two arguments are provided, the first argument represents the start value and the second value defines the stop value of a half-open interval:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([ 4.,  5.,  6.,  7.,  8.,  9.])"
      ]
     },
     "execution_count": 21,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.arange(4., 10.)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Notice that `arange` also performs type inference similar to the `array` function. If we only provide a single function argument, the range object treats this number as the endpoint of the interval and starts at 0:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([0, 1, 2, 3, 4])"
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.arange(5)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Similar to Python's `range`, a third argument can be provided to define the *step* (the default step size is 1). For example, we can obtain an array of all uneven values between one and ten as follows:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([ 1.,  3.,  5.,  7.,  9.])"
      ]
     },
     "execution_count": 23,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.arange(1., 11., 2)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The `linspace` function is especially useful if we want to create a particular number of evenly spaced values in a specified half-open interval:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([ 0.  ,  0.25,  0.5 ,  0.75,  1.  ])"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.linspace(0., 1., num=5)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Array Indexing"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In this section, we will go over the basics of retrieving NumPy array elements via different indexing methods. Simple NumPy indexing and slicing works similar to Python lists, which we will demonstrate in the following code snippet, where we retrieve the first element of a one-dimensional array:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1"
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary = np.array([1, 2, 3])\n",
    "ary[0]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Also, the same Python semantics apply to slicing operations. The following example shows how to fetch the first two elements in `ary`:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 2])"
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary[:2] # equivalent to ary[0:2]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "If we work with arrays that have more than one dimension or axis, we separate our indexing or slicing operations by commas as shown in the series of examples below:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1"
      ]
     },
     "execution_count": 27,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary = np.array([[1, 2, 3],\n",
    "                [4, 5, 6]])\n",
    "\n",
    "ary[0, 0] # upper left"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "6"
      ]
     },
     "execution_count": 28,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary[-1, -1] # lower right"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "2"
      ]
     },
     "execution_count": 29,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary[0, 1] # first row, second column"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "![](images/numpy-intro/array_2.png)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 2, 3])"
      ]
     },
     "execution_count": 30,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary[0] # entire first row"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 4])"
      ]
     },
     "execution_count": 31,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary[:, 0] # entire first column"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[1, 2],\n",
       "       [4, 5]])"
      ]
     },
     "execution_count": 32,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary[:, :2] # first two columns"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1"
      ]
     },
     "execution_count": 33,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary[0, 0]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Array Math and Universal Functions"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the previous sections, you learned how to create NumPy arrays and how to access different elements in an array. It is about time that we introduce one of the core features of NumPy that makes working with `ndarray` so efficient and convenient: vectorization. While we typically use for-loops if we want to perform arithmetic operations on sequence-like objects, NumPy provides vectorized wrappers for performing element-wise operations implicitly via so-called *ufuncs* -- short for universal functions.\n",
    "\n",
    "As of this writing, there are more than 60 ufuncs available in NumPy; ufuncs are implemented in compiled C code and very fast and efficient compared to vanilla Python. In this section, we will take a look at the most commonly used ufuncs, and I recommend you to check out the [official documentation](https://docs.scipy.org/doc/numpy/reference/ufuncs.html#available-ufuncs) for a complete list.\n",
    "\n",
    "To provide an example of a simple ufunc for element-wise addition, consider the following example, where we add a scalar (here: 1) to each element in a nested Python list:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[[2, 3, 4], [5, 6, 7]]"
      ]
     },
     "execution_count": 34,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "lst = [[1, 2, 3], [4, 5, 6]]\n",
    "\n",
    "for row_idx, row_val in enumerate(lst):\n",
    "    for col_idx, col_val in enumerate(row_val):\n",
    "        lst[row_idx][col_idx] += 1\n",
    "lst"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This for-loop approach is very verbose, and we could achieve the same goal more elegantly using list comprehensions:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[[2, 3, 4], [5, 6, 7]]"
      ]
     },
     "execution_count": 35,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "lst = [[1, 2, 3], [4, 5, 6]]\n",
    "[[cell + 1 for cell in row] for row in lst]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can accomplish the same using NumPy's ufunc for element-wise scalar addition as shown below:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[2, 3, 4],\n",
       "       [5, 6, 7]])"
      ]
     },
     "execution_count": 36,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary = np.array([[1, 2, 3], [4, 5, 6]])\n",
    "ary = np.add(ary, 1)\n",
    "ary"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The ufuncs for basic arithmetic operations are `add`, `subtract`, `divide`, `multiply`, and `exp` (exponential). However, NumPy uses operator overloading so that we can use mathematical operators (`+`, `-`, `/`, `*`, and `**`) directly:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[3, 4, 5],\n",
       "       [6, 7, 8]])"
      ]
     },
     "execution_count": 37,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary + 1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 4,  9, 16],\n",
       "       [25, 36, 49]])"
      ]
     },
     "execution_count": 38,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary**2"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Above, we have seen examples of *binary* ufuncs, which are ufuncs that take two arguments as an input. In addition, NumPy implements several useful *unary* ufuncs, such as `log` (natural logarithm), `log10` (base-10 logarithm), and `sqrt` (square root).\n",
    "\n",
    "Often, we want to compute the sum or product of array element along a given axis. For this purpose, we can use a ufunc's `reduce` operation. By default, `reduce` applies an operation along the first axis (`axis=0`). In the case of a two-dimensional array, we can think of the first axis as the rows of a matrix. Thus, adding up elements along rows yields the column sums of that matrix as shown below:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([5, 7, 9])"
      ]
     },
     "execution_count": 39,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary = np.array([[1, 2, 3], \n",
    "                [4, 5, 6]])\n",
    "\n",
    "np.add.reduce(ary) # column sumns"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "To compute the row sums of the array above, we can specify `axis=1`:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([ 6, 15])"
      ]
     },
     "execution_count": 40,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.add.reduce(ary, axis=1) # row sums"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "While it can be more intuitive to use `reduce` as a more general operation, NumPy also provides shorthands for specific operations such as `product` and `sum`. For example, `sum(axis=0)` is equivalent to `add.reduce`:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([5, 7, 9])"
      ]
     },
     "execution_count": 41,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary.sum(axis=0) # column sums"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "![](images/numpy-intro/ufunc.png)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As a word of caution, keep in mind that `product` and `sum` both compute the product or sum of the entire array if we do not specify an axis:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "21"
      ]
     },
     "execution_count": 42,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary.sum()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Other useful unary ufuncs are:\n",
    "    \n",
    "- mean (computes arithmetic average)\n",
    "- std (computes the standard deviation)\n",
    "- var (computes variance)\n",
    "- np.sort (sorts an array)\n",
    "- np.argsort (returns indices that would sort an array)\n",
    "- np.min (returns the minimum value of an array)\n",
    "- np.max (returns the maximum value of an array)\n",
    "- np.argmin (returns the index of the minimum value)\n",
    "- np.argmax (returns the index of the maximum value)\n",
    "- array_equal (checks if two arrays have the same shape and elements)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Broadcasting"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "A topic we glanced over in the previous section is broadcasting. Broadcasting allows us to perform vectorized operations between two arrays even if their dimensions do not match by creating implicit multidimensional grids. You already learned about ufuncs in the previous section where we performed element-wise addition between a scalar and a multidimensional array, which is just one example of broadcasting. \n",
    "\n",
    "\n",
    "![](images/numpy-intro/broadcasting-1.png)\n",
    "\n",
    "Naturally, we can also perform element-wise operations between arrays of equal dimensions:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 43,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([5, 7, 9])"
      ]
     },
     "execution_count": 43,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary1 = np.array([1, 2, 3])\n",
    "ary2 = np.array([4, 5, 6])\n",
    "\n",
    "ary1 + ary2"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In contrast to what we are used from linear algebra, we can also add arrays of different shapes. In the example above, we will add a one-dimensional to a two-dimensional array, where NumPy creates an implicit multidimensional grid from the one-dimensional array `ary1`:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 5,  7,  9],\n",
       "       [ 8, 10, 12]])"
      ]
     },
     "execution_count": 44,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary3 = np.array([[4, 5, 6], \n",
    "                 [7, 8, 9]])\n",
    "\n",
    "ary3 + ary1 # similarly, ary1 + ary3"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "![](images/numpy-intro/broadcasting-2.png)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Keep in mind though that the number of elements along the explicit axes and the implicit grid have to match so that NumPy can perform a sensical operation. For instance, the following example should raise a `ValueError`, because NumPy attempts to add the elements from the first axis of the left array (2 elements) to the first axis of the right array (3 elements):"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "ValueError: operands could not be broadcast together with shapes (2,3) (2,) \n"
     ]
    }
   ],
   "source": [
    "try: \n",
    "    ary3 + np.array([1, 2])\n",
    "except ValueError as e:\n",
    "    print('ValueError:', e)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "So, if we want to add the 2-element array to the columns in `ary3`, the 2-element array must have two elements along its *first* axis as well:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 5,  6,  7],\n",
       "       [ 9, 10, 11]])"
      ]
     },
     "execution_count": 46,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary3 + np.array([[1], [2]])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 5,  6,  7],\n",
       "       [ 9, 10, 11]])"
      ]
     },
     "execution_count": 47,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.array([[1], [2]]) + ary3"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Advanced Indexing -- Memory Views and Copies"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the previous sections, we have used basic indexing and slicing routines. It is important to note that basic integer-based indexing and slicing create so-called *views* of NumPy arrays in memory. Working with views can be highly desirable since it avoids making unnecessary copies of arrays to save memory resources. To illustrate the concept of memory views, let us walk through a simple example where we access the first row in an array, assign it to a variable, and modify that variable:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 48,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[100, 101, 102],\n",
       "       [  4,   5,   6]])"
      ]
     },
     "execution_count": 48,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary = np.array([[1, 2, 3],\n",
    "                [4, 5, 6]])\n",
    "\n",
    "first_row = ary[0]\n",
    "first_row += 99\n",
    "ary"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As we can see in the example above, changing the value of `first_row` also affected the original array. The reason for this is that `ary[0]` created a view of the first row in `ary`, and its elements were then incremented by 99. The same concept applies to slicing operations:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[100, 101, 102],\n",
       "       [  4,   5,   6]])"
      ]
     },
     "execution_count": 49,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary = np.array([[1, 2, 3],\n",
    "                [4, 5, 6]])\n",
    "\n",
    "first_row = ary[:1]\n",
    "first_row += 99\n",
    "ary"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[  1, 101,   3],\n",
       "       [  4, 104,   6]])"
      ]
     },
     "execution_count": 50,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary = np.array([[1, 2, 3],\n",
    "                [4, 5, 6]])\n",
    "\n",
    "center_col = ary[:, 1]\n",
    "center_col += 99\n",
    "ary"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "If we are working with NumPy arrays, it is always important to be aware that slicing creates views -- sometimes it is desirable since it can speed up our code by avoiding to create unnecessary copies in memory. However, in certain scenarios we want force a copy of an array; we can do this via the `copy` method as shown below:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 51,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[  1, 101,   3],\n",
       "       [  4, 104,   6]])"
      ]
     },
     "execution_count": 51,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "second_row = ary[1].copy()\n",
    "second_row += 99\n",
    "ary"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "One way to check if two arrays might share memory is to use the `may_share_memory` function from NumPy. However, be aware that it uses a heuristic and can return false negatives or false positives. The code snippets shows an example of `may_share_memory` applied to the view (`first_row`) and copy (`second_row`) of the array elements from `ary`:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[100, 101, 102],\n",
       "       [  4,   5,   6]])"
      ]
     },
     "execution_count": 52,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary = np.array([[1, 2, 3],\n",
    "                [4, 5, 6]])\n",
    "\n",
    "first_row = ary[:1]\n",
    "first_row += 99\n",
    "ary"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 53,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "True"
      ]
     },
     "execution_count": 53,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.may_share_memory(first_row, ary)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 54,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[100, 101, 102],\n",
       "       [  4,   5,   6]])"
      ]
     },
     "execution_count": 54,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "second_row = ary[1].copy()\n",
    "second_row += 99\n",
    "ary"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 55,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "False"
      ]
     },
     "execution_count": 55,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.may_share_memory(second_row, ary)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In addition to basic single-integer indexing and slicing operations, NumPy supports advanced indexing routines called *fancy* indexing. Via fancy indexing, we can use tuple or list objects of non-contiguous integer indices to return desired array elements. Since fancy indexing can be performed with non-contiguous sequences, it cannot return a view -- a contiguous slice from memory. Thus, fancy indexing always returns a copy of an array -- it is important to keep that in mind. The following code snippets show some fancy indexing examples:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 56,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[1, 3],\n",
       "       [4, 6]])"
      ]
     },
     "execution_count": 56,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary = np.array([[1, 2, 3],\n",
    "                [4, 5, 6]])\n",
    "\n",
    "ary[:, [0, 2]] # first and and last column"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 57,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[1, 2, 3],\n",
       "       [4, 5, 6]])"
      ]
     },
     "execution_count": 57,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "this_is_a_copy = ary[:, [0, 2]]\n",
    "this_is_a_copy += 99\n",
    "ary"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 58,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[3, 1],\n",
       "       [6, 4]])"
      ]
     },
     "execution_count": 58,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary[:, [2, 0]] # first and and last column"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "Finally, we can also use Boolean masks for indexing -- that is, arrays of `True` and `False` values. Consider the following example, where we return all values in the array that are greater than 3:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 59,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[False, False, False],\n",
       "       [ True,  True,  True]], dtype=bool)"
      ]
     },
     "execution_count": 59,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary = np.array([[1, 2, 3],\n",
    "                [4, 5, 6]])\n",
    "\n",
    "greater3_mask = ary > 3\n",
    "greater3_mask"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Using these masks, we can select elements given our desired criteria:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 60,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([4, 5, 6])"
      ]
     },
     "execution_count": 60,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary[greater3_mask]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can also chain different selection criteria using the logical *and* operator '&' or the logical *or* operator '|'. The example below demonstrates how we can select array elements that are greater than 3 and divisible by 2:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 61,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([4, 6])"
      ]
     },
     "execution_count": 61,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary[(ary > 3) & (ary % 2 == 0)]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Note that indexing using Boolean arrays is also considered \"fancy indexing\" and thus returns a copy of the array."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Random Number Generators"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In machine learning and deep learning, we often have to generate arrays of random numbers -- for example, the initial values of our model parameters before optimization. NumPy has a `random` subpackage to create random numbers and samples from a variety of distributions conveniently. Again, I encourage you to browse through the more comprehensive [numpy.random documentation](https://docs.scipy.org/doc/numpy/reference/routines.random.html) for a more comprehensive list of functions for random sampling.\n",
    "\n",
    "To provide a brief overview of the pseudo-random number generators that we will use most commonly, let's start with drawing a random sample from a uniform distribution:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 62,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([ 0.69646919,  0.28613933,  0.22685145])"
      ]
     },
     "execution_count": 62,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.random.seed(123)\n",
    "np.random.rand(3)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the code snippet above, we first seeded NumPy's random number generator. Then, we drew three random samples from a uniform distribution via `random.rand` in the half-open interval [0, 1). I highly recommend the seeding step in practical applications as well as in research projects, since it ensures that our results are reproducible. If we run our code sequentially -- for example, if we execute a Python script -- it should be sufficient to seed the random number generator only once at the beginning to enforce reproducible outcomes between different runs. However, it is often useful to create separate `RandomState` objects for various parts of our code, so that we can test methods of functions reliably in unit tests. Working with multiple, separate `RandomState` objects can also be useful if we run our code in non-sequential order -- for example if we are experimenting with our code in interactive sessions or Jupyter Notebook environments. \n",
    "\n",
    "The example below shows how we can use a `RandomState` object to create the same results that we obtained via np.random.rand in the previous code snippet:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 63,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([ 0.69646919,  0.28613933,  0.22685145])"
      ]
     },
     "execution_count": 63,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "rng1 = np.random.RandomState(seed=123)\n",
    "rng1.rand(3)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Another useful function that we will often use in practice is `randn`, which returns a random sample of floats from a standard normal distribution $N(\\mu, \\sigma^2)$, where the mean, ($\\mu$) is zero and unit variance ($\\sigma = 1$). The example below creates a two-dimensional array of such *z*-scores:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 64,
   "metadata": {},
   "outputs": [],
   "source": [
    "rng2 = np.random.RandomState(seed=123)\n",
    "z_scores = rng2.randn(100, 2)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "NumPy's random functions `rand` and `randn` take an arbitrary number of integer arguments, where each integer argument specifies the number of elements along a given axis -- the `z_scores` array should now refer to an array of 100 rows and two columns. Let us now visualize how our random sample looks like using Matplotlib:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 65,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAXYAAAD8CAYAAABjAo9vAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAFtFJREFUeJzt3X+IZWd9x/HPN5tRR2PdQhaCk6wbqKy1Rhw6WEv+aLPablp/ZIyIlmJtLSxCpVVkcdP8YUstLiwopQrtgiLCohESk5RY1oQI0tCIs2bbJG5WUiW6E8GVuCpm2szufvvHzOzOzJ577zn3POc8P877BYHszJ1zn3vuOd/zPN/zfZ5j7i4AQDmuit0AAEBYBHYAKAyBHQAKQ2AHgMIQ2AGgMAR2ACgMgR0ACkNgB4DCENgBoDBXx3jTa6+91vfs2RPjrQEgWydOnPipu++a9LoogX3Pnj1aWlqK8dYAkC0ze6bO60jFAEBhCOwAUBgCOwAUhsAOAIUhsANAYQjsAFCYKOWOAMK497FlHTl+Ws+eW9Erd87q4P69Wpyfi90sREZgBzJ172PLuuOex7WyekGStHxuRXfc87gkEdwHjlQMkKkjx09fCuobVlYv6Mjx05FahFQQ2IFMPXtupdHPMRwEdiBTr9w52+jnGA4CO5Cpg/v3anZmx5afzc7s0MH9eyO1CKng5imQqY0bpFTFYDsCO5Cxxfk5AjmuQCoGAApDYAeAwhDYAaAwBHYAKAw3T4GBY72Z8hDYgQFjvZkyEdiBARu33gyBfbTURzkEdmDAWG+muRxGOdw8BQaM9Waay2FVTQI7MGCsN9NcDqMcAjswYIvzc/rk7TdpbuesTNLczll98vabkkkppCiHUU7rHLuZ3SDpi5Kuk3RR0lF3/6e22wXQD9abaebg/r1bcuxSeqOcEDdPz0v6qLt/x8xeLumEmT3o7t8NsG0ASEoOq2q2Duzu/mNJP17//1+a2SlJc5II7ACKlPooJ2iO3cz2SJqX9K2Q2wUA1BcssJvZNZLulvRhd/9Fxe8PmNmSmS2dPXs21NsCALYJEtjNbEZrQf2Yu99T9Rp3P+ruC+6+sGvXrhBvCwCo0Dqwm5lJ+pykU+7+qfZNAgC0EaIq5mZJ75P0uJmdXP/Z37r71wJsGwOQ+robQG5CVMX8hyQL0BYMUA7rbgC5YREwRMXqgv1hZDQcBHZElcO6GyVgZDQsrBWDqHJYd6MEOaxIiHAI7IiK1QX7wchoWAjsiGYj57uyekE7bO3+O6sLdoOR0bAQ2BHFRs53eb3HeMH9Uk+doB4eI6NhIbAjCnK+/WLd9WGhKgZRkPNd02cJYuorEiIceuyIgpzv1nSU63IJ4r2PLcduGjJHYEcU5HzDpqPufWxZNx9+WDceekA3H36Yi8PAkYpBFDk8hWZD6HTJxvaWA6WjmHyE7QjsiCaHnG/ooLl9e1WapqNYlgHbkYoBxghdvVO1vc2mSUdxIxrbEdiBMUIHzXF/N20JIjeisR2BHRgjdNAc9XdzO2f1yKF9U6VOuBGN7QjswBihg2YXQZjJR9iOm6fAGKGrd7qqBsrhRjT6Y+7e+5suLCz40tJS7++LPPGACGCNmZ1w94VJr6PHjqRRow00R44dSWOxMKA5euyYKGYqJOUabVJESBWBHWPFToW8cuds5dT72DXasfcLMA6pGIwVOxWSao127P0CjEOPHWPFToXEWCysTool9n4pDWmtsAYb2DmQ6kkhFdJnjXbdFEsK+6UUpLXCC5KKMbPPm9lPzOyJENvrGg84qC/VVEhX64/XTbGkul9yRForvFA99i9I+oykLwbaXqdY5nRNnVFLiuumd9nDq5tiSXG/5Iq0VnhBAru7f9PM9oTYVh84kJoFx9Smq3d5YW6SYkltv+SKtFZ4g6yKYZnTvIe/XV6YSbH0j30eXm+B3cwOmNmSmS2dPXu2r7etxIGU96ilywszKyX2j30eXm9VMe5+VNJRaW0RsL7etwr50byHvwf3773i8XIhL8ykWPrHPg9rsOWOQz+Qug6OXeLCDIwXJLCb2Zck/b6ka83sjKSPu/vnQmwb3cg9OA79wpyzNnNImH9SD+uxIxhOOkyyvRpLWhsp1smpt/nbUtRdj32QVTEIbwiTvrqaFDUkbaqxcq7k6huBHUGUftIN4cLVhzbVWDlXcvWNwI4gSjnpRvXKR124/u7+J2M0M1ttSlWZf1IfgR1BlHDSjeuVj7pAnVtZpdfeQJs5JMw/qY/AjiBKOOnGpZPGXaBKSTf1oc1kJCYy1TfYOnaElXv5pDQ+nfTp97xBH77rZKO/Q7U2paqUudZDYEcwXZ90XZdTjpuNuzg/p7//tyf1s+dXK38PpIRUDLLQR1XKpHTSx9/+W9mnmzAM9NgRXBc96z7W0J+UTioh3YRhILAjqK4egtFXOeWkdFJOOV5mAg8XqRgE1dVEpRLKKfvEhKphI7AjqK561iWUU/ap9JnAuel7OQpSMQiqq3XeN+e3l8+taIfZlkBFimGraS6wpG660eUzekehx46guuxZL87PXdr+hfVVSUkxVGuauiJ1050Yoyd67Aiq68qRPqpjcrW5x73zpTOaucq0evHystzjLrAh9is9/mox1lEisCOork/uUhYbC237cP9nz69qZodp5+yMfr6yOvG7aLtfY6QbchHjMZQEdjQyLnD3cXKn/KzWmD3Wqh736gXXy158tU5+/A8n/n3b/cpIarQYj6Ekx47aJuVh+8glplodEztH3bbHfctrdjX6eej3L1mMxcvosaO2Sb2yPk7uVGd/xu6xtu1xf+Ops41+Hvr9S9f3xDYCe+FCpgcmBe6+Tu4UZ3/G7rG2He63bX+MdANGI7AXrGnOe9JFYFLgHvLJHbvH2nYk07b9qY6k2si5ysfcffKrAltYWPClpaXe33dobj78cOXJOrdzVo8c2rflZ3WeAF/1mpmrTNe85Gqde36t8uKW1+zSN54628nJUOdEi3Uy1tl/Kcu9/aGluj/M7IS7L0x6HT32gjUZXtfJEW/vlb1idka/euH8pTXKl8+t6O4Ty50c/HVGHzFL7nLvsebe/tBi3zNpi8BesCbD67oXgc357ZsPP6xzK1sfPLHxgOcYy/bGPhlTzP03kXv7Q4p9z6Qtyh0L1qQ0cJrVE8c94Dl02V+dE63Nydj3Ik1IW+6riQYJ7GZ2q5mdNrOnzexQiG2ivSb1s9PUh9c9yPtatnfakzF2DTrSk+p8ibpap2LMbIekz0r6A0lnJH3bzO539++23Tbaqzu8nibHWlUFM0qIZXsnVdxMW5UzbQqn7o3anKsrhir3ew4hcuxvlPS0u39fkszsy5Juk0Rgz0zTHGvVwf/8ppupm4VctnfUiTbtyTjtErd1btSyhkq+cr7nECKwz0n60aZ/n5H0O9tfZGYHJB2QpN27dwd4W4TSpke5/eAfVSYWatneSe2a5mScpoa7bi8/9g1dDFOIHLtV/OyK4nh3P+ruC+6+sGtXvfUn0L3Q+eWqvP67fntOR46f7vTGZJubn9PkU+v28nOvrkCeQvTYz0i6YdO/r5f0bIDtogdd9Cg395pDpSK6XFVymhTOqF7+K2Znar0ul+qKULjP0K8QPfZvS3q1md1oZi+S9F5J9wfYLnrQdY8yxIqPfawquTg/p0cO7dMPDr9VjxzaNzHoHNy/VzNXXTlY/dUL57eMFlKtruizvJOqo/61Duzufl7ShyQdl3RK0lfc/cm220U/uq7XDXHhmBS4Q1+c6gS9xfk5XfOSKwe8qxd8ywUlxpKtk/QdaHmwdv+CzDx1969J+lqIbaFfXS/cFSIVMSpAL59b0Y2HHtBVZpeegTrte2yoSut85K6TWnrmOX1i8aYtrz1XUf1T1d5pbuh2mbro+4Yu9xn6x8zTgeu6RxkiFTEuQLtUGdSnvThVBT2XdOzRH17Ro+1qtNN1j7rvQJv7LM4cEdjROL/cdNttLxxVF4cqO8xaX5xGBTeX9NGv/Fcv+fOuUxd9B9q2+4nlHppjETB0ru1Ej+1VK6MWmr7orh8cfuvU7yONTh1JayODzdU2Xc1O7LpH3fe6+W32ExO8psN67BkaeulYk3Xmm7r3sWV95K6TIy8eod5nnC4/34YUj6GqNh05frrzfZET1mMvFD2Ybnuci/NzWnrmOR179Icjg3ubaps6wbSPHnWM6fLTzEUYtQ4RN17HI8eeGUrHur/h+4nFm/Tp97xBO6xqUnW7aps6N0RTLJFsa9q5CCG/gyHJqsee4vCxb0MqHRv3fXfd49zYdqiec9MSw5wXoKoy6fOPOn4vuGt2Zscgn6PbRjY9dmavrRlK6VgK33fInvOQLshVJn3+Ucfvxj4vafTSh2x67KySt6bvioZYUvm+Q/Wch75mzKTPP+64Lm300odseuxD7/FsKDH/WqW077tpLXdptduTPv9Qjuu+ZNNjH3qPZ7Mh9GCaft+p338ZV8u9ve23vGaX7j6xXFTlU90HpeT6+VKTTR37qAc4cFUvU5PvO+djo6rtpooHGmi4tdu4rLg69tyfQYhmmnzfqeTjt6szihi1Nk2VXNNQ6F82gV1iqFZX6mmJuup+3ynm4+tOJGvSxlLTjqUcrynJ5uYp6kmhTLBvKZaA1p1INqqN26fllFj5JA3zeO0DgT2w2NUMQ5yZmuJTiuqOIka1/U/ftDurCpFpj/shHq99yCoVk7oU1nFJMS3RtRTvv9St6kmx7U21Oe6HeLz2gcAeUAo38YZaFpra/ZcmE8lSa3tTbY77oR6vXSMVE1AKvY8U0xJDNKQJN22O+xDHa+z0Z4rosQeUQu+jhKF9Ker2xHOvCmlz3Lc9XlNIf6YomwlKOch5oswQpBhASzhmYn6GPh5KkpK6E5RIxQQ0pOF3blItqyuhKmTjuP/1l85c+tmLr+4ntKSQ/kwRqZjAcr8RVqoUbmxXmSYwpTjykKT/Xb146f/Praz2khJJIf2ZInrsGIRUe3ZNJ1cx8tiKYoFqrQK7mb3bzJ40s4tmNjHvA1Tpo6ohxdmpUvPAlGrqJtaFk/RntbapmCck3S7pXwO0BQPUV1VDqg8oaVoVkvLII1ZKhPTnlVoFdnc/JUk24oGz6E+qeddJ+sp9p1wG2iQwpZpTTvXCOVTcPC1AzrW8ffZAS+jZpRpAU75wDtHEwG5mD0m6ruJXd7r7fXXfyMwOSDogSbt3767dQEyWasVHHW17oLmOVKaVQgAdtc/bXjiH9l12aWJgd/e3hHgjdz8q6ai0NkEpxDaxJnSvt88TrE0PNOeRShsxRx5d7fOhfpddodyxACErPvoup2tT1ZBqhUjJutrnfJdhtcqxm9k7Jf2zpF2SHjCzk+6+P0jLUFvIvGuMtM60PdBUK0RK1tU+57sMq21VzFclfTVQWzClkHnXECdYX6mcVCtEStbVPue7DItUTCEW5+f0yKF9+sHht+qRQ/umDqRt0zp9pnKYddi/rvY532VYBHZs0fYE6zNXyqzDOF4yczls7JydCbLP+S7Doo4dW7RN6/SdKy2hNj0XVcvz/t/5i2P+ohm+y3AI7LhCmxOMXOllpdVl5zxfYmhIxQxYF4tvkStdk+oqjG1QuZIPAvtAdRV4yJWuKbEuO9UVMnElUjED1eWwmlxpmb3bVNepwZUI7ANVYuBJScr3GqbN/aewTg3qIbAPVMqBpwSp9m7brsnCaCwP5NgHipuc3dnoEa+sXtCO9WcVpHKvocTcP65Ej32gGFZ3Y3uP+IL7pQtmCvuWFNwwENgHjGF1eKnXepOCGwZSMUBAqfeIScENAz12TK20mZUh1O0Rx9p3pOCGgcCOqfDEm2p1qmFi7ztScOUjFYOpUF1Rrc7MW/YdukaPHVNJPZcc06QeMfsOXaPHjqmMqqK4yizrha76wJor6BqBHVOpqq6Q1uq2c1/FsGtUpqBrBHZMZSOXvDGzcjPyxeOxAia6Ro4dU1ucn9NH7jpZ+TvyxeNRmYIuEdjRypBnMlLHj1SRislIF088amuo+eISn5CEchDYM5FqIBlqvphadKSMVEwmUl5caoj5YmrRkbJWgd3Mjkh6u6QXJP2PpL9w93MhGoatCCRpiXVvgbw+6mibinlQ0uvc/fWSvifpjvZNQhUmtaQlxr2FVNNxSE+rwO7uX3f38+v/fFTS9e2bhCpDvUmZqhj3Fsjrh5ViMUIoIXPsH5B0V8DtYROWW01P3/cWSMeFE3uFza5NDOxm9pCk6yp+dae737f+mjslnZd0bMx2Dkg6IEm7d++eqrFDN8SblLhsyHMGQku5GCGEiYHd3d8y7vdm9n5Jb5P0Znf3Mds5KumoJC0sLIx8HYBqddZ6Rz2lj37aVsXcKuljkn7P3Z8P0yQAVUjHhVP66Kdtjv0zkl4s6UFbWwzqUXf/YOtWAahEOi6M0kc/rQK7u/9GqIYAQF9KH/0w8xTAIJU8+mGtGAAoDIEdAApDYAeAwhDYAaAwBHYAKAyBHQAKQ2AHgMIQ2AGgMAR2ACgMgR0ACsOSAoiO53gCYRHYEVXpT7IBYiAVg6h4jicQHoEdUZX+JBsgBgI7ohr1xJpSnmQDxEBgR1QH9+/V7MyOLT8r6Uk2QAzcPEVUpT/JBoiBwI7oSn6SDRADgR3FoB4eWENgRxGohwcu4+YpikA9PHAZgR1FoB4euIzAjiJQDw9cRmBHEaiHBy5rdfPUzP5B0m2SLkr6iaQ/d/dnQzQMaIJ6eOAyc/fp/9js19z9F+v//9eSXuvuH5z0dwsLC760tDT1+wLAEJnZCXdfmPS6VqmYjaC+7mWSpr9KAACCaF3Hbmb/KOnPJP1c0i2tWwQAaGVij93MHjKzJyr+u02S3P1Od79B0jFJHxqznQNmtmRmS2fPng33CQAAW7TKsW/ZkNmrJD3g7q+b9Fpy7ADQXC85djN79aZ/vkPSU222BwBor22O/bCZ7dVaueMzkiZWxAAAutUqsLv7u0I1BMgRK0oiRazuCEyJFSWRKpYUAKbEipJIFYEdmBIrSiJVBHZgSqwoiVQR2IEpsaIkUsXNU2BKrCiJVBHYgRYW5+cI5EgOqRgAKAyBHQAKQ2AHgMIQ2AGgMAR2ACgMgR0AChPsQRuN3tTsrNaW+c3BtZJ+GrsRkQz1sw/1c0t89tQ/+6vcfdekF0UJ7Dkxs6U6Tywp0VA/+1A/t8RnL+Wzk4oBgMIQ2AGgMAT2yY7GbkBEQ/3sQ/3cEp+9COTYAaAw9NgBoDAE9gnM7IiZPWVm/21mXzWznbHb1Bcze7eZPWlmF82siGqBSczsVjM7bWZPm9mh2O3pi5l93sx+YmZPxG5L38zsBjP7hpmdWj/e/yZ2m9oisE/2oKTXufvrJX1P0h2R29OnJyTdLumbsRvSBzPbIemzkv5I0msl/YmZvTZuq3rzBUm3xm5EJOclfdTdf1PSmyT9Ve7fO4F9Anf/urufX//no5Kuj9mePrn7KXcf0pOZ3yjpaXf/vru/IOnLkm6L3KZeuPs3JT0Xux0xuPuP3f076///S0mnJGW9yD6BvZkPSPr32I1AZ+Yk/WjTv88o8xMczZjZHknzkr4VtyXt8AQlSWb2kKTrKn51p7vft/6aO7U2ZDvWZ9u6VuezD4hV/IyysYEws2sk3S3pw+7+i9jtaYPALsnd3zLu92b2fklvk/RmL6w+dNJnH5gzkm7Y9O/rJT0bqS3okZnNaC2oH3P3e2K3py1SMROY2a2SPibpHe7+fOz2oFPflvRqM7vRzF4k6b2S7o/cJnTMzEzS5ySdcvdPxW5PCAT2yT4j6eWSHjSzk2b2L7Eb1Bcze6eZnZH0u5IeMLPjsdvUpfWb5B+SdFxrN9C+4u5Pxm1VP8zsS5L+U9JeMztjZn8Zu009ulnS+yTtWz/HT5rZH8duVBvMPAWAwtBjB4DCENgBoDAEdgAoDIEdAApDYAeAwhDYAaAwBHYAKAyBHQAK8//UQsq2TFDaHAAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x10f18d4a8>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "%matplotlib inline\n",
    "import matplotlib.pyplot as plt\n",
    "\n",
    "plt.scatter(z_scores[:, 0], z_scores[:, 1])\n",
    "#plt.savefig('images/numpy-intro/random_1.png', dpi=600)\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "If we want to draw a random sample from a non-standard normal distribution, we can simply add a scalar value to the array elements to shift the mean of the sample, and we can multiply the sample by a scalar to change its standard deviation. The following code snippet will change the properties of our random sample as if it has been drawn from a Normal distribution $N(5, 4)$:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 66,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAXYAAAD8CAYAAABjAo9vAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAGK1JREFUeJzt3X2MHVd5x/Hf4/UibxKog7K8ZJ2tTZsaQkIxWdEUS7QkoARCkxVpRVBBESBZlXhNaSqn/AF/gLAUBEUqorLCSyqsEJSkISoUJ01AqBFErGO3STAuUVIn3gRiFFwQsYjtPP1j79rr9b17586cmXPmzPcjWd69vp45d2buM2eeec4Zc3cBAPKxKnYDAABhEdgBIDMEdgDIDIEdADJDYAeAzBDYASAzBHYAyAyBHQAyQ2AHgMysjrHSs846y9evXx9j1QDQWrt27fqlu08Oe1+UwL5+/XrNzc3FWDUAtJaZ7S/yPlIxAJAZAjsAZIbADgCZIbADQGYI7ACQmShVMQDCuGP3vG7YuU9PHjqss9dO6LpLN2p201TsZiEyAjvQUnfsntf1tz+ow0eOSZLmDx3W9bc/KEkE944jFQO01A079x0P6osOHzmmG3bui9QipKJwYDezr5jZ02b20JLXXmxmd5vZz3p/n1lPMwEs9+ShwyO9ju4Ypcf+NUmXLXttq6R73P1cSff0fgfQgLPXToz0OrqjcGB39x9IembZy1dKuqn3802SZgO1C8AQ1126URPjYye9NjE+pusu3RipRUhF1ZunL3X3pyTJ3Z8ys5cEaBOAAhZvkFIVg+Uaq4oxsy2StkjS9PR0U6sFsja7aYpAjlNUrYr5hZm9XJJ6fz896I3uvt3dZ9x9ZnJy6KyTAICSqgb2OyVd0/v5Gknfqrg8AEBFo5Q73izph5I2mtkBM3u/pG2S3mJmP5P0lt7vAICICufY3f1dA/7pkkBtAQAEwMhTAMgMc8UAHcdEYvkhsAMdxkRi5aR+MiQVA3QYE4mNbvFkOH/osFwnToZ37J6P3bTjCOxAhzGR2OjacDIksAMdxkRio2vDyZDADnQYE4mNrg0nQwI70GGzm6b0mXdcoKm1EzJJU2sn9Jl3XJDUjcDUtOFkSFUM0HFMJDaaNsyqSWAHgBGlfjIkFQMAmSGwA0BmCOwAkBkCOwBkhsAOAJmhKgbRpT6hEtA2BHZExeyCQHgEdkS10oRKBPbwuDrqBgI7omrDhEq54OqoO7h5iqjaMKFSLtow3SzCILAjqjZMqJQLro66g8COaBbzvYePHNOYmSRmF6wTV0fdQWBHFEsfLyZJx9yP99QJ6vXg6qg7COyIgnxv85h7vTuoikEU5HsXNF1+mPp0swgjSI/dzK41s4fN7CEzu9nM1oRYLvJFvrcdT7tHO1UO7GY2JenDkmbc/XxJY5Kurrpc5I18b9h01B2757V5273asPXb2rztXk4OHRcqFbNa0oSZHZF0mqQnAy0XmWrD48UWhU6XLC5vPlA6ioFHWK5yYHf3eTP7rKTHJR2WdJe731W5ZcheG/K9oYPm8uX1M2o6imkZsFyIVMyZkq6UtEHS2ZJON7N393nfFjObM7O5gwcPVl0t0IjQ1Tv9lrdUmXQUN6KxXIibp2+W9Ji7H3T3I5Jul/SG5W9y9+3uPuPuM5OTkwFWC9QvdNBc6f+VLT/kRjSWCxHYH5d0kZmdZmYm6RJJewMsF4gudNAc9P+m1k7ovq0Xl0qdcCMay1UO7O5+v6RbJT0g6cHeMrdXXS6QgtBBs44gzMAjLGfu3vhKZ2ZmfG5urvH1AmXUVRWTejUQ0mNmu9x9Zuj7COxIGUEQOKFoYGdKASSL+mygHCYBQ7KYKAwohx47VhQzFZJ6fTZpIqSKwI6BYqdCzl470XfYfQr12bG3DbASUjEYKHYqJOX67NjbBlgJPXYMFDsVEmuisCIpltjbJjektcLqbGDnQBouhVTIoInC6tp/RVMsKWybXJDWCq+TqRgecFBMqqmQOvdf0RRLqtumjUhrhdfJwM6BtGDYwxlSHape5/4rmmJJddu0EWmt8DqZiuFAKn75m+Kc6XXuv1FSLClumzYirRVeJ3vsTHPa7quWOvcfKZbmsc3D62Rg50Bq91VLnfuPFEvz2ObhdTIV06bnbdalzZe/de8/UizNY5uHxeyOHdXv2ZsT42P0lICEMbsjVlRHr5exASiiynHCMVYMgb3DQl7+MsgERVQ5TjjGiuvkzVOE1+Yqm6KG1f1juCrHSReOsVDosSOINlfZFEFvMYwqx0nux1hI9NgRRC5jAwb1ygf1Fj9558MxmtlaVY6TXI6xJhDYEUQOYwNWmoNmUK/w0OEjpGRGUOU4yeEYawqBHUHkMMhkpRzuSr1CcrzFVTlOcjjGmkIdO9CzYeu31e/bYJI+/87X6qO37On7/0zSY9sur7NpgKTidez02NEadVelrJTDnd00pTNPGx/p/wGxENjRCk3MoT8sh/uJv3g1OV60QpByRzNbK+lGSedLcknvc/cfhlg22qeO0YEr5b9DzhGzuK5+bW/bHEOM0uyuUHXsX5D0XXf/SzN7gaTTAi0XLVNXvXdTNczDRuO2ZbIq6u67rXIqxsxeJOmNkr4sSe7+nLsfqrpctFNdowOpYR4NozS7LUSO/RWSDkr6qpntNrMbzez05W8ysy1mNmdmcwcPHgywWqSorp41NcyjYZRmWpqejiJEYF8t6XWSvuTumyT9VtLW5W9y9+3uPuPuM5OTkwFWixTV1bNeWsMsSWNmx3ugDBA6VZn9wFw49Wjixv9yIQL7AUkH3P3+3u+3aiHQo4PqfrrR4vKP9cZfNPElaaNR90OM4NMVMdJilW+euvvPzewJM9vo7vskXSLpJ9WbhrZaM77q+IG8dmJcn7zi1cFu2DVRHdNWy6tgrrpwSt/76cFCVTEhtitVOP3FSIuFqor5kKQdvYqYRyW9N9By0SL9nsr0u6PPB10HueP++lXB3LZrvvCQ+6rblSqcwWI8hjLIACV339PLn7/G3Wfd/Vchlov0rJSHbeKSM+XqmJg56qrbvup2pQpnsBg3/hl5isKG5WGb6E2nWh0TO0ddddu/6ZX9CxoGvR56/TmLMXkZD9pAYcPysE1ccqY6+jN27r/qtv/eT/uXIA96PfT6c9f0wDYCe+ZC3tAa1iu77tKNp+TY6+hNpzj6M3aPteq2r9r+pvY9iiGwZ2zUG1rDTgLDemWp9qabELvHWnXbV21/jvu+zVU+zMeesc3b7u37ZZ1aO6H7tl580mv9KlomxsdOygX2e8/4KtMZa1br0LNHaj/4i3zRYn0Zi2y/lLW9/aGluj2Yjx0jXV4XqWpYfhNo7cS4ZNKvnj1S+w3DIjcnY97AbPvTfdre/tDaXuVDKiZjo1xeFz0JLM1vb952rw4dPnLSvy8+4DnGtL2xb2CmmPsfRdvbH1LseyZV0WPP2CilgWXqmFd6wHPoXnORL1qVLyPzpGCplMdLFEFgz9gol9dl6sOLHuRNTdtb9ssYuwYd6Ul1vERRpGIyV/TyukxVQ78St0FCTNs7rJyubMld2RRO0Ru1ba6u6Kq2V/kQ2HHcqDnWfgf/s88d1a+ePXLKe0NM27t8Xcu/aGW/jGVSOEVLSZlDpb3afM+BwI5KPcrlB/+gMrFQ0/YOa1eZL2OZGu6ivfzYN3TRTeTYOy50frlfXv+qC6d0w859td6YrHLzs0w+tWgvv+3VFWgneuwdV0ePcmmvOVQqYqWriqrrKJPCGdTL/72J8ULva0t1RSjcZ2gWPfaOq7tHGWKgx7CrihDrmN00pfu2XqzHtl2u+7ZePDToXHfpRo2vslNe/+1zR0+6Wki1uqLJ8k6qjppHYO+4uut1Q5w4hgXu0CenIkFvdtOUzlhz6gXvkWO+4mjdFEZ0Nh1o2z6Ks41IxXRc3bPyhUhFDArQ84cOa8PWb2uV2fFnoJZdx6J+aZ1rb9mjuf3P6FOzF5z03kN9qn/6tbdsdUVd6Yumb+hyn6F59Ng7ru4eZYhUxEoB2qW+Qb3syalf0HNJO370+Ck92jqvdursVTcdaNs+irONCOwYOb886rKrnjj6nRz6GTOrfHIaFNxc0se++V+N5c/rTF80HWirbiemexgdqRjUrupAj+VVK4Mmmn7eXY9tu7z0eqTBqSNp4cpgabVNnaMT6+xVN/1QjCrbiQFe5TAfewt1vXRslHnmR3XH7nlde8uegSePUOsZps7PKKV5DPVr0w0799W6Hdqm6Hzs9Nhbhh5MvT3O2U1Tmtv/jHb86PGBwb1KtU3RYFp3rzrGcPkyYxEGzUPEjdeVkWNvGUrH6r/h+6nZC/T5d75WY3ZqnbpUrdqm6M3QFMskqyg7FiHkPuiS1vTYU7x0jKFLpWMr7fO6e5yLyw7Vay5TYtjmSaiWG/b5Bx2/x9w1MT7GQ7JH1IoeOyPXTuhK6VgK+zxkr7lLJ+R+hn3+Qcfv4jbP5cqlKcF67GY2JmlO0ry7vz3UciVmyFuq6YqGWFLZ56F6zV2fM2bY51/puM7pyqUpIXvsH5G0N+Dyjut6b2ep3HKvg+S2z0et5c6tdnvY5+/Kcd2UID12M1sn6XJJn5b0tyGWuVTXezvLdaEHM+o+T/0ezEq13Mvb/qZXTuq2XfNZVT4VfVBKWz9faoLUsZvZrZI+I+mFkv6uXyrGzLZI2iJJ09PTF+7fv7/w8gc9vIEzer5G2edtPj76td2kvqWWXa3dxglF69grp2LM7O2Snnb3XSu9z923u/uMu89MTk6OtA4u07pnlH2eaglokXTKoLlp+mlrGgrNC5GK2SzpCjN7m6Q1kl5kZl9393cHWPZxXKYVk3pKYhRF93mK+fiiA8lGaWOuqcecjtlUVO6xu/v17r7O3ddLulrSvaGDOopJoUQwhhRLQIteRQxq4/JhOTlWPkndPWbr1oo69jaJWc2Qakqibik+pajoVcSgtv/1RdOtSz2WOfa7eszWLejIU3f/vqTvh1xmm8SexyXFlEQT6pxlsayiVT0ptr2Mssd+V4/ZurVmSoE2iD2opstloandgxllIFlqbS+j7LHf5WO2TqRiAord+0gxJdFVXavkKnvshzhmcxvMFQI99oBi9z5yuazPRdGeeA5VIWWP/arHbOz0Z6p40EZAbR4ogzhyOWZifY66H0iSmsYGKOGErl1+t02Kl+y5VIXMbprSVRdOHZ8/fcxMV11Y/72D2OnPVJGKCSyHG2E5SvWSvUxgSjF1c8fued22a17HehmAY+66bde8Zn7/xbW2LXb6M1X02NEJqfaMRx1cleqAnljbl4KB/gjsiK6JFEmql+yjBqZUT1Cxti/pz/5IxSCqplIkqV6yj1oVkuoJKub2Jf15KgI7ompqUFfKT54aJTCleoJKeft2EYE9EyneUCuiqR5oLjX+qQbQXLZvLgjsGUi14qOIqj3QUU5oOVyypxBAB23zqtu3rZ2TFBHYMxA6ndHkF6xKD7TNJ7QqYp6g6trmXd2XdaEqJgMh0xlNl9NVqWpItUIkZ3Vtc/ZlWPTYMxDyhlqMGSrL9kBTrRDJWV3bnH0ZFj32DIQcpBHiC9bU0P0Un5yUu7q2OfsyLAJ7BkIO0qj6BWsylcOow+bVtc3Zl2GRislEqBtqVcvpmkzlpFAh0kVrxlcd38drJ8b1ySteXXmbsy/DIrDjJFW/YE3nSnMoYWyLflPz/u7o88GWz74Mh8COU1T5gqU6MjKG3OqyYz/6EcWRY0dQ5EoXpDoLYxVUrrQHgb3D6qheYba9BTnWZVO50h6kYjqqzpF+5Erz7N2mOk8NTkWPvaNy7FGmJOXebdkrNa7G2qNyj93MzpH0L5JeJul5Sdvd/QtVl4t65dijTEmqvduqV2pcjbVDiB77UUkfc/dXSbpI0gfM7LwAy0WNUu5Rtt1iNczhI8eOP9w5ld4tV2rdUDmwu/tT7v5A7+ffSNoriVN64qheqcfSahhp4aHOi9s1dlCXuFLriqA5djNbL2mTpPtDLhfhkS+tR+o9Yq7UuiFYVYyZnSHpNkkfdfdf9/n3LZK2SNL09HSo1aIC8qXhpd4jTjX3j7CCBHYzG9dCUN/h7rf3e4+7b5e0XZJmZmY8xHoRV24jK0MoOvI21rZjTpZuCFEVY5K+LGmvu3+uepPQBjzxpr8iPeLY244rtfyFyLFvlvQeSReb2Z7en7cFWC4SlnouOZYi9y7Ydqhb5R67u/+nJAvQFrRI6rnkmIb1iNl2qBsjT1HKoCqKVWatnuiqCVSmoG4EdpTSrw5eWqjbbvsshnVjDAHqRmBHKYu55MWRlUuRL14ZYwhQN2Z3RGmzm6Z07S17+v4b+eKVUZmCOhHYUUmXn5hEHT9SRSqmJep4KEYIXc0X5/iEJOSDwN4CKQeRruaLqUVHykjFtEDqDxHuYr6YWnSkjMDeAgSR9MS6t0BeH0WQimkBBrSkJ8a9hZRTckgLgb0FunqDMmUx7i2Q1w8r1YKEEEjFtABTraap6XsLpOTCiT3DZt0I7C3RxRuUOFmXxwyElnpBQlWkYoCWICUXTu5XPwR2oCW6OmagDrkXJJCKAVqElFwYuT/7lcAOoHNyL0ggsAPopJyvfsixA0BmCOwAkBkCOwBkhsAOAJkhsANAZgjsAJAZAjsAZCZIYDezy8xsn5k9YmZbQywTAFBO5cBuZmOSvijprZLOk/QuMzuv6nIBAOWE6LG/XtIj7v6ouz8n6RuSrgywXABACSGmFJiS9MSS3w9I+pMAy0VH8BxPIKwQgd36vOanvMlsi6QtkjQ9PR1gtchB7k+yAWIIkYo5IOmcJb+vk/Tk8je5+3Z3n3H3mcnJyQCrRQ54jicQXojA/mNJ55rZBjN7gaSrJd0ZYLnogNyfZAPEUDmwu/tRSR+UtFPSXknfdPeHqy4X3ZD7k2yAGILUsbv7d9z9j9z9D9z90yGWiW7gOZ5AeDxoA1Hl/iQbIAYCO6LL+Uk2QAwEdmSDenhgAYEdWaAeHjiB2R2RBerhgRMI7MgC9fDACQR2ZIF6eOAEAjuyQD08cAI3T5EF6uGBEwjsyAb18MACUjEAkBkCOwBkhsAOAJkhsANAZgjsAJAZAjsAZIbADgCZoY4dqICpgpEiAjtQElMFI1WkYoCSmCoYqSKwAyUxVTBSRWAHSmKqYKSKwA6UxFTBSBU3T4GSmCoYqSKwAxUwVTBSVCkVY2Y3mNlPzey/zexfzWxtqIYBAMqpmmO/W9L57v4aSf8j6frqTQIAVFEpsLv7Xe5+tPfrjyStq94kAEAVIati3ifp3wMuDwBQwtCbp2b2H5Je1uefPu7u3+q95+OSjkrascJytkjaIknT09OlGgsAGM7cvdoCzK6R9DeSLnH3Zwv+n4OS9hdcxVmSflmyeW3HZ+8mPns3Ffnsv+/uk8MWVCmwm9llkj4n6c/c/WDpBa28jjl3n6lj2anjs/PZu4bPHuazV82x/5OkF0q628z2mNk/B2gTAKCCSgOU3P0PQzUEABBGG+aK2R67ARHx2buJz95NwT575ZunAIC0tKHHDgAYQbKB3cwuM7N9ZvaImW2N3Z6mmNk5ZvY9M9trZg+b2Udit6lpZjZmZrvN7N9it6VpZrbWzG7tzcG018z+NHabmmBm1/aO94fM7GYzWxO7TXUys6+Y2dNm9tCS115sZneb2c96f59ZdvlJBnYzG5P0RUlvlXSepHeZ2XlxW9WYo5I+5u6vknSRpA906LMv+oikvbEbEckXJH3X3V8p6Y/Vge1gZlOSPixpxt3PlzQm6eq4rard1yRdtuy1rZLucfdzJd3T+72UJAO7pNdLesTdH3X35yR9Q9KVkdvUCHd/yt0f6P38Gy18sTszL6yZrZN0uaQbY7elaWb2IklvlPRlSXL359z9UNxWNWa1pAkzWy3pNElPRm5Prdz9B5KeWfbylZJu6v18k6TZsstPNbBPSXpiye8H1KHgtsjM1kvaJOn+uC1p1D9K+ntJz8duSASvkHRQ0ld7qagbzez02I2qm7vPS/qspMclPSXp/9z9rritiuKl7v6UtNDBk/SSsgtKNbBbn9c6Vb5jZmdIuk3SR93917Hb0wQze7ukp919V+y2RLJa0uskfcndN0n6rSpcjrdFL5d8paQNks6WdLqZvTtuq9ot1cB+QNI5S35fp8wvzZYys3EtBPUd7n577PY0aLOkK8zsf7WQfrvYzL4et0mNOiDpgLsvXqHdqoVAn7s3S3rM3Q+6+xFJt0t6Q+Q2xfALM3u5JPX+frrsglIN7D+WdK6ZbTCzF2jhRsqdkdvUCDMzLeRY97r752K3p0nufr27r3P39VrY5/e6e2d6bu7+c0lPmNni07AvkfSTiE1qyuOSLjKz03rH/yXqwE3jPu6UdE3v52skfavsgpJ85qm7HzWzD0raqYU75F9x94cjN6spmyW9R9KDZran99o/uPt3IrYJzfmQpB29Ds2jkt4buT21c/f7zexWSQ9ooSpstzIfgWpmN0v6c0lnmdkBSZ+QtE3SN83s/Vo42f1V6eUz8hQA8pJqKgYAUBKBHQAyQ2AHgMwQ2AEgMwR2AMgMgR0AMkNgB4DMENgBIDP/DzBmJmFJuz9YAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x10f4db860>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "rng3 = np.random.RandomState(seed=123)\n",
    "scores = 2. * rng3.randn(100, 2) + 5.\n",
    "\n",
    "plt.scatter(scores[:, 0], scores[:, 1])\n",
    "#plt.savefig('images/numpy-intro/random_2.png', dpi=600)\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Note that in the example above, we multiplied the z-scores by a standard deviation of 2 -- the standard deviation of a sample is the square root of the variance $\\sigma^2$. Also, notice that all elements in the array were updated when we multiplied it by a scalar or added a scalar. In the next section, we will discuss NumPy's capabilities regarding such element-wise operations in more detail."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Reshaping Arrays"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In practice, we often run into situations where existing arrays do not have the *right* shape to perform certain computations. As you might remember from the beginning of this appendix, the size of NumPy arrays is fixed. Fortunately, this does not mean that we have to create new arrays and copy values from the old array to the new one if we want arrays of different shapes -- the size is fixed, but the shape is not. NumPy provides a `reshape` methods that allow us to obtain a view of an array with a different shape. \n",
    "\n",
    "For example, we can reshape a one-dimensional array into a two-dimensional one using `reshape` as follows:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 67,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[1, 2, 3],\n",
       "       [4, 5, 6]])"
      ]
     },
     "execution_count": 67,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary1d = np.array([1, 2, 3, 4, 5, 6])\n",
    "ary2d_view = ary1d.reshape(2, 3)\n",
    "ary2d_view"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 68,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "True"
      ]
     },
     "execution_count": 68,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.may_share_memory(ary2d_view, ary1d)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "While we need to specify the desired elements along each axis, we need to make sure that the reshaped array has the same number of elements as the original one. However, we do not need to specify the number elements in each axis; NumPy is smart enough to figure out how many elements to put along an axis if only one axis is unspecified (by using the placeholder `-1`):"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 69,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[1, 2, 3],\n",
       "       [4, 5, 6]])"
      ]
     },
     "execution_count": 69,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary1d.reshape(2, -1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 70,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[1, 2],\n",
       "       [3, 4],\n",
       "       [5, 6]])"
      ]
     },
     "execution_count": 70,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary1d.reshape(-1, 2)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can, of course, also use `reshape` to flatten an array:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 71,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 2, 3, 4, 5, 6])"
      ]
     },
     "execution_count": 71,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary2d = np.array([[1, 2, 3],\n",
    "                  [4, 5, 6]])\n",
    "\n",
    "ary2d.reshape(-1)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Note that NumPy also has a shorthand for that called `ravel`:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 72,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 2, 3, 4, 5, 6])"
      ]
     },
     "execution_count": 72,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary2d.ravel()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "A function related to `ravel` is `flatten`. In contrast to `ravel`, `flatten` returns a copy, though:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 73,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "False"
      ]
     },
     "execution_count": 73,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.may_share_memory(ary2d.flatten(), ary2d)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 74,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "True"
      ]
     },
     "execution_count": 74,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.may_share_memory(ary2d.ravel(), ary2d)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Sometimes, we are interested in merging different arrays. Unfortunately, there is no efficient way to do this without creating a new array, since NumPy arrays have a fixed size. While combining arrays should be avoided if possible -- for reasons of computational efficiency -- it is sometimes necessary. To combine two or more array objects, we can use NumPy's `concatenate` function as shown in the following examples:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 75,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 2, 3, 1, 2, 3])"
      ]
     },
     "execution_count": 75,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary = np.array([1, 2, 3])\n",
    "\n",
    "# stack along the first axis\n",
    "np.concatenate((ary, ary)) "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 76,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[1, 2, 3],\n",
       "       [1, 2, 3]])"
      ]
     },
     "execution_count": 76,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary = np.array([[1, 2, 3]])\n",
    "\n",
    "# stack along the first axis (here: rows)\n",
    "np.concatenate((ary, ary), axis=0) "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 77,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[1, 2, 3, 1, 2, 3]])"
      ]
     },
     "execution_count": 77,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# stack along the second axis (here: column)\n",
    "np.concatenate((ary, ary), axis=1) "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Comparison Operators and Masks"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the previous section, we already briefly introduced the concept of Boolean masks in NumPy. Boolean masks are `bool`-type arrays (storing `True` and `False` values) that have the same shape as a certain target array. For example, consider the following 4-element array below. Using comparison operators (such as `<`, `>`, `<=`, and `>=`), we can create a Boolean mask of that array which consists of `True` and `False` elements depending on whether a condition is met in the target array (here: `ary`):"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 78,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([False, False,  True,  True], dtype=bool)"
      ]
     },
     "execution_count": 78,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary = np.array([1, 2, 3, 4])\n",
    "mask = ary > 2\n",
    "mask"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "One we created such a Boolean mask, we can use it to select certain entries from the target array -- those entries that match the condition upon which the mask was created):"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 79,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([3, 4])"
      ]
     },
     "execution_count": 79,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary[mask]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Beyond the selection of elements from an array, Boolean masks can also come in handy when we want to count how many elements in an array meet a certain condition:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 80,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([False, False,  True,  True], dtype=bool)"
      ]
     },
     "execution_count": 80,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "mask"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 81,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "2"
      ]
     },
     "execution_count": 81,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "mask.sum()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "If we are interested in the index positions of array elements that meet a certain condition, we can use the `nonzero()` method on a mask, as follows:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 82,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(array([2, 3]),)"
      ]
     },
     "execution_count": 82,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "mask.nonzero()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Note that selecting index elements in the way suggested above is a two-step process of creating a mask and then applying the non-zero method:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 83,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(array([2, 3]),)"
      ]
     },
     "execution_count": 83,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "(ary > 2).nonzero()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "An alternative approach to the index selection by a condition is using the `np.where` method:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 84,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(array([2, 3]),)"
      ]
     },
     "execution_count": 84,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.where(ary > 2)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "While the example above demonstrate the use of `np.where` with only one input argument provided, `np.where` is especially useful in the context of re-assigning values to array elements that meet a certain condition."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 85,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([0, 0, 1, 1])"
      ]
     },
     "execution_count": 85,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.where(ary > 2, 1, 0)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Notice that we use the `np.where` function with three arguments: `np.where(condition, x, y`), which is interpreted as  \n",
    "> When condition is True, yield x, otherwise yield y.\n",
    "\n",
    "Or more concretely, what we have done in the previous example is to assign `1` to all elements greater than 2, and 0 to all other elements. Of course, this can also be achieved by using Boolean masks \"manually:\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 86,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([0, 0, 1, 1])"
      ]
     },
     "execution_count": 86,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary = np.array([1, 2, 3, 4])\n",
    "mask = ary > 2\n",
    "ary[mask] = 1\n",
    "ary[~mask] = 0\n",
    "ary"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The `~` operator in the example above is one of the logical operators in NumPy:\n",
    "    \n",
    "- A: `&`  or `np.bitwise_and`\n",
    "- Or: `|` or `np.bitwise_or`\n",
    "- Xor: `^` or `np.bitwise_xor`\n",
    "- Not: `~` or `np.bitwise_not`"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "These logical operators allow us to chain an arbitrary number of conditions to create even more \"complex\" Boolean masks. For example, using the \"Or\" operator, we can select all elements that are greater than 3 or smaller than 2 as follows:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 87,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([ True, False, False,  True], dtype=bool)"
      ]
     },
     "execution_count": 87,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary = np.array([1, 2, 3, 4])\n",
    "\n",
    "(ary > 3) | (ary < 2)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "And, for example, to negate the condition, we can use the `~` operator:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 88,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([False,  True,  True, False], dtype=bool)"
      ]
     },
     "execution_count": 88,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "~((ary > 3) | (ary < 2))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Linear Algebra with NumPy Arrays"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Most of the operations in machine learning and deep learning are based on concepts from linear algebra. In this section, we will take a look how to perform basic linear algebra operations using NumPy arrays."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "---\n",
    "\n",
    "I want to mention that there is also a special [`matrix`](https://docs.scipy.org/doc/numpy/reference/generated/numpy.matrix.html) type in NumPy. NumPy `matrix` objects are analogous to NumPy arrays but are restricted to two dimensions. Also, matrices define certain operations differently than arrays; for instance, the `*` operator performs matrix multiplication instead of element-wise multiplication. However, NumPy `matrix` is less popular in the science community compared to the more general array data structure. Since we are also going to work with arrays that have more than two dimensions (for example, when we are working with convolutional neural networks), we will not use NumPy matrix data structures in this book.\n",
    "\n",
    "---"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Intuitively, we can think of one-dimensional NumPy arrays as data structures that represent row vectors:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 89,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 2, 3])"
      ]
     },
     "execution_count": 89,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "row_vector = np.array([1, 2, 3])\n",
    "row_vector"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Similarly, we can use two-dimensional arrays to create column vectors:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 90,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[1],\n",
       "       [2],\n",
       "       [3]])"
      ]
     },
     "execution_count": 90,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "column_vector = np.array([[1, 2, 3]]).reshape(-1, 1)\n",
    "column_vector"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Instead of reshaping a one-dimensional array into a two-dimensional one, we can simply add a new axis as shown below:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 91,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[1],\n",
       "       [2],\n",
       "       [3]])"
      ]
     },
     "execution_count": 91,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "row_vector[:, np.newaxis]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Note that in this context, `np.newaxis` behaves like `None`:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 92,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[1],\n",
       "       [2],\n",
       "       [3]])"
      ]
     },
     "execution_count": 92,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "row_vector[:, None]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "All three approaches listed above, using `reshape(-1, 1)`, `np.newaxis`, or `None` yield the same results -- all three approaches create views not copies of the `row_vector` array.\n",
    "\n",
    "As we remember from the Linear Algebra appendix, we can think of a column vector as a matrix consisting only of one column. To perform matrix multiplication between matrices, we learned that number of columns of the left matrix must match the number of rows of the matrix to the right. In NumPy, we can perform matrix multiplication via the `matmul` function:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 93,
   "metadata": {},
   "outputs": [],
   "source": [
    "matrix = np.array([[1, 2, 3], \n",
    "                   [4, 5, 6]])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 94,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[14],\n",
       "       [32]])"
      ]
     },
     "execution_count": 94,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.matmul(matrix, column_vector)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "![](images/numpy-intro/matmul.png)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "However, if we are working with matrices and vectors, NumPy can be quite forgiving if the dimensions of matrices and one-dimensional arrays do not match exactly -- thanks to broadcasting. The following example yields the same result as the matrix-column vector multiplication, except that it returns a one-dimensional array instead of a two-dimensional one:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 95,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([14, 32])"
      ]
     },
     "execution_count": 95,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.matmul(matrix, row_vector)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Similarly, we can compute the dot-product between two vectors (here: the vector norm)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 96,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "14"
      ]
     },
     "execution_count": 96,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.matmul(row_vector, row_vector)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "NumPy has a special `dot` function that behaves similar to `matmul` on pairs of one- or two-dimensional arrays -- its underlying implementation is different though, and one or the other can be slightly faster on specific machines and versions of [BLAS](https://en.wikipedia.org/wiki/Basic_Linear_Algebra_Subprograms):"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 97,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "14"
      ]
     },
     "execution_count": 97,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.dot(row_vector, row_vector)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 98,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([14, 32])"
      ]
     },
     "execution_count": 98,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.dot(matrix, row_vector)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 99,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[14],\n",
       "       [32]])"
      ]
     },
     "execution_count": 99,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.dot(matrix, column_vector)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Similar to the examples above we can use `matmul` or `dot` to multiply two matrices (here: two-dimensional arrays). In this context, NumPy arrays have a handy `transpose` method to transpose matrices if necessary:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 100,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[1, 4],\n",
       "       [2, 5],\n",
       "       [3, 6]])"
      ]
     },
     "execution_count": 100,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "matrix = np.array([[1, 2, 3], \n",
    "                   [4, 5, 6]])\n",
    "\n",
    "matrix.transpose()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "![](images/numpy-intro/transpose.png)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 101,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[14, 32],\n",
       "       [32, 77]])"
      ]
     },
     "execution_count": 101,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.matmul(matrix, matrix.transpose())"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "While `transpose` can be annoyingly verbose for implementing linear algebra operations -- think of [PEP8's](https://www.python.org/dev/peps/pep-0008/) *80 character per line* recommendation -- NumPy has a shorthand for that: `T`:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 102,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[1, 4],\n",
       "       [2, 5],\n",
       "       [3, 6]])"
      ]
     },
     "execution_count": 102,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "matrix.T"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "![](images/numpy-intro/matmatmul.png)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "While this section demonstrates some of the basic linear algebra operations carried out on NumPy arrays that we use in practice, you can find an additional function in the documentation of NumPy's submodule for linear algebra: [`numpy.linalg`](https://docs.scipy.org/doc/numpy/reference/routines.linalg.html). If you want to perform a particular linear algebra routine that is not implemented in NumPy, it is also worth consulting the [`scipy.linalg` documentation](https://docs.scipy.org/doc/scipy/reference/linalg.html) -- SciPy is a library for scientific computing built on top of NumPy."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Set Operations"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Appendix B: Algebra Basics introduced the basics behind set theory, which are visually summarized in the following figure, and NumPy implements several functions that allow us to work with sets efficiently so that we are not restricted to Python's built-in functions (and converting back and forth between Python sets and NumPy arrays)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "![](images/numpy-intro/set_theory.png)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Remember that a set is essentially a collection of unique elements. Given an array, we can generate such a \"set\" using the `np.unique` function:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 103,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 2, 3, 5])"
      ]
     },
     "execution_count": 103,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary = np.array([1, 1, 2, 3, 1, 5])\n",
    "ary_set = np.unique(ary)\n",
    "ary_set"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "However, we have to keep in mind that unlike Python sets, the output of `np.unique` is a regular NumPy array, not specialized data structure that does not allow for duplicate entries. The set operations for example, set union (`np.union1d`), set difference (`np.setdiff1d`), or set intersection (`np.intersect1d`) would return the same results whether array elements are unique or not. However, setting their optional `assume_unique` argument can speed up the computation."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 104,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([3])"
      ]
     },
     "execution_count": 104,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary1 = np.array([1, 2, 3])\n",
    "ary2 = np.array([3, 4, 5, 6])        \n",
    "np.intersect1d(ary1, ary2, assume_unique=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 105,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 2])"
      ]
     },
     "execution_count": 105,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.setdiff1d(ary1, ary2, assume_unique=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 106,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 2, 3, 4, 5, 6])"
      ]
     },
     "execution_count": 106,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.union1d(ary1, ary2) # does not have assume_unique"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Note that NumPy does not have a function for the symmetric set difference, but it can be readily computed by composition:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 107,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 2, 4, 5, 6])"
      ]
     },
     "execution_count": 107,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.union1d(np.setdiff1d(ary1, ary2, \n",
    "                        assume_unique=True),\n",
    "           np.setdiff1d(ary2, ary1,\n",
    "                        assume_unique=True))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "For a complete list of set operations in NumPy, please see the official [Set Routines](https://docs.scipy.org/doc/numpy/reference/routines.set.html) documentation."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Serializing NumPy Arrays"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the context of computer science, serialization is a term that refers to storing data or objects in a different format that can be used for reconstruction later. For example, in Python, we can use the pickle library to write Python objects as bytecode (or binary code) to a local drive.\n",
    "\n",
    "NumPy offers a data storage format ([NPY](https://docs.scipy.org/doc/numpy/neps/npy-format.html)) that is especially well-suited (compared to regular pickle files) for storing array data. There are three different functions that can be used for this purpose:\n",
    "\n",
    "- `np.save`\n",
    "- `np.savez`\n",
    "- `np.savez_compressed`\n",
    "\n",
    "Starting with `np.save`, this function saves a single array to a so-called `.npy` file:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 108,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 2, 3])"
      ]
     },
     "execution_count": 108,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ary1 = np.array([1, 2, 3])\n",
    "\n",
    "np.save('ary-data.npy', ary1)\n",
    "np.load('ary-data.npy')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Suffice it to say, the the `np.load` a universal function for loading data that has been serialized via NumPy back into the current Python session.\n",
    "\n",
    "The `np.savez` is slightly more powerful than the `np.save` function as it generates an archive consisting of 1 or more `.npy` files and thus allows us to save multiple arrays at once."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 109,
   "metadata": {},
   "outputs": [],
   "source": [
    "np.savez('ary-data.npz', ary1, ary2)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "However, note that if the `np.load` function will wrap the arrays as a `NpzFile` object from which the individual arrays can be accessed via keys like values in a Python dictionary:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 110,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['arr_0', 'arr_1']"
      ]
     },
     "execution_count": 110,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "d = np.load('ary-data.npz')\n",
    "d.keys()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 111,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 2, 3])"
      ]
     },
     "execution_count": 111,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "d['arr_0']"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As demonstrated above, the arrays are numerated in ascending order with an `arr_` prefix (`'arr_0'`, `'arr_1'`, etc.). To use a custom naming convention, we can simply provide keyword arguments:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 112,
   "metadata": {},
   "outputs": [],
   "source": [
    "kwargs = {'ary1':ary1, 'ary2':ary2}\n",
    "\n",
    "np.savez('ary-data.npz',\n",
    "         **kwargs)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 113,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 2, 3])"
      ]
     },
     "execution_count": 113,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.load('ary-data.npz')\n",
    "d = np.load('ary-data.npz')\n",
    "d['ary1']"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Conclusion"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We have covered a lot of material in this appendix. If you are new to NumPy, its functionality can be quite overwhelming at first. Good news is that we do not need to master all the different concepts at once before we can get started using NumPy in our applications. In my opinion, the most useful yet most difficult concepts are NumPy's broadcasting rules and to distinguish between views and copies of arrays. However, with some experimentation, you can quickly get the hang of it and be able to write elegant and efficient NumPy code. "
   ]
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.4"
  },
  "toc": {
   "nav_menu": {},
   "number_sections": true,
   "sideBar": true,
   "skip_h1_title": false,
   "title_cell": "Table of Contents",
   "title_sidebar": "Contents",
   "toc_cell": false,
   "toc_position": {},
   "toc_section_display": true,
   "toc_window_display": false
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}