content/ScientificPython_Pandas.ipynb

{"cells": [{"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "slide"}, "tags": ["remove_cell"]}, "source": ["# Pandas: Python Data Anaylsis Library"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["[Pandas](https://pandas.pydata.org/) is a library for working with and manipulating tabular style data.  In many ways you can think of it as a replacement for a spreadsheet only it's much more powerful.  Whereas [NumPy](https://numpy.org/) provides $N$-dimensional data structures, Pandas is best utilized on two-dimensional, *labeled* data.  The fundamental data structures in Pandas are the `Series` and the `Dataframe`.  \n", "\n", "A Pandas Series contains a single column of data and an *index*.  The index is a way to reference the rows of data in the Series.  Common examples of an index would be simply a monotonically increasing set of integers, or time/date stamps for time series data.\n", "\n", "A Pandas DataFrame can be thought of being created by combining more than one Series that share a common index.  So a table with multiple column labels and common index would be an example of a DataFrame.  The description of these data structures will be made clear through examples in the sequel."]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "subslide"}, "tags": ["popout"]}, "source": ["Similarly to the way we import NumPy, it's idiomatic Python to import Pandas as\n", "\n", "```python\n", "import pandas as pd\n", "```"]}, {"cell_type": "code", "execution_count": 1, "metadata": {"scrolled": true, "slideshow": {"slide_type": "skip"}}, "outputs": [], "source": ["import numpy as np\n", "import pandas as pd"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "slide"}}, "source": ["## Loading Data "]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["Pandas offers some of the best utilities available for reading/parsing data from text files. The function [`read_csv`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.read_csv.html) has numerous options for managing header/footer lines in files, parsing dates, selecting specific columns, etc in comma separated value (CSV) files.  The default index for the Dataframe is set to a set of monotonically increasing integers unless otherwise specified with the keyword argument `index_col`.\n", "\n", "There are similar functions for reading Microsoft Excel spreadsheets ([`read_excel`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.read_excel.html)) and fixed width formatted text  ([`read_fwf`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.read_fwf.html#pandas.read_fwf)).\n", "\n", "The file `'200wells.csv'` contains a dataset with X and Y coordinates, facies 1 and 2 (1 is sandstone and 2 interbedded sand and mudstone), porosity , permeability (mD) and acoustic impedance ($\\mbox{kg} / (\\mbox{m}^2 \\cdot \\mbox{s} \\cdot 10^6)$)."]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}, "tags": ["popout"]}, "source": ["The [`head()`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.head.html) member function for DataFrames displays the first 5 rows of the DataFrame.  Optionally, you can specify an argument (e.g. `head(n=10)` to display more/less rows"]}, {"cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies_threshold_0.3</th>\n", "      <th>porosity</th>\n", "      <th>permeability</th>\n", "      <th>acoustic_impedance</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>565</td>\n", "      <td>1485</td>\n", "      <td>1</td>\n", "      <td>0.1184</td>\n", "      <td>6.170</td>\n", "      <td>2.009</td>\n", "    </tr>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>2585</td>\n", "      <td>1185</td>\n", "      <td>1</td>\n", "      <td>0.1566</td>\n", "      <td>6.275</td>\n", "      <td>2.864</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>2065</td>\n", "      <td>2865</td>\n", "      <td>2</td>\n", "      <td>0.1920</td>\n", "      <td>92.297</td>\n", "      <td>3.524</td>\n", "    </tr>\n", "    <tr>\n", "      <th>3</th>\n", "      <td>3575</td>\n", "      <td>2655</td>\n", "      <td>1</td>\n", "      <td>0.1621</td>\n", "      <td>9.048</td>\n", "      <td>2.157</td>\n", "    </tr>\n", "    <tr>\n", "      <th>4</th>\n", "      <td>1835</td>\n", "      <td>35</td>\n", "      <td>1</td>\n", "      <td>0.1766</td>\n", "      <td>7.123</td>\n", "      <td>3.979</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["      X     Y  facies_threshold_0.3  porosity  permeability  \\\n", "0   565  1485                     1    0.1184         6.170   \n", "1  2585  1185                     1    0.1566         6.275   \n", "2  2065  2865                     2    0.1920        92.297   \n", "3  3575  2655                     1    0.1621         9.048   \n", "4  1835    35                     1    0.1766         7.123   \n", "\n", "   acoustic_impedance  \n", "0               2.009  \n", "1               2.864  \n", "2               3.524  \n", "3               2.157  \n", "4               3.979  "]}, "execution_count": 3, "metadata": {}, "output_type": "execute_result"}], "source": ["df = pd.read_csv('datasets/200wells.csv'); df.head()"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"scroll": true, "slide_type": "slide"}}, "source": ["## Summary Statistics"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["The DataFrame member function [`describe`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.describe.html) provides useful summary statistics such as the total number of samples, mean, standard deviations, min/max, and quartiles for each column of the DataFrame. "]}, {"cell_type": "code", "execution_count": 4, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies_threshold_0.3</th>\n", "      <th>porosity</th>\n", "      <th>permeability</th>\n", "      <th>acoustic_impedance</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>count</th>\n", "      <td>200.000000</td>\n", "      <td>200.00000</td>\n", "      <td>200.000000</td>\n", "      <td>200.000000</td>\n", "      <td>200.000000</td>\n", "      <td>200.000000</td>\n", "    </tr>\n", "    <tr>\n", "      <th>mean</th>\n", "      <td>2053.400000</td>\n", "      <td>1876.15000</td>\n", "      <td>1.330000</td>\n", "      <td>0.149300</td>\n", "      <td>25.287462</td>\n", "      <td>3.000435</td>\n", "    </tr>\n", "    <tr>\n", "      <th>std</th>\n", "      <td>1113.524641</td>\n", "      <td>1137.58016</td>\n", "      <td>0.471393</td>\n", "      <td>0.032948</td>\n", "      <td>64.470135</td>\n", "      <td>0.592201</td>\n", "    </tr>\n", "    <tr>\n", "      <th>min</th>\n", "      <td>25.000000</td>\n", "      <td>35.00000</td>\n", "      <td>1.000000</td>\n", "      <td>0.050000</td>\n", "      <td>0.015820</td>\n", "      <td>2.009000</td>\n", "    </tr>\n", "    <tr>\n", "      <th>25%</th>\n", "      <td>1112.500000</td>\n", "      <td>920.00000</td>\n", "      <td>1.000000</td>\n", "      <td>0.132175</td>\n", "      <td>1.366750</td>\n", "      <td>2.483250</td>\n", "    </tr>\n", "    <tr>\n", "      <th>50%</th>\n", "      <td>2160.000000</td>\n", "      <td>1855.00000</td>\n", "      <td>1.000000</td>\n", "      <td>0.150150</td>\n", "      <td>4.825500</td>\n", "      <td>2.964500</td>\n", "    </tr>\n", "    <tr>\n", "      <th>75%</th>\n", "      <td>2915.000000</td>\n", "      <td>2782.50000</td>\n", "      <td>2.000000</td>\n", "      <td>0.174200</td>\n", "      <td>14.597000</td>\n", "      <td>3.527000</td>\n", "    </tr>\n", "    <tr>\n", "      <th>max</th>\n", "      <td>3955.000000</td>\n", "      <td>3995.00000</td>\n", "      <td>2.000000</td>\n", "      <td>0.223200</td>\n", "      <td>463.641000</td>\n", "      <td>3.984000</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["                 X           Y  facies_threshold_0.3    porosity  \\\n", "count   200.000000   200.00000            200.000000  200.000000   \n", "mean   2053.400000  1876.15000              1.330000    0.149300   \n", "std    1113.524641  1137.58016              0.471393    0.032948   \n", "min      25.000000    35.00000              1.000000    0.050000   \n", "25%    1112.500000   920.00000              1.000000    0.132175   \n", "50%    2160.000000  1855.00000              1.000000    0.150150   \n", "75%    2915.000000  2782.50000              2.000000    0.174200   \n", "max    3955.000000  3995.00000              2.000000    0.223200   \n", "\n", "       permeability  acoustic_impedance  \n", "count    200.000000          200.000000  \n", "mean      25.287462            3.000435  \n", "std       64.470135            0.592201  \n", "min        0.015820            2.009000  \n", "25%        1.366750            2.483250  \n", "50%        4.825500            2.964500  \n", "75%       14.597000            3.527000  \n", "max      463.641000            3.984000  "]}, "execution_count": 4, "metadata": {}, "output_type": "execute_result"}], "source": ["df.describe()"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"scrolling": true, "slide_type": "slide"}}, "source": ["## Indexing and Selecting Data"]}, {"cell_type": "markdown", "metadata": {}, "source": ["We can access parts of the DataFrame by their labels or their numerical indices. The most basic and useful operation is to select an entire column of data by it's label."]}, {"cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>porosity</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>0.1184</td>\n", "    </tr>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>0.1566</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>0.1920</td>\n", "    </tr>\n", "    <tr>\n", "      <th>3</th>\n", "      <td>0.1621</td>\n", "    </tr>\n", "    <tr>\n", "      <th>4</th>\n", "      <td>0.1766</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["   porosity\n", "0    0.1184\n", "1    0.1566\n", "2    0.1920\n", "3    0.1621\n", "4    0.1766"]}, "execution_count": 5, "metadata": {}, "output_type": "execute_result"}], "source": ["df[['porosity']].head()"]}, {"cell_type": "markdown", "metadata": {}, "source": ["Multiple columns can be selected by passing in a list of labels."]}, {"cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>porosity</th>\n", "      <th>permeability</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>0.1184</td>\n", "      <td>6.170</td>\n", "    </tr>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>0.1566</td>\n", "      <td>6.275</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>0.1920</td>\n", "      <td>92.297</td>\n", "    </tr>\n", "    <tr>\n", "      <th>3</th>\n", "      <td>0.1621</td>\n", "      <td>9.048</td>\n", "    </tr>\n", "    <tr>\n", "      <th>4</th>\n", "      <td>0.1766</td>\n", "      <td>7.123</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["   porosity  permeability\n", "0    0.1184         6.170\n", "1    0.1566         6.275\n", "2    0.1920        92.297\n", "3    0.1621         9.048\n", "4    0.1766         7.123"]}, "execution_count": 6, "metadata": {}, "output_type": "execute_result"}], "source": ["df[['porosity', 'permeability']].head()"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "subslide"}}, "source": ["### Label based selection"]}, {"cell_type": "markdown", "metadata": {}, "source": ["The member function [`loc`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.loc.html) can be used to select both rows and columns of data by their labels.  The index is interpreted as the row label."]}, {"cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>porosity</th>\n", "      <th>permeability</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>0.1566</td>\n", "      <td>6.275</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>0.1920</td>\n", "      <td>92.297</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["   porosity  permeability\n", "1    0.1566         6.275\n", "2    0.1920        92.297"]}, "execution_count": 7, "metadata": {}, "output_type": "execute_result"}], "source": ["df.loc[1:2, ['porosity', 'permeability']]"]}, {"cell_type": "markdown", "metadata": {}, "source": ["`loc` support NumPy-style *slicing* notation to select sequences of labels."]}, {"cell_type": "code", "execution_count": 8, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>porosity</th>\n", "      <th>permeability</th>\n", "      <th>acoustic_impedance</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>0.1566</td>\n", "      <td>6.275</td>\n", "      <td>2.864</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>0.1920</td>\n", "      <td>92.297</td>\n", "      <td>3.524</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["   porosity  permeability  acoustic_impedance\n", "1    0.1566         6.275               2.864\n", "2    0.1920        92.297               3.524"]}, "execution_count": 8, "metadata": {}, "output_type": "execute_result"}], "source": ["df.loc[1:2, 'porosity':'acoustic_impedance']"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "subslide"}}, "source": ["### Index based selection"]}, {"cell_type": "markdown", "metadata": {}, "source": ["The member function [`iloc`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.iloc.html) can be used to select both rows and columns of data by their integer index.  `iloc` supports Python-list style slicing."]}, {"cell_type": "code", "execution_count": 9, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>porosity</th>\n", "      <th>permeability</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>0.1566</td>\n", "      <td>6.275</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>0.1920</td>\n", "      <td>92.297</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["   porosity  permeability\n", "1    0.1566         6.275\n", "2    0.1920        92.297"]}, "execution_count": 9, "metadata": {}, "output_type": "execute_result"}], "source": ["df.iloc[1:3, 3:5]"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "subslide"}}, "source": ["### Get data as NumPy array "]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "-"}}, "source": ["We can get the underlying data in a Series/DataFrame as a NumPy array with the `values` attribute."]}, {"cell_type": "code", "execution_count": 10, "metadata": {"scrolled": true, "slideshow": {"scrolled": true, "slide_type": "-"}}, "outputs": [{"data": {"text/plain": ["array([0.1184 , 0.1566 , 0.192  , 0.1621 , 0.1766 , 0.1239 , 0.179  ,\n", "       0.1914 , 0.1763 , 0.1674 , 0.1369 , 0.1095 , 0.1677 , 0.1817 ,\n", "       0.119  , 0.1774 , 0.1418 , 0.1296 , 0.1325 , 0.1729 , 0.08494,\n", "       0.188  , 0.1147 , 0.1795 , 0.1981 , 0.1258 , 0.215  , 0.1781 ,\n", "       0.1428 , 0.1495 , 0.1435 , 0.1026 , 0.1772 , 0.19   , 0.1597 ,\n", "       0.1453 , 0.1653 , 0.176  , 0.2232 , 0.1336 , 0.1819 , 0.1591 ,\n", "       0.1328 , 0.1517 , 0.1061 , 0.08187, 0.1682 , 0.1367 , 0.1628 ,\n", "       0.1305 , 0.1097 , 0.2062 , 0.168  , 0.1663 , 0.1231 , 0.1965 ,\n", "       0.1292 , 0.1347 , 0.1481 , 0.1523 , 0.1388 , 0.1574 , 0.1769 ,\n", "       0.1982 , 0.161  , 0.1584 , 0.1594 , 0.1146 , 0.1367 , 0.1742 ,\n", "       0.1585 , 0.1065 , 0.181  , 0.1372 , 0.1384 , 0.0991 , 0.137  ,\n", "       0.1957 , 0.1032 , 0.1973 , 0.1336 , 0.1792 , 0.152  , 0.08245,\n", "       0.1505 , 0.0938 , 0.1563 , 0.1277 , 0.141  , 0.1712 , 0.1428 ,\n", "       0.07338, 0.1595 , 0.1079 , 0.1191 , 0.132  , 0.1394 , 0.2154 ,\n", "       0.1428 , 0.1416 , 0.1658 , 0.187  , 0.1796 , 0.177  , 0.1714 ,\n", "       0.1438 , 0.186  , 0.0964 , 0.1455 , 0.1322 , 0.06726, 0.1162 ,\n", "       0.1021 , 0.1396 , 0.1139 , 0.1576 , 0.1417 , 0.2159 , 0.1352 ,\n", "       0.0964 , 0.1853 , 0.1898 , 0.1785 , 0.1648 , 0.1367 , 0.1644 ,\n", "       0.1376 , 0.1974 , 0.1498 , 0.1524 , 0.1579 , 0.147  , 0.1105 ,\n", "       0.1825 , 0.1227 , 0.1414 , 0.1347 , 0.165  , 0.2019 , 0.1487 ,\n", "       0.1784 , 0.0784 , 0.1061 , 0.1491 , 0.0915 , 0.1677 , 0.1811 ,\n", "       0.1377 , 0.2158 , 0.1356 , 0.1062 , 0.132  , 0.05   , 0.08678,\n", "       0.1474 , 0.164  , 0.15   , 0.1606 , 0.1478 , 0.1645 , 0.1415 ,\n", "       0.1821 , 0.1319 , 0.08012, 0.2158 , 0.177  , 0.08209, 0.1254 ,\n", "       0.1611 , 0.1916 , 0.1742 , 0.2063 , 0.122  , 0.1541 , 0.1435 ,\n", "       0.1505 , 0.192  , 0.1104 , 0.1717 , 0.1394 , 0.1503 , 0.18   ,\n", "       0.164  , 0.1808 , 0.1577 , 0.1211 , 0.1523 , 0.1467 , 0.1591 ,\n", "       0.1367 , 0.192  , 0.1359 , 0.1513 , 0.1473 , 0.1377 , 0.1634 ,\n", "       0.1548 , 0.1321 , 0.06092, 0.1505 ])"]}, "execution_count": 10, "metadata": {}, "output_type": "execute_result"}], "source": ["df['porosity'].values"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "slide"}}, "source": ["## DataFrame Transformations"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["There are several member functions that allow for transformations of the DataFrame labels, adding/removing columns, etc.\n", "\n", "To rename DataFrame column labels, we pass a Python dictionary where the keywords are the current labels and the values are the new labels.  For example,"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}, "tags": ["popout"]}, "source": ["The use of the keyword argument `inplace = True` has an equivalent outcome as writing\n", "\n", "```python\n", "df = df.rename(...\n", "```"]}, {"cell_type": "code", "execution_count": 11, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>565</td>\n", "      <td>1485</td>\n", "      <td>1</td>\n", "      <td>0.1184</td>\n", "      <td>6.170</td>\n", "      <td>2.009</td>\n", "    </tr>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>2585</td>\n", "      <td>1185</td>\n", "      <td>1</td>\n", "      <td>0.1566</td>\n", "      <td>6.275</td>\n", "      <td>2.864</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>2065</td>\n", "      <td>2865</td>\n", "      <td>2</td>\n", "      <td>0.1920</td>\n", "      <td>92.297</td>\n", "      <td>3.524</td>\n", "    </tr>\n", "    <tr>\n", "      <th>3</th>\n", "      <td>3575</td>\n", "      <td>2655</td>\n", "      <td>1</td>\n", "      <td>0.1621</td>\n", "      <td>9.048</td>\n", "      <td>2.157</td>\n", "    </tr>\n", "    <tr>\n", "      <th>4</th>\n", "      <td>1835</td>\n", "      <td>35</td>\n", "      <td>1</td>\n", "      <td>0.1766</td>\n", "      <td>7.123</td>\n", "      <td>3.979</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["      X     Y  facies  porosity    perm     ai\n", "0   565  1485       1    0.1184   6.170  2.009\n", "1  2585  1185       1    0.1566   6.275  2.864\n", "2  2065  2865       2    0.1920  92.297  3.524\n", "3  3575  2655       1    0.1621   9.048  2.157\n", "4  1835    35       1    0.1766   7.123  3.979"]}, "execution_count": 11, "metadata": {}, "output_type": "execute_result"}], "source": ["df.rename(columns={'facies_threshold_0.3': 'facies', \n", "                   'permeability': 'perm', \n", "                   'acoustic_impedance': 'ai'}, inplace = True)\n", "df.head()"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "subslide"}}, "source": ["### Adding a New Column"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["Pandas DataFrames share a lot of the same syntax with Python dictionaries including accessing columns by label (i.e. keyword) and adding entries.  The example below shows how to add a new column with the label `'zero'`."]}, {"cell_type": "code", "execution_count": 12, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "      <th>zero</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>565</td>\n", "      <td>1485</td>\n", "      <td>1</td>\n", "      <td>0.1184</td>\n", "      <td>6.170</td>\n", "      <td>2.009</td>\n", "      <td>0.0</td>\n", "    </tr>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>2585</td>\n", "      <td>1185</td>\n", "      <td>1</td>\n", "      <td>0.1566</td>\n", "      <td>6.275</td>\n", "      <td>2.864</td>\n", "      <td>0.0</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>2065</td>\n", "      <td>2865</td>\n", "      <td>2</td>\n", "      <td>0.1920</td>\n", "      <td>92.297</td>\n", "      <td>3.524</td>\n", "      <td>0.0</td>\n", "    </tr>\n", "    <tr>\n", "      <th>3</th>\n", "      <td>3575</td>\n", "      <td>2655</td>\n", "      <td>1</td>\n", "      <td>0.1621</td>\n", "      <td>9.048</td>\n", "      <td>2.157</td>\n", "      <td>0.0</td>\n", "    </tr>\n", "    <tr>\n", "      <th>4</th>\n", "      <td>1835</td>\n", "      <td>35</td>\n", "      <td>1</td>\n", "      <td>0.1766</td>\n", "      <td>7.123</td>\n", "      <td>3.979</td>\n", "      <td>0.0</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["      X     Y  facies  porosity    perm     ai  zero\n", "0   565  1485       1    0.1184   6.170  2.009   0.0\n", "1  2585  1185       1    0.1566   6.275  2.864   0.0\n", "2  2065  2865       2    0.1920  92.297  3.524   0.0\n", "3  3575  2655       1    0.1621   9.048  2.157   0.0\n", "4  1835    35       1    0.1766   7.123  3.979   0.0"]}, "execution_count": 12, "metadata": {}, "output_type": "execute_result"}], "source": ["df['zero'] = np.zeros(len(df)) \n", "df.head()"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "subslide"}}, "source": ["### Removing Columns "]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["We can remove unwanted columns with the [`drop`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.drop.html) member function. The argument `inplace = True` modifies the existing DataFrame in place in memory, i.e. `'zero'` will no longer be accessible in any way in the DataFrame."]}, {"cell_type": "markdown", "metadata": {"tags": ["popout"]}, "source": ["The argument `axis = 1` refers to columns, the default is `axis = 0` in which case the positional argument would be expected to be an index label."]}, {"cell_type": "code", "execution_count": 13, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>565</td>\n", "      <td>1485</td>\n", "      <td>1</td>\n", "      <td>0.1184</td>\n", "      <td>6.170</td>\n", "      <td>2.009</td>\n", "    </tr>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>2585</td>\n", "      <td>1185</td>\n", "      <td>1</td>\n", "      <td>0.1566</td>\n", "      <td>6.275</td>\n", "      <td>2.864</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>2065</td>\n", "      <td>2865</td>\n", "      <td>2</td>\n", "      <td>0.1920</td>\n", "      <td>92.297</td>\n", "      <td>3.524</td>\n", "    </tr>\n", "    <tr>\n", "      <th>3</th>\n", "      <td>3575</td>\n", "      <td>2655</td>\n", "      <td>1</td>\n", "      <td>0.1621</td>\n", "      <td>9.048</td>\n", "      <td>2.157</td>\n", "    </tr>\n", "    <tr>\n", "      <th>4</th>\n", "      <td>1835</td>\n", "      <td>35</td>\n", "      <td>1</td>\n", "      <td>0.1766</td>\n", "      <td>7.123</td>\n", "      <td>3.979</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["      X     Y  facies  porosity    perm     ai\n", "0   565  1485       1    0.1184   6.170  2.009\n", "1  2585  1185       1    0.1566   6.275  2.864\n", "2  2065  2865       2    0.1920  92.297  3.524\n", "3  3575  2655       1    0.1621   9.048  2.157\n", "4  1835    35       1    0.1766   7.123  3.979"]}, "execution_count": 13, "metadata": {}, "output_type": "execute_result"}], "source": ["df.drop('zero', axis=1, inplace=True)\n", "df.head()"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "subslide"}}, "source": ["### Removing Rows"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["We can remove the row indexed by `1` as follows."]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}, "tags": ["popout"]}, "source": ["Notice we can stack member function commands, i.e. the `drop` function is immediately followed by `head` to display the DataFrame with row index `1` removed."]}, {"cell_type": "code", "execution_count": 14, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>565</td>\n", "      <td>1485</td>\n", "      <td>1</td>\n", "      <td>0.1184</td>\n", "      <td>6.170</td>\n", "      <td>2.009</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>2065</td>\n", "      <td>2865</td>\n", "      <td>2</td>\n", "      <td>0.1920</td>\n", "      <td>92.297</td>\n", "      <td>3.524</td>\n", "    </tr>\n", "    <tr>\n", "      <th>3</th>\n", "      <td>3575</td>\n", "      <td>2655</td>\n", "      <td>1</td>\n", "      <td>0.1621</td>\n", "      <td>9.048</td>\n", "      <td>2.157</td>\n", "    </tr>\n", "    <tr>\n", "      <th>4</th>\n", "      <td>1835</td>\n", "      <td>35</td>\n", "      <td>1</td>\n", "      <td>0.1766</td>\n", "      <td>7.123</td>\n", "      <td>3.979</td>\n", "    </tr>\n", "    <tr>\n", "      <th>5</th>\n", "      <td>3375</td>\n", "      <td>2525</td>\n", "      <td>1</td>\n", "      <td>0.1239</td>\n", "      <td>1.468</td>\n", "      <td>2.337</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["      X     Y  facies  porosity    perm     ai\n", "0   565  1485       1    0.1184   6.170  2.009\n", "2  2065  2865       2    0.1920  92.297  3.524\n", "3  3575  2655       1    0.1621   9.048  2.157\n", "4  1835    35       1    0.1766   7.123  3.979\n", "5  3375  2525       1    0.1239   1.468  2.337"]}, "execution_count": 14, "metadata": {}, "output_type": "execute_result"}], "source": ["df.drop(1).head()"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["Because the argument `inplace = True` was not given, the orginal DataFrame is unchanged.  "]}, {"cell_type": "code", "execution_count": 15, "metadata": {"slideshow": {"slide_type": "skip"}}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>565</td>\n", "      <td>1485</td>\n", "      <td>1</td>\n", "      <td>0.1184</td>\n", "      <td>6.170</td>\n", "      <td>2.009</td>\n", "    </tr>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>2585</td>\n", "      <td>1185</td>\n", "      <td>1</td>\n", "      <td>0.1566</td>\n", "      <td>6.275</td>\n", "      <td>2.864</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>2065</td>\n", "      <td>2865</td>\n", "      <td>2</td>\n", "      <td>0.1920</td>\n", "      <td>92.297</td>\n", "      <td>3.524</td>\n", "    </tr>\n", "    <tr>\n", "      <th>3</th>\n", "      <td>3575</td>\n", "      <td>2655</td>\n", "      <td>1</td>\n", "      <td>0.1621</td>\n", "      <td>9.048</td>\n", "      <td>2.157</td>\n", "    </tr>\n", "    <tr>\n", "      <th>4</th>\n", "      <td>1835</td>\n", "      <td>35</td>\n", "      <td>1</td>\n", "      <td>0.1766</td>\n", "      <td>7.123</td>\n", "      <td>3.979</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["      X     Y  facies  porosity    perm     ai\n", "0   565  1485       1    0.1184   6.170  2.009\n", "1  2585  1185       1    0.1566   6.275  2.864\n", "2  2065  2865       2    0.1920  92.297  3.524\n", "3  3575  2655       1    0.1621   9.048  2.157\n", "4  1835    35       1    0.1766   7.123  3.979"]}, "execution_count": 15, "metadata": {}, "output_type": "execute_result"}], "source": ["df.head()"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"scroll": true, "slide_type": "subslide"}}, "source": ["### Sorting"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["We can sort the DataFrame in either ascending or desending order by any column label."]}, {"cell_type": "code", "execution_count": 16, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>38</th>\n", "      <td>3505</td>\n", "      <td>1525</td>\n", "      <td>2</td>\n", "      <td>0.2232</td>\n", "      <td>174.654</td>\n", "      <td>3.344</td>\n", "    </tr>\n", "    <tr>\n", "      <th>117</th>\n", "      <td>2665</td>\n", "      <td>3205</td>\n", "      <td>2</td>\n", "      <td>0.2159</td>\n", "      <td>273.980</td>\n", "      <td>2.551</td>\n", "    </tr>\n", "    <tr>\n", "      <th>164</th>\n", "      <td>2455</td>\n", "      <td>2885</td>\n", "      <td>2</td>\n", "      <td>0.2158</td>\n", "      <td>9.592</td>\n", "      <td>2.773</td>\n", "    </tr>\n", "    <tr>\n", "      <th>148</th>\n", "      <td>1975</td>\n", "      <td>2745</td>\n", "      <td>2</td>\n", "      <td>0.2158</td>\n", "      <td>361.704</td>\n", "      <td>3.839</td>\n", "    </tr>\n", "    <tr>\n", "      <th>97</th>\n", "      <td>1855</td>\n", "      <td>3025</td>\n", "      <td>2</td>\n", "      <td>0.2154</td>\n", "      <td>463.641</td>\n", "      <td>3.091</td>\n", "    </tr>\n", "    <tr>\n", "      <th>26</th>\n", "      <td>1785</td>\n", "      <td>3145</td>\n", "      <td>2</td>\n", "      <td>0.2150</td>\n", "      <td>201.363</td>\n", "      <td>2.877</td>\n", "    </tr>\n", "    <tr>\n", "      <th>171</th>\n", "      <td>3735</td>\n", "      <td>2585</td>\n", "      <td>1</td>\n", "      <td>0.2063</td>\n", "      <td>30.258</td>\n", "      <td>2.100</td>\n", "    </tr>\n", "    <tr>\n", "      <th>51</th>\n", "      <td>1655</td>\n", "      <td>2985</td>\n", "      <td>2</td>\n", "      <td>0.2062</td>\n", "      <td>17.585</td>\n", "      <td>3.444</td>\n", "    </tr>\n", "    <tr>\n", "      <th>138</th>\n", "      <td>1855</td>\n", "      <td>3095</td>\n", "      <td>2</td>\n", "      <td>0.2019</td>\n", "      <td>257.990</td>\n", "      <td>2.886</td>\n", "    </tr>\n", "    <tr>\n", "      <th>63</th>\n", "      <td>845</td>\n", "      <td>3915</td>\n", "      <td>1</td>\n", "      <td>0.1982</td>\n", "      <td>410.570</td>\n", "      <td>2.781</td>\n", "    </tr>\n", "    <tr>\n", "      <th>24</th>\n", "      <td>2625</td>\n", "      <td>3185</td>\n", "      <td>1</td>\n", "      <td>0.1981</td>\n", "      <td>124.222</td>\n", "      <td>2.451</td>\n", "    </tr>\n", "    <tr>\n", "      <th>127</th>\n", "      <td>1615</td>\n", "      <td>2285</td>\n", "      <td>2</td>\n", "      <td>0.1974</td>\n", "      <td>159.567</td>\n", "      <td>3.167</td>\n", "    </tr>\n", "    <tr>\n", "      <th>79</th>\n", "      <td>1265</td>\n", "      <td>3105</td>\n", "      <td>2</td>\n", "      <td>0.1973</td>\n", "      <td>114.044</td>\n", "      <td>2.750</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["        X     Y  facies  porosity     perm     ai\n", "38   3505  1525       2    0.2232  174.654  3.344\n", "117  2665  3205       2    0.2159  273.980  2.551\n", "164  2455  2885       2    0.2158    9.592  2.773\n", "148  1975  2745       2    0.2158  361.704  3.839\n", "97   1855  3025       2    0.2154  463.641  3.091\n", "26   1785  3145       2    0.2150  201.363  2.877\n", "171  3735  2585       1    0.2063   30.258  2.100\n", "51   1655  2985       2    0.2062   17.585  3.444\n", "138  1855  3095       2    0.2019  257.990  2.886\n", "63    845  3915       1    0.1982  410.570  2.781\n", "24   2625  3185       1    0.1981  124.222  2.451\n", "127  1615  2285       2    0.1974  159.567  3.167\n", "79   1265  3105       2    0.1973  114.044  2.750"]}, "execution_count": 16, "metadata": {}, "output_type": "execute_result"}], "source": ["df.sort_values('porosity', ascending=False, inplace=True)\n", "df.head(n=13)"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"scroll": true, "slide_type": "subslide"}}, "source": ["### Reseting Indices"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["In the previous example, the resulting indices are now out of order after the sorting operation.  This can be fixed, if desired, with the [`reset_index`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.reset_index.html) member function."]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}, "tags": ["popout"]}, "source": ["The reindexing operation could have been accomplished during the sort operation by passing the argument `ingnore_index = True`."]}, {"cell_type": "code", "execution_count": 17, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>3505</td>\n", "      <td>1525</td>\n", "      <td>2</td>\n", "      <td>0.2232</td>\n", "      <td>174.654</td>\n", "      <td>3.344</td>\n", "    </tr>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>2665</td>\n", "      <td>3205</td>\n", "      <td>2</td>\n", "      <td>0.2159</td>\n", "      <td>273.980</td>\n", "      <td>2.551</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>2455</td>\n", "      <td>2885</td>\n", "      <td>2</td>\n", "      <td>0.2158</td>\n", "      <td>9.592</td>\n", "      <td>2.773</td>\n", "    </tr>\n", "    <tr>\n", "      <th>3</th>\n", "      <td>1975</td>\n", "      <td>2745</td>\n", "      <td>2</td>\n", "      <td>0.2158</td>\n", "      <td>361.704</td>\n", "      <td>3.839</td>\n", "    </tr>\n", "    <tr>\n", "      <th>4</th>\n", "      <td>1855</td>\n", "      <td>3025</td>\n", "      <td>2</td>\n", "      <td>0.2154</td>\n", "      <td>463.641</td>\n", "      <td>3.091</td>\n", "    </tr>\n", "    <tr>\n", "      <th>5</th>\n", "      <td>1785</td>\n", "      <td>3145</td>\n", "      <td>2</td>\n", "      <td>0.2150</td>\n", "      <td>201.363</td>\n", "      <td>2.877</td>\n", "    </tr>\n", "    <tr>\n", "      <th>6</th>\n", "      <td>3735</td>\n", "      <td>2585</td>\n", "      <td>1</td>\n", "      <td>0.2063</td>\n", "      <td>30.258</td>\n", "      <td>2.100</td>\n", "    </tr>\n", "    <tr>\n", "      <th>7</th>\n", "      <td>1655</td>\n", "      <td>2985</td>\n", "      <td>2</td>\n", "      <td>0.2062</td>\n", "      <td>17.585</td>\n", "      <td>3.444</td>\n", "    </tr>\n", "    <tr>\n", "      <th>8</th>\n", "      <td>1855</td>\n", "      <td>3095</td>\n", "      <td>2</td>\n", "      <td>0.2019</td>\n", "      <td>257.990</td>\n", "      <td>2.886</td>\n", "    </tr>\n", "    <tr>\n", "      <th>9</th>\n", "      <td>845</td>\n", "      <td>3915</td>\n", "      <td>1</td>\n", "      <td>0.1982</td>\n", "      <td>410.570</td>\n", "      <td>2.781</td>\n", "    </tr>\n", "    <tr>\n", "      <th>10</th>\n", "      <td>2625</td>\n", "      <td>3185</td>\n", "      <td>1</td>\n", "      <td>0.1981</td>\n", "      <td>124.222</td>\n", "      <td>2.451</td>\n", "    </tr>\n", "    <tr>\n", "      <th>11</th>\n", "      <td>1615</td>\n", "      <td>2285</td>\n", "      <td>2</td>\n", "      <td>0.1974</td>\n", "      <td>159.567</td>\n", "      <td>3.167</td>\n", "    </tr>\n", "    <tr>\n", "      <th>12</th>\n", "      <td>1265</td>\n", "      <td>3105</td>\n", "      <td>2</td>\n", "      <td>0.1973</td>\n", "      <td>114.044</td>\n", "      <td>2.750</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["       X     Y  facies  porosity     perm     ai\n", "0   3505  1525       2    0.2232  174.654  3.344\n", "1   2665  3205       2    0.2159  273.980  2.551\n", "2   2455  2885       2    0.2158    9.592  2.773\n", "3   1975  2745       2    0.2158  361.704  3.839\n", "4   1855  3025       2    0.2154  463.641  3.091\n", "5   1785  3145       2    0.2150  201.363  2.877\n", "6   3735  2585       1    0.2063   30.258  2.100\n", "7   1655  2985       2    0.2062   17.585  3.444\n", "8   1855  3095       2    0.2019  257.990  2.886\n", "9    845  3915       1    0.1982  410.570  2.781\n", "10  2625  3185       1    0.1981  124.222  2.451\n", "11  1615  2285       2    0.1974  159.567  3.167\n", "12  1265  3105       2    0.1973  114.044  2.750"]}, "execution_count": 17, "metadata": {}, "output_type": "execute_result"}], "source": ["df.reset_index(inplace=True, drop=True)\n", "df.head(n = 13)"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"scroll": true, "slide_type": "slide"}}, "source": ["## Feature Engineering "]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["In the field of data science, DataFrame column labels are often referred to as *features*.  *Feature engineering* is the process of creating new features and/or transforming features for further analysis.  In the example below, we create two new features through manipulations of existing features."]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}, "tags": ["popout"]}, "source": ["Mathematical operations can be performed directly on the DataFrame columns that are accessed by their labels."]}, {"cell_type": "code", "execution_count": 18, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "      <th>% porosity</th>\n", "      <th>perm-por ratio</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>3505</td>\n", "      <td>1525</td>\n", "      <td>2</td>\n", "      <td>0.2232</td>\n", "      <td>174.654</td>\n", "      <td>3.344</td>\n", "      <td>22.32</td>\n", "      <td>782.500000</td>\n", "    </tr>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>2665</td>\n", "      <td>3205</td>\n", "      <td>2</td>\n", "      <td>0.2159</td>\n", "      <td>273.980</td>\n", "      <td>2.551</td>\n", "      <td>21.59</td>\n", "      <td>1269.013432</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>2455</td>\n", "      <td>2885</td>\n", "      <td>2</td>\n", "      <td>0.2158</td>\n", "      <td>9.592</td>\n", "      <td>2.773</td>\n", "      <td>21.58</td>\n", "      <td>44.448563</td>\n", "    </tr>\n", "    <tr>\n", "      <th>3</th>\n", "      <td>1975</td>\n", "      <td>2745</td>\n", "      <td>2</td>\n", "      <td>0.2158</td>\n", "      <td>361.704</td>\n", "      <td>3.839</td>\n", "      <td>21.58</td>\n", "      <td>1676.107507</td>\n", "    </tr>\n", "    <tr>\n", "      <th>4</th>\n", "      <td>1855</td>\n", "      <td>3025</td>\n", "      <td>2</td>\n", "      <td>0.2154</td>\n", "      <td>463.641</td>\n", "      <td>3.091</td>\n", "      <td>21.54</td>\n", "      <td>2152.465181</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["      X     Y  facies  porosity     perm     ai  % porosity  perm-por ratio\n", "0  3505  1525       2    0.2232  174.654  3.344       22.32      782.500000\n", "1  2665  3205       2    0.2159  273.980  2.551       21.59     1269.013432\n", "2  2455  2885       2    0.2158    9.592  2.773       21.58       44.448563\n", "3  1975  2745       2    0.2158  361.704  3.839       21.58     1676.107507\n", "4  1855  3025       2    0.2154  463.641  3.091       21.54     2152.465181"]}, "execution_count": 18, "metadata": {}, "output_type": "execute_result"}], "source": ["df['% porosity'] = df['porosity'] * 100\n", "df['perm-por ratio'] = df['perm'] / df['porosity']          \n", "df.head()"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"scroll": true, "slide_type": "subslide"}}, "source": ["### Assigning Conditional Categories"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["We can also use conditional statements when assigning values to a new feature.  For example, we could have a categorical porosity measure for high and low porosity, called `'porosity type'`."]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}, "tags": ["popout"]}, "source": ["Most NumPy functions such as [`where`](https://docs.scipy.org/doc/numpy/reference/generated/numpy.where.html) will work directly on Pandas DataFrame columns."]}, {"cell_type": "code", "execution_count": 19, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "      <th>% porosity</th>\n", "      <th>perm-por ratio</th>\n", "      <th>porosity type</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>3505</td>\n", "      <td>1525</td>\n", "      <td>2</td>\n", "      <td>0.2232</td>\n", "      <td>174.654</td>\n", "      <td>3.344</td>\n", "      <td>22.32</td>\n", "      <td>782.500000</td>\n", "      <td>high</td>\n", "    </tr>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>2665</td>\n", "      <td>3205</td>\n", "      <td>2</td>\n", "      <td>0.2159</td>\n", "      <td>273.980</td>\n", "      <td>2.551</td>\n", "      <td>21.59</td>\n", "      <td>1269.013432</td>\n", "      <td>high</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>2455</td>\n", "      <td>2885</td>\n", "      <td>2</td>\n", "      <td>0.2158</td>\n", "      <td>9.592</td>\n", "      <td>2.773</td>\n", "      <td>21.58</td>\n", "      <td>44.448563</td>\n", "      <td>high</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["      X     Y  facies  porosity     perm     ai  % porosity  perm-por ratio  \\\n", "0  3505  1525       2    0.2232  174.654  3.344       22.32      782.500000   \n", "1  2665  3205       2    0.2159  273.980  2.551       21.59     1269.013432   \n", "2  2455  2885       2    0.2158    9.592  2.773       21.58       44.448563   \n", "\n", "  porosity type  \n", "0          high  \n", "1          high  \n", "2          high  "]}, "execution_count": 19, "metadata": {}, "output_type": "execute_result"}], "source": ["df['porosity type'] = np.where(df['porosity'] > 0.12, 'high', 'low')\n", "df[df['porosity type'] == 'high'].head(n=3)"]}, {"cell_type": "code", "execution_count": 20, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "      <th>% porosity</th>\n", "      <th>perm-por ratio</th>\n", "      <th>porosity type</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>165</th>\n", "      <td>1365</td>\n", "      <td>2715</td>\n", "      <td>1</td>\n", "      <td>0.1191</td>\n", "      <td>0.2666</td>\n", "      <td>2.788</td>\n", "      <td>11.91</td>\n", "      <td>2.238455</td>\n", "      <td>low</td>\n", "    </tr>\n", "    <tr>\n", "      <th>166</th>\n", "      <td>2765</td>\n", "      <td>925</td>\n", "      <td>1</td>\n", "      <td>0.1190</td>\n", "      <td>0.7731</td>\n", "      <td>2.323</td>\n", "      <td>11.90</td>\n", "      <td>6.496639</td>\n", "      <td>low</td>\n", "    </tr>\n", "    <tr>\n", "      <th>167</th>\n", "      <td>565</td>\n", "      <td>1485</td>\n", "      <td>1</td>\n", "      <td>0.1184</td>\n", "      <td>6.1700</td>\n", "      <td>2.009</td>\n", "      <td>11.84</td>\n", "      <td>52.111486</td>\n", "      <td>low</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["        X     Y  facies  porosity    perm     ai  % porosity  perm-por ratio  \\\n", "165  1365  2715       1    0.1191  0.2666  2.788       11.91        2.238455   \n", "166  2765   925       1    0.1190  0.7731  2.323       11.90        6.496639   \n", "167   565  1485       1    0.1184  6.1700  2.009       11.84       52.111486   \n", "\n", "    porosity type  \n", "165           low  \n", "166           low  \n", "167           low  "]}, "execution_count": 20, "metadata": {}, "output_type": "execute_result"}], "source": ["df[df['porosity type'] == 'low'].head(n=3)"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"scroll": true, "slide_type": "subslide"}}, "source": ["### Feature Truncation"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["Here's an example where we use a conditional statement to assign a very low permeability value (0.0001 mD) for all porosity values below a threshold. Of course, this is for demonstration, in practice a much lower porosity threshold would likely be applied.  "]}, {"cell_type": "code", "execution_count": 21, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "      <th>% porosity</th>\n", "      <th>perm-por ratio</th>\n", "      <th>porosity type</th>\n", "      <th>perm cutoff</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>3505</td>\n", "      <td>1525</td>\n", "      <td>2</td>\n", "      <td>0.2232</td>\n", "      <td>174.654</td>\n", "      <td>3.344</td>\n", "      <td>22.32</td>\n", "      <td>782.500000</td>\n", "      <td>high</td>\n", "      <td>174.654</td>\n", "    </tr>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>2665</td>\n", "      <td>3205</td>\n", "      <td>2</td>\n", "      <td>0.2159</td>\n", "      <td>273.980</td>\n", "      <td>2.551</td>\n", "      <td>21.59</td>\n", "      <td>1269.013432</td>\n", "      <td>high</td>\n", "      <td>273.980</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>2455</td>\n", "      <td>2885</td>\n", "      <td>2</td>\n", "      <td>0.2158</td>\n", "      <td>9.592</td>\n", "      <td>2.773</td>\n", "      <td>21.58</td>\n", "      <td>44.448563</td>\n", "      <td>high</td>\n", "      <td>9.592</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["      X     Y  facies  porosity     perm     ai  % porosity  perm-por ratio  \\\n", "0  3505  1525       2    0.2232  174.654  3.344       22.32      782.500000   \n", "1  2665  3205       2    0.2159  273.980  2.551       21.59     1269.013432   \n", "2  2455  2885       2    0.2158    9.592  2.773       21.58       44.448563   \n", "\n", "  porosity type  perm cutoff  \n", "0          high      174.654  \n", "1          high      273.980  \n", "2          high        9.592  "]}, "execution_count": 21, "metadata": {}, "output_type": "execute_result"}], "source": ["df['perm cutoff'] = np.where(df['porosity'] > 0.12, df['perm'], 0.0001) \n", "df.head(n=3)"]}, {"cell_type": "code", "execution_count": 22, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "      <th>% porosity</th>\n", "      <th>perm-por ratio</th>\n", "      <th>porosity type</th>\n", "      <th>perm cutoff</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>165</th>\n", "      <td>1365</td>\n", "      <td>2715</td>\n", "      <td>1</td>\n", "      <td>0.1191</td>\n", "      <td>0.2666</td>\n", "      <td>2.788</td>\n", "      <td>11.91</td>\n", "      <td>2.238455</td>\n", "      <td>low</td>\n", "      <td>0.0001</td>\n", "    </tr>\n", "    <tr>\n", "      <th>166</th>\n", "      <td>2765</td>\n", "      <td>925</td>\n", "      <td>1</td>\n", "      <td>0.1190</td>\n", "      <td>0.7731</td>\n", "      <td>2.323</td>\n", "      <td>11.90</td>\n", "      <td>6.496639</td>\n", "      <td>low</td>\n", "      <td>0.0001</td>\n", "    </tr>\n", "    <tr>\n", "      <th>167</th>\n", "      <td>565</td>\n", "      <td>1485</td>\n", "      <td>1</td>\n", "      <td>0.1184</td>\n", "      <td>6.1700</td>\n", "      <td>2.009</td>\n", "      <td>11.84</td>\n", "      <td>52.111486</td>\n", "      <td>low</td>\n", "      <td>0.0001</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["        X     Y  facies  porosity    perm     ai  % porosity  perm-por ratio  \\\n", "165  1365  2715       1    0.1191  0.2666  2.788       11.91        2.238455   \n", "166  2765   925       1    0.1190  0.7731  2.323       11.90        6.496639   \n", "167   565  1485       1    0.1184  6.1700  2.009       11.84       52.111486   \n", "\n", "    porosity type  perm cutoff  \n", "165           low       0.0001  \n", "166           low       0.0001  \n", "167           low       0.0001  "]}, "execution_count": 22, "metadata": {}, "output_type": "execute_result"}], "source": ["df[df['perm cutoff'] == 0.0001].head(n=3)"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"scrolling": true, "slide_type": "subslide"}}, "source": ["### Applying functions to Series/DataFrame"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["We can apply any function that we can define in Python to entries of a Series or DataFrame.  First we define a function.  This function returns the Kozeny-Carmen relationship to predict permeability from porosity \u03d5, for values of \u03d5 greater that $0.12$, otherwise it returns $0.0001$.  The proportionality constant $m$ is given as an additional keyword argument."]}, {"cell_type": "code", "execution_count": 23, "metadata": {"slideshow": {"slide_type": "-"}}, "outputs": [], "source": ["def kozeny_carmen_with_threshold(\u03d5, m=5):\n", "    \n", "    if \u03d5 > 0.12:\n", "        return m * \u03d5 ** 3 / (1 - \u03d5) ** 2\n", "    else:\n", "        return 0.0001"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "-"}}, "source": [" Using the [`apply`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.apply.html) member function we can transform the `'porosity'` column into permeability via the `kozeny_carmen_with_threshold` function above.  "]}, {"cell_type": "code", "execution_count": 24, "metadata": {"slideshow": {"slide_type": "-"}}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "      <th>% porosity</th>\n", "      <th>perm-por ratio</th>\n", "      <th>porosity type</th>\n", "      <th>perm cutoff</th>\n", "      <th>kozeny carmen</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>3505</td>\n", "      <td>1525</td>\n", "      <td>2</td>\n", "      <td>0.22320</td>\n", "      <td>174.65400</td>\n", "      <td>3.344</td>\n", "      <td>22.320</td>\n", "      <td>782.500000</td>\n", "      <td>high</td>\n", "      <td>174.6540</td>\n", "      <td>0.184274</td>\n", "    </tr>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>2665</td>\n", "      <td>3205</td>\n", "      <td>2</td>\n", "      <td>0.21590</td>\n", "      <td>273.98000</td>\n", "      <td>2.551</td>\n", "      <td>21.590</td>\n", "      <td>1269.013432</td>\n", "      <td>high</td>\n", "      <td>273.9800</td>\n", "      <td>0.163687</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>2455</td>\n", "      <td>2885</td>\n", "      <td>2</td>\n", "      <td>0.21580</td>\n", "      <td>9.59200</td>\n", "      <td>2.773</td>\n", "      <td>21.580</td>\n", "      <td>44.448563</td>\n", "      <td>high</td>\n", "      <td>9.5920</td>\n", "      <td>0.163418</td>\n", "    </tr>\n", "    <tr>\n", "      <th>3</th>\n", "      <td>1975</td>\n", "      <td>2745</td>\n", "      <td>2</td>\n", "      <td>0.21580</td>\n", "      <td>361.70400</td>\n", "      <td>3.839</td>\n", "      <td>21.580</td>\n", "      <td>1676.107507</td>\n", "      <td>high</td>\n", "      <td>361.7040</td>\n", "      <td>0.163418</td>\n", "    </tr>\n", "    <tr>\n", "      <th>4</th>\n", "      <td>1855</td>\n", "      <td>3025</td>\n", "      <td>2</td>\n", "      <td>0.21540</td>\n", "      <td>463.64100</td>\n", "      <td>3.091</td>\n", "      <td>21.540</td>\n", "      <td>2152.465181</td>\n", "      <td>high</td>\n", "      <td>463.6410</td>\n", "      <td>0.162346</td>\n", "    </tr>\n", "    <tr>\n", "      <th>...</th>\n", "      <td>...</td>\n", "      <td>...</td>\n", "      <td>...</td>\n", "      <td>...</td>\n", "      <td>...</td>\n", "      <td>...</td>\n", "      <td>...</td>\n", "      <td>...</td>\n", "      <td>...</td>\n", "      <td>...</td>\n", "      <td>...</td>\n", "    </tr>\n", "    <tr>\n", "      <th>195</th>\n", "      <td>1745</td>\n", "      <td>255</td>\n", "      <td>2</td>\n", "      <td>0.07840</td>\n", "      <td>1.01500</td>\n", "      <td>3.949</td>\n", "      <td>7.840</td>\n", "      <td>12.946429</td>\n", "      <td>low</td>\n", "      <td>0.0001</td>\n", "      <td>0.000100</td>\n", "    </tr>\n", "    <tr>\n", "      <th>196</th>\n", "      <td>3835</td>\n", "      <td>1095</td>\n", "      <td>1</td>\n", "      <td>0.07338</td>\n", "      <td>0.02198</td>\n", "      <td>3.775</td>\n", "      <td>7.338</td>\n", "      <td>0.299537</td>\n", "      <td>low</td>\n", "      <td>0.0001</td>\n", "      <td>0.000100</td>\n", "    </tr>\n", "    <tr>\n", "      <th>197</th>\n", "      <td>2365</td>\n", "      <td>355</td>\n", "      <td>1</td>\n", "      <td>0.06726</td>\n", "      <td>0.15170</td>\n", "      <td>3.833</td>\n", "      <td>6.726</td>\n", "      <td>2.255427</td>\n", "      <td>low</td>\n", "      <td>0.0001</td>\n", "      <td>0.000100</td>\n", "    </tr>\n", "    <tr>\n", "      <th>198</th>\n", "      <td>3795</td>\n", "      <td>535</td>\n", "      <td>1</td>\n", "      <td>0.06092</td>\n", "      <td>0.01582</td>\n", "      <td>3.907</td>\n", "      <td>6.092</td>\n", "      <td>0.259685</td>\n", "      <td>low</td>\n", "      <td>0.0001</td>\n", "      <td>0.000100</td>\n", "    </tr>\n", "    <tr>\n", "      <th>199</th>\n", "      <td>3745</td>\n", "      <td>115</td>\n", "      <td>1</td>\n", "      <td>0.05000</td>\n", "      <td>0.01653</td>\n", "      <td>3.527</td>\n", "      <td>5.000</td>\n", "      <td>0.330600</td>\n", "      <td>low</td>\n", "      <td>0.0001</td>\n", "      <td>0.000100</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "<p>200 rows \u00d7 11 columns</p>\n", "</div>"], "text/plain": ["        X     Y  facies  porosity       perm     ai  % porosity  \\\n", "0    3505  1525       2   0.22320  174.65400  3.344      22.320   \n", "1    2665  3205       2   0.21590  273.98000  2.551      21.590   \n", "2    2455  2885       2   0.21580    9.59200  2.773      21.580   \n", "3    1975  2745       2   0.21580  361.70400  3.839      21.580   \n", "4    1855  3025       2   0.21540  463.64100  3.091      21.540   \n", "..    ...   ...     ...       ...        ...    ...         ...   \n", "195  1745   255       2   0.07840    1.01500  3.949       7.840   \n", "196  3835  1095       1   0.07338    0.02198  3.775       7.338   \n", "197  2365   355       1   0.06726    0.15170  3.833       6.726   \n", "198  3795   535       1   0.06092    0.01582  3.907       6.092   \n", "199  3745   115       1   0.05000    0.01653  3.527       5.000   \n", "\n", "     perm-por ratio porosity type  perm cutoff  kozeny carmen  \n", "0        782.500000          high     174.6540       0.184274  \n", "1       1269.013432          high     273.9800       0.163687  \n", "2         44.448563          high       9.5920       0.163418  \n", "3       1676.107507          high     361.7040       0.163418  \n", "4       2152.465181          high     463.6410       0.162346  \n", "..              ...           ...          ...            ...  \n", "195       12.946429           low       0.0001       0.000100  \n", "196        0.299537           low       0.0001       0.000100  \n", "197        2.255427           low       0.0001       0.000100  \n", "198        0.259685           low       0.0001       0.000100  \n", "199        0.330600           low       0.0001       0.000100  \n", "\n", "[200 rows x 11 columns]"]}, "execution_count": 24, "metadata": {}, "output_type": "execute_result"}], "source": ["df['kozeny carmen'] = df['porosity'].apply(kozeny_carmen_with_threshold, m=10)\n", "df"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "subslide"}}, "source": ["### Missing Features"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["It's very common in data analysis to have missing and/or invalid values in our our DataFrames.  Pandas offers several built in methods to identify and deal with missing Data.  "]}, {"cell_type": "markdown", "metadata": {}, "source": ["First, let's create a missing data point in the `'porosity'` column of `df`."]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}, "tags": ["popout"]}, "source": ["The [`at`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.at.html#pandas.DataFrame.at) member function allows for fast selection of a single row/label position within a Series/DataFrame."]}, {"cell_type": "code", "execution_count": 25, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "      <th>% porosity</th>\n", "      <th>perm-por ratio</th>\n", "      <th>porosity type</th>\n", "      <th>perm cutoff</th>\n", "      <th>kozeny carmen</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>3505</td>\n", "      <td>1525</td>\n", "      <td>2</td>\n", "      <td>0.2232</td>\n", "      <td>174.654</td>\n", "      <td>3.344</td>\n", "      <td>22.32</td>\n", "      <td>782.500000</td>\n", "      <td>high</td>\n", "      <td>174.654</td>\n", "      <td>0.184274</td>\n", "    </tr>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>2665</td>\n", "      <td>3205</td>\n", "      <td>2</td>\n", "      <td>NaN</td>\n", "      <td>273.980</td>\n", "      <td>2.551</td>\n", "      <td>21.59</td>\n", "      <td>1269.013432</td>\n", "      <td>high</td>\n", "      <td>273.980</td>\n", "      <td>0.163687</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>2455</td>\n", "      <td>2885</td>\n", "      <td>2</td>\n", "      <td>0.2158</td>\n", "      <td>9.592</td>\n", "      <td>2.773</td>\n", "      <td>21.58</td>\n", "      <td>44.448563</td>\n", "      <td>high</td>\n", "      <td>9.592</td>\n", "      <td>0.163418</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["      X     Y  facies  porosity     perm     ai  % porosity  perm-por ratio  \\\n", "0  3505  1525       2    0.2232  174.654  3.344       22.32      782.500000   \n", "1  2665  3205       2       NaN  273.980  2.551       21.59     1269.013432   \n", "2  2455  2885       2    0.2158    9.592  2.773       21.58       44.448563   \n", "\n", "  porosity type  perm cutoff  kozeny carmen  \n", "0          high      174.654       0.184274  \n", "1          high      273.980       0.163687  \n", "2          high        9.592       0.163418  "]}, "execution_count": 25, "metadata": {}, "output_type": "execute_result"}], "source": ["df.at[1, 'porosity'] = None\n", "df.head(n = 3)"]}, {"cell_type": "markdown", "metadata": {}, "source": ["The [`isnull`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.isnull.html) member function returns a boolean array that identifies rows with missing values."]}, {"cell_type": "code", "execution_count": 26, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "      <th>% porosity</th>\n", "      <th>perm-por ratio</th>\n", "      <th>porosity type</th>\n", "      <th>perm cutoff</th>\n", "      <th>kozeny carmen</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>2665</td>\n", "      <td>3205</td>\n", "      <td>2</td>\n", "      <td>NaN</td>\n", "      <td>273.98</td>\n", "      <td>2.551</td>\n", "      <td>21.59</td>\n", "      <td>1269.013432</td>\n", "      <td>high</td>\n", "      <td>273.98</td>\n", "      <td>0.163687</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["      X     Y  facies  porosity    perm     ai  % porosity  perm-por ratio  \\\n", "1  2665  3205       2       NaN  273.98  2.551       21.59     1269.013432   \n", "\n", "  porosity type  perm cutoff  kozeny carmen  \n", "1          high       273.98       0.163687  "]}, "execution_count": 26, "metadata": {}, "output_type": "execute_result"}], "source": ["df[df['porosity'].isnull()]"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "subslide"}}, "source": ["### Dropping missing rows"]}, {"cell_type": "markdown", "metadata": {}, "source": ["The [`dropna`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.dropna.html) member function allows us to remove missing rows from the DataFrame."]}, {"cell_type": "code", "execution_count": 27, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>X</th>\n", "      <th>Y</th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "      <th>% porosity</th>\n", "      <th>perm-por ratio</th>\n", "      <th>porosity type</th>\n", "      <th>perm cutoff</th>\n", "      <th>kozeny carmen</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>3505</td>\n", "      <td>1525</td>\n", "      <td>2</td>\n", "      <td>0.2232</td>\n", "      <td>174.654</td>\n", "      <td>3.344</td>\n", "      <td>22.32</td>\n", "      <td>782.500000</td>\n", "      <td>high</td>\n", "      <td>174.654</td>\n", "      <td>0.184274</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>2455</td>\n", "      <td>2885</td>\n", "      <td>2</td>\n", "      <td>0.2158</td>\n", "      <td>9.592</td>\n", "      <td>2.773</td>\n", "      <td>21.58</td>\n", "      <td>44.448563</td>\n", "      <td>high</td>\n", "      <td>9.592</td>\n", "      <td>0.163418</td>\n", "    </tr>\n", "    <tr>\n", "      <th>3</th>\n", "      <td>1975</td>\n", "      <td>2745</td>\n", "      <td>2</td>\n", "      <td>0.2158</td>\n", "      <td>361.704</td>\n", "      <td>3.839</td>\n", "      <td>21.58</td>\n", "      <td>1676.107507</td>\n", "      <td>high</td>\n", "      <td>361.704</td>\n", "      <td>0.163418</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["      X     Y  facies  porosity     perm     ai  % porosity  perm-por ratio  \\\n", "0  3505  1525       2    0.2232  174.654  3.344       22.32      782.500000   \n", "2  2455  2885       2    0.2158    9.592  2.773       21.58       44.448563   \n", "3  1975  2745       2    0.2158  361.704  3.839       21.58     1676.107507   \n", "\n", "  porosity type  perm cutoff  kozeny carmen  \n", "0          high      174.654       0.184274  \n", "2          high        9.592       0.163418  \n", "3          high      361.704       0.163418  "]}, "execution_count": 27, "metadata": {}, "output_type": "execute_result"}], "source": ["df.dropna(inplace=True)\n", "df.head(n = 3)"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"scrolling": true, "slide_type": "slide"}}, "source": ["## Creating New DataFrames"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["Up to now, we've utilized a DataFrame that was created by reading in the data from a CSV file.  We can also create DataFrames from scratch.  First we'll create a couple of NumPy arrays with representative data for demonstration."]}, {"cell_type": "code", "execution_count": 28, "metadata": {}, "outputs": [], "source": ["porosity = np.random.random_sample(100) * 0.2\n", "permeability = 10 * porosity ** 3 / (1 - porosity) ** 2 "]}, {"cell_type": "markdown", "metadata": {}, "source": ["Create a Python dictionary where the keywords are the desired DataFrame labels and the values are the associated data."]}, {"cell_type": "code", "execution_count": 29, "metadata": {}, "outputs": [], "source": ["df_dict = {'porosity': porosity, 'permeability': permeability}"]}, {"cell_type": "markdown", "metadata": {}, "source": ["Pass the dictionary as an argument to `pd.Dataframe` to create the DataFrame"]}, {"cell_type": "code", "execution_count": 30, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>porosity</th>\n", "      <th>permeability</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>0.001372</td>\n", "      <td>2.587134e-08</td>\n", "    </tr>\n", "    <tr>\n", "      <th>1</th>\n", "      <td>0.003407</td>\n", "      <td>3.980377e-07</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>0.005140</td>\n", "      <td>1.371724e-06</td>\n", "    </tr>\n", "    <tr>\n", "      <th>3</th>\n", "      <td>0.005541</td>\n", "      <td>1.720006e-06</td>\n", "    </tr>\n", "    <tr>\n", "      <th>4</th>\n", "      <td>0.009899</td>\n", "      <td>9.894022e-06</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["   porosity  permeability\n", "0  0.001372  2.587134e-08\n", "1  0.003407  3.980377e-07\n", "2  0.005140  1.371724e-06\n", "3  0.005541  1.720006e-06\n", "4  0.009899  9.894022e-06"]}, "execution_count": 30, "metadata": {}, "output_type": "execute_result"}], "source": ["df_new = pd.DataFrame(df_dict)\n", "df_new.sort_values('porosity', inplace=True, ignore_index=True)\n", "df_new.head()"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"scrolling": true, "slide_type": "subslide"}}, "source": ["## Merging DataFrames"]}, {"cell_type": "markdown", "metadata": {}, "source": ["In this example, we'll take a couple subsets from our original DataFrame and create a new one by joining them with the [`concat`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.concat.html) function."]}, {"cell_type": "code", "execution_count": 31, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "      <th>% porosity</th>\n", "      <th>perm-por ratio</th>\n", "      <th>porosity type</th>\n", "      <th>perm cutoff</th>\n", "      <th>kozeny carmen</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>2</td>\n", "      <td>0.2232</td>\n", "      <td>174.654</td>\n", "      <td>3.344</td>\n", "      <td>22.32</td>\n", "      <td>782.500000</td>\n", "      <td>high</td>\n", "      <td>174.654</td>\n", "      <td>0.184274</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>2</td>\n", "      <td>0.2158</td>\n", "      <td>9.592</td>\n", "      <td>2.773</td>\n", "      <td>21.58</td>\n", "      <td>44.448563</td>\n", "      <td>high</td>\n", "      <td>9.592</td>\n", "      <td>0.163418</td>\n", "    </tr>\n", "    <tr>\n", "      <th>3</th>\n", "      <td>2</td>\n", "      <td>0.2158</td>\n", "      <td>361.704</td>\n", "      <td>3.839</td>\n", "      <td>21.58</td>\n", "      <td>1676.107507</td>\n", "      <td>high</td>\n", "      <td>361.704</td>\n", "      <td>0.163418</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["   facies  porosity     perm     ai  % porosity  perm-por ratio porosity type  \\\n", "0       2    0.2232  174.654  3.344       22.32      782.500000          high   \n", "2       2    0.2158    9.592  2.773       21.58       44.448563          high   \n", "3       2    0.2158  361.704  3.839       21.58     1676.107507          high   \n", "\n", "   perm cutoff  kozeny carmen  \n", "0      174.654       0.184274  \n", "2        9.592       0.163418  \n", "3      361.704       0.163418  "]}, "execution_count": 31, "metadata": {}, "output_type": "execute_result"}], "source": ["df1 = df.iloc[0:3,2:]; df1"]}, {"cell_type": "code", "execution_count": 32, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "      <th>% porosity</th>\n", "      <th>perm-por ratio</th>\n", "      <th>porosity type</th>\n", "      <th>perm cutoff</th>\n", "      <th>kozeny carmen</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>11</th>\n", "      <td>2</td>\n", "      <td>0.1974</td>\n", "      <td>159.567</td>\n", "      <td>3.167</td>\n", "      <td>19.74</td>\n", "      <td>808.343465</td>\n", "      <td>high</td>\n", "      <td>159.567</td>\n", "      <td>0.119411</td>\n", "    </tr>\n", "    <tr>\n", "      <th>12</th>\n", "      <td>2</td>\n", "      <td>0.1973</td>\n", "      <td>114.044</td>\n", "      <td>2.750</td>\n", "      <td>19.73</td>\n", "      <td>578.023315</td>\n", "      <td>high</td>\n", "      <td>114.044</td>\n", "      <td>0.119200</td>\n", "    </tr>\n", "    <tr>\n", "      <th>13</th>\n", "      <td>2</td>\n", "      <td>0.1965</td>\n", "      <td>199.952</td>\n", "      <td>2.747</td>\n", "      <td>19.65</td>\n", "      <td>1017.567430</td>\n", "      <td>high</td>\n", "      <td>199.952</td>\n", "      <td>0.117521</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["    facies  porosity     perm     ai  % porosity  perm-por ratio  \\\n", "11       2    0.1974  159.567  3.167       19.74      808.343465   \n", "12       2    0.1973  114.044  2.750       19.73      578.023315   \n", "13       2    0.1965  199.952  2.747       19.65     1017.567430   \n", "\n", "   porosity type  perm cutoff  kozeny carmen  \n", "11          high      159.567       0.119411  \n", "12          high      114.044       0.119200  \n", "13          high      199.952       0.117521  "]}, "execution_count": 32, "metadata": {}, "output_type": "execute_result"}], "source": ["df2 = df.iloc[10:13,2:]; df2"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}, "tags": ["popout"]}, "source": ["We could have reindexed with the `ingnore_index = True` keyword argument."]}, {"cell_type": "code", "execution_count": 33, "metadata": {}, "outputs": [{"data": {"text/html": ["<div>\n", "<style scoped>\n", "    .dataframe tbody tr th:only-of-type {\n", "        vertical-align: middle;\n", "    }\n", "\n", "    .dataframe tbody tr th {\n", "        vertical-align: top;\n", "    }\n", "\n", "    .dataframe thead th {\n", "        text-align: right;\n", "    }\n", "</style>\n", "<table border=\"1\" class=\"dataframe\">\n", "  <thead>\n", "    <tr style=\"text-align: right;\">\n", "      <th></th>\n", "      <th>facies</th>\n", "      <th>porosity</th>\n", "      <th>perm</th>\n", "      <th>ai</th>\n", "      <th>% porosity</th>\n", "      <th>perm-por ratio</th>\n", "      <th>porosity type</th>\n", "      <th>perm cutoff</th>\n", "      <th>kozeny carmen</th>\n", "    </tr>\n", "  </thead>\n", "  <tbody>\n", "    <tr>\n", "      <th>0</th>\n", "      <td>2</td>\n", "      <td>0.2232</td>\n", "      <td>174.654</td>\n", "      <td>3.344</td>\n", "      <td>22.32</td>\n", "      <td>782.500000</td>\n", "      <td>high</td>\n", "      <td>174.654</td>\n", "      <td>0.184274</td>\n", "    </tr>\n", "    <tr>\n", "      <th>2</th>\n", "      <td>2</td>\n", "      <td>0.2158</td>\n", "      <td>9.592</td>\n", "      <td>2.773</td>\n", "      <td>21.58</td>\n", "      <td>44.448563</td>\n", "      <td>high</td>\n", "      <td>9.592</td>\n", "      <td>0.163418</td>\n", "    </tr>\n", "    <tr>\n", "      <th>3</th>\n", "      <td>2</td>\n", "      <td>0.2158</td>\n", "      <td>361.704</td>\n", "      <td>3.839</td>\n", "      <td>21.58</td>\n", "      <td>1676.107507</td>\n", "      <td>high</td>\n", "      <td>361.704</td>\n", "      <td>0.163418</td>\n", "    </tr>\n", "    <tr>\n", "      <th>11</th>\n", "      <td>2</td>\n", "      <td>0.1974</td>\n", "      <td>159.567</td>\n", "      <td>3.167</td>\n", "      <td>19.74</td>\n", "      <td>808.343465</td>\n", "      <td>high</td>\n", "      <td>159.567</td>\n", "      <td>0.119411</td>\n", "    </tr>\n", "    <tr>\n", "      <th>12</th>\n", "      <td>2</td>\n", "      <td>0.1973</td>\n", "      <td>114.044</td>\n", "      <td>2.750</td>\n", "      <td>19.73</td>\n", "      <td>578.023315</td>\n", "      <td>high</td>\n", "      <td>114.044</td>\n", "      <td>0.119200</td>\n", "    </tr>\n", "    <tr>\n", "      <th>13</th>\n", "      <td>2</td>\n", "      <td>0.1965</td>\n", "      <td>199.952</td>\n", "      <td>2.747</td>\n", "      <td>19.65</td>\n", "      <td>1017.567430</td>\n", "      <td>high</td>\n", "      <td>199.952</td>\n", "      <td>0.117521</td>\n", "    </tr>\n", "  </tbody>\n", "</table>\n", "</div>"], "text/plain": ["    facies  porosity     perm     ai  % porosity  perm-por ratio  \\\n", "0        2    0.2232  174.654  3.344       22.32      782.500000   \n", "2        2    0.2158    9.592  2.773       21.58       44.448563   \n", "3        2    0.2158  361.704  3.839       21.58     1676.107507   \n", "11       2    0.1974  159.567  3.167       19.74      808.343465   \n", "12       2    0.1973  114.044  2.750       19.73      578.023315   \n", "13       2    0.1965  199.952  2.747       19.65     1017.567430   \n", "\n", "   porosity type  perm cutoff  kozeny carmen  \n", "0           high      174.654       0.184274  \n", "2           high        9.592       0.163418  \n", "3           high      361.704       0.163418  \n", "11          high      159.567       0.119411  \n", "12          high      114.044       0.119200  \n", "13          high      199.952       0.117521  "]}, "execution_count": 33, "metadata": {}, "output_type": "execute_result"}], "source": ["pd.concat([df1, df2], axis=0)"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "slide"}}, "source": ["## Plotting DataFrames"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["Pandas has some built in automatic plotting methods for DataFrames. They are most useful for quick-look plots of relationships between DataFrame columns, but they can be fully customized to make publication quality plots with additional options available in the [Matplotlib](https://matplotlib.org/) plotting library.  The default [`plot`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.plot.html) member function will create a line plot of all DataFrame labels as functions of the index."]}, {"cell_type": "code", "execution_count": 34, "metadata": {}, "outputs": [{"data": {"image/png": "iVBORw0KGgoAAAANSUhEUgAAAYAAAAD4CAYAAADlwTGnAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy8li6FKAAAgAElEQVR4nO3dd3hUVfrA8e+bDgkkEJASupRQgiBBsAuKYgMLCgoqlmUt6Or+1rLuLqtYFstadnVdUcGuKCoiiiiCqwIioXcIEEhCTScJqfP+/rgDjpHIAEkmM/N+nicPM+eWeS83Oe+dc889R1QVY4wxwSfE1wEYY4zxDUsAxhgTpCwBGGNMkLIEYIwxQcoSgDHGBKkwXwdwNJo1a6YdOnTwdRjGGONXli5dmqWqzauW+1UC6NChAykpKb4Owxhj/IqIbD9cuTUBGWNMkLIEYIwxQcqrBCAiQ0Vko4ikisgDh1n+RxFZJyKrROQbEWnvsewGEdns/rnBo7yfiKx27/NfIiI1c0jGGGO8ccR7ACISCrwIDAEygCUiMlNV13msthxIVtViEbkNeBIYKSJNgb8DyYACS93b5gIvAb8DFgNfAEOB2Ud7AOXl5WRkZFBSUnK0m5oaFBUVRZs2bQgPD/d1KMYYL3lzE/gUIFVVtwKIyPvAcOBQAlDV+R7r/wiMcb++APhaVXPc234NDBWRb4HGqvqju/xN4DKOIQFkZGTQqFEjOnTogH2J8A1VJTs7m4yMDDp27OjrcIwxXvKmCSgBSPd4n+Euq87N/FyRV7dtgvu1t/usVklJCfHx8Vb5+5CIEB8fb9/CjPEzNdoNVETG4DT3nF2D+xwHjANo165ddevU1MeZY2TnwBj/4803gEygrcf7Nu6yXxCR84C/AMNUtfQI22a6X//mPgFUdbKqJqtqcvPmv3qOwRhjAlpWYSkTP1vHgbLKGt+3NwlgCdBFRDqKSAQwCpjpuYKI9AVexqn893osmgOcLyJNRKQJcD4wR1V3AQUiMtDd++d64NMaOJ6AN3PmTCZNmgTAjBkzWLdu3RG2MMb4q4pKF3e+u5x3Fm8nLbuoxvd/xASgqhXAeJzKfD3wgaquFZGJIjLMvdpTQAzwoYisEJGZ7m1zgEdwksgSYOLBG8LA7cCrQCqwhWO4ARwIKiuPLqsPGzaMBx5weuJaAjAmsD05ZyOLtmbz2OVJdG/VuOY/QFX95qdfv35a1bp1635VVte2bdum3bp102uvvVYTExP1yiuv1KKiIp07d6726dNHe/XqpTfeeKOWlJSoqmr79u31vvvu0759++p7772ny5cv1wEDBmhSUpJedtllmpOTo6qqzz//vHbv3l2TkpJ05MiRqqo6depUveOOO3TBggXapEkT7dChg5500kmampqqffv2PRTTpk2bfvG+LtSHc2FMoJi1cqe2v3+W/vWT1ce9LyBFD1On+tVYQEfy8GdrWbezoEb32aN1Y/5+ac8jrrdx40Zee+01Tj/9dG666SaeeeYZXn75Zb755hu6du3K9ddfz0svvcTdd98NQHx8PMuWLQOgd+/e/Pvf/+bss89mwoQJPPzwwzz33HNMmjSJbdu2ERkZSV5e3i8+77TTTmPYsGFccskljBgxAoDY2FhWrFhBnz59mDp1KjfeeGON/l8YY2rPtqwipi1Jp6S8kvJKF58sz+TkdnH87ZIetfaZNhREDWnbti2nn346AGPGjOGbb76hY8eOdO3aFYAbbriB77777tD6I0eOBCA/P5+8vDzOPvvsX63Xu3dvRo8ezdtvv01Y2JFz9S233MLUqVOprKxk2rRpXHvttTV6jMaY2rEr/wDXTP6RV7/fysfLMvhyzW66nBDDS2P6ERFWe9V0QH0D8OZKvbZU7QYZFxdHdnZ2tetHR0cfcZ+ff/453333HZ999hmPPfYYq1ev/s31r7zySh5++GEGDx5Mv379iI+P9y54Y4zPFJSUc+PUJRSWVjBz/Bn0aF0Lbf3VsG8ANWTHjh0sWrQIgHfffZfk5GTS0tJITU0F4K233jp0le8pNjaWJk2a8P333/9iPZfLRXp6OoMGDeKJJ54gPz+fwsLCX2zbqFEj9u/ff+h9VFQUF1xwAbfddps1/xjjB8oqXNz29lJS9xby3zH96rTyB0sANaZbt268+OKLdO/endzcXO655x6mTp3KVVddRVJSEiEhIdx6662H3faNN97g3nvvpXfv3qxYsYIJEyZQWVnJmDFjSEpKom/fvtx1113ExcX9YrtRo0bx1FNP0bdvX7Zs2QLA6NGjCQkJ4fzzz6/1YzbGHLtlO3IZOXkRC1KzeXJEb87o0qzOYxDnBrF/SE5O1qoTwqxfv57u3bv7KCJHWloal1xyCWvWrPFpHABPP/00+fn5PPLII3X+2fXhXBhT36XnFPPknI18tnInzRtF8peLunNZ32MaCcdrIrJUVZOrlgfUPYBgd/nll7NlyxbmzZvn61CMMVWk5xTz4vxUpi/NICxUuOvcLvz+rE5ER/quGrYEUAM6dOhQL67+P/nkE1+HYIxx27u/hIWp2WzYvZ8Nuwv4YXMWISHCmIHtufXsE2kZG+XrEC0BGGNMTUvLKmLEfxeSVVhGeKhwYvMYrj+1A+PO6lQvKv6DLAEYY0wN2ltQwnVTFuNS+Oi2U+ndJo7w0PrZ38YSgDHG1JCCknJumLqE7MIy3v3dQPq0jTvyRj5UP9OSMcb4meKyCm55I4XNe/bz0ph+9b7yB0sAAe2cc86hardZ+OWQ0g899BBPP/00ABMmTGDu3LkAPPfccxQXF9ddsMb4seKyCm6cuoSUtBz+efVJnN3VP+YusSYgH6uoqPBqnJ+aNGzYMIYNG/ar8okTJx56/dxzzzFmzBgaNmxYl6EZ43eKSiu48XWn8n92ZB+G96ndPv01yb4B1IC0tDQSExMZPXo03bt3Z8SIERQXF7N06VLOPvts+vXrxwUXXMCuXbsA58r87rvvJjk5meeff56xY8dy2223MXDgQDp16sS3337LTTfdRPfu3Rk7duyhz/nqq6849dRTOfnkk7nqqqsODQ0xceJE+vfvT69evRg3bhyeD/e99dZb9OnTh169evHTTz8B8PrrrzN+/PhfHcfYsWOZPn06//rXv9i5cyeDBg1i0KBBTJky5dAopgCvvPIK99xzT238VxrjF9btLOCdxduZ8Okahr3wA0u35/L8qL5+VflDoH0DmP0A7P7tAdOOWsskuHDSEVerOhz0iy++yCeffMKnn35K8+bNmTZtGn/5y1+YMmUKAGVlZYeaZ8aOHUtubi6LFi1i5syZDBs2jAULFvDqq6/Sv39/VqxYQZs2bXj00UeZO3cu0dHRPPHEEzzzzDNMmDCB8ePHM2HCBACuu+46Zs2axaWXXgpAcXExK1as4LvvvuOmm27y6nmFu+66i2eeeYb58+fTrFkzCgsLeeyxx3jqqacIDw9n6tSpvPzyy8f6P2qM31qSlsPzczfzQ2oWADGRYXRr2YiXhiZyfs+WPo7u6HmVAERkKPA8EAq8qqqTqiw/C3gO6A2MUtXp7vJBwLMeqya6l88QkddxJo/Pdy8bq6orjuNYfKrqcNCPP/44a9asYciQIYAz81erVq0OrX9wOOiDLr30UkSEpKQkWrRoQVJSEgA9e/YkLS2NjIwM1q1bd+gzysrKOPXUUwGYP38+Tz75JMXFxeTk5NCzZ89DCeCaa64B4KyzzqKgoOBX8wp4IyYmhsGDBzNr1iy6d+9OeXn5ofiMCQb79pdyz7QV/JCaRbOYCB68KJGLklqRENfgVyMB+5MjJgARCQVeBIYAGcASEZmpqp5zEe4AxgJ/8txWVecDfdz7aYoz/eNXHqvcezBZ1AgvrtRrS9VfgkaNGtGzZ89DI4RWVXU46MjISABCQkIOvT74vqKigtDQUIYMGcJ77733i+1KSkq4/fbbSUlJoW3btjz00EOUlJRUG9ex/rLecsstPP744yQmJtpIoyaobM8u4vopP7GnoIS/Xtyd0QPa0yAi1Ndh1Qhv7gGcAqSq6lZVLQPeB4Z7rqCqaaq6CnD9xn5GALNVNSC7llQdDnrgwIHs27fvUFl5eTlr16495v0PHDiQBQsWHBpeuqioiE2bNh2q7A821Uyf/st8Om3aNAB++OEHYmNjiY2N9erzqg41PWDAANLT03n33XcPfaswJtCtycznypcWkn+gnHd/N5BbzuwUMJU/eJcAEoB0j/cZ7rKjNQp4r0rZYyKySkSeFZHIw23kL6oOB33nnXcyffp07r//fk466ST69OnDwoULj3n/zZs35/XXX+eaa66hd+/enHrqqWzYsIG4uDh+97vf0atXLy644AL69+//i+2ioqLo27cvt956K6+99prXnzdu3DiGDh3KoEGDDpVdffXVnH766TRp0uSYj8MYf5GZd4BRk38kMiyU6beexsntAvD3/nATBXv+4Fy5v+rx/jrghWrWfR0YcZjyVsA+ILxKmQCRwBvAhGr2OQ5IAVLatWv3q8mO68NE5Nu2bdOePXv6Ooxad/HFF+vcuXOrXV4fzoUxNeXvn67Rzg9+rjuyi3wdynGjmknhvfkGkAm09Xjfxl12NK4GPlHVco/Es8sdWykwFaep6VdUdbKqJqtqcvPm/vFwRaDJy8uja9euNGjQgHPPPdfX4RhT63KKypi2JJ3hfRJo2zRwn4XxphfQEqCLiHTEqfhHAUc72/g1wJ89C0SklaruEueu5GWA78dTPkb1ZTjo2hIXF8emTZt8HYYxdeaNhWkcKK/k92d18nUoteqI3wBUtQIYD8wB1gMfqOpaEZkoIsMARKS/iGQAVwEvi8ihu50i0gHnG8T/quz6HRFZDawGmgGPHutBqB/Nahao7ByYQFFcVsEbi9I4r/sJdGnRyNfh1CqvngNQ1S+AL6qUTfB4vQSnaehw26ZxmJvGqjr4aAKtTlRUFNnZ2cTHx/t1f1x/pqpkZ2cTFVV/xjk35lhNW5JOXnE5t559oq9DqXV+/yRwmzZtyMjIYN++fb4OJahFRUXRps1hrwGM8RulFZW8+v02kts3IblDU1+HU+v8PgGEh4fTsWNHX4dhjPFz327cy8TP1pGZd4BHL+/l63DqhN8nAGOMOVoVlS4Wbslmd0EJ2YVl/LQtm/kb99GxWTRTb+zPoG4n+DrEOmEJwBgTVFSV+z9azUfLMg6VxTYI588XJnLj6R2JCAueQZItARhjgsrrC9P4aFkGt559IqMHtCM+JoKGEcFZFQbnURtjgtLC1Cwe/Xw95/dowX0XdCMkJLh7DgbPdx1jTFDLyC3mjneX0alZNM+M7BP0lT9YAjDGBIlHZq2jrMLF5OuTiYm0xg+wBGCMCQJLt+cwZ+0ebj37RDo2iz7yBkHCEoAxJqCpKpNmb6B5o0huPtOeGfJkCcAYE9Dmrt/LkrRc7j6vS9D29qmOJQBjTMCqqHTxxJcb6NQ8mpHJbY+8QZCxdGiMCThZhaUsSM1i9urdpO4t5L9j+hEWate7VVkCMMYEDFXl4c/W8frCNADiGoYz9rQOXNCzhW8Dq6csARhjAsbL323l9YVpjExuy+iB7ejZOpZQ6+9fLUsAxpiA8PmqXUyavYFLerfiH1ck2YNeXrBGMWOM31u2I5d7PlhBv/ZNePqqk6zy95JXCUBEhorIRhFJFZEHDrP8LBFZJiIVIjKiyrJKEVnh/pnpUd5RRBa79zlNRCKO/3CMMcGmtKKSe6atoEXjSCZf14+o8FBfh+Q3jpgARCQUeBG4EOgBXCMiPaqstgMYC7x7mF0cUNU+7p9hHuVPAM+qamcgF7j5GOI3xgS5qQvS2J5dzKOXJREfE+nrcPyKN98ATgFSVXWrqpYB7wPDPVdQ1TRVXQW4vPlQcSbvHQxMdxe9AVzmddTGGAPs21/KC/NSOTfxBM7u2tzX4fgdbxJAApDu8T6Dw0zy/huiRCRFRH4UkYOVfDyQp6oVR9qniIxzb59i8/4aYzw9PWcjpRWV/OXi7r4OxS/VRS+g9qqaKSKdgHkishrI93ZjVZ0MTAZITk7WWorRGONn1mTm88HSdG45oyOdmsf4Ohy/5E0CyAQ8n6Fu4y7ziqpmuv/dKiLfAn2Bj4A4EQlzfws4qn0aY4JDaUUli7ZkszOvhOKyCopKK9mRU8yG3QVs3ltI04YR3HluF1+H6be8SQBLgC4i0hGnkh4FXOvNzkWkCVCsqqUi0gw4HXhSVVVE5gMjcO4p3AB8eiwHYIwJLAfKKpm/cS+z1+xm/oa9FJZW/GJ580aRJLZsxNjTOjC8T2saR4X7KFL/d8QEoKoVIjIemAOEAlNUda2ITARSVHWmiPQHPgGaAJeKyMOq2hPoDrwsIi6c+w2TVHWde9f3A++LyKPAcuC1Gj86Y4xfUFXmb9zLjOU7mbt+D8VllTSNjuCS3q24oGdLurdqTMPIUBqGh9qYPjVIVP2nWT05OVlTUlJ8HYYxpgYt3prNP2ZvYEV6Hk0ahjO0Vysu7d2KUzo2tcq+hojIUlVNrlpuQ0EYY+qcy6X8kJrFGwvT+GbDXlo2juLJK3tz+ckJhFulX2csARhj6kxZhYv//m8L05akk5l3gLiG4dx7QTduOr0jDSLsCd66ZgnAGFMnVJX7pq9kxoqdnNmlGX++KJEhPVoQGWYVv69YAjDG1Imn5mxkxoqd/On8rowfbF036wNrbDPG1Lp3Fm/nP99u4ZpT2nHHoM6+Dse42TcAY0ytcbmUV3/YyqTZGxiceAKPDO+JMxSYqQ8sARhjasXOvAP83wcrWbQ1mwt6tuCZq/tYt856xhKAMeaYbdy9n5krM8naX0Z2USl5xeVUuBSXKtv2FVGpyhNXJnF1clu78q+HLAEYY45aeaWL/8zfwgvzN+NSiI+OoFlMJLENwmkQIYSGCJ2aRXP3eV3p0Cza1+GaalgCMMYclTWZ+dw7fRXrdxUwvE9r/n5pT5pG24R+/sgSgDHGK0WlFTzz9SamLthGfEwkL1/Xjwt6tvR1WOY4WAIwxvwmVWXO2t1M/GwdO/NLGD2gHfcNTSS2gY3C6e8sARhjqrU6I59HPl/HT9tySGzZiH9f25d+7Zv6OixTQywBGGMOKSmvZPmOPJZuz2Hxthy+35xFfHQEj13ei5HJba0bZ4CxBGCModKlfJiSztNfbSKrsBSAri1iGD+oM78/uxONbNKVgGQJwJggt3BLFo/MWs/6XQX0a9+Ef1yRRP8OTYhraD17Ap1X3+dEZKiIbBSRVBF54DDLzxKRZSJSISIjPMr7iMgiEVkrIqtEZKTHstdFZJuIrHD/9KmZQzLGeCN1735ueWMJ176ymIID5fz7mr5Mv/VUhvRoYZV/kDjiNwARCQVeBIYAGcASEZnpMbUjwA5gLPCnKpsXA9er6mYRaQ0sFZE5qprnXn6vqk4/3oMwxniv0qU8/sV6Xl+YRsPwUO4fmsiNp3cgKtyGZQ423jQBnQKkqupWABF5HxgOHEoAqprmXuby3FBVN3m83ikie4HmQB7GmDqnqvzt0zW8u3gH1w5ox/8N6Up8TKSvwzI+4k0TUAKQ7vE+w112VETkFCAC2OJR/Ji7aehZETnsb6GIjBORFBFJ2bdv39F+rDHGw5NzNvLu4h3cds6JPH55klX+Qa5O+nSJSCvgLeBGVT34LeHPQCLQH2gK3H+4bVV1sqomq2py8+bN6yJcYwLKgbJK1u8q4Kk5G3jp2y3Og1wXdPN1WKYe8KYJKBNo6/G+jbvMKyLSGPgc+Iuq/niwXFV3uV+WishUfn3/wBjjBVUlI/cAi7Zm8+OWbJan51FSXolLlYpKJbuo7NC6w05qzcThvWxkTgN4lwCWAF1EpCNOxT8KuNabnYtIBPAJ8GbVm70i0kpVd4nzm3gZsOaoIjcmiBWVVjB1wTaWbs9ldWY+WYVOJR8fHUFyhybENghHEEJChNaxUXRsHk3HZtH0aNXYKn9zyBETgKpWiMh4YA4QCkxR1bUiMhFIUdWZItIfp6JvAlwqIg+rak/gauAsIF5Exrp3OVZVVwDviEhzQIAVwK01fXDGBKq/zVjDx8sz6doihnO6ncBJbWI5pWM8XVvEWAUfaIqyYMPn0OtKiIyp0V179SCYqn4BfFGlbILH6yU4TUNVt3sbeLuafQ4+qkiNMQDMXr2Lj5dncte5XfjjkK6+DsfUtlXTYM6D0HYAnJBYo7u2gT2M8SN795fw4CerSUqI5c7BNrl6wFOFZW9Bm/41XvmDJQBj/Iaq8uDHqykqq+TZkScRbgOzBb7MZbBvPfQdUyu7t98gY/xATlEZf/pwFXPX7+X+oYl0PqGRr0MydWH5WxDWAHpeUSu7t8HgjKnHXC5lWko6T3y5gcKSCm4/50RuPK2Dr8MydaGsGNZ8BD0vg6jGtfIRlgCMqYdKyiuZsTyTyd9tZWtWEQM6NuXRy3rRpYVd+QeN9Z9BaUGtNf+AJQBj6p3/bdrHnz5cyb79pfRs3ZgXrz2Zi5JaWvfOYLP8LWjaCdqfXmsfYQnAmHqkoKScP324ksZRYTx7dR9O7xxvFX+wqCiD3aucq/7CfZD2PQz+G9Ti+bcEYEw98ox7Rq7Xbkimd5s4X4dj6tK8R2Dhv35+HxoJJ11Tqx9pCcCYemJNZj5vLkpjzID2VvkHm5J8SJkKXYfC6XdDREOIaQmNWtTqx1oCMKYecLmUv85YQ9PoCP50vo3UGXSWvQll++GcB6B13zr7WEsAxvhYYWkF/563mRXpeTxz9UnENrQJ2INKZTn8+BJ0OLNOK3+wBGCMz+QUlfH6gm28sWg7+QfKuaR3Ky7ve9RzLRl/t/YTKMiEi5+p84+2BGBMHcsrLuOV77fy+oI0isoqOb9HC24f1Jk+ba3dP+iowsJ/Q7Ou0OX8Ov94SwDG1LK9+0vYsGs/W/YVsmlPIbNW7mR/aQWX9G7FXed2oas93BW8tn3ndP289HkIqfuReSwBGFODyipcbMsqYsPuApak5bBoSzZb9hUdWt44KoyzujbnznM7k9iydh7vN34iPwM+vcPp7dN7lE9CsARgTA1wuZTb3lnKvA17Ka9UAKIjQunfsSlXJ7eld5s4Op8QQ7OYCHuwyzgPer053On+ecNnEB7lkzC8SgAiMhR4HmdGsFdVdVKV5WcBzwG9gVGe0z+KyA3AX91vH1XVN9zl/YDXgQY4k838QVX1uI7GGB9Znp7LnLV7uLxvAmd3bU63lo3ofEKMDdlsfu1ALrx1ORTshOs+gdZ9fBbKEROAiIQCLwJDgAxgiYjMVNV1HqvtAMZSZWJ3EWkK/B1IBhRY6t42F3gJ+B2wGCcBDAVmH+8BGeMLs1fvJiI0hIeH96RxlHXjNNUo3AfvXAlZG+HaadBuoE/D8eby5BQgVVW3qmoZ8D4w3HMFVU1T1VWAq8q2FwBfq2qOu9L/GhgqIq2Axqr6o/uq/02cieGN8Tuqyuw1uzmzSzOr/E318nbA1KGwbxOMfAdO9P2suN4kgAQg3eN9hrvMG9Vtm+B+fcR9isg4EUkRkZR9+/Z5+bHG1J1VGflk5h3gwqRWvg7F1EeqkL4EXrsAivbB9TOga913+Tycen8TWFUnA5MBkpOT7R6BqXe+WLOLsBBhSPfaHbfF+JmsVFg6FTbMgtw0iGkBN86GFj19Hdkh3iSATKCtx/s27jJvZALnVNn2W3d5m2PcpzH1hqry5ZrdnNa5mQ3hYH5WfgDeuASKsqDT2c4Abz2GQ8Omvo7sF7xJAEuALiLSEaeSHgVc6+X+5wCPi0gT9/vzgT+rao6IFIjIQJybwNcD/z660I3xvXW7CtieXcxtZ5/o61BMfbLkNdi/C26YBR3P9HU01TriPQBVrQDG41Tm64EPVHWtiEwUkWEAItJfRDKAq4CXRWSte9sc4BGcJLIEmOguA7gdeBVIBbZgPYCMH5q9ejchAkN6WPOPcSsthB+ehU7n1OvKH7y8B6CqX+B01fQsm+Dxegm/bNLxXG8KMOUw5SlAr6MJ1pj6pKS8ki9W72Jgp3jiYyJ9HY6pL356GYqzYNBfj7yuj9lTKsYcJZdL+XRFJuf+839szSriquTDXvuYYFSSDwv+BV0ugLb9fR3NEdX7XkDG1CeZeQe4/Z1lrEzPo2frxjw1ojendW7m67BMfbHoP1CSB4Me9HUkXrEEYIyXUvfu57rXfqKwpIJ/XnUSl/dNICTExvUxbgU7YdEL0P1Snw7vcDQsARjjhRXpedw49SdCQ0KY9vtT6dHaRvI0VXz1N2d2ryETfR2J1+wegDFHsH5XAde+8iMxUWF8dJtV/uYwtn0Pa6bD6X+App18HY3X7BuAMb+hpLySP7y/nOjIMKbfehotGvtm2F5Tj1WWw+z7ILYdnHGPr6M5KpYAjPkNT365kU17Cnn9xv5W+ZvDW/wy7F0HI9+GiIa+juaoWAIwphrfb97HlAXbuOHU9pzT7QRfh2Pqk/QlsG4GbJoD2ZvhxHMh8RJfR3XULAEYg9O3f+3OAlZm5LG/pIKi0go+SEmn8wkx/Pmi7r4Oz9QXrkqY/zh8/zSERkCHM6D/LdDnGvDDmd4sAZigtnR7DlMWpLEwNYvc4vJD5SLQqnEUz4/qQ1R4qA8jNPXGgTz4+Hew+Svoex0M/QdENvJ1VMfFEoAJSnsLSvjH7A18sjyT+OgIBiWewJldmnFKx3iaNowgKjzE5u41PyvOgdeGQO52uORZ6HejX17xV2UJwAQVl0t5c1EaT83ZSHmlcsegE7ljUGcaRtifgqmGKnz2B6fyv36G0+wTIOy33gSNrfsKuW/6KlK253J21+Y8PKwnHZpF+zosU9+teBfWz4TzHg6oyh8sAZgAtnhrNl+t20NecTl5xWX8kJpFZFgI/7zqJK44OcGaeMyR5Wxz+vi3PwNOu9PX0dQ4SwAm4Kgq//3fVp6as4GIsBDioyOJaxjOJb1bc//Qbpxg/fmNN1yV8MnvQULh8v9CSOB1BrAEYAJKUWkF901fxeerd3Fx71Y8NaK3te+bY7Ptf5C+GIa/CHFtj7y+H/LqL0NEhgLPA6HAq6o6qcrySOBNoB+QDYxU1TQRGQ3c67Fqb+BkVV0hIt8CrYAD7mXnqxC0S7AAABrFSURBVOre4zkYE3xcLuWntBx+2JzF0u25rEjPo7Sikj9fmMi4szpZM485dus/g/Bo6HWlryOpNUdMACISCrwIDAEygCUiMlNV13msdjOQq6qdRWQU8AROEngHeMe9nyRghqqu8NhutHtmMGO8VulSNu3Zz+erdvHJ8kwy8w4QGiL0aNWYkf3bcknvViR3qF+Tbxs/43LBhi+g87kQ3sDX0dQab74BnAKkqupWABF5HxgOeCaA4cBD7tfTgRdERFRVPda5Bnj/uCM2QcnlUqYuTOOb9XtYlZFPYWkFIQJndmnOfUO7cV73FkRHWlOPqSGZKVC4G7oP83Uktcqbv5gEIN3jfQYwoLp1VLVCRPKBeCDLY52ROInC01QRqQQ+Ah6tkjAAEJFxwDiAdu3aeRGuCTSVLuXBj1czLSWdHq0ac8XJCfRpG8fpnZvZAG2mdqyfCSHh0PV8X0dSq+rkkklEBgDFqrrGo3i0qmaKSCOcBHAdzn2EX1DVycBkgOTk5F8lCBPYyitd/OnDlXy6Yid3nduFe87rYu36pnapwvpZ0PEsiIr1dTS1ypsEkAl43gJv4y473DoZIhIGxOLcDD5oFPCe5waqmun+d7+IvIvT1PSrBGCCT2FpBRt3F7B+136+XLObH1KzuG9oN24/p7OvQzPBYO86yN0Gp9/l60hqnTcJYAnQRUQ64lT0o4Brq6wzE7gBWASMAOYdbM4RkRDgauDMgyu7k0ScqmaJSDhwCTD3OI/F+DmXS3l9YRpPztlASbkLgEZRYTw8rCc3nNbBt8GZ4LH+M0Cg28W+jqTWHTEBuNv0xwNzcLqBTlHVtSIyEUhR1ZnAa8BbIpIK5OAkiYPOAtIP3kR2iwTmuCv/UJzK/5UaOSLjlzLzDnDvhytZuCWbQd2aM3pAexJbNSIhroE1+Zi6tX4WtB0AjVr4OpJa59U9AFX9AviiStkEj9clwFXVbPstMLBKWRHOMwMmSO0vKeeL1btYu7OADbv2szoznxCBSVckMbJ/W6v0jW9sXwh7VsP5j/o6kjph/eZMndpfUs6bi7bzyvdbySsuJyYyjMSWjbgquQ23nNGJdvH+NaWeCSDL3oLP/whx7aH3SF9HUycsAZhaV1bhYuGWLOas3cMXq3eRf6CcwYkncOfgzvRpG2dX+8Y3XC4o2gv5mbDyXVjyKnQ6B0ZMhYbB8SChJQBTK1SV5el5fLAknc9X72J/SQUNI0IZnHgC487qRO82cb4O0QSzjbNh+k1QXvxz2anjnSGfQ4OnWgyeIzW1KqeojLnr9pCZd4Bd+QdYtiOP1L2FNAgP5cKkllyc1IrTOzez6RWN75Xkw2d3Q5MOkHwTxLaBpidC866+jqzOWQIwNeLRz9fx8bJMRKB5TCSdmkdzyxlJXHJSa2JsiAZTn8x7DAr3wDXvQcLJvo7Gp+wv0xy34rIKvlyzmytOTmDSFb2JCAvxdUjGHN7O5bDkFeh/S9BX/gD2l2qO29fr9lBcVslV/dpa5W/qL1clzLoHopvDuX/zdTT1gn0DMMdtxvJMWsVGMaBjcPScMH5qxTvON4ArXwv4MX68ZZdr5rhkF5by3eYshvdJICTEunOaesrlggX/glZ9AnqCl6NlCcAcl1mrdlHpUi7r29rXoRhTvdSvIXuz09XTnjs5xBKAOS4zVmSS2LIRiS0b+zoUY6q36AVo1Bp6XubrSOoVSwDmmKVlFbF8Rx6X903wdSjGVG/3atj2HQz4PYSG+zqaesUSgDkmLpfyyvdbEYFhfaz5x9Rji/4D4Q2h3w2+jqTesV5A5qjlFpXxxw9WMH/jPq4d0I5WsYE7abbxc/t3w+oPIflGaNDE19HUO5YAzFFZkpbDH95bTlZhGY9c1osxA2yeZlPPuFyQsQQ2zIJ1n4KrAgbc6uuo6iVLAMYr+QfKefLLDbyzeAdtmzbgo9tOI6mN9aU29YwqfHQzrP3YmdS941nO2P7xJ/o6snrJqwQgIkOB53Fm73pVVSdVWR6JM59vP5y5gEeqapqIdADWAxvdq/6oqre6t+kHvA40wJls5g8Hp5E0vlFYWkHBgXLKK12UVyq5xWXszi8hPbeYqQvSyC4s5eYzOvLHIV2JtvF9TH206EWn8j/zT86cvvbA12864l+xiIQCLwJDgAxgiYjMVNV1HqvdDOSqamcRGQU8ARycUWGLqvY5zK5fAn4HLMZJAEOB2cd8JOaoqCqrM/P5cs1u1uwsYPOe/ezKL6l2/d5tYplyQ3+76jf11/aF8PUE6H4pDP6r9ff3gjeXcacAqQfn9BWR94HhgGcCGA485H49HXhBfmOWDxFpBTRW1R/d798ELsMSQK1TVV6Yl8q0lHQycg8QFiJ0bdGIgZ3i6XxCDM1iIggLCSEsVGjSMIKWsVG0jI2iUWSYTdxi6q/9e+DDsc4Qz8P/Y5W/l7xJAAlAusf7DGBAdeu4J5HPB+LdyzqKyHKgAPirqn7vXj+jyj4P25lcRMYB4wDatbMbjsfr63V7+OfXmzjtxHjuOrcL5/doQVzDCF+HZczxmXknlO6H62ZAlD2U6K3absjdBbRT1Wx3m/8MEel5NDtQ1cnAZIDk5GS7R3AcVJXnv9lM+/iGvHnTKYSF2mMgJgBsmQeb58CQR6BFD19H41e8qQEygbYe79u4yw67joiEAbFAtqqWqmo2gKouBbYAXd3rtznCPk0Nm7dhL2t3FnDHoM5W+ZvA4KqEr/4Gce2cJ33NUfGmFlgCdBGRjiISAYwCZlZZZyZw8DG7EcA8VVURae6+iYyIdAK6AFtVdRdQICID3fcKrgc+rYHjMdVQVf71zWbaNm1gQzeYwLHyfdizBs57CMIifR2N3zliE5C7TX88MAenG+gUVV0rIhOBFFWdCbwGvCUiqUAOTpIAOAuYKCLlgAu4VVVz3Mtu5+duoLOxG8C16ttN+1iZkc+kK5IIt6t/EwjKimHeo5CQDD2v8HU0fsmrewCq+gVOV03Psgker0uAqw6z3UfAR9XsMwXodTTBmmNT6VKen7uZhLgGXHFymyNvYEx95XJB3nbYuw7WzoD9O2HEFOv1c4zsaZ4ApqrMWbubp7/aROreQiZdkWRTNhr/oOpU8hs+h42zIT8DyoqgvOiX6/W7Edqf6psYA4AlgAC1ZV8hf/xgJSvT8+jUPJr/jD6ZC3u19HVYxlRPFTKXwboZsH4m5KYBAm1PgcSLISLaGdUzNgFa9ILmiRAZ4+uo/ZolgAA0b8Me/vDeCsLDQnjyyt5ccXKC9fox9VdluTNf7/fPOM07IeHQ6Ww44x7odhHEnODrCAOWJYAAoqq8OD+Vf369iZ6tG/PydckkxNlQzaaeKit2xu357innaj8hGQY9CF2HQoM4X0cXFCwBBAiXS/nLjNW891M6l/dN4B9XJBEVHurrsIz5JVXnwa1V02D9LKdNv9VJcO0H0OV8u5lbxywBBIBKl3Lf9FV8tCyDOwadyJ/O72bj9pj6RxW+mQg/POOM0pk0ApKugg5nWMXvI5YA/FxFpYt7PljJZyt38schXbnr3C6+DsmYX1OFbx6GH56Fk2+Ai56yB7fqAUsAfu7l77by2cqd3D80kdvOsUkvTD3kWfn3uxEufgZCrFNCfWAJwI/t21/Kf+ancn6PFlb5m/ppzzqYfR+kfQ/JN8FF/7TKvx6xBODHnpu7idIKFw9cmOjrUEywclVC9hY4kAMHcp0hmV0VoC7YuQJSpjjDM1/8T+h3k1X+9YwlAD+1ec9+3l+SzpgB7ejU3B6GMXVM1Zl0fd6jsG/D4deREKfJZ/BfoWHTuo3PeMUSgJ+aNHsDDcND7aavqVuqsOUbmP84ZC6F+C5w6fMQ2xYaNIHIxhAS6lT+kY2s4q/nLAH4oe837+ObDXt54MJE4mOsJ4WpAy4XbPwCvn8adi6Hxm1g2Atw0jUQatWIv7Iz52eyC0v504cr6dQsmrGndfB1OCbQleTDivdgyauQvdmZc/fSf8FJo6wbZwCwBOBHXC7l/z5cSW5xOVPG9rcnfU3NK9gJ6T857fp71kLqN87TugnJcMWr0PNyu+IPIHYm/cgr32/l2437eOSyXvRsHevrcEygcFVC6lynx87mr5wePAg07Qi9LofkmyHhZF9HaWqBVwlARIYCz+PMCPaqqk6qsjwSeBPoB2QDI1U1TUSGAJOACKAMuFdV57m3+RZoBRxw7+Z8Vd173EcUYLIKS1m/q4BVGfk8+/UmLkpqyZgB7XwdlgkEOdtgxbvOT0EGRJ/gjMDZ/VJo1g0iGvo6QlPLjpgA3HP6vggMATKAJSIyU1XXeax2M5Crqp1FZBTwBDASyAIuVdWdItILZ1pJzwlpR7tnBjNV7NtfygMfreKbDT/nxN5tYvnHFb1tnB9zfPLSYdY9kPo1IHDiYLjgUeh2MYRF+Do6U4e8+QZwCpCqqlsBROR9YDjgmQCGAw+5X08HXhARUdXlHuusBRqISKSqlh535AFs3oY93PvhKgpLK7j7vC6c0qEp3Vs1pkm0/XGa47TqQ/j8/0Ar4ZwHoc+1ENfW11EZH/EmASQA6R7vM4AB1a3jnkQ+H4jH+QZw0JXAsiqV/1QRqcSZN/hRVdWqHy4i44BxAO3aBWbTx4GySpZuz2XZjlyWpOXw/eYsEls24r1xA+naopGvwzP+orwEslMhdxtUuP/M1AXF2VC4x7mpu/kraDsALn/ZaeM3Qa1ObgKLSE+cZqHzPYpHq2qmiDTCSQDX4dxH+AVVnQxMBkhOTv5VgvB38zbs4cGP17C7oAQR6HJCDOMHdWb84M7Wy8dU70AeLHvDGYYhb7szoUrudqCaP5GQMIhpCYP+6rTzW08eg3cJIBPw/I7Yxl12uHUyRCQMiMW5GYyItAE+Aa5X1S0HN1DVTPe/+0XkXZympl8lgECVV1zGxFnr+HhZJt1aNOLxK3qR3KEpjaPCfR2aqe9ytsG7V0PWJohuDnHtofXJ0HsUNOsC8Z0hvAEgzhO5DZtCVJyNw2N+xZsEsAToIiIdcSr6UcC1VdaZCdwALAJGAPNUVUUkDvgceEBVFxxc2Z0k4lQ1S0TCgUuAucd9NPVURaWLnXklpGUXsXR7Lou2ZLM8PReXwl2DO3PH4M5EhtnVvvHCjsXw/jVO087Yz53JVIw5RkdMAO42/fE4PXhCgSmqulZEJgIpqjoTeA14S0RSgRycJAEwHugMTBCRCe6y84EiYI678g/FqfxfqcHjqhdKKyq55Y0UFm3JpsLlfDUPEUhKiOXmMzoxvE9rurdq7OMoTb3nqoTtC2DtJ7D8HYhtA6M/hHgbAtwcHznMfdd6Kzk5WVNS/KfX6IvzU3lqzkbGntaB7q0a0a5pND1aNya2gTXzmN+gCjlbIe0Hp+LfMg+K9kF4Q6eP/tBJNsiaOSoislRVk6uW252gWpKeU8y/523mwl4teWhYT1+HY/xF6X745FZnqGVw2vg7nAk9hjuTptvDWaYGWQKoJY/MWocg/O2SHr4OxfiLnG3w3jXOzd1zHnTG3WnWxSZMN7XGEkAtmL9hL1+t28P9QxNpHdfA1+GY+qyy3Omfn74Yvv2H0/wz5iM4cZCvIzNBwBJADap0KV+t3c0js9ZxYvNobj7DHrQxbqpQWuBMm7h3g1Phpy+GzGVQ4R4Oq0USXP2G3dw1dcYSwHEor3SxK6+EHTnFrNuVz9s/7mBHTjHtmjbk6atOIiLM+l0HlW3fw+7Vzvy4xTnO07f5Gc4Qy8XZzvALB4WEQauToN9YaNsf2vR3ZtWy5h5ThywBHIO9+0t4+X9beWfxdkrKXYfK+7aL48GLEhnSoyWhIfaHHFRWT4ePbnZeS4jz4FWjltC4NbTqDTEtnLIGTaCJ+8Etu6FrfMwSwFHYU1DCK99t5e3F2ymrcDG8TwKndoqnbdOGtI9vaO39wWrHYphxO7Q7DUa+BQ2a2lO3xi9YAvBC6t5CJn+3hU+WZ1LpUi7rm8Cdg7vQsVm0r0Mzvpaz1XkyN7YNjHrH+ucbv2IJ4DBWpufx+Bfr2V1Qwr79pRSXVRIZFsKo/u343ZmdaBdvX92DlqsSdq10fnavhk1znGEZRn9olb/xO5YAqigoKef2d5ZRVuni1E7xNIuJJKFJAy7r05r4GJsEOyiVFcPGL5zKPnWuc5MXILIxtEyC8x6ynjvGL1kCqOKhT9eyu6CED289lZPbNfF1OKYuqUJlmdM3XyuhYJcz5PKKd6AkHxrGO0/jdhkCbZKdUTit147xY5YAPHy2cicfL8/k7vO6WOUfqIpznCdtD/2kOuPpF+c4ffQrq0xWFxLujL+TfCO0Px1CbNRWEziCPgEcKKskI7eYbVlF/OWT1fRpG8f4QZ19HZbxliqUFztX6KWFUFboVOi71zhP2O7fBa4K56c42xlU7aDQSKfppklHSOjntOFHNobQcKeffnhDSLwYYk7w3fEZU4uCNgGk7t3PP77Y8ItJ1xtHhfHcyD6EhVoXPp9yuaCixPkpK3Ku1Hevcir14mynrKwISvKc9xUlv96HhDrj6MS1c67iQ0IhKhaadYXmiR7L7IreBK+gSwC5RWU8N3cTby/eQcPwUG4750QSWzaiTZOGdGkRYzNy1aSKMmf4g9KCn6/OS/dDURYUZzmVd7m7oi8/AAWZkJfu/Ov51OxBsW2dh6siop1RMhvEOVftDeOdh6wiYiAyxlmneXcIj6r7YzbGjwRVAvhi9S7+NmMNeQfKufaUdtx9Xhfr2XO8yg/Api9h1Qewc7lzE9VV4UxKfrgrc08h4c7TsGFRzk/jBGh/qtOnPrKxM61hWCQ07eT0tmlg92WMqUleJQARGQo8jzN716uqOqnK8kic+Xz74cwFPFJV09zL/gzcDFQCd6nqHG/2WZOyCkv5+6dr+Xz1LpISYnn7lgHBOxNX+QFnAvHSQueGZ0Wpu4280vlXXYA6beuo0xyjlc52pQVQ4h7QrDjb+dm10ilv1Ao6DXIq7dBw5ycyFqIaQ2Sjn6/OIxs7V+zRzZwy60VjjM8cMQGISCjwIjAEyACWiMhMVV3nsdrNQK6qdhaRUcATwEgR6YEzPWRPoDUwV0S6urc50j5rzO/fWsrqjHzuvaAbvz+rk3+08as6lbJWelTGFe4mkwNO3/SSPDiQ59wALSv8uW28vMhZXl7sVNwVpc7y3O2Qn+7s61gdHOcmuplTkfcYBklXOZOWWHu6MX7Fm28ApwCpqroVQETeB4YDnpX1cOAh9+vpwAsiIu7y91W1FNjmnjP4FPd6R9pnjZnc5B1iyhYTuTYE1v7WmgevfH+r3GP5L9ZVjzL3lfPB3ifqqrIfda9+sJJ3/fLKW12HbwP3VnhD5yeiIYS5m1HCG0C7ARA/xmlSaRAHoRHOsoM3SUNCnZun4FyZS8jPP2FRzk3UiGi7ajcmQHiTABKAdI/3GcCA6tZxTyKfD8S7y3+ssm2C+/WR9gmAiIwDxgG0a9fOi3B/LT6hE4QUereyCHCYCs6z/BcVoFRZx10WEvbrStVzP1Ur2KrlIe6uiCI/LwsJc7eLRzmVe1Sc+yfWaV6JiIbwaBuIzBjjlXp/E1hVJwOTwZkU/ph2cub/1WRIxhgTELy5VMwE2nq8b+MuO+w6IhIGxOLcDK5uW2/2aYwxphZ5kwCWAF1EpKOIRODc1J1ZZZ2ZwA3u1yOAeaqq7vJRIhIpIh2BLsBPXu7TGGNMLTpiE5C7TX88MAeny+YUVV0rIhOBFFWdCbwGvOW+yZuDU6HjXu8DnJu7FcAdqs7dzcPts+YPzxhjTHVED9vrpX5KTk7WlJQUX4dhjDF+RUSWqmpy1XLrLmKMMUHKEoAxxgQpSwDGGBOkLAEYY0yQ8qubwCKyD9h+jJs3A7JqMBx/EYzHHYzHDMF53HbM3mmvqs2rFvpVAjgeIpJyuLvggS4YjzsYjxmC87jtmI+PNQEZY0yQsgRgjDFBKpgSwGRfB+AjwXjcwXjMEJzHbcd8HILmHoAxxphfCqZvAMYYYzxYAjDGmCAVFAlARIaKyEYRSRWRB3wdT20QkbYiMl9E1onIWhH5g7u8qYh8LSKb3f828XWsNU1EQkVkuYjMcr/vKCKL3ed7mnvI8YAiInEiMl1ENojIehE5NdDPtYjc4/7dXiMi74lIVCCeaxGZIiJ7RWSNR9lhz604/uU+/lUicvLRfFbAJwCPSe0vBHoA17gnqw80FcD/qWoPYCBwh/s4HwC+UdUuwDfu94HmD8B6j/dPAM+qamcgF7jZJ1HVrueBL1U1ETgJ5/gD9lyLSAJwF5Csqr1whpEfRWCe69eBoVXKqju3F+LMs9IFZ+rcl47mgwI+AeAxqb2qlgEHJ6APKKq6S1WXuV/vx6kQEnCO9Q33am8Al/kmwtohIm2Ai4FX3e8FGAxMd68SiMccC5yFMw8HqlqmqnkE+LnGmb+kgXvWwYbALgLwXKvqdzjzqniq7twOB95Ux49AnIi08vazgiEBHG5S+4Rq1g0IItIB6AssBlqo6i73ot1ACx+FVVueA+4DXO738UCeqla43wfi+e4I7AOmupu+XhWRaAL4XKtqJvA0sAOn4s8HlhL45/qg6s7tcdVvwZAAgoqIxAAfAXeraoHnMvc0nQHT71dELgH2qupSX8dSx8KAk4GXVLUvUESV5p4APNdNcK52OwKtgWh+3UwSFGry3AZDAgiaCehFJByn8n9HVT92F+85+JXQ/e9eX8VXC04HholIGk7T3mCctvE4dzMBBOb5zgAyVHWx+/10nIQQyOf6PGCbqu5T1XLgY5zzH+jn+qDqzu1x1W/BkACCYgJ6d9v3a8B6VX3GY9FM4Ab36xuAT+s6ttqiqn9W1Taq2gHnvM5T1dHAfGCEe7WAOmYAVd0NpItIN3fRuTjzbgfsucZp+hkoIg3dv+sHjzmgz7WH6s7tTOB6d2+ggUC+R1PRkalqwP8AFwGbgC3AX3wdTy0d4xk4XwtXASvcPxfhtIl/A2wG5gJNfR1rLR3/OcAs9+tOwE9AKvAhEOnr+GrhePsAKe7zPQNoEujnGngY2ACsAd4CIgPxXAPv4dznKMf5tndzdecWEJxejluA1Ti9pLz+LBsKwhhjglQwNAEZY4w5DEsAxhgTpCwBGGNMkLIEYIwxQcoSgDHGBClLAMYYE6QsARhjTJD6f2DPSdUV0CkPAAAAAElFTkSuQmCC\n", "text/plain": ["<Figure size 432x288 with 1 Axes>"]}, "metadata": {"needs_background": "light"}, "output_type": "display_data"}], "source": ["df_new.plot();"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["Of course, this is not that useful a plot.  What we are likely looking for is a relationship between the DataFrame columns.  One way to visualize this is to set the desired abscissa as the DataFrame index and create a plot. "]}, {"cell_type": "code", "execution_count": 35, "metadata": {"slideshow": {"slide_type": "subslide"}}, "outputs": [{"data": {"image/png": "iVBORw0KGgoAAAANSUhEUgAAAX0AAAEGCAYAAACJnEVTAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy8li6FKAAAgAElEQVR4nO3deXxU9dn//9eVnSWELbLv+6agYVFb11KxreJ9F6uoFURLq1Vv296t9rY3tf6sv1qttt7S27rgjmCtVlzqVnGptwphU4ISIyCEnYQ1Ifv1/WMOdEyDGZJJZpJ5Px+PPObMOZ9z5pozw3sOZ/kcc3dERCQxJMW6ABERaT4KfRGRBKLQFxFJIAp9EZEEotAXEUkgKbEuoLauXbt6//79Y12GiEiLsmzZsl3unl1fu7gL/f79+5ObmxvrMkREWhQz+zySdtq9IyKSQBT6IiIJRKEvIpJA4m6ffl0qKyspLCykrKws1qUktIyMDHr37k1qamqsSxGRBooo9M1sCvAHIBl4wN1/U2v6KcDvgWOBC9396WD8WOB/gQ5ANfBrd194tEUWFhaSmZlJ//79MbOjnV2iwN0pKiqisLCQAQMGxLocEWmgenfvmFkyMBc4GxgJTDezkbWabQRmAvNrjS8FLnX3UcAU4Pdm1vFoiywrK6NLly4K/BgyM7p06aL/bYm0cJFs6U8ACtx9HYCZLQCmAmsONXD3DcG0mvAZ3T0/bHiLme0AsoE9R1uoAj/29BmItHyRHMjtBWwKe14YjDsqZjYBSAM+q2PabDPLNbPcnTt3Hu2iRURavGdXFPL0skKaurv7Zjl7x8x6AI8Bl7l7Te3p7n6fu+e4e052dr0XlEmY0047rc6L2RYtWsRvfhM69HLTTTdxxx13ADBnzhxef/11AH7/+99TWlrafMWKSJ0qqmq47W9reXZFYZP/jzqS0N8M9Al73jsYFxEz6wC8CNzo7u8fXXmtQ1VVVbO/5rnnnssNN9zwL+Nvvvlmvva1rwEKfZF48fyqLWzbV8b3vjqwyV8rktBfCgwxswFmlgZcCCyKZOFB+2eBRw+d0dNSbdiwgeHDh3PxxRczYsQIpk2bRmlpKcuWLePUU0/lhBNO4KyzzmLr1q1AaAv8uuuuIycnhz/84Q/MnDmTK6+8kkmTJjFw4EDefPNNZs2axYgRI5g5c+bh13n11Vc58cQTOf744zn//PM5cOAAEArr8ePHM3r0aGbPnv2F/wI+9thjjB07ltGjR7NkyRIAHn74Ya6++up/eR8zZ87k6aef5u6772bLli2cfvrpnH766cybN4/rrrvucLv777+fH/3oR02xKkUkjLtz/zvrGN49k1OHNv2ejnoP5Lp7lZldDbxC6JTNee6eZ2Y3A7nuvsjMxhMK907AOWb2q+CMne8ApwBdzGxmsMiZ7r6yoQX/6vk81mzZ19DZ6zSyZwd+ec6oetutXbuWBx98kJNPPplZs2Yxd+5cnn32WZ577jmys7NZuHAhN954I/PmzQOgoqLi8K6XmTNnsnv3bt577z0WLVrEueeey7vvvssDDzzA+PHjWblyJb179+aWW27h9ddfp127dtx2223ceeedzJkzh6uvvpo5c+YA8N3vfpcXXniBc845B4DS0lJWrlzJ22+/zaxZs1i9enW97+Xaa6/lzjvvZPHixXTt2pUDBw7w61//mttvv53U1FQeeugh/vSnPzV0lYpIhN7K38kn2/bzu/OPa5aTJSI6T9/dXwJeqjVuTtjwUkK7fWrP9zjweCNrjBt9+vTh5JNPBuCSSy7h1ltvZfXq1UyePBmA6upqevTocbj9BRdc8IX5zznnHMyMMWPG0K1bN8aMGQPAqFGj2LBhA4WFhaxZs+bwa1RUVHDiiScCsHjxYn77299SWlpKcXExo0aNOhz606dPB+CUU05h37597Nlz1CdH0b59e8444wxeeOEFRowYQWVl5eH6RKTp3P/OOrp3yOCc43o2y+u1iCtyw0WyRd5Uav8KZ2ZmMmrUKN57770627dr1+4Lz9PT0wFISko6PHzoeVVVFcnJyUyePJknn3zyC/OVlZVx1VVXkZubS58+fbjpppu+cL587boaurVwxRVXcOuttzJ8+HAuu+yyBi1DRCK3evNe3i0o4udnDyctpXl6xVHfO0dh48aNhwN+/vz5TJo0iZ07dx4eV1lZSV5eXoOXP2nSJN59910KCgoAKCkpIT8//3DAH9oN8/TTXzw8snBh6CLnf/zjH2RlZZGVlRXR62VmZrJ///7DzydOnMimTZuYP3/+4f89iEjTue/tdbRPT2H6xL7N9potbks/loYNG8bcuXOZNWsWI0eO5JprruGss87i2muvZe/evVRVVXHdddcxalTD/jeSnZ3Nww8/zPTp0ykvLwfglltuYejQoXzve99j9OjRdO/enfHjx39hvoyMDMaNG0dlZeXh4wmRmD17NlOmTKFnz54sXrwYgO985zusXLmSTp06Neg9iEhkCneX8uJHW5l1cn86ZDRff1bW1BcCHK2cnByvfd75xx9/zIgRI2JUUciGDRv41re+FdFB0pbsW9/6Fj/60Y8488wz65weD5+FSGtw8/NrePS9Dbz9s9Pp2bFNo5dnZsvcPae+dtq9IwDs2bOHoUOH0qZNmyMGvohEx97SShYs3ci5x/WMSuAfDe3eiVD//v1b9VZ+x44dyc/Pr7+hiDTaE0s+p7Simiua4WKs2lrMln687YZKRPoMRBqvvKqah97dwFeHdGVkzw7N/votIvQzMjIoKipS6MTQof70MzIyYl2KSIv23Iot7NxfzvdPGRST128Ru3d69+5NYWEh6oEztg7dOUtEGqamxrnvnXWM6NGBkwd3iUkNLSL0U1NTdbcmEWnxXsnbRsGOA9w9fVzM7k/RInbviIi0dO7OPYsLGNC1Hd8c06P+GZqIQl9EpBm8mb+TvC37uPLUQSQnxe4udAp9EZEm5u7MfaOAnlkZnDfuqG88GFUKfRGRJvbB+mJyP9/N908d1Gwdqx2JQl9EpInNXVxA1/ZpXDC+T/2Nm5hCX0SkCa3atId3Pt3F5V8ZSEZqcqzLUeiLiDSluYsL6JCRwiWTmq/75C+j0BcRaSJrt+3n1TXbmXnyADKbsfvkL6PQFxFpIn98s4C2aclcdlL/WJdymEJfRKQJfF5UwvOrtnDxxL50apcW63IOU+iLiDSBe94oIDU5ie/FoPvkL6PQFxGJso1FpTyzYjMXTezLMR3iq2dahb6ISJTds/hTkpOMH5wam+6Tv4xCX0QkijYWlfLM8s1cNKEv3eJsKx8iDH0zm2Jma82swMxuqGP6KWa23MyqzGxarWkzzOzT4G9GtAoXEYlHcxcXkJRkXHla/G3lQwShb2bJwFzgbGAkMN3MRtZqthGYCcyvNW9n4JfARGAC8Esz69T4skVE4s/GolL+sryQ6eP7xOVWPkS2pT8BKHD3de5eASwApoY3cPcN7v4hUFNr3rOA19y92N13A68BU6JQt4hI3Ln7jdC+/KtOHxzrUo4oktDvBWwKe14YjItERPOa2WwzyzWzXN0SUURaovW7SnhmeSGXTOoXt1v5ECcHct39PnfPcfec7OzsWJcjInLU/vB6PmkpSXF5xk64SEJ/MxDeH2jvYFwkGjOviEiLULBjP8+t2sKME/uTnZke63K+VCShvxQYYmYDzCwNuBBYFOHyXwG+bmadggO4Xw/GiYi0Gne99iltU5OZfUp8XX1bl3pD392rgKsJhfXHwFPunmdmN5vZuQBmNt7MCoHzgT+ZWV4wbzHw/xH64VgK3ByMExFpFfK27OXFj7Yy6ysD6NI+vrfyAVIiaeTuLwEv1Ro3J2x4KaFdN3XNOw+Y14gaRUTi1u2vrCWrTSpXxFkfO0cSFwdyRURaovfXFfHm2p1cddogstrER3/59VHoi4g0gLvz25c/oVuHdGbEUX/59VHoi4g0wOsf72D5xj1c97WhcXHv20gp9EVEjlJ1jXP7K58wsGs7zj+hzsOZcUuhLyJylP66YjP52w/wk68PIyW5ZcVoy6pWRCTGyququev1fMb0yuLs0d1jXc5RU+iLiByFJz/YSOHug/xsyjCSkizW5Rw1hb6ISIQOlFfxP28UcNKgLnxlcNdYl9MgCn0RkQg98M46ikoq+OlZwzBreVv5oNAXEYnI9n1l/OmtdXxzTA/G9W2594JS6IuIRODOV/OpqqnhZ1OGxbqURlHoi4jU4+Ot+3hq2SZmnNiffl3axbqcRlHoi4jU4///2yd0yEjl6jPi9zaIkVLoi4h8ibfyd/J2/k6uOWMwHdumxbqcRlPoi4gcQXWNc+uLH9OvS1suPbF/rMuJCoW+iMgRPL1sE2u37+f6KcNJS2kdcdk63oWISJSVlFdxx6v5nNCvU4vsbuFIFPoiInW4963P2Lm/nBu/OaLFXohVF4W+iEgtm4pLue/tdUwd25PjW/CFWHVR6IuI1PKbv31Ckhk3nD081qVEnUJfRCTMe58V8eJHW7nytEH0yGoT63KiTqEvIhKornF+9XwevTq2YfYpA2NdTpNQ6IuIBJ5cspFPtu3nv74xokXd9/ZoKPRFRIDikgpuf2UtkwZ25htjWs8pmrVFFPpmNsXM1ppZgZndUMf0dDNbGEz/wMz6B+NTzewRM/vIzD42s59Ht3wRkei4/ZVPKCmv4uapo1vVKZq11Rv6ZpYMzAXOBkYC081sZK1mlwO73X0wcBdwWzD+fCDd3ccAJwDfP/SDICISL1Zt2sOCpZuYeVJ/hnbLjHU5TSqSLf0JQIG7r3P3CmABMLVWm6nAI8Hw08CZFvqpdKCdmaUAbYAKYF9UKhcRiYKaGmfOc6vp2j6d//jakFiX0+QiCf1ewKaw54XBuDrbuHsVsBfoQugHoATYCmwE7nD34tovYGazzSzXzHJ37tx51G9CRKShFuZuYlXhXm78xggyM1JjXU6Ta+oDuROAaqAnMAD4iZn9y3lQ7n6fu+e4e052dnYTlyQiErKntILfvvwJE/p3ZurYnrEup1lEEvqbgT5hz3sH4+psE+zKyQKKgIuAl9290t13AO8COY0tWkQkGn77ylr2lVXxq6mjWvXB23CRhP5SYIiZDTCzNOBCYFGtNouAGcHwNOANd3dCu3TOADCzdsAk4JNoFC4i0hhL1hcz/4ONzDypPyN6dIh1Oc2m3tAP9tFfDbwCfAw85e55ZnazmZ0bNHsQ6GJmBcCPgUOndc4F2ptZHqEfj4fc/cNovwkRkaNRVlnNDc98SO9ObfjJ14fGupxmlRJJI3d/CXip1rg5YcNlhE7PrD3fgbrGi4jE0h8XF7BuZwmPzJpA27SIYrDV0BW5IpJQPtm2jz+++Rn/Pq4Xpw5NvBNHFPoikjCqa5wb/vIRHdqk8otv1b7GNDEo9EUkYTz63gZWbtrDL88ZSed2abEuJyYU+iKSEAp3l3L7K2s5bVg25x6XGOfk10WhLyKtnrvzi7+uBuCW81p3h2r1UeiLSKu3aNUW3ly7k//8+jB6d2ob63JiSqEvIq1acUkFv3p+Dcf16ciMk/rHupyYU+iLSKt2ywtr2Hewktu+PYbkpMTdrXOIQl9EWq238nfyzIrNXHnaIIZ3T5yuFr6MQl9EWqWS8ir+65mPGJjdjh+ePjjW5cSNxLr+WEQSxp2v5bN5z0Ge+v6JrfYm5w2hLX0RaXVWbdrDQ++u5+KJfZkwoHOsy4krCn0RaVUqqmq4/i8fkp2ZzvVnD491OXFHu3dEpFX5w9/z+WTbfu6/NIcOCXD7w6OlLX0RaTVWbNzN/775GdNO6M3kkd1iXU5cUuiLSKtwsKKanzy1iu4dMphzTmL2oBkJ7d4RkVbhtpc/Yd2uEp64YqJ263wJbemLSIv3zqc7efj/NjDjxH6cPLhrrMuJawp9EWnRig6U8+OnVjHkmPb8/BsjYl1O3NPuHRFpsdyd6//yIXtLK3l01gRdhBUBbemLSIv1+Acbef3jHVx/9nBG9FDfOpFQ6ItIi/Tp9v3c8sIaThmazWXqMjliCn0RaXHKq6q5dsFK2qencMf5x5KkLpMjpn36ItLi/PbltXy8dR8PzsjhmMyMWJfTokS0pW9mU8xsrZkVmNkNdUxPN7OFwfQPzKx/2LRjzew9M8szs4/MTJ+QiDTY2/k7efAf67n0xH6cOUJX3R6tekPfzJKBucDZwEhgupnVvtztcmC3uw8G7gJuC+ZNAR4HfuDuo4DTgMqoVS8iCWXH/jJ+8udVDO3Wnv/S6ZkNEsmW/gSgwN3XuXsFsACYWqvNVOCRYPhp4EwL3W7+68CH7r4KwN2L3L06OqWLSCKpqq7hmvkr2F9Wyd3Tx+n0zAaKJPR7AZvCnhcG4+ps4+5VwF6gCzAUcDN7xcyWm9nPGl+yiCSiO17N54P1xfz6vDG69WEjNPWB3BTgK8B4oBT4u5ktc/e/hzcys9nAbIC+ffs2cUki0tK8tmY79771GdMn9OXbJ/SOdTktWiRb+puBPmHPewfj6mwT7MfPAooI/a/gbXff5e6lwEvA8bVfwN3vc/ccd8/Jzs4++nchIq3W50Ul/PiplYzu1YFfqvfMRosk9JcCQ8xsgJmlARcCi2q1WQTMCIanAW+4uwOvAGPMrG3wY3AqsCY6pYtIa1dWWc2Vjy8nyYz/vfgE7cePgnp377h7lZldTSjAk4F57p5nZjcDue6+CHgQeMzMCoBiQj8MuPtuM7uT0A+HAy+5+4tN9F5EpJX55XN5rNm6j3kzc+jTuW2sy2kVItqn7+4vEdo1Ez5uTthwGXD+EeZ9nNBpmyIiEXsqdxMLczfxw9MHccZwnY8fLeqGQUTiTt6Wvfz3X1dz0qAu/HjysFiX06oo9EUkruw9WMlVTyynY9tU7p4+jmT1qxNV6ntHROKGu/PTP69i8+6DLJg9ia7t02NdUqujLX0RiRv3vb2OV9ds54azh5PTv3Osy2mVFPoiEhfe+XQnt738CWeP7s7lXxkQ63JaLYW+iMTchl0lXD1/BUOOyeT2848j1HWXNAWFvojE1N7SSmY9spQkg/svzaF9ug41NiWtXRGJmcrqGn44fzmbikt54opJ9O2iC7CamkJfRGLC3fnV83n8o2AXt087lgkDdOC2OWj3jojExCP/t4HH39/I908dyPk5feqfQaJCoS8ize7NtTu4+YU1TB7ZjevPGh7rchKKQl9EmtWn2/dzzfwVDOvegd9fMJYkXXHbrBT6ItJstu0tY+ZDS8lIS+bBGTm005k6zU6hLyLNYu/BSmbMW8Ke0goemjmenh3bxLqkhKSfWRFpcmWV1Xzv0VzW7TrAQzMnMLpXVqxLSlgKfRFpUtU1znULVrJkfTF3Tx/HV4Z0jXVJCU27d0Skybg7c55bzct525jzrZGce1zPWJeU8BT6ItJk7v57AU98sJEfnDqIWepELS4o9EWkScz/YCN3vZ7Pt4/vzfVTdPereKHQF5GoeyVvG7/460ecPiyb33x7jHrNjCMKfRGJqiXri7nmyRUc27sjcy8+ntRkxUw80achIlGTt2Uvlz+ylN6d2jBv5njapukEwXij0BeRqPh0+34ufXAJmekpPDprAp3bpcW6JKmDQl9EGm3DrhIufuADkpKMx6+YSO9O6hc/Xin0RaRRNhWXctH971NV4zxxxUQGZrePdUnyJSIKfTObYmZrzazAzG6oY3q6mS0Mpn9gZv1rTe9rZgfM7D+jU7aIxINNxaVceN/7lFRU8/jlExnaLTPWJUk96g19M0sG5gJnAyOB6WY2slazy4Hd7j4YuAu4rdb0O4G/Nb5cEYkXhwJ/f1klj18+kZE9O8S6JIlAJFv6E4ACd1/n7hXAAmBqrTZTgUeC4aeBMy04MdfMzgPWA3nRKVlEYu1Q4B8or+KJKyYxprc6UGspIgn9XsCmsOeFwbg627h7FbAX6GJm7YHrgV992QuY2WwzyzWz3J07d0Zau4jEwOdFJWGBP1GB38I09YHcm4C73P3AlzVy9/vcPcfdc7Kzs5u4JBFpqM92HuCCP71PaUUo8NVFcssTyZUTm4Hwuxb3DsbV1abQzFKALKAImAhMM7PfAh2BGjMrc/d7Gl25iDSrvC17mTFvCe7w5OxJDO+uffgtUSShvxQYYmYDCIX7hcBFtdosAmYA7wHTgDfc3YGvHmpgZjcBBxT4Ii1P7oZiLnt4KZnpKTx2xUQG6bTMFqve0Hf3KjO7GngFSAbmuXuemd0M5Lr7IuBB4DEzKwCKCf0wiEgr8ObaHfzg8WX0zGrDY1dMpJduc9iiWWiDPH7k5OR4bm5urMsQEeDFD7dy3cIVDDkmk0cvn0DX9umxLkmOwMyWuXtOfe3UG5KI1Gnh0o38/JmPOL5vJx6cOZ6sNqmxLkmiQKEvIl/g7sxdXMAdr+ZzytBs/nTJCbRJS451WRIlCn0ROayquoY5i/KY/8FG/m1cL2779rGkpaiLrtZEoS8iABysqOaaJ1fw+sfbufK0QfzsrGG641UrpNAXEXbsL+N7jy7jw8I9/OrcUcw4qX+sS5ImotAXSXBrt+1n1sNLKS6p4N5LTuCsUd1jXZI0IYW+SAJ7K38nP3xiOW3Tknnq+yeqH50EoNAXSUDuzkPvbuCWF9cwrHsH5s3MoUeWLrpKBAp9kQRTXlXNnL/msTB3E5NHduOuC8bSPl1RkCj0SYskkB37y7jq8eXkfr6ba84YzI++NpSkJJ2hk0gU+iIJYvnG3Vz5+DL2Hazif6aP45zjesa6JIkBhb5IK+fuzF+ykZsW5dEjqw3PXDWBET3ULXKiUuiLtGIHK6r5xV9X85flhZwyNJu7LxxLx7ZpsS5LYkihL9JKFew4wA+fWE7+jv1ce+YQ/uPMISRr/33CU+iLtELPrdzMz5/5iIzUZB65bAKnDNVtSCVEoS/SipRWVPHL5/L487JCcvp14n8uGqfz7+ULFPoircTqzXv5jwUrWLerhGvOGMx/nDmElGT1kClfpNAXaeGqa5w/vf0Zd72WT+d2aTxx+UROGtw11mVJnFLoi7Rgm4pL+clTq1iyoZhvjOnOrf82RmfnyJdS6Iu0QO7Osys288vn8nDgd+cfx78f30v930u9FPoiLcyuA+X84tnVvJy3jfH9O3Hnd8bSp3PbWJclLYRCX6SFcHee/3ArNy3K40BZFddPGc7sUwbq3Hs5Kgp9kRZgU3Epc55bzeK1OzmuT0fumHYsQ7plxrosaYEU+iJxrKq6hnnvrueu1z7FDH7xzRHMPKm/TsWUBovom2NmU8xsrZkVmNkNdUxPN7OFwfQPzKx/MH6ymS0zs4+CxzOiW75I67Vy0x7Oueddbn3pE04e3IXXfnwqV3x1oAJfGqXeLX0zSwbmApOBQmCpmS1y9zVhzS4Hdrv7YDO7ELgNuADYBZzj7lvMbDTwCtAr2m9CpDXZX1bJ717N55H3NnBMZjr3XnI8Z43qrjNzJCoi2b0zAShw93UAZrYAmAqEh/5U4KZg+GngHjMzd18R1iYPaGNm6e5e3ujKRVoZd2fRqi3c+tLH7NhfzqWT+vGfZw0jMyM11qVJKxJJ6PcCNoU9LwQmHqmNu1eZ2V6gC6Et/UO+DSyvK/DNbDYwG6Bv374RFy/SWuRt2cuvFq1hyYZixvTK4t5LTmBc306xLktaoWY5kGtmowjt8vl6XdPd/T7gPoCcnBxvjppE4sHO/eX87tW1LMzdRKe2afzm38dwfk4fnYYpTSaS0N8M9Al73jsYV1ebQjNLAbKAIgAz6w08C1zq7p81umKRVuBAeRUPvrOe+99ZR1llNbNOHsC1Zwwhq6125UjTiiT0lwJDzGwAoXC/ELioVptFwAzgPWAa8Ia7u5l1BF4EbnD3d6NXtkjLVF5VzfwPNnLPGwUUlVRw1qhuXD9lOAOz28e6NEkQ9YZ+sI/+akJn3iQD89w9z8xuBnLdfRHwIPCYmRUAxYR+GACuBgYDc8xsTjDu6+6+I9pvRCSeVdc4f12xmTtfy2fznoOcOLALP5syTPvtpdmZe3ztQs/JyfHc3NxYlyESFe7O6x/v4PZXPiF/+wFG9+rA9VOG85XBXXUKpkSVmS1z95z62umKXJEm4O68/eku/vB6Pss37mFA13bMveh4zh7dnSQdpJUYUuiLRJG7s3jtDv7njQJWbNxDz6wMbv23MZyf05tUXUkrcUChLxIF1TXO31Zv5Y+LP2PN1n306tiGX//baKad0Jv0lORYlydymEJfpBEOVlTz9PJCHnhnHZ8XlTIwux13nH8cU8f21Ja9xCWFvkgD5G/fz/wPNvKX5YXsL6viuD4d+fnZw5k8srsurJK4ptAXiVB5VTUvr97GE+9vZMmGYtKSk/jGmO5cPKkfOf066WwcaREU+iL1+LyohPlLNvLn3EKKSyro16Ut//WN4Uw7oQ+d2+km5NKyKPRF6lBVXcPfP9nB4+9/zjuf7iI5yZg8ohsXT+rLyYO66rRLabEU+iJhtu49yIIlm1iwdCPb95XTIyuDH31tKBeM70P3rIxYlyfSaAp9SXhV1TW8U7CL+R9s5O8fb8eBU4dmc8t5/Th9WLbuVCWtikJfEpK7s6pwL8+t3Mzzq7ay60A5Xdql8f1TBzF9fF/6dmkb6xJFmoRCXxKGu/PR5r28+OFWXvhwK5v3HCQtOYkzhh/DeeN6cvrwY3QhlbR6Cn1p1aqqa1i6YTevf7ydV9dsY1PxQVKSjK8M6cqPJg9l8shuZLVRH/aSOBT60uocKK/i7fydvL5mO2+s3cGe0krSUpI4aVAXrjl9CF8f1Y2ObXWqpSQmhb60eO7O+l0lvJW/kzfX7uS9z4qoqK6hY9tUzhh+DJNHdOOUodm0S9fXXUT/CqRFKjpQznvrini3oIi383eyec9BAAZ2bcd3T+zH5JHdyOnXSWfeiNSi0JcWobikgiXri1myvpj/+2wXn2zbD0D79BROGtSFK08bxKlDs+nTWWfdiHwZhb7EHXencPdBcj8vJnfDbpZuKCZ/+wEA0lOSOKFfJ3561jBOHNSFY3tlaWte5Cgo9CXm9pRWsKpwL6s27eHDwj2s3LSXXQfKAchMT2Fcv05MHduLSQM7M6ZXR4tVDGQAAAw4SURBVNJSFPIiDaXQl2a1Y38Za7bsI2/LPtZs2cfqLXv5vKgUADMYlN2eU4Z25fi+nTihXyeGdstUV8UiUaTQlyaxr6ySgh0H+HT7ftZuO8Da7ftYu20/uw5UHG7Tp3MbRvXI4oLxfRjbuyOje2fRIUPnzIs0JYW+NIi7s6e0ks+LS/m8qISNRaV8XlwaPJawfV/54bYZqUkM7ZbJ6cOOYXiPDozq2YERPTrooiiRGFDoyxFV1zjb95XxeVEpG4tL2FD0z1D/vKiU/WVVX2h/TGY6/bq05SuDsxl0TDuGHJPJkGPa06dzW+2iEYkTCv0EVFPj7D1Yya4D5ew8UM7O/eVs31fG9n3lbNtXxra9ZWzdc5Dt+8uprvHD86UkGb07taFvl3aM69OJfl3a0rdzW/p1aUffzm1pk6Z+a0TiXUShb2ZTgD8AycAD7v6bWtPTgUeBE4Ai4AJ33xBM+zlwOVANXOvur0St+gTn7pRV1rC/rJJ9ZVXsPVjJvoOV7DlYQdGBCnaXVlBcUsnukgqKSysoLqlgd0lofFiWH9Y2LZluHTLokZXBpEFd6JnVhh4dM+jXuR39urSlR1aGTo8UaeHqDX0zSwbmApOBQmCpmS1y9zVhzS4Hdrv7YDO7ELgNuMDMRgIXAqOAnsDrZjbU3auj/UZizd2pqnGqa0KPVdU1VFY7ldU1VFU7FdU1lFdVU1FVQ0VVDeXB46HxBytqOFhZTVllNQcrqjlYWU1pxT+fl1RUUVJeRUl5NQfKqyipqOJAWRVVdaV3IDnJ6NQ2lc7t0ujUNo0hx7SnU7s0OrdNo1O7NLIz0+naPo1jMtPp1iGD9ukpus+rSCsXyZb+BKDA3dcBmNkCYCoQHvpTgZuC4aeBeyyUHlOBBe5eDqw3s4Jgee9Fp/x/2lNawbR7j7xYd+dwPPoXHg5PcwfHQ48eGl/jUO1OTY1T46FQr3HChv85LlqSDNqmpZCRmkybtCTapCbTJi2F9unJdG2fTvv0FNqlp5CZkUJmRmrwmEJWm1Q6tEmlY5tUurRLJzMjRbf1E5EviCT0ewGbwp4XAhOP1Mbdq8xsL9AlGP9+rXl71X4BM5sNzAbo27dvpLV/QXKSMaxb5pc3MjgUgYe2aP/5PDRsZocfkyw0PjnJSLLQ3z+Hg/FJRrKFHlOTjJTkJJKTICUpidSUJFKTjNTkJFKSjfSUJNJTkklLSSI9JYm0Q3/JSbRNS6FNajIZaaHn2uIWkaYQFwdy3f0+4D6AnJycBm0zZ2akMvfi46Nal4hIaxPJUbnNQJ+w572DcXW2MbMUIIvQAd1I5hURkWYSSegvBYaY2QAzSyN0YHZRrTaLgBnB8DTgDXf3YPyFZpZuZgOAIcCS6JQuIiJHq97dO8E++quBVwidsjnP3fPM7GYg190XAQ8CjwUHaosJ/TAQtHuK0EHfKuCHrfHMHRGRlsJCG+TxIycnx3Nzc2NdhohIi2Jmy9w9p752utJGRCSBKPRFRBKIQl9EJIEo9EVEEkjcHcg1s53A5w2YtSuwK8rlREO81gWqraFU29GL17qg9dTWz92z62sUd6HfUGaWG8mR6+YWr3WBamso1Xb04rUuSLzatHtHRCSBKPRFRBJIawr9+2JdwBHEa12g2hpKtR29eK0LEqy2VrNPX0RE6teatvRFRKQeCn0RkQQSl6FvZlPMbK2ZFZjZDXVMTzezhcH0D8ysf9i0nwfj15rZWZEus6lrM7PJZrbMzD4KHs8Im+fNYJkrg79jmrm2/mZ2MOz17w2b54Sg5gIzu9sacEuvRtR1cVhNK82sxszGBtOaa52dYmbLzazKzKbVmjbDzD4N/maEjW/0OmtMbWY21szeM7M8M/vQzC4Im/awma0PW29jm7O2YFp12OsvChs/IPj8C4LvQ1pz1mZmp9f6vpWZ2XnBtOZabz82szXB5/Z3M+sXNi063zd3j6s/Qt03fwYMBNKAVcDIWm2uAu4Nhi8EFgbDI4P26cCAYDnJkSyzGWobB/QMhkcDm8PmeRPIieF66w+sPsJylwCTCN1N8m/A2c1VV602Y4DPYrDO+gPHAo8C08LGdwbWBY+dguFO0VhnUahtKDAkGO4JbAU6Bs8fDm/b3OstmHbgCMt9CrgwGL4XuLK5a6v1+RYDbZt5vZ0e9ppX8s9/o1H7vsXjlv7hG7G7ewVw6Ebs4aYCjwTDTwNnBr9uh2/E7u7rgUM3Yo9kmU1am7uvcPctwfg8oI2ZpTeghqjXdqQFmlkPoIO7v++hb9ejwHkxqmt6MG801Vubu29w9w+BmlrzngW85u7F7r4beA2YEqV11qja3D3f3T8NhrcAO4B6r9RsjtqOJPi8zyD0+UPo+9Cs662WacDf3L20ATU0prbFYa/5PqG7DUIUv2/xGPp13Yi99s3Uv3AjdiD8Rux1zRvJMpu6tnDfBpa7e3nYuIeC/zb+dwN3BzS2tgFmtsLM3jKzr4a1L6xnmU1d1yEXAE/WGtcc6+xo543GOmtsbYeZ2QRCW5WfhY3+dbD74K4Gbng0trYMM8s1s/cP7T4h9HnvCT7/hiwzWrUdciH/+n1r7vV2OaEt9y+b96i/b/EY+q2amY0CbgO+Hzb6YncfA3w1+PtuM5e1Fejr7uOAHwPzzaxDM9dwRGY2ESh199Vho2O9zuJesBX4GHCZux/aqv05MBwYT2hXwfUxKK2fh7oWuAj4vZkNikENRxSstzGE7hZ4SLOuNzO7BMgBbo/2suMx9JviRuzRukF7Y2rDzHoDzwKXuvvhLS933xw87gfmE/pvYLPVFuwOKwpqWEZoq3Bo0L532PwNWW+NWmeBf9nqasZ1drTzRmOdNbY2gh/tF4Eb3f39Q+PdfauHlAMP0fzrLfyzW0fo2Mw4Qp93x+DzP+plRqu2wHeAZ929MqzmZltvZvY14Ebg3LC9AdH7vjXmwERT/BG6b+86QgdiDx3sGFWrzQ/54oG/p4LhUXzxQO46QgdP6l1mM9TWMWj/73Uss2swnEpon+YPmrm2bCA5GB4YfGk6e90Hib7RXHUFz5OCegbGYp2FtX2Yfz2Qu57QQbVOwXBU1lkUaksD/g5cV0fbHsGjAb8HftPMtXUC0oPhrsCnBAczgT/zxQO5VzVnbWHj3wdOj8V6I/QD+BnBgfim+L4dVdHN9Qd8A8gP3vyNwbibCf3yAWQEX5CC4A2HB8KNwXxrCTuKXdcym7M24BdACbAy7O8YoB2wDPiQ0AHePxAEcDPW9u3gtVcCy4FzwpaZA6wOlnkPwVXczfh5nga8X2t5zbnOxhPaT1pCaGs0L2zeWUHNBYR2oURtnTWmNuASoLLWd21sMO0N4KOgvseB9s1c20nB668KHi8PW+bA4PMvCL4P6TH4TPsT2shIqrXM5lpvrwPbwz63RdH+vqkbBhGRBBKP+/RFRKSJKPRFRBKIQl9EJIEo9EVEEohCX0QkgSj0RaLIzM491HuimZ1nZiNjXZNIOJ2yKfIlzCzZ3asbOO/DwAvu/nR9bUWai7b0pdWz0P0CPjGzJ8zsYzN72szamtmZQSdzH5nZvEOdaJnZBjO7zcyWA+dbqH/694POtp41s05Bu2vD+j5fEIybaWb3mNlJwLnA7UGncIOC5R2qaUj4c5HmotCXRDEM+KO7jwD2EepY7mHgAg913JZCqP/yQ4rc/Xh3X0Cou9rr3f1YQldl/jJocwMwLhj/g/AXc/f/AxYBP3X3sR7qa2lv2M03LiPUh4tIs1LoS6LY5O7vBsOPA2cC6909Pxj3CHBKWPuFAGaWRegGJG/V0e5D4ImgR8Qq6vcAcJmZJRPqKnp+Q9+MSEMp9CVR1D54taee9iURLPObwFzgeGBpWA+RR/IX4GzgW8AyD3o2FWlOCn1JFH3N7MRg+CIgF+hvZoODcd8F3qo9k7vvBXaH3Vjmu8BbZpYE9HH3xYT6Vs8C2teafT+QGbasMkJ9tP8v2rUjMaLQl0SxFvihmX1MqGvauwjtV/+zmX1E6NZ59x5h3hmEDsh+CIwl1CtiMvB4MO8K4G53r/2/hwXAT4ODxYduFPJE8FqvRu+tiUROp2xKq2dm/QmdOjk6xqVgZv8JZLn7f8e6FklM9e2DFJEoMbNngUGEbgAuEhPa0hcRSSDapy8ikkAU+iIiCUShLyKSQBT6IiIJRKEvIpJA/h9pBoDYvKCGRwAAAABJRU5ErkJggg==\n", "text/plain": ["<Figure size 432x288 with 1 Axes>"]}, "metadata": {"needs_background": "light"}, "output_type": "display_data"}], "source": ["df_new.set_index(['porosity']).plot();"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["Or explicitly pass the desired independent variable to the `x` keyword arguments and the dependent variable to the `y` keyword argument.  This time we'll also explicitly create a scatter plot."]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}, "tags": ["popout"]}, "source": ["When the DataFrame columns are explicitly passed as arguments, the axis labels are correctly populated."]}, {"cell_type": "code", "execution_count": 36, "metadata": {"slideshow": {"slide_type": "subslide"}}, "outputs": [{"data": {"image/png": "iVBORw0KGgoAAAANSUhEUgAAAYgAAAEGCAYAAAB/+QKOAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy8li6FKAAAgAElEQVR4nO3dfZhdZXnv8e9vdmYmgUCISUrNmwlMOG0iIcpIoGgscES0klgJErEGlV7Utmg9WAIervISa0/BY6kt9GAqqFg8AUOFiFqOCtVKgWaCQzBBcHjNhBZhSEIGk0lm5j5/7LXDnp01e3Yms2bvmfl9rivX7PW2596LYd37Wc+z7kcRgZmZWam6agdgZma1yQnCzMxSOUGYmVkqJwgzM0vlBGFmZqnGVTuAoTJ16tSYM2dOtcMwMxtRNm7c+HJETEvbNmoSxJw5c2hpaal2GGZmI4qk5/rb5ltMZmaWygnCzMxSOUGYmVkqJwgzM0vlBGFmZqmcIMzMLJUThJmZpXKCMDOzVE4QZmaWygnCzMxSOUGYmVkqJwgzM0vlBGFmZqmcIMzMLJUThJmZpXKCMDOzVE4QZmaWygnCzMxSOUGYmVmqTBOEpLMkPSGpTdLlKduXSHpEUrek5UXrF0l6UNJmSZsknZdlnGZmdqDMEoSkHHAj8B5gPvAhSfNLdnse+CjwzZL1vwZWRsQC4CzgbyUdlVWsZma1pqOzi0e37qCjs6tqMYzL8L1PAtoi4mkASWuBZcCWwg4R8Wyyrbf4wIh4suj1C5J+BUwDdmQYr5lZTbi7dRuX3bmJ+ro69vX2ct05C1m6aMawx5HlLaYZwNai5fZk3UGRdBLQADyVsu0iSS2SWl566aVBB2pmVis6Oru47M5N7NnXy66ubvbs62XVnZuq0pKo6U5qSW8EvgF8LCJ6S7dHxJqIaI6I5mnTpg1/gGZmQ6x9+27q6/pemuvr6mjfvnvYY8kyQWwDZhUtz0zWVUTSkcB3gSsi4qEhjs3MrCbNnDyBfb19vw/v6+1l5uQJwx5LlgliAzBP0lxJDcAKYH0lByb7fxu4NSLWZRijmVlNmTKxkevOWcj4+jqOaBzH+Po6rjtnIVMmNg57LJl1UkdEt6SLgXuBHHBLRGyWtBpoiYj1kt5GPhFMBs6WdE0ycumDwBJgiqSPJm/50YhozSpeM7NasXTRDE5tmkr79t3MnDyhKskBQBFRlV881Jqbm6OlpaXaYZiZjSiSNkZEc9q2mu6kNjOz6nGCMDOzVE4QZmaWygnCzKzK2l7cxbqWrbS9uKvaofSRZakNMzMbwJV3PcatDz2/f3nlKbNZvez4Kkb0OrcgzMyqpO3FXX2SA8CtDz5fMy0JJwgzsypp3Zpef7S/9cPNCcLMrEoWzUqfxaC/9cPNCcLMrEqajj6ClafM7rNu5SmzaTr6iCpF1Jc7qc3Mqmj1suNZefIcWrfuYNGso2omOYAThJlZ1TUdfURNJYYC32IyM7NUThBmZpbKCcLMbJh0dHbx6NYdVZk+dDDcB2FmNgzubt3GZXduor6ujn29vVx3zkKWLppR7bDKcgvCzCxjHZ1dXHbnJvbs62VXVzd79vWy6s5NNd+ScIIwM8tY+/bd1Nf1vdzW19XRvn13lSKqjBOEmVnGDm/I0dXT22fdvt5eZk6eUKWIKuM+CDOzDBX6HpRM7zy+Pv+9/LpzFlZtrulKZdqCkHSWpCcktUm6PGX7EkmPSOqWtLxk2wWSfpn8uyDLOM3MslDc99DVk08Qvb3BPRe/veY7qCHDBCEpB9wIvAeYD3xI0vyS3Z4HPgp8s+TYNwBXAYuBk4CrJE3OKlYzsyyk9T00jsvx2t6eKkV0cLJsQZwEtEXE0xGxF1gLLCveISKejYhNQG/Jse8GfhARr0TEduAHwFkZxmpmNuRGat9DQZYJYgawtWi5PVk3ZMdKukhSi6SWl156adCBmpkNtbtbt/G+G37ap+9hfH3diOh7KBjRndQRsQZYA9Dc3BxVDsfMDMj3Paxat4mu7tdbD729wfc+9Y6aLMrXnyxbENuAWUXLM5N1WR9rZlZVtz38fJ/kACOr76EgywSxAZgnaa6kBmAFsL7CY+8FzpQ0OemcPjNZZ2ZW0zo6u7jx/l8esH5vz8jpeyjILEFERDdwMfkL++PAHRGxWdJqSUsBJL1NUjtwLvBlSZuTY18BPkc+yWwAVifrzMxqWvv23TTkcgesv/i0phHT91CQaR9ERHwP+F7JuiuLXm8gf/so7dhbgFuyjM/MbKjNnDyBfb2lt5fE+Ytn93NE7XKpDTOzITRlYiPXnbOQ8fV1HNE4jvH1dXxh+QkjrvUAI3wUk5lZLVq6aAanNk2lfftuZk6eMCKTAzhBmJllYsrExhGbGAp8i8nM7BCNtJniKuUWhJnZIRiJM8VVyi0IM7NBGqkzxVXKCcLMbJBG6kxxlXKCMDMbpLRnHkZStdaBOEGYmQ1S2jMPI6la60DcSW1mdghGyzMPaZwgzMwO0Wh45iGNbzGZmR2k0frcQym3IMzMDsJtDz3HNfdsoSEnuntjVD33UMotCDOzCt320HNccdfP2dvdS2dXz6h77qGUE4SZWQU6Oru45jubD1ifq9Ooee6hlBOEmVkFNr+wk1ydDli/rydGzXMPpdwHYWY2gLtbt7Fq3aN0dccB2646e/6oHMEEbkGYmZVVqLdUmhzqc+Lz738zH178pipFlj23IMzMyijUW9rD6yU1DqvPcdNHTmTJcdOqGFn2Mm1BSDpL0hOS2iRdnrK9UdLtyfaHJc1J1tdL+rqkxyQ9LumzWcZpZtaftHpLvQQLph9ZpYiGT2YJQlIOuBF4DzAf+JCk+SW7XQhsj4gm4Hrg2mT9uUBjRBwPnAj8USF5mJkNp9Feb6mcLG8xnQS0RcTTAJLWAsuALUX7LAOuTl6vA26QJCCAwyWNAyYAe4FXM4zVzKyPjs6u/fWVRnO9pXIqShCSvgjcEhEHDgLu3wxga9FyO7C4v30iolvSTmAK+WSxDPhP4DDgf0TEKylxXQRcBDB79uyDCM3MrH/9zRI3VhJDQaW3mB4H1iT9BJ+QNCnLoMi3PnqA6cBc4DOSjindKSLWRERzRDRPmza6O4vMbHiM9lniDkZFCSIivhIRpwIrgTnAJknflHRamcO2AbOKlmcm61L3SW4nTQI6gPOBf4mIfRHxK+ABoLmSWM3MDsVonyXuYFTcSZ10Ov9W8u9l4FHgkqRvIc0GYJ6kuZIagBXA+pJ91gMXJK+XA/dFRADPA6cnv/dw4GTgF5XGamY2WKN9lriDUVGCkHQ9+Qv0e4G/iogTI+LaiDgbeEvaMRHRDVwM3Ev+FtUdEbFZ0mpJS5PdbgamSGoDLgEKQ2FvBCZK2kw+0Xw1IjYN7iOamVVuLI9aKqX8F/YBdpI+Rv4C/1rKtkkRsTOL4A5Gc3NztLS0VDsMMxslikcxjebkIGljRKTewq/0FtMflCYHST8CqIXkYGY21KZMbOSEWUeN6uQwkLLDXCWNJz/MdKqkyUChlOGR5IeompnZKDXQcxB/BHya/HDTR4rWvwrckFVQZmZWfWUTRER8CfiSpE9GxN8PU0xmZlYDBrrFdHpE3Adsk/SB0u0R8c+ZRWZmZlU10C2mdwL3AWenbAvACcLMbJQa6BbTVcnPjw1POGZmVisGusV0SbntEfE3QxuOmVm2xsrzDUNhoFtMRwxLFGZmw6C/Kq2WbqBbTNcMVyBmZlkqrtJamD501Z2bOLVpqlsS/RjoFtOqiLhO0t+T75TuIyI+lVlkZmZDKG1u6UKVVieIdAPdYno8+ekiR2Y2YrW9uIufPb+dvT2u0nowBrrF9J3k59cBJB2ZX4xdwxCbmdkhu/Kux7j1oef3L+fqxGH1uf19EG499K/SKUebga+S77SWpB3AxyNiY5bBmZkdirYXd/VJDgA9vcH/+sDxnHLsFCeHAVSUIIBbgD+JiH8DkPR28gljYVaBmZkdqtatO1LX79nX4+RQgUrLffcUkgNARPwU6M4mJDOzobFo1lEHtd76KpsgJL1V0luBH0v6sqTflfROSf8A/OuwRGhmNkhNRx/BylNm91m38pTZNB3tR7wqUXZGOUn3lzk2IuL0oQ9pcDyjnJn1p+3FXbRu3cGiWUc5OZQoN6PcQKOYTssmJDOzoddfGY2mo49wYhiESjupkfR7wAJgfGFdRKwe4JizgC8BOeArEfHXJdsbgVuBE4EO4LyIeDbZthD4MvnZ63qBt0XEnkrjNbOxxWU0hl5FndSSbgLOAz5JftrRc4E3DXBMDrgReA8wH/iQpPklu10IbI+IJuB64Nrk2HHAPwGfiIgFwO8C+yr7SGY21hSX0djV1c2efb2sunMTHZ1d1Q5tRKt0FNPvRMRK8hfza4BTgOMGOOYkoC0ino6IvcBaYFnJPsuAryev1wFnSBJwJrApIh4FiIiOiOipMFYzG2MKZTSKFcpo2OBVmiAKZ/nXkqaT/zb/xgGOmQFsLVpuT9al7hMR3cBOYAr55BOS7pX0iKRVFcZpZmPQzMkT2NfrMhpDrdIEcY+ko4AvAI8AzwL/N6ugyPeNvB34cPLz9yWdUbqTpIsktUhqeemllzIMx8xq2ZSJjVx3zkLG19dxROM4xtfXuYzGEKiokzoiPpe8vFPSPcD4iNg5wGHbgFlFyzOTdWn7tCf9DpPId1a3Az+JiJcBJH0PeCvwo5K41gBrID/MtZLPYmaj09JFMzi1aaonAxpClXZSHybpLyT9Y0R0Ab8h6X0DHLYBmCdprqQGYAWwvmSf9cAFyevlwH2RfzDjXuD45PeOIz839pYKP5OZjVFTJjZywqyjnByGSKW3mL4KdJHvnIb8N/+/LHdA0qdwMfmL/ePAHRGxWdJqSUuT3W4GpkhqAy4BLk+O3Q78Dfkk0wo8EhHfrfhTmZnZISv7JPX+naSWiGiW9LOIeEuy7tGIOCHzCCvkJ6nNzA5euSepK21B7JU0gWRWOUnHkm9RmJkNm47OLh7dusPPNwyTSp+kvgr4F2CWpNuAU4GPZhWUmVmp2x56jmvu2UJDTnT3hp+UHgaVjmL6gaRHgJPJP0n9Z4URRmZmWbvtoee44q6fA7A3mWhg1Z2bOLVpqjukM1TpLSbIP9SWAxqAJZI+kE1IZmav6+js4prvbD5gfa5OflI6Y5VOOXoL+dnjNpMvnAf5/oh/ziguMzMgKaORq2NvT99qO/t6wk9KZ6zSPoiTI6K00J6ZWeZmTp5AT8poy6vOnu/bSxmr9BbTgymVWM3MMldcRuPwhhwNOfH597+ZDy8uW1DahkClLYhbySeJ/yI/vFXkZ5RbmFlkZjZmlU784zIa1VFpgrgZ+AjwGK/3QZiZDbn+Jv6ZMrHRiWGYVZogXoqI0jpKZmZDqnjinz3Jd1EPZ62eShPEzyR9E/gORU9QR4RHMZnZkClM/LOn6EZFYeIfJ4jhV2mCmEA+MZxZtM7DXM1sSHnin9oyYIJI5pbeFBHXD0M8ZjaGFUYsrSrpg3DroToGTBAR0SPpQ4AThJllziOWakelt5gekHQDcDvwWmFlRDySSVRmNqZ5xFJtqDRBLEp+ri5aF8DpQxuOmY12HZ1dbH7hVSBYMH2SE0ENq7Sa62lZB2Jmo9/drdu45PZWepLKGfU58cVzT3DZ7hpV6ZzUR0u6WdL3k+X5ki7MNjQzG006Orv4zB2vJwfIF9y7dN0mTwBUoyqtxfQ18nNLT0+WnwQ+nUVAZjb6dHR28fnvbqE7pQ5DnXDZ7hpVaR/E1Ii4Q9JnASKiW1LPQAeZmd3duo1V6x6lq/vAiqwAPb34OYcaVWkL4jVJU3h9TuqTgZ0DHSTpLElPSGqTdHnK9kZJtyfbH5Y0p2T7bEmdkv68wjjNrIYUSmf0lxwArlrqst21qtIWxCXAeuAYSQ8A04Dl5Q5IHrC7EXgX0A5skLQ+IrYU7XYhsD0imiStAK4Fziva/jfA9yuM0cxqzOYXdlIn9bv9f773t1y2u4ZVmiC2AN8Gfg3sAu4i3w9RzklAW0Q8DSBpLbAsea+CZcDVyet1wA2SFBEh6f3AMxQ9d2FmI0NHZxe3Pfw8N9z3S/b2HNh6qM+Jq89ewIdPdnKoZQczH8SrwF8ly+cD3wDOLXPMDGBr0XI7sLi/fZJ+jZ3AFEl7gMvItz76vb0k6SLgIoDZs2dX+FHMLEvl+hwacuKTp8/j/MWzfVtpBKg0Qby5ZMrR+yVt6XfvQ3c1cH1EdKpM8zQi1gBrAJqbm/u/yWlmw6Jcn8Nh9Tlu+siJLDluWhUis8GoNEE8IunkiHgIQNJioGWAY7YBs4qWZybr0vZplzQOmAR0kG9pLJd0HXAU0CtpT0TcUGG8ZlYFaeW6C3oJFkw/sgpR2WBVmiBOBP5d0vPJ8mzgCUmP0f/UoxuAeZLmkk8EK8jfmiq2HrgAeJB8p/d9ERHAOwo7SLoa6HRyMKt9aeW6ARrH1bkq6whUaYI462DfOOlTuJj8A3Y54JaI2CxpNdCSzFB3M/ANSW3AK+STiJmNIKXzRxeX697b08PFp7nPYaRS/gv7yNfc3BwtLQPd9TKzodTf/NGlScNql6SNEdGctq3SFoSZGZBvMTz4VAfPdXTyd/c9RVd3+vzRTgwjnxOEmVXs7tZtfHptK/3dd/D80aNLpaU2zGyM6+js4tJv9Z8cwPNHjzZuQZjZgDo6u7j/F79CCFJSROO4OiQ8UmmUcYIws7IKHdE5ia6UshkAXzz3BE45doqTwyjjBGFm/Wp7cReXrtvE3rSJHBIrT5nN+06Y3u92G7mcIMws1d2t27j0W48eUGzv8IYcf/K7x3J4Y463N02j6egjqhShZc0Jwsz26+jsYvMLr/Lq7r2sWrcptRJrTwQrTvKDb2OBE4SZAfkWw2fuaE2dFrSgwSUzxhQnCLMxrtBquPRbj5ZPDjnxvU++3beUxhAnCLMxrDBCqQ6l3k4COKwhR28E152z0MlhjHGCMBujKhmh1JATN/3BW1kwfZJvK41BThBmY1B/I5SK1efE/z73BJYc9xvDGJnVEicIszGmMOtbWnJoHCe+eO4JHDmh3q0Gc4IwGwtanungJ798mSXzplI/Lpc661vDuDq+sHwh7zthRpWitFrjBGE2ShVGJ137/cfZ/J+7APi7+9pYPHfyAbO+eYSSpXGCMBuFyj3T8PAz2/n0GU3c9JOn+0z04+RgpZwgzEaZjs4uVq0r/0xDb8ADl53uWd+sLCcIs1GmfftucqoDevrdZ8k8z/pmA8t0wiBJZ0l6QlKbpMtTtjdKuj3Z/rCkOcn6d0naKOmx5OfpWcZpNpJ1dHbx6NYddHR2ATBz8gR6ov/mwzuaptA8d8pwhWcjWGYtCEk54EbgXUA7sEHS+ojYUrTbhcD2iGiStAK4FjgPeBk4OyJekPRm4F7AQyvMShSehC7uS1i6aAZfWH4ClxT1QdQBZ84/mj98x1wnB6tYlreYTgLaIuJpAElrgWVAcYJYBlydvF4H3CBJEfGzon02AxMkNUZEV4bxmo0YhRFKq9Ztoqu7d/+Q1VV3buLUpqksXTSDU5umsvmFV4HwMw02KFkmiBnA1qLldmBxf/tERLekncAU8i2IgnOAR9KSg6SLgIsAZs+ePXSRm9Wojs4ubnv4eW68vy0/w1tJT3R9XR3t23fv719Ycty0KkVqo0FNd1JLWkD+ttOZadsjYg2wBqC5ubncXOpmI97drdtYte5Rurr7/1Pf19vLzMkThjEqG82y7KTeBswqWp6ZrEvdR9I4YBLQkSzPBL4NrIyIpzKM06zmFcpj9JccDmvIMb7eczXY0MqyBbEBmCdpLvlEsAI4v2Sf9cAFwIPAcuC+iAhJRwHfBS6PiAcyjNGs5nR0dh3wfEL79t2p5TEgXz/JFVctC5kliKRP4WLyI5BywC0RsVnSaqAlItYDNwPfkNQGvEI+iQBcDDQBV0q6Mll3ZkT8Kqt4zaqtuH+hIdd3VNLMyRMOKI8B0JjUT3LFVcuCIkbHrfvm5uZoaWmpdhhmB6UwGunBp17m5p8+c0CF1fH1dTxw2elMmdjI+tZtrEqGtO7t6eHi0+Zx/mLPDW2HRtLGiGhO21bTndRmo1VHZxdf+benWfOTpykzJUOfUUmFoasuj2HDxQnCbJjd3bqNS25vLZsYCkpHJbk8hg2nTEttmFlfhUJ6lSSHxnEelWTV5RaE2TCqpJBeQ0588nT3L1j1OUGYDaNyhfTG1cGfnXGcE4PVDCcIs0OQ9sxCOVMmNh5YSE/wR0uO4Q/fcYwTg9UUJwizQSj3zMJAXEjPRgonCLMKFLcUftr2cp+aSIWCeYVKqpW2JFxIz2qdE4TZAIrnXNjb00NvwL6UYUjFzyyYjQZOEGaJthd30bp1B4tmHUXT0UcArxfJ27OvN7UOUjFXUrXRxgnCxqzi20bX/ssvuKOlff+2lafMZvWy48sWySvmZxZsNHKCsDGl0EroeG0v1//wSerr6nitq/uAy/+tDz7PypPnpBbJG1cHubo6GnKuiWSjmxOEjUqFIniv7t7LkRPqWTB9El/64ZPc+tDzffYr1zJo3bqD5c2zuO6chfuL5BVGK7kmko0FThA2ohUSQfFw0dseeo4r7/55n3IWOVFReYtii2YdBdBvkTwnBhvtnCBsRClOCFtf2c1V63++/4Gz+pz4/UXTuWNj6cSFB58cPtg8c39HNbhIno1NThBWk0pvEU2fNIHv/fy/+NIPn+z3Yr+vJ1KTQzmHNeTY292DJOrrxN6eXla9+7e46J3HDsGnMBvZnCCs5tzduo3PFJWiGCoCinPLB5tn8OHFc/YPTXWfgllfThB2yArf9p/4r1f51a49vHv+bzJ32sQ+F9xKaxYVymEPdXKoz4kvnnsC89945AHPOhQ4MZj15QRhQN9nAoDU12kX0LRv+//4b89SJzi8YRz7env54IkzuWNje59RQP3VLKqkHHZ/6nPiQyfN4o6WdnISe7t7+PDiN3H6b/9Gn3pHpYnBzNJlmiAknQV8CcgBX4mIvy7Z3gjcCpwIdADnRcSzybbPAheSv1J8KiLuzTLWgfR3Ad3+2t5+v5EWxtzPmXIY9eNyHN6Q44Wde4Bg+qQJvLa3J/XCmzZEE+gzWqd0ufg9Bvq2Xrq9uJTE7n3dSGL8uFyf12kX9nLf9nsDdnV1A+wfWloYUlquZlG5ctil6nPi6rMXMOsNh/U5D392xnG+XWQ2BDJLEJJywI3Au4B2YIOk9RGxpWi3C4HtEdEkaQVwLXCepPnACmABMB34oaTjIuLgv1YOgf4uoJ1d3X3uaReevgW48q7H+oy5r1P+ollsfH1+Qr/iC2/aN/I65X8Wji9dLtw+WbpoRp9Y0y7qpdv/4vfm87nvbikpJRHs6+k+4HXphX2w3/bL1SxKK4ddfL4igo+fOpdTjp3SbxVUjzgyGxpZtiBOAtoi4mkASWuBZUBxglgGXJ28XgfcIEnJ+rUR0QU8I6kteb8HM4w3VXotnuIL6OsKT98CBzyQVZocAPbs6/uNGkj9Rl56bOnyvp7g0nWbmP/GIw+ItfiinvZZrvnOZhrGVTbzbOmF/WC+7feJd4CaRcXlsItHMfXX4jKzbGSZIGYAW4uW24HF/e0TEd2SdgJTkvUPlRx7wE1rSRcBFwHMnj17yAIvVmktnoLWrTsO+ncULrzAoO+/5+pE69YdB8RafFFP+yz1uTr2VviQQOmFvdy3/T59EM0zuaOlbx/EQBd5l8M2q74R3UkdEWuANQDNzc0H+ShUZdJq8ZRTePr2YBRfeAfzjRygpzdYNOuoA2Itfu+0z9ITwVVnz+dz92ypqA+i9MJe/G2/3Cgm9wuYjTxZJohtwKyi5ZnJurR92iWNAyaR76yu5NhhMWViY59aPAP1QRQ6qleeMptbH6y8D6Jw0Uz7Rl5JH8QXli+k6egjUusGFZeGSNu+dNEMzlrwm4MaxVR43yXHTTvgG3/x/u4XMBt5FJHJF2+SC/6TwBnkL+4bgPMjYnPRPn8KHB8Rn0g6qT8QER+UtAD4Jvl+h+nAj4B55Tqpm5ubo6WlJZPPAqN7FJOZjV2SNkZEc+q2rBJE8ovfC/wt+WGut0TE5yWtBloiYr2k8cA3gLcArwArijq1rwA+DnQDn46I75f7XVknCDOz0ahqCWI4OUGYmR28cgmisvGNZmY25jhBmJlZKicIMzNL5QRhZmapnCDMzCyVE4SZmaVygjAzs1ROEGZmlsoJwszMUjlBmJlZKicIMzNL5QRhZmapnCDMzCyVE4SZmaVygjAzs1ROEGZmlsoJwszMUjlBmJlZKicIMzNLNWrmpJb0EvBcRm8/FXg5o/ceLXyOBuZzVJ7Pz8CyOEdviohpaRtGTYLIkqSW/ib1tjyfo4H5HJXn8zOw4T5HvsVkZmapnCDMzCyVE0Rl1lQ7gBHA52hgPkfl+fwMbFjPkfsgzMwslVsQZmaWygnCzMxSjfkEIeksSU9IapN0ecr2Rkm3J9sfljSnaNtnk/VPSHr3cMY9nAZ7jiTNkbRbUmvy76bhjn04VHB+lkh6RFK3pOUl2y6Q9Mvk3wXDF/XwOsRz1FP0N7R++KIeXhWco0skbZG0SdKPJL2paFs2f0cRMWb/ATngKeAYoAF4FJhfss+fADclr1cAtyev5yf7NwJzk/fJVfsz1dg5mgP8vNqfoQbOzxxgIXArsLxo/RuAp5Ofk5PXk6v9mWrpHCXbOqv9GWrkHJ0GHJa8/uOi/88y+zsa6y2Ik4C2iHg6IvYCa4FlJfssA76evF4HnCFJyfq1EdEVEc8Abcn7jTaHco7GggHPT0Q8GxGbgN6SY98N/CAiXomI7cAPgLOGI+hhdijnaKyo5BzdHxG/ThYfAmYmrzP7OxrrCWIGsLVouT1Zl7pPRHQDO4EpFR47GhzKOQKYK+lnkn4s6R1ZB1sFh/J34L+hyoyX1CLpIUnvH9rQasbBnqMLge8P8tiKjRuKNzHrx38CsyOiQ9KJwF2SFkTEq9UOzEaUN0XENknHAPdJeiwinqp2UNUi6Q+AZuCdWf+usd6C2AbMKlqemaxL3UfSOGAS0FHhsaPBoM9RcvutAyAiNvWgthoAAANRSURBVJK/x3pc5hEPr0P5O/DfUAUiYlvy82ngX4G3DGVwNaKicyTpvwNXAEsjoutgjh2MsZ4gNgDzJM2V1EC+g7V0lMR6oDAqYDlwX+R7htYDK5IRPHOBecB/DFPcw2nQ50jSNEk5gOTb3zzyHWijSSXnpz/3AmdKmixpMnBmsm60GfQ5Ss5NY/J6KnAqsCWzSKtnwHMk6S3Al8knh18Vbcru76javffV/ge8F3iS/LfbK5J1q5P/CADjgW+R74T+D+CYomOvSI57AnhPtT9LrZ0j4BxgM9AKPAKcXe3PUqXz8zby94VfI9/63Fx07MeT89YGfKzan6XWzhHwO8Bj5Ef1PAZcWO3PUsVz9EPgxeT/p1ZgfdZ/Ry61YWZmqcb6LSYzM+uHE4SZmaVygjAzs1ROEGZmlsoJwszMUjlBmNUASUsLFTwlvV/S/GrHZOZhrmYZkJSLiJ5BHvs14J6IWDe0UZkdHLcgzPqRzGfxC0m3SXpc0jpJh0k6IylA+JikW4qe9H1W0rWSHgHOlbQoKTC3SdK3k6dckfSporr+a5N1H5V0g6TfAZYCX0jmPzg2eb9CTPOKl82y5ARhVt5/A/4hIn4beBW4BPgacF5EHE++4OUfF+3fERFvjYi15Oc2uCwiFpJ/CviqZJ/Lgbck6z9R/Msi4t/Jl1i4NCIWRb4o3U5Ji5JdPgZ8NYPPaXYAJwiz8rZGxAPJ638CzgCeiYgnk3VfB5YU7X87gKRJwFER8eOU/TYBtyVVObsriOErwMeSulbnAd8c7IcxOxhOEGbllXbS7Rhg/9cqeM/fA24E3gpsSCrglnMn8B7gfcDGSCrkmmXNCcKsvNmSTklenw+0AHMkNSXrPgL8uPSgiNgJbC+aJOkjwI8l1QGzIuJ+4DLypdEnlhy+Czii6L32kK/O+X/w7SUbRk4QZuU9AfyppMfJz/d7Pfl+gG9Jeoz8FJk39XPsBeQ7mzcBi8hX5swB/5Qc+zPg7yKitFWyFrg06Qg/Nll3W/K7/t/QfTSz8jzM1awfkuaQH2765iqHgqQ/ByZFxF9UOxYbOzzlqFmNk/Rt4Fjg9GrHYmOLWxBmZpbKfRBmZpbKCcLMzFI5QZiZWSonCDMzS+UEYWZmqf4/elH8qjK0HqwAAAAASUVORK5CYII=\n", "text/plain": ["<Figure size 432x288 with 1 Axes>"]}, "metadata": {"needs_background": "light"}, "output_type": "display_data"}], "source": ["df_new.plot.scatter(x='porosity', y='permeability');"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "slide"}}, "source": ["## Writing a DataFrame to a File"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["The most common way way to store and share DataFrames among different computers is the export the DataFrame to a CSV file.  This is accomplished with the [`to_csv`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.to_csv.html) member function."]}, {"cell_type": "code", "execution_count": 37, "metadata": {}, "outputs": [], "source": ["df.to_csv(\"datasets/200wells_out.csv\", index = False)"]}, {"cell_type": "markdown", "metadata": {}, "source": ["Displaying the raw data is the file with the UNIX `head` command"]}, {"cell_type": "code", "execution_count": 38, "metadata": {}, "outputs": [{"name": "stdout", "output_type": "stream", "text": ["X,Y,facies,porosity,perm,ai,% porosity,perm-por ratio,porosity type,perm cutoff,kozeny carmen\n", "3505,1525,2,0.2232,174.65400000000002,3.344,22.32,782.5000000000001,high,174.65400000000002,0.18427403135841575\n", "2455,2885,2,0.2158,9.592,2.773,21.58,44.44856348470807,high,9.592,0.16341828373836473\n", "1975,2745,2,0.2158,361.704,3.839,21.58,1676.1075069508806,high,361.704,0.16341828373836473\n", "1855,3025,2,0.2154,463.64099999999996,3.091,21.54,2152.4651810584955,high,463.64099999999996,0.1623455875592409\n"]}], "source": ["!head -n 5 datasets/200wells_out.csv"]}, {"cell_type": "markdown", "metadata": {"slideshow": {"slide_type": "skip"}}, "source": ["## Further Reading \n", "\n", "Further reading on Pandas is avialable in the [official Pandas documentation](https://pandas.pydata.org/pandas-docs/stable/index.html)"]}, {"cell_type": "code", "execution_count": 1, "metadata": {"hide_input": true, "init_cell": true, "javascript_last_cell": true, "slideshow": {"slide_type": "skip"}, "tags": ["remove_cell"]}, "outputs": [{"data": {"application/javascript": ["function hideElements(elements, start) {\n", "for(var i = 0, length = elements.length; i < length;i++) {\n", "    if(i >= start) {\n", "        elements[i].style.display = \"none\";\n", "    }\n", "}\n", "}\n", "var prompt_elements = document.getElementsByClassName(\"prompt\");\n", "hideElements(prompt_elements, 0)\n"], "text/plain": ["<IPython.core.display.Javascript object>"]}, "metadata": {}, "output_type": "display_data"}], "source": ["%%javascript\n", "function hideElements(elements, start) {\n", "for(var i = 0, length = elements.length; i < length;i++) {\n", "    if(i >= start) {\n", "        elements[i].style.display = \"none\";\n", "    }\n", "}\n", "}\n", "var prompt_elements = document.getElementsByClassName(\"prompt\");\n", "hideElements(prompt_elements, 0)"]}], "metadata": {"celltoolbar": "Edit Metadata", "kernelspec": {"display_name": "Python 3", "language": "python", "name": "python3"}, "language_info": {"codemirror_mode": {"name": "ipython", "version": 3}, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.8.1"}, "rise": {"auto_select": null, "autolaunch": false, "controls": true, "footer": "", "progress": true, "scroll": true, "slideNumber": false, "theme": "simple"}}, "nbformat": 4, "nbformat_minor": 4}