Data.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Data"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Los objetivos de este fichero son:\n",
    "- Leer los datos proporcionados por Cajamar\n",
    "- Analizar los datos brevemente\n",
    "- Guardar los datos en formato HDF"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Los aprendizajes y resultados obtenidos de este notebook:\n",
    "- Leer datos y guardarlos en un formato mas conveniente\n",
    "- Los valores nulos representan una cantidad mínima de observaciones train set = 0.0005% y test set = 0.0097%. Estos valores se encuentran en las variables MAXBUILDINGFLOOR y CADASTRALQUALITYID, si una de ellas es nula la otra también. Ambas provienen de los datos catastrales del gobierno. Estos valores pertenecen mayoritariamente a la clase AGRICULTURA, sobre esta es la que menos observaciones tenemos, aun así el porcentaje sobre esto sigue siendo ínfimo.\n",
    "- Num. observaciones train = 103230 y test = 5618, 55 variables + Y.\n",
    "- Las clases de Y están muy desbalanceadas."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Imports"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "\n",
    "import sys; sys.path.insert(0, '..')\n",
    "import lib"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Define variables"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "raw_path = \"../../Data/raw/txt/\"\n",
    "store_path_hdf5 = \"../../Data/raw/hdf5/data.hdf5\"\n",
    "store_path_csv = \"../../Data/raw/csv/\""
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Read data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "Xy_train, X_test = lib.readRAW(raw_path)\n",
    "lib.storeCSV(X_train=Xy_train,path='../')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "ID                     object\n",
       "X                       int64\n",
       "Y                       int64\n",
       "Q_R_4_0_0             float64\n",
       "Q_R_4_0_1             float64\n",
       "Q_R_4_0_2             float64\n",
       "Q_R_4_0_3             float64\n",
       "Q_R_4_0_4             float64\n",
       "Q_R_4_0_5             float64\n",
       "Q_R_4_0_6             float64\n",
       "Q_R_4_0_7             float64\n",
       "Q_R_4_0_8             float64\n",
       "Q_R_4_0_9             float64\n",
       "Q_R_4_1_0             float64\n",
       "Q_G_3_0_0             float64\n",
       "Q_G_3_0_1             float64\n",
       "Q_G_3_0_2             float64\n",
       "Q_G_3_0_3             float64\n",
       "Q_G_3_0_4             float64\n",
       "Q_G_3_0_5             float64\n",
       "Q_G_3_0_6             float64\n",
       "Q_G_3_0_7             float64\n",
       "Q_G_3_0_8             float64\n",
       "Q_G_3_0_9             float64\n",
       "Q_G_3_1_0             float64\n",
       "Q_B_2_0_0             float64\n",
       "Q_B_2_0_1             float64\n",
       "Q_B_2_0_2             float64\n",
       "Q_B_2_0_3             float64\n",
       "Q_B_2_0_4             float64\n",
       "Q_B_2_0_5             float64\n",
       "Q_B_2_0_6             float64\n",
       "Q_B_2_0_7             float64\n",
       "Q_B_2_0_8             float64\n",
       "Q_B_2_0_9             float64\n",
       "Q_B_2_1_0             float64\n",
       "Q_NIR_8_0_0           float64\n",
       "Q_NIR_8_0_1           float64\n",
       "Q_NIR_8_0_2           float64\n",
       "Q_NIR_8_0_3           float64\n",
       "Q_NIR_8_0_4           float64\n",
       "Q_NIR_8_0_5           float64\n",
       "Q_NIR_8_0_6           float64\n",
       "Q_NIR_8_0_7           float64\n",
       "Q_NIR_8_0_8           float64\n",
       "Q_NIR_8_0_9           float64\n",
       "Q_NIR_8_1_0           float64\n",
       "AREA                  float64\n",
       "GEOM_R1               float64\n",
       "GEOM_R2               float64\n",
       "GEOM_R3               float64\n",
       "GEOM_R4               float64\n",
       "CONTRUCTIONYEAR         int64\n",
       "MAXBUILDINGFLOOR      float64\n",
       "CADASTRALQUALITYID     object\n",
       "CLASE                  object\n",
       "dtype: object"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Xy_train.dtypes"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "ID                    category\n",
       "X                        int64\n",
       "Y                        int64\n",
       "Q_R_4_0_0              float64\n",
       "Q_R_4_0_1              float64\n",
       "Q_R_4_0_2              float64\n",
       "Q_R_4_0_3              float64\n",
       "Q_R_4_0_4              float64\n",
       "Q_R_4_0_5              float64\n",
       "Q_R_4_0_6              float64\n",
       "Q_R_4_0_7              float64\n",
       "Q_R_4_0_8              float64\n",
       "Q_R_4_0_9              float64\n",
       "Q_R_4_1_0              float64\n",
       "Q_G_3_0_0              float64\n",
       "Q_G_3_0_1              float64\n",
       "Q_G_3_0_2              float64\n",
       "Q_G_3_0_3              float64\n",
       "Q_G_3_0_4              float64\n",
       "Q_G_3_0_5              float64\n",
       "Q_G_3_0_6              float64\n",
       "Q_G_3_0_7              float64\n",
       "Q_G_3_0_8              float64\n",
       "Q_G_3_0_9              float64\n",
       "Q_G_3_1_0              float64\n",
       "Q_B_2_0_0              float64\n",
       "Q_B_2_0_1              float64\n",
       "Q_B_2_0_2              float64\n",
       "Q_B_2_0_3              float64\n",
       "Q_B_2_0_4              float64\n",
       "Q_B_2_0_5              float64\n",
       "Q_B_2_0_6              float64\n",
       "Q_B_2_0_7              float64\n",
       "Q_B_2_0_8              float64\n",
       "Q_B_2_0_9              float64\n",
       "Q_B_2_1_0              float64\n",
       "Q_NIR_8_0_0            float64\n",
       "Q_NIR_8_0_1            float64\n",
       "Q_NIR_8_0_2            float64\n",
       "Q_NIR_8_0_3            float64\n",
       "Q_NIR_8_0_4            float64\n",
       "Q_NIR_8_0_5            float64\n",
       "Q_NIR_8_0_6            float64\n",
       "Q_NIR_8_0_7            float64\n",
       "Q_NIR_8_0_8            float64\n",
       "Q_NIR_8_0_9            float64\n",
       "Q_NIR_8_1_0            float64\n",
       "AREA                   float64\n",
       "GEOM_R1                float64\n",
       "GEOM_R2                float64\n",
       "GEOM_R3                float64\n",
       "GEOM_R4                float64\n",
       "CONTRUCTIONYEAR          int64\n",
       "MAXBUILDINGFLOOR       float64\n",
       "CADASTRALQUALITYID    category\n",
       "CLASE                 category\n",
       "dtype: object"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#Convertimos a variables categoricas\n",
    "Xy_train['CLASE'] = pd.Categorical(Xy_train.CLASE)\n",
    "Xy_train['CADASTRALQUALITYID'] = pd.Categorical(Xy_train.CADASTRALQUALITYID)\n",
    "\"\"\"\n",
    "En esta variable existe una relación entre las distintas clases, no se cual (lineal, exp...)ya que esta información\n",
    "no se expresa en la faq de los datos del catastro, pero voy a contactar para preguntar.\n",
    "Punto 17: http://www.catastro.minhap.es/documentos/preguntas_frecuentes_formato_CAT.pdf\n",
    "\"\"\"\n",
    "Xy_train['ID'] = pd.Categorical(Xy_train.ID)\n",
    "#En principio ID no se usará pero la quiero estudiar por posible data leakage\n",
    "Xy_train.dtypes"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "y_train = Xy_train['CLASE']\n",
    "X_train = Xy_train.drop(columns='CLASE',inplace=False)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Analyze data"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Train data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "X INPUT\n",
      "Número de observaciones =  103230\n",
      "Número de variables =  55\n",
      "Count total Nulls =  40\n",
      "% Observaciones con Nulls = \n",
      " 0.0005327908553715005\n",
      "Count Nulls by columns = \n",
      " ID                     0\n",
      "X                      0\n",
      "Y                      0\n",
      "Q_R_4_0_0              0\n",
      "Q_R_4_0_1              0\n",
      "Q_R_4_0_2              0\n",
      "Q_R_4_0_3              0\n",
      "Q_R_4_0_4              0\n",
      "Q_R_4_0_5              0\n",
      "Q_R_4_0_6              0\n",
      "Q_R_4_0_7              0\n",
      "Q_R_4_0_8              0\n",
      "Q_R_4_0_9              0\n",
      "Q_R_4_1_0              0\n",
      "Q_G_3_0_0              0\n",
      "Q_G_3_0_1              0\n",
      "Q_G_3_0_2              0\n",
      "Q_G_3_0_3              0\n",
      "Q_G_3_0_4              0\n",
      "Q_G_3_0_5              0\n",
      "Q_G_3_0_6              0\n",
      "Q_G_3_0_7              0\n",
      "Q_G_3_0_8              0\n",
      "Q_G_3_0_9              0\n",
      "Q_G_3_1_0              0\n",
      "Q_B_2_0_0              0\n",
      "Q_B_2_0_1              0\n",
      "Q_B_2_0_2              0\n",
      "Q_B_2_0_3              0\n",
      "Q_B_2_0_4              0\n",
      "Q_B_2_0_5              0\n",
      "Q_B_2_0_6              0\n",
      "Q_B_2_0_7              0\n",
      "Q_B_2_0_8              0\n",
      "Q_B_2_0_9              0\n",
      "Q_B_2_1_0              0\n",
      "Q_NIR_8_0_0            0\n",
      "Q_NIR_8_0_1            0\n",
      "Q_NIR_8_0_2            0\n",
      "Q_NIR_8_0_3            0\n",
      "Q_NIR_8_0_4            0\n",
      "Q_NIR_8_0_5            0\n",
      "Q_NIR_8_0_6            0\n",
      "Q_NIR_8_0_7            0\n",
      "Q_NIR_8_0_8            0\n",
      "Q_NIR_8_0_9            0\n",
      "Q_NIR_8_1_0            0\n",
      "AREA                   0\n",
      "GEOM_R1                0\n",
      "GEOM_R2                0\n",
      "GEOM_R3                0\n",
      "GEOM_R4                0\n",
      "CONTRUCTIONYEAR        0\n",
      "MAXBUILDINGFLOOR      20\n",
      "CADASTRALQUALITYID    20\n",
      "dtype: int64\n"
     ]
    }
   ],
   "source": [
    "print('X INPUT')\n",
    "print('Número de observaciones = ', X_train.shape[0])\n",
    "print('Número de variables = ', X_train.shape[1])\n",
    "print('Count total Nulls = ',X_train.isnull().sum().sum())\n",
    "print('% Observaciones con Nulls = \\n', sum(map(any, X_train.isnull()))/X_train.shape[0])\n",
    "print('Count Nulls by columns = \\n',X_train.isnull().sum())"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Solo las variables MAXBUILDINGFLOOR y CADASTRALQUALITYID contienen valores nulos."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "Y OUTPUT\n",
      "Count Nulls =  0\n",
      "VALORES Y:\n",
      " RESIDENTIAL    90173\n",
      "INDUSTRIAL      4490\n",
      "PUBLIC          2976\n",
      "RETAIL          2093\n",
      "OFFICE          1828\n",
      "OTHER           1332\n",
      "AGRICULTURE      338\n",
      "Name: CLASE, dtype: int64 \n",
      " RESIDENTIAL    0.873515\n",
      "INDUSTRIAL     0.043495\n",
      "PUBLIC         0.028829\n",
      "RETAIL         0.020275\n",
      "OFFICE         0.017708\n",
      "OTHER          0.012903\n",
      "AGRICULTURE    0.003274\n",
      "Name: CLASE, dtype: float64\n"
     ]
    }
   ],
   "source": [
    "# Output variable\n",
    "print('\\nY OUTPUT')\n",
    "print('Count Nulls = ',y_train.isnull().sum().sum())\n",
    "y_classes = y_train.value_counts()\n",
    "y_classes_rev = y_classes/y_train.shape[0]\n",
    "print('VALORES Y:\\n',y_classes,'\\n', y_classes_rev)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Las clases de salida están muy desbalanceadas"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "      <th>2</th>\n",
       "      <th>3</th>\n",
       "      <th>4</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>ID</th>\n",
       "      <td>35984B9C3E7CD9A1</td>\n",
       "      <td>F9D04BF6D037F8FB</td>\n",
       "      <td>B89D5711AFF8C423</td>\n",
       "      <td>1C3478AC1522E7E4</td>\n",
       "      <td>4D12AA5009064345</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>X</th>\n",
       "      <td>2207357872</td>\n",
       "      <td>2189757160</td>\n",
       "      <td>2240147335</td>\n",
       "      <td>2227146459</td>\n",
       "      <td>2212350459</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y</th>\n",
       "      <td>165920300</td>\n",
       "      <td>165463267</td>\n",
       "      <td>165690752</td>\n",
       "      <td>165934099</td>\n",
       "      <td>165681791</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_R_4_0_0</th>\n",
       "      <td>0</td>\n",
       "      <td>5.87961e-05</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_R_4_0_1</th>\n",
       "      <td>443.001</td>\n",
       "      <td>443.899</td>\n",
       "      <td>353.502</td>\n",
       "      <td>268.001</td>\n",
       "      <td>318.998</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_R_4_0_2</th>\n",
       "      <td>616.002</td>\n",
       "      <td>627.999</td>\n",
       "      <td>523.004</td>\n",
       "      <td>377</td>\n",
       "      <td>492.004</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_R_4_0_3</th>\n",
       "      <td>746.998</td>\n",
       "      <td>770.002</td>\n",
       "      <td>644.002</td>\n",
       "      <td>478.004</td>\n",
       "      <td>633</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_R_4_0_4</th>\n",
       "      <td>872.996</td>\n",
       "      <td>905</td>\n",
       "      <td>760.997</td>\n",
       "      <td>575.001</td>\n",
       "      <td>757.002</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_R_4_0_5</th>\n",
       "      <td>1009</td>\n",
       "      <td>1033</td>\n",
       "      <td>877</td>\n",
       "      <td>683.998</td>\n",
       "      <td>883</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_R_4_0_6</th>\n",
       "      <td>1159</td>\n",
       "      <td>1165</td>\n",
       "      <td>1007</td>\n",
       "      <td>809.006</td>\n",
       "      <td>1019.01</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_R_4_0_7</th>\n",
       "      <td>1342</td>\n",
       "      <td>1316</td>\n",
       "      <td>1169</td>\n",
       "      <td>955.003</td>\n",
       "      <td>1175.99</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_R_4_0_8</th>\n",
       "      <td>1572</td>\n",
       "      <td>1505.99</td>\n",
       "      <td>1375.01</td>\n",
       "      <td>1137</td>\n",
       "      <td>1401</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_R_4_0_9</th>\n",
       "      <td>1943.69</td>\n",
       "      <td>1804.99</td>\n",
       "      <td>1719</td>\n",
       "      <td>1448</td>\n",
       "      <td>1756.99</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_R_4_1_0</th>\n",
       "      <td>6512.79</td>\n",
       "      <td>6269.94</td>\n",
       "      <td>5010.77</td>\n",
       "      <td>5465.43</td>\n",
       "      <td>7376.53</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_G_3_0_0</th>\n",
       "      <td>1.28336e-10</td>\n",
       "      <td>1.35252e-11</td>\n",
       "      <td>0</td>\n",
       "      <td>6.34159e-06</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_G_3_0_1</th>\n",
       "      <td>428.996</td>\n",
       "      <td>433.998</td>\n",
       "      <td>379.002</td>\n",
       "      <td>310.999</td>\n",
       "      <td>284.001</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_G_3_0_2</th>\n",
       "      <td>574.001</td>\n",
       "      <td>565</td>\n",
       "      <td>507.004</td>\n",
       "      <td>405.999</td>\n",
       "      <td>421.002</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_G_3_0_3</th>\n",
       "      <td>676.003</td>\n",
       "      <td>662.997</td>\n",
       "      <td>600.001</td>\n",
       "      <td>485.001</td>\n",
       "      <td>526.004</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_G_3_0_4</th>\n",
       "      <td>778.004</td>\n",
       "      <td>746.001</td>\n",
       "      <td>684</td>\n",
       "      <td>558.998</td>\n",
       "      <td>618.999</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_G_3_0_5</th>\n",
       "      <td>880.999</td>\n",
       "      <td>828.998</td>\n",
       "      <td>768.998</td>\n",
       "      <td>641.001</td>\n",
       "      <td>705.999</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_G_3_0_6</th>\n",
       "      <td>997</td>\n",
       "      <td>912</td>\n",
       "      <td>867.002</td>\n",
       "      <td>731.994</td>\n",
       "      <td>801.005</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_G_3_0_7</th>\n",
       "      <td>1130</td>\n",
       "      <td>1012</td>\n",
       "      <td>992.992</td>\n",
       "      <td>838.004</td>\n",
       "      <td>912.999</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_G_3_0_8</th>\n",
       "      <td>1312</td>\n",
       "      <td>1142.2</td>\n",
       "      <td>1166</td>\n",
       "      <td>974.797</td>\n",
       "      <td>1070</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_G_3_0_9</th>\n",
       "      <td>1627</td>\n",
       "      <td>1384.99</td>\n",
       "      <td>1443</td>\n",
       "      <td>1218</td>\n",
       "      <td>1348.5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_G_3_1_0</th>\n",
       "      <td>8627.1</td>\n",
       "      <td>5357.79</td>\n",
       "      <td>5240.23</td>\n",
       "      <td>5343.17</td>\n",
       "      <td>7460.39</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_B_2_0_0</th>\n",
       "      <td>155.004</td>\n",
       "      <td>120</td>\n",
       "      <td>83.0004</td>\n",
       "      <td>0.00144985</td>\n",
       "      <td>193.001</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_B_2_0_1</th>\n",
       "      <td>402</td>\n",
       "      <td>419</td>\n",
       "      <td>363</td>\n",
       "      <td>256.999</td>\n",
       "      <td>431.505</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_B_2_0_2</th>\n",
       "      <td>459</td>\n",
       "      <td>473</td>\n",
       "      <td>429.003</td>\n",
       "      <td>296</td>\n",
       "      <td>463</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_B_2_0_3</th>\n",
       "      <td>510</td>\n",
       "      <td>510</td>\n",
       "      <td>473</td>\n",
       "      <td>329</td>\n",
       "      <td>492</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_B_2_0_4</th>\n",
       "      <td>568</td>\n",
       "      <td>542</td>\n",
       "      <td>510</td>\n",
       "      <td>366</td>\n",
       "      <td>519</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_B_2_0_5</th>\n",
       "      <td>632.001</td>\n",
       "      <td>572</td>\n",
       "      <td>549</td>\n",
       "      <td>411.001</td>\n",
       "      <td>547</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_B_2_0_6</th>\n",
       "      <td>681.001</td>\n",
       "      <td>603</td>\n",
       "      <td>591</td>\n",
       "      <td>457</td>\n",
       "      <td>579</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_B_2_0_7</th>\n",
       "      <td>726.109</td>\n",
       "      <td>636</td>\n",
       "      <td>636</td>\n",
       "      <td>506</td>\n",
       "      <td>618</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_B_2_0_8</th>\n",
       "      <td>791</td>\n",
       "      <td>673</td>\n",
       "      <td>693</td>\n",
       "      <td>566</td>\n",
       "      <td>663</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_B_2_0_9</th>\n",
       "      <td>903</td>\n",
       "      <td>745</td>\n",
       "      <td>796.499</td>\n",
       "      <td>664</td>\n",
       "      <td>750</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_B_2_1_0</th>\n",
       "      <td>1980.17</td>\n",
       "      <td>3647.2</td>\n",
       "      <td>1947.74</td>\n",
       "      <td>1424.4</td>\n",
       "      <td>1940.4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_NIR_8_0_0</th>\n",
       "      <td>1.34289e-05</td>\n",
       "      <td>2.96746e-05</td>\n",
       "      <td>5.15823e-06</td>\n",
       "      <td>0.00228463</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_NIR_8_0_1</th>\n",
       "      <td>892.016</td>\n",
       "      <td>846.003</td>\n",
       "      <td>807.001</td>\n",
       "      <td>1200.99</td>\n",
       "      <td>529.004</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_NIR_8_0_2</th>\n",
       "      <td>1244.01</td>\n",
       "      <td>1139.01</td>\n",
       "      <td>1124</td>\n",
       "      <td>1476</td>\n",
       "      <td>790.997</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_NIR_8_0_3</th>\n",
       "      <td>1498</td>\n",
       "      <td>1363.99</td>\n",
       "      <td>1365.01</td>\n",
       "      <td>1678.01</td>\n",
       "      <td>999.002</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_NIR_8_0_4</th>\n",
       "      <td>1731.2</td>\n",
       "      <td>1558</td>\n",
       "      <td>1571</td>\n",
       "      <td>1848</td>\n",
       "      <td>1184</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_NIR_8_0_5</th>\n",
       "      <td>1944</td>\n",
       "      <td>1749.99</td>\n",
       "      <td>1768.99</td>\n",
       "      <td>2022.99</td>\n",
       "      <td>1355.99</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_NIR_8_0_6</th>\n",
       "      <td>2161</td>\n",
       "      <td>1956</td>\n",
       "      <td>1978.99</td>\n",
       "      <td>2211.99</td>\n",
       "      <td>1536</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_NIR_8_0_7</th>\n",
       "      <td>2411</td>\n",
       "      <td>2194</td>\n",
       "      <td>2229</td>\n",
       "      <td>2433</td>\n",
       "      <td>1725.5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_NIR_8_0_8</th>\n",
       "      <td>2720</td>\n",
       "      <td>2507</td>\n",
       "      <td>2562</td>\n",
       "      <td>2741</td>\n",
       "      <td>1954.99</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_NIR_8_0_9</th>\n",
       "      <td>3180</td>\n",
       "      <td>3012.99</td>\n",
       "      <td>3088</td>\n",
       "      <td>3349.99</td>\n",
       "      <td>2315.99</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Q_NIR_8_1_0</th>\n",
       "      <td>10951.9</td>\n",
       "      <td>7048.37</td>\n",
       "      <td>7013.07</td>\n",
       "      <td>6216.88</td>\n",
       "      <td>7092.77</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>AREA</th>\n",
       "      <td>144.427</td>\n",
       "      <td>38.3425</td>\n",
       "      <td>108.794</td>\n",
       "      <td>155.224</td>\n",
       "      <td>1789.87</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GEOM_R1</th>\n",
       "      <td>0.557237</td>\n",
       "      <td>0.709884</td>\n",
       "      <td>0.517702</td>\n",
       "      <td>0.450871</td>\n",
       "      <td>0.458819</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GEOM_R2</th>\n",
       "      <td>0.0672495</td>\n",
       "      <td>0.125156</td>\n",
       "      <td>0.0582683</td>\n",
       "      <td>0.0535906</td>\n",
       "      <td>0.0128581</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GEOM_R3</th>\n",
       "      <td>0.0573723</td>\n",
       "      <td>0.147929</td>\n",
       "      <td>0.081666</td>\n",
       "      <td>0.0542005</td>\n",
       "      <td>0.0199362</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GEOM_R4</th>\n",
       "      <td>0.853127</td>\n",
       "      <td>1.18195</td>\n",
       "      <td>1.40155</td>\n",
       "      <td>1.01138</td>\n",
       "      <td>1.55048</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>CONTRUCTIONYEAR</th>\n",
       "      <td>2002</td>\n",
       "      <td>1949</td>\n",
       "      <td>1986</td>\n",
       "      <td>1999</td>\n",
       "      <td>1966</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>MAXBUILDINGFLOOR</th>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>CADASTRALQUALITYID</th>\n",
       "      <td>2</td>\n",
       "      <td>8</td>\n",
       "      <td>5</td>\n",
       "      <td>2</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>CLASE</th>\n",
       "      <td>RESIDENTIAL</td>\n",
       "      <td>RESIDENTIAL</td>\n",
       "      <td>RESIDENTIAL</td>\n",
       "      <td>RESIDENTIAL</td>\n",
       "      <td>RESIDENTIAL</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                   0                 1                 2  \\\n",
       "ID                  35984B9C3E7CD9A1  F9D04BF6D037F8FB  B89D5711AFF8C423   \n",
       "X                         2207357872        2189757160        2240147335   \n",
       "Y                          165920300         165463267         165690752   \n",
       "Q_R_4_0_0                          0       5.87961e-05                 0   \n",
       "Q_R_4_0_1                    443.001           443.899           353.502   \n",
       "Q_R_4_0_2                    616.002           627.999           523.004   \n",
       "Q_R_4_0_3                    746.998           770.002           644.002   \n",
       "Q_R_4_0_4                    872.996               905           760.997   \n",
       "Q_R_4_0_5                       1009              1033               877   \n",
       "Q_R_4_0_6                       1159              1165              1007   \n",
       "Q_R_4_0_7                       1342              1316              1169   \n",
       "Q_R_4_0_8                       1572           1505.99           1375.01   \n",
       "Q_R_4_0_9                    1943.69           1804.99              1719   \n",
       "Q_R_4_1_0                    6512.79           6269.94           5010.77   \n",
       "Q_G_3_0_0                1.28336e-10       1.35252e-11                 0   \n",
       "Q_G_3_0_1                    428.996           433.998           379.002   \n",
       "Q_G_3_0_2                    574.001               565           507.004   \n",
       "Q_G_3_0_3                    676.003           662.997           600.001   \n",
       "Q_G_3_0_4                    778.004           746.001               684   \n",
       "Q_G_3_0_5                    880.999           828.998           768.998   \n",
       "Q_G_3_0_6                        997               912           867.002   \n",
       "Q_G_3_0_7                       1130              1012           992.992   \n",
       "Q_G_3_0_8                       1312            1142.2              1166   \n",
       "Q_G_3_0_9                       1627           1384.99              1443   \n",
       "Q_G_3_1_0                     8627.1           5357.79           5240.23   \n",
       "Q_B_2_0_0                    155.004               120           83.0004   \n",
       "Q_B_2_0_1                        402               419               363   \n",
       "Q_B_2_0_2                        459               473           429.003   \n",
       "Q_B_2_0_3                        510               510               473   \n",
       "Q_B_2_0_4                        568               542               510   \n",
       "Q_B_2_0_5                    632.001               572               549   \n",
       "Q_B_2_0_6                    681.001               603               591   \n",
       "Q_B_2_0_7                    726.109               636               636   \n",
       "Q_B_2_0_8                        791               673               693   \n",
       "Q_B_2_0_9                        903               745           796.499   \n",
       "Q_B_2_1_0                    1980.17            3647.2           1947.74   \n",
       "Q_NIR_8_0_0              1.34289e-05       2.96746e-05       5.15823e-06   \n",
       "Q_NIR_8_0_1                  892.016           846.003           807.001   \n",
       "Q_NIR_8_0_2                  1244.01           1139.01              1124   \n",
       "Q_NIR_8_0_3                     1498           1363.99           1365.01   \n",
       "Q_NIR_8_0_4                   1731.2              1558              1571   \n",
       "Q_NIR_8_0_5                     1944           1749.99           1768.99   \n",
       "Q_NIR_8_0_6                     2161              1956           1978.99   \n",
       "Q_NIR_8_0_7                     2411              2194              2229   \n",
       "Q_NIR_8_0_8                     2720              2507              2562   \n",
       "Q_NIR_8_0_9                     3180           3012.99              3088   \n",
       "Q_NIR_8_1_0                  10951.9           7048.37           7013.07   \n",
       "AREA                         144.427           38.3425           108.794   \n",
       "GEOM_R1                     0.557237          0.709884          0.517702   \n",
       "GEOM_R2                    0.0672495          0.125156         0.0582683   \n",
       "GEOM_R3                    0.0573723          0.147929          0.081666   \n",
       "GEOM_R4                     0.853127           1.18195           1.40155   \n",
       "CONTRUCTIONYEAR                 2002              1949              1986   \n",
       "MAXBUILDINGFLOOR                   0                 1                 1   \n",
       "CADASTRALQUALITYID                 2                 8                 5   \n",
       "CLASE                    RESIDENTIAL       RESIDENTIAL       RESIDENTIAL   \n",
       "\n",
       "                                   3                 4  \n",
       "ID                  1C3478AC1522E7E4  4D12AA5009064345  \n",
       "X                         2227146459        2212350459  \n",
       "Y                          165934099         165681791  \n",
       "Q_R_4_0_0                          0                 0  \n",
       "Q_R_4_0_1                    268.001           318.998  \n",
       "Q_R_4_0_2                        377           492.004  \n",
       "Q_R_4_0_3                    478.004               633  \n",
       "Q_R_4_0_4                    575.001           757.002  \n",
       "Q_R_4_0_5                    683.998               883  \n",
       "Q_R_4_0_6                    809.006           1019.01  \n",
       "Q_R_4_0_7                    955.003           1175.99  \n",
       "Q_R_4_0_8                       1137              1401  \n",
       "Q_R_4_0_9                       1448           1756.99  \n",
       "Q_R_4_1_0                    5465.43           7376.53  \n",
       "Q_G_3_0_0                6.34159e-06                 0  \n",
       "Q_G_3_0_1                    310.999           284.001  \n",
       "Q_G_3_0_2                    405.999           421.002  \n",
       "Q_G_3_0_3                    485.001           526.004  \n",
       "Q_G_3_0_4                    558.998           618.999  \n",
       "Q_G_3_0_5                    641.001           705.999  \n",
       "Q_G_3_0_6                    731.994           801.005  \n",
       "Q_G_3_0_7                    838.004           912.999  \n",
       "Q_G_3_0_8                    974.797              1070  \n",
       "Q_G_3_0_9                       1218            1348.5  \n",
       "Q_G_3_1_0                    5343.17           7460.39  \n",
       "Q_B_2_0_0                 0.00144985           193.001  \n",
       "Q_B_2_0_1                    256.999           431.505  \n",
       "Q_B_2_0_2                        296               463  \n",
       "Q_B_2_0_3                        329               492  \n",
       "Q_B_2_0_4                        366               519  \n",
       "Q_B_2_0_5                    411.001               547  \n",
       "Q_B_2_0_6                        457               579  \n",
       "Q_B_2_0_7                        506               618  \n",
       "Q_B_2_0_8                        566               663  \n",
       "Q_B_2_0_9                        664               750  \n",
       "Q_B_2_1_0                     1424.4            1940.4  \n",
       "Q_NIR_8_0_0               0.00228463                 0  \n",
       "Q_NIR_8_0_1                  1200.99           529.004  \n",
       "Q_NIR_8_0_2                     1476           790.997  \n",
       "Q_NIR_8_0_3                  1678.01           999.002  \n",
       "Q_NIR_8_0_4                     1848              1184  \n",
       "Q_NIR_8_0_5                  2022.99           1355.99  \n",
       "Q_NIR_8_0_6                  2211.99              1536  \n",
       "Q_NIR_8_0_7                     2433            1725.5  \n",
       "Q_NIR_8_0_8                     2741           1954.99  \n",
       "Q_NIR_8_0_9                  3349.99           2315.99  \n",
       "Q_NIR_8_1_0                  6216.88           7092.77  \n",
       "AREA                         155.224           1789.87  \n",
       "GEOM_R1                     0.450871          0.458819  \n",
       "GEOM_R2                    0.0535906         0.0128581  \n",
       "GEOM_R3                    0.0542005         0.0199362  \n",
       "GEOM_R4                      1.01138           1.55048  \n",
       "CONTRUCTIONYEAR                 1999              1966  \n",
       "MAXBUILDINGFLOOR                   1                 8  \n",
       "CADASTRALQUALITYID                 2                 6  \n",
       "CLASE                    RESIDENTIAL       RESIDENTIAL  "
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Xy_train.head().T"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>X</th>\n",
       "      <th>Y</th>\n",
       "      <th>Q_R_4_0_0</th>\n",
       "      <th>Q_R_4_0_1</th>\n",
       "      <th>Q_R_4_0_2</th>\n",
       "      <th>Q_R_4_0_3</th>\n",
       "      <th>Q_R_4_0_4</th>\n",
       "      <th>Q_R_4_0_5</th>\n",
       "      <th>Q_R_4_0_6</th>\n",
       "      <th>...</th>\n",
       "      <th>Q_NIR_8_1_0</th>\n",
       "      <th>AREA</th>\n",
       "      <th>GEOM_R1</th>\n",
       "      <th>GEOM_R2</th>\n",
       "      <th>GEOM_R3</th>\n",
       "      <th>GEOM_R4</th>\n",
       "      <th>CONTRUCTIONYEAR</th>\n",
       "      <th>MAXBUILDINGFLOOR</th>\n",
       "      <th>CADASTRALQUALITYID</th>\n",
       "      <th>CLASE</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>9864</th>\n",
       "      <td>B7DE3FE20084F9FA</td>\n",
       "      <td>2254413625</td>\n",
       "      <td>165244276</td>\n",
       "      <td>0.000597</td>\n",
       "      <td>592.998193</td>\n",
       "      <td>742.001184</td>\n",
       "      <td>855.996881</td>\n",
       "      <td>976.798755</td>\n",
       "      <td>1106.998474</td>\n",
       "      <td>1238.995532</td>\n",
       "      <td>...</td>\n",
       "      <td>6763.517046</td>\n",
       "      <td>2120.276750</td>\n",
       "      <td>0.465508</td>\n",
       "      <td>0.015959</td>\n",
       "      <td>0.013757</td>\n",
       "      <td>0.862017</td>\n",
       "      <td>1975</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>INDUSTRIAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10145</th>\n",
       "      <td>5D08956CDC0B7C37</td>\n",
       "      <td>2250193143</td>\n",
       "      <td>165232359</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>648.000018</td>\n",
       "      <td>788.999866</td>\n",
       "      <td>894.999255</td>\n",
       "      <td>987.001318</td>\n",
       "      <td>1079.999817</td>\n",
       "      <td>1184.999121</td>\n",
       "      <td>...</td>\n",
       "      <td>6084.405066</td>\n",
       "      <td>1999.778850</td>\n",
       "      <td>0.531552</td>\n",
       "      <td>0.016810</td>\n",
       "      <td>0.015813</td>\n",
       "      <td>0.940702</td>\n",
       "      <td>1975</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>AGRICULTURE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12273</th>\n",
       "      <td>20D3200047F4D73A</td>\n",
       "      <td>2254610358</td>\n",
       "      <td>165241603</td>\n",
       "      <td>0.000597</td>\n",
       "      <td>592.998193</td>\n",
       "      <td>742.001184</td>\n",
       "      <td>855.996881</td>\n",
       "      <td>976.798755</td>\n",
       "      <td>1106.998474</td>\n",
       "      <td>1238.995532</td>\n",
       "      <td>...</td>\n",
       "      <td>6763.517046</td>\n",
       "      <td>723.268350</td>\n",
       "      <td>0.563042</td>\n",
       "      <td>0.036284</td>\n",
       "      <td>0.021455</td>\n",
       "      <td>0.591289</td>\n",
       "      <td>1975</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>AGRICULTURE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13089</th>\n",
       "      <td>82489ECC7BDFB0B0</td>\n",
       "      <td>2250087048</td>\n",
       "      <td>165252257</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>648.000018</td>\n",
       "      <td>788.999866</td>\n",
       "      <td>894.999255</td>\n",
       "      <td>987.001318</td>\n",
       "      <td>1079.999817</td>\n",
       "      <td>1184.999121</td>\n",
       "      <td>...</td>\n",
       "      <td>6084.405066</td>\n",
       "      <td>1829.160728</td>\n",
       "      <td>0.153173</td>\n",
       "      <td>0.009619</td>\n",
       "      <td>0.008705</td>\n",
       "      <td>0.905010</td>\n",
       "      <td>1975</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>RETAIL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16330</th>\n",
       "      <td>6447D96932B64C3F</td>\n",
       "      <td>2250800402</td>\n",
       "      <td>165234583</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>648.000018</td>\n",
       "      <td>788.999866</td>\n",
       "      <td>894.999255</td>\n",
       "      <td>987.001318</td>\n",
       "      <td>1079.999817</td>\n",
       "      <td>1184.999121</td>\n",
       "      <td>...</td>\n",
       "      <td>6084.405066</td>\n",
       "      <td>249.497550</td>\n",
       "      <td>0.361907</td>\n",
       "      <td>0.040209</td>\n",
       "      <td>0.036075</td>\n",
       "      <td>0.897186</td>\n",
       "      <td>1975</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>AGRICULTURE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23184</th>\n",
       "      <td>8BF6E2CB5B152739</td>\n",
       "      <td>2248534716</td>\n",
       "      <td>165225185</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>648.000018</td>\n",
       "      <td>788.999866</td>\n",
       "      <td>894.999255</td>\n",
       "      <td>987.001318</td>\n",
       "      <td>1079.999817</td>\n",
       "      <td>1184.999121</td>\n",
       "      <td>...</td>\n",
       "      <td>6084.405066</td>\n",
       "      <td>159.968400</td>\n",
       "      <td>0.294582</td>\n",
       "      <td>0.042373</td>\n",
       "      <td>0.043459</td>\n",
       "      <td>1.025641</td>\n",
       "      <td>1975</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>AGRICULTURE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>34988</th>\n",
       "      <td>621448B2B12E3B3E</td>\n",
       "      <td>2233865202</td>\n",
       "      <td>165097257</td>\n",
       "      <td>0.000009</td>\n",
       "      <td>609.998492</td>\n",
       "      <td>778.999695</td>\n",
       "      <td>889.001544</td>\n",
       "      <td>976.000098</td>\n",
       "      <td>1068.000366</td>\n",
       "      <td>1169.998853</td>\n",
       "      <td>...</td>\n",
       "      <td>5208.317414</td>\n",
       "      <td>710.658165</td>\n",
       "      <td>0.115690</td>\n",
       "      <td>0.014473</td>\n",
       "      <td>0.011248</td>\n",
       "      <td>0.777191</td>\n",
       "      <td>1950</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>AGRICULTURE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>38537</th>\n",
       "      <td>042ABAFAE9B5BDB9</td>\n",
       "      <td>2246045656</td>\n",
       "      <td>165214428</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>648.000018</td>\n",
       "      <td>788.999866</td>\n",
       "      <td>894.999255</td>\n",
       "      <td>987.001318</td>\n",
       "      <td>1079.999817</td>\n",
       "      <td>1184.999121</td>\n",
       "      <td>...</td>\n",
       "      <td>6084.405066</td>\n",
       "      <td>4112.808185</td>\n",
       "      <td>0.028464</td>\n",
       "      <td>0.003521</td>\n",
       "      <td>0.001966</td>\n",
       "      <td>0.558325</td>\n",
       "      <td>1966</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>INDUSTRIAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>43448</th>\n",
       "      <td>55B7201B5219C83B</td>\n",
       "      <td>2260254994</td>\n",
       "      <td>165132637</td>\n",
       "      <td>0.000004</td>\n",
       "      <td>437.000958</td>\n",
       "      <td>597.003247</td>\n",
       "      <td>711.998651</td>\n",
       "      <td>806.999329</td>\n",
       "      <td>910.999084</td>\n",
       "      <td>1039.000195</td>\n",
       "      <td>...</td>\n",
       "      <td>5922.090811</td>\n",
       "      <td>47.266733</td>\n",
       "      <td>0.043968</td>\n",
       "      <td>0.031348</td>\n",
       "      <td>0.029674</td>\n",
       "      <td>0.946588</td>\n",
       "      <td>1982</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>AGRICULTURE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>48059</th>\n",
       "      <td>51DCB5C9945A826E</td>\n",
       "      <td>2239496952</td>\n",
       "      <td>165148413</td>\n",
       "      <td>0.000006</td>\n",
       "      <td>493.999994</td>\n",
       "      <td>610.000061</td>\n",
       "      <td>687.999243</td>\n",
       "      <td>754.999768</td>\n",
       "      <td>824.999542</td>\n",
       "      <td>912.000513</td>\n",
       "      <td>...</td>\n",
       "      <td>5270.232234</td>\n",
       "      <td>88.353700</td>\n",
       "      <td>0.469356</td>\n",
       "      <td>0.068634</td>\n",
       "      <td>0.077399</td>\n",
       "      <td>1.127709</td>\n",
       "      <td>1957</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>AGRICULTURE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55054</th>\n",
       "      <td>D9A6B8B330C11143</td>\n",
       "      <td>2253924221</td>\n",
       "      <td>165223854</td>\n",
       "      <td>0.000597</td>\n",
       "      <td>592.998193</td>\n",
       "      <td>742.001184</td>\n",
       "      <td>855.996881</td>\n",
       "      <td>976.798755</td>\n",
       "      <td>1106.998474</td>\n",
       "      <td>1238.995532</td>\n",
       "      <td>...</td>\n",
       "      <td>6763.517046</td>\n",
       "      <td>8997.809000</td>\n",
       "      <td>0.035354</td>\n",
       "      <td>0.002757</td>\n",
       "      <td>0.001425</td>\n",
       "      <td>0.517025</td>\n",
       "      <td>1975</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>AGRICULTURE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>57998</th>\n",
       "      <td>41FB599E9B4816A8</td>\n",
       "      <td>2246888671</td>\n",
       "      <td>165177534</td>\n",
       "      <td>0.000760</td>\n",
       "      <td>641.000610</td>\n",
       "      <td>764.999939</td>\n",
       "      <td>875.999817</td>\n",
       "      <td>990.000061</td>\n",
       "      <td>1116.992004</td>\n",
       "      <td>1286.000854</td>\n",
       "      <td>...</td>\n",
       "      <td>7712.102151</td>\n",
       "      <td>958.381450</td>\n",
       "      <td>0.218652</td>\n",
       "      <td>0.008562</td>\n",
       "      <td>0.026645</td>\n",
       "      <td>3.111910</td>\n",
       "      <td>1966</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>AGRICULTURE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>61724</th>\n",
       "      <td>C339404268E66A71</td>\n",
       "      <td>2240645160</td>\n",
       "      <td>165170912</td>\n",
       "      <td>1.016050</td>\n",
       "      <td>656.998816</td>\n",
       "      <td>753.997913</td>\n",
       "      <td>834.000061</td>\n",
       "      <td>909.000635</td>\n",
       "      <td>985.000031</td>\n",
       "      <td>1068.000659</td>\n",
       "      <td>...</td>\n",
       "      <td>6227.741406</td>\n",
       "      <td>1566.221950</td>\n",
       "      <td>0.026735</td>\n",
       "      <td>0.003917</td>\n",
       "      <td>0.004358</td>\n",
       "      <td>1.112656</td>\n",
       "      <td>1966</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>AGRICULTURE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>67773</th>\n",
       "      <td>353645ED2FA18A</td>\n",
       "      <td>2233716870</td>\n",
       "      <td>165108956</td>\n",
       "      <td>0.000009</td>\n",
       "      <td>609.998492</td>\n",
       "      <td>778.999695</td>\n",
       "      <td>889.001544</td>\n",
       "      <td>976.000098</td>\n",
       "      <td>1068.000366</td>\n",
       "      <td>1169.998853</td>\n",
       "      <td>...</td>\n",
       "      <td>5208.317414</td>\n",
       "      <td>103410.248537</td>\n",
       "      <td>0.487248</td>\n",
       "      <td>0.002164</td>\n",
       "      <td>0.002177</td>\n",
       "      <td>1.006096</td>\n",
       "      <td>1950</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>AGRICULTURE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>69253</th>\n",
       "      <td>B4A58FDBD97DA74B</td>\n",
       "      <td>2255636575</td>\n",
       "      <td>165095665</td>\n",
       "      <td>0.000004</td>\n",
       "      <td>437.000958</td>\n",
       "      <td>597.003247</td>\n",
       "      <td>711.998651</td>\n",
       "      <td>806.999329</td>\n",
       "      <td>910.999084</td>\n",
       "      <td>1039.000195</td>\n",
       "      <td>...</td>\n",
       "      <td>5922.090811</td>\n",
       "      <td>1083.745180</td>\n",
       "      <td>0.152886</td>\n",
       "      <td>0.008717</td>\n",
       "      <td>0.016184</td>\n",
       "      <td>1.856596</td>\n",
       "      <td>1975</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>AGRICULTURE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>71932</th>\n",
       "      <td>99C000CA552F2F1A</td>\n",
       "      <td>2246109269</td>\n",
       "      <td>165175274</td>\n",
       "      <td>0.000760</td>\n",
       "      <td>641.000610</td>\n",
       "      <td>764.999939</td>\n",
       "      <td>875.999817</td>\n",
       "      <td>990.000061</td>\n",
       "      <td>1116.992004</td>\n",
       "      <td>1286.000854</td>\n",
       "      <td>...</td>\n",
       "      <td>7712.102151</td>\n",
       "      <td>719.815650</td>\n",
       "      <td>0.299387</td>\n",
       "      <td>0.015946</td>\n",
       "      <td>0.026082</td>\n",
       "      <td>1.635629</td>\n",
       "      <td>1966</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>AGRICULTURE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>76837</th>\n",
       "      <td>2CC4B745CE79E7C7</td>\n",
       "      <td>2238737866</td>\n",
       "      <td>165233240</td>\n",
       "      <td>0.003241</td>\n",
       "      <td>732.000824</td>\n",
       "      <td>846.999390</td>\n",
       "      <td>929.000122</td>\n",
       "      <td>1006.999573</td>\n",
       "      <td>1091.998230</td>\n",
       "      <td>1190.000000</td>\n",
       "      <td>...</td>\n",
       "      <td>6525.757126</td>\n",
       "      <td>265.335000</td>\n",
       "      <td>0.453691</td>\n",
       "      <td>0.046970</td>\n",
       "      <td>0.036403</td>\n",
       "      <td>0.775027</td>\n",
       "      <td>1966</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>INDUSTRIAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>78351</th>\n",
       "      <td>D715EFB7AB240B96</td>\n",
       "      <td>2257571528</td>\n",
       "      <td>165116729</td>\n",
       "      <td>0.000004</td>\n",
       "      <td>437.000958</td>\n",
       "      <td>597.003247</td>\n",
       "      <td>711.998651</td>\n",
       "      <td>806.999329</td>\n",
       "      <td>910.999084</td>\n",
       "      <td>1039.000195</td>\n",
       "      <td>...</td>\n",
       "      <td>5922.090811</td>\n",
       "      <td>50.010750</td>\n",
       "      <td>0.532060</td>\n",
       "      <td>0.118624</td>\n",
       "      <td>0.089686</td>\n",
       "      <td>0.756054</td>\n",
       "      <td>1982</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>AGRICULTURE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>78891</th>\n",
       "      <td>BE7A8EF34949F941</td>\n",
       "      <td>2256124126</td>\n",
       "      <td>165224223</td>\n",
       "      <td>0.000597</td>\n",
       "      <td>592.998193</td>\n",
       "      <td>742.001184</td>\n",
       "      <td>855.996881</td>\n",
       "      <td>976.798755</td>\n",
       "      <td>1106.998474</td>\n",
       "      <td>1238.995532</td>\n",
       "      <td>...</td>\n",
       "      <td>6763.517046</td>\n",
       "      <td>32376.156200</td>\n",
       "      <td>0.127731</td>\n",
       "      <td>0.002600</td>\n",
       "      <td>0.001517</td>\n",
       "      <td>0.583445</td>\n",
       "      <td>1975</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>INDUSTRIAL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>102247</th>\n",
       "      <td>3E0790BED7BFB548</td>\n",
       "      <td>2253919302</td>\n",
       "      <td>165257556</td>\n",
       "      <td>0.000597</td>\n",
       "      <td>592.998193</td>\n",
       "      <td>742.001184</td>\n",
       "      <td>855.996881</td>\n",
       "      <td>976.798755</td>\n",
       "      <td>1106.998474</td>\n",
       "      <td>1238.995532</td>\n",
       "      <td>...</td>\n",
       "      <td>6763.517046</td>\n",
       "      <td>224.965000</td>\n",
       "      <td>0.500545</td>\n",
       "      <td>0.047170</td>\n",
       "      <td>0.047170</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>1975</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>AGRICULTURE</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>20 rows × 56 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                      ID           X          Y  Q_R_4_0_0   Q_R_4_0_1  \\\n",
       "9864    B7DE3FE20084F9FA  2254413625  165244276   0.000597  592.998193   \n",
       "10145   5D08956CDC0B7C37  2250193143  165232359   0.000000  648.000018   \n",
       "12273   20D3200047F4D73A  2254610358  165241603   0.000597  592.998193   \n",
       "13089   82489ECC7BDFB0B0  2250087048  165252257   0.000000  648.000018   \n",
       "16330   6447D96932B64C3F  2250800402  165234583   0.000000  648.000018   \n",
       "23184   8BF6E2CB5B152739  2248534716  165225185   0.000000  648.000018   \n",
       "34988   621448B2B12E3B3E  2233865202  165097257   0.000009  609.998492   \n",
       "38537   042ABAFAE9B5BDB9  2246045656  165214428   0.000000  648.000018   \n",
       "43448   55B7201B5219C83B  2260254994  165132637   0.000004  437.000958   \n",
       "48059   51DCB5C9945A826E  2239496952  165148413   0.000006  493.999994   \n",
       "55054   D9A6B8B330C11143  2253924221  165223854   0.000597  592.998193   \n",
       "57998   41FB599E9B4816A8  2246888671  165177534   0.000760  641.000610   \n",
       "61724   C339404268E66A71  2240645160  165170912   1.016050  656.998816   \n",
       "67773     353645ED2FA18A  2233716870  165108956   0.000009  609.998492   \n",
       "69253   B4A58FDBD97DA74B  2255636575  165095665   0.000004  437.000958   \n",
       "71932   99C000CA552F2F1A  2246109269  165175274   0.000760  641.000610   \n",
       "76837   2CC4B745CE79E7C7  2238737866  165233240   0.003241  732.000824   \n",
       "78351   D715EFB7AB240B96  2257571528  165116729   0.000004  437.000958   \n",
       "78891   BE7A8EF34949F941  2256124126  165224223   0.000597  592.998193   \n",
       "102247  3E0790BED7BFB548  2253919302  165257556   0.000597  592.998193   \n",
       "\n",
       "         Q_R_4_0_2   Q_R_4_0_3    Q_R_4_0_4    Q_R_4_0_5    Q_R_4_0_6  ...  \\\n",
       "9864    742.001184  855.996881   976.798755  1106.998474  1238.995532  ...   \n",
       "10145   788.999866  894.999255   987.001318  1079.999817  1184.999121  ...   \n",
       "12273   742.001184  855.996881   976.798755  1106.998474  1238.995532  ...   \n",
       "13089   788.999866  894.999255   987.001318  1079.999817  1184.999121  ...   \n",
       "16330   788.999866  894.999255   987.001318  1079.999817  1184.999121  ...   \n",
       "23184   788.999866  894.999255   987.001318  1079.999817  1184.999121  ...   \n",
       "34988   778.999695  889.001544   976.000098  1068.000366  1169.998853  ...   \n",
       "38537   788.999866  894.999255   987.001318  1079.999817  1184.999121  ...   \n",
       "43448   597.003247  711.998651   806.999329   910.999084  1039.000195  ...   \n",
       "48059   610.000061  687.999243   754.999768   824.999542   912.000513  ...   \n",
       "55054   742.001184  855.996881   976.798755  1106.998474  1238.995532  ...   \n",
       "57998   764.999939  875.999817   990.000061  1116.992004  1286.000854  ...   \n",
       "61724   753.997913  834.000061   909.000635   985.000031  1068.000659  ...   \n",
       "67773   778.999695  889.001544   976.000098  1068.000366  1169.998853  ...   \n",
       "69253   597.003247  711.998651   806.999329   910.999084  1039.000195  ...   \n",
       "71932   764.999939  875.999817   990.000061  1116.992004  1286.000854  ...   \n",
       "76837   846.999390  929.000122  1006.999573  1091.998230  1190.000000  ...   \n",
       "78351   597.003247  711.998651   806.999329   910.999084  1039.000195  ...   \n",
       "78891   742.001184  855.996881   976.798755  1106.998474  1238.995532  ...   \n",
       "102247  742.001184  855.996881   976.798755  1106.998474  1238.995532  ...   \n",
       "\n",
       "        Q_NIR_8_1_0           AREA   GEOM_R1   GEOM_R2   GEOM_R3   GEOM_R4  \\\n",
       "9864    6763.517046    2120.276750  0.465508  0.015959  0.013757  0.862017   \n",
       "10145   6084.405066    1999.778850  0.531552  0.016810  0.015813  0.940702   \n",
       "12273   6763.517046     723.268350  0.563042  0.036284  0.021455  0.591289   \n",
       "13089   6084.405066    1829.160728  0.153173  0.009619  0.008705  0.905010   \n",
       "16330   6084.405066     249.497550  0.361907  0.040209  0.036075  0.897186   \n",
       "23184   6084.405066     159.968400  0.294582  0.042373  0.043459  1.025641   \n",
       "34988   5208.317414     710.658165  0.115690  0.014473  0.011248  0.777191   \n",
       "38537   6084.405066    4112.808185  0.028464  0.003521  0.001966  0.558325   \n",
       "43448   5922.090811      47.266733  0.043968  0.031348  0.029674  0.946588   \n",
       "48059   5270.232234      88.353700  0.469356  0.068634  0.077399  1.127709   \n",
       "55054   6763.517046    8997.809000  0.035354  0.002757  0.001425  0.517025   \n",
       "57998   7712.102151     958.381450  0.218652  0.008562  0.026645  3.111910   \n",
       "61724   6227.741406    1566.221950  0.026735  0.003917  0.004358  1.112656   \n",
       "67773   5208.317414  103410.248537  0.487248  0.002164  0.002177  1.006096   \n",
       "69253   5922.090811    1083.745180  0.152886  0.008717  0.016184  1.856596   \n",
       "71932   7712.102151     719.815650  0.299387  0.015946  0.026082  1.635629   \n",
       "76837   6525.757126     265.335000  0.453691  0.046970  0.036403  0.775027   \n",
       "78351   5922.090811      50.010750  0.532060  0.118624  0.089686  0.756054   \n",
       "78891   6763.517046   32376.156200  0.127731  0.002600  0.001517  0.583445   \n",
       "102247  6763.517046     224.965000  0.500545  0.047170  0.047170  1.000000   \n",
       "\n",
       "        CONTRUCTIONYEAR  MAXBUILDINGFLOOR  CADASTRALQUALITYID        CLASE  \n",
       "9864               1975               NaN                 NaN   INDUSTRIAL  \n",
       "10145              1975               NaN                 NaN  AGRICULTURE  \n",
       "12273              1975               NaN                 NaN  AGRICULTURE  \n",
       "13089              1975               NaN                 NaN       RETAIL  \n",
       "16330              1975               NaN                 NaN  AGRICULTURE  \n",
       "23184              1975               NaN                 NaN  AGRICULTURE  \n",
       "34988              1950               NaN                 NaN  AGRICULTURE  \n",
       "38537              1966               NaN                 NaN   INDUSTRIAL  \n",
       "43448              1982               NaN                 NaN  AGRICULTURE  \n",
       "48059              1957               NaN                 NaN  AGRICULTURE  \n",
       "55054              1975               NaN                 NaN  AGRICULTURE  \n",
       "57998              1966               NaN                 NaN  AGRICULTURE  \n",
       "61724              1966               NaN                 NaN  AGRICULTURE  \n",
       "67773              1950               NaN                 NaN  AGRICULTURE  \n",
       "69253              1975               NaN                 NaN  AGRICULTURE  \n",
       "71932              1966               NaN                 NaN  AGRICULTURE  \n",
       "76837              1966               NaN                 NaN   INDUSTRIAL  \n",
       "78351              1982               NaN                 NaN  AGRICULTURE  \n",
       "78891              1975               NaN                 NaN   INDUSTRIAL  \n",
       "102247             1975               NaN                 NaN  AGRICULTURE  \n",
       "\n",
       "[20 rows x 56 columns]"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Xy_train[Xy_train.isna().any(axis=1)]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Se observa como si una de las dos variables es nula la otra también, \n",
    "por lo que aunque el número de valores nulos en el dataframe es de 40,\n",
    "el número de observaciones con algún valor nulo es de 20.\n",
    "\n",
    "La mayoría de estas observaciones pertenecen a la Clase AGRICULTURA,\n",
    "la cual es de la que menos observaciones se tiene."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "4      24621\n",
       "6      24528\n",
       "5      19473\n",
       "7      13799\n",
       "3      10209\n",
       "8       5547\n",
       "2       2980\n",
       "9       1105\n",
       "1        652\n",
       "C        216\n",
       "B         43\n",
       "A         37\n",
       "NaN       20\n",
       "Name: CADASTRALQUALITYID, dtype: int64"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "X_train['CADASTRALQUALITYID'].value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1.0     34548\n",
       "5.0     16296\n",
       "4.0     14683\n",
       "3.0      8787\n",
       "6.0      7130\n",
       "7.0      5341\n",
       "2.0      3923\n",
       "8.0      3586\n",
       "0.0      2628\n",
       "9.0      1787\n",
       "10.0     1370\n",
       "12.0      795\n",
       "11.0      706\n",
       "13.0      635\n",
       "14.0      474\n",
       "15.0      175\n",
       "16.0      128\n",
       "17.0       86\n",
       "21.0       49\n",
       "22.0       21\n",
       "18.0       20\n",
       "NaN        20\n",
       "25.0       16\n",
       "23.0       16\n",
       "19.0        6\n",
       "24.0        3\n",
       "20.0        1\n",
       "Name: MAXBUILDINGFLOOR, dtype: int64"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "X_train['MAXBUILDINGFLOOR'].value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Test Data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "X INPUT\n",
      "Número de observaciones =  5618\n",
      "Número de variables =  55\n",
      "Count total Nulls =  14\n",
      "% Observaciones con Nulls = \n",
      " 0.009789960840156639\n",
      "Count Nulls by columns =  ID                    0\n",
      "X                     0\n",
      "Y                     0\n",
      "Q_R_4_0_0             0\n",
      "Q_R_4_0_1             0\n",
      "Q_R_4_0_2             0\n",
      "Q_R_4_0_3             0\n",
      "Q_R_4_0_4             0\n",
      "Q_R_4_0_5             0\n",
      "Q_R_4_0_6             0\n",
      "Q_R_4_0_7             0\n",
      "Q_R_4_0_8             0\n",
      "Q_R_4_0_9             0\n",
      "Q_R_4_1_0             0\n",
      "Q_G_3_0_0             0\n",
      "Q_G_3_0_1             0\n",
      "Q_G_3_0_2             0\n",
      "Q_G_3_0_3             0\n",
      "Q_G_3_0_4             0\n",
      "Q_G_3_0_5             0\n",
      "Q_G_3_0_6             0\n",
      "Q_G_3_0_7             0\n",
      "Q_G_3_0_8             0\n",
      "Q_G_3_0_9             0\n",
      "Q_G_3_1_0             0\n",
      "Q_B_2_0_0             0\n",
      "Q_B_2_0_1             0\n",
      "Q_B_2_0_2             0\n",
      "Q_B_2_0_3             0\n",
      "Q_B_2_0_4             0\n",
      "Q_B_2_0_5             0\n",
      "Q_B_2_0_6             0\n",
      "Q_B_2_0_7             0\n",
      "Q_B_2_0_8             0\n",
      "Q_B_2_0_9             0\n",
      "Q_B_2_1_0             0\n",
      "Q_NIR_8_0_0           0\n",
      "Q_NIR_8_0_1           0\n",
      "Q_NIR_8_0_2           0\n",
      "Q_NIR_8_0_3           0\n",
      "Q_NIR_8_0_4           0\n",
      "Q_NIR_8_0_5           0\n",
      "Q_NIR_8_0_6           0\n",
      "Q_NIR_8_0_7           0\n",
      "Q_NIR_8_0_8           0\n",
      "Q_NIR_8_0_9           0\n",
      "Q_NIR_8_1_0           0\n",
      "AREA                  0\n",
      "GEOM_R1               0\n",
      "GEOM_R2               0\n",
      "GEOM_R3               0\n",
      "GEOM_R4               0\n",
      "CONTRUCTIONYEAR       0\n",
      "MAXBUILDINGFLOOR      7\n",
      "CADASTRALQUALITYID    7\n",
      "dtype: int64\n"
     ]
    }
   ],
   "source": [
    "print('X INPUT')\n",
    "print('Número de observaciones = ', X_test.shape[0])\n",
    "print('Número de variables = ', X_test.shape[1])\n",
    "print('Count total Nulls = ',X_test.isnull().sum().sum())\n",
    "print('% Observaciones con Nulls = \\n', sum(map(any, X_test.isnull()))/X_test.shape[0])\n",
    "print('Count Nulls by columns = ',X_test.isnull().sum())"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "La cantidad de valores nulos en el train set y en el test set es ínfima, serán  estudiados y imputados en un próximo notebook"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Store data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "lib.storeHDF5(X_train=X_train,y_train=y_train,X_test=X_test,path=store_path_hdf5)\n",
    "lib.storeCSV(X_train=X_train,y_train=y_train,X_test=X_test,path=store_path_csv)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.6"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}