Pandas/3-Read-CSV-Features.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "f6dd2b10",
   "metadata": {},
   "source": [
    "# Daily-Dose-of-Data-Science\n",
    "\n",
    "[Daily Dose of Data Science](https://avichawla.substack.com) is a publication on Substack that brings together intriguing frameworks, libraries, technologies, and tips that make the life cycle of a Data Science project effortless. \n",
    "\n",
    "Author: Avi Chawla\n",
    "\n",
    "[Medium](https://medium.com/@avi_chawla) | [LinkedIn](https://www.linkedin.com/in/avi-chawla/)\n",
    "\n",
    "# Three Lesser-known Tips For Reading a CSV File Using Pandas\n",
    "\n",
    "Post Link: [Substack](https://avichawla.substack.com/p/three-lesser-known-tips-for-reading)\n",
    "\n",
    "LinkedIn Post: [LinkedIn](https://www.linkedin.com/posts/avi-chawla_python-datascience-pandas-activity-7008745715367571456-e8oc?utm_source=share&utm_medium=member_desktop)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "d07b44e4",
   "metadata": {
    "ExecuteTime": {
     "end_time": "2022-12-14T11:12:24.590851Z",
     "start_time": "2022-12-14T11:12:23.183607Z"
    }
   },
   "outputs": [],
   "source": [
    "import pandas as pd"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "23f6d4e2",
   "metadata": {
    "ExecuteTime": {
     "end_time": "2022-12-14T11:12:50.858042Z",
     "start_time": "2022-12-14T11:12:50.804534Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(1000, 9)"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = pd.read_csv(\"../_Datasets/employee_dataset.csv\")\n",
    "df.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "23c4ba4d",
   "metadata": {},
   "source": [
    "## Read first 10 rows"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "id": "d6d4d55a",
   "metadata": {
    "ExecuteTime": {
     "end_time": "2022-12-14T11:13:11.755485Z",
     "start_time": "2022-12-14T11:13:11.722736Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(10, 9)"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = pd.read_csv(\"../_Datasets/employee_dataset.csv\", nrows = 10)\n",
    "df.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "id": "56fcdc73",
   "metadata": {
    "ExecuteTime": {
     "end_time": "2022-12-14T11:13:41.043929Z",
     "start_time": "2022-12-14T11:13:41.008454Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Name</th>\n",
       "      <th>Company_Name</th>\n",
       "      <th>Employee_Job_Title</th>\n",
       "      <th>Employee_City</th>\n",
       "      <th>Employee_Country</th>\n",
       "      <th>Employee_Salary</th>\n",
       "      <th>Employment_Status</th>\n",
       "      <th>Employee_Rating</th>\n",
       "      <th>Credits</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Johnny Maynard</td>\n",
       "      <td>White, Mcclain and Cobb</td>\n",
       "      <td>Equities trader</td>\n",
       "      <td>New Cindychester</td>\n",
       "      <td>Mongolia</td>\n",
       "      <td>764340</td>\n",
       "      <td>Full Time</td>\n",
       "      <td>3.3</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Michael Williams</td>\n",
       "      <td>Scott Inc</td>\n",
       "      <td>Patent examiner</td>\n",
       "      <td>Ricardomouth</td>\n",
       "      <td>Guinea-Bissau</td>\n",
       "      <td>929230</td>\n",
       "      <td>Full Time</td>\n",
       "      <td>4.6</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Laura Flynn</td>\n",
       "      <td>Andrade LLC</td>\n",
       "      <td>Equities trader</td>\n",
       "      <td>North Melissafurt</td>\n",
       "      <td>Tonga</td>\n",
       "      <td>606900</td>\n",
       "      <td>Intern</td>\n",
       "      <td>0.3</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Stefanie Archer</td>\n",
       "      <td>James and Sons</td>\n",
       "      <td>Retail merchandiser</td>\n",
       "      <td>Ricardomouth</td>\n",
       "      <td>San Marino</td>\n",
       "      <td>775380</td>\n",
       "      <td>Full Time</td>\n",
       "      <td>2.8</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Sierra Garcia</td>\n",
       "      <td>Matthews Inc</td>\n",
       "      <td>Armed forces logistics/support/administrative ...</td>\n",
       "      <td>Whitakerbury</td>\n",
       "      <td>Nepal</td>\n",
       "      <td>944480</td>\n",
       "      <td>Full Time</td>\n",
       "      <td>4.5</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Donna Miller</td>\n",
       "      <td>Andrade LLC</td>\n",
       "      <td>Garment/textile technologist</td>\n",
       "      <td>West Jamesview</td>\n",
       "      <td>Tonga</td>\n",
       "      <td>428090</td>\n",
       "      <td>Intern</td>\n",
       "      <td>1.1</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Linda Rodriguez</td>\n",
       "      <td>Marshall-Holloway</td>\n",
       "      <td>Optometrist</td>\n",
       "      <td>Whitakerbury</td>\n",
       "      <td>Portugal</td>\n",
       "      <td>645690</td>\n",
       "      <td>Full Time</td>\n",
       "      <td>4.7</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Jonathan Gibson</td>\n",
       "      <td>Scott Inc</td>\n",
       "      <td>Naval architect</td>\n",
       "      <td>Whiteside</td>\n",
       "      <td>Libyan Arab Jamahiriya</td>\n",
       "      <td>483210</td>\n",
       "      <td>Intern</td>\n",
       "      <td>3.4</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Karl Henry</td>\n",
       "      <td>Campos, Reynolds and Mccormick</td>\n",
       "      <td>Radiographer, therapeutic</td>\n",
       "      <td>Whiteside</td>\n",
       "      <td>Kyrgyz Republic</td>\n",
       "      <td>586480</td>\n",
       "      <td>Full Time</td>\n",
       "      <td>3.7</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Katherine Sims</td>\n",
       "      <td>Baker, Allen and Edwards</td>\n",
       "      <td>Regulatory affairs officer</td>\n",
       "      <td>Kristaburgh</td>\n",
       "      <td>Haiti</td>\n",
       "      <td>712320</td>\n",
       "      <td>Full Time</td>\n",
       "      <td>3.0</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "               Name                    Company_Name  \\\n",
       "0    Johnny Maynard         White, Mcclain and Cobb   \n",
       "1  Michael Williams                       Scott Inc   \n",
       "2       Laura Flynn                     Andrade LLC   \n",
       "3   Stefanie Archer                  James and Sons   \n",
       "4     Sierra Garcia                    Matthews Inc   \n",
       "5      Donna Miller                     Andrade LLC   \n",
       "6   Linda Rodriguez               Marshall-Holloway   \n",
       "7   Jonathan Gibson                       Scott Inc   \n",
       "8        Karl Henry  Campos, Reynolds and Mccormick   \n",
       "9    Katherine Sims        Baker, Allen and Edwards   \n",
       "\n",
       "                                  Employee_Job_Title      Employee_City  \\\n",
       "0                                    Equities trader   New Cindychester   \n",
       "1                                    Patent examiner       Ricardomouth   \n",
       "2                                    Equities trader  North Melissafurt   \n",
       "3                                Retail merchandiser       Ricardomouth   \n",
       "4  Armed forces logistics/support/administrative ...       Whitakerbury   \n",
       "5                       Garment/textile technologist     West Jamesview   \n",
       "6                                        Optometrist       Whitakerbury   \n",
       "7                                    Naval architect          Whiteside   \n",
       "8                          Radiographer, therapeutic          Whiteside   \n",
       "9                         Regulatory affairs officer        Kristaburgh   \n",
       "\n",
       "         Employee_Country  Employee_Salary Employment_Status  Employee_Rating  \\\n",
       "0                Mongolia           764340         Full Time              3.3   \n",
       "1           Guinea-Bissau           929230         Full Time              4.6   \n",
       "2                   Tonga           606900            Intern              0.3   \n",
       "3              San Marino           775380         Full Time              2.8   \n",
       "4                   Nepal           944480         Full Time              4.5   \n",
       "5                   Tonga           428090            Intern              1.1   \n",
       "6                Portugal           645690         Full Time              4.7   \n",
       "7  Libyan Arab Jamahiriya           483210            Intern              3.4   \n",
       "8         Kyrgyz Republic           586480         Full Time              3.7   \n",
       "9                   Haiti           712320         Full Time              3.0   \n",
       "\n",
       "   Credits  \n",
       "0        1  \n",
       "1        4  \n",
       "2        3  \n",
       "3        5  \n",
       "4        4  \n",
       "5        4  \n",
       "6        5  \n",
       "7        1  \n",
       "8        2  \n",
       "9        2  "
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "633ed278",
   "metadata": {},
   "source": [
    "## Read few columns"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "id": "b199dd6d",
   "metadata": {
    "ExecuteTime": {
     "end_time": "2022-12-14T11:13:47.854332Z",
     "start_time": "2022-12-14T11:13:47.806595Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(1000, 2)"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = pd.read_csv(\"../_Datasets/employee_dataset.csv\", usecols = [\"Name\", \"Employee_Rating\"])\n",
    "df.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "769db9e3",
   "metadata": {},
   "source": [
    "## Skip first 5 rows"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "id": "ca482fe5",
   "metadata": {
    "ExecuteTime": {
     "end_time": "2022-12-14T11:13:58.268122Z",
     "start_time": "2022-12-14T11:13:58.249338Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(995, 9)"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = pd.read_csv(\"../_Datasets/employee_dataset.csv\", skiprows = 5)\n",
    "df.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "f92d0f91",
   "metadata": {},
   "source": [
    "## Skip 1st and 5th rows"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "id": "31ac7c1f",
   "metadata": {
    "ExecuteTime": {
     "end_time": "2022-12-14T11:14:25.602058Z",
     "start_time": "2022-12-14T11:14:25.570250Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(998, 9)"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = pd.read_csv(\"../_Datasets/employee_dataset.csv\", skiprows = [1,5])\n",
    "df.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "8b9f8a15",
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.9.12"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}