Skip to content

Code for importing data and working with various file types in Python.

Notifications You must be signed in to change notification settings

elena-e-barbulescu/Importing-Data

Repository files navigation

Importing Data

1_Importing-Data-from-Internet

  • urlretrieve()
  • HTTP requests to import files from web
  • urlib library
  • requests package
    • Optional Parameters/Results/Just getting the data (not metadata)
    • Case example using Yelp request

2_Scraping-the-Web-in-Python

  • BeautifulSoup package
  • Prettified Soup
  • Exploring Associated Methods

3_APIs-and-JSONs

  • APIs
  • JSONs
  • keys
  • values
  • loading JSON from local directory
  • connecting to an API
  • URL request for API connection
  • Working with Nested JSONs

4_Importing-Flat-Files

  • what are flat files?
  • loading flat files with separators
  • limiting data by columns and rows
  • assigning column names
  • handling errors or missing data
    • treating certain values as missing
    • handing line errors in parsing

5_Importing-Excel-Spreadsheets

  • selecting columns and rows
  • getting data from multiple worksheets
  • using a loop to get data from excel worksheets
  • modifying imports with booleans

6_Importing-and-Parsing-with-Dates

  • Date and Time Data
  • How parse_dates functions
  • non-standard dates

7_Importing-Data-from-Databases

  • Relational Databases
  • Types of Common Relational Databases
  • SQLite
  • Connecting to Databases
  • SQLAlchemy
    • create_engine()
    • read_sql()
    • Building multi line queries
  • SQL and Pandas to perform query from database

About

Code for importing data and working with various file types in Python.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published