Skip to content

Migrates hundreds of Excel files with the same format to SQL using Python

Notifications You must be signed in to change notification settings

ErikaJacobs/Excel-Python-SQL-Migration

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Data From Hundreds of Excel Files to SQL Server

This project features the migration of hundreds of Excel files with a similar format to SQL using Python. This code also features a conversion loop to remove macros from all Excel files being migrated using VBA code, and saving a new copy of these files.

Methods Used

  • ETL

Technologies Used

  • Python
  • Spyder
  • SQL Server

Environment

  • win32com
  • glob
  • os
  • sys
  • datetime
  • numpy - 1.16.5
  • pandas - 0.25.1
  • sqlalchemy - 1.3.9

Featured Scripts or Deliverables

Other Repository Contents

  • Modules

    • convert_import.py
      • Checks if any files need to be converted/uploaded
      • Removes macros from Excel files and saves new converted copy
      • Imports Excel files to Python
      • Basic data cleansing in Python
    • main.py - Organizes execution of all modules
    • sql.py
      • Exports data from Python to SQL Server
      • Runs code to clean data in SQL Server
      • Runs code to create final tables in SQL
    • warning.py - Creates warning message for importing all directory Excel files
  • SQL Files

About

Migrates hundreds of Excel files with the same format to SQL using Python

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published