Skip to content

Rahyudiy/python-bd-to-sql-import

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

7 Commits
Β 
Β 
Β 
Β 

Repository files navigation

πŸ“‚ Big Data CSV Import to MySQL

This project was created to complete a college task on handling big data by importing a large CSV file into a MySQL database using Python. πŸš€


πŸ“Œ Project Overview

  • Goal: Import a large CSV dataset into MySQL.
  • Dataset Used: Sign Language MNIST (hand gesture images in CSV format).
  • Tools & Libraries:
    • Python 🐍
    • Pandas πŸ“Š
    • SQLAlchemy ⚑
    • PyMySQL πŸ—„οΈ
    • MySQL (via Laragon)

βš™οΈ How It Works

  1. Load CSV file using Pandas.
  2. Process & clean data (e.g., encoding issues with UTF-8).
  3. Connect to MySQL using SQLAlchemy + PyMySQL.
  4. Import into database table (table-data or custom table on your databases) with df.to_sql().

πŸ“œ Installation

Clone the repo:

git clone https://github.com/your-username/your-repo.git
cd your-repo

## Install dependencies:
py -m pip install pandas sqlalchemy pymysql

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages