This project was created to complete a college task on handling big data by importing a large CSV file into a MySQL database using Python. π
- Goal: Import a large CSV dataset into MySQL.
- Dataset Used: Sign Language MNIST (hand gesture images in CSV format).
- Tools & Libraries:
- Python π
- Pandas π
- SQLAlchemy β‘
- PyMySQL ποΈ
- MySQL (via Laragon)
- Load CSV file using Pandas.
- Process & clean data (e.g., encoding issues with UTF-8).
- Connect to MySQL using SQLAlchemy + PyMySQL.
- Import into database table (
table-data or custom table on your databases
) withdf.to_sql()
.
Clone the repo:
git clone https://github.com/your-username/your-repo.git
cd your-repo
## Install dependencies:
py -m pip install pandas sqlalchemy pymysql