PROG8245 Lab2 – Data Collection and Pre-processing

Project Synopsis

This is a data collection and pre-processing exercise. Our project is based on two synthetic data files. Using the widely adopted and powerful NumPy and pandas technology stack, we perform data loading, cleaning, and aggregation on these datasets.

Group Info

Group: Group1

GitHub Link: https://github.com/chence/DataCollectionPreProcessing.git

Team Members:

• Ce Chen | 9007166
• Zhuoran Zhang | 9048508

Quick-start

$ python -m venv .venv
$ source .venv/bin/activate
(.venv)$ pip install -r requirements.txt

Export PDF

(.venv)$ quarto render lab2.ipynb --to pdf --execute

Data-source attribution links

Since the customer_id field was not found in the provided download link, the data file used in this project was synthesized using ChatGPT.

List of other projects already in your GitHub (max 3 bullet points; link only).

• https://github.com/chence/TestRepo.git
• https://github.com/chence/TestOOP.git
• https://github.com/chence/DataStreamVisualization_workshop.git