This Node JS command line application takes a CSV set of sales data and restructures it to fit a normalized database that I designed based on the data. The normalized data can be saved either as a CSV, SQL, or JSON file for each corresponding table.
After downloading this project, open a terminal inside the root folder and run npm install. Execute node convert <output-type> to run the program. The normalized data files are saved in the 'output-files' folder.
Supported output types:
| Output Type | Description |
|---|---|
| csv | CSV files that can be used in a spreadsheet. |
| sql | SQL files that can be used with the database schema |
| array | JSON files as a multi-dimensional array. Does not include column names. |
| object | JSON files as an array of objects. Includes column names as properties. |
This project also contains a fully functional database schema based on the normalized design. There is an option to output normalized data as SQL files that insert data for the corresponding table.
- Start a MySQL instance of your choice and run
schema.sql. - In the project folder, run
node convert sqlto normalize the data and output as SQL files. - In your MySQL instance, run the SQL files in the 'output-files' folder. Each SQL file corresponds to a table and should be executed in order of table definition. If you insert the table data out of order, you might get an error.
The original data set was licensed under CC BY-NC-SA 3.0. Therefore, I have decided to use the same for this project.