From webscrapping to inserting the data in SQLite, using python. There's only one code per card, parallel rare were excluded because they have the same features and code to their original card (no parallel rare).
The code is designed to webscrape even the newest decks, it doesn't matter the date of the update, if the deck is in the page, it will get it.
The data were taken from the official website of Digimon Card Game
Code:
- 1_Getting_data.py: To webscrap and get a clean dataset for all the decks.
- 2_Database_creation.py: To create the database and the tables in SQLite
- 3_Data_insertion.py: To insert the data from the dataset created in 1_Getting_data.py into the database created in 2_Database_creation.py