- Python 3.9.6,
- Scrapy - For crawl data
- jsonschema - To validate the data before writing the database
- Sqlite3 - To write collected data to the database
- Download the project folder,
- Open Terminal and cd to project folder,
- Type "scrapy crawl gplay" and press Enter,
PS: "requirements.txt" have to install every package I used in the project. If it's not installed, please don't forget to check and install all missing packages.
Scrapy
The quick way:
pip install scrapy
See the install section in the documentation at https://docs.scrapy.org/en/latest/intro/install.html for more details.
jsonschema
The quick way:
pip install jsonschema
See the install section in the documentation at https://python-jsonschema.readthedocs.io/en/stable/ for more details.