Skip to content

Latest commit

 

History

History
38 lines (28 loc) · 1.62 KB

README.md

File metadata and controls

38 lines (28 loc) · 1.62 KB
Raw

opis-scraper-manager-2020

This project aims to scrape data from the new constantly changing opis web site, in order to provide data to the opis manager.
At the time of development I was trying to learn Node.js, hence the project is fully written in that language.
DISCLAIMER: I've just started learning js, so you might cringe yourself seeing how badly things might have been implemented. If you want to help feel free to do so!

I've tried to stick as much as possible to the previous scraper.

Start a local instance

Requirements

If you want to run the project using docker (a docker-compose is provided) make sure you have installed:

  1. docker
  2. docker-compose

Otherwise, if you prefer to run the project directly in "your machine" make sure you have:

  1. Node.js
  2. npm or any of the available package managers
  3. MySQL
  4. Created a database with the name 'opis_manager'

Steps

  1. Clone the repo
  2. Rename config.js.dist into congifg.js and fill with your credentials
  3. Type the following in your shell: npm run dev

Create the db

$ mysql -u username -p
> CREATE DATABASE opis_manager;
> source /path/to/opis_manager.sql;
> exit;

License

This open-source software is published under the GNU General Public License (GNU GPL) version 3. Please refer to the "LICENSE" file of this project for the full text.