scrape-master

added:

• poetry
• devcontainer
• selenium grid

Usage

configure .env file:

cp .env.sample .env

start selenium grid:
doc

docker run --rm -d -p 4444:4444 -p 7900:7900 --shm-size="2g" selenium/standalone-chrome:latest

start the scraper:

make

optional:

see the browser working: http://localhost:7900/?autoconnect=1&resize=scale&password=secret see the grid console: http://localhost:4444/ui/#

About

This project is based/forked from scrape-master