Skip to content

aciobanu/docker-scrapy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Scrapy

An open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way.

See scrapy official page and the official documentation for more details.

Usage

For a list of scrapy commands, simply run:

$ docker run -v $(pwd):/runtime/app aciobanu/scrapy

Since the container doesn't provide any persistence, we can use the volumes (-v) directive to share the current folder with the container.

To start a new project

$ docker run -v $(pwd):/runtime/app aciobanu/scrapy startproject tutorial

This will create a new tutorial folder in your current path.

To work on the scrapy project:

$ cd tutorial
$ docker run -v $(pwd):/runtime/app aciobanu/scrapy

Continue reading the official tutorial for a more in depth usage manual of scrapy. For more details about Docker and usage options, please see the official documentation page.