Loading…

scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

Updated

scrapyd

A service daemon to run Scrapy spiders

Updated

Python 26 13

scrapyd-client

Command line client for Scrapyd server

Updated

scrapy.org

Source code for Scrapy website

Updated

Python 47 22

queuelib

Collection of persistent (disk-based) queues

Updated

Python 16 4

parsel

Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

Updated

Python 90 28

loginform

Fill HTML login forms automatically

Updated

Python 138 34

w3lib

Python library of web-related functions

Updated

scrapely

A pure-python HTML screen-scraping library

Updated

dirbot

Scrapy project to scrape public web directories (educational)

Updated

slybot

Updated

Shell 2 0

gsoc2014-integration-tests

GSoC2014 - Scrapy Integration tests project

Updated